2024-06-13T10:54:28.058 INFO:root:teuthology version: 0.0.1.dev316+gc1b06c2 2024-06-13T10:54:28.058 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/fsx}} --name teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752830 --owner scheduled_teuthology@teuthology --verbose -- /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752830/orig.config.yaml 2024-06-13T10:54:28.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-13T10:54:28.217 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752830 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/fsx}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7752830' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow metadata IO - SLOW_OPS - slow request sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 1373963c202323287783ccb099bbae1ec8f14a5d owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 8815 sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba sleep_before_teardown: 0 subset: 250/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1373963c202323287783ccb099bbae1ec8f14a5d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLA2JhRidtg/d9mK9agL5+ERT4hFf1Yx3HZFNPnreXpoCa24KjJI+bA3AVP+0BkorODzBtj+c7gxzhlCDvD+NdA= smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLkELq3w1ZXZrWH/KMX2Z/mfCV++0QOFOrgKtLpCbajCEdi4iSphLgLeBmmO5ZypD2FjlTosbZDbDEIqv6WlsKI= smithi178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBswl22ITdeCHCqb8kr04nrhPL/+1ZOsoKOIvVPr82UlmrM8Q5XCA9GqUHF0d+Qyl91O3C2cNwiW4oW6r1oxXx8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: c1b06c2b5d3a02a3583265a115f09e052855bcf2 timestamp: 2024-06-12_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-13T10:54:28.217 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa; will attempt to use it 2024-06-13T10:54:28.218 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks 2024-06-13T10:54:28.218 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-13T10:54:28.220 INFO:teuthology.task.internal:Checking packages... 2024-06-13T10:54:28.243 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d89accfe3201286f000e065a1faea2a88c7a6ba' 2024-06-13T10:54:28.243 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-13T10:54:28.244 INFO:teuthology.packaging:ref: None 2024-06-13T10:54:28.244 INFO:teuthology.packaging:tag: None 2024-06-13T10:54:28.244 INFO:teuthology.packaging:branch: squid 2024-06-13T10:54:28.244 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T10:54:28.244 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-06-13T10:54:28.501 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2998.g1373963c 2024-06-13T10:54:28.503 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-13T10:54:28.509 INFO:teuthology.task.internal:no buildpackages task found 2024-06-13T10:54:28.509 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-13T10:54:28.530 INFO:teuthology.task.internal:Saving configuration 2024-06-13T10:54:28.550 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-13T10:54:28.557 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-13T10:54:28.581 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752830', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-13 10:49:03.516602', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLA2JhRidtg/d9mK9agL5+ERT4hFf1Yx3HZFNPnreXpoCa24KjJI+bA3AVP+0BkorODzBtj+c7gxzhlCDvD+NdA='} 2024-06-13T10:54:28.603 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752830', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-13 10:49:03.515525', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLkELq3w1ZXZrWH/KMX2Z/mfCV++0QOFOrgKtLpCbajCEdi4iSphLgLeBmmO5ZypD2FjlTosbZDbDEIqv6WlsKI='} 2024-06-13T10:54:28.625 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752830', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-13 10:49:03.514228', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBswl22ITdeCHCqb8kr04nrhPL/+1ZOsoKOIvVPr82UlmrM8Q5XCA9GqUHF0d+Qyl91O3C2cNwiW4oW6r1oxXx8='} 2024-06-13T10:54:28.625 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-13T10:54:28.632 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-06-13T10:54:28.632 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-06-13T10:54:28.632 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-06-13T10:54:28.632 INFO:teuthology.run_tasks:Running task console_log... 2024-06-13T10:54:28.726 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2bf3807be0>, signals=[15]) 2024-06-13T10:54:28.726 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-13T10:54:28.732 INFO:teuthology.task.internal:Opening connections... 2024-06-13T10:54:28.732 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T10:54:28.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T10:54:28.812 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2024-06-13T10:54:28.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T10:54:28.888 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2024-06-13T10:54:28.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T10:54:28.967 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-13T10:54:28.973 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-06-13T10:54:28.992 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-06-13T10:54:28.992 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-06-13T10:54:29.049 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-06-13T10:54:29.049 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-06-13T10:54:29.049 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-06-13T10:54:29.050 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-06-13T10:54:29.050 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-06-13T10:54:29.050 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-06-13T10:54:29.050 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-13T10:54:29.050 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-06-13T10:54:29.050 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-06-13T10:54:29.050 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-13T10:54:29.050 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-06-13T10:54:29.050 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-13T10:54:29.050 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-13T10:54:29.050 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-13T10:54:29.051 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-06-13T10:54:29.081 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-06-13T10:54:29.099 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-06-13T10:54:29.099 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-06-13T10:54:29.157 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-06-13T10:54:29.157 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2024-06-13T10:54:29.157 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-06-13T10:54:29.158 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-06-13T10:54:29.158 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2024-06-13T10:54:29.158 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2024-06-13T10:54:29.158 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-13T10:54:29.158 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-06-13T10:54:29.158 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2024-06-13T10:54:29.159 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-13T10:54:29.159 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-06-13T10:54:29.159 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-13T10:54:29.159 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-13T10:54:29.159 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-13T10:54:29.159 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-06-13T10:54:29.181 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2024-06-13T10:54:29.199 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2024-06-13T10:54:29.199 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-06-13T10:54:29.255 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream" 2024-06-13T10:54:29.256 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="9" 2024-06-13T10:54:29.256 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos" 2024-06-13T10:54:29.256 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora" 2024-06-13T10:54:29.256 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="9" 2024-06-13T10:54:29.256 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el9" 2024-06-13T10:54:29.256 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-13T10:54:29.256 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2024-06-13T10:54:29.256 INFO:teuthology.orchestra.run.smithi178.stdout:LOGO="fedora-logo-icon" 2024-06-13T10:54:29.256 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-13T10:54:29.256 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/" 2024-06-13T10:54:29.256 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-13T10:54:29.256 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-13T10:54:29.257 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-13T10:54:29.257 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-06-13T10:54:29.281 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-13T10:54:29.291 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-13T10:54:29.297 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-13T10:54:29.297 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-06-13T10:54:29.299 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2024-06-13T10:54:29.302 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2024-06-13T10:54:29.318 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-13T10:54:29.324 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-13T10:54:29.324 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-06-13T10:54:29.357 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2024-06-13T10:54:29.359 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2024-06-13T10:54:29.449 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-13T10:54:29.527 INFO:teuthology.run_tasks:Running task kernel... 2024-06-13T10:54:29.541 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-06-13T10:54:29.541 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-06-13T10:54:29.542 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-06-13T10:54:29.542 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-13T10:54:29.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T10:54:29.559 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-06-13T10:54:29.717 DEBUG:teuthology.task.kernel:sha1 for client.0 is ff88c41504f3e4c4268de18904a6f347f1b3f2d6 2024-06-13T10:54:29.718 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "ff88c41504f3e4c4268de18904a6f347f1b3f2d6"... 2024-06-13T10:54:29.718 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-06-13T10:54:29.736 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-437.el9.x86_64 2024-06-13T10:54:29.736 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs ff88c41504f3e4c4268de18904a6f347f1b3f2d6 2024-06-13T10:54:29.736 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-06-13T10:54:29.737 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum upgrade -y linux-firmware 2024-06-13T10:54:32.051 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-06-13T10:54:41.543 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 2.3 MB/s | 20 MB 00:08 2024-06-13T10:54:46.144 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.3 MB 00:00 2024-06-13T10:54:47.836 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 17 kB 00:00 2024-06-13T10:54:48.848 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 25 MB/s | 21 MB 00:00 2024-06-13T10:54:54.271 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-06-13T10:54:56.509 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-06-13T10:54:56.514 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-06-13T10:54:56.514 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-06-13T10:54:56.515 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-06-13T10:54:56.515 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-06-13T10:54:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: linux-firmware noarch 20240603-144.el9 baseos 380 M 2024-06-13T10:54:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T10:54:56.515 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-06-13T10:54:56.515 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-06-13T10:54:56.515 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 1 Package 2024-06-13T10:54:56.515 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T10:54:56.515 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 380 M 2024-06-13T10:54:56.516 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-06-13T10:56:03.897 INFO:teuthology.orchestra.run.smithi002.stdout:linux-firmware-20240603-144.el9.noarch.rpm 5.6 MB/s | 380 MB 01:07 2024-06-13T10:56:03.898 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-06-13T10:56:03.898 INFO:teuthology.orchestra.run.smithi002.stdout:Total 5.6 MB/s | 380 MB 01:07 2024-06-13T10:56:07.100 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-06-13T10:56:07.175 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-06-13T10:56:07.175 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-06-13T10:56:10.544 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-06-13T10:56:10.544 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-06-13T10:56:19.539 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-06-13T10:56:20.234 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : linux-firmware-20240603-144.el9.noarch 1/2 2024-06-13T10:56:20.323 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-06-13T10:56:20.802 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-06-13T10:56:20.802 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : linux-firmware-20240603-144.el9.noarch 1/2 2024-06-13T10:56:21.522 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-06-13T10:56:21.522 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T10:56:21.522 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-06-13T10:56:21.522 INFO:teuthology.orchestra.run.smithi002.stdout: linux-firmware-20240603-144.el9.noarch 2024-06-13T10:56:21.522 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T10:56:21.523 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-06-13T10:56:21.846 INFO:teuthology.task.kernel:Downloading kernel ff88c41504f3e4c4268de18904a6f347f1b3f2d6 on client.0... 2024-06-13T10:56:21.847 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ff88c41504f3e4c4268de18904a6f347f1b3f2d6 2024-06-13T10:56:22.078 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/ff88c41504f3e4c4268de18904a6f347f1b3f2d6/centos/9/flavors/default/x86_64/ 2024-06-13T10:56:22.078 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_gff88c41504f3-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/ff88c41504f3e4c4268de18904a6f347f1b3f2d6/centos/9/flavors/default/x86_64/ --input-file=- 2024-06-13T10:56:22.080 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi002.front.sepia.ceph.com to complete... 2024-06-13T10:56:34.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13 10:56:34 URL:https://3.chacra.ceph.com/r/kernel/testing/ff88c41504f3e4c4268de18904a6f347f1b3f2d6/centos/9/flavors/default/x86_64/kernel-6.9.0_gff88c41504f3-1.x86_64.rpm [356881057/356881057] -> "/tmp/kernel.x86_64.rpm" [1] 2024-06-13T10:56:34.330 INFO:teuthology.orchestra.run.smithi002.stderr:FINISHED --2024-06-13 10:56:34-- 2024-06-13T10:56:34.330 INFO:teuthology.orchestra.run.smithi002.stderr:Total wall clock time: 12s 2024-06-13T10:56:34.330 INFO:teuthology.orchestra.run.smithi002.stderr:Downloaded: 1 files, 340M in 12s (28.5 MB/s) 2024-06-13T10:56:34.333 INFO:teuthology.task.kernel:Installing kernel ff88c41504f3e4c4268de18904a6f347f1b3f2d6 on client.0... 2024-06-13T10:56:34.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-06-13T10:56:36.481 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying... ######################################## 2024-06-13T10:56:36.527 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing... ######################################## 2024-06-13T10:56:36.580 INFO:teuthology.orchestra.run.smithi002.stdout:Updating / installing... 2024-06-13T10:56:44.855 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-6.9.0_gff88c41504f3-1 ######################################## 2024-06-13T10:57:25.110 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-06-13T10:57:25.110 DEBUG:teuthology.orchestra.run.smithi002:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-06-13T10:57:25.203 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/System.map-6.9.0-gff88c41504f3 2024-06-13T10:57:25.203 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/config-6.9.0-gff88c41504f3 2024-06-13T10:57:25.203 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/vmlinuz-6.9.0-gff88c41504f3 2024-06-13T10:57:25.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/System.map 2024-06-13T10:57:25.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/config 2024-06-13T10:57:25.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel 2024-06-13T10:57:25.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch 2024-06-13T10:57:25.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86 2024-06-13T10:57:25.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto 2024-06-13T10:57:25.203 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-06-13T10:57:25.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-06-13T10:57:25.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-06-13T10:57:25.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-06-13T10:57:25.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-06-13T10:57:25.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-06-13T10:57:25.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-06-13T10:57:25.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/crc32c-intel.ko 2024-06-13T10:57:25.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-06-13T10:57:25.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-06-13T10:57:25.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-06-13T10:57:25.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-06-13T10:57:25.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/serpent-avx2.ko 2024-06-13T10:57:25.204 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-06-13T10:57:25.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-06-13T10:57:25.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-06-13T10:57:25.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-06-13T10:57:25.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-06-13T10:57:25.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-06-13T10:57:25.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-06-13T10:57:25.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/kernel 2024-06-13T10:57:25.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/kernel/cpu 2024-06-13T10:57:25.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/kernel/cpu/mce 2024-06-13T10:57:25.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-06-13T10:57:25.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/kvm 2024-06-13T10:57:25.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/kvm/kvm-amd.ko 2024-06-13T10:57:25.205 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/kvm/kvm-intel.ko 2024-06-13T10:57:25.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/kvm/kvm.ko 2024-06-13T10:57:25.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto 2024-06-13T10:57:25.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/ansi_cprng.ko 2024-06-13T10:57:25.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/anubis.ko 2024-06-13T10:57:25.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/arc4.ko 2024-06-13T10:57:25.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/async_tx 2024-06-13T10:57:25.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/async_tx/async_memcpy.ko 2024-06-13T10:57:25.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/async_tx/async_pq.ko 2024-06-13T10:57:25.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/async_tx/async_raid6_recov.ko 2024-06-13T10:57:25.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/async_tx/async_tx.ko 2024-06-13T10:57:25.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/async_tx/async_xor.ko 2024-06-13T10:57:25.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/async_tx/raid6test.ko 2024-06-13T10:57:25.206 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/authenc.ko 2024-06-13T10:57:25.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/authencesn.ko 2024-06-13T10:57:25.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/blake2b_generic.ko 2024-06-13T10:57:25.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/blowfish_common.ko 2024-06-13T10:57:25.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/blowfish_generic.ko 2024-06-13T10:57:25.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/camellia_generic.ko 2024-06-13T10:57:25.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/cast5_generic.ko 2024-06-13T10:57:25.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/cast6_generic.ko 2024-06-13T10:57:25.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/cast_common.ko 2024-06-13T10:57:25.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/ccm.ko 2024-06-13T10:57:25.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/cmac.ko 2024-06-13T10:57:25.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/crc32_generic.ko 2024-06-13T10:57:25.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/crypto_engine.ko 2024-06-13T10:57:25.207 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/crypto_user.ko 2024-06-13T10:57:25.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/cts.ko 2024-06-13T10:57:25.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/des_generic.ko 2024-06-13T10:57:25.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/dh_generic.ko 2024-06-13T10:57:25.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/echainiv.ko 2024-06-13T10:57:25.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/essiv.ko 2024-06-13T10:57:25.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/fcrypt.ko 2024-06-13T10:57:25.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/khazad.ko 2024-06-13T10:57:25.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/lz4.ko 2024-06-13T10:57:25.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/lz4hc.ko 2024-06-13T10:57:25.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/md4.ko 2024-06-13T10:57:25.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/michael_mic.ko 2024-06-13T10:57:25.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/pcbc.ko 2024-06-13T10:57:25.208 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/pcrypt.ko 2024-06-13T10:57:25.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/rmd160.ko 2024-06-13T10:57:25.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/seed.ko 2024-06-13T10:57:25.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/serpent_generic.ko 2024-06-13T10:57:25.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/tcrypt.ko 2024-06-13T10:57:25.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/tea.ko 2024-06-13T10:57:25.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/twofish_common.ko 2024-06-13T10:57:25.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/twofish_generic.ko 2024-06-13T10:57:25.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/vmac.ko 2024-06-13T10:57:25.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/wp512.ko 2024-06-13T10:57:25.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/xcbc.ko 2024-06-13T10:57:25.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/xor.ko 2024-06-13T10:57:25.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/xxhash_generic.ko 2024-06-13T10:57:25.209 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers 2024-06-13T10:57:25.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/acpi 2024-06-13T10:57:25.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/acpi/acpi_ipmi.ko 2024-06-13T10:57:25.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/acpi/acpi_pad.ko 2024-06-13T10:57:25.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/acpi/ec_sys.ko 2024-06-13T10:57:25.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/acpi/platform_profile.ko 2024-06-13T10:57:25.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/acpi/sbs.ko 2024-06-13T10:57:25.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/acpi/sbshc.ko 2024-06-13T10:57:25.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/acpi/video.ko 2024-06-13T10:57:25.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata 2024-06-13T10:57:25.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/acard-ahci.ko 2024-06-13T10:57:25.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/ahci_platform.ko 2024-06-13T10:57:25.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/ata_generic.ko 2024-06-13T10:57:25.210 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/libahci_platform.ko 2024-06-13T10:57:25.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_acpi.ko 2024-06-13T10:57:25.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_ali.ko 2024-06-13T10:57:25.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_amd.ko 2024-06-13T10:57:25.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_artop.ko 2024-06-13T10:57:25.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_atiixp.ko 2024-06-13T10:57:25.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_atp867x.ko 2024-06-13T10:57:25.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_cmd640.ko 2024-06-13T10:57:25.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_cmd64x.ko 2024-06-13T10:57:25.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_cypress.ko 2024-06-13T10:57:25.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_efar.ko 2024-06-13T10:57:25.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_hpt366.ko 2024-06-13T10:57:25.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_hpt37x.ko 2024-06-13T10:57:25.211 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_hpt3x2n.ko 2024-06-13T10:57:25.212 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_hpt3x3.ko 2024-06-13T10:57:25.212 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_it8213.ko 2024-06-13T10:57:25.212 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_it821x.ko 2024-06-13T10:57:25.212 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_jmicron.ko 2024-06-13T10:57:25.212 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_marvell.ko 2024-06-13T10:57:25.212 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_mpiix.ko 2024-06-13T10:57:25.212 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_netcell.ko 2024-06-13T10:57:25.212 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_ninja32.ko 2024-06-13T10:57:25.212 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_ns87410.ko 2024-06-13T10:57:25.212 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_ns87415.ko 2024-06-13T10:57:25.212 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_oldpiix.ko 2024-06-13T10:57:25.212 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_opti.ko 2024-06-13T10:57:25.212 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_optidma.ko 2024-06-13T10:57:25.212 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_pcmcia.ko 2024-06-13T10:57:25.213 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_pdc2027x.ko 2024-06-13T10:57:25.213 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-06-13T10:57:25.213 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_piccolo.ko 2024-06-13T10:57:25.213 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_rdc.ko 2024-06-13T10:57:25.213 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_sch.ko 2024-06-13T10:57:25.213 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_serverworks.ko 2024-06-13T10:57:25.213 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_sil680.ko 2024-06-13T10:57:25.213 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_sis.ko 2024-06-13T10:57:25.213 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_sl82c105.ko 2024-06-13T10:57:25.213 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_triflex.ko 2024-06-13T10:57:25.213 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_via.ko 2024-06-13T10:57:25.213 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pdc_adma.ko 2024-06-13T10:57:25.213 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_inic162x.ko 2024-06-13T10:57:25.214 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_mv.ko 2024-06-13T10:57:25.214 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_nv.ko 2024-06-13T10:57:25.214 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_promise.ko 2024-06-13T10:57:25.214 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_qstor.ko 2024-06-13T10:57:25.214 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_sil.ko 2024-06-13T10:57:25.214 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_sil24.ko 2024-06-13T10:57:25.214 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_sis.ko 2024-06-13T10:57:25.214 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_svw.ko 2024-06-13T10:57:25.214 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_sx4.ko 2024-06-13T10:57:25.214 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_uli.ko 2024-06-13T10:57:25.214 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_via.ko 2024-06-13T10:57:25.214 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_vsc.ko 2024-06-13T10:57:25.214 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/auxdisplay 2024-06-13T10:57:25.215 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/auxdisplay/ks0108.ko 2024-06-13T10:57:25.215 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/base 2024-06-13T10:57:25.215 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/base/regmap 2024-06-13T10:57:25.215 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/base/regmap/regmap-i2c.ko 2024-06-13T10:57:25.215 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/base/regmap/regmap-mmio.ko 2024-06-13T10:57:25.215 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/bcma 2024-06-13T10:57:25.215 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/bcma/bcma.ko 2024-06-13T10:57:25.215 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block 2024-06-13T10:57:25.215 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/aoe 2024-06-13T10:57:25.215 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/aoe/aoe.ko 2024-06-13T10:57:25.215 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/brd.ko 2024-06-13T10:57:25.215 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/drbd 2024-06-13T10:57:25.215 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/drbd/drbd.ko 2024-06-13T10:57:25.215 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/floppy.ko 2024-06-13T10:57:25.216 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/loop.ko 2024-06-13T10:57:25.216 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/mtip32xx 2024-06-13T10:57:25.216 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-06-13T10:57:25.216 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/nbd.ko 2024-06-13T10:57:25.216 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/null_blk 2024-06-13T10:57:25.216 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/null_blk/null_blk.ko 2024-06-13T10:57:25.216 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/pktcdvd.ko 2024-06-13T10:57:25.216 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/rbd.ko 2024-06-13T10:57:25.216 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/virtio_blk.ko 2024-06-13T10:57:25.216 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/xen-blkback 2024-06-13T10:57:25.216 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-06-13T10:57:25.216 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/xen-blkfront.ko 2024-06-13T10:57:25.216 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/zram 2024-06-13T10:57:25.217 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/zram/zram.ko 2024-06-13T10:57:25.217 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char 2024-06-13T10:57:25.217 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/hangcheck-timer.ko 2024-06-13T10:57:25.217 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/hw_random 2024-06-13T10:57:25.217 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/hw_random/amd-rng.ko 2024-06-13T10:57:25.217 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/hw_random/intel-rng.ko 2024-06-13T10:57:25.217 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-06-13T10:57:25.217 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/hw_random/via-rng.ko 2024-06-13T10:57:25.217 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/hw_random/virtio-rng.ko 2024-06-13T10:57:25.217 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/ipmi 2024-06-13T10:57:25.217 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-06-13T10:57:25.217 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-06-13T10:57:25.217 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-06-13T10:57:25.218 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/ipmi/ipmi_si.ko 2024-06-13T10:57:25.218 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-06-13T10:57:25.218 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-06-13T10:57:25.218 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/lp.ko 2024-06-13T10:57:25.218 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/mwave 2024-06-13T10:57:25.218 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/mwave/mwave.ko 2024-06-13T10:57:25.218 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/ppdev.ko 2024-06-13T10:57:25.218 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/tlclk.ko 2024-06-13T10:57:25.218 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/tpm 2024-06-13T10:57:25.218 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/tpm/tpm.ko 2024-06-13T10:57:25.218 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/tpm/tpm_atmel.ko 2024-06-13T10:57:25.218 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/tpm/tpm_infineon.ko 2024-06-13T10:57:25.218 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/tpm/tpm_nsc.ko 2024-06-13T10:57:25.219 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/tpm/tpm_tis.ko 2024-06-13T10:57:25.219 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-06-13T10:57:25.219 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/uv_mmtimer.ko 2024-06-13T10:57:25.219 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/virtio_console.ko 2024-06-13T10:57:25.219 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/cpufreq 2024-06-13T10:57:25.219 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-06-13T10:57:25.219 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-06-13T10:57:25.219 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/cpufreq/p4-clockmod.ko 2024-06-13T10:57:25.219 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-06-13T10:57:25.219 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/cpufreq/powernow-k8.ko 2024-06-13T10:57:25.219 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/cpufreq/speedstep-lib.ko 2024-06-13T10:57:25.219 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto 2024-06-13T10:57:25.219 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/ccp 2024-06-13T10:57:25.219 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-06-13T10:57:25.220 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/ccp/ccp.ko 2024-06-13T10:57:25.220 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/intel 2024-06-13T10:57:25.220 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/intel/qat 2024-06-13T10:57:25.220 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/intel/qat/qat_common 2024-06-13T10:57:25.220 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-06-13T10:57:25.220 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-06-13T10:57:25.220 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-06-13T10:57:25.220 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/padlock-aes.ko 2024-06-13T10:57:25.220 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/padlock-sha.ko 2024-06-13T10:57:25.220 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/virtio 2024-06-13T10:57:25.220 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-06-13T10:57:25.220 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/dca 2024-06-13T10:57:25.220 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/dca/dca.ko 2024-06-13T10:57:25.220 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/devfreq 2024-06-13T10:57:25.220 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-06-13T10:57:25.221 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/dma 2024-06-13T10:57:25.221 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/dma/dw 2024-06-13T10:57:25.221 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/dma/dw/dw_dmac.ko 2024-06-13T10:57:25.221 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/dma/ioat 2024-06-13T10:57:25.221 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/dma/ioat/ioatdma.ko 2024-06-13T10:57:25.221 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac 2024-06-13T10:57:25.221 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/amd64_edac.ko 2024-06-13T10:57:25.221 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/e752x_edac.ko 2024-06-13T10:57:25.221 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/edac_mce_amd.ko 2024-06-13T10:57:25.221 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/i3000_edac.ko 2024-06-13T10:57:25.221 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/i3200_edac.ko 2024-06-13T10:57:25.221 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/i5100_edac.ko 2024-06-13T10:57:25.221 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/i5400_edac.ko 2024-06-13T10:57:25.221 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/i7300_edac.ko 2024-06-13T10:57:25.222 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/i7core_edac.ko 2024-06-13T10:57:25.222 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/i82975x_edac.ko 2024-06-13T10:57:25.222 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/ie31200_edac.ko 2024-06-13T10:57:25.222 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/sb_edac.ko 2024-06-13T10:57:25.222 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/x38_edac.ko 2024-06-13T10:57:25.222 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/firmware 2024-06-13T10:57:25.222 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/firmware/edd.ko 2024-06-13T10:57:25.222 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/firmware/iscsi_ibft.ko 2024-06-13T10:57:25.222 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/gpio 2024-06-13T10:57:25.222 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/gpio/gpio-ich.ko 2024-06-13T10:57:25.222 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/gpio/gpio-viperboard.ko 2024-06-13T10:57:25.222 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid 2024-06-13T10:57:25.223 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-appleir.ko 2024-06-13T10:57:25.223 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-aureal.ko 2024-06-13T10:57:25.223 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-axff.ko 2024-06-13T10:57:25.223 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-dr.ko 2024-06-13T10:57:25.223 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-elecom.ko 2024-06-13T10:57:25.223 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-elo.ko 2024-06-13T10:57:25.223 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-emsff.ko 2024-06-13T10:57:25.223 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-gaff.ko 2024-06-13T10:57:25.223 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-gt683r.ko 2024-06-13T10:57:25.223 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-gyration.ko 2024-06-13T10:57:25.223 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-holtek-kbd.ko 2024-06-13T10:57:25.223 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-holtek-mouse.ko 2024-06-13T10:57:25.223 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-holtekff.ko 2024-06-13T10:57:25.223 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-hyperv.ko 2024-06-13T10:57:25.224 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-icade.ko 2024-06-13T10:57:25.224 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-keytouch.ko 2024-06-13T10:57:25.224 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-kye.ko 2024-06-13T10:57:25.224 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-lcpower.ko 2024-06-13T10:57:25.224 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-led.ko 2024-06-13T10:57:25.224 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-lenovo.ko 2024-06-13T10:57:25.224 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-logitech-dj.ko 2024-06-13T10:57:25.224 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-06-13T10:57:25.224 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-multitouch.ko 2024-06-13T10:57:25.224 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-ortek.ko 2024-06-13T10:57:25.224 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-penmount.ko 2024-06-13T10:57:25.224 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-petalynx.ko 2024-06-13T10:57:25.224 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-picolcd.ko 2024-06-13T10:57:25.224 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-pl.ko 2024-06-13T10:57:25.225 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-plantronics.ko 2024-06-13T10:57:25.225 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-primax.ko 2024-06-13T10:57:25.225 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-rmi.ko 2024-06-13T10:57:25.225 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-arvo.ko 2024-06-13T10:57:25.225 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-common.ko 2024-06-13T10:57:25.225 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-isku.ko 2024-06-13T10:57:25.225 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-kone.ko 2024-06-13T10:57:25.225 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-06-13T10:57:25.225 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-konepure.ko 2024-06-13T10:57:25.225 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-06-13T10:57:25.225 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-lua.ko 2024-06-13T10:57:25.225 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-pyra.ko 2024-06-13T10:57:25.225 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-ryos.ko 2024-06-13T10:57:25.225 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-savu.ko 2024-06-13T10:57:25.226 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat.ko 2024-06-13T10:57:25.226 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-saitek.ko 2024-06-13T10:57:25.226 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-samsung.ko 2024-06-13T10:57:25.226 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-sensor-hub.ko 2024-06-13T10:57:25.226 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-sjoy.ko 2024-06-13T10:57:25.226 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-sony.ko 2024-06-13T10:57:25.226 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-speedlink.ko 2024-06-13T10:57:25.226 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-steelseries.ko 2024-06-13T10:57:25.226 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-sunplus.ko 2024-06-13T10:57:25.226 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-thrustmaster.ko 2024-06-13T10:57:25.226 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-tivo.ko 2024-06-13T10:57:25.226 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-tmff.ko 2024-06-13T10:57:25.226 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-topseed.ko 2024-06-13T10:57:25.227 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-twinhan.ko 2024-06-13T10:57:25.227 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-uclogic.ko 2024-06-13T10:57:25.227 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-waltop.ko 2024-06-13T10:57:25.227 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-wiimote.ko 2024-06-13T10:57:25.227 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-xinmo.ko 2024-06-13T10:57:25.227 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-zpff.ko 2024-06-13T10:57:25.227 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-zydacron.ko 2024-06-13T10:57:25.227 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/uhid.ko 2024-06-13T10:57:25.227 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/wacom.ko 2024-06-13T10:57:25.227 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hv 2024-06-13T10:57:25.227 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hv/hv_balloon.ko 2024-06-13T10:57:25.227 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hv/hv_utils.ko 2024-06-13T10:57:25.227 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hv/hv_vmbus.ko 2024-06-13T10:57:25.228 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon 2024-06-13T10:57:25.228 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/abituguru.ko 2024-06-13T10:57:25.228 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/abituguru3.ko 2024-06-13T10:57:25.228 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/acpi_power_meter.ko 2024-06-13T10:57:25.228 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ad7414.ko 2024-06-13T10:57:25.228 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ad7418.ko 2024-06-13T10:57:25.228 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adc128d818.ko 2024-06-13T10:57:25.228 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adm1025.ko 2024-06-13T10:57:25.228 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adm1026.ko 2024-06-13T10:57:25.228 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adm1029.ko 2024-06-13T10:57:25.228 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adm1031.ko 2024-06-13T10:57:25.228 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adm9240.ko 2024-06-13T10:57:25.228 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ads7828.ko 2024-06-13T10:57:25.229 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adt7410.ko 2024-06-13T10:57:25.229 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adt7411.ko 2024-06-13T10:57:25.229 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adt7462.ko 2024-06-13T10:57:25.229 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adt7470.ko 2024-06-13T10:57:25.229 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adt7475.ko 2024-06-13T10:57:25.229 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adt7x10.ko 2024-06-13T10:57:25.229 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/amc6821.ko 2024-06-13T10:57:25.229 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/applesmc.ko 2024-06-13T10:57:25.229 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/asb100.ko 2024-06-13T10:57:25.229 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/asc7621.ko 2024-06-13T10:57:25.229 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/asus_atk0110.ko 2024-06-13T10:57:25.229 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/atxp1.ko 2024-06-13T10:57:25.229 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/coretemp.ko 2024-06-13T10:57:25.229 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-06-13T10:57:25.230 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/dme1737.ko 2024-06-13T10:57:25.230 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ds1621.ko 2024-06-13T10:57:25.230 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ds620.ko 2024-06-13T10:57:25.230 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/emc1403.ko 2024-06-13T10:57:25.230 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/emc6w201.ko 2024-06-13T10:57:25.230 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/f71805f.ko 2024-06-13T10:57:25.230 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/f71882fg.ko 2024-06-13T10:57:25.230 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/f75375s.ko 2024-06-13T10:57:25.230 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/fam15h_power.ko 2024-06-13T10:57:25.230 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/fschmd.ko 2024-06-13T10:57:25.230 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/g760a.ko 2024-06-13T10:57:25.230 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/g762.ko 2024-06-13T10:57:25.230 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/gl518sm.ko 2024-06-13T10:57:25.231 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/gl520sm.ko 2024-06-13T10:57:25.231 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/hwmon-vid.ko 2024-06-13T10:57:25.231 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/i5500_temp.ko 2024-06-13T10:57:25.231 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/i5k_amb.ko 2024-06-13T10:57:25.231 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ibmaem.ko 2024-06-13T10:57:25.231 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ibmpex.ko 2024-06-13T10:57:25.231 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ina209.ko 2024-06-13T10:57:25.231 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ina2xx.ko 2024-06-13T10:57:25.231 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/it87.ko 2024-06-13T10:57:25.231 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/k10temp.ko 2024-06-13T10:57:25.231 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/k8temp.ko 2024-06-13T10:57:25.231 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lineage-pem.ko 2024-06-13T10:57:25.231 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm63.ko 2024-06-13T10:57:25.231 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm73.ko 2024-06-13T10:57:25.232 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm75.ko 2024-06-13T10:57:25.232 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm77.ko 2024-06-13T10:57:25.232 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm78.ko 2024-06-13T10:57:25.232 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm80.ko 2024-06-13T10:57:25.232 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm83.ko 2024-06-13T10:57:25.232 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm85.ko 2024-06-13T10:57:25.232 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm87.ko 2024-06-13T10:57:25.232 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm90.ko 2024-06-13T10:57:25.232 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm92.ko 2024-06-13T10:57:25.232 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm93.ko 2024-06-13T10:57:25.232 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm95234.ko 2024-06-13T10:57:25.232 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm95241.ko 2024-06-13T10:57:25.232 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm95245.ko 2024-06-13T10:57:25.232 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ltc2945.ko 2024-06-13T10:57:25.233 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ltc4151.ko 2024-06-13T10:57:25.233 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ltc4215.ko 2024-06-13T10:57:25.233 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ltc4222.ko 2024-06-13T10:57:25.233 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ltc4245.ko 2024-06-13T10:57:25.233 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ltc4260.ko 2024-06-13T10:57:25.233 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ltc4261.ko 2024-06-13T10:57:25.233 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/max16065.ko 2024-06-13T10:57:25.233 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/max1619.ko 2024-06-13T10:57:25.233 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/max1668.ko 2024-06-13T10:57:25.233 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/max197.ko 2024-06-13T10:57:25.233 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/max6639.ko 2024-06-13T10:57:25.233 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/max6650.ko 2024-06-13T10:57:25.233 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/max6697.ko 2024-06-13T10:57:25.234 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/mcp3021.ko 2024-06-13T10:57:25.234 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/nct6683.ko 2024-06-13T10:57:25.234 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/nct6775-core.ko 2024-06-13T10:57:25.234 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/nct6775.ko 2024-06-13T10:57:25.234 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/nct7802.ko 2024-06-13T10:57:25.234 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pc87360.ko 2024-06-13T10:57:25.234 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pc87427.ko 2024-06-13T10:57:25.234 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pcf8591.ko 2024-06-13T10:57:25.234 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus 2024-06-13T10:57:25.234 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-06-13T10:57:25.234 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-06-13T10:57:25.234 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-06-13T10:57:25.234 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/max16064.ko 2024-06-13T10:57:25.235 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/max34440.ko 2024-06-13T10:57:25.235 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/max8688.ko 2024-06-13T10:57:25.235 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-06-13T10:57:25.235 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-06-13T10:57:25.235 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-06-13T10:57:25.235 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-06-13T10:57:25.235 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-06-13T10:57:25.235 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-06-13T10:57:25.235 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/powr1220.ko 2024-06-13T10:57:25.235 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/sch5627.ko 2024-06-13T10:57:25.235 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/sch5636.ko 2024-06-13T10:57:25.235 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/sch56xx-common.ko 2024-06-13T10:57:25.235 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/sht15.ko 2024-06-13T10:57:25.235 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/sht21.ko 2024-06-13T10:57:25.236 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/shtc1.ko 2024-06-13T10:57:25.236 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/sis5595.ko 2024-06-13T10:57:25.236 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/smsc47b397.ko 2024-06-13T10:57:25.236 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/smsc47m1.ko 2024-06-13T10:57:25.236 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/smsc47m192.ko 2024-06-13T10:57:25.236 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/thmc50.ko 2024-06-13T10:57:25.236 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/tmp102.ko 2024-06-13T10:57:25.236 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/tmp103.ko 2024-06-13T10:57:25.236 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/tmp401.ko 2024-06-13T10:57:25.236 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/tmp421.ko 2024-06-13T10:57:25.236 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/via-cputemp.ko 2024-06-13T10:57:25.236 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/via686a.ko 2024-06-13T10:57:25.236 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/vt1211.ko 2024-06-13T10:57:25.236 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/vt8231.ko 2024-06-13T10:57:25.237 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83627ehf.ko 2024-06-13T10:57:25.237 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83627hf.ko 2024-06-13T10:57:25.237 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83781d.ko 2024-06-13T10:57:25.237 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83791d.ko 2024-06-13T10:57:25.237 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83792d.ko 2024-06-13T10:57:25.237 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83793.ko 2024-06-13T10:57:25.237 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83795.ko 2024-06-13T10:57:25.237 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83l785ts.ko 2024-06-13T10:57:25.237 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83l786ng.ko 2024-06-13T10:57:25.237 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c 2024-06-13T10:57:25.237 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/algos 2024-06-13T10:57:25.237 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-06-13T10:57:25.237 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-06-13T10:57:25.238 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses 2024-06-13T10:57:25.238 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-06-13T10:57:25.238 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-06-13T10:57:25.238 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-06-13T10:57:25.238 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-06-13T10:57:25.238 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-06-13T10:57:25.238 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-06-13T10:57:25.238 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-06-13T10:57:25.238 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-06-13T10:57:25.238 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-i801.ko 2024-06-13T10:57:25.238 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-isch.ko 2024-06-13T10:57:25.238 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-06-13T10:57:25.239 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-06-13T10:57:25.239 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-06-13T10:57:25.239 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-parport.ko 2024-06-13T10:57:25.239 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-06-13T10:57:25.239 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-06-13T10:57:25.239 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-06-13T10:57:25.239 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-06-13T10:57:25.239 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-06-13T10:57:25.239 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-06-13T10:57:25.239 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-via.ko 2024-06-13T10:57:25.239 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-06-13T10:57:25.239 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-06-13T10:57:25.239 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/i2c-dev.ko 2024-06-13T10:57:25.239 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/i2c-mux.ko 2024-06-13T10:57:25.240 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-06-13T10:57:25.240 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/i2c-smbus.ko 2024-06-13T10:57:25.240 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/i2c-stub.ko 2024-06-13T10:57:25.240 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband 2024-06-13T10:57:25.240 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/core 2024-06-13T10:57:25.240 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/core/ib_cm.ko 2024-06-13T10:57:25.240 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/core/ib_core.ko 2024-06-13T10:57:25.240 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/core/ib_umad.ko 2024-06-13T10:57:25.240 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-06-13T10:57:25.240 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/core/iw_cm.ko 2024-06-13T10:57:25.240 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/core/rdma_cm.ko 2024-06-13T10:57:25.240 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-06-13T10:57:25.240 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw 2024-06-13T10:57:25.241 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw/cxgb4 2024-06-13T10:57:25.241 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-06-13T10:57:25.241 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw/mlx4 2024-06-13T10:57:25.241 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-06-13T10:57:25.241 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw/mlx5 2024-06-13T10:57:25.241 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-06-13T10:57:25.241 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw/mthca 2024-06-13T10:57:25.241 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-06-13T10:57:25.241 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp 2024-06-13T10:57:25.241 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/ipoib 2024-06-13T10:57:25.241 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-06-13T10:57:25.241 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/iser 2024-06-13T10:57:25.241 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-06-13T10:57:25.241 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/isert 2024-06-13T10:57:25.242 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-06-13T10:57:25.242 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/srp 2024-06-13T10:57:25.242 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-06-13T10:57:25.242 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/srpt 2024-06-13T10:57:25.242 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-06-13T10:57:25.242 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input 2024-06-13T10:57:25.242 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/gameport 2024-06-13T10:57:25.242 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-06-13T10:57:25.242 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/gameport/fm801-gp.ko 2024-06-13T10:57:25.242 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/gameport/gameport.ko 2024-06-13T10:57:25.242 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/joydev.ko 2024-06-13T10:57:25.242 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/keyboard 2024-06-13T10:57:25.242 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/keyboard/gpio_keys.ko 2024-06-13T10:57:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse 2024-06-13T10:57:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse/appletouch.ko 2024-06-13T10:57:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse/bcm5974.ko 2024-06-13T10:57:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse/cyapatp.ko 2024-06-13T10:57:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse/elan_i2c.ko 2024-06-13T10:57:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse/sermouse.ko 2024-06-13T10:57:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-06-13T10:57:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse/synaptics_usb.ko 2024-06-13T10:57:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse/vsxxxaa.ko 2024-06-13T10:57:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/rmi4 2024-06-13T10:57:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/rmi4/rmi_core.ko 2024-06-13T10:57:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/serio 2024-06-13T10:57:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/serio/altera_ps2.ko 2024-06-13T10:57:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/serio/arc_ps2.ko 2024-06-13T10:57:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-06-13T10:57:25.244 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/serio/serio_raw.ko 2024-06-13T10:57:25.244 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/sparse-keymap.ko 2024-06-13T10:57:25.244 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds 2024-06-13T10:57:25.244 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/leds-blinkm.ko 2024-06-13T10:57:25.244 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/leds-lm3530.ko 2024-06-13T10:57:25.244 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/leds-lp3944.ko 2024-06-13T10:57:25.244 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/leds-ss4200.ko 2024-06-13T10:57:25.244 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger 2024-06-13T10:57:25.244 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-06-13T10:57:25.244 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-06-13T10:57:25.244 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-06-13T10:57:25.244 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-06-13T10:57:25.244 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-06-13T10:57:25.244 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-06-13T10:57:25.244 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-06-13T10:57:25.245 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-06-13T10:57:25.245 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-06-13T10:57:25.245 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md 2024-06-13T10:57:25.245 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/bcache 2024-06-13T10:57:25.245 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/bcache/bcache.ko 2024-06-13T10:57:25.245 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-bio-prison.ko 2024-06-13T10:57:25.245 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-cache-smq.ko 2024-06-13T10:57:25.245 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-cache.ko 2024-06-13T10:57:25.245 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-crypt.ko 2024-06-13T10:57:25.245 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-delay.ko 2024-06-13T10:57:25.245 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-flakey.ko 2024-06-13T10:57:25.245 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-log-userspace.ko 2024-06-13T10:57:25.245 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-multipath.ko 2024-06-13T10:57:25.246 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-queue-length.ko 2024-06-13T10:57:25.246 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-raid.ko 2024-06-13T10:57:25.246 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-round-robin.ko 2024-06-13T10:57:25.246 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-service-time.ko 2024-06-13T10:57:25.246 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-switch.ko 2024-06-13T10:57:25.246 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-thin-pool.ko 2024-06-13T10:57:25.246 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-verity.ko 2024-06-13T10:57:25.246 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/persistent-data 2024-06-13T10:57:25.246 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-06-13T10:57:25.246 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/raid0.ko 2024-06-13T10:57:25.246 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/raid1.ko 2024-06-13T10:57:25.246 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/raid10.ko 2024-06-13T10:57:25.246 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/raid456.ko 2024-06-13T10:57:25.246 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message 2024-06-13T10:57:25.247 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message/fusion 2024-06-13T10:57:25.247 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message/fusion/mptbase.ko 2024-06-13T10:57:25.247 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message/fusion/mptctl.ko 2024-06-13T10:57:25.247 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message/fusion/mptfc.ko 2024-06-13T10:57:25.247 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message/fusion/mptlan.ko 2024-06-13T10:57:25.247 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message/fusion/mptsas.ko 2024-06-13T10:57:25.247 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message/fusion/mptscsih.ko 2024-06-13T10:57:25.247 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message/fusion/mptspi.ko 2024-06-13T10:57:25.247 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/mfd 2024-06-13T10:57:25.247 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/mfd/lpc_ich.ko 2024-06-13T10:57:25.247 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/mfd/lpc_sch.ko 2024-06-13T10:57:25.247 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/mfd/mfd-core.ko 2024-06-13T10:57:25.247 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/mfd/sm501.ko 2024-06-13T10:57:25.247 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/mfd/viperboard.ko 2024-06-13T10:57:25.248 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/mfd/vx855.ko 2024-06-13T10:57:25.248 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/mfd/wl1273-core.ko 2024-06-13T10:57:25.248 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc 2024-06-13T10:57:25.248 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/altera-stapl 2024-06-13T10:57:25.248 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-06-13T10:57:25.248 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/apds9802als.ko 2024-06-13T10:57:25.248 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/apds990x.ko 2024-06-13T10:57:25.248 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/bh1770glc.ko 2024-06-13T10:57:25.248 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/cb710 2024-06-13T10:57:25.248 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/cb710/cb710.ko 2024-06-13T10:57:25.248 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/eeprom 2024-06-13T10:57:25.248 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/eeprom/at24.ko 2024-06-13T10:57:25.248 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-06-13T10:57:25.249 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/eeprom/max6875.ko 2024-06-13T10:57:25.249 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/enclosure.ko 2024-06-13T10:57:25.249 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/hpilo.ko 2024-06-13T10:57:25.249 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/isl29003.ko 2024-06-13T10:57:25.249 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/isl29020.ko 2024-06-13T10:57:25.249 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/lis3lv02d 2024-06-13T10:57:25.249 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-06-13T10:57:25.249 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-06-13T10:57:25.249 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/mei 2024-06-13T10:57:25.249 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/mei/mei-me.ko 2024-06-13T10:57:25.249 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/mei/mei-txe.ko 2024-06-13T10:57:25.249 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/mei/mei.ko 2024-06-13T10:57:25.249 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/sgi-gru 2024-06-13T10:57:25.249 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/sgi-gru/gru.ko 2024-06-13T10:57:25.250 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/sgi-xp 2024-06-13T10:57:25.250 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/sgi-xp/xp.ko 2024-06-13T10:57:25.250 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/sgi-xp/xpc.ko 2024-06-13T10:57:25.250 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-06-13T10:57:25.250 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/tifm_7xx1.ko 2024-06-13T10:57:25.250 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/tifm_core.ko 2024-06-13T10:57:25.250 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/tsl2550.ko 2024-06-13T10:57:25.250 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/vmw_balloon.ko 2024-06-13T10:57:25.250 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/vmw_vmci 2024-06-13T10:57:25.250 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-06-13T10:57:25.250 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net 2024-06-13T10:57:25.250 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/bonding 2024-06-13T10:57:25.250 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/bonding/bonding.ko 2024-06-13T10:57:25.251 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/dsa 2024-06-13T10:57:25.251 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/dsa/b53 2024-06-13T10:57:25.251 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/dsa/b53/b53_common.ko 2024-06-13T10:57:25.251 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/dsa/bcm-sf2.ko 2024-06-13T10:57:25.251 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/dsa/mv88e6060.ko 2024-06-13T10:57:25.251 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/dsa/mv88e6xxx 2024-06-13T10:57:25.251 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-06-13T10:57:25.251 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/dummy.ko 2024-06-13T10:57:25.251 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/eql.ko 2024-06-13T10:57:25.251 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet 2024-06-13T10:57:25.251 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/3com 2024-06-13T10:57:25.251 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-06-13T10:57:25.251 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-06-13T10:57:25.252 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-06-13T10:57:25.252 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-06-13T10:57:25.252 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/8390 2024-06-13T10:57:25.252 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/8390/8390.ko 2024-06-13T10:57:25.252 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-06-13T10:57:25.252 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-06-13T10:57:25.252 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-06-13T10:57:25.252 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/adaptec 2024-06-13T10:57:25.252 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-06-13T10:57:25.252 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/agere 2024-06-13T10:57:25.252 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/agere/et131x.ko 2024-06-13T10:57:25.252 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/alteon 2024-06-13T10:57:25.252 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-06-13T10:57:25.253 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/altera 2024-06-13T10:57:25.253 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-06-13T10:57:25.253 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/amd 2024-06-13T10:57:25.253 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-06-13T10:57:25.253 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-06-13T10:57:25.253 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-06-13T10:57:25.253 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros 2024-06-13T10:57:25.253 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/alx 2024-06-13T10:57:25.253 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-06-13T10:57:25.253 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/atl1c 2024-06-13T10:57:25.253 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-06-13T10:57:25.253 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/atl1e 2024-06-13T10:57:25.253 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-06-13T10:57:25.253 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/atlx 2024-06-13T10:57:25.253 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-06-13T10:57:25.254 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-06-13T10:57:25.254 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom 2024-06-13T10:57:25.254 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-06-13T10:57:25.254 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-06-13T10:57:25.254 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-06-13T10:57:25.254 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-06-13T10:57:25.254 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-06-13T10:57:25.254 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom/genet 2024-06-13T10:57:25.254 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-06-13T10:57:25.254 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-06-13T10:57:25.254 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/brocade 2024-06-13T10:57:25.254 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/brocade/bna 2024-06-13T10:57:25.254 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-06-13T10:57:25.255 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio 2024-06-13T10:57:25.255 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/cxgb 2024-06-13T10:57:25.255 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-06-13T10:57:25.255 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-06-13T10:57:25.255 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-06-13T10:57:25.255 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-06-13T10:57:25.255 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-06-13T10:57:25.255 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-06-13T10:57:25.255 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-06-13T10:57:25.255 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-06-13T10:57:25.255 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-06-13T10:57:25.255 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/cisco 2024-06-13T10:57:25.255 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/cisco/enic 2024-06-13T10:57:25.255 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-06-13T10:57:25.256 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dec 2024-06-13T10:57:25.256 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dec/tulip 2024-06-13T10:57:25.256 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-06-13T10:57:25.256 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-06-13T10:57:25.256 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-06-13T10:57:25.256 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-06-13T10:57:25.256 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-06-13T10:57:25.256 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-06-13T10:57:25.256 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dlink 2024-06-13T10:57:25.256 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-06-13T10:57:25.256 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-06-13T10:57:25.256 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dnet.ko 2024-06-13T10:57:25.256 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/emulex 2024-06-13T10:57:25.256 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/emulex/benet 2024-06-13T10:57:25.257 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-06-13T10:57:25.257 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/ethoc.ko 2024-06-13T10:57:25.257 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/fealnx.ko 2024-06-13T10:57:25.257 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel 2024-06-13T10:57:25.257 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/e100.ko 2024-06-13T10:57:25.257 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/e1000 2024-06-13T10:57:25.257 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-06-13T10:57:25.257 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/e1000e 2024-06-13T10:57:25.257 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-06-13T10:57:25.257 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/fm10k 2024-06-13T10:57:25.257 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-06-13T10:57:25.257 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/i40e 2024-06-13T10:57:25.257 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-06-13T10:57:25.258 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/iavf 2024-06-13T10:57:25.258 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-06-13T10:57:25.258 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/igb 2024-06-13T10:57:25.258 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-06-13T10:57:25.258 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/igbvf 2024-06-13T10:57:25.258 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-06-13T10:57:25.258 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/ixgbe 2024-06-13T10:57:25.258 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-06-13T10:57:25.258 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/ixgbevf 2024-06-13T10:57:25.258 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-06-13T10:57:25.258 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/jme.ko 2024-06-13T10:57:25.258 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/marvell 2024-06-13T10:57:25.258 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-06-13T10:57:25.259 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/marvell/skge.ko 2024-06-13T10:57:25.259 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-06-13T10:57:25.259 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/mellanox 2024-06-13T10:57:25.259 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/mellanox/mlx4 2024-06-13T10:57:25.259 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-06-13T10:57:25.259 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-06-13T10:57:25.259 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/mellanox/mlx5 2024-06-13T10:57:25.259 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-06-13T10:57:25.259 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-06-13T10:57:25.259 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/micrel 2024-06-13T10:57:25.259 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-06-13T10:57:25.259 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/myricom 2024-06-13T10:57:25.259 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/myricom/myri10ge 2024-06-13T10:57:25.259 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-06-13T10:57:25.260 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/natsemi 2024-06-13T10:57:25.260 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-06-13T10:57:25.260 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-06-13T10:57:25.260 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/neterion 2024-06-13T10:57:25.260 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-06-13T10:57:25.260 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/nvidia 2024-06-13T10:57:25.260 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-06-13T10:57:25.260 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/packetengines 2024-06-13T10:57:25.260 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-06-13T10:57:25.260 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-06-13T10:57:25.260 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/qlogic 2024-06-13T10:57:25.260 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/qlogic/netxen 2024-06-13T10:57:25.260 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-06-13T10:57:25.260 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-06-13T10:57:25.261 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-06-13T10:57:25.261 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-06-13T10:57:25.261 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/rdc 2024-06-13T10:57:25.261 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-06-13T10:57:25.261 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/realtek 2024-06-13T10:57:25.261 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-06-13T10:57:25.261 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-06-13T10:57:25.261 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/realtek/atp.ko 2024-06-13T10:57:25.261 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-06-13T10:57:25.261 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/rocker 2024-06-13T10:57:25.261 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-06-13T10:57:25.261 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sfc 2024-06-13T10:57:25.261 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-06-13T10:57:25.261 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/silan 2024-06-13T10:57:25.261 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-06-13T10:57:25.262 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sis 2024-06-13T10:57:25.262 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sis/sis190.ko 2024-06-13T10:57:25.262 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sis/sis900.ko 2024-06-13T10:57:25.262 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/smsc 2024-06-13T10:57:25.262 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-06-13T10:57:25.262 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-06-13T10:57:25.262 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-06-13T10:57:25.262 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-06-13T10:57:25.262 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/stmicro 2024-06-13T10:57:25.262 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/stmicro/stmmac 2024-06-13T10:57:25.262 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-06-13T10:57:25.262 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-06-13T10:57:25.262 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sun 2024-06-13T10:57:25.263 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sun/cassini.ko 2024-06-13T10:57:25.263 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sun/niu.ko 2024-06-13T10:57:25.263 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sun/sungem.ko 2024-06-13T10:57:25.263 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-06-13T10:57:25.263 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/tehuti 2024-06-13T10:57:25.263 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-06-13T10:57:25.263 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/ti 2024-06-13T10:57:25.263 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/ti/tlan.ko 2024-06-13T10:57:25.263 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/via 2024-06-13T10:57:25.263 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-06-13T10:57:25.263 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-06-13T10:57:25.263 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/wiznet 2024-06-13T10:57:25.263 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-06-13T10:57:25.263 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-06-13T10:57:25.264 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/xircom 2024-06-13T10:57:25.264 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-06-13T10:57:25.264 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/geneve.ko 2024-06-13T10:57:25.264 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/hyperv 2024-06-13T10:57:25.264 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-06-13T10:57:25.264 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ieee802154 2024-06-13T10:57:25.264 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ieee802154/fakelb.ko 2024-06-13T10:57:25.264 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ifb.ko 2024-06-13T10:57:25.264 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ipvlan 2024-06-13T10:57:25.264 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ipvlan/ipvlan.ko 2024-06-13T10:57:25.264 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/macvlan.ko 2024-06-13T10:57:25.264 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/macvtap.ko 2024-06-13T10:57:25.264 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/mdio 2024-06-13T10:57:25.264 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/mdio.ko 2024-06-13T10:57:25.265 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-06-13T10:57:25.265 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-06-13T10:57:25.265 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/mdio/mdio-regmap.ko 2024-06-13T10:57:25.265 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/mii.ko 2024-06-13T10:57:25.265 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/net_failover.ko 2024-06-13T10:57:25.265 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/netconsole.ko 2024-06-13T10:57:25.265 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/nlmon.ko 2024-06-13T10:57:25.265 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/pcs 2024-06-13T10:57:25.265 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/pcs/pcs-lynx.ko 2024-06-13T10:57:25.265 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-06-13T10:57:25.265 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy 2024-06-13T10:57:25.265 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/amd.ko 2024-06-13T10:57:25.265 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-06-13T10:57:25.265 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-06-13T10:57:25.266 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/bcm7xxx.ko 2024-06-13T10:57:25.266 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/bcm87xx.ko 2024-06-13T10:57:25.266 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/broadcom.ko 2024-06-13T10:57:25.266 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/cicada.ko 2024-06-13T10:57:25.266 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/davicom.ko 2024-06-13T10:57:25.266 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/dp83640.ko 2024-06-13T10:57:25.266 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/et1011c.ko 2024-06-13T10:57:25.266 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/icplus.ko 2024-06-13T10:57:25.266 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/lxt.ko 2024-06-13T10:57:25.266 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/marvell.ko 2024-06-13T10:57:25.266 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/micrel.ko 2024-06-13T10:57:25.266 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/national.ko 2024-06-13T10:57:25.266 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/phylink.ko 2024-06-13T10:57:25.267 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/qsemi.ko 2024-06-13T10:57:25.267 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/realtek.ko 2024-06-13T10:57:25.267 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/smsc.ko 2024-06-13T10:57:25.267 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/ste10Xp.ko 2024-06-13T10:57:25.267 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/vitesse.ko 2024-06-13T10:57:25.267 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp 2024-06-13T10:57:25.267 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/bsd_comp.ko 2024-06-13T10:57:25.267 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/ppp_async.ko 2024-06-13T10:57:25.267 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/ppp_deflate.ko 2024-06-13T10:57:25.267 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/ppp_generic.ko 2024-06-13T10:57:25.267 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/ppp_mppe.ko 2024-06-13T10:57:25.267 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/ppp_synctty.ko 2024-06-13T10:57:25.267 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/pppoe.ko 2024-06-13T10:57:25.267 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/pppox.ko 2024-06-13T10:57:25.268 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/pptp.ko 2024-06-13T10:57:25.268 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/slip 2024-06-13T10:57:25.268 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/slip/slhc.ko 2024-06-13T10:57:25.268 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/slip/slip.ko 2024-06-13T10:57:25.268 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/sungem_phy.ko 2024-06-13T10:57:25.268 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/tap.ko 2024-06-13T10:57:25.268 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/team 2024-06-13T10:57:25.268 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/team/team.ko 2024-06-13T10:57:25.268 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/team/team_mode_activebackup.ko 2024-06-13T10:57:25.268 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/team/team_mode_broadcast.ko 2024-06-13T10:57:25.268 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-06-13T10:57:25.268 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/team/team_mode_random.ko 2024-06-13T10:57:25.268 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-06-13T10:57:25.268 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/tun.ko 2024-06-13T10:57:25.269 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/veth.ko 2024-06-13T10:57:25.269 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/virtio_net.ko 2024-06-13T10:57:25.269 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/vmxnet3 2024-06-13T10:57:25.269 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-06-13T10:57:25.269 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/vxlan 2024-06-13T10:57:25.269 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/vxlan/vxlan.ko 2024-06-13T10:57:25.269 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/xen-netback 2024-06-13T10:57:25.269 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/xen-netback/xen-netback.ko 2024-06-13T10:57:25.269 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/xen-netfront.ko 2024-06-13T10:57:25.269 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ntb 2024-06-13T10:57:25.269 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ntb/ntb.ko 2024-06-13T10:57:25.269 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/nvme 2024-06-13T10:57:25.269 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/nvme/host 2024-06-13T10:57:25.270 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/nvme/host/nvme-core.ko 2024-06-13T10:57:25.270 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/nvme/host/nvme.ko 2024-06-13T10:57:25.270 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/parport 2024-06-13T10:57:25.270 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/parport/parport.ko 2024-06-13T10:57:25.270 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/parport/parport_cs.ko 2024-06-13T10:57:25.270 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/parport/parport_pc.ko 2024-06-13T10:57:25.270 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/parport/parport_serial.ko 2024-06-13T10:57:25.270 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pci 2024-06-13T10:57:25.270 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pci/hotplug 2024-06-13T10:57:25.270 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-06-13T10:57:25.270 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pci/pcie 2024-06-13T10:57:25.270 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pci/pcie/aer_inject.ko 2024-06-13T10:57:25.270 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pci/xen-pcifront.ko 2024-06-13T10:57:25.271 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pcmcia 2024-06-13T10:57:25.271 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pcmcia/i82092.ko 2024-06-13T10:57:25.271 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pcmcia/pd6729.ko 2024-06-13T10:57:25.271 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pcmcia/yenta_socket.ko 2024-06-13T10:57:25.271 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pinctrl 2024-06-13T10:57:25.271 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pinctrl/intel 2024-06-13T10:57:25.271 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-06-13T10:57:25.271 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform 2024-06-13T10:57:25.271 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86 2024-06-13T10:57:25.271 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/acer-wmi.ko 2024-06-13T10:57:25.271 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/acerhdf.ko 2024-06-13T10:57:25.271 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/apple-gmux.ko 2024-06-13T10:57:25.271 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/asus-laptop.ko 2024-06-13T10:57:25.271 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-06-13T10:57:25.272 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/asus-wmi.ko 2024-06-13T10:57:25.272 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/classmate-laptop.ko 2024-06-13T10:57:25.272 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-06-13T10:57:25.272 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-06-13T10:57:25.272 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-06-13T10:57:25.272 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-06-13T10:57:25.272 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/hdaps.ko 2024-06-13T10:57:25.272 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/intel 2024-06-13T10:57:25.272 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-06-13T10:57:25.272 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/intel_ips.ko 2024-06-13T10:57:25.272 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/msi-wmi.ko 2024-06-13T10:57:25.272 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/mxm-wmi.ko 2024-06-13T10:57:25.272 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-06-13T10:57:25.272 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/samsung-laptop.ko 2024-06-13T10:57:25.272 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/samsung-q10.ko 2024-06-13T10:57:25.273 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/topstar-laptop.ko 2024-06-13T10:57:25.273 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-06-13T10:57:25.273 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/toshiba_haps.ko 2024-06-13T10:57:25.273 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/wmi-bmof.ko 2024-06-13T10:57:25.273 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/wmi.ko 2024-06-13T10:57:25.273 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/powercap 2024-06-13T10:57:25.273 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/powercap/intel_rapl_common.ko 2024-06-13T10:57:25.273 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/powercap/intel_rapl_msr.ko 2024-06-13T10:57:25.273 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pps 2024-06-13T10:57:25.273 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pps/clients 2024-06-13T10:57:25.273 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pps/clients/pps-gpio.ko 2024-06-13T10:57:25.273 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pps/clients/pps-ldisc.ko 2024-06-13T10:57:25.273 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pps/clients/pps_parport.ko 2024-06-13T10:57:25.274 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pps/pps_core.ko 2024-06-13T10:57:25.274 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ptp 2024-06-13T10:57:25.274 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ptp/ptp.ko 2024-06-13T10:57:25.274 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ptp/ptp_kvm.ko 2024-06-13T10:57:25.274 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ras 2024-06-13T10:57:25.274 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ras/amd 2024-06-13T10:57:25.274 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ras/amd/atl 2024-06-13T10:57:25.274 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-06-13T10:57:25.274 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ras/amd/fmpm.ko 2024-06-13T10:57:25.274 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc 2024-06-13T10:57:25.274 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-bq32k.ko 2024-06-13T10:57:25.274 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds1286.ko 2024-06-13T10:57:25.275 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds1307.ko 2024-06-13T10:57:25.275 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds1374.ko 2024-06-13T10:57:25.275 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds1511.ko 2024-06-13T10:57:25.275 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds1553.ko 2024-06-13T10:57:25.275 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds1672.ko 2024-06-13T10:57:25.275 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds1742.ko 2024-06-13T10:57:25.275 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds2404.ko 2024-06-13T10:57:25.275 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds3232.ko 2024-06-13T10:57:25.275 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-em3027.ko 2024-06-13T10:57:25.275 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-fm3130.ko 2024-06-13T10:57:25.275 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-isl12022.ko 2024-06-13T10:57:25.275 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-isl1208.ko 2024-06-13T10:57:25.275 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-m41t80.ko 2024-06-13T10:57:25.276 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-m48t35.ko 2024-06-13T10:57:25.276 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-m48t59.ko 2024-06-13T10:57:25.276 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-max6900.ko 2024-06-13T10:57:25.276 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-msm6242.ko 2024-06-13T10:57:25.276 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-pcf2127.ko 2024-06-13T10:57:25.276 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-pcf85063.ko 2024-06-13T10:57:25.276 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-pcf8523.ko 2024-06-13T10:57:25.276 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-pcf8563.ko 2024-06-13T10:57:25.276 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-pcf8583.ko 2024-06-13T10:57:25.276 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-rp5c01.ko 2024-06-13T10:57:25.276 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-rs5c372.ko 2024-06-13T10:57:25.276 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-06-13T10:57:25.276 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-rx8025.ko 2024-06-13T10:57:25.277 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-rx8581.ko 2024-06-13T10:57:25.277 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-06-13T10:57:25.277 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-x1205.ko 2024-06-13T10:57:25.277 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi 2024-06-13T10:57:25.277 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/3w-9xxx.ko 2024-06-13T10:57:25.277 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/3w-sas.ko 2024-06-13T10:57:25.277 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/3w-xxxx.ko 2024-06-13T10:57:25.277 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/BusLogic.ko 2024-06-13T10:57:25.277 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/a100u2w.ko 2024-06-13T10:57:25.277 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/aacraid 2024-06-13T10:57:25.277 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/aacraid/aacraid.ko 2024-06-13T10:57:25.277 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/advansys.ko 2024-06-13T10:57:25.277 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/aic7xxx 2024-06-13T10:57:25.277 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-06-13T10:57:25.278 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-06-13T10:57:25.278 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/am53c974.ko 2024-06-13T10:57:25.278 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/arcmsr 2024-06-13T10:57:25.278 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-06-13T10:57:25.278 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/atp870u.ko 2024-06-13T10:57:25.278 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/be2iscsi 2024-06-13T10:57:25.278 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-06-13T10:57:25.278 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/bfa 2024-06-13T10:57:25.278 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/bfa/bfa.ko 2024-06-13T10:57:25.278 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/bnx2fc 2024-06-13T10:57:25.278 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-06-13T10:57:25.278 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/bnx2i 2024-06-13T10:57:25.278 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-06-13T10:57:25.279 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/ch.ko 2024-06-13T10:57:25.279 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/csiostor 2024-06-13T10:57:25.279 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/csiostor/csiostor.ko 2024-06-13T10:57:25.279 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/cxgbi 2024-06-13T10:57:25.279 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/cxgbi/cxgb3i 2024-06-13T10:57:25.279 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-06-13T10:57:25.279 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/cxgbi/cxgb4i 2024-06-13T10:57:25.279 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-06-13T10:57:25.279 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-06-13T10:57:25.279 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/dc395x.ko 2024-06-13T10:57:25.279 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/device_handler 2024-06-13T10:57:25.279 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-06-13T10:57:25.279 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-06-13T10:57:25.279 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-06-13T10:57:25.280 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-06-13T10:57:25.280 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/dmx3191d.ko 2024-06-13T10:57:25.280 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/esas2r 2024-06-13T10:57:25.280 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/esas2r/esas2r.ko 2024-06-13T10:57:25.280 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/esp_scsi.ko 2024-06-13T10:57:25.280 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/fcoe 2024-06-13T10:57:25.280 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/fcoe/fcoe.ko 2024-06-13T10:57:25.280 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-06-13T10:57:25.280 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/fnic 2024-06-13T10:57:25.280 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/fnic/fnic.ko 2024-06-13T10:57:25.280 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/hpsa.ko 2024-06-13T10:57:25.280 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/hptiop.ko 2024-06-13T10:57:25.280 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/hv_storvsc.ko 2024-06-13T10:57:25.280 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/initio.ko 2024-06-13T10:57:25.281 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/ipr.ko 2024-06-13T10:57:25.281 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/ips.ko 2024-06-13T10:57:25.281 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/isci 2024-06-13T10:57:25.281 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/isci/isci.ko 2024-06-13T10:57:25.281 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-06-13T10:57:25.281 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/iscsi_tcp.ko 2024-06-13T10:57:25.281 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/libfc 2024-06-13T10:57:25.281 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/libfc/libfc.ko 2024-06-13T10:57:25.281 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/libiscsi.ko 2024-06-13T10:57:25.281 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/libiscsi_tcp.ko 2024-06-13T10:57:25.281 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/libsas 2024-06-13T10:57:25.281 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/libsas/libsas.ko 2024-06-13T10:57:25.281 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/lpfc 2024-06-13T10:57:25.282 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/lpfc/lpfc.ko 2024-06-13T10:57:25.282 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/megaraid 2024-06-13T10:57:25.282 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/megaraid.ko 2024-06-13T10:57:25.282 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-06-13T10:57:25.282 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-06-13T10:57:25.282 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-06-13T10:57:25.282 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/mpt3sas 2024-06-13T10:57:25.282 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-06-13T10:57:25.282 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/mvsas 2024-06-13T10:57:25.282 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/mvsas/mvsas.ko 2024-06-13T10:57:25.282 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/mvumi.ko 2024-06-13T10:57:25.282 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/pm8001 2024-06-13T10:57:25.282 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-06-13T10:57:25.283 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/pmcraid.ko 2024-06-13T10:57:25.283 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/qla1280.ko 2024-06-13T10:57:25.283 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/qla2xxx 2024-06-13T10:57:25.283 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-06-13T10:57:25.283 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-06-13T10:57:25.283 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/qla4xxx 2024-06-13T10:57:25.283 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-06-13T10:57:25.283 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/raid_class.ko 2024-06-13T10:57:25.283 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/scsi_debug.ko 2024-06-13T10:57:25.283 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/scsi_transport_fc.ko 2024-06-13T10:57:25.283 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-06-13T10:57:25.283 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/scsi_transport_sas.ko 2024-06-13T10:57:25.283 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/scsi_transport_spi.ko 2024-06-13T10:57:25.284 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/scsi_transport_srp.ko 2024-06-13T10:57:25.284 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/ses.ko 2024-06-13T10:57:25.284 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/st.ko 2024-06-13T10:57:25.284 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/stex.ko 2024-06-13T10:57:25.284 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/sym53c8xx_2 2024-06-13T10:57:25.284 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-06-13T10:57:25.284 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/virtio_scsi.ko 2024-06-13T10:57:25.284 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/vmw_pvscsi.ko 2024-06-13T10:57:25.284 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/wd719x.ko 2024-06-13T10:57:25.284 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ssb 2024-06-13T10:57:25.284 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ssb/ssb.ko 2024-06-13T10:57:25.284 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target 2024-06-13T10:57:25.284 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/iscsi 2024-06-13T10:57:25.284 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-06-13T10:57:25.285 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/loopback 2024-06-13T10:57:25.285 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/loopback/tcm_loop.ko 2024-06-13T10:57:25.285 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/target_core_file.ko 2024-06-13T10:57:25.285 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/target_core_iblock.ko 2024-06-13T10:57:25.285 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/target_core_mod.ko 2024-06-13T10:57:25.285 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/target_core_pscsi.ko 2024-06-13T10:57:25.285 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/target_core_user.ko 2024-06-13T10:57:25.285 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/tcm_fc 2024-06-13T10:57:25.285 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-06-13T10:57:25.285 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal 2024-06-13T10:57:25.285 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel 2024-06-13T10:57:25.285 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal 2024-06-13T10:57:25.285 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-06-13T10:57:25.285 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-06-13T10:57:25.285 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-06-13T10:57:25.286 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-06-13T10:57:25.286 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-06-13T10:57:25.286 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-06-13T10:57:25.286 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-06-13T10:57:25.286 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-06-13T10:57:25.286 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-06-13T10:57:25.286 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-06-13T10:57:25.286 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-06-13T10:57:25.286 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-06-13T10:57:25.286 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-06-13T10:57:25.286 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-06-13T10:57:25.286 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-06-13T10:57:25.286 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-06-13T10:57:25.287 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-06-13T10:57:25.287 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-06-13T10:57:25.287 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty 2024-06-13T10:57:25.287 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/ipwireless 2024-06-13T10:57:25.287 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-06-13T10:57:25.287 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/n_gsm.ko 2024-06-13T10:57:25.287 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/n_hdlc.ko 2024-06-13T10:57:25.287 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/nozomi.ko 2024-06-13T10:57:25.287 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/serial 2024-06-13T10:57:25.287 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/serial/8250 2024-06-13T10:57:25.287 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-06-13T10:57:25.287 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/serial/arc_uart.ko 2024-06-13T10:57:25.287 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/serial/jsm 2024-06-13T10:57:25.287 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/serial/jsm/jsm.ko 2024-06-13T10:57:25.288 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ufs 2024-06-13T10:57:25.288 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ufs/core 2024-06-13T10:57:25.288 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ufs/core/ufshcd-core.ko 2024-06-13T10:57:25.288 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ufs/host 2024-06-13T10:57:25.288 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-06-13T10:57:25.288 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/uio 2024-06-13T10:57:25.288 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/uio/uio.ko 2024-06-13T10:57:25.288 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/uio/uio_aec.ko 2024-06-13T10:57:25.288 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/uio/uio_cif.ko 2024-06-13T10:57:25.288 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/uio/uio_pci_generic.ko 2024-06-13T10:57:25.288 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/uio/uio_sercos3.ko 2024-06-13T10:57:25.288 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb 2024-06-13T10:57:25.288 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/class 2024-06-13T10:57:25.288 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/class/cdc-acm.ko 2024-06-13T10:57:25.289 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/class/cdc-wdm.ko 2024-06-13T10:57:25.289 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/class/usblp.ko 2024-06-13T10:57:25.289 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/class/usbtmc.ko 2024-06-13T10:57:25.289 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/host 2024-06-13T10:57:25.289 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/host/sl811-hcd.ko 2024-06-13T10:57:25.289 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/image 2024-06-13T10:57:25.289 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/image/mdc800.ko 2024-06-13T10:57:25.289 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/image/microtek.ko 2024-06-13T10:57:25.289 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc 2024-06-13T10:57:25.289 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/adutux.ko 2024-06-13T10:57:25.289 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/appledisplay.ko 2024-06-13T10:57:25.289 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/emi26.ko 2024-06-13T10:57:25.289 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/emi62.ko 2024-06-13T10:57:25.289 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/ezusb.ko 2024-06-13T10:57:25.289 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/idmouse.ko 2024-06-13T10:57:25.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/iowarrior.ko 2024-06-13T10:57:25.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/isight_firmware.ko 2024-06-13T10:57:25.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/ldusb.ko 2024-06-13T10:57:25.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/legousbtower.ko 2024-06-13T10:57:25.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/sisusbvga 2024-06-13T10:57:25.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-06-13T10:57:25.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/trancevibrator.ko 2024-06-13T10:57:25.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/usb3503.ko 2024-06-13T10:57:25.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/usblcd.ko 2024-06-13T10:57:25.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/usbsevseg.ko 2024-06-13T10:57:25.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/uss720.ko 2024-06-13T10:57:25.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/yurex.ko 2024-06-13T10:57:25.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/phy 2024-06-13T10:57:25.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/phy/phy-generic.ko 2024-06-13T10:57:25.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial 2024-06-13T10:57:25.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/aircable.ko 2024-06-13T10:57:25.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/ark3116.ko 2024-06-13T10:57:25.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/belkin_sa.ko 2024-06-13T10:57:25.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/ch341.ko 2024-06-13T10:57:25.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/cp210x.ko 2024-06-13T10:57:25.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/cyberjack.ko 2024-06-13T10:57:25.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/cypress_m8.ko 2024-06-13T10:57:25.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/digi_acceleport.ko 2024-06-13T10:57:25.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/empeg.ko 2024-06-13T10:57:25.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/ftdi_sio.ko 2024-06-13T10:57:25.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/garmin_gps.ko 2024-06-13T10:57:25.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/io_edgeport.ko 2024-06-13T10:57:25.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/io_ti.ko 2024-06-13T10:57:25.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/ipaq.ko 2024-06-13T10:57:25.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/ipw.ko 2024-06-13T10:57:25.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/ir-usb.ko 2024-06-13T10:57:25.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-06-13T10:57:25.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/keyspan.ko 2024-06-13T10:57:25.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/keyspan_pda.ko 2024-06-13T10:57:25.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/kl5kusb105.ko 2024-06-13T10:57:25.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/kobil_sct.ko 2024-06-13T10:57:25.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/mct_u232.ko 2024-06-13T10:57:25.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/mos7720.ko 2024-06-13T10:57:25.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/mos7840.ko 2024-06-13T10:57:25.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/navman.ko 2024-06-13T10:57:25.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/omninet.ko 2024-06-13T10:57:25.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/opticon.ko 2024-06-13T10:57:25.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/option.ko 2024-06-13T10:57:25.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/oti6858.ko 2024-06-13T10:57:25.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/pl2303.ko 2024-06-13T10:57:25.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/qcaux.ko 2024-06-13T10:57:25.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/qcserial.ko 2024-06-13T10:57:25.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/quatech2.ko 2024-06-13T10:57:25.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/safe_serial.ko 2024-06-13T10:57:25.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/sierra.ko 2024-06-13T10:57:25.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/spcp8x5.ko 2024-06-13T10:57:25.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/ssu100.ko 2024-06-13T10:57:25.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/symbolserial.ko 2024-06-13T10:57:25.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-06-13T10:57:25.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-06-13T10:57:25.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/usb_debug.ko 2024-06-13T10:57:25.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/usb_wwan.ko 2024-06-13T10:57:25.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/visor.ko 2024-06-13T10:57:25.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/whiteheat.ko 2024-06-13T10:57:25.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/xsens_mt.ko 2024-06-13T10:57:25.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage 2024-06-13T10:57:25.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/uas.ko 2024-06-13T10:57:25.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-alauda.ko 2024-06-13T10:57:25.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-cypress.ko 2024-06-13T10:57:25.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-datafab.ko 2024-06-13T10:57:25.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-06-13T10:57:25.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-freecom.ko 2024-06-13T10:57:25.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-isd200.ko 2024-06-13T10:57:25.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-06-13T10:57:25.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-karma.ko 2024-06-13T10:57:25.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-onetouch.ko 2024-06-13T10:57:25.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-realtek.ko 2024-06-13T10:57:25.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-sddr09.ko 2024-06-13T10:57:25.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-sddr55.ko 2024-06-13T10:57:25.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-usbat.ko 2024-06-13T10:57:25.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/usb-storage.ko 2024-06-13T10:57:25.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/usbip 2024-06-13T10:57:25.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/usbip/usbip-core.ko 2024-06-13T10:57:25.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/usbip/usbip-host.ko 2024-06-13T10:57:25.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-06-13T10:57:25.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vfio 2024-06-13T10:57:25.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vfio/pci 2024-06-13T10:57:25.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-06-13T10:57:25.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vfio/pci/vfio-pci.ko 2024-06-13T10:57:25.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vfio/vfio.ko 2024-06-13T10:57:25.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-06-13T10:57:25.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vhost 2024-06-13T10:57:25.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vhost/vhost.ko 2024-06-13T10:57:25.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vhost/vhost_iotlb.ko 2024-06-13T10:57:25.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vhost/vhost_net.ko 2024-06-13T10:57:25.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vhost/vhost_scsi.ko 2024-06-13T10:57:25.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/video 2024-06-13T10:57:25.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/video/backlight 2024-06-13T10:57:25.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/video/backlight/apple_bl.ko 2024-06-13T10:57:25.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/video/backlight/lcd.ko 2024-06-13T10:57:25.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/video/backlight/platform_lcd.ko 2024-06-13T10:57:25.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/virtio 2024-06-13T10:57:25.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/virtio/virtio.ko 2024-06-13T10:57:25.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/virtio/virtio_balloon.ko 2024-06-13T10:57:25.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/virtio/virtio_mmio.ko 2024-06-13T10:57:25.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/virtio/virtio_pci.ko 2024-06-13T10:57:25.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-06-13T10:57:25.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-06-13T10:57:25.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/virtio/virtio_ring.ko 2024-06-13T10:57:25.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1 2024-06-13T10:57:25.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/masters 2024-06-13T10:57:25.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/masters/ds2482.ko 2024-06-13T10:57:25.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/masters/ds2490.ko 2024-06-13T10:57:25.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves 2024-06-13T10:57:25.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-06-13T10:57:25.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-06-13T10:57:25.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-06-13T10:57:25.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-06-13T10:57:25.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-06-13T10:57:25.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-06-13T10:57:25.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-06-13T10:57:25.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-06-13T10:57:25.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-06-13T10:57:25.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_smem.ko 2024-06-13T10:57:25.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_therm.ko 2024-06-13T10:57:25.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/wire.ko 2024-06-13T10:57:25.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog 2024-06-13T10:57:25.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/alim1535_wdt.ko 2024-06-13T10:57:25.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/alim7101_wdt.ko 2024-06-13T10:57:25.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/f71808e_wdt.ko 2024-06-13T10:57:25.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/hpwdt.ko 2024-06-13T10:57:25.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/i6300esb.ko 2024-06-13T10:57:25.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-06-13T10:57:25.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/iTCO_wdt.ko 2024-06-13T10:57:25.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/ib700wdt.ko 2024-06-13T10:57:25.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/ibmasr.ko 2024-06-13T10:57:25.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-06-13T10:57:25.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/it8712f_wdt.ko 2024-06-13T10:57:25.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/it87_wdt.ko 2024-06-13T10:57:25.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/machzwd.ko 2024-06-13T10:57:25.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/nv_tco.ko 2024-06-13T10:57:25.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/pcwd_pci.ko 2024-06-13T10:57:25.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/pcwd_usb.ko 2024-06-13T10:57:25.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-06-13T10:57:25.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/sch311x_wdt.ko 2024-06-13T10:57:25.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/softdog.ko 2024-06-13T10:57:25.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/sp5100_tco.ko 2024-06-13T10:57:25.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/via_wdt.ko 2024-06-13T10:57:25.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-06-13T10:57:25.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/w83877f_wdt.ko 2024-06-13T10:57:25.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/w83977f_wdt.ko 2024-06-13T10:57:25.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/wdt_pci.ko 2024-06-13T10:57:25.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/xen_wdt.ko 2024-06-13T10:57:25.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen 2024-06-13T10:57:25.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xen-acpi-processor.ko 2024-06-13T10:57:25.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xen-evtchn.ko 2024-06-13T10:57:25.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xen-gntalloc.ko 2024-06-13T10:57:25.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xen-gntdev.ko 2024-06-13T10:57:25.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xen-pciback 2024-06-13T10:57:25.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-06-13T10:57:25.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xen-privcmd.ko 2024-06-13T10:57:25.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xenfs 2024-06-13T10:57:25.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xenfs/xenfs.ko 2024-06-13T10:57:25.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs 2024-06-13T10:57:25.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/9p 2024-06-13T10:57:25.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/9p/9p.ko 2024-06-13T10:57:25.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/affs 2024-06-13T10:57:25.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/affs/affs.ko 2024-06-13T10:57:25.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/befs 2024-06-13T10:57:25.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/befs/befs.ko 2024-06-13T10:57:25.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/binfmt_misc.ko 2024-06-13T10:57:25.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/btrfs 2024-06-13T10:57:25.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/btrfs/btrfs.ko 2024-06-13T10:57:25.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/cachefiles 2024-06-13T10:57:25.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/cachefiles/cachefiles.ko 2024-06-13T10:57:25.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ceph 2024-06-13T10:57:25.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ceph/ceph.ko 2024-06-13T10:57:25.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/coda 2024-06-13T10:57:25.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/coda/coda.ko 2024-06-13T10:57:25.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/cramfs 2024-06-13T10:57:25.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/cramfs/cramfs.ko 2024-06-13T10:57:25.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/dlm 2024-06-13T10:57:25.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/dlm/dlm.ko 2024-06-13T10:57:25.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ecryptfs 2024-06-13T10:57:25.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ecryptfs/ecryptfs.ko 2024-06-13T10:57:25.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/f2fs 2024-06-13T10:57:25.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/f2fs/f2fs.ko 2024-06-13T10:57:25.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/fat 2024-06-13T10:57:25.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/fat/fat.ko 2024-06-13T10:57:25.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/fat/msdos.ko 2024-06-13T10:57:25.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/fat/vfat.ko 2024-06-13T10:57:25.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/fuse 2024-06-13T10:57:25.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/fuse/cuse.ko 2024-06-13T10:57:25.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/fuse/fuse.ko 2024-06-13T10:57:25.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/gfs2 2024-06-13T10:57:25.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/gfs2/gfs2.ko 2024-06-13T10:57:25.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/hfs 2024-06-13T10:57:25.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/hfs/hfs.ko 2024-06-13T10:57:25.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/hfsplus 2024-06-13T10:57:25.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/hfsplus/hfsplus.ko 2024-06-13T10:57:25.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/isofs 2024-06-13T10:57:25.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/isofs/isofs.ko 2024-06-13T10:57:25.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/jfs 2024-06-13T10:57:25.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/jfs/jfs.ko 2024-06-13T10:57:25.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/lockd 2024-06-13T10:57:25.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/lockd/lockd.ko 2024-06-13T10:57:25.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/minix 2024-06-13T10:57:25.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/minix/minix.ko 2024-06-13T10:57:25.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/netfs 2024-06-13T10:57:25.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/netfs/netfs.ko 2024-06-13T10:57:25.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs 2024-06-13T10:57:25.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/blocklayout 2024-06-13T10:57:25.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-06-13T10:57:25.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/filelayout 2024-06-13T10:57:25.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-06-13T10:57:25.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/flexfilelayout 2024-06-13T10:57:25.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-06-13T10:57:25.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/nfs.ko 2024-06-13T10:57:25.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/nfsv3.ko 2024-06-13T10:57:25.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/nfsv4.ko 2024-06-13T10:57:25.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs_common 2024-06-13T10:57:25.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs_common/grace.ko 2024-06-13T10:57:25.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs_common/nfs_acl.ko 2024-06-13T10:57:25.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfsd 2024-06-13T10:57:25.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfsd/nfsd.ko 2024-06-13T10:57:25.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nilfs2 2024-06-13T10:57:25.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nilfs2/nilfs2.ko 2024-06-13T10:57:25.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls 2024-06-13T10:57:25.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-celtic.ko 2024-06-13T10:57:25.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-centeuro.ko 2024-06-13T10:57:25.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-croatian.ko 2024-06-13T10:57:25.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-cyrillic.ko 2024-06-13T10:57:25.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-gaelic.ko 2024-06-13T10:57:25.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-greek.ko 2024-06-13T10:57:25.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-iceland.ko 2024-06-13T10:57:25.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-inuit.ko 2024-06-13T10:57:25.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-roman.ko 2024-06-13T10:57:25.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-romanian.ko 2024-06-13T10:57:25.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-turkish.ko 2024-06-13T10:57:25.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp1250.ko 2024-06-13T10:57:25.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp1251.ko 2024-06-13T10:57:25.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp1255.ko 2024-06-13T10:57:25.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp737.ko 2024-06-13T10:57:25.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp775.ko 2024-06-13T10:57:25.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp850.ko 2024-06-13T10:57:25.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp852.ko 2024-06-13T10:57:25.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp855.ko 2024-06-13T10:57:25.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp857.ko 2024-06-13T10:57:25.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp860.ko 2024-06-13T10:57:25.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp861.ko 2024-06-13T10:57:25.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp862.ko 2024-06-13T10:57:25.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp863.ko 2024-06-13T10:57:25.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp864.ko 2024-06-13T10:57:25.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp865.ko 2024-06-13T10:57:25.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp866.ko 2024-06-13T10:57:25.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp869.ko 2024-06-13T10:57:25.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp874.ko 2024-06-13T10:57:25.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp932.ko 2024-06-13T10:57:25.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp936.ko 2024-06-13T10:57:25.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp949.ko 2024-06-13T10:57:25.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp950.ko 2024-06-13T10:57:25.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_euc-jp.ko 2024-06-13T10:57:25.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-1.ko 2024-06-13T10:57:25.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-13.ko 2024-06-13T10:57:25.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-14.ko 2024-06-13T10:57:25.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-15.ko 2024-06-13T10:57:25.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-2.ko 2024-06-13T10:57:25.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-3.ko 2024-06-13T10:57:25.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-4.ko 2024-06-13T10:57:25.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-5.ko 2024-06-13T10:57:25.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-6.ko 2024-06-13T10:57:25.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-7.ko 2024-06-13T10:57:25.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-9.ko 2024-06-13T10:57:25.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_koi8-r.ko 2024-06-13T10:57:25.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_koi8-ru.ko 2024-06-13T10:57:25.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_koi8-u.ko 2024-06-13T10:57:25.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_ucs2_utils.ko 2024-06-13T10:57:25.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_utf8.ko 2024-06-13T10:57:25.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2 2024-06-13T10:57:25.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/cluster 2024-06-13T10:57:25.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-06-13T10:57:25.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/dlm 2024-06-13T10:57:25.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-06-13T10:57:25.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/dlmfs 2024-06-13T10:57:25.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-06-13T10:57:25.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/ocfs2.ko 2024-06-13T10:57:25.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-06-13T10:57:25.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-06-13T10:57:25.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-06-13T10:57:25.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/overlayfs 2024-06-13T10:57:25.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/overlayfs/overlay.ko 2024-06-13T10:57:25.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/pstore 2024-06-13T10:57:25.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/pstore/ramoops.ko 2024-06-13T10:57:25.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/reiserfs 2024-06-13T10:57:25.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/reiserfs/reiserfs.ko 2024-06-13T10:57:25.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/romfs 2024-06-13T10:57:25.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/romfs/romfs.ko 2024-06-13T10:57:25.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/smb 2024-06-13T10:57:25.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/smb/client 2024-06-13T10:57:25.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/smb/client/cifs.ko 2024-06-13T10:57:25.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/smb/common 2024-06-13T10:57:25.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/smb/common/cifs_arc4.ko 2024-06-13T10:57:25.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/smb/common/cifs_md4.ko 2024-06-13T10:57:25.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/squashfs 2024-06-13T10:57:25.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/squashfs/squashfs.ko 2024-06-13T10:57:25.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/sysv 2024-06-13T10:57:25.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/sysv/sysv.ko 2024-06-13T10:57:25.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/udf 2024-06-13T10:57:25.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/udf/udf.ko 2024-06-13T10:57:25.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ufs 2024-06-13T10:57:25.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ufs/ufs.ko 2024-06-13T10:57:25.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/xfs 2024-06-13T10:57:25.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/xfs/xfs.ko 2024-06-13T10:57:25.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/kernel 2024-06-13T10:57:25.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/kernel/rcu 2024-06-13T10:57:25.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/kernel/rcu/rcutorture.ko 2024-06-13T10:57:25.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/kernel/torture.ko 2024-06-13T10:57:25.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/kernel/trace 2024-06-13T10:57:25.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-06-13T10:57:25.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib 2024-06-13T10:57:25.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/asn1_encoder.ko 2024-06-13T10:57:25.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/crc-itu-t.ko 2024-06-13T10:57:25.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/crc8.ko 2024-06-13T10:57:25.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/crypto 2024-06-13T10:57:25.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/crypto/libarc4.ko 2024-06-13T10:57:25.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/crypto/libdes.ko 2024-06-13T10:57:25.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/libcrc32c.ko 2024-06-13T10:57:25.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/lru_cache.ko 2024-06-13T10:57:25.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/lz4 2024-06-13T10:57:25.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/lz4/lz4_compress.ko 2024-06-13T10:57:25.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/lz4/lz4hc_compress.ko 2024-06-13T10:57:25.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/math 2024-06-13T10:57:25.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/math/cordic.ko 2024-06-13T10:57:25.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/raid6 2024-06-13T10:57:25.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/raid6/raid6_pq.ko 2024-06-13T10:57:25.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/reed_solomon 2024-06-13T10:57:25.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/reed_solomon/reed_solomon.ko 2024-06-13T10:57:25.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/ts_bm.ko 2024-06-13T10:57:25.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/ts_fsm.ko 2024-06-13T10:57:25.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/ts_kmp.ko 2024-06-13T10:57:25.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/zstd 2024-06-13T10:57:25.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/zstd/zstd_compress.ko 2024-06-13T10:57:25.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/mm 2024-06-13T10:57:25.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/mm/hwpoison-inject.ko 2024-06-13T10:57:25.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net 2024-06-13T10:57:25.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan 2024-06-13T10:57:25.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan/6lowpan.ko 2024-06-13T10:57:25.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan/nhc_dest.ko 2024-06-13T10:57:25.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan/nhc_fragment.ko 2024-06-13T10:57:25.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan/nhc_hop.ko 2024-06-13T10:57:25.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan/nhc_ipv6.ko 2024-06-13T10:57:25.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan/nhc_mobility.ko 2024-06-13T10:57:25.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan/nhc_routing.ko 2024-06-13T10:57:25.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan/nhc_udp.ko 2024-06-13T10:57:25.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/802 2024-06-13T10:57:25.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/802/garp.ko 2024-06-13T10:57:25.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/802/mrp.ko 2024-06-13T10:57:25.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/802/p8022.ko 2024-06-13T10:57:25.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/802/psnap.ko 2024-06-13T10:57:25.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/802/stp.ko 2024-06-13T10:57:25.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/8021q 2024-06-13T10:57:25.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/8021q/8021q.ko 2024-06-13T10:57:25.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/9p 2024-06-13T10:57:25.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/9p/9pnet.ko 2024-06-13T10:57:25.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/9p/9pnet_fd.ko 2024-06-13T10:57:25.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/9p/9pnet_rdma.ko 2024-06-13T10:57:25.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/9p/9pnet_virtio.ko 2024-06-13T10:57:25.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/batman-adv 2024-06-13T10:57:25.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/batman-adv/batman-adv.ko 2024-06-13T10:57:25.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge 2024-06-13T10:57:25.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/br_netfilter.ko 2024-06-13T10:57:25.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/bridge.ko 2024-06-13T10:57:25.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter 2024-06-13T10:57:25.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-06-13T10:57:25.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_among.ko 2024-06-13T10:57:25.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_arp.ko 2024-06-13T10:57:25.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-06-13T10:57:25.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-06-13T10:57:25.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_ip.ko 2024-06-13T10:57:25.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-06-13T10:57:25.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_limit.ko 2024-06-13T10:57:25.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_log.ko 2024-06-13T10:57:25.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_mark.ko 2024-06-13T10:57:25.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-06-13T10:57:25.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-06-13T10:57:25.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-06-13T10:57:25.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-06-13T10:57:25.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_snat.ko 2024-06-13T10:57:25.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_stp.ko 2024-06-13T10:57:25.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-06-13T10:57:25.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-06-13T10:57:25.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-06-13T10:57:25.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-06-13T10:57:25.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebtables.ko 2024-06-13T10:57:25.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-06-13T10:57:25.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-06-13T10:57:25.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-06-13T10:57:25.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ceph 2024-06-13T10:57:25.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ceph/libceph.ko 2024-06-13T10:57:25.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/core 2024-06-13T10:57:25.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/core/failover.ko 2024-06-13T10:57:25.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/core/pktgen.ko 2024-06-13T10:57:25.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dccp 2024-06-13T10:57:25.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dccp/dccp.ko 2024-06-13T10:57:25.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dccp/dccp_diag.ko 2024-06-13T10:57:25.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dccp/dccp_ipv4.ko 2024-06-13T10:57:25.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dccp/dccp_ipv6.ko 2024-06-13T10:57:25.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dns_resolver 2024-06-13T10:57:25.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dns_resolver/dns_resolver.ko 2024-06-13T10:57:25.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dsa 2024-06-13T10:57:25.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dsa/dsa_core.ko 2024-06-13T10:57:25.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dsa/tag_brcm.ko 2024-06-13T10:57:25.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dsa/tag_dsa.ko 2024-06-13T10:57:25.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dsa/tag_none.ko 2024-06-13T10:57:25.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dsa/tag_trailer.ko 2024-06-13T10:57:25.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ieee802154 2024-06-13T10:57:25.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ieee802154/6lowpan 2024-06-13T10:57:25.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-06-13T10:57:25.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ieee802154/ieee802154.ko 2024-06-13T10:57:25.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ieee802154/ieee802154_socket.ko 2024-06-13T10:57:25.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4 2024-06-13T10:57:25.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/ah4.ko 2024-06-13T10:57:25.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/esp4.ko 2024-06-13T10:57:25.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/fou.ko 2024-06-13T10:57:25.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/gre.ko 2024-06-13T10:57:25.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/inet_diag.ko 2024-06-13T10:57:25.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/ip_gre.ko 2024-06-13T10:57:25.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/ip_tunnel.ko 2024-06-13T10:57:25.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/ip_vti.ko 2024-06-13T10:57:25.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/ipcomp.ko 2024-06-13T10:57:25.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/ipip.ko 2024-06-13T10:57:25.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter 2024-06-13T10:57:25.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/arp_tables.ko 2024-06-13T10:57:25.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-06-13T10:57:25.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-06-13T10:57:25.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-06-13T10:57:25.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-06-13T10:57:25.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-06-13T10:57:25.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-06-13T10:57:25.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-06-13T10:57:25.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-06-13T10:57:25.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-06-13T10:57:25.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/iptable_security.ko 2024-06-13T10:57:25.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-06-13T10:57:25.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-06-13T10:57:25.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-06-13T10:57:25.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-06-13T10:57:25.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-06-13T10:57:25.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-06-13T10:57:25.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-06-13T10:57:25.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-06-13T10:57:25.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-06-13T10:57:25.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-06-13T10:57:25.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_bic.ko 2024-06-13T10:57:25.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_dctcp.ko 2024-06-13T10:57:25.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_diag.ko 2024-06-13T10:57:25.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_highspeed.ko 2024-06-13T10:57:25.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_htcp.ko 2024-06-13T10:57:25.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_hybla.ko 2024-06-13T10:57:25.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_illinois.ko 2024-06-13T10:57:25.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_lp.ko 2024-06-13T10:57:25.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_scalable.ko 2024-06-13T10:57:25.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_vegas.ko 2024-06-13T10:57:25.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_veno.ko 2024-06-13T10:57:25.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_westwood.ko 2024-06-13T10:57:25.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_yeah.ko 2024-06-13T10:57:25.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tunnel4.ko 2024-06-13T10:57:25.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/udp_diag.ko 2024-06-13T10:57:25.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/udp_tunnel.ko 2024-06-13T10:57:25.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/xfrm4_tunnel.ko 2024-06-13T10:57:25.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6 2024-06-13T10:57:25.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/ah6.ko 2024-06-13T10:57:25.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/esp6.ko 2024-06-13T10:57:25.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/fou6.ko 2024-06-13T10:57:25.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/ip6_tunnel.ko 2024-06-13T10:57:25.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-06-13T10:57:25.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/ip6_vti.ko 2024-06-13T10:57:25.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/ipcomp6.ko 2024-06-13T10:57:25.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter 2024-06-13T10:57:25.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-06-13T10:57:25.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-06-13T10:57:25.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-06-13T10:57:25.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-06-13T10:57:25.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-06-13T10:57:25.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-06-13T10:57:25.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-06-13T10:57:25.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-06-13T10:57:25.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-06-13T10:57:25.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-06-13T10:57:25.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-06-13T10:57:25.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-06-13T10:57:25.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-06-13T10:57:25.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-06-13T10:57:25.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-06-13T10:57:25.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-06-13T10:57:25.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-06-13T10:57:25.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-06-13T10:57:25.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-06-13T10:57:25.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-06-13T10:57:25.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-06-13T10:57:25.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-06-13T10:57:25.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-06-13T10:57:25.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-06-13T10:57:25.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/sit.ko 2024-06-13T10:57:25.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/tunnel6.ko 2024-06-13T10:57:25.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/xfrm6_tunnel.ko 2024-06-13T10:57:25.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/key 2024-06-13T10:57:25.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/key/af_key.ko 2024-06-13T10:57:25.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/l2tp 2024-06-13T10:57:25.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/l2tp/l2tp_core.ko 2024-06-13T10:57:25.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/l2tp/l2tp_debugfs.ko 2024-06-13T10:57:25.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/l2tp/l2tp_eth.ko 2024-06-13T10:57:25.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/l2tp/l2tp_ip.ko 2024-06-13T10:57:25.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/l2tp/l2tp_ip6.ko 2024-06-13T10:57:25.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/l2tp/l2tp_netlink.ko 2024-06-13T10:57:25.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/l2tp/l2tp_ppp.ko 2024-06-13T10:57:25.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/llc 2024-06-13T10:57:25.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/llc/llc.ko 2024-06-13T10:57:25.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/mac802154 2024-06-13T10:57:25.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/mac802154/mac802154.ko 2024-06-13T10:57:25.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/mpls 2024-06-13T10:57:25.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/mpls/mpls_gso.ko 2024-06-13T10:57:25.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter 2024-06-13T10:57:25.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset 2024-06-13T10:57:25.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set.ko 2024-06-13T10:57:25.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-06-13T10:57:25.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-06-13T10:57:25.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-06-13T10:57:25.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-06-13T10:57:25.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-06-13T10:57:25.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-06-13T10:57:25.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-06-13T10:57:25.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-06-13T10:57:25.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-06-13T10:57:25.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-06-13T10:57:25.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-06-13T10:57:25.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-06-13T10:57:25.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-06-13T10:57:25.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-06-13T10:57:25.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-06-13T10:57:25.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs 2024-06-13T10:57:25.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs.ko 2024-06-13T10:57:25.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-06-13T10:57:25.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-06-13T10:57:25.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-06-13T10:57:25.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-06-13T10:57:25.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-06-13T10:57:25.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-06-13T10:57:25.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-06-13T10:57:25.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-06-13T10:57:25.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-06-13T10:57:25.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-06-13T10:57:25.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-06-13T10:57:25.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-06-13T10:57:25.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-06-13T10:57:25.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conncount.ko 2024-06-13T10:57:25.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack.ko 2024-06-13T10:57:25.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-06-13T10:57:25.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-06-13T10:57:25.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-06-13T10:57:25.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_h323.ko 2024-06-13T10:57:25.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_irc.ko 2024-06-13T10:57:25.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-06-13T10:57:25.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-06-13T10:57:25.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-06-13T10:57:25.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_sane.ko 2024-06-13T10:57:25.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_sip.ko 2024-06-13T10:57:25.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-06-13T10:57:25.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-06-13T10:57:25.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_dup_netdev.ko 2024-06-13T10:57:25.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_flow_table.ko 2024-06-13T10:57:25.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_flow_table_inet.ko 2024-06-13T10:57:25.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_log_syslog.ko 2024-06-13T10:57:25.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_nat.ko 2024-06-13T10:57:25.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_nat_amanda.ko 2024-06-13T10:57:25.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_nat_ftp.ko 2024-06-13T10:57:25.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_nat_irc.ko 2024-06-13T10:57:25.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_nat_sip.ko 2024-06-13T10:57:25.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_nat_tftp.ko 2024-06-13T10:57:25.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_synproxy_core.ko 2024-06-13T10:57:25.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_tables.ko 2024-06-13T10:57:25.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nfnetlink.ko 2024-06-13T10:57:25.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nfnetlink_acct.ko 2024-06-13T10:57:25.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nfnetlink_log.ko 2024-06-13T10:57:25.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nfnetlink_osf.ko 2024-06-13T10:57:25.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nfnetlink_queue.ko 2024-06-13T10:57:25.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_chain_nat.ko 2024-06-13T10:57:25.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_compat.ko 2024-06-13T10:57:25.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_ct.ko 2024-06-13T10:57:25.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_dup_netdev.ko 2024-06-13T10:57:25.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_fib.ko 2024-06-13T10:57:25.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_fwd_netdev.ko 2024-06-13T10:57:25.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_hash.ko 2024-06-13T10:57:25.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_limit.ko 2024-06-13T10:57:25.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_log.ko 2024-06-13T10:57:25.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_masq.ko 2024-06-13T10:57:25.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_nat.ko 2024-06-13T10:57:25.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_numgen.ko 2024-06-13T10:57:25.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_queue.ko 2024-06-13T10:57:25.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_quota.ko 2024-06-13T10:57:25.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_redir.ko 2024-06-13T10:57:25.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_reject.ko 2024-06-13T10:57:25.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_reject_inet.ko 2024-06-13T10:57:25.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_socket.ko 2024-06-13T10:57:25.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_tunnel.ko 2024-06-13T10:57:25.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_AUDIT.ko 2024-06-13T10:57:25.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_CHECKSUM.ko 2024-06-13T10:57:25.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_CLASSIFY.ko 2024-06-13T10:57:25.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-06-13T10:57:25.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_CT.ko 2024-06-13T10:57:25.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_DSCP.ko 2024-06-13T10:57:25.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_HL.ko 2024-06-13T10:57:25.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_HMARK.ko 2024-06-13T10:57:25.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_IDLETIMER.ko 2024-06-13T10:57:25.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_LED.ko 2024-06-13T10:57:25.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_LOG.ko 2024-06-13T10:57:25.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_MASQUERADE.ko 2024-06-13T10:57:25.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_NETMAP.ko 2024-06-13T10:57:25.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_NFLOG.ko 2024-06-13T10:57:25.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_NFQUEUE.ko 2024-06-13T10:57:25.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_RATEEST.ko 2024-06-13T10:57:25.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_REDIRECT.ko 2024-06-13T10:57:25.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_SECMARK.ko 2024-06-13T10:57:25.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_TCPMSS.ko 2024-06-13T10:57:25.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-06-13T10:57:25.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_TEE.ko 2024-06-13T10:57:25.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_TPROXY.ko 2024-06-13T10:57:25.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_TRACE.ko 2024-06-13T10:57:25.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_addrtype.ko 2024-06-13T10:57:25.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_bpf.ko 2024-06-13T10:57:25.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_cgroup.ko 2024-06-13T10:57:25.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_cluster.ko 2024-06-13T10:57:25.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_comment.ko 2024-06-13T10:57:25.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_connbytes.ko 2024-06-13T10:57:25.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_connlabel.ko 2024-06-13T10:57:25.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_connlimit.ko 2024-06-13T10:57:25.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_connmark.ko 2024-06-13T10:57:25.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_conntrack.ko 2024-06-13T10:57:25.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_cpu.ko 2024-06-13T10:57:25.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_dccp.ko 2024-06-13T10:57:25.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_devgroup.ko 2024-06-13T10:57:25.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_dscp.ko 2024-06-13T10:57:25.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_ecn.ko 2024-06-13T10:57:25.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_esp.ko 2024-06-13T10:57:25.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_hashlimit.ko 2024-06-13T10:57:25.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_helper.ko 2024-06-13T10:57:25.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_hl.ko 2024-06-13T10:57:25.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_ipcomp.ko 2024-06-13T10:57:25.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_iprange.ko 2024-06-13T10:57:25.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_ipvs.ko 2024-06-13T10:57:25.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_l2tp.ko 2024-06-13T10:57:25.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_length.ko 2024-06-13T10:57:25.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_limit.ko 2024-06-13T10:57:25.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_mac.ko 2024-06-13T10:57:25.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_mark.ko 2024-06-13T10:57:25.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_multiport.ko 2024-06-13T10:57:25.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_nat.ko 2024-06-13T10:57:25.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_nfacct.ko 2024-06-13T10:57:25.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_osf.ko 2024-06-13T10:57:25.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_owner.ko 2024-06-13T10:57:25.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_physdev.ko 2024-06-13T10:57:25.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_pkttype.ko 2024-06-13T10:57:25.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_policy.ko 2024-06-13T10:57:25.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_quota.ko 2024-06-13T10:57:25.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_rateest.ko 2024-06-13T10:57:25.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_realm.ko 2024-06-13T10:57:25.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_recent.ko 2024-06-13T10:57:25.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_sctp.ko 2024-06-13T10:57:25.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_set.ko 2024-06-13T10:57:25.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_socket.ko 2024-06-13T10:57:25.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_state.ko 2024-06-13T10:57:25.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_statistic.ko 2024-06-13T10:57:25.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_string.ko 2024-06-13T10:57:25.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_tcpmss.ko 2024-06-13T10:57:25.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_time.ko 2024-06-13T10:57:25.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_u32.ko 2024-06-13T10:57:25.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netlink 2024-06-13T10:57:25.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netlink/netlink_diag.ko 2024-06-13T10:57:25.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/nsh 2024-06-13T10:57:25.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/nsh/nsh.ko 2024-06-13T10:57:25.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/openvswitch 2024-06-13T10:57:25.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/openvswitch/openvswitch.ko 2024-06-13T10:57:25.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/openvswitch/vport-geneve.ko 2024-06-13T10:57:25.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/openvswitch/vport-gre.ko 2024-06-13T10:57:25.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/openvswitch/vport-vxlan.ko 2024-06-13T10:57:25.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/packet 2024-06-13T10:57:25.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/packet/af_packet_diag.ko 2024-06-13T10:57:25.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/rds 2024-06-13T10:57:25.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/rds/rds.ko 2024-06-13T10:57:25.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/rds/rds_rdma.ko 2024-06-13T10:57:25.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/rds/rds_tcp.ko 2024-06-13T10:57:25.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched 2024-06-13T10:57:25.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_csum.ko 2024-06-13T10:57:25.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_gact.ko 2024-06-13T10:57:25.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_mirred.ko 2024-06-13T10:57:25.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_nat.ko 2024-06-13T10:57:25.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_pedit.ko 2024-06-13T10:57:25.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_police.ko 2024-06-13T10:57:25.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_simple.ko 2024-06-13T10:57:25.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_skbedit.ko 2024-06-13T10:57:25.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_vlan.ko 2024-06-13T10:57:25.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/cls_basic.ko 2024-06-13T10:57:25.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/cls_bpf.ko 2024-06-13T10:57:25.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/cls_flow.ko 2024-06-13T10:57:25.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/cls_fw.ko 2024-06-13T10:57:25.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/cls_route.ko 2024-06-13T10:57:25.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/cls_u32.ko 2024-06-13T10:57:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/em_cmp.ko 2024-06-13T10:57:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/em_ipset.ko 2024-06-13T10:57:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/em_meta.ko 2024-06-13T10:57:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/em_nbyte.ko 2024-06-13T10:57:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/em_text.ko 2024-06-13T10:57:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/em_u32.ko 2024-06-13T10:57:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_choke.ko 2024-06-13T10:57:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_codel.ko 2024-06-13T10:57:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_drr.ko 2024-06-13T10:57:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_fq.ko 2024-06-13T10:57:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_gred.ko 2024-06-13T10:57:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_hfsc.ko 2024-06-13T10:57:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_hhf.ko 2024-06-13T10:57:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_htb.ko 2024-06-13T10:57:25.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_ingress.ko 2024-06-13T10:57:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_mqprio.ko 2024-06-13T10:57:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_mqprio_lib.ko 2024-06-13T10:57:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_multiq.ko 2024-06-13T10:57:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_netem.ko 2024-06-13T10:57:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_pie.ko 2024-06-13T10:57:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_plug.ko 2024-06-13T10:57:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_prio.ko 2024-06-13T10:57:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_qfq.ko 2024-06-13T10:57:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_red.ko 2024-06-13T10:57:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_sfb.ko 2024-06-13T10:57:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_sfq.ko 2024-06-13T10:57:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_tbf.ko 2024-06-13T10:57:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_teql.ko 2024-06-13T10:57:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sctp 2024-06-13T10:57:25.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sctp/sctp.ko 2024-06-13T10:57:25.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sctp/sctp_diag.ko 2024-06-13T10:57:25.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sunrpc 2024-06-13T10:57:25.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sunrpc/auth_gss 2024-06-13T10:57:25.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-06-13T10:57:25.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-06-13T10:57:25.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sunrpc/sunrpc.ko 2024-06-13T10:57:25.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sunrpc/xprtrdma 2024-06-13T10:57:25.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-06-13T10:57:25.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/tipc 2024-06-13T10:57:25.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/tipc/tipc.ko 2024-06-13T10:57:25.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/tipc/tipc_diag.ko 2024-06-13T10:57:25.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/unix 2024-06-13T10:57:25.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/unix/unix_diag.ko 2024-06-13T10:57:25.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/vmw_vsock 2024-06-13T10:57:25.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-06-13T10:57:25.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-06-13T10:57:25.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/vmw_vsock/vsock.ko 2024-06-13T10:57:25.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/vmw_vsock/vsock_diag.ko 2024-06-13T10:57:25.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/vmw_vsock/vsock_loopback.ko 2024-06-13T10:57:25.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/xfrm 2024-06-13T10:57:25.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/xfrm/xfrm_ipcomp.ko 2024-06-13T10:57:25.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/security 2024-06-13T10:57:25.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/security/keys 2024-06-13T10:57:25.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/security/keys/encrypted-keys 2024-06-13T10:57:25.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-06-13T10:57:25.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/security/keys/trusted-keys 2024-06-13T10:57:25.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/security/keys/trusted-keys/trusted.ko 2024-06-13T10:57:25.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.alias 2024-06-13T10:57:25.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.alias.bin 2024-06-13T10:57:25.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.builtin 2024-06-13T10:57:25.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.builtin.alias.bin 2024-06-13T10:57:25.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.builtin.bin 2024-06-13T10:57:25.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.builtin.modinfo 2024-06-13T10:57:25.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.dep 2024-06-13T10:57:25.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.dep.bin 2024-06-13T10:57:25.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.devname 2024-06-13T10:57:25.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.order 2024-06-13T10:57:25.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.softdep 2024-06-13T10:57:25.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.symbols 2024-06-13T10:57:25.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.symbols.bin 2024-06-13T10:57:25.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/vmlinuz 2024-06-13T10:57:25.351 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gff88c41504f3 2024-06-13T10:57:25.351 DEBUG:teuthology.orchestra.run.smithi002:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-06-13T10:57:25.374 INFO:teuthology.orchestra.run.smithi002.stdout:postinstall scriptlet (using /bin/sh): 2024-06-13T10:57:25.375 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-06-13T10:57:25.375 INFO:teuthology.orchestra.run.smithi002.stdout: /usr/bin/kernel-install add 6.9.0-gff88c41504f3 /lib/modules/6.9.0-gff88c41504f3/vmlinuz 2024-06-13T10:57:25.375 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-06-13T10:57:25.375 INFO:teuthology.orchestra.run.smithi002.stdout:for file in vmlinuz System.map config; do 2024-06-13T10:57:25.375 INFO:teuthology.orchestra.run.smithi002.stdout: if ! cmp --silent "/lib/modules/6.9.0-gff88c41504f3/${file}" "/boot/${file}-6.9.0-gff88c41504f3"; then 2024-06-13T10:57:25.375 INFO:teuthology.orchestra.run.smithi002.stdout: cp "/lib/modules/6.9.0-gff88c41504f3/${file}" "/boot/${file}-6.9.0-gff88c41504f3" 2024-06-13T10:57:25.375 INFO:teuthology.orchestra.run.smithi002.stdout: fi 2024-06-13T10:57:25.375 INFO:teuthology.orchestra.run.smithi002.stdout:done 2024-06-13T10:57:25.375 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -d "/lib/modules/6.9.0-gff88c41504f3/dtb" ] && \ 2024-06-13T10:57:25.375 INFO:teuthology.orchestra.run.smithi002.stdout: ! diff -rq "/lib/modules/6.9.0-gff88c41504f3/dtb" "/boot/dtb-6.9.0-gff88c41504f3" >/dev/null 2>&1; then 2024-06-13T10:57:25.375 INFO:teuthology.orchestra.run.smithi002.stdout: rm -rf "/boot/dtb-6.9.0-gff88c41504f3" 2024-06-13T10:57:25.375 INFO:teuthology.orchestra.run.smithi002.stdout: cp -r "/lib/modules/6.9.0-gff88c41504f3/dtb" "/boot/dtb-6.9.0-gff88c41504f3" 2024-06-13T10:57:25.375 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-06-13T10:57:25.376 INFO:teuthology.orchestra.run.smithi002.stdout:if [ ! -e "/lib/modules/6.9.0-gff88c41504f3/modules.dep" ]; then 2024-06-13T10:57:25.376 INFO:teuthology.orchestra.run.smithi002.stdout: /usr/sbin/depmod 6.9.0-gff88c41504f3 2024-06-13T10:57:25.376 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-06-13T10:57:25.376 INFO:teuthology.orchestra.run.smithi002.stdout:preuninstall scriptlet (using /bin/sh): 2024-06-13T10:57:25.376 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-06-13T10:57:25.376 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-install remove 6.9.0-gff88c41504f3 2024-06-13T10:57:25.376 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-06-13T10:57:25.377 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-06-13T10:57:25.451 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-06-13T10:57:25.451 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-06-13T10:57:25.452 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-06-13T10:57:25.452 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 68.el9 2024-06-13T10:57:25.452 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-06-13T10:57:25.452 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-13T10:57:25.452 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-06-13T10:57:25.452 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8264254 2024-06-13T10:57:25.452 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-06-13T10:57:25.452 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-13T10:57:25.452 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-13T10:57:25.453 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-13T10:57:25.453 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-13T10:57:25.453 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-06-13T10:57:25.453 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-06-13T10:57:25.453 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-13T10:57:25.453 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-06-13T10:57:25.453 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-06-13T10:57:25.453 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T10:57:25.453 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-13T10:57:25.454 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-13T10:57:25.454 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-13T10:57:25.454 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-06-13T10:57:25.454 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T10:57:25.454 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-06-13T10:57:25.455 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-13T10:57:25.455 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 6.9.0-gff88c41504f3 2024-06-13T10:57:25.455 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-13T10:57:26.047 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-06-13T10:57:27.474 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-13T10:57:27.494 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-06-13T10:57:27.496 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-06-13T10:57:27.512 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.0M4s7cqjJB 2024-06-13T10:57:27.513 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0M4s7cqjJB 2024-06-13T10:57:27.579 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.0M4s7cqjJB 2024-06-13T10:57:27.716 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.0M4s7cqjJB is 6KB 2024-06-13T10:57:27.768 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.0M4s7cqjJB 2024-06-13T10:57:27.783 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-06-13T10:57:27.845 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-13T10:57:27.845 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-13T10:57:27.845 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-13T10:57:27.845 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gff88c41504f3.conf 2024-06-13T10:57:27.847 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gff88c41504f3 2024-06-13T10:57:28.020 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-06-13T10:57:58.023 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-06-13T10:57:58.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-06-13T10:57:58.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T10:58:16.478 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-06-13T10:58:25.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-06-13T10:58:25.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T10:58:43.870 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-06-13T10:58:55.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-06-13T10:58:55.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T10:58:58.942 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-06-13T10:59:13.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-06-13T10:59:13.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T10:59:14.255 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-06-13T10:59:14.755 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-06-13T10:59:14.755 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-gff88c41504f3"... 2024-06-13T10:59:14.756 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-06-13T10:59:14.793 INFO:teuthology.orchestra.run.smithi002.stdout:6.9.0-gff88c41504f3 2024-06-13T10:59:14.794 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gff88c41504f3 vs 6.9.0-gff88c41504f3 2024-06-13T10:59:14.794 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-13T10:59:14.794 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-13T10:59:15.795 DEBUG:teuthology.parallel:result is None 2024-06-13T10:59:15.795 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-13T10:59:15.810 INFO:teuthology.task.internal:Creating test directory... 2024-06-13T10:59:15.811 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-13T10:59:15.816 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-13T10:59:15.819 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-13T10:59:15.859 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-13T10:59:15.866 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-13T10:59:15.872 INFO:teuthology.task.internal:Creating archive directory... 2024-06-13T10:59:15.873 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-13T10:59:15.879 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-13T10:59:15.881 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-13T10:59:16.166 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-13T10:59:16.172 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-13T10:59:16.172 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-13T10:59:16.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T10:59:16.189 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-13T10:59:16.204 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T10:59:16.205 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-13T10:59:16.212 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-13T10:59:16.230 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-13T10:59:16.266 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-13T10:59:16.282 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-13T10:59:16.284 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-13T10:59:16.314 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-13T10:59:16.326 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-13T10:59:16.412 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-13T10:59:16.416 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-13T10:59:16.424 INFO:teuthology.task.internal:Configuring sudo... 2024-06-13T10:59:16.424 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-13T10:59:16.428 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-13T10:59:16.431 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-13T10:59:16.500 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-13T10:59:16.509 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-13T10:59:16.509 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-13T10:59:16.515 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-13T10:59:16.517 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-13T10:59:16.553 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-13T10:59:16.669 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-13T10:59:16.801 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-13T10:59:16.881 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-13T10:59:16.965 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T10:59:16.965 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-13T10:59:17.036 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-13T10:59:17.080 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-13T10:59:17.136 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-13T10:59:17.219 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-13T10:59:17.261 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-06-13T10:59:17.261 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-13T10:59:17.327 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-13T10:59:17.372 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-13T10:59:17.424 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-13T10:59:17.508 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-13T10:59:17.550 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-13T10:59:17.550 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-13T10:59:17.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-06-13T10:59:17.627 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2024-06-13T10:59:17.630 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2024-06-13T10:59:17.661 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-13T10:59:17.692 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-13T10:59:17.776 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-13T10:59:18.253 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-13T10:59:18.261 INFO:teuthology.task.internal:Starting timer... 2024-06-13T10:59:18.261 INFO:teuthology.run_tasks:Running task pcp... 2024-06-13T10:59:18.270 INFO:teuthology.run_tasks:Running task selinux... 2024-06-13T10:59:18.278 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-06-13T10:59:18.279 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-06-13T10:59:18.432 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-06-13T10:59:18.438 DEBUG:teuthology.orchestra.run.smithi077:> sudo service auditd rotate 2024-06-13T10:59:18.502 INFO:teuthology.orchestra.run.smithi077.stdout:Rotating logs: 2024-06-13T10:59:18.504 DEBUG:teuthology.orchestra.run.smithi178:> sudo service auditd rotate 2024-06-13T10:59:18.572 INFO:teuthology.orchestra.run.smithi178.stdout:Rotating logs: 2024-06-13T10:59:18.574 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-13T10:59:18.574 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-06-13T10:59:18.669 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-06-13T10:59:18.670 DEBUG:teuthology.orchestra.run.smithi077:> /usr/sbin/getenforce 2024-06-13T10:59:18.701 INFO:teuthology.orchestra.run.smithi077.stdout:Permissive 2024-06-13T10:59:18.702 DEBUG:teuthology.orchestra.run.smithi178:> /usr/sbin/getenforce 2024-06-13T10:59:18.736 INFO:teuthology.orchestra.run.smithi178.stdout:Permissive 2024-06-13T10:59:18.736 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi077.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi178.front.sepia.ceph.com': 'permissive'} 2024-06-13T10:59:18.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-13T10:59:18.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T10:59:18.869 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-13T10:59:18.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T10:59:18.895 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-13T10:59:18.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T10:59:18.920 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-13T10:59:18.920 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-06-13T10:59:19.039 DEBUG:teuthology.orchestra.run.smithi077:> sudo /usr/sbin/setenforce permissive 2024-06-13T10:59:19.063 DEBUG:teuthology.orchestra.run.smithi178:> sudo /usr/sbin/setenforce permissive 2024-06-13T10:59:19.087 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-13T10:59:19.096 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-13T10:59:19.108 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-13T10:59:19.108 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi077.front.sepia.ceph.com,smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-13T11:05:45.089 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi077.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2024-06-13T11:05:45.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-06-13T11:05:45.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T11:05:45.205 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-06-13T11:05:45.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-06-13T11:05:45.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-06-13T11:05:45.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T11:05:45.435 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-06-13T11:05:45.515 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-06-13T11:05:45.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-06-13T11:05:45.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T11:05:45.592 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-06-13T11:05:45.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-06-13T11:05:45.672 INFO:teuthology.run_tasks:Running task clock... 2024-06-13T11:05:45.683 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-13T11:05:45.683 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-13T11:05:45.684 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-13T11:05:45.691 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-13T11:05:45.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-13T11:05:45.694 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-13T11:05:45.694 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-13T11:05:45.725 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-13T11:05:45.740 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-13T11:05:45.744 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-13T11:05:45.759 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-13T11:05:45.765 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: ntpd: command not found 2024-06-13T11:05:45.776 INFO:teuthology.orchestra.run.smithi077.stdout:506 Cannot talk to daemon 2024-06-13T11:05:45.783 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: ntpd: command not found 2024-06-13T11:05:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-13T11:05:45.789 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-13T11:05:45.794 INFO:teuthology.orchestra.run.smithi178.stdout:506 Cannot talk to daemon 2024-06-13T11:05:45.802 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-13T11:05:45.808 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-13T11:05:45.821 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-13T11:05:45.834 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-13T11:05:45.864 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-06-13T11:05:45.867 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-13T11:05:45.868 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-06-13T11:05:45.868 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:05:45.868 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:05:45.868 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:05:45.868 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:05:45.876 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 1: ntpq: command not found 2024-06-13T11:05:45.880 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-13T11:05:45.880 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2024-06-13T11:05:45.880 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:05:45.880 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:05:45.881 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:05:45.881 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:05:45.914 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-06-13T11:05:45.949 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-06-13T11:05:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-13T11:05:46.039 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-13T11:05:46.187 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-06-13T11:05:46.197 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-13T11:05:46.197 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-06-13T11:05:46.197 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:05:46.197 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:05:46.197 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:05:46.197 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:05:46.199 INFO:teuthology.run_tasks:Running task install... 2024-06-13T11:05:46.207 DEBUG:teuthology.task.install:project ceph 2024-06-13T11:05:46.207 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}} 2024-06-13T11:05:46.207 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'} 2024-06-13T11:05:46.207 INFO:teuthology.task.install:Using flavor: default 2024-06-13T11:05:46.213 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-13T11:05:46.213 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-06-13T11:05:46.213 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-13T11:05:46.214 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T11:05:46.216 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-13T11:05:46.216 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T11:05:46.217 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-13T11:05:46.218 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T11:05:46.356 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-13T11:05:46.357 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-13T11:05:46.426 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-13T11:05:46.427 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-13T11:05:46.437 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-13T11:05:46.437 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-13T11:05:46.528 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-13T11:05:46.528 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:05:46.528 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-13T11:05:46.547 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-13T11:05:46.547 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-13T11:05:46.547 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-13T11:05:46.575 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-13T11:05:46.575 DEBUG:teuthology.orchestra.run.smithi178:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-13T11:05:46.604 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-13T11:05:46.604 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-06-13T11:05:46.604 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-13T11:05:46.623 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-13T11:05:46.623 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-13T11:05:46.634 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-13T11:05:46.635 DEBUG:teuthology.orchestra.run.smithi077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-13T11:05:46.642 DEBUG:teuthology.orchestra.run.smithi178:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-13T11:05:46.702 DEBUG:teuthology.orchestra.run.smithi077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-13T11:05:46.717 DEBUG:teuthology.orchestra.run.smithi178:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-13T11:05:46.758 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-13T11:05:46.776 DEBUG:teuthology.orchestra.run.smithi077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-13T11:05:46.783 INFO:teuthology.orchestra.run.smithi178.stdout:check_obsoletes = 1 2024-06-13T11:05:46.784 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum clean all 2024-06-13T11:05:46.839 INFO:teuthology.orchestra.run.smithi077.stdout:check_obsoletes = 1 2024-06-13T11:05:46.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum clean all 2024-06-13T11:05:46.879 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-13T11:05:46.966 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-06-13T11:05:46.970 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-06-13T11:05:47.011 INFO:teuthology.orchestra.run.smithi178.stdout:45 files removed 2024-06-13T11:05:47.038 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-13T11:05:47.063 INFO:teuthology.orchestra.run.smithi077.stdout:45 files removed 2024-06-13T11:05:47.090 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-13T11:05:47.308 INFO:teuthology.orchestra.run.smithi002.stdout:45 files removed 2024-06-13T11:05:47.348 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-13T11:05:47.774 INFO:teuthology.orchestra.run.smithi178.stdout:ceph packages for x86_64 174 kB/s | 83 kB 00:00 2024-06-13T11:05:47.837 INFO:teuthology.orchestra.run.smithi077.stdout:ceph packages for x86_64 171 kB/s | 83 kB 00:00 2024-06-13T11:05:48.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 218 kB/s | 83 kB 00:00 2024-06-13T11:05:48.179 INFO:teuthology.orchestra.run.smithi077.stdout:ceph noarch packages 39 kB/s | 11 kB 00:00 2024-06-13T11:05:48.199 INFO:teuthology.orchestra.run.smithi178.stdout:ceph noarch packages 30 kB/s | 11 kB 00:00 2024-06-13T11:05:48.522 INFO:teuthology.orchestra.run.smithi077.stdout:ceph source packages 6.1 kB/s | 1.9 kB 00:00 2024-06-13T11:05:48.575 INFO:teuthology.orchestra.run.smithi178.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-06-13T11:05:48.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 26 kB/s | 11 kB 00:00 2024-06-13T11:05:49.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2024-06-13T11:05:50.102 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.1 MB 00:01 2024-06-13T11:05:50.322 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.1 MB 00:01 2024-06-13T11:05:50.948 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.1 MB 00:01 2024-06-13T11:05:55.817 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - AppStream 4.3 MB/s | 20 MB 00:04 2024-06-13T11:05:57.044 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 4.1 MB/s | 20 MB 00:04 2024-06-13T11:05:59.589 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 2.4 MB/s | 20 MB 00:08 2024-06-13T11:06:02.001 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.3 MB 00:02 2024-06-13T11:06:03.086 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.3 MB 00:01 2024-06-13T11:06:03.551 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 17 kB 00:00 2024-06-13T11:06:04.695 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 17 kB 00:00 2024-06-13T11:06:04.722 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:01 2024-06-13T11:06:05.365 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.3 MB 00:02 2024-06-13T11:06:06.202 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-06-13T11:06:06.941 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 17 kB 00:00 2024-06-13T11:06:08.251 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-06-13T11:06:09.986 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-06-13T11:06:12.274 INFO:teuthology.orchestra.run.smithi178.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-13T11:06:12.275 INFO:teuthology.orchestra.run.smithi178.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-13T11:06:12.286 INFO:teuthology.orchestra.run.smithi178.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-13T11:06:12.286 INFO:teuthology.orchestra.run.smithi178.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-13T11:06:12.287 INFO:teuthology.orchestra.run.smithi178.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-13T11:06:12.288 INFO:teuthology.orchestra.run.smithi178.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-13T11:06:12.290 INFO:teuthology.orchestra.run.smithi178.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-13T11:06:12.292 INFO:teuthology.orchestra.run.smithi178.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-13T11:06:12.293 INFO:teuthology.orchestra.run.smithi178.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-13T11:06:12.356 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-06-13T11:06:12.370 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2024-06-13T11:06:12.371 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-06-13T11:06:12.371 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2024-06-13T11:06:12.371 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-06-13T11:06:12.371 INFO:teuthology.orchestra.run.smithi178.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-13T11:06:12.372 INFO:teuthology.orchestra.run.smithi178.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-13T11:06:12.372 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-13T11:06:12.372 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-13T11:06:12.372 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-13T11:06:12.372 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-13T11:06:12.372 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-13T11:06:12.373 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-13T11:06:12.373 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-13T11:06:12.373 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-13T11:06:12.373 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-13T11:06:12.373 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-13T11:06:12.374 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-13T11:06:12.374 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-13T11:06:12.374 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-13T11:06:12.374 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-13T11:06:12.374 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-13T11:06:12.375 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-13T11:06:12.375 INFO:teuthology.orchestra.run.smithi178.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-13T11:06:12.375 INFO:teuthology.orchestra.run.smithi178.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-13T11:06:12.375 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-13T11:06:12.375 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-13T11:06:12.375 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-13T11:06:12.376 INFO:teuthology.orchestra.run.smithi178.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-13T11:06:12.376 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-13T11:06:12.376 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-devel x86_64 1:3.2.2-1.el9 appstream 4.4 M 2024-06-13T11:06:12.376 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-13T11:06:12.376 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-13T11:06:12.376 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-13T11:06:12.377 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-13T11:06:12.377 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-13T11:06:12.377 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-13T11:06:12.377 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-13T11:06:12.377 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-13T11:06:12.378 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-13T11:06:12.378 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-13T11:06:12.378 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-devel x86_64 6.4.0-1.el9 appstream 95 k 2024-06-13T11:06:12.378 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrading: 2024-06-13T11:06:12.378 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-13T11:06:12.378 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-13T11:06:12.379 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-13T11:06:12.379 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-13T11:06:12.379 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-13T11:06:12.379 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-13T11:06:12.379 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-13T11:06:12.379 INFO:teuthology.orchestra.run.smithi178.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-13T11:06:12.380 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-13T11:06:12.380 INFO:teuthology.orchestra.run.smithi178.stdout: openssl x86_64 1:3.2.2-1.el9 baseos 1.4 M 2024-06-13T11:06:12.380 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-libs x86_64 1:3.2.2-1.el9 baseos 2.4 M 2024-06-13T11:06:12.380 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs x86_64 6.4.0-1.el9 baseos 1.1 M 2024-06-13T11:06:12.380 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-06-13T11:06:12.381 INFO:teuthology.orchestra.run.smithi178.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-13T11:06:12.381 INFO:teuthology.orchestra.run.smithi178.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-13T11:06:12.381 INFO:teuthology.orchestra.run.smithi178.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-13T11:06:12.381 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-13T11:06:12.382 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-13T11:06:12.382 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-13T11:06:12.382 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-13T11:06:12.382 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-13T11:06:12.382 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-13T11:06:12.382 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-13T11:06:12.383 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-13T11:06:12.383 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-13T11:06:12.383 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-13T11:06:12.383 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-13T11:06:12.383 INFO:teuthology.orchestra.run.smithi178.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-13T11:06:12.383 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-13T11:06:12.384 INFO:teuthology.orchestra.run.smithi178.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-13T11:06:12.384 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-13T11:06:12.384 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-13T11:06:12.384 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-13T11:06:12.384 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-13T11:06:12.384 INFO:teuthology.orchestra.run.smithi178.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-13T11:06:12.385 INFO:teuthology.orchestra.run.smithi178.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-13T11:06:12.385 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-13T11:06:12.385 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-13T11:06:12.385 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-13T11:06:12.385 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-13T11:06:12.386 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-13T11:06:12.386 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-13T11:06:12.386 INFO:teuthology.orchestra.run.smithi178.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-13T11:06:12.386 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-13T11:06:12.386 INFO:teuthology.orchestra.run.smithi178.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-13T11:06:12.387 INFO:teuthology.orchestra.run.smithi178.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-13T11:06:12.387 INFO:teuthology.orchestra.run.smithi178.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-13T11:06:12.387 INFO:teuthology.orchestra.run.smithi178.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-13T11:06:12.387 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-13T11:06:12.387 INFO:teuthology.orchestra.run.smithi178.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-13T11:06:12.387 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-13T11:06:12.388 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-13T11:06:12.388 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-13T11:06:12.388 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-13T11:06:12.388 INFO:teuthology.orchestra.run.smithi178.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-13T11:06:12.388 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-13T11:06:12.389 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-13T11:06:12.389 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-13T11:06:12.389 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-13T11:06:12.389 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-13T11:06:12.389 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-13T11:06:12.390 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-13T11:06:12.390 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-13T11:06:12.390 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-13T11:06:12.390 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-13T11:06:12.390 INFO:teuthology.orchestra.run.smithi178.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-13T11:06:12.390 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-13T11:06:12.391 INFO:teuthology.orchestra.run.smithi178.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-13T11:06:12.391 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth noarch 1:2.29.0-2.el9 epel 205 k 2024-06-13T11:06:12.391 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-13T11:06:12.391 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-13T11:06:12.391 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-13T11:06:12.392 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-13T11:06:12.392 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-13T11:06:12.392 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-13T11:06:12.392 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-13T11:06:12.392 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-13T11:06:12.392 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-13T11:06:12.393 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-13T11:06:12.393 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-13T11:06:12.393 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-13T11:06:12.393 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-13T11:06:12.393 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-13T11:06:12.393 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-13T11:06:12.394 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-13T11:06:12.394 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-13T11:06:12.394 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-13T11:06:12.394 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-13T11:06:12.394 INFO:teuthology.orchestra.run.smithi178.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-13T11:06:12.395 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-13T11:06:12.395 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-13T11:06:12.395 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-13T11:06:12.395 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-13T11:06:12.395 INFO:teuthology.orchestra.run.smithi178.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-13T11:06:12.395 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-13T11:06:12.396 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-13T11:06:12.396 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-13T11:06:12.396 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-13T11:06:12.396 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-13T11:06:12.396 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-13T11:06:12.396 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-13T11:06:12.397 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-13T11:06:12.397 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-13T11:06:12.397 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-13T11:06:12.397 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-13T11:06:12.397 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-13T11:06:12.397 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-13T11:06:12.398 INFO:teuthology.orchestra.run.smithi178.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-13T11:06:12.398 INFO:teuthology.orchestra.run.smithi178.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-13T11:06:12.398 INFO:teuthology.orchestra.run.smithi178.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-13T11:06:12.398 INFO:teuthology.orchestra.run.smithi178.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-13T11:06:12.398 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-13T11:06:12.399 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-13T11:06:12.399 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-13T11:06:12.399 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-13T11:06:12.399 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-13T11:06:12.399 INFO:teuthology.orchestra.run.smithi178.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-13T11:06:12.399 INFO:teuthology.orchestra.run.smithi178.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-13T11:06:12.400 INFO:teuthology.orchestra.run.smithi178.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-06-13T11:06:12.400 INFO:teuthology.orchestra.run.smithi178.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-13T11:06:12.400 INFO:teuthology.orchestra.run.smithi178.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-13T11:06:12.400 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-13T11:06:12.400 INFO:teuthology.orchestra.run.smithi178.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-13T11:06:12.400 INFO:teuthology.orchestra.run.smithi178.stdout:Installing weak dependencies: 2024-06-13T11:06:12.401 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-13T11:06:12.401 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:06:12.401 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-06-13T11:06:12.401 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2024-06-13T11:06:12.401 INFO:teuthology.orchestra.run.smithi178.stdout:Install 148 Packages 2024-06-13T11:06:12.401 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrade 12 Packages 2024-06-13T11:06:12.402 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:06:12.403 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 226 M 2024-06-13T11:06:12.403 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-06-13T11:06:12.663 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-06-13T11:06:13.029 INFO:teuthology.orchestra.run.smithi178.stdout:(1/160): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 38 kB/s | 6.6 kB 00:00 2024-06-13T11:06:13.254 INFO:teuthology.orchestra.run.smithi178.stdout:(2/160): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 3.9 MB/s | 890 kB 00:00 2024-06-13T11:06:13.321 INFO:teuthology.orchestra.run.smithi178.stdout:(3/160): ceph-immutable-object-cache-19.0.0-294 2.1 MB/s | 145 kB 00:00 2024-06-13T11:06:13.568 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-06-13T11:06:13.704 INFO:teuthology.orchestra.run.smithi178.stdout:(4/160): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 6.2 MB/s | 2.4 MB 00:00 2024-06-13T11:06:13.838 INFO:teuthology.orchestra.run.smithi178.stdout:(5/160): ceph-base-19.0.0-2946.g3d89accf.el9.x8 5.5 MB/s | 5.4 MB 00:00 2024-06-13T11:06:13.913 INFO:teuthology.orchestra.run.smithi178.stdout:(6/160): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 7.2 MB/s | 1.5 MB 00:00 2024-06-13T11:06:14.514 INFO:teuthology.orchestra.run.smithi178.stdout:(7/160): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 6.9 MB/s | 4.7 MB 00:00 2024-06-13T11:06:14.797 INFO:teuthology.orchestra.run.smithi178.stdout:(8/160): ceph-common-19.0.0-2946.g3d89accf.el9. 11 MB/s | 21 MB 00:01 2024-06-13T11:06:14.872 INFO:teuthology.orchestra.run.smithi178.stdout:(9/160): ceph-selinux-19.0.0-2946.g3d89accf.el9 336 kB/s | 25 kB 00:00 2024-06-13T11:06:15.338 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-13T11:06:15.339 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-13T11:06:15.359 INFO:teuthology.orchestra.run.smithi002.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-13T11:06:15.361 INFO:teuthology.orchestra.run.smithi002.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-13T11:06:15.362 INFO:teuthology.orchestra.run.smithi002.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-13T11:06:15.363 INFO:teuthology.orchestra.run.smithi002.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-13T11:06:15.366 INFO:teuthology.orchestra.run.smithi002.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-13T11:06:15.369 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-13T11:06:15.371 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-13T11:06:15.448 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-06-13T11:06:15.471 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-06-13T11:06:15.471 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-06-13T11:06:15.471 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-06-13T11:06:15.471 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-06-13T11:06:15.471 INFO:teuthology.orchestra.run.smithi002.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-13T11:06:15.471 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-13T11:06:15.471 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-13T11:06:15.471 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-13T11:06:15.471 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-13T11:06:15.471 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-13T11:06:15.471 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-13T11:06:15.472 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-13T11:06:15.472 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-13T11:06:15.472 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-13T11:06:15.472 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-13T11:06:15.472 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-13T11:06:15.472 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-13T11:06:15.472 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-13T11:06:15.472 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-13T11:06:15.472 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-13T11:06:15.472 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-13T11:06:15.472 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-13T11:06:15.472 INFO:teuthology.orchestra.run.smithi002.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-13T11:06:15.472 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-13T11:06:15.473 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-13T11:06:15.473 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-13T11:06:15.473 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-13T11:06:15.473 INFO:teuthology.orchestra.run.smithi002.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-13T11:06:15.473 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-13T11:06:15.473 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel x86_64 1:3.2.2-1.el9 appstream 4.4 M 2024-06-13T11:06:15.473 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-13T11:06:15.473 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-13T11:06:15.473 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-13T11:06:15.473 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-13T11:06:15.473 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-13T11:06:15.473 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-13T11:06:15.474 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-13T11:06:15.474 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-13T11:06:15.474 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-13T11:06:15.474 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-13T11:06:15.474 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel x86_64 6.4.0-1.el9 appstream 95 k 2024-06-13T11:06:15.474 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-06-13T11:06:15.474 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-13T11:06:15.474 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-13T11:06:15.474 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-13T11:06:15.474 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-13T11:06:15.474 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-13T11:06:15.475 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-13T11:06:15.475 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-13T11:06:15.475 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-13T11:06:15.475 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-13T11:06:15.475 INFO:teuthology.orchestra.run.smithi002.stdout: openssl x86_64 1:3.2.2-1.el9 baseos 1.4 M 2024-06-13T11:06:15.475 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs x86_64 1:3.2.2-1.el9 baseos 2.4 M 2024-06-13T11:06:15.475 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs x86_64 6.4.0-1.el9 baseos 1.1 M 2024-06-13T11:06:15.475 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-06-13T11:06:15.475 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-13T11:06:15.475 INFO:teuthology.orchestra.run.smithi002.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-13T11:06:15.475 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-13T11:06:15.475 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-13T11:06:15.475 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-13T11:06:15.476 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-13T11:06:15.476 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-13T11:06:15.476 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-13T11:06:15.476 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-13T11:06:15.476 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-13T11:06:15.476 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-13T11:06:15.476 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-13T11:06:15.476 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-13T11:06:15.476 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-13T11:06:15.476 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-13T11:06:15.476 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-13T11:06:15.476 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-13T11:06:15.476 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-13T11:06:15.477 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-13T11:06:15.477 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-13T11:06:15.477 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-13T11:06:15.477 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-13T11:06:15.477 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-13T11:06:15.477 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-13T11:06:15.477 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-13T11:06:15.477 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-13T11:06:15.477 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-13T11:06:15.477 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-13T11:06:15.477 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-13T11:06:15.477 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-13T11:06:15.478 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-13T11:06:15.478 INFO:teuthology.orchestra.run.smithi002.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-13T11:06:15.478 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-13T11:06:15.478 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-13T11:06:15.478 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-13T11:06:15.478 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-13T11:06:15.478 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-13T11:06:15.478 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-13T11:06:15.478 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-13T11:06:15.478 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-13T11:06:15.478 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-13T11:06:15.478 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-13T11:06:15.478 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-13T11:06:15.479 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-13T11:06:15.479 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-13T11:06:15.479 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-13T11:06:15.479 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-13T11:06:15.479 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-13T11:06:15.479 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-13T11:06:15.479 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-13T11:06:15.479 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-13T11:06:15.479 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-13T11:06:15.479 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-13T11:06:15.479 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-13T11:06:15.479 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-13T11:06:15.480 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.29.0-2.el9 epel 205 k 2024-06-13T11:06:15.480 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-13T11:06:15.480 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-13T11:06:15.480 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-13T11:06:15.480 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-13T11:06:15.480 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-13T11:06:15.480 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-13T11:06:15.480 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-13T11:06:15.480 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-13T11:06:15.480 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-13T11:06:15.480 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-13T11:06:15.480 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-13T11:06:15.480 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-13T11:06:15.481 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-13T11:06:15.481 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-13T11:06:15.481 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-13T11:06:15.481 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-13T11:06:15.481 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-13T11:06:15.481 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-13T11:06:15.481 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-13T11:06:15.481 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-13T11:06:15.481 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-13T11:06:15.481 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-13T11:06:15.481 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-13T11:06:15.481 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-13T11:06:15.481 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-13T11:06:15.481 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-13T11:06:15.482 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-13T11:06:15.482 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-13T11:06:15.482 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-13T11:06:15.482 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-13T11:06:15.482 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-13T11:06:15.482 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-13T11:06:15.482 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-13T11:06:15.482 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-13T11:06:15.482 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-13T11:06:15.482 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-13T11:06:15.482 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-13T11:06:15.482 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-13T11:06:15.482 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-13T11:06:15.483 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-13T11:06:15.483 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-13T11:06:15.483 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-13T11:06:15.483 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-13T11:06:15.483 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-13T11:06:15.483 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-13T11:06:15.483 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-13T11:06:15.483 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-13T11:06:15.483 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-13T11:06:15.483 INFO:teuthology.orchestra.run.smithi002.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-13T11:06:15.483 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-06-13T11:06:15.483 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-13T11:06:15.484 INFO:teuthology.orchestra.run.smithi002.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-13T11:06:15.484 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-13T11:06:15.484 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-13T11:06:15.484 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-06-13T11:06:15.484 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-13T11:06:15.484 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:06:15.484 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-06-13T11:06:15.484 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-06-13T11:06:15.484 INFO:teuthology.orchestra.run.smithi002.stdout:Install 148 Packages 2024-06-13T11:06:15.484 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 12 Packages 2024-06-13T11:06:15.484 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:06:15.485 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 226 M 2024-06-13T11:06:15.485 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-06-13T11:06:15.839 INFO:teuthology.orchestra.run.smithi178.stdout:(10/160): ceph-radosgw-19.0.0-2946.g3d89accf.el 7.7 MB/s | 10 MB 00:01 2024-06-13T11:06:15.886 INFO:teuthology.orchestra.run.smithi077.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-13T11:06:15.887 INFO:teuthology.orchestra.run.smithi077.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-13T11:06:15.897 INFO:teuthology.orchestra.run.smithi077.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-13T11:06:15.898 INFO:teuthology.orchestra.run.smithi077.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-13T11:06:15.899 INFO:teuthology.orchestra.run.smithi077.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-13T11:06:15.900 INFO:teuthology.orchestra.run.smithi077.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-13T11:06:15.901 INFO:teuthology.orchestra.run.smithi077.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-13T11:06:15.904 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-13T11:06:15.905 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-13T11:06:15.966 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-06-13T11:06:15.988 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-06-13T11:06:15.988 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-06-13T11:06:15.988 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-06-13T11:06:15.988 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-06-13T11:06:15.988 INFO:teuthology.orchestra.run.smithi077.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-13T11:06:15.989 INFO:teuthology.orchestra.run.smithi077.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-13T11:06:15.989 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-13T11:06:15.989 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-13T11:06:15.989 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-13T11:06:15.989 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-13T11:06:15.989 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-13T11:06:15.989 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-13T11:06:15.989 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-13T11:06:15.989 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-13T11:06:15.989 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-13T11:06:15.989 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-13T11:06:15.989 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-13T11:06:15.990 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-13T11:06:15.990 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-13T11:06:15.990 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-13T11:06:15.990 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-13T11:06:15.990 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-13T11:06:15.990 INFO:teuthology.orchestra.run.smithi077.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-13T11:06:15.990 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-13T11:06:15.990 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-13T11:06:15.990 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-13T11:06:15.990 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-13T11:06:15.990 INFO:teuthology.orchestra.run.smithi077.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-13T11:06:15.990 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-13T11:06:15.990 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel x86_64 1:3.2.2-1.el9 appstream 4.4 M 2024-06-13T11:06:15.991 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-13T11:06:15.991 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-13T11:06:15.991 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-13T11:06:15.991 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-13T11:06:15.991 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-13T11:06:15.991 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-13T11:06:15.991 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-13T11:06:15.991 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-13T11:06:15.991 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-13T11:06:15.991 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-13T11:06:15.991 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel x86_64 6.4.0-1.el9 appstream 95 k 2024-06-13T11:06:15.991 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2024-06-13T11:06:15.991 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-13T11:06:15.992 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-13T11:06:15.992 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-13T11:06:15.992 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-13T11:06:15.992 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-13T11:06:15.992 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-13T11:06:15.992 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-13T11:06:15.992 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-13T11:06:15.992 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-13T11:06:15.992 INFO:teuthology.orchestra.run.smithi077.stdout: openssl x86_64 1:3.2.2-1.el9 baseos 1.4 M 2024-06-13T11:06:15.992 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-libs x86_64 1:3.2.2-1.el9 baseos 2.4 M 2024-06-13T11:06:15.992 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs x86_64 6.4.0-1.el9 baseos 1.1 M 2024-06-13T11:06:15.992 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-06-13T11:06:15.992 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-13T11:06:15.993 INFO:teuthology.orchestra.run.smithi077.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-13T11:06:15.993 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-13T11:06:15.993 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-13T11:06:15.993 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-13T11:06:15.993 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-13T11:06:15.993 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-13T11:06:15.993 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-13T11:06:15.993 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-13T11:06:15.993 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-13T11:06:15.993 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-13T11:06:15.993 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-13T11:06:15.993 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-13T11:06:15.993 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-13T11:06:15.994 INFO:teuthology.orchestra.run.smithi077.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-13T11:06:15.994 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-13T11:06:15.994 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-13T11:06:15.994 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-13T11:06:15.994 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-13T11:06:15.994 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-13T11:06:15.994 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-13T11:06:15.994 INFO:teuthology.orchestra.run.smithi077.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-13T11:06:15.994 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-13T11:06:15.994 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-13T11:06:15.995 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-13T11:06:15.995 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-13T11:06:15.995 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-13T11:06:15.995 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-13T11:06:15.995 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-13T11:06:15.995 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-13T11:06:15.995 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-13T11:06:15.995 INFO:teuthology.orchestra.run.smithi077.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-13T11:06:15.995 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-13T11:06:15.995 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-13T11:06:15.995 INFO:teuthology.orchestra.run.smithi077.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-13T11:06:15.995 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-13T11:06:15.996 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-13T11:06:15.996 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-13T11:06:15.996 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-13T11:06:15.996 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-13T11:06:15.996 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-13T11:06:15.996 INFO:teuthology.orchestra.run.smithi077.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-13T11:06:15.996 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-13T11:06:15.996 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-13T11:06:15.996 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-13T11:06:15.996 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-13T11:06:15.996 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-13T11:06:15.996 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-13T11:06:15.996 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-13T11:06:15.997 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-13T11:06:15.997 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-13T11:06:15.997 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-13T11:06:15.997 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-13T11:06:15.997 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-13T11:06:15.997 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-13T11:06:15.997 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth noarch 1:2.29.0-2.el9 epel 205 k 2024-06-13T11:06:15.997 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-13T11:06:15.997 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-13T11:06:15.997 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-13T11:06:15.997 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-13T11:06:15.997 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-13T11:06:15.997 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-13T11:06:15.998 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-13T11:06:15.998 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-13T11:06:15.998 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-13T11:06:15.998 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-13T11:06:15.998 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-13T11:06:15.998 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-13T11:06:15.998 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-13T11:06:15.998 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-13T11:06:15.998 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-13T11:06:15.998 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-13T11:06:15.998 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-13T11:06:15.998 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-13T11:06:15.999 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-13T11:06:15.999 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-13T11:06:15.999 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-13T11:06:15.999 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-13T11:06:15.999 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-13T11:06:15.999 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-13T11:06:15.999 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-13T11:06:15.999 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-13T11:06:15.999 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-13T11:06:15.999 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-13T11:06:15.999 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-13T11:06:15.999 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-13T11:06:15.999 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-13T11:06:16.000 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-13T11:06:16.000 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-13T11:06:16.000 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-13T11:06:16.000 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-13T11:06:16.000 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-13T11:06:16.000 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-13T11:06:16.000 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-13T11:06:16.000 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-13T11:06:16.000 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-13T11:06:16.000 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-13T11:06:16.000 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-13T11:06:16.000 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-13T11:06:16.000 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-13T11:06:16.000 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-13T11:06:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-13T11:06:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-13T11:06:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-13T11:06:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-13T11:06:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-06-13T11:06:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-13T11:06:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-13T11:06:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-13T11:06:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-13T11:06:16.001 INFO:teuthology.orchestra.run.smithi077.stdout:Installing weak dependencies: 2024-06-13T11:06:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-13T11:06:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-06-13T11:06:16.001 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-06-13T11:06:16.002 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-06-13T11:06:16.002 INFO:teuthology.orchestra.run.smithi077.stdout:Install 148 Packages 2024-06-13T11:06:16.002 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 12 Packages 2024-06-13T11:06:16.002 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-06-13T11:06:16.002 INFO:teuthology.orchestra.run.smithi178.stdout:(11/160): ceph-osd-19.0.0-2946.g3d89accf.el9.x8 8.0 MB/s | 17 MB 00:02 2024-06-13T11:06:16.003 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 226 M 2024-06-13T11:06:16.003 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-06-13T11:06:16.023 INFO:teuthology.orchestra.run.smithi178.stdout:(12/160): cephfs-mirror-19.0.0-2946.g3d89accf.e 1.2 MB/s | 221 kB 00:00 2024-06-13T11:06:16.048 INFO:teuthology.orchestra.run.smithi178.stdout:(13/160): cephfs-shell-19.0.0-2946.g3d89accf.el 539 kB/s | 27 kB 00:00 2024-06-13T11:06:16.082 INFO:teuthology.orchestra.run.smithi178.stdout:(14/160): libcephfs-devel-19.0.0-2946.g3d89accf 541 kB/s | 32 kB 00:00 2024-06-13T11:06:16.166 INFO:teuthology.orchestra.run.smithi178.stdout:(15/160): libcephfs2-19.0.0-2946.g3d89accf.el9. 6.2 MB/s | 747 kB 00:00 2024-06-13T11:06:16.191 INFO:teuthology.orchestra.run.smithi178.stdout:(16/160): libcephsqlite-19.0.0-2946.g3d89accf.e 1.5 MB/s | 163 kB 00:00 2024-06-13T11:06:16.216 INFO:teuthology.orchestra.run.smithi178.stdout:(17/160): librados-devel-19.0.0-2946.g3d89accf. 2.5 MB/s | 127 kB 00:00 2024-06-13T11:06:16.283 INFO:teuthology.orchestra.run.smithi178.stdout:(18/160): libradosstriper1-19.0.0-2946.g3d89acc 5.3 MB/s | 501 kB 00:00 2024-06-13T11:06:16.339 INFO:teuthology.orchestra.run.smithi002.stdout:(1/160): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-06-13T11:06:16.375 INFO:teuthology.orchestra.run.smithi178.stdout:(19/160): python3-ceph-argparse-19.0.0-2946.g3d 491 kB/s | 45 kB 00:00 2024-06-13T11:06:16.475 INFO:teuthology.orchestra.run.smithi178.stdout:(20/160): python3-ceph-common-19.0.0-2946.g3d89 1.3 MB/s | 135 kB 00:00 2024-06-13T11:06:16.584 INFO:teuthology.orchestra.run.smithi178.stdout:(21/160): python3-cephfs-19.0.0-2946.g3d89accf. 1.5 MB/s | 162 kB 00:00 2024-06-13T11:06:16.701 INFO:teuthology.orchestra.run.smithi178.stdout:(22/160): python3-rados-19.0.0-2946.g3d89accf.e 2.7 MB/s | 321 kB 00:00 2024-06-13T11:06:16.851 INFO:teuthology.orchestra.run.smithi178.stdout:(23/160): librgw2-19.0.0-2946.g3d89accf.el9.x86 8.4 MB/s | 5.3 MB 00:00 2024-06-13T11:06:16.877 INFO:teuthology.orchestra.run.smithi178.stdout:(24/160): python3-rbd-19.0.0-2946.g3d89accf.el9 1.7 MB/s | 300 kB 00:00 2024-06-13T11:06:16.911 INFO:teuthology.orchestra.run.smithi077.stdout:(1/160): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 19 kB/s | 6.6 kB 00:00 2024-06-13T11:06:16.918 INFO:teuthology.orchestra.run.smithi178.stdout:(25/160): python3-rgw-19.0.0-2946.g3d89accf.el9 1.5 MB/s | 99 kB 00:00 2024-06-13T11:06:16.969 INFO:teuthology.orchestra.run.smithi178.stdout:(26/160): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 929 kB/s | 85 kB 00:00 2024-06-13T11:06:17.064 INFO:teuthology.orchestra.run.smithi002.stdout:(2/160): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 1.2 MB/s | 890 kB 00:00 2024-06-13T11:06:17.085 INFO:teuthology.orchestra.run.smithi178.stdout:(27/160): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 1.4 MB/s | 171 kB 00:00 2024-06-13T11:06:17.203 INFO:teuthology.orchestra.run.smithi178.stdout:(28/160): ceph-grafana-dashboards-19.0.0-2946.g 271 kB/s | 32 kB 00:00 2024-06-13T11:06:17.231 INFO:teuthology.orchestra.run.smithi002.stdout:(3/160): ceph-immutable-object-cache-19.0.0-294 873 kB/s | 145 kB 00:00 2024-06-13T11:06:17.328 INFO:teuthology.orchestra.run.smithi178.stdout:(29/160): rbd-mirror-19.0.0-2946.g3d89accf.el9. 7.6 MB/s | 3.1 MB 00:00 2024-06-13T11:06:17.353 INFO:teuthology.orchestra.run.smithi178.stdout:(30/160): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 946 kB/s | 142 kB 00:00 2024-06-13T11:06:17.970 INFO:teuthology.orchestra.run.smithi178.stdout:(31/160): ceph-mgr-dashboard-19.0.0-2946.g3d89a 5.5 MB/s | 3.5 MB 00:00 2024-06-13T11:06:18.070 INFO:teuthology.orchestra.run.smithi178.stdout:(32/160): ceph-mgr-modules-core-19.0.0-2946.g3d 2.4 MB/s | 249 kB 00:00 2024-06-13T11:06:18.154 INFO:teuthology.orchestra.run.smithi178.stdout:(33/160): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 592 kB/s | 49 kB 00:00 2024-06-13T11:06:18.229 INFO:teuthology.orchestra.run.smithi178.stdout:(34/160): ceph-prometheus-alerts-19.0.0-2946.g3 219 kB/s | 16 kB 00:00 2024-06-13T11:06:18.330 INFO:teuthology.orchestra.run.smithi178.stdout:(35/160): ceph-volume-19.0.0-2946.g3d89accf.el9 2.6 MB/s | 264 kB 00:00 2024-06-13T11:06:18.565 INFO:teuthology.orchestra.run.smithi002.stdout:(4/160): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 1.8 MB/s | 2.4 MB 00:01 2024-06-13T11:06:18.572 INFO:teuthology.orchestra.run.smithi178.stdout:(36/160): cephadm-19.0.0-2946.g3d89accf.el9.noa 3.1 MB/s | 763 kB 00:00 2024-06-13T11:06:18.655 INFO:teuthology.orchestra.run.smithi178.stdout:(37/160): cephfs-top-19.0.0-2946.g3d89accf.el9. 218 kB/s | 18 kB 00:00 2024-06-13T11:06:18.719 INFO:teuthology.orchestra.run.smithi077.stdout:(2/160): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 492 kB/s | 890 kB 00:01 2024-06-13T11:06:18.847 INFO:teuthology.orchestra.run.smithi178.stdout:(38/160): ceph-mgr-diskprediction-local-19.0.0- 4.9 MB/s | 7.4 MB 00:01 2024-06-13T11:06:18.872 INFO:teuthology.orchestra.run.smithi178.stdout:(39/160): fuse-2.9.9-15.el9.x86_64.rpm 370 kB/s | 80 kB 00:00 2024-06-13T11:06:18.973 INFO:teuthology.orchestra.run.smithi178.stdout:(40/160): libgfortran-11.4.1-3.el9.x86_64.rpm 6.3 MB/s | 803 kB 00:00 2024-06-13T11:06:19.023 INFO:teuthology.orchestra.run.smithi178.stdout:(41/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-06-13T11:06:19.028 INFO:teuthology.orchestra.run.smithi077.stdout:(3/160): ceph-immutable-object-cache-19.0.0-294 470 kB/s | 145 kB 00:00 2024-06-13T11:06:19.048 INFO:teuthology.orchestra.run.smithi178.stdout:(42/160): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-06-13T11:06:19.095 INFO:teuthology.orchestra.run.smithi077.stdout:(4/160): ceph-base-19.0.0-2946.g3d89accf.el9.x8 2.1 MB/s | 5.4 MB 00:02 2024-06-13T11:06:19.140 INFO:teuthology.orchestra.run.smithi002.stdout:(5/160): ceph-base-19.0.0-2946.g3d89accf.el9.x8 1.7 MB/s | 5.4 MB 00:03 2024-06-13T11:06:19.232 INFO:teuthology.orchestra.run.smithi002.stdout:(6/160): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 2.2 MB/s | 1.5 MB 00:00 2024-06-13T11:06:19.329 INFO:teuthology.orchestra.run.smithi077.stdout:(5/160): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 6.4 MB/s | 1.5 MB 00:00 2024-06-13T11:06:19.499 INFO:teuthology.orchestra.run.smithi178.stdout:(43/160): ceph-test-19.0.0-2946.g3d89accf.el9.x 10 MB/s | 48 MB 00:04 2024-06-13T11:06:19.516 INFO:teuthology.orchestra.run.smithi178.stdout:(44/160): python3-ply-3.11-14.el9.noarch.rpm 228 kB/s | 106 kB 00:00 2024-06-13T11:06:19.558 INFO:teuthology.orchestra.run.smithi178.stdout:(45/160): python3-cryptography-36.0.1-4.el9.x86 2.3 MB/s | 1.2 MB 00:00 2024-06-13T11:06:19.583 INFO:teuthology.orchestra.run.smithi178.stdout:(46/160): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-06-13T11:06:19.608 INFO:teuthology.orchestra.run.smithi178.stdout:(47/160): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-06-13T11:06:19.684 INFO:teuthology.orchestra.run.smithi178.stdout:(48/160): python3-pycparser-2.20-6.el9.noarch.r 734 kB/s | 135 kB 00:00 2024-06-13T11:06:20.129 INFO:teuthology.orchestra.run.smithi077.stdout:(6/160): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 5.9 MB/s | 4.7 MB 00:00 2024-06-13T11:06:20.332 INFO:teuthology.orchestra.run.smithi002.stdout:(7/160): ceph-common-19.0.0-2946.g3d89accf.el9. 4.9 MB/s | 21 MB 00:04 2024-06-13T11:06:20.425 INFO:teuthology.orchestra.run.smithi178.stdout:(49/160): boost-program-options-1.75.0-8.el9.x8 144 kB/s | 107 kB 00:00 2024-06-13T11:06:20.444 INFO:teuthology.orchestra.run.smithi002.stdout:(8/160): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 3.6 MB/s | 4.7 MB 00:01 2024-06-13T11:06:20.533 INFO:teuthology.orchestra.run.smithi002.stdout:(9/160): ceph-selinux-19.0.0-2946.g3d89accf.el9 278 kB/s | 25 kB 00:00 2024-06-13T11:06:20.568 INFO:teuthology.orchestra.run.smithi178.stdout:(50/160): automake-1.16.2-8.el9.noarch.rpm 700 kB/s | 689 kB 00:00 2024-06-13T11:06:20.626 INFO:teuthology.orchestra.run.smithi178.stdout:(51/160): bison-3.7.4-5.el9.x86_64.rpm 927 kB/s | 943 kB 00:01 2024-06-13T11:06:21.018 INFO:teuthology.orchestra.run.smithi178.stdout:(52/160): elfutils-libelf-devel-0.191-4.el9.x86 37 kB/s | 22 kB 00:00 2024-06-13T11:06:21.251 INFO:teuthology.orchestra.run.smithi178.stdout:(53/160): flexiblas-3.0.4-8.el9.x86_64.rpm 52 kB/s | 33 kB 00:00 2024-06-13T11:06:21.266 INFO:teuthology.orchestra.run.smithi002.stdout:(10/160): ceph-radosgw-19.0.0-2946.g3d89accf.el 11 MB/s | 10 MB 00:00 2024-06-13T11:06:21.341 INFO:teuthology.orchestra.run.smithi002.stdout:(11/160): cephfs-mirror-19.0.0-2946.g3d89accf.e 2.9 MB/s | 221 kB 00:00 2024-06-13T11:06:21.400 INFO:teuthology.orchestra.run.smithi002.stdout:(12/160): cephfs-shell-19.0.0-2946.g3d89accf.el 472 kB/s | 27 kB 00:00 2024-06-13T11:06:21.426 INFO:teuthology.orchestra.run.smithi178.stdout:(54/160): flex-2.6.4-9.el9.x86_64.rpm 365 kB/s | 313 kB 00:00 2024-06-13T11:06:21.450 INFO:teuthology.orchestra.run.smithi002.stdout:(13/160): libcephfs-devel-19.0.0-2946.g3d89accf 648 kB/s | 32 kB 00:00 2024-06-13T11:06:21.551 INFO:teuthology.orchestra.run.smithi002.stdout:(14/160): libcephfs2-19.0.0-2946.g3d89accf.el9. 7.4 MB/s | 747 kB 00:00 2024-06-13T11:06:21.617 INFO:teuthology.orchestra.run.smithi002.stdout:(15/160): libcephsqlite-19.0.0-2946.g3d89accf.e 2.4 MB/s | 163 kB 00:00 2024-06-13T11:06:21.684 INFO:teuthology.orchestra.run.smithi002.stdout:(16/160): librados-devel-19.0.0-2946.g3d89accf. 1.9 MB/s | 127 kB 00:00 2024-06-13T11:06:21.776 INFO:teuthology.orchestra.run.smithi002.stdout:(17/160): libradosstriper1-19.0.0-2946.g3d89acc 5.4 MB/s | 501 kB 00:00 2024-06-13T11:06:21.827 INFO:teuthology.orchestra.run.smithi178.stdout:(55/160): flexiblas-openblas-openmp-3.0.4-8.el9 33 kB/s | 18 kB 00:00 2024-06-13T11:06:21.829 INFO:teuthology.orchestra.run.smithi077.stdout:(7/160): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 864 kB/s | 2.4 MB 00:02 2024-06-13T11:06:21.952 INFO:teuthology.orchestra.run.smithi178.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 21 kB/s | 11 kB 00:00 2024-06-13T11:06:22.211 INFO:teuthology.orchestra.run.smithi178.stdout:(57/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.5 MB/s | 3.0 MB 00:01 2024-06-13T11:06:22.293 INFO:teuthology.orchestra.run.smithi002.stdout:(18/160): librgw2-19.0.0-2946.g3d89accf.el9.x86 10 MB/s | 5.3 MB 00:00 2024-06-13T11:06:22.304 INFO:teuthology.orchestra.run.smithi077.stdout:(8/160): ceph-osd-19.0.0-2946.g3d89accf.el9.x86 7.7 MB/s | 17 MB 00:02 2024-06-13T11:06:22.352 INFO:teuthology.orchestra.run.smithi002.stdout:(19/160): python3-ceph-argparse-19.0.0-2946.g3d 789 kB/s | 45 kB 00:00 2024-06-13T11:06:22.363 INFO:teuthology.orchestra.run.smithi077.stdout:(9/160): ceph-selinux-19.0.0-2946.g3d89accf.el9 434 kB/s | 25 kB 00:00 2024-06-13T11:06:22.410 INFO:teuthology.orchestra.run.smithi002.stdout:(20/160): python3-ceph-common-19.0.0-2946.g3d89 2.3 MB/s | 135 kB 00:00 2024-06-13T11:06:22.486 INFO:teuthology.orchestra.run.smithi002.stdout:(21/160): python3-cephfs-19.0.0-2946.g3d89accf. 2.1 MB/s | 162 kB 00:00 2024-06-13T11:06:22.608 INFO:teuthology.orchestra.run.smithi002.stdout:(22/160): python3-rados-19.0.0-2946.g3d89accf.e 2.6 MB/s | 321 kB 00:00 2024-06-13T11:06:22.644 INFO:teuthology.orchestra.run.smithi178.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 65 kB/s | 45 kB 00:00 2024-06-13T11:06:22.669 INFO:teuthology.orchestra.run.smithi178.stdout:(59/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 190 kB/s | 160 kB 00:00 2024-06-13T11:06:22.695 INFO:teuthology.orchestra.run.smithi002.stdout:(23/160): python3-rbd-19.0.0-2946.g3d89accf.el9 3.4 MB/s | 300 kB 00:00 2024-06-13T11:06:22.762 INFO:teuthology.orchestra.run.smithi002.stdout:(24/160): python3-rgw-19.0.0-2946.g3d89accf.el9 1.5 MB/s | 99 kB 00:00 2024-06-13T11:06:22.829 INFO:teuthology.orchestra.run.smithi002.stdout:(25/160): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.3 MB/s | 85 kB 00:00 2024-06-13T11:06:23.187 INFO:teuthology.orchestra.run.smithi002.stdout:(26/160): rbd-mirror-19.0.0-2946.g3d89accf.el9. 8.7 MB/s | 3.1 MB 00:00 2024-06-13T11:06:23.211 INFO:teuthology.orchestra.run.smithi178.stdout:(60/160): librdkafka-1.6.1-102.el9.x86_64.rpm 681 kB/s | 662 kB 00:00 2024-06-13T11:06:23.262 INFO:teuthology.orchestra.run.smithi178.stdout:(61/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 43 kB/s | 25 kB 00:00 2024-06-13T11:06:23.262 INFO:teuthology.orchestra.run.smithi002.stdout:(27/160): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 2.3 MB/s | 171 kB 00:00 2024-06-13T11:06:23.313 INFO:teuthology.orchestra.run.smithi002.stdout:(28/160): ceph-grafana-dashboards-19.0.0-2946.g 648 kB/s | 32 kB 00:00 2024-06-13T11:06:23.380 INFO:teuthology.orchestra.run.smithi002.stdout:(29/160): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 2.1 MB/s | 142 kB 00:00 2024-06-13T11:06:23.397 INFO:teuthology.orchestra.run.smithi077.stdout:(10/160): ceph-common-19.0.0-2946.g3d89accf.el9 3.1 MB/s | 21 MB 00:06 2024-06-13T11:06:23.563 INFO:teuthology.orchestra.run.smithi077.stdout:(11/160): cephfs-mirror-19.0.0-2946.g3d89accf.e 1.3 MB/s | 221 kB 00:00 2024-06-13T11:06:23.578 INFO:teuthology.orchestra.run.smithi178.stdout:(62/160): libtool-2.4.6-45.el9.x86_64.rpm 623 kB/s | 582 kB 00:00 2024-06-13T11:06:23.663 INFO:teuthology.orchestra.run.smithi077.stdout:(12/160): cephfs-shell-19.0.0-2946.g3d89accf.el 271 kB/s | 27 kB 00:00 2024-06-13T11:06:23.722 INFO:teuthology.orchestra.run.smithi077.stdout:(13/160): libcephfs-devel-19.0.0-2946.g3d89accf 543 kB/s | 32 kB 00:00 2024-06-13T11:06:23.730 INFO:teuthology.orchestra.run.smithi002.stdout:(30/160): ceph-mgr-dashboard-19.0.0-2946.g3d89a 10 MB/s | 3.5 MB 00:00 2024-06-13T11:06:23.854 INFO:teuthology.orchestra.run.smithi178.stdout:(63/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 74 kB/s | 47 kB 00:00 2024-06-13T11:06:24.014 INFO:teuthology.orchestra.run.smithi077.stdout:(14/160): libcephfs2-19.0.0-2946.g3d89accf.el9. 2.5 MB/s | 747 kB 00:00 2024-06-13T11:06:24.114 INFO:teuthology.orchestra.run.smithi077.stdout:(15/160): libcephsqlite-19.0.0-2946.g3d89accf.e 1.6 MB/s | 163 kB 00:00 2024-06-13T11:06:24.137 INFO:teuthology.orchestra.run.smithi178.stdout:(64/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 334 kB/s | 292 kB 00:00 2024-06-13T11:06:24.215 INFO:teuthology.orchestra.run.smithi077.stdout:(16/160): librados-devel-19.0.0-2946.g3d89accf. 1.2 MB/s | 127 kB 00:00 2024-06-13T11:06:24.396 INFO:teuthology.orchestra.run.smithi178.stdout:(65/160): lua-5.4.4-4.el9.x86_64.rpm 230 kB/s | 188 kB 00:00 2024-06-13T11:06:24.432 INFO:teuthology.orchestra.run.smithi077.stdout:(17/160): libradosstriper1-19.0.0-2946.g3d89acc 2.3 MB/s | 501 kB 00:00 2024-06-13T11:06:24.455 INFO:teuthology.orchestra.run.smithi002.stdout:(31/160): ceph-mgr-diskprediction-local-19.0.0- 10 MB/s | 7.4 MB 00:00 2024-06-13T11:06:24.471 INFO:teuthology.orchestra.run.smithi178.stdout:(66/160): openblas-0.3.21-2.el9.x86_64.rpm 57 kB/s | 35 kB 00:00 2024-06-13T11:06:24.539 INFO:teuthology.orchestra.run.smithi002.stdout:(32/160): ceph-mgr-modules-core-19.0.0-2946.g3d 3.0 MB/s | 249 kB 00:00 2024-06-13T11:06:24.614 INFO:teuthology.orchestra.run.smithi002.stdout:(33/160): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 665 kB/s | 49 kB 00:00 2024-06-13T11:06:24.681 INFO:teuthology.orchestra.run.smithi002.stdout:(34/160): ceph-prometheus-alerts-19.0.0-2946.g3 250 kB/s | 16 kB 00:00 2024-06-13T11:06:24.765 INFO:teuthology.orchestra.run.smithi002.stdout:(35/160): ceph-volume-19.0.0-2946.g3d89accf.el9 3.1 MB/s | 264 kB 00:00 2024-06-13T11:06:24.881 INFO:teuthology.orchestra.run.smithi002.stdout:(36/160): cephadm-19.0.0-2946.g3d89accf.el9.noa 6.4 MB/s | 763 kB 00:00 2024-06-13T11:06:25.099 INFO:teuthology.orchestra.run.smithi002.stdout:(37/160): ceph-osd-19.0.0-2946.g3d89accf.el9.x8 2.9 MB/s | 17 MB 00:05 2024-06-13T11:06:25.154 INFO:teuthology.orchestra.run.smithi002.stdout:(38/160): cephfs-top-19.0.0-2946.g3d89accf.el9. 67 kB/s | 18 kB 00:00 2024-06-13T11:06:25.266 INFO:teuthology.orchestra.run.smithi002.stdout:(39/160): fuse-2.9.9-15.el9.x86_64.rpm 484 kB/s | 80 kB 00:00 2024-06-13T11:06:25.333 INFO:teuthology.orchestra.run.smithi002.stdout:(40/160): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-06-13T11:06:25.366 INFO:teuthology.orchestra.run.smithi002.stdout:(41/160): libgfortran-11.4.1-3.el9.x86_64.rpm 3.7 MB/s | 803 kB 00:00 2024-06-13T11:06:25.397 INFO:teuthology.orchestra.run.smithi178.stdout:(67/160): openblas-openmp-0.3.21-2.el9.x86_64.r 3.8 MB/s | 4.7 MB 00:01 2024-06-13T11:06:25.400 INFO:teuthology.orchestra.run.smithi002.stdout:(42/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.8 MB/s | 253 kB 00:00 2024-06-13T11:06:25.448 INFO:teuthology.orchestra.run.smithi077.stdout:(18/160): librgw2-19.0.0-2946.g3d89accf.el9.x86 5.2 MB/s | 5.3 MB 00:01 2024-06-13T11:06:25.450 INFO:teuthology.orchestra.run.smithi002.stdout:(43/160): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-06-13T11:06:25.509 INFO:teuthology.orchestra.run.smithi002.stdout:(44/160): python3-cryptography-36.0.1-4.el9.x86 8.7 MB/s | 1.2 MB 00:00 2024-06-13T11:06:25.524 INFO:teuthology.orchestra.run.smithi077.stdout:(19/160): python3-ceph-argparse-19.0.0-2946.g3d 603 kB/s | 45 kB 00:00 2024-06-13T11:06:25.542 INFO:teuthology.orchestra.run.smithi002.stdout:(45/160): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-06-13T11:06:25.555 INFO:teuthology.orchestra.run.smithi178.stdout:(68/160): postgresql-13.14-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-06-13T11:06:25.568 INFO:teuthology.orchestra.run.smithi002.stdout:(46/160): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-06-13T11:06:25.582 INFO:teuthology.orchestra.run.smithi077.stdout:(20/160): python3-ceph-common-19.0.0-2946.g3d89 2.3 MB/s | 135 kB 00:00 2024-06-13T11:06:25.601 INFO:teuthology.orchestra.run.smithi002.stdout:(47/160): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-06-13T11:06:25.639 INFO:teuthology.orchestra.run.smithi178.stdout:(69/160): openssl-devel-3.2.2-1.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-06-13T11:06:25.641 INFO:teuthology.orchestra.run.smithi077.stdout:(21/160): python3-cephfs-19.0.0-2946.g3d89accf. 2.7 MB/s | 162 kB 00:00 2024-06-13T11:06:25.741 INFO:teuthology.orchestra.run.smithi077.stdout:(22/160): python3-rados-19.0.0-2946.g3d89accf.e 3.1 MB/s | 321 kB 00:00 2024-06-13T11:06:25.841 INFO:teuthology.orchestra.run.smithi077.stdout:(23/160): python3-rbd-19.0.0-2946.g3d89accf.el9 2.9 MB/s | 300 kB 00:00 2024-06-13T11:06:25.900 INFO:teuthology.orchestra.run.smithi077.stdout:(24/160): python3-rgw-19.0.0-2946.g3d89accf.el9 1.7 MB/s | 99 kB 00:00 2024-06-13T11:06:25.959 INFO:teuthology.orchestra.run.smithi077.stdout:(25/160): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.4 MB/s | 85 kB 00:00 2024-06-13T11:06:26.389 INFO:teuthology.orchestra.run.smithi178.stdout:(70/160): postgresql-private-libs-13.14-1.el9.x 160 kB/s | 133 kB 00:00 2024-06-13T11:06:26.439 INFO:teuthology.orchestra.run.smithi178.stdout:(71/160): postgresql-contrib-13.14-1.el9.x86_64 875 kB/s | 911 kB 00:01 2024-06-13T11:06:26.534 INFO:teuthology.orchestra.run.smithi077.stdout:(26/160): rbd-mirror-19.0.0-2946.g3d89accf.el9. 5.4 MB/s | 3.1 MB 00:00 2024-06-13T11:06:26.585 INFO:teuthology.orchestra.run.smithi077.stdout:(27/160): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 3.4 MB/s | 171 kB 00:00 2024-06-13T11:06:26.618 INFO:teuthology.orchestra.run.smithi002.stdout:(48/160): automake-1.16.2-8.el9.noarch.rpm 657 kB/s | 689 kB 00:01 2024-06-13T11:06:26.643 INFO:teuthology.orchestra.run.smithi077.stdout:(28/160): ceph-grafana-dashboards-19.0.0-2946.g 545 kB/s | 32 kB 00:00 2024-06-13T11:06:26.702 INFO:teuthology.orchestra.run.smithi077.stdout:(29/160): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 2.4 MB/s | 142 kB 00:00 2024-06-13T11:06:26.710 INFO:teuthology.orchestra.run.smithi002.stdout:(49/160): bison-3.7.4-5.el9.x86_64.rpm 851 kB/s | 943 kB 00:01 2024-06-13T11:06:27.039 INFO:teuthology.orchestra.run.smithi178.stdout:(72/160): postgresql-server-13.14-1.el9.x86_64. 4.2 MB/s | 5.8 MB 00:01 2024-06-13T11:06:27.219 INFO:teuthology.orchestra.run.smithi077.stdout:(30/160): ceph-mgr-dashboard-19.0.0-2946.g3d89a 6.8 MB/s | 3.5 MB 00:00 2024-06-13T11:06:27.239 INFO:teuthology.orchestra.run.smithi178.stdout:(73/160): python3-attrs-20.3.0-7.el9.noarch.rpm 109 kB/s | 87 kB 00:00 2024-06-13T11:06:27.486 INFO:teuthology.orchestra.run.smithi002.stdout:(50/160): ceph-test-19.0.0-2946.g3d89accf.el9.x 6.9 MB/s | 48 MB 00:06 2024-06-13T11:06:27.531 INFO:teuthology.orchestra.run.smithi178.stdout:(74/160): protobuf-3.14.0-13.el9.x86_64.rpm 905 kB/s | 1.0 MB 00:01 2024-06-13T11:06:27.786 INFO:teuthology.orchestra.run.smithi077.stdout:(31/160): ceph-test-19.0.0-2946.g3d89accf.el9.x 8.9 MB/s | 48 MB 00:05 2024-06-13T11:06:27.895 INFO:teuthology.orchestra.run.smithi077.stdout:(32/160): ceph-radosgw-19.0.0-2946.g3d89accf.el 1.7 MB/s | 10 MB 00:06 2024-06-13T11:06:27.911 INFO:teuthology.orchestra.run.smithi002.stdout:(51/160): boost-program-options-1.75.0-8.el9.x8 83 kB/s | 107 kB 00:01 2024-06-13T11:06:27.920 INFO:teuthology.orchestra.run.smithi077.stdout:(33/160): ceph-mgr-modules-core-19.0.0-2946.g3d 1.8 MB/s | 249 kB 00:00 2024-06-13T11:06:27.928 INFO:teuthology.orchestra.run.smithi002.stdout:(52/160): elfutils-libelf-devel-0.191-4.el9.x86 18 kB/s | 22 kB 00:01 2024-06-13T11:06:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:(34/160): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 740 kB/s | 49 kB 00:00 2024-06-13T11:06:27.969 INFO:teuthology.orchestra.run.smithi178.stdout:(75/160): python3-colorama-0.4.6-3.el9.noarch.r 84 kB/s | 61 kB 00:00 2024-06-13T11:06:27.987 INFO:teuthology.orchestra.run.smithi077.stdout:(35/160): ceph-prometheus-alerts-19.0.0-2946.g3 246 kB/s | 16 kB 00:00 2024-06-13T11:06:28.063 INFO:teuthology.orchestra.run.smithi077.stdout:(36/160): ceph-volume-19.0.0-2946.g3d89accf.el9 2.6 MB/s | 264 kB 00:00 2024-06-13T11:06:28.104 INFO:teuthology.orchestra.run.smithi077.stdout:(37/160): cephadm-19.0.0-2946.g3d89accf.el9.noa 6.4 MB/s | 763 kB 00:00 2024-06-13T11:06:28.129 INFO:teuthology.orchestra.run.smithi077.stdout:(38/160): cephfs-top-19.0.0-2946.g3d89accf.el9. 273 kB/s | 18 kB 00:00 2024-06-13T11:06:28.299 INFO:teuthology.orchestra.run.smithi178.stdout:(76/160): python3-babel-2.9.1-2.el9.noarch.rpm 4.7 MB/s | 6.0 MB 00:01 2024-06-13T11:06:28.380 INFO:teuthology.orchestra.run.smithi077.stdout:(39/160): ceph-mgr-diskprediction-local-19.0.0- 6.4 MB/s | 7.4 MB 00:01 2024-06-13T11:06:28.407 INFO:teuthology.orchestra.run.smithi178.stdout:(77/160): python3-devel-3.9.18-3.el9.x86_64.rpm 279 kB/s | 244 kB 00:00 2024-06-13T11:06:28.536 INFO:teuthology.orchestra.run.smithi002.stdout:(53/160): flex-2.6.4-9.el9.x86_64.rpm 322 kB/s | 313 kB 00:00 2024-06-13T11:06:28.587 INFO:teuthology.orchestra.run.smithi002.stdout:(54/160): flexiblas-3.0.4-8.el9.x86_64.rpm 49 kB/s | 33 kB 00:00 2024-06-13T11:06:28.816 INFO:teuthology.orchestra.run.smithi178.stdout:(78/160): python3-jinja2-2.11.3-6.el9.noarch.rp 294 kB/s | 248 kB 00:00 2024-06-13T11:06:28.872 INFO:teuthology.orchestra.run.smithi077.stdout:(40/160): fuse-2.9.9-15.el9.x86_64.rpm 105 kB/s | 80 kB 00:00 2024-06-13T11:06:28.899 INFO:teuthology.orchestra.run.smithi178.stdout:(79/160): python3-jsonpatch-1.21-16.el9.noarch. 43 kB/s | 26 kB 00:00 2024-06-13T11:06:28.975 INFO:teuthology.orchestra.run.smithi178.stdout:(80/160): python3-jsonpointer-2.0-4.el9.noarch. 34 kB/s | 19 kB 00:00 2024-06-13T11:06:29.137 INFO:teuthology.orchestra.run.smithi002.stdout:(55/160): flexiblas-openblas-openmp-3.0.4-8.el9 30 kB/s | 18 kB 00:00 2024-06-13T11:06:29.172 INFO:teuthology.orchestra.run.smithi077.stdout:(41/160): libgfortran-11.4.1-3.el9.x86_64.rpm 770 kB/s | 803 kB 00:01 2024-06-13T11:06:29.179 INFO:teuthology.orchestra.run.smithi002.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 19 kB/s | 11 kB 00:00 2024-06-13T11:06:29.239 INFO:teuthology.orchestra.run.smithi077.stdout:(42/160): libquadmath-11.4.1-3.el9.x86_64.rpm 243 kB/s | 195 kB 00:00 2024-06-13T11:06:29.279 INFO:teuthology.orchestra.run.smithi002.stdout:(57/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.2 MB/s | 3.0 MB 00:01 2024-06-13T11:06:29.526 INFO:teuthology.orchestra.run.smithi178.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 56 kB/s | 35 kB 00:00 2024-06-13T11:06:29.608 INFO:teuthology.orchestra.run.smithi178.stdout:(82/160): python3-mako-1.1.4-6.el9.noarch.rpm 217 kB/s | 172 kB 00:00 2024-06-13T11:06:29.731 INFO:teuthology.orchestra.run.smithi077.stdout:(43/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 295 kB/s | 253 kB 00:00 2024-06-13T11:06:29.981 INFO:teuthology.orchestra.run.smithi077.stdout:(44/160): python3-ply-3.11-14.el9.noarch.rpm 144 kB/s | 106 kB 00:00 2024-06-13T11:06:30.038 INFO:teuthology.orchestra.run.smithi002.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 53 kB/s | 45 kB 00:00 2024-06-13T11:06:30.079 INFO:teuthology.orchestra.run.smithi002.stdout:(59/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 170 kB/s | 160 kB 00:00 2024-06-13T11:06:30.209 INFO:teuthology.orchestra.run.smithi178.stdout:(83/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-06-13T11:06:30.215 INFO:teuthology.orchestra.run.smithi077.stdout:(45/160): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:01 2024-06-13T11:06:30.359 INFO:teuthology.orchestra.run.smithi178.stdout:(84/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 301 kB/s | 250 kB 00:00 2024-06-13T11:06:30.430 INFO:teuthology.orchestra.run.smithi002.stdout:(60/160): librdkafka-1.6.1-102.el9.x86_64.rpm 577 kB/s | 662 kB 00:01 2024-06-13T11:06:30.517 INFO:teuthology.orchestra.run.smithi178.stdout:(85/160): python3-oauthlib-3.1.1-5.el9.noarch.r 244 kB/s | 222 kB 00:00 2024-06-13T11:06:30.532 INFO:teuthology.orchestra.run.smithi077.stdout:(46/160): python3-pycparser-2.20-6.el9.noarch.r 169 kB/s | 135 kB 00:00 2024-06-13T11:06:30.740 INFO:teuthology.orchestra.run.smithi077.stdout:(47/160): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-06-13T11:06:30.765 INFO:teuthology.orchestra.run.smithi077.stdout:(48/160): python3-requests-2.25.1-8.el9.noarch. 165 kB/s | 125 kB 00:00 2024-06-13T11:06:30.771 INFO:teuthology.orchestra.run.smithi002.stdout:(61/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 37 kB/s | 25 kB 00:00 2024-06-13T11:06:30.824 INFO:teuthology.orchestra.run.smithi077.stdout:(49/160): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 943 kB 00:00 2024-06-13T11:06:30.866 INFO:teuthology.orchestra.run.smithi077.stdout:(50/160): elfutils-libelf-devel-0.191-4.el9.x86 524 kB/s | 22 kB 00:00 2024-06-13T11:06:30.916 INFO:teuthology.orchestra.run.smithi077.stdout:(51/160): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-06-13T11:06:30.917 INFO:teuthology.orchestra.run.smithi178.stdout:(86/160): python3-packaging-20.9-5.el9.noarch.r 109 kB/s | 77 kB 00:00 2024-06-13T11:06:30.953 INFO:teuthology.orchestra.run.smithi077.stdout:(52/160): boost-program-options-1.75.0-8.el9.x8 579 kB/s | 107 kB 00:00 2024-06-13T11:06:31.005 INFO:teuthology.orchestra.run.smithi077.stdout:(53/160): flexiblas-3.0.4-8.el9.x86_64.rpm 369 kB/s | 33 kB 00:00 2024-06-13T11:06:31.026 INFO:teuthology.orchestra.run.smithi178.stdout:(87/160): python3-prettytable-0.7.2-27.el9.noar 63 kB/s | 42 kB 00:00 2024-06-13T11:06:31.034 INFO:teuthology.orchestra.run.smithi077.stdout:(54/160): python3-urllib3-1.26.5-5.el9.noarch.r 262 kB/s | 215 kB 00:00 2024-06-13T11:06:31.059 INFO:teuthology.orchestra.run.smithi077.stdout:(55/160): flexiblas-openblas-openmp-3.0.4-8.el9 339 kB/s | 18 kB 00:00 2024-06-13T11:06:31.110 INFO:teuthology.orchestra.run.smithi077.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 149 kB/s | 11 kB 00:00 2024-06-13T11:06:31.113 INFO:teuthology.orchestra.run.smithi002.stdout:(62/160): libtool-2.4.6-45.el9.x86_64.rpm 542 kB/s | 582 kB 00:01 2024-06-13T11:06:31.135 INFO:teuthology.orchestra.run.smithi077.stdout:(57/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-06-13T11:06:31.147 INFO:teuthology.orchestra.run.smithi002.stdout:(63/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 66 kB/s | 47 kB 00:00 2024-06-13T11:06:31.185 INFO:teuthology.orchestra.run.smithi077.stdout:(58/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-06-13T11:06:31.211 INFO:teuthology.orchestra.run.smithi077.stdout:(59/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-06-13T11:06:31.244 INFO:teuthology.orchestra.run.smithi077.stdout:(60/160): libtool-2.4.6-45.el9.x86_64.rpm 9.7 MB/s | 582 kB 00:00 2024-06-13T11:06:31.270 INFO:teuthology.orchestra.run.smithi077.stdout:(61/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 433 kB/s | 25 kB 00:00 2024-06-13T11:06:31.295 INFO:teuthology.orchestra.run.smithi077.stdout:(62/160): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-06-13T11:06:31.320 INFO:teuthology.orchestra.run.smithi077.stdout:(63/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-06-13T11:06:31.345 INFO:teuthology.orchestra.run.smithi077.stdout:(64/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-06-13T11:06:31.371 INFO:teuthology.orchestra.run.smithi077.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 703 kB/s | 35 kB 00:00 2024-06-13T11:06:31.401 INFO:teuthology.orchestra.run.smithi178.stdout:(88/160): python3-protobuf-3.14.0-13.el9.noarch 305 kB/s | 269 kB 00:00 2024-06-13T11:06:31.421 INFO:teuthology.orchestra.run.smithi077.stdout:(66/160): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-06-13T11:06:31.505 INFO:teuthology.orchestra.run.smithi077.stdout:(67/160): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-06-13T11:06:31.572 INFO:teuthology.orchestra.run.smithi077.stdout:(68/160): openssl-devel-3.2.2-1.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-06-13T11:06:31.605 INFO:teuthology.orchestra.run.smithi077.stdout:(69/160): postgresql-contrib-13.14-1.el9.x86_64 8.9 MB/s | 911 kB 00:00 2024-06-13T11:06:31.631 INFO:teuthology.orchestra.run.smithi077.stdout:(70/160): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-06-13T11:06:31.672 INFO:teuthology.orchestra.run.smithi077.stdout:(71/160): postgresql-13.14-1.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-06-13T11:06:31.701 INFO:teuthology.orchestra.run.smithi178.stdout:(89/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 203 kB/s | 159 kB 00:00 2024-06-13T11:06:31.706 INFO:teuthology.orchestra.run.smithi077.stdout:(72/160): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-06-13T11:06:31.732 INFO:teuthology.orchestra.run.smithi077.stdout:(73/160): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-06-13T11:06:31.790 INFO:teuthology.orchestra.run.smithi077.stdout:(74/160): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-06-13T11:06:31.831 INFO:teuthology.orchestra.run.smithi002.stdout:(64/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 276 kB/s | 292 kB 00:01 2024-06-13T11:06:31.864 INFO:teuthology.orchestra.run.smithi002.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 49 kB/s | 35 kB 00:00 2024-06-13T11:06:31.865 INFO:teuthology.orchestra.run.smithi077.stdout:(75/160): postgresql-server-13.14-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-06-13T11:06:31.891 INFO:teuthology.orchestra.run.smithi077.stdout:(76/160): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-06-13T11:06:31.910 INFO:teuthology.orchestra.run.smithi178.stdout:(90/160): python3-pyasn1-modules-0.4.8-6.el9.no 315 kB/s | 279 kB 00:00 2024-06-13T11:06:31.916 INFO:teuthology.orchestra.run.smithi077.stdout:(77/160): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-06-13T11:06:31.941 INFO:teuthology.orchestra.run.smithi077.stdout:(78/160): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-06-13T11:06:31.959 INFO:teuthology.orchestra.run.smithi077.stdout:(79/160): python3-jsonpointer-2.0-4.el9.noarch. 455 kB/s | 19 kB 00:00 2024-06-13T11:06:32.034 INFO:teuthology.orchestra.run.smithi077.stdout:(80/160): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-06-13T11:06:32.040 INFO:teuthology.orchestra.run.smithi002.stdout:(66/160): lua-5.4.4-4.el9.x86_64.rpm 204 kB/s | 188 kB 00:00 2024-06-13T11:06:32.051 INFO:teuthology.orchestra.run.smithi077.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 377 kB/s | 35 kB 00:00 2024-06-13T11:06:32.076 INFO:teuthology.orchestra.run.smithi077.stdout:(82/160): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-06-13T11:06:32.085 INFO:teuthology.orchestra.run.smithi178.stdout:(91/160): python3-pytz-2021.1-5.el9.noarch.rpm 75 kB/s | 51 kB 00:00 2024-06-13T11:06:32.118 INFO:teuthology.orchestra.run.smithi077.stdout:(83/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-06-13T11:06:32.143 INFO:teuthology.orchestra.run.smithi077.stdout:(84/160): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-06-13T11:06:32.169 INFO:teuthology.orchestra.run.smithi077.stdout:(85/160): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-06-13T11:06:32.194 INFO:teuthology.orchestra.run.smithi077.stdout:(86/160): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-06-13T11:06:32.219 INFO:teuthology.orchestra.run.smithi077.stdout:(87/160): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-06-13T11:06:32.244 INFO:teuthology.orchestra.run.smithi077.stdout:(88/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-13T11:06:32.270 INFO:teuthology.orchestra.run.smithi077.stdout:(89/160): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-06-13T11:06:32.295 INFO:teuthology.orchestra.run.smithi077.stdout:(90/160): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-06-13T11:06:32.320 INFO:teuthology.orchestra.run.smithi077.stdout:(91/160): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-06-13T11:06:32.387 INFO:teuthology.orchestra.run.smithi077.stdout:(92/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-06-13T11:06:32.402 INFO:teuthology.orchestra.run.smithi178.stdout:(92/160): python3-requests-oauthlib-1.3.0-12.el 77 kB/s | 54 kB 00:00 2024-06-13T11:06:32.413 INFO:teuthology.orchestra.run.smithi077.stdout:(93/160): python3-toml-0.10.2-6.el9.noarch.rpm 452 kB/s | 42 kB 00:00 2024-06-13T11:06:32.438 INFO:teuthology.orchestra.run.smithi077.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 877 kB/s | 44 kB 00:00 2024-06-13T11:06:32.463 INFO:teuthology.orchestra.run.smithi077.stdout:(95/160): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-06-13T11:06:32.489 INFO:teuthology.orchestra.run.smithi077.stdout:(96/160): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-06-13T11:06:32.514 INFO:teuthology.orchestra.run.smithi077.stdout:(97/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-06-13T11:06:32.539 INFO:teuthology.orchestra.run.smithi077.stdout:(98/160): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-06-13T11:06:32.565 INFO:teuthology.orchestra.run.smithi077.stdout:(99/160): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-06-13T11:06:32.598 INFO:teuthology.orchestra.run.smithi077.stdout:(100/160): xfsprogs-devel-6.4.0-1.el9.x86_64.rp 1.6 MB/s | 95 kB 00:00 2024-06-13T11:06:32.624 INFO:teuthology.orchestra.run.smithi077.stdout:(101/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-06-13T11:06:32.649 INFO:teuthology.orchestra.run.smithi077.stdout:(102/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-06-13T11:06:32.761 INFO:teuthology.orchestra.run.smithi178.stdout:(93/160): python3-toml-0.10.2-6.el9.noarch.rpm 62 kB/s | 42 kB 00:00 2024-06-13T11:06:32.774 INFO:teuthology.orchestra.run.smithi077.stdout:(103/160): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-06-13T11:06:32.841 INFO:teuthology.orchestra.run.smithi077.stdout:(104/160): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-06-13T11:06:33.000 INFO:teuthology.orchestra.run.smithi077.stdout:(105/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-06-13T11:06:33.050 INFO:teuthology.orchestra.run.smithi077.stdout:(106/160): gperftools-libs-2.9.1-2.el9.x86_64.r 1.4 MB/s | 309 kB 00:00 2024-06-13T11:06:33.148 INFO:teuthology.orchestra.run.smithi002.stdout:(67/160): openblas-openmp-0.3.21-2.el9.x86_64.r 3.6 MB/s | 4.7 MB 00:01 2024-06-13T11:06:33.159 INFO:teuthology.orchestra.run.smithi077.stdout:(107/160): grpc-data-1.46.7-10.el9.noarch.rpm 122 kB/s | 19 kB 00:00 2024-06-13T11:06:33.228 INFO:teuthology.orchestra.run.smithi178.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 53 kB/s | 44 kB 00:00 2024-06-13T11:06:33.251 INFO:teuthology.orchestra.run.smithi077.stdout:(108/160): protobuf-compiler-3.14.0-13.el9.x86_ 1.4 MB/s | 863 kB 00:00 2024-06-13T11:06:33.257 INFO:teuthology.orchestra.run.smithi002.stdout:(68/160): openssl-devel-3.2.2-1.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-06-13T11:06:33.276 INFO:teuthology.orchestra.run.smithi077.stdout:(109/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 222 kB/s | 26 kB 00:00 2024-06-13T11:06:33.307 INFO:teuthology.orchestra.run.smithi002.stdout:(69/160): postgresql-13.14-1.el9.x86_64.rpm 1.3 MB/s | 1.6 MB 00:01 2024-06-13T11:06:33.326 INFO:teuthology.orchestra.run.smithi077.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-06-13T11:06:33.360 INFO:teuthology.orchestra.run.smithi077.stdout:(111/160): liboath-2.6.7-2.el9.x86_64.rpm 446 kB/s | 49 kB 00:00 2024-06-13T11:06:33.386 INFO:teuthology.orchestra.run.smithi077.stdout:(112/160): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-06-13T11:06:33.453 INFO:teuthology.orchestra.run.smithi077.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-06-13T11:06:33.478 INFO:teuthology.orchestra.run.smithi077.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-06-13T11:06:33.503 INFO:teuthology.orchestra.run.smithi077.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-06-13T11:06:33.570 INFO:teuthology.orchestra.run.smithi077.stdout:(116/160): libarrow-9.0.0-11.el9.x86_64.rpm 8.5 MB/s | 4.4 MB 00:00 2024-06-13T11:06:33.595 INFO:teuthology.orchestra.run.smithi077.stdout:(117/160): python3-certifi-2021.10.8-2.el9.noar 163 kB/s | 15 kB 00:00 2024-06-13T11:06:33.621 INFO:teuthology.orchestra.run.smithi077.stdout:(118/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.2 MB/s | 839 kB 00:00 2024-06-13T11:06:33.646 INFO:teuthology.orchestra.run.smithi077.stdout:(119/160): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-06-13T11:06:33.653 INFO:teuthology.orchestra.run.smithi178.stdout:(95/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.3 MB/s | 16 MB 00:01 2024-06-13T11:06:33.671 INFO:teuthology.orchestra.run.smithi077.stdout:(120/160): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-06-13T11:06:33.696 INFO:teuthology.orchestra.run.smithi077.stdout:(121/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-06-13T11:06:33.728 INFO:teuthology.orchestra.run.smithi178.stdout:(96/160): qatlib-24.02.0-1.el9.x86_64.rpm 228 kB/s | 221 kB 00:00 2024-06-13T11:06:33.730 INFO:teuthology.orchestra.run.smithi077.stdout:(122/160): python3-google-auth-2.29.0-2.el9.noa 2.4 MB/s | 205 kB 00:00 2024-06-13T11:06:33.756 INFO:teuthology.orchestra.run.smithi077.stdout:(123/160): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-06-13T11:06:33.772 INFO:teuthology.orchestra.run.smithi077.stdout:(124/160): python3-jaraco-8.2.1-3.el9.noarch.rp 255 kB/s | 11 kB 00:00 2024-06-13T11:06:33.789 INFO:teuthology.orchestra.run.smithi077.stdout:(125/160): python3-jaraco-classes-3.2.1-5.el9.n 529 kB/s | 18 kB 00:00 2024-06-13T11:06:33.807 INFO:teuthology.orchestra.run.smithi077.stdout:(126/160): python3-jaraco-collections-3.0.0-8.e 689 kB/s | 23 kB 00:00 2024-06-13T11:06:33.823 INFO:teuthology.orchestra.run.smithi077.stdout:(127/160): python3-jaraco-functools-3.5.0-2.el9 577 kB/s | 19 kB 00:00 2024-06-13T11:06:33.840 INFO:teuthology.orchestra.run.smithi077.stdout:(128/160): python3-jaraco-text-3.2.0-6.el9.noar 585 kB/s | 20 kB 00:00 2024-06-13T11:06:33.866 INFO:teuthology.orchestra.run.smithi077.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-06-13T11:06:33.891 INFO:teuthology.orchestra.run.smithi077.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-06-13T11:06:33.916 INFO:teuthology.orchestra.run.smithi077.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-06-13T11:06:33.937 INFO:teuthology.orchestra.run.smithi178.stdout:(97/160): qatlib-service-24.02.0-1.el9.x86_64.r 51 kB/s | 36 kB 00:00 2024-06-13T11:06:33.950 INFO:teuthology.orchestra.run.smithi077.stdout:(132/160): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-06-13T11:06:33.975 INFO:teuthology.orchestra.run.smithi077.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 653 kB/s | 16 kB 00:00 2024-06-13T11:06:34.009 INFO:teuthology.orchestra.run.smithi077.stdout:(134/160): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-06-13T11:06:34.034 INFO:teuthology.orchestra.run.smithi077.stdout:(135/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-06-13T11:06:34.060 INFO:teuthology.orchestra.run.smithi077.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-06-13T11:06:34.085 INFO:teuthology.orchestra.run.smithi077.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-06-13T11:06:34.130 INFO:teuthology.orchestra.run.smithi077.stdout:(138/160): python3-rsa-4.9-2.el9.noarch.rpm 1.3 MB/s | 59 kB 00:00 2024-06-13T11:06:34.152 INFO:teuthology.orchestra.run.smithi077.stdout:(139/160): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-06-13T11:06:34.174 INFO:teuthology.orchestra.run.smithi002.stdout:(70/160): postgresql-private-libs-13.14-1.el9.x 146 kB/s | 133 kB 00:00 2024-06-13T11:06:34.178 INFO:teuthology.orchestra.run.smithi077.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 754 kB/s | 36 kB 00:00 2024-06-13T11:06:34.203 INFO:teuthology.orchestra.run.smithi077.stdout:(141/160): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-06-13T11:06:34.253 INFO:teuthology.orchestra.run.smithi077.stdout:(142/160): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-06-13T11:06:34.279 INFO:teuthology.orchestra.run.smithi077.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-06-13T11:06:34.299 INFO:teuthology.orchestra.run.smithi002.stdout:(71/160): postgresql-contrib-13.14-1.el9.x86_64 793 kB/s | 911 kB 00:01 2024-06-13T11:06:34.304 INFO:teuthology.orchestra.run.smithi077.stdout:(144/160): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-06-13T11:06:34.329 INFO:teuthology.orchestra.run.smithi178.stdout:(98/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 70 kB/s | 47 kB 00:00 2024-06-13T11:06:34.329 INFO:teuthology.orchestra.run.smithi077.stdout:(145/160): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-06-13T11:06:34.354 INFO:teuthology.orchestra.run.smithi077.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-06-13T11:06:34.397 INFO:teuthology.orchestra.run.smithi077.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-06-13T11:06:34.447 INFO:teuthology.orchestra.run.smithi077.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-06-13T11:06:34.662 INFO:teuthology.orchestra.run.smithi178.stdout:(99/160): socat-1.7.4.1-6.el9.x86_64.rpm 326 kB/s | 304 kB 00:00 2024-06-13T11:06:34.688 INFO:teuthology.orchestra.run.smithi178.stdout:(100/160): uuid-1.6.2-55.el9.x86_64.rpm 77 kB/s | 58 kB 00:00 2024-06-13T11:06:34.730 INFO:teuthology.orchestra.run.smithi077.stdout:(149/160): librbd1-19.0.0-2946.g3d89accf.el9.x8 9.4 MB/s | 3.1 MB 00:00 2024-06-13T11:06:34.850 INFO:teuthology.orchestra.run.smithi002.stdout:(72/160): postgresql-server-13.14-1.el9.x86_64. 3.8 MB/s | 5.8 MB 00:01 2024-06-13T11:06:35.138 INFO:teuthology.orchestra.run.smithi178.stdout:(101/160): xfsprogs-devel-6.4.0-1.el9.x86_64.rp 117 kB/s | 95 kB 00:00 2024-06-13T11:06:35.242 INFO:teuthology.orchestra.run.smithi002.stdout:(73/160): python3-attrs-20.3.0-7.el9.noarch.rpm 93 kB/s | 87 kB 00:00 2024-06-13T11:06:35.246 INFO:teuthology.orchestra.run.smithi178.stdout:(102/160): lua-devel-5.4.4-4.el9.x86_64.rpm 207 kB/s | 22 kB 00:00 2024-06-13T11:06:35.256 INFO:teuthology.orchestra.run.smithi077.stdout:(150/160): librados2-19.0.0-2946.g3d89accf.el9. 3.8 MB/s | 3.4 MB 00:00 2024-06-13T11:06:35.322 INFO:teuthology.orchestra.run.smithi178.stdout:(103/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 71 kB/s | 45 kB 00:00 2024-06-13T11:06:35.363 INFO:teuthology.orchestra.run.smithi178.stdout:(104/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 91 kB/s | 64 kB 00:00 2024-06-13T11:06:35.400 INFO:teuthology.orchestra.run.smithi002.stdout:(74/160): protobuf-3.14.0-13.el9.x86_64.rpm 844 kB/s | 1.0 MB 00:01 2024-06-13T11:06:35.431 INFO:teuthology.orchestra.run.smithi178.stdout:(105/160): abseil-cpp-20211102.0-3.el9.x86_64.r 4.9 MB/s | 548 kB 00:00 2024-06-13T11:06:35.451 INFO:teuthology.orchestra.run.smithi178.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 1.3 MB/s | 19 kB 00:00 2024-06-13T11:06:35.481 INFO:teuthology.orchestra.run.smithi178.stdout:(107/160): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-06-13T11:06:35.506 INFO:teuthology.orchestra.run.smithi178.stdout:(108/160): gperftools-libs-2.9.1-2.el9.x86_64.r 2.2 MB/s | 309 kB 00:00 2024-06-13T11:06:35.557 INFO:teuthology.orchestra.run.smithi178.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-06-13T11:06:35.591 INFO:teuthology.orchestra.run.smithi178.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.1 MB/s | 67 kB 00:00 2024-06-13T11:06:35.616 INFO:teuthology.orchestra.run.smithi178.stdout:(111/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 194 kB/s | 26 kB 00:00 2024-06-13T11:06:35.641 INFO:teuthology.orchestra.run.smithi178.stdout:(112/160): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-06-13T11:06:35.648 INFO:teuthology.orchestra.run.smithi077.stdout:(151/160): NetworkManager-1.47.91-1.el9.x86_64. 1.9 MB/s | 2.3 MB 00:01 2024-06-13T11:06:35.692 INFO:teuthology.orchestra.run.smithi178.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-06-13T11:06:35.716 INFO:teuthology.orchestra.run.smithi178.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-06-13T11:06:35.741 INFO:teuthology.orchestra.run.smithi178.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-06-13T11:06:35.767 INFO:teuthology.orchestra.run.smithi178.stdout:(116/160): python3-certifi-2021.10.8-2.el9.noar 598 kB/s | 15 kB 00:00 2024-06-13T11:06:35.792 INFO:teuthology.orchestra.run.smithi178.stdout:(117/160): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-06-13T11:06:35.826 INFO:teuthology.orchestra.run.smithi178.stdout:(118/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.9 MB/s | 839 kB 00:00 2024-06-13T11:06:35.856 INFO:teuthology.orchestra.run.smithi077.stdout:(152/160): NetworkManager-libnm-1.47.91-1.el9.x 1.6 MB/s | 1.8 MB 00:01 2024-06-13T11:06:35.859 INFO:teuthology.orchestra.run.smithi178.stdout:(119/160): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-06-13T11:06:35.885 INFO:teuthology.orchestra.run.smithi178.stdout:(120/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-06-13T11:06:35.898 INFO:teuthology.orchestra.run.smithi077.stdout:(153/160): NetworkManager-team-1.47.91-1.el9.x8 64 kB/s | 41 kB 00:00 2024-06-13T11:06:35.910 INFO:teuthology.orchestra.run.smithi178.stdout:(121/160): python3-google-auth-2.29.0-2.el9.noa 4.0 MB/s | 205 kB 00:00 2024-06-13T11:06:35.978 INFO:teuthology.orchestra.run.smithi178.stdout:(122/160): libarrow-9.0.0-11.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-06-13T11:06:35.993 INFO:teuthology.orchestra.run.smithi002.stdout:(75/160): python3-colorama-0.4.6-3.el9.noarch.r 82 kB/s | 61 kB 00:00 2024-06-13T11:06:36.003 INFO:teuthology.orchestra.run.smithi178.stdout:(123/160): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-06-13T11:06:36.030 INFO:teuthology.orchestra.run.smithi178.stdout:(124/160): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-06-13T11:06:36.054 INFO:teuthology.orchestra.run.smithi178.stdout:(125/160): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-06-13T11:06:36.081 INFO:teuthology.orchestra.run.smithi178.stdout:(126/160): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-06-13T11:06:36.112 INFO:teuthology.orchestra.run.smithi178.stdout:(127/160): python3-jaraco-functools-3.5.0-2.el9 333 kB/s | 19 kB 00:00 2024-06-13T11:06:36.140 INFO:teuthology.orchestra.run.smithi178.stdout:(128/160): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2024-06-13T11:06:36.163 INFO:teuthology.orchestra.run.smithi178.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-06-13T11:06:36.189 INFO:teuthology.orchestra.run.smithi178.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-06-13T11:06:36.209 INFO:teuthology.orchestra.run.smithi002.stdout:(76/160): python3-babel-2.9.1-2.el9.noarch.rpm 4.4 MB/s | 6.0 MB 00:01 2024-06-13T11:06:36.213 INFO:teuthology.orchestra.run.smithi178.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-06-13T11:06:36.247 INFO:teuthology.orchestra.run.smithi178.stdout:(132/160): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-06-13T11:06:36.272 INFO:teuthology.orchestra.run.smithi178.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-06-13T11:06:36.290 INFO:teuthology.orchestra.run.smithi178.stdout:(134/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 5.3 MB/s | 90 kB 00:00 2024-06-13T11:06:36.315 INFO:teuthology.orchestra.run.smithi178.stdout:(135/160): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-06-13T11:06:36.340 INFO:teuthology.orchestra.run.smithi178.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-06-13T11:06:36.365 INFO:teuthology.orchestra.run.smithi178.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-06-13T11:06:36.387 INFO:teuthology.orchestra.run.smithi002.stdout:(77/160): python3-devel-3.9.18-3.el9.x86_64.rpm 249 kB/s | 244 kB 00:00 2024-06-13T11:06:36.390 INFO:teuthology.orchestra.run.smithi178.stdout:(138/160): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-06-13T11:06:36.416 INFO:teuthology.orchestra.run.smithi178.stdout:(139/160): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-06-13T11:06:36.441 INFO:teuthology.orchestra.run.smithi178.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-06-13T11:06:36.483 INFO:teuthology.orchestra.run.smithi178.stdout:(141/160): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-06-13T11:06:36.490 INFO:teuthology.orchestra.run.smithi077.stdout:(154/160): elfutils-debuginfod-client-0.191-4.e 58 kB/s | 37 kB 00:00 2024-06-13T11:06:36.499 INFO:teuthology.orchestra.run.smithi178.stdout:(142/160): python3-typing-extensions-4.4.0-2.el 872 kB/s | 51 kB 00:00 2024-06-13T11:06:36.515 INFO:teuthology.orchestra.run.smithi077.stdout:(155/160): NetworkManager-tui-1.47.91-1.el9.x86 286 kB/s | 248 kB 00:00 2024-06-13T11:06:36.517 INFO:teuthology.orchestra.run.smithi178.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-06-13T11:06:36.533 INFO:teuthology.orchestra.run.smithi178.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-06-13T11:06:36.559 INFO:teuthology.orchestra.run.smithi178.stdout:(145/160): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-06-13T11:06:36.584 INFO:teuthology.orchestra.run.smithi178.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-06-13T11:06:36.618 INFO:teuthology.orchestra.run.smithi178.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-06-13T11:06:36.660 INFO:teuthology.orchestra.run.smithi178.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-06-13T11:06:36.732 INFO:teuthology.orchestra.run.smithi077.stdout:(156/160): elfutils-libelf-0.191-4.el9.x86_64.r 256 kB/s | 207 kB 00:00 2024-06-13T11:06:36.918 INFO:teuthology.orchestra.run.smithi178.stdout:(149/160): NetworkManager-1.47.91-1.el9.x86_64. 9.0 MB/s | 2.3 MB 00:00 2024-06-13T11:06:37.001 INFO:teuthology.orchestra.run.smithi002.stdout:(78/160): python3-jsonpatch-1.21-16.el9.noarch. 32 kB/s | 26 kB 00:00 2024-06-13T11:06:37.002 INFO:teuthology.orchestra.run.smithi178.stdout:(150/160): librados2-19.0.0-2946.g3d89accf.el9. 8.1 MB/s | 3.4 MB 00:00 2024-06-13T11:06:37.026 INFO:teuthology.orchestra.run.smithi002.stdout:(79/160): python3-jsonpointer-2.0-4.el9.noarch. 30 kB/s | 19 kB 00:00 2024-06-13T11:06:37.044 INFO:teuthology.orchestra.run.smithi178.stdout:(151/160): NetworkManager-libnm-1.47.91-1.el9.x 14 MB/s | 1.8 MB 00:00 2024-06-13T11:06:37.060 INFO:teuthology.orchestra.run.smithi002.stdout:(80/160): python3-jinja2-2.11.3-6.el9.noarch.rp 233 kB/s | 248 kB 00:01 2024-06-13T11:06:37.094 INFO:teuthology.orchestra.run.smithi178.stdout:(152/160): NetworkManager-tui-1.47.91-1.el9.x86 4.9 MB/s | 248 kB 00:00 2024-06-13T11:06:37.153 INFO:teuthology.orchestra.run.smithi178.stdout:(153/160): librbd1-19.0.0-2946.g3d89accf.el9.x8 5.9 MB/s | 3.1 MB 00:00 2024-06-13T11:06:37.178 INFO:teuthology.orchestra.run.smithi178.stdout:(154/160): NetworkManager-team-1.47.91-1.el9.x8 235 kB/s | 41 kB 00:00 2024-06-13T11:06:37.203 INFO:teuthology.orchestra.run.smithi178.stdout:(155/160): elfutils-debuginfod-client-0.191-4.e 338 kB/s | 37 kB 00:00 2024-06-13T11:06:37.254 INFO:teuthology.orchestra.run.smithi178.stdout:(156/160): elfutils-libelf-0.191-4.el9.x86_64.r 2.0 MB/s | 207 kB 00:00 2024-06-13T11:06:37.296 INFO:teuthology.orchestra.run.smithi178.stdout:(157/160): openssl-3.2.2-1.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-06-13T11:06:37.354 INFO:teuthology.orchestra.run.smithi178.stdout:(158/160): elfutils-libs-0.191-4.el9.x86_64.rpm 1.4 MB/s | 260 kB 00:00 2024-06-13T11:06:37.357 INFO:teuthology.orchestra.run.smithi077.stdout:(157/160): elfutils-libs-0.191-4.el9.x86_64.rpm 299 kB/s | 260 kB 00:00 2024-06-13T11:06:37.388 INFO:teuthology.orchestra.run.smithi178.stdout:(159/160): xfsprogs-6.4.0-1.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-06-13T11:06:37.430 INFO:teuthology.orchestra.run.smithi178.stdout:(160/160): openssl-libs-3.2.2-1.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-06-13T11:06:37.437 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-06-13T11:06:37.437 INFO:teuthology.orchestra.run.smithi178.stdout:Total 9.0 MB/s | 226 MB 00:25 2024-06-13T11:06:37.599 INFO:teuthology.orchestra.run.smithi077.stdout:(158/160): openssl-3.2.2-1.el9.x86_64.rpm 1.2 MB/s | 1.4 MB 00:01 2024-06-13T11:06:37.768 INFO:teuthology.orchestra.run.smithi002.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 47 kB/s | 35 kB 00:00 2024-06-13T11:06:37.941 INFO:teuthology.orchestra.run.smithi077.stdout:(159/160): openssl-libs-3.2.2-1.el9.x86_64.rpm 2.1 MB/s | 2.4 MB 00:01 2024-06-13T11:06:38.013 INFO:teuthology.orchestra.run.smithi002.stdout:(82/160): python3-mako-1.1.4-6.el9.noarch.rpm 170 kB/s | 172 kB 00:01 2024-06-13T11:06:38.417 INFO:teuthology.orchestra.run.smithi077.stdout:(160/160): xfsprogs-6.4.0-1.el9.x86_64.rpm 1.0 MB/s | 1.1 MB 00:01 2024-06-13T11:06:38.424 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-06-13T11:06:38.424 INFO:teuthology.orchestra.run.smithi077.stdout:Total 10 MB/s | 226 MB 00:22 2024-06-13T11:06:38.603 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-06-13T11:06:38.677 INFO:teuthology.orchestra.run.smithi002.stdout:(83/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.2 MB/s | 5.1 MB 00:01 2024-06-13T11:06:38.793 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-06-13T11:06:38.793 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-06-13T11:06:38.827 INFO:teuthology.orchestra.run.smithi002.stdout:(84/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 237 kB/s | 250 kB 00:01 2024-06-13T11:06:39.020 INFO:teuthology.orchestra.run.smithi002.stdout:(85/160): python3-oauthlib-3.1.1-5.el9.noarch.r 221 kB/s | 222 kB 00:01 2024-06-13T11:06:39.545 INFO:teuthology.orchestra.run.smithi002.stdout:(86/160): python3-packaging-20.9-5.el9.noarch.r 89 kB/s | 77 kB 00:00 2024-06-13T11:06:39.595 INFO:teuthology.orchestra.run.smithi002.stdout:(87/160): python3-prettytable-0.7.2-27.el9.noar 55 kB/s | 42 kB 00:00 2024-06-13T11:06:39.654 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-06-13T11:06:39.847 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-06-13T11:06:39.847 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-06-13T11:06:40.012 INFO:teuthology.orchestra.run.smithi002.stdout:(88/160): python3-protobuf-3.14.0-13.el9.noarch 272 kB/s | 269 kB 00:00 2024-06-13T11:06:40.404 INFO:teuthology.orchestra.run.smithi002.stdout:(89/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 185 kB/s | 159 kB 00:00 2024-06-13T11:06:40.529 INFO:teuthology.orchestra.run.smithi002.stdout:(90/160): python3-pyasn1-modules-0.4.8-6.el9.no 299 kB/s | 279 kB 00:00 2024-06-13T11:06:40.681 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-06-13T11:06:40.681 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-06-13T11:06:40.745 INFO:teuthology.orchestra.run.smithi002.stdout:(91/160): python3-pytz-2021.1-5.el9.noarch.rpm 70 kB/s | 51 kB 00:00 2024-06-13T11:06:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:(92/160): python3-requests-oauthlib-1.3.0-12.el 67 kB/s | 54 kB 00:00 2024-06-13T11:06:41.538 INFO:teuthology.orchestra.run.smithi002.stdout:(93/160): python3-toml-0.10.2-6.el9.noarch.rpm 53 kB/s | 42 kB 00:00 2024-06-13T11:06:41.669 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-06-13T11:06:41.669 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-06-13T11:06:41.930 INFO:teuthology.orchestra.run.smithi002.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 61 kB/s | 44 kB 00:00 2024-06-13T11:06:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:(95/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.2 MB/s | 16 MB 00:01 2024-06-13T11:06:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:(96/160): qatlib-24.02.0-1.el9.x86_64.rpm 192 kB/s | 221 kB 00:01 2024-06-13T11:06:42.972 INFO:teuthology.orchestra.run.smithi002.stdout:(97/160): qatlib-service-24.02.0-1.el9.x86_64.r 35 kB/s | 36 kB 00:01 2024-06-13T11:06:43.623 INFO:teuthology.orchestra.run.smithi002.stdout:(98/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 43 kB/s | 47 kB 00:01 2024-06-13T11:06:44.056 INFO:teuthology.orchestra.run.smithi002.stdout:(99/160): uuid-1.6.2-55.el9.x86_64.rpm 53 kB/s | 58 kB 00:01 2024-06-13T11:06:44.090 INFO:teuthology.orchestra.run.smithi002.stdout:(100/160): socat-1.7.4.1-6.el9.x86_64.rpm 217 kB/s | 304 kB 00:01 2024-06-13T11:06:44.632 INFO:teuthology.orchestra.run.smithi002.stdout:(101/160): xfsprogs-devel-6.4.0-1.el9.x86_64.rp 94 kB/s | 95 kB 00:01 2024-06-13T11:06:44.932 INFO:teuthology.orchestra.run.smithi002.stdout:(102/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 73 kB/s | 64 kB 00:00 2024-06-13T11:06:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:(103/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 51 kB/s | 45 kB 00:00 2024-06-13T11:06:45.066 INFO:teuthology.orchestra.run.smithi002.stdout:(104/160): lua-devel-5.4.4-4.el9.x86_64.rpm 52 kB/s | 22 kB 00:00 2024-06-13T11:06:45.208 INFO:teuthology.orchestra.run.smithi002.stdout:(105/160): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-06-13T11:06:45.233 INFO:teuthology.orchestra.run.smithi002.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 793 kB/s | 19 kB 00:00 2024-06-13T11:06:45.267 INFO:teuthology.orchestra.run.smithi002.stdout:(107/160): abseil-cpp-20211102.0-3.el9.x86_64.r 2.3 MB/s | 548 kB 00:00 2024-06-13T11:06:45.292 INFO:teuthology.orchestra.run.smithi002.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-06-13T11:06:45.325 INFO:teuthology.orchestra.run.smithi002.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-06-13T11:06:45.359 INFO:teuthology.orchestra.run.smithi002.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-06-13T11:06:45.393 INFO:teuthology.orchestra.run.smithi002.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 4.6 MB/s | 151 kB 00:00 2024-06-13T11:06:45.443 INFO:teuthology.orchestra.run.smithi002.stdout:(112/160): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-06-13T11:06:45.577 INFO:teuthology.orchestra.run.smithi002.stdout:(113/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.5 MB/s | 839 kB 00:00 2024-06-13T11:06:45.602 INFO:teuthology.orchestra.run.smithi002.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-06-13T11:06:45.627 INFO:teuthology.orchestra.run.smithi002.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-06-13T11:06:45.653 INFO:teuthology.orchestra.run.smithi002.stdout:(116/160): python3-certifi-2021.10.8-2.el9.noar 622 kB/s | 15 kB 00:00 2024-06-13T11:06:45.695 INFO:teuthology.orchestra.run.smithi002.stdout:(117/160): python3-cheroot-8.6.0-4.el9.noarch.r 4.1 MB/s | 172 kB 00:00 2024-06-13T11:06:45.728 INFO:teuthology.orchestra.run.smithi002.stdout:(118/160): python3-asyncssh-2.13.2-5.el9.noarch 1.9 MB/s | 548 kB 00:00 2024-06-13T11:06:45.778 INFO:teuthology.orchestra.run.smithi002.stdout:(119/160): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-06-13T11:06:45.812 INFO:teuthology.orchestra.run.smithi002.stdout:(120/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.6 MB/s | 303 kB 00:00 2024-06-13T11:06:45.854 INFO:teuthology.orchestra.run.smithi002.stdout:(121/160): python3-google-auth-2.29.0-2.el9.noa 2.7 MB/s | 205 kB 00:00 2024-06-13T11:06:45.897 INFO:teuthology.orchestra.run.smithi002.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 3.5 MB/s | 144 kB 00:00 2024-06-13T11:06:45.922 INFO:teuthology.orchestra.run.smithi002.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 439 kB/s | 11 kB 00:00 2024-06-13T11:06:45.947 INFO:teuthology.orchestra.run.smithi002.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 733 kB/s | 18 kB 00:00 2024-06-13T11:06:45.972 INFO:teuthology.orchestra.run.smithi002.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 960 kB/s | 23 kB 00:00 2024-06-13T11:06:45.997 INFO:teuthology.orchestra.run.smithi002.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 807 kB/s | 19 kB 00:00 2024-06-13T11:06:46.023 INFO:teuthology.orchestra.run.smithi002.stdout:(127/160): python3-jaraco-text-3.2.0-6.el9.noar 816 kB/s | 20 kB 00:00 2024-06-13T11:06:46.123 INFO:teuthology.orchestra.run.smithi002.stdout:(128/160): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-06-13T11:06:46.148 INFO:teuthology.orchestra.run.smithi002.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.9 MB/s | 46 kB 00:00 2024-06-13T11:06:46.182 INFO:teuthology.orchestra.run.smithi002.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 2.4 MB/s | 79 kB 00:00 2024-06-13T11:06:46.218 INFO:teuthology.orchestra.run.smithi002.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 2.4 MB/s | 58 kB 00:00 2024-06-13T11:06:46.283 INFO:teuthology.orchestra.run.smithi002.stdout:(132/160): python3-grpcio-1.46.7-10.el9.x86_64. 4.3 MB/s | 2.0 MB 00:00 2024-06-13T11:06:46.316 INFO:teuthology.orchestra.run.smithi002.stdout:(133/160): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2024-06-13T11:06:46.333 INFO:teuthology.orchestra.run.smithi002.stdout:(134/160): python3-portend-3.1.0-2.el9.noarch.r 334 kB/s | 16 kB 00:00 2024-06-13T11:06:46.350 INFO:teuthology.orchestra.run.smithi002.stdout:(135/160): python3-pyperclip-1.8.2-2.el9.noarch 1.8 MB/s | 28 kB 00:00 2024-06-13T11:06:46.367 INFO:teuthology.orchestra.run.smithi002.stdout:(136/160): python3-repoze-lru-0.7-16.el9.noarch 1.9 MB/s | 31 kB 00:00 2024-06-13T11:06:46.392 INFO:teuthology.orchestra.run.smithi002.stdout:(137/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-06-13T11:06:46.426 INFO:teuthology.orchestra.run.smithi002.stdout:(138/160): python3-rsa-4.9-2.el9.noarch.rpm 1.8 MB/s | 59 kB 00:00 2024-06-13T11:06:46.451 INFO:teuthology.orchestra.run.smithi002.stdout:(139/160): python3-tempora-5.0.0-2.el9.noarch.r 1.5 MB/s | 36 kB 00:00 2024-06-13T11:06:46.485 INFO:teuthology.orchestra.run.smithi002.stdout:(140/160): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-06-13T11:06:46.510 INFO:teuthology.orchestra.run.smithi002.stdout:(141/160): python3-typing-extensions-4.4.0-2.el 886 kB/s | 51 kB 00:00 2024-06-13T11:06:46.610 INFO:teuthology.orchestra.run.smithi002.stdout:(142/160): libarrow-9.0.0-11.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-06-13T11:06:46.644 INFO:teuthology.orchestra.run.smithi002.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 679 kB/s | 90 kB 00:00 2024-06-13T11:06:46.678 INFO:teuthology.orchestra.run.smithi002.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 615 kB/s | 20 kB 00:00 2024-06-13T11:06:46.736 INFO:teuthology.orchestra.run.smithi002.stdout:(145/160): python3-webob-1.8.7-6.el9.noarch.rpm 1.0 MB/s | 230 kB 00:00 2024-06-13T11:06:46.770 INFO:teuthology.orchestra.run.smithi002.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 2.1 MB/s | 192 kB 00:00 2024-06-13T11:06:46.804 INFO:teuthology.orchestra.run.smithi002.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 2.2 MB/s | 427 kB 00:00 2024-06-13T11:06:46.887 INFO:teuthology.orchestra.run.smithi002.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-06-13T11:06:47.087 INFO:teuthology.orchestra.run.smithi002.stdout:(149/160): NetworkManager-1.47.91-1.el9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-06-13T11:06:47.153 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-06-13T11:06:47.179 INFO:teuthology.orchestra.run.smithi002.stdout:(150/160): NetworkManager-libnm-1.47.91-1.el9.x 20 MB/s | 1.8 MB 00:00 2024-06-13T11:06:47.213 INFO:teuthology.orchestra.run.smithi002.stdout:(151/160): NetworkManager-team-1.47.91-1.el9.x8 1.2 MB/s | 41 kB 00:00 2024-06-13T11:06:47.234 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : openssl-libs-1:3.2.2-1.el9.x86_64 1/172 2024-06-13T11:06:47.263 INFO:teuthology.orchestra.run.smithi002.stdout:(152/160): NetworkManager-tui-1.47.91-1.el9.x86 4.9 MB/s | 248 kB 00:00 2024-06-13T11:06:47.272 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-06-13T11:06:47.325 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-06-13T11:06:47.339 INFO:teuthology.orchestra.run.smithi002.stdout:(153/160): librbd1-19.0.0-2946.g3d89accf.el9.x8 5.9 MB/s | 3.1 MB 00:00 2024-06-13T11:06:47.359 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-06-13T11:06:47.364 INFO:teuthology.orchestra.run.smithi002.stdout:(154/160): elfutils-debuginfod-client-0.191-4.e 370 kB/s | 37 kB 00:00 2024-06-13T11:06:47.385 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-06-13T11:06:47.427 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-06-13T11:06:47.448 INFO:teuthology.orchestra.run.smithi002.stdout:(155/160): librados2-19.0.0-2946.g3d89accf.el9. 5.0 MB/s | 3.4 MB 00:00 2024-06-13T11:06:47.481 INFO:teuthology.orchestra.run.smithi002.stdout:(156/160): elfutils-libelf-0.191-4.el9.x86_64.r 1.4 MB/s | 207 kB 00:00 2024-06-13T11:06:47.515 INFO:teuthology.orchestra.run.smithi002.stdout:(157/160): elfutils-libs-0.191-4.el9.x86_64.rpm 1.7 MB/s | 260 kB 00:00 2024-06-13T11:06:47.598 INFO:teuthology.orchestra.run.smithi002.stdout:(158/160): xfsprogs-6.4.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-06-13T11:06:47.665 INFO:teuthology.orchestra.run.smithi002.stdout:(159/160): openssl-libs-3.2.2-1.el9.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2024-06-13T11:06:47.749 INFO:teuthology.orchestra.run.smithi002.stdout:(160/160): openssl-3.2.2-1.el9.x86_64.rpm 4.5 MB/s | 1.4 MB 00:00 2024-06-13T11:06:47.759 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-06-13T11:06:47.760 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-06-13T11:06:47.760 INFO:teuthology.orchestra.run.smithi002.stdout:Total 7.0 MB/s | 226 MB 00:32 2024-06-13T11:06:47.878 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T11:06:47.983 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T11:06:48.012 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T11:06:48.081 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-06-13T11:06:48.102 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T11:06:48.133 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/172 2024-06-13T11:06:48.165 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-06-13T11:06:48.183 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : openssl-libs-1:3.2.2-1.el9.x86_64 1/172 2024-06-13T11:06:48.221 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-06-13T11:06:48.283 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-06-13T11:06:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-06-13T11:06:48.343 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-06-13T11:06:48.358 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-06-13T11:06:48.377 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-06-13T11:06:48.422 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-06-13T11:06:48.451 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T11:06:48.554 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T11:06:48.577 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/172 2024-06-13T11:06:48.639 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/172 2024-06-13T11:06:48.661 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-06-13T11:06:48.681 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-06-13T11:06:48.720 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-06-13T11:06:48.827 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T11:06:48.869 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-06-13T11:06:48.932 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T11:06:48.959 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-06-13T11:06:48.961 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T11:06:49.053 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T11:06:49.082 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/172 2024-06-13T11:06:49.115 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-06-13T11:06:49.136 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : xfsprogs-6.4.0-1.el9.x86_64 18/172 2024-06-13T11:06:49.294 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 19/172 2024-06-13T11:06:49.328 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-06-13T11:06:49.354 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 19/172 2024-06-13T11:06:49.381 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-06-13T11:06:49.409 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T11:06:49.440 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T11:06:49.512 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T11:06:49.535 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/172 2024-06-13T11:06:49.539 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T11:06:49.597 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/172 2024-06-13T11:06:49.619 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-06-13T11:06:49.645 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-06-13T11:06:49.742 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T11:06:49.827 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-06-13T11:06:49.852 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-06-13T11:06:49.924 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-06-13T11:06:49.948 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-06-13T11:06:49.977 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/172 2024-06-13T11:06:50.012 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/172 2024-06-13T11:06:50.079 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/172 2024-06-13T11:06:50.114 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/172 2024-06-13T11:06:50.117 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : xfsprogs-6.4.0-1.el9.x86_64 18/172 2024-06-13T11:06:50.157 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-06-13T11:06:50.190 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-06-13T11:06:50.218 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-06-13T11:06:50.286 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 19/172 2024-06-13T11:06:50.286 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-06-13T11:06:50.338 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 19/172 2024-06-13T11:06:50.340 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/172 2024-06-13T11:06:50.379 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-06-13T11:06:50.414 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-06-13T11:06:50.448 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T11:06:50.502 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-06-13T11:06:50.523 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T11:06:50.534 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 35/172 2024-06-13T11:06:50.577 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 36/172 2024-06-13T11:06:50.606 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 37/172 2024-06-13T11:06:50.676 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-06-13T11:06:50.725 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T11:06:50.754 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-06-13T11:06:50.828 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-06-13T11:06:50.828 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-06-13T11:06:50.923 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-06-13T11:06:50.962 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/172 2024-06-13T11:06:50.963 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-06-13T11:06:50.996 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/172 2024-06-13T11:06:51.023 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-06-13T11:06:51.056 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-06-13T11:06:51.061 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/172 2024-06-13T11:06:51.096 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/172 2024-06-13T11:06:51.139 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-06-13T11:06:51.172 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-06-13T11:06:51.208 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-06-13T11:06:51.276 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-06-13T11:06:51.330 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/172 2024-06-13T11:06:51.362 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-06-13T11:06:51.370 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-06-13T11:06:51.370 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-06-13T11:06:51.396 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-06-13T11:06:51.472 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-06-13T11:06:51.508 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 35/172 2024-06-13T11:06:51.551 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 36/172 2024-06-13T11:06:51.556 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-06-13T11:06:51.580 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 37/172 2024-06-13T11:06:51.637 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-06-13T11:06:51.650 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-06-13T11:06:51.666 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-06-13T11:06:51.695 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-06-13T11:06:51.701 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-06-13T11:06:51.742 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-06-13T11:06:51.769 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-06-13T11:06:51.781 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 48/172 2024-06-13T11:06:51.822 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-06-13T11:06:51.903 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-06-13T11:06:51.956 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-06-13T11:06:51.980 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-06-13T11:06:52.034 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : openssl-1:3.2.2-1.el9.x86_64 51/172 2024-06-13T11:06:52.089 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-06-13T11:06:52.161 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 53/172 2024-06-13T11:06:52.193 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 54/172 2024-06-13T11:06:52.229 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 55/172 2024-06-13T11:06:52.276 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 56/172 2024-06-13T11:06:52.312 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 57/172 2024-06-13T11:06:52.356 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 58/172 2024-06-13T11:06:52.406 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/172 2024-06-13T11:06:52.479 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-06-13T11:06:52.542 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/172 2024-06-13T11:06:52.561 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-06-13T11:06:52.591 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-06-13T11:06:52.592 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/172 2024-06-13T11:06:52.627 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-06-13T11:06:52.633 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/172 2024-06-13T11:06:52.668 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-06-13T11:06:52.706 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 48/172 2024-06-13T11:06:52.727 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/172 2024-06-13T11:06:52.747 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-06-13T11:06:52.766 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-google-auth-1:2.29.0-2.el9.noarch 64/172 2024-06-13T11:06:52.806 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/172 2024-06-13T11:06:52.832 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/172 2024-06-13T11:06:52.857 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/172 2024-06-13T11:06:52.890 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-06-13T11:06:52.931 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/172 2024-06-13T11:06:52.950 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : openssl-1:3.2.2-1.el9.x86_64 51/172 2024-06-13T11:06:53.005 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-06-13T11:06:53.067 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/172 2024-06-13T11:06:53.078 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 53/172 2024-06-13T11:06:53.098 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/172 2024-06-13T11:06:53.109 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 54/172 2024-06-13T11:06:53.126 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/172 2024-06-13T11:06:53.145 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 55/172 2024-06-13T11:06:53.160 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/172 2024-06-13T11:06:53.192 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 56/172 2024-06-13T11:06:53.199 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/172 2024-06-13T11:06:53.228 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 57/172 2024-06-13T11:06:53.231 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/172 2024-06-13T11:06:53.261 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/172 2024-06-13T11:06:53.271 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 58/172 2024-06-13T11:06:53.296 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/172 2024-06-13T11:06:53.322 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/172 2024-06-13T11:06:53.329 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/172 2024-06-13T11:06:53.362 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/172 2024-06-13T11:06:53.397 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/172 2024-06-13T11:06:53.458 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/172 2024-06-13T11:06:53.483 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/172 2024-06-13T11:06:53.507 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/172 2024-06-13T11:06:53.527 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/172 2024-06-13T11:06:53.548 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/172 2024-06-13T11:06:53.559 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/172 2024-06-13T11:06:53.605 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/172 2024-06-13T11:06:53.704 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/172 2024-06-13T11:06:53.744 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/172 2024-06-13T11:06:53.760 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-06-13T11:06:53.773 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-google-auth-1:2.29.0-2.el9.noarch 64/172 2024-06-13T11:06:53.822 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/172 2024-06-13T11:06:53.856 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/172 2024-06-13T11:06:53.880 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/172 2024-06-13T11:06:53.955 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/172 2024-06-13T11:06:54.052 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-06-13T11:06:54.052 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-06-13T11:06:54.083 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/172 2024-06-13T11:06:54.121 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/172 2024-06-13T11:06:54.148 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/172 2024-06-13T11:06:54.183 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/172 2024-06-13T11:06:54.230 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/172 2024-06-13T11:06:54.270 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/172 2024-06-13T11:06:54.300 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/172 2024-06-13T11:06:54.335 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/172 2024-06-13T11:06:54.368 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/172 2024-06-13T11:06:54.410 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/172 2024-06-13T11:06:54.444 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/172 2024-06-13T11:06:54.486 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-06-13T11:06:54.533 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-06-13T11:06:54.539 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/172 2024-06-13T11:06:54.566 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-06-13T11:06:54.583 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/172 2024-06-13T11:06:54.639 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/172 2024-06-13T11:06:54.685 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-06-13T11:06:54.686 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/172 2024-06-13T11:06:54.730 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-06-13T11:06:54.775 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-06-13T11:06:54.784 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/172 2024-06-13T11:06:54.832 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-06-13T11:06:54.871 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-06-13T11:06:54.911 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-06-13T11:06:55.088 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-06-13T11:06:55.126 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-06-13T11:06:55.203 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-06-13T11:06:55.552 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-06-13T11:06:55.606 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-06-13T11:06:55.703 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-06-13T11:06:55.854 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-06-13T11:06:55.962 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-06-13T11:06:55.965 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-06-13T11:06:56.084 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-06-13T11:06:56.129 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-06-13T11:06:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-06-13T11:06:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-06-13T11:06:56.442 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-06-13T11:06:56.480 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-06-13T11:06:56.558 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-06-13T11:06:57.204 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-06-13T11:06:57.208 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-06-13T11:06:57.298 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-06-13T11:06:57.326 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-06-13T11:06:57.328 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-06-13T11:06:57.359 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-06-13T11:06:57.669 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-06-13T11:06:57.706 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 104/172 2024-06-13T11:06:57.789 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 104/172 2024-06-13T11:06:57.819 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 105/172 2024-06-13T11:06:57.855 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-06-13T11:06:58.318 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-06-13T11:06:58.351 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 108/172 2024-06-13T11:06:58.421 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 108/172 2024-06-13T11:06:58.444 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 109/172 2024-06-13T11:06:58.568 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-06-13T11:06:58.658 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-06-13T11:06:58.694 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-06-13T11:06:58.736 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-06-13T11:06:59.055 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-06-13T11:06:59.098 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 104/172 2024-06-13T11:06:59.189 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 104/172 2024-06-13T11:06:59.220 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 105/172 2024-06-13T11:06:59.256 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-06-13T11:06:59.730 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-06-13T11:06:59.760 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 108/172 2024-06-13T11:06:59.814 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 108/172 2024-06-13T11:06:59.836 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 109/172 2024-06-13T11:07:00.731 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T11:07:00.783 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T11:07:00.897 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-06-13T11:07:00.989 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-libs-1:3.2.2-1.el9.x86_64 1/172 2024-06-13T11:07:01.068 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-06-13T11:07:01.169 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-06-13T11:07:01.226 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-06-13T11:07:01.257 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-06-13T11:07:01.320 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T11:07:01.353 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-06-13T11:07:01.361 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 111/172 2024-06-13T11:07:01.454 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 111/172 2024-06-13T11:07:01.454 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-13T11:07:01.454 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-13T11:07:01.454 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:07:01.488 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 112/172 2024-06-13T11:07:01.799 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-06-13T11:07:01.927 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T11:07:02.057 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T11:07:02.091 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T11:07:02.112 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T11:07:02.139 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T11:07:02.269 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T11:07:02.313 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/172 2024-06-13T11:07:02.381 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-06-13T11:07:02.630 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T11:07:02.669 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 111/172 2024-06-13T11:07:02.675 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-06-13T11:07:02.743 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-06-13T11:07:02.753 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 111/172 2024-06-13T11:07:02.753 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-13T11:07:02.753 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-13T11:07:02.753 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-06-13T11:07:02.768 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T11:07:02.787 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 112/172 2024-06-13T11:07:02.937 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T11:07:02.978 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/172 2024-06-13T11:07:03.066 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/172 2024-06-13T11:07:03.096 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-06-13T11:07:03.182 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-06-13T11:07:03.481 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-06-13T11:07:03.665 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-06-13T11:07:04.036 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : xfsprogs-6.4.0-1.el9.x86_64 18/172 2024-06-13T11:07:04.204 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 19/172 2024-06-13T11:07:04.293 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 19/172 2024-06-13T11:07:04.491 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T11:07:04.590 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T11:07:04.906 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T11:07:05.110 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-06-13T11:07:05.235 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-06-13T11:07:05.306 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/172 2024-06-13T11:07:05.383 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/172 2024-06-13T11:07:05.525 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/172 2024-06-13T11:07:05.604 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/172 2024-06-13T11:07:05.712 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-06-13T11:07:05.803 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-06-13T11:07:05.865 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-06-13T11:07:06.031 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-06-13T11:07:06.136 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/172 2024-06-13T11:07:06.200 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-06-13T11:07:06.304 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-06-13T11:07:06.449 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-06-13T11:07:06.518 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 35/172 2024-06-13T11:07:06.610 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 36/172 2024-06-13T11:07:06.676 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 37/172 2024-06-13T11:07:06.843 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-06-13T11:07:06.935 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-06-13T11:07:07.088 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-06-13T11:07:07.298 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-06-13T11:07:07.381 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-06-13T11:07:08.122 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-06-13T11:07:08.248 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-06-13T11:07:08.331 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-06-13T11:07:08.372 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-06-13T11:07:08.442 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-06-13T11:07:08.495 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 48/172 2024-06-13T11:07:08.587 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-06-13T11:07:08.824 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-06-13T11:07:08.892 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-1:3.2.2-1.el9.x86_64 51/172 2024-06-13T11:07:08.972 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-06-13T11:07:09.078 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 53/172 2024-06-13T11:07:09.125 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 54/172 2024-06-13T11:07:09.165 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 55/172 2024-06-13T11:07:09.236 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 56/172 2024-06-13T11:07:09.281 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 57/172 2024-06-13T11:07:09.335 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 58/172 2024-06-13T11:07:09.398 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/172 2024-06-13T11:07:09.601 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/172 2024-06-13T11:07:09.649 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/172 2024-06-13T11:07:09.694 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/172 2024-06-13T11:07:09.823 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/172 2024-06-13T11:07:09.864 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.29.0-2.el9.noarch 64/172 2024-06-13T11:07:09.918 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/172 2024-06-13T11:07:09.955 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/172 2024-06-13T11:07:09.988 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/172 2024-06-13T11:07:10.179 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/172 2024-06-13T11:07:10.360 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/172 2024-06-13T11:07:10.410 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/172 2024-06-13T11:07:10.448 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/172 2024-06-13T11:07:10.495 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/172 2024-06-13T11:07:10.553 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/172 2024-06-13T11:07:10.597 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/172 2024-06-13T11:07:10.639 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/172 2024-06-13T11:07:10.685 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/172 2024-06-13T11:07:10.735 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/172 2024-06-13T11:07:10.835 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/172 2024-06-13T11:07:10.893 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/172 2024-06-13T11:07:11.040 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/172 2024-06-13T11:07:11.109 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/172 2024-06-13T11:07:11.153 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/172 2024-06-13T11:07:11.226 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/172 2024-06-13T11:07:11.384 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/172 2024-06-13T11:07:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-06-13T11:07:12.458 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-06-13T11:07:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-06-13T11:07:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-06-13T11:07:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-06-13T11:07:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-06-13T11:07:12.793 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-06-13T11:07:12.906 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-06-13T11:07:12.949 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-06-13T11:07:13.197 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-06-13T11:07:13.244 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-06-13T11:07:13.356 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-06-13T11:07:13.370 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 112/172 2024-06-13T11:07:13.370 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /sys 2024-06-13T11:07:13.370 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /proc 2024-06-13T11:07:13.370 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /mnt 2024-06-13T11:07:13.370 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /var/tmp 2024-06-13T11:07:13.370 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /home 2024-06-13T11:07:13.370 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /root 2024-06-13T11:07:13.370 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /tmp 2024-06-13T11:07:13.371 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:07:13.542 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 113/172 2024-06-13T11:07:13.560 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 113/172 2024-06-13T11:07:13.560 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:13.560 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-13T11:07:13.560 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:07:14.298 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 112/172 2024-06-13T11:07:14.298 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /sys 2024-06-13T11:07:14.298 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /proc 2024-06-13T11:07:14.298 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /mnt 2024-06-13T11:07:14.298 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /var/tmp 2024-06-13T11:07:14.298 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /home 2024-06-13T11:07:14.298 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /root 2024-06-13T11:07:14.298 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /tmp 2024-06-13T11:07:14.298 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-06-13T11:07:14.304 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-06-13T11:07:14.448 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-06-13T11:07:14.458 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 113/172 2024-06-13T11:07:14.474 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 113/172 2024-06-13T11:07:14.474 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:14.474 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-13T11:07:14.474 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-06-13T11:07:15.020 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 114/172 2024-06-13T11:07:15.045 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 114/172 2024-06-13T11:07:15.045 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:15.045 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-13T11:07:15.046 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-13T11:07:15.046 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-13T11:07:15.046 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:07:15.270 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 115/172 2024-06-13T11:07:15.293 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 115/172 2024-06-13T11:07:15.293 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:15.293 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-13T11:07:15.293 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-13T11:07:15.293 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-13T11:07:15.293 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:07:15.729 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 116/172 2024-06-13T11:07:15.752 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 116/172 2024-06-13T11:07:15.752 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:15.752 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-13T11:07:15.752 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-13T11:07:15.752 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-13T11:07:15.752 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:07:15.868 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-06-13T11:07:15.924 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-06-13T11:07:15.944 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 114/172 2024-06-13T11:07:15.971 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 114/172 2024-06-13T11:07:15.971 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:15.971 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-13T11:07:15.971 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-13T11:07:15.971 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-13T11:07:15.971 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-06-13T11:07:15.980 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-06-13T11:07:16.127 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-06-13T11:07:16.163 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-06-13T11:07:16.212 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 115/172 2024-06-13T11:07:16.213 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-06-13T11:07:16.217 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-06-13T11:07:16.234 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 115/172 2024-06-13T11:07:16.234 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:16.235 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-13T11:07:16.235 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-13T11:07:16.235 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-13T11:07:16.235 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-06-13T11:07:16.253 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-06-13T11:07:16.288 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-06-13T11:07:16.290 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-06-13T11:07:16.379 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-06-13T11:07:16.520 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-06-13T11:07:16.563 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-06-13T11:07:16.595 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-06-13T11:07:16.623 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : fuse-2.9.9-15.el9.x86_64 127/172 2024-06-13T11:07:16.685 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-06-13T11:07:16.689 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 116/172 2024-06-13T11:07:16.712 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 116/172 2024-06-13T11:07:16.712 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:16.712 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-13T11:07:16.712 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-13T11:07:16.712 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-13T11:07:16.712 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-06-13T11:07:16.737 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 104/172 2024-06-13T11:07:16.819 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-06-13T11:07:16.854 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 104/172 2024-06-13T11:07:16.884 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-06-13T11:07:16.886 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 105/172 2024-06-13T11:07:16.943 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-06-13T11:07:16.948 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-06-13T11:07:17.066 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 128/172 2024-06-13T11:07:17.096 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 128/172 2024-06-13T11:07:17.133 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-06-13T11:07:17.136 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 129/172 2024-06-13T11:07:17.190 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-06-13T11:07:17.197 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 130/172 2024-06-13T11:07:17.227 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 131/172 2024-06-13T11:07:17.276 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-06-13T11:07:17.373 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-06-13T11:07:17.531 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-06-13T11:07:17.536 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-06-13T11:07:17.573 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-06-13T11:07:17.574 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 108/172 2024-06-13T11:07:17.605 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-06-13T11:07:17.632 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fuse-2.9.9-15.el9.x86_64 127/172 2024-06-13T11:07:17.688 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 108/172 2024-06-13T11:07:17.726 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 109/172 2024-06-13T11:07:18.009 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 128/172 2024-06-13T11:07:18.039 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 128/172 2024-06-13T11:07:18.071 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 129/172 2024-06-13T11:07:18.133 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 130/172 2024-06-13T11:07:18.179 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 131/172 2024-06-13T11:07:18.253 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 131/172 2024-06-13T11:07:18.288 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 132/172 2024-06-13T11:07:19.205 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 131/172 2024-06-13T11:07:19.239 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 132/172 2024-06-13T11:07:19.244 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 132/172 2024-06-13T11:07:19.271 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 133/172 2024-06-13T11:07:19.372 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 133/172 2024-06-13T11:07:19.534 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 134/172 2024-06-13T11:07:19.565 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 135/172 2024-06-13T11:07:19.588 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 135/172 2024-06-13T11:07:19.588 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:19.588 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-13T11:07:19.588 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-13T11:07:19.588 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-13T11:07:19.588 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:07:19.632 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 136/172 2024-06-13T11:07:19.643 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 136/172 2024-06-13T11:07:19.740 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 137/172 2024-06-13T11:07:19.788 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 138/172 2024-06-13T11:07:20.208 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 132/172 2024-06-13T11:07:20.231 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 133/172 2024-06-13T11:07:20.334 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 133/172 2024-06-13T11:07:20.503 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 134/172 2024-06-13T11:07:20.536 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T11:07:20.541 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 135/172 2024-06-13T11:07:20.565 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 135/172 2024-06-13T11:07:20.565 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:20.565 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-13T11:07:20.565 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-13T11:07:20.565 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-13T11:07:20.565 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-06-13T11:07:20.582 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T11:07:20.609 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 136/172 2024-06-13T11:07:20.620 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 136/172 2024-06-13T11:07:20.679 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libtool-2.4.6-45.el9.x86_64 139/172 2024-06-13T11:07:20.717 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 137/172 2024-06-13T11:07:20.718 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 140/172 2024-06-13T11:07:20.740 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 140/172 2024-06-13T11:07:20.741 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:20.741 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-13T11:07:20.741 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-13T11:07:20.741 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-13T11:07:20.741 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:07:20.765 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 138/172 2024-06-13T11:07:20.785 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 141/172 2024-06-13T11:07:20.807 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 141/172 2024-06-13T11:07:20.807 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:20.807 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-13T11:07:20.807 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:07:20.861 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/172 2024-06-13T11:07:20.883 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/172 2024-06-13T11:07:20.883 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:20.883 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-13T11:07:20.883 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-13T11:07:20.883 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-13T11:07:20.883 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:07:21.187 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 143/172 2024-06-13T11:07:21.208 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 143/172 2024-06-13T11:07:21.209 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:21.209 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-13T11:07:21.209 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-13T11:07:21.209 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-13T11:07:21.209 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:07:21.259 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T11:07:21.309 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 111/172 2024-06-13T11:07:21.493 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 111/172 2024-06-13T11:07:21.493 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-13T11:07:21.493 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-13T11:07:21.493 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:07:21.527 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 112/172 2024-06-13T11:07:21.659 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libtool-2.4.6-45.el9.x86_64 139/172 2024-06-13T11:07:21.695 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 140/172 2024-06-13T11:07:21.717 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 140/172 2024-06-13T11:07:21.717 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:21.717 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-13T11:07:21.717 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-13T11:07:21.718 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-13T11:07:21.718 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-06-13T11:07:21.762 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 141/172 2024-06-13T11:07:21.784 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 141/172 2024-06-13T11:07:21.784 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:21.785 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-13T11:07:21.785 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-06-13T11:07:21.829 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/172 2024-06-13T11:07:21.851 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/172 2024-06-13T11:07:21.852 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:21.852 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-13T11:07:21.852 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-13T11:07:21.852 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-13T11:07:21.852 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-06-13T11:07:22.163 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 143/172 2024-06-13T11:07:22.186 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 143/172 2024-06-13T11:07:22.186 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:22.186 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-13T11:07:22.186 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-13T11:07:22.186 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-13T11:07:22.186 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-06-13T11:07:25.706 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 144/172 2024-06-13T11:07:25.747 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 145/172 2024-06-13T11:07:25.796 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 146/172 2024-06-13T11:07:25.854 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xfsprogs-devel-6.4.0-1.el9.x86_64 147/172 2024-06-13T11:07:25.881 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-06-13T11:07:26.067 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 149/172 2024-06-13T11:07:26.110 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-06-13T11:07:26.142 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 151/172 2024-06-13T11:07:26.183 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-06-13T11:07:26.212 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 153/172 2024-06-13T11:07:26.259 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 154/172 2024-06-13T11:07:26.691 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 144/172 2024-06-13T11:07:26.732 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 145/172 2024-06-13T11:07:26.774 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 146/172 2024-06-13T11:07:26.806 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xfsprogs-devel-6.4.0-1.el9.x86_64 147/172 2024-06-13T11:07:26.841 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-06-13T11:07:26.846 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T11:07:26.881 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T11:07:26.901 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T11:07:27.027 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 149/172 2024-06-13T11:07:27.071 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-06-13T11:07:27.103 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 151/172 2024-06-13T11:07:27.135 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-06-13T11:07:27.165 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 153/172 2024-06-13T11:07:27.211 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 154/172 2024-06-13T11:07:27.726 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 156/172 2024-06-13T11:07:27.802 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openssl-devel-1:3.2.2-1.el9.x86_64 157/172 2024-06-13T11:07:27.831 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T11:07:27.843 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-06-13T11:07:27.875 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T11:07:27.895 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T11:07:27.925 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-06-13T11:07:27.964 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-06-13T11:07:27.989 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-06-13T11:07:28.015 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-06-13T11:07:28.041 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-06-13T11:07:28.041 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-06-13T11:07:28.117 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-06-13T11:07:28.142 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-06-13T11:07:28.142 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-06-13T11:07:28.226 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-06-13T11:07:28.251 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-06-13T11:07:28.255 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T11:07:28.256 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T11:07:28.444 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T11:07:28.445 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-06-13T11:07:28.529 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-06-13T11:07:28.553 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-06-13T11:07:28.580 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-06-13T11:07:28.644 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T11:07:28.736 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 156/172 2024-06-13T11:07:28.822 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openssl-devel-1:3.2.2-1.el9.x86_64 157/172 2024-06-13T11:07:28.862 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-06-13T11:07:28.945 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-06-13T11:07:28.991 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-06-13T11:07:29.016 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-06-13T11:07:29.042 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-06-13T11:07:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-06-13T11:07:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-06-13T11:07:29.152 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-06-13T11:07:29.185 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-06-13T11:07:29.185 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-06-13T11:07:29.269 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-06-13T11:07:29.294 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-06-13T11:07:29.300 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T11:07:29.300 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T11:07:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T11:07:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-06-13T11:07:29.564 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-06-13T11:07:29.589 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-06-13T11:07:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-06-13T11:07:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T11:07:34.243 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T11:07:34.243 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/172 2024-06-13T11:07:34.244 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/172 2024-06-13T11:07:34.244 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/172 2024-06-13T11:07:34.244 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/172 2024-06-13T11:07:34.244 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/172 2024-06-13T11:07:34.244 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/172 2024-06-13T11:07:34.244 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/172 2024-06-13T11:07:34.244 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T11:07:34.244 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T11:07:34.244 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/172 2024-06-13T11:07:34.244 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/172 2024-06-13T11:07:34.244 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/172 2024-06-13T11:07:34.244 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/172 2024-06-13T11:07:34.245 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T11:07:34.245 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/172 2024-06-13T11:07:34.245 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/172 2024-06-13T11:07:34.245 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/172 2024-06-13T11:07:34.245 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/172 2024-06-13T11:07:34.245 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/172 2024-06-13T11:07:34.245 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/172 2024-06-13T11:07:34.245 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/172 2024-06-13T11:07:34.245 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/172 2024-06-13T11:07:34.245 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/172 2024-06-13T11:07:34.245 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/172 2024-06-13T11:07:34.245 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/172 2024-06-13T11:07:34.245 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/172 2024-06-13T11:07:34.246 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/172 2024-06-13T11:07:34.246 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/172 2024-06-13T11:07:34.258 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/172 2024-06-13T11:07:34.258 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/172 2024-06-13T11:07:34.258 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/172 2024-06-13T11:07:34.258 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/172 2024-06-13T11:07:34.258 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/172 2024-06-13T11:07:34.258 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/172 2024-06-13T11:07:34.258 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/172 2024-06-13T11:07:34.258 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/172 2024-06-13T11:07:34.258 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/172 2024-06-13T11:07:34.258 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/172 2024-06-13T11:07:34.258 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/172 2024-06-13T11:07:34.258 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/172 2024-06-13T11:07:34.259 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-06-13T11:07:34.259 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-06-13T11:07:34.259 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-06-13T11:07:34.259 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-06-13T11:07:34.259 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-06-13T11:07:34.259 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-06-13T11:07:34.259 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-06-13T11:07:34.259 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/172 2024-06-13T11:07:34.259 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-06-13T11:07:34.259 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-06-13T11:07:34.259 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-06-13T11:07:34.259 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-06-13T11:07:34.259 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-06-13T11:07:34.260 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-06-13T11:07:34.260 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-06-13T11:07:34.260 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-06-13T11:07:34.260 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-06-13T11:07:34.260 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-06-13T11:07:34.260 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-06-13T11:07:34.260 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-06-13T11:07:34.260 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/172 2024-06-13T11:07:34.260 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-06-13T11:07:34.260 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-06-13T11:07:34.260 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-06-13T11:07:34.260 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-06-13T11:07:34.260 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-06-13T11:07:34.261 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-06-13T11:07:34.261 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-devel-1:3.2.2-1.el9.x86_64 68/172 2024-06-13T11:07:34.261 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-06-13T11:07:34.261 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-06-13T11:07:34.261 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-06-13T11:07:34.261 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-06-13T11:07:34.261 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-06-13T11:07:34.261 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-06-13T11:07:34.261 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-06-13T11:07:34.261 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-06-13T11:07:34.261 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-06-13T11:07:34.261 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-06-13T11:07:34.261 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-06-13T11:07:34.262 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-06-13T11:07:34.262 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-06-13T11:07:34.262 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-06-13T11:07:34.262 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-06-13T11:07:34.262 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-06-13T11:07:34.262 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-06-13T11:07:34.262 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-06-13T11:07:34.262 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-06-13T11:07:34.262 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-06-13T11:07:34.262 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-06-13T11:07:34.262 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-06-13T11:07:34.262 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-06-13T11:07:34.262 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-06-13T11:07:34.263 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-06-13T11:07:34.263 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-06-13T11:07:34.263 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-06-13T11:07:34.263 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-06-13T11:07:34.263 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-06-13T11:07:34.263 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-06-13T11:07:34.263 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-06-13T11:07:34.263 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-06-13T11:07:34.263 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xfsprogs-devel-6.4.0-1.el9.x86_64 101/172 2024-06-13T11:07:34.263 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-06-13T11:07:34.263 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-06-13T11:07:34.263 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-06-13T11:07:34.263 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-06-13T11:07:34.263 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-06-13T11:07:34.264 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-06-13T11:07:34.264 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-06-13T11:07:34.264 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-06-13T11:07:34.264 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-06-13T11:07:34.264 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-06-13T11:07:34.264 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-06-13T11:07:34.264 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-06-13T11:07:34.264 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-06-13T11:07:34.264 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-06-13T11:07:34.264 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-06-13T11:07:34.264 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-06-13T11:07:34.264 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/172 2024-06-13T11:07:34.264 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-06-13T11:07:34.265 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-06-13T11:07:34.265 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-06-13T11:07:34.265 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-google-auth-1:2.29.0-2.el9.noarch 122/172 2024-06-13T11:07:34.265 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-06-13T11:07:34.265 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-06-13T11:07:34.265 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-06-13T11:07:34.265 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-06-13T11:07:34.265 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-06-13T11:07:34.265 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-06-13T11:07:34.265 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-06-13T11:07:34.265 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-06-13T11:07:34.265 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-06-13T11:07:34.265 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-06-13T11:07:34.266 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-06-13T11:07:34.266 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-06-13T11:07:34.266 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-06-13T11:07:34.266 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-06-13T11:07:34.266 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-06-13T11:07:34.266 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-06-13T11:07:34.266 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-06-13T11:07:34.266 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-06-13T11:07:34.266 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-06-13T11:07:34.266 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-06-13T11:07:34.266 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-06-13T11:07:34.266 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-06-13T11:07:34.267 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-06-13T11:07:34.267 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-06-13T11:07:34.267 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-06-13T11:07:34.267 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-06-13T11:07:34.267 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/172 2024-06-13T11:07:34.267 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-06-13T11:07:34.267 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/172 2024-06-13T11:07:34.267 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-06-13T11:07:34.267 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/172 2024-06-13T11:07:34.267 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-06-13T11:07:34.267 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/172 2024-06-13T11:07:34.267 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-06-13T11:07:34.267 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/172 2024-06-13T11:07:34.267 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-06-13T11:07:34.268 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/172 2024-06-13T11:07:34.268 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-06-13T11:07:34.268 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-06-13T11:07:34.268 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-06-13T11:07:34.268 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-06-13T11:07:34.268 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-06-13T11:07:34.268 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-06-13T11:07:34.268 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-06-13T11:07:34.268 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-1:3.2.2-1.el9.x86_64 167/172 2024-06-13T11:07:34.269 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-06-13T11:07:34.269 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-libs-1:3.2.2-1.el9.x86_64 169/172 2024-06-13T11:07:34.269 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-06-13T11:07:34.269 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xfsprogs-6.4.0-1.el9.x86_64 171/172 2024-06-13T11:07:35.268 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T11:07:35.268 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/172 2024-06-13T11:07:35.268 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/172 2024-06-13T11:07:35.268 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/172 2024-06-13T11:07:35.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/172 2024-06-13T11:07:35.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/172 2024-06-13T11:07:35.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/172 2024-06-13T11:07:35.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/172 2024-06-13T11:07:35.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T11:07:35.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T11:07:35.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/172 2024-06-13T11:07:35.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/172 2024-06-13T11:07:35.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/172 2024-06-13T11:07:35.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/172 2024-06-13T11:07:35.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T11:07:35.269 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/172 2024-06-13T11:07:35.270 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/172 2024-06-13T11:07:35.270 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/172 2024-06-13T11:07:35.270 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/172 2024-06-13T11:07:35.270 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/172 2024-06-13T11:07:35.270 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/172 2024-06-13T11:07:35.270 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/172 2024-06-13T11:07:35.270 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/172 2024-06-13T11:07:35.270 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/172 2024-06-13T11:07:35.270 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/172 2024-06-13T11:07:35.270 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/172 2024-06-13T11:07:35.270 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/172 2024-06-13T11:07:35.270 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/172 2024-06-13T11:07:35.270 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/172 2024-06-13T11:07:35.271 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/172 2024-06-13T11:07:35.271 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/172 2024-06-13T11:07:35.283 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/172 2024-06-13T11:07:35.283 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/172 2024-06-13T11:07:35.283 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/172 2024-06-13T11:07:35.283 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/172 2024-06-13T11:07:35.283 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/172 2024-06-13T11:07:35.283 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/172 2024-06-13T11:07:35.283 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/172 2024-06-13T11:07:35.283 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/172 2024-06-13T11:07:35.283 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/172 2024-06-13T11:07:35.283 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/172 2024-06-13T11:07:35.283 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-06-13T11:07:35.284 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-06-13T11:07:35.284 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-06-13T11:07:35.284 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-06-13T11:07:35.284 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-06-13T11:07:35.284 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-06-13T11:07:35.284 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-06-13T11:07:35.284 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/172 2024-06-13T11:07:35.284 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-06-13T11:07:35.284 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-06-13T11:07:35.284 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-06-13T11:07:35.284 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-06-13T11:07:35.284 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-06-13T11:07:35.284 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-06-13T11:07:35.284 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-06-13T11:07:35.285 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-06-13T11:07:35.285 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-06-13T11:07:35.285 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-06-13T11:07:35.285 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-06-13T11:07:35.285 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-06-13T11:07:35.285 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/172 2024-06-13T11:07:35.285 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-06-13T11:07:35.285 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-06-13T11:07:35.285 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-06-13T11:07:35.285 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-06-13T11:07:35.285 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-06-13T11:07:35.285 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-06-13T11:07:35.285 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-devel-1:3.2.2-1.el9.x86_64 68/172 2024-06-13T11:07:35.285 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-06-13T11:07:35.286 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-06-13T11:07:35.286 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-06-13T11:07:35.286 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-06-13T11:07:35.286 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-06-13T11:07:35.286 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-06-13T11:07:35.286 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-06-13T11:07:35.286 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-06-13T11:07:35.286 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-06-13T11:07:35.286 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-06-13T11:07:35.286 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-06-13T11:07:35.286 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-06-13T11:07:35.286 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-06-13T11:07:35.286 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-06-13T11:07:35.286 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-06-13T11:07:35.287 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-06-13T11:07:35.287 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-06-13T11:07:35.287 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-06-13T11:07:35.287 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-06-13T11:07:35.287 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-06-13T11:07:35.287 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-06-13T11:07:35.287 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-06-13T11:07:35.287 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-06-13T11:07:35.287 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-06-13T11:07:35.287 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-06-13T11:07:35.287 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-06-13T11:07:35.287 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-06-13T11:07:35.287 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-06-13T11:07:35.288 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-06-13T11:07:35.288 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-06-13T11:07:35.288 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-06-13T11:07:35.288 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-06-13T11:07:35.288 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsprogs-devel-6.4.0-1.el9.x86_64 101/172 2024-06-13T11:07:35.288 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-06-13T11:07:35.288 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-06-13T11:07:35.288 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-06-13T11:07:35.288 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-06-13T11:07:35.288 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-06-13T11:07:35.288 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-06-13T11:07:35.288 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-06-13T11:07:35.288 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-06-13T11:07:35.289 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-06-13T11:07:35.289 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-06-13T11:07:35.289 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-06-13T11:07:35.289 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-06-13T11:07:35.289 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-06-13T11:07:35.289 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-06-13T11:07:35.289 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-06-13T11:07:35.289 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-06-13T11:07:35.289 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/172 2024-06-13T11:07:35.289 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-06-13T11:07:35.289 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-06-13T11:07:35.289 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-06-13T11:07:35.289 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-google-auth-1:2.29.0-2.el9.noarch 122/172 2024-06-13T11:07:35.290 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-06-13T11:07:35.290 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-06-13T11:07:35.290 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-06-13T11:07:35.290 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-06-13T11:07:35.290 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-06-13T11:07:35.290 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-06-13T11:07:35.290 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-06-13T11:07:35.290 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-06-13T11:07:35.290 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-06-13T11:07:35.290 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-06-13T11:07:35.290 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-06-13T11:07:35.290 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-06-13T11:07:35.291 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-06-13T11:07:35.291 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-06-13T11:07:35.291 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-06-13T11:07:35.291 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-06-13T11:07:35.291 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-06-13T11:07:35.291 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-06-13T11:07:35.291 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-06-13T11:07:35.291 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-06-13T11:07:35.291 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-06-13T11:07:35.291 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-06-13T11:07:35.291 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-06-13T11:07:35.291 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-06-13T11:07:35.291 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-06-13T11:07:35.291 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-06-13T11:07:35.292 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/172 2024-06-13T11:07:35.292 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-06-13T11:07:35.292 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/172 2024-06-13T11:07:35.292 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-06-13T11:07:35.292 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/172 2024-06-13T11:07:35.292 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-06-13T11:07:35.292 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/172 2024-06-13T11:07:35.292 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-06-13T11:07:35.292 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/172 2024-06-13T11:07:35.292 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-06-13T11:07:35.292 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/172 2024-06-13T11:07:35.292 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-06-13T11:07:35.292 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-06-13T11:07:35.293 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-06-13T11:07:35.293 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-06-13T11:07:35.293 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-06-13T11:07:35.293 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-06-13T11:07:35.293 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-06-13T11:07:35.293 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-1:3.2.2-1.el9.x86_64 167/172 2024-06-13T11:07:35.293 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-06-13T11:07:35.293 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-libs-1:3.2.2-1.el9.x86_64 169/172 2024-06-13T11:07:35.293 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-06-13T11:07:35.293 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsprogs-6.4.0-1.el9.x86_64 171/172 2024-06-13T11:07:35.578 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 112/172 2024-06-13T11:07:35.579 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-06-13T11:07:35.579 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-06-13T11:07:35.579 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-06-13T11:07:35.579 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-06-13T11:07:35.579 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-06-13T11:07:35.579 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-06-13T11:07:35.579 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-06-13T11:07:35.579 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:07:35.823 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 113/172 2024-06-13T11:07:35.871 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 113/172 2024-06-13T11:07:35.871 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:35.871 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-13T11:07:35.871 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:07:36.739 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T11:07:36.739 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:07:36.739 INFO:teuthology.orchestra.run.smithi178.stdout:Upgraded: 2024-06-13T11:07:36.739 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-13T11:07:36.739 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-13T11:07:36.739 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-13T11:07:36.739 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-13T11:07:36.739 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-13T11:07:36.739 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-13T11:07:36.739 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-13T11:07:36.740 INFO:teuthology.orchestra.run.smithi178.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.740 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.740 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-1:3.2.2-1.el9.x86_64 2024-06-13T11:07:36.740 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-libs-1:3.2.2-1.el9.x86_64 2024-06-13T11:07:36.740 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-6.4.0-1.el9.x86_64 2024-06-13T11:07:36.740 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-06-13T11:07:36.740 INFO:teuthology.orchestra.run.smithi178.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-13T11:07:36.740 INFO:teuthology.orchestra.run.smithi178.stdout: automake-1.16.2-8.el9.noarch 2024-06-13T11:07:36.740 INFO:teuthology.orchestra.run.smithi178.stdout: bison-3.7.4-5.el9.x86_64 2024-06-13T11:07:36.740 INFO:teuthology.orchestra.run.smithi178.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-13T11:07:36.740 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.740 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.741 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.741 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.741 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:36.741 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.741 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.741 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.741 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:36.741 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:36.741 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:36.741 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:36.741 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:36.741 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.741 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.742 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:36.742 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.742 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.742 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.742 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:36.742 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:36.742 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.742 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.742 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:36.742 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-13T11:07:36.742 INFO:teuthology.orchestra.run.smithi178.stdout: flex-2.6.4-9.el9.x86_64 2024-06-13T11:07:36.742 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-13T11:07:36.743 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-13T11:07:36.743 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-13T11:07:36.743 INFO:teuthology.orchestra.run.smithi178.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-13T11:07:36.743 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-13T11:07:36.743 INFO:teuthology.orchestra.run.smithi178.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-13T11:07:36.743 INFO:teuthology.orchestra.run.smithi178.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-13T11:07:36.743 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-13T11:07:36.743 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-13T11:07:36.743 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.743 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.743 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.743 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-13T11:07:36.744 INFO:teuthology.orchestra.run.smithi178.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-13T11:07:36.744 INFO:teuthology.orchestra.run.smithi178.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-13T11:07:36.744 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-13T11:07:36.744 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-13T11:07:36.744 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.744 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.744 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-13T11:07:36.744 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.744 INFO:teuthology.orchestra.run.smithi178.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-13T11:07:36.744 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-13T11:07:36.744 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-13T11:07:36.744 INFO:teuthology.orchestra.run.smithi178.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-13T11:07:36.744 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-13T11:07:36.745 INFO:teuthology.orchestra.run.smithi178.stdout: lua-5.4.4-4.el9.x86_64 2024-06-13T11:07:36.745 INFO:teuthology.orchestra.run.smithi178.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-13T11:07:36.745 INFO:teuthology.orchestra.run.smithi178.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-13T11:07:36.745 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-13T11:07:36.745 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-13T11:07:36.745 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-devel-1:3.2.2-1.el9.x86_64 2024-06-13T11:07:36.745 INFO:teuthology.orchestra.run.smithi178.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-13T11:07:36.745 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-13.14-1.el9.x86_64 2024-06-13T11:07:36.745 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-13T11:07:36.745 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-13T11:07:36.745 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-13T11:07:36.745 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-13T11:07:36.746 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-13T11:07:36.746 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-13T11:07:36.746 INFO:teuthology.orchestra.run.smithi178.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-13T11:07:36.746 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-13T11:07:36.746 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-13T11:07:36.746 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-13T11:07:36.746 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.746 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.746 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.746 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-13T11:07:36.746 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-13T11:07:36.746 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-13T11:07:36.746 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-13T11:07:36.747 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-13T11:07:36.747 INFO:teuthology.orchestra.run.smithi178.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-13T11:07:36.747 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-13T11:07:36.747 INFO:teuthology.orchestra.run.smithi178.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-13T11:07:36.747 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth-1:2.29.0-2.el9.noarch 2024-06-13T11:07:36.747 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-13T11:07:36.747 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-13T11:07:36.747 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-13T11:07:36.747 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-13T11:07:36.747 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-13T11:07:36.747 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-13T11:07:36.748 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-13T11:07:36.748 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-13T11:07:36.748 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-13T11:07:36.748 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-13T11:07:36.748 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-13T11:07:36.748 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-13T11:07:36.748 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-13T11:07:36.748 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-13T11:07:36.748 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-13T11:07:36.748 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-13T11:07:36.748 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-13T11:07:36.748 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-13T11:07:36.748 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-13T11:07:36.749 INFO:teuthology.orchestra.run.smithi178.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-13T11:07:36.749 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-13T11:07:36.749 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ply-3.11-14.el9.noarch 2024-06-13T11:07:36.749 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-13T11:07:36.749 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-13T11:07:36.749 INFO:teuthology.orchestra.run.smithi178.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-13T11:07:36.749 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-13T11:07:36.749 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-13T11:07:36.749 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-13T11:07:36.749 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-13T11:07:36.749 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-13T11:07:36.749 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-13T11:07:36.750 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.750 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.750 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-13T11:07:36.750 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-13T11:07:36.750 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-13T11:07:36.750 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.750 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-13T11:07:36.750 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-13T11:07:36.750 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-13T11:07:36.750 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-13T11:07:36.750 INFO:teuthology.orchestra.run.smithi178.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-13T11:07:36.750 INFO:teuthology.orchestra.run.smithi178.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-13T11:07:36.751 INFO:teuthology.orchestra.run.smithi178.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-13T11:07:36.751 INFO:teuthology.orchestra.run.smithi178.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-13T11:07:36.751 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-13T11:07:36.751 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-13T11:07:36.751 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-13T11:07:36.751 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-13T11:07:36.751 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-13T11:07:36.751 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-13T11:07:36.751 INFO:teuthology.orchestra.run.smithi178.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-13T11:07:36.751 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.751 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.751 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:36.752 INFO:teuthology.orchestra.run.smithi178.stdout: re2-1:20211101-3.el9.x86_64 2024-06-13T11:07:36.752 INFO:teuthology.orchestra.run.smithi178.stdout: socat-1.7.4.1-6.el9.x86_64 2024-06-13T11:07:36.752 INFO:teuthology.orchestra.run.smithi178.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-13T11:07:36.752 INFO:teuthology.orchestra.run.smithi178.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-13T11:07:36.752 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-devel-6.4.0-1.el9.x86_64 2024-06-13T11:07:36.752 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-13T11:07:36.752 INFO:teuthology.orchestra.run.smithi178.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-13T11:07:36.752 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:07:36.752 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-06-13T11:07:37.190 DEBUG:teuthology.parallel:result is None 2024-06-13T11:07:37.584 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 114/172 2024-06-13T11:07:37.671 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 114/172 2024-06-13T11:07:37.671 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:37.672 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-13T11:07:37.672 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-13T11:07:37.672 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-13T11:07:37.672 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:07:37.934 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 115/172 2024-06-13T11:07:38.010 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 115/172 2024-06-13T11:07:38.010 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:38.010 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-13T11:07:38.010 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-13T11:07:38.010 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-13T11:07:38.010 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:07:38.078 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T11:07:38.078 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-06-13T11:07:38.078 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2024-06-13T11:07:38.078 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-13T11:07:38.078 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-13T11:07:38.079 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-13T11:07:38.079 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-13T11:07:38.079 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-13T11:07:38.079 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-13T11:07:38.079 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-13T11:07:38.079 INFO:teuthology.orchestra.run.smithi077.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.079 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.079 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-1:3.2.2-1.el9.x86_64 2024-06-13T11:07:38.079 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-libs-1:3.2.2-1.el9.x86_64 2024-06-13T11:07:38.079 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-6.4.0-1.el9.x86_64 2024-06-13T11:07:38.080 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-06-13T11:07:38.080 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-13T11:07:38.080 INFO:teuthology.orchestra.run.smithi077.stdout: automake-1.16.2-8.el9.noarch 2024-06-13T11:07:38.080 INFO:teuthology.orchestra.run.smithi077.stdout: bison-3.7.4-5.el9.x86_64 2024-06-13T11:07:38.080 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-13T11:07:38.080 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.080 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.080 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.080 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.080 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:38.081 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.081 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.081 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.081 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:38.081 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:38.081 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:38.081 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:38.081 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:38.081 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.081 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.081 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:38.082 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.082 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.082 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.082 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:38.082 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:38.083 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.083 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.083 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:07:38.083 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-13T11:07:38.083 INFO:teuthology.orchestra.run.smithi077.stdout: flex-2.6.4-9.el9.x86_64 2024-06-13T11:07:38.083 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-13T11:07:38.083 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-13T11:07:38.083 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-13T11:07:38.083 INFO:teuthology.orchestra.run.smithi077.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-13T11:07:38.083 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-13T11:07:38.084 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-13T11:07:38.084 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-13T11:07:38.084 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-13T11:07:38.084 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-13T11:07:38.084 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.084 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.084 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.084 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-13T11:07:38.084 INFO:teuthology.orchestra.run.smithi077.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-13T11:07:38.084 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-13T11:07:38.084 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-13T11:07:38.084 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-13T11:07:38.085 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.085 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.085 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-13T11:07:38.085 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.085 INFO:teuthology.orchestra.run.smithi077.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-13T11:07:38.085 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-13T11:07:38.085 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-13T11:07:38.085 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-13T11:07:38.085 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-13T11:07:38.085 INFO:teuthology.orchestra.run.smithi077.stdout: lua-5.4.4-4.el9.x86_64 2024-06-13T11:07:38.085 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-13T11:07:38.086 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-13T11:07:38.086 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-13T11:07:38.086 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-13T11:07:38.086 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel-1:3.2.2-1.el9.x86_64 2024-06-13T11:07:38.086 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-13T11:07:38.086 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-13.14-1.el9.x86_64 2024-06-13T11:07:38.086 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-13T11:07:38.086 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-13T11:07:38.086 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-13T11:07:38.087 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-13T11:07:38.087 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-13T11:07:38.087 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-13T11:07:38.087 INFO:teuthology.orchestra.run.smithi077.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-13T11:07:38.087 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-13T11:07:38.087 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-13T11:07:38.087 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-13T11:07:38.087 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.087 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.088 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.088 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-13T11:07:38.088 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-13T11:07:38.088 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-13T11:07:38.088 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-13T11:07:38.088 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-13T11:07:38.088 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-13T11:07:38.088 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-13T11:07:38.088 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-13T11:07:38.088 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth-1:2.29.0-2.el9.noarch 2024-06-13T11:07:38.088 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-13T11:07:38.089 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-13T11:07:38.089 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-13T11:07:38.089 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-13T11:07:38.089 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-13T11:07:38.089 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-13T11:07:38.089 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-13T11:07:38.089 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-13T11:07:38.089 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-13T11:07:38.089 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-13T11:07:38.089 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-13T11:07:38.090 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-13T11:07:38.090 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-13T11:07:38.090 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-13T11:07:38.090 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-13T11:07:38.090 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-13T11:07:38.090 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-13T11:07:38.090 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-13T11:07:38.090 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-13T11:07:38.090 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-13T11:07:38.091 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-13T11:07:38.091 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply-3.11-14.el9.noarch 2024-06-13T11:07:38.091 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-13T11:07:38.091 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-13T11:07:38.091 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-13T11:07:38.091 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-13T11:07:38.091 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-13T11:07:38.091 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-13T11:07:38.091 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-13T11:07:38.091 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-13T11:07:38.092 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-13T11:07:38.092 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.092 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.092 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-13T11:07:38.092 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-13T11:07:38.092 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-13T11:07:38.092 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.092 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-13T11:07:38.092 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-13T11:07:38.092 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-13T11:07:38.092 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-13T11:07:38.093 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-13T11:07:38.093 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-13T11:07:38.093 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-13T11:07:38.093 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-13T11:07:38.093 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-13T11:07:38.093 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-13T11:07:38.093 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-13T11:07:38.093 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-13T11:07:38.093 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-13T11:07:38.093 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-13T11:07:38.094 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-13T11:07:38.094 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.094 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.094 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:07:38.094 INFO:teuthology.orchestra.run.smithi077.stdout: re2-1:20211101-3.el9.x86_64 2024-06-13T11:07:38.094 INFO:teuthology.orchestra.run.smithi077.stdout: socat-1.7.4.1-6.el9.x86_64 2024-06-13T11:07:38.094 INFO:teuthology.orchestra.run.smithi077.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-13T11:07:38.094 INFO:teuthology.orchestra.run.smithi077.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-13T11:07:38.094 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel-6.4.0-1.el9.x86_64 2024-06-13T11:07:38.094 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-13T11:07:38.095 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-13T11:07:38.095 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-06-13T11:07:38.095 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-06-13T11:07:38.507 DEBUG:teuthology.parallel:result is None 2024-06-13T11:07:38.526 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 116/172 2024-06-13T11:07:38.600 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 116/172 2024-06-13T11:07:38.600 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:38.600 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-13T11:07:38.600 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-13T11:07:38.601 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-13T11:07:38.601 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:07:38.736 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-06-13T11:07:38.799 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-06-13T11:07:38.876 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-06-13T11:07:39.131 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-06-13T11:07:39.191 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-06-13T11:07:39.290 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-06-13T11:07:39.410 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-06-13T11:07:39.599 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-06-13T11:07:39.648 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-06-13T11:07:39.696 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-06-13T11:07:39.728 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-15.el9.x86_64 127/172 2024-06-13T11:07:40.377 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 128/172 2024-06-13T11:07:40.416 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 128/172 2024-06-13T11:07:40.470 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 129/172 2024-06-13T11:07:40.587 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 130/172 2024-06-13T11:07:40.622 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 131/172 2024-06-13T11:07:41.955 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 131/172 2024-06-13T11:07:42.005 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 132/172 2024-06-13T11:07:43.174 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 132/172 2024-06-13T11:07:43.205 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 133/172 2024-06-13T11:07:43.358 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 133/172 2024-06-13T11:07:43.545 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 134/172 2024-06-13T11:07:43.574 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 135/172 2024-06-13T11:07:43.653 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 135/172 2024-06-13T11:07:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-13T11:07:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-13T11:07:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-13T11:07:43.653 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:07:43.708 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 136/172 2024-06-13T11:07:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 136/172 2024-06-13T11:07:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 137/172 2024-06-13T11:07:43.966 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 138/172 2024-06-13T11:07:45.021 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtool-2.4.6-45.el9.x86_64 139/172 2024-06-13T11:07:45.052 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 140/172 2024-06-13T11:07:45.126 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 140/172 2024-06-13T11:07:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-13T11:07:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-13T11:07:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-13T11:07:45.127 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:07:45.186 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 141/172 2024-06-13T11:07:45.263 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 141/172 2024-06-13T11:07:45.263 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:45.263 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-13T11:07:45.263 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:07:45.328 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/172 2024-06-13T11:07:45.408 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/172 2024-06-13T11:07:45.408 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:45.408 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-13T11:07:45.408 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-13T11:07:45.408 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-13T11:07:45.409 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:07:45.812 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 143/172 2024-06-13T11:07:45.895 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 143/172 2024-06-13T11:07:45.895 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T11:07:45.895 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-13T11:07:45.895 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-13T11:07:45.896 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-13T11:07:45.896 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:07:51.170 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 144/172 2024-06-13T11:07:51.227 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 145/172 2024-06-13T11:07:51.292 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 146/172 2024-06-13T11:07:51.327 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xfsprogs-devel-6.4.0-1.el9.x86_64 147/172 2024-06-13T11:07:51.363 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-06-13T11:07:51.677 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 149/172 2024-06-13T11:07:51.731 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-06-13T11:07:51.756 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 151/172 2024-06-13T11:07:51.795 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-06-13T11:07:51.835 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 153/172 2024-06-13T11:07:51.887 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 154/172 2024-06-13T11:07:52.722 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T11:07:52.776 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T11:07:52.839 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T11:07:54.322 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 156/172 2024-06-13T11:07:54.443 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openssl-devel-1:3.2.2-1.el9.x86_64 157/172 2024-06-13T11:07:54.511 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-06-13T11:07:54.660 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-06-13T11:07:54.702 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-06-13T11:07:54.735 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-06-13T11:07:54.769 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-06-13T11:07:54.811 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-06-13T11:07:54.812 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-06-13T11:07:54.935 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-06-13T11:07:54.982 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-06-13T11:07:54.982 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-06-13T11:07:55.128 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-06-13T11:07:55.166 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-06-13T11:07:55.201 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T11:07:55.202 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T11:07:55.538 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T11:07:55.538 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-06-13T11:07:55.707 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-06-13T11:07:55.752 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-06-13T11:07:55.795 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-06-13T11:07:55.936 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T11:07:56.203 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T11:07:56.203 INFO:teuthology.orchestra.run.smithi002.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-06-13T11:07:56.203 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:08:01.779 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/172 2024-06-13T11:08:01.779 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/172 2024-06-13T11:08:01.779 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/172 2024-06-13T11:08:01.779 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/172 2024-06-13T11:08:01.779 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/172 2024-06-13T11:08:01.779 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/172 2024-06-13T11:08:01.779 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/172 2024-06-13T11:08:01.779 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T11:08:01.780 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T11:08:01.780 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/172 2024-06-13T11:08:01.780 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/172 2024-06-13T11:08:01.780 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/172 2024-06-13T11:08:01.780 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/172 2024-06-13T11:08:01.780 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T11:08:01.780 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/172 2024-06-13T11:08:01.780 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/172 2024-06-13T11:08:01.780 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/172 2024-06-13T11:08:01.780 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/172 2024-06-13T11:08:01.780 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/172 2024-06-13T11:08:01.780 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/172 2024-06-13T11:08:01.780 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/172 2024-06-13T11:08:01.780 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/172 2024-06-13T11:08:01.781 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/172 2024-06-13T11:08:01.781 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/172 2024-06-13T11:08:01.781 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/172 2024-06-13T11:08:01.793 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/172 2024-06-13T11:08:01.793 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/172 2024-06-13T11:08:01.793 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/172 2024-06-13T11:08:01.793 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/172 2024-06-13T11:08:01.793 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/172 2024-06-13T11:08:01.793 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/172 2024-06-13T11:08:01.793 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/172 2024-06-13T11:08:01.793 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/172 2024-06-13T11:08:01.794 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/172 2024-06-13T11:08:01.794 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/172 2024-06-13T11:08:01.794 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/172 2024-06-13T11:08:01.794 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/172 2024-06-13T11:08:01.794 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/172 2024-06-13T11:08:01.794 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/172 2024-06-13T11:08:01.794 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/172 2024-06-13T11:08:01.794 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-06-13T11:08:01.794 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-06-13T11:08:01.794 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-06-13T11:08:01.794 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-06-13T11:08:01.794 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-06-13T11:08:01.795 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-06-13T11:08:01.795 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-06-13T11:08:01.795 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/172 2024-06-13T11:08:01.795 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-06-13T11:08:01.795 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-06-13T11:08:01.795 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-06-13T11:08:01.795 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-06-13T11:08:01.795 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-06-13T11:08:01.795 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-06-13T11:08:01.795 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-06-13T11:08:01.795 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-06-13T11:08:01.795 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-06-13T11:08:01.796 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-06-13T11:08:01.796 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-06-13T11:08:01.796 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-06-13T11:08:01.796 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/172 2024-06-13T11:08:01.796 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-06-13T11:08:01.796 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-06-13T11:08:01.796 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-06-13T11:08:01.796 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-06-13T11:08:01.796 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-06-13T11:08:01.796 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-06-13T11:08:01.796 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-devel-1:3.2.2-1.el9.x86_64 68/172 2024-06-13T11:08:01.796 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-06-13T11:08:01.796 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-06-13T11:08:01.797 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-06-13T11:08:01.797 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-06-13T11:08:01.797 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-06-13T11:08:01.797 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-06-13T11:08:01.797 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-06-13T11:08:01.797 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-06-13T11:08:01.797 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-06-13T11:08:01.797 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-06-13T11:08:01.797 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-06-13T11:08:01.797 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-06-13T11:08:01.797 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-06-13T11:08:01.797 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-06-13T11:08:01.797 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-06-13T11:08:01.798 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-06-13T11:08:01.798 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-06-13T11:08:01.798 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-06-13T11:08:01.798 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-06-13T11:08:01.798 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-06-13T11:08:01.798 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-06-13T11:08:01.798 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-06-13T11:08:01.798 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-06-13T11:08:01.798 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-06-13T11:08:01.798 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-06-13T11:08:01.798 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-06-13T11:08:01.798 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-06-13T11:08:01.799 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-06-13T11:08:01.799 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-06-13T11:08:01.799 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-06-13T11:08:01.799 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-06-13T11:08:01.799 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-06-13T11:08:01.799 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-devel-6.4.0-1.el9.x86_64 101/172 2024-06-13T11:08:01.799 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-06-13T11:08:01.799 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-06-13T11:08:01.799 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-06-13T11:08:01.799 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-06-13T11:08:01.799 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-06-13T11:08:01.799 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-06-13T11:08:01.799 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-06-13T11:08:01.799 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-06-13T11:08:01.800 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-06-13T11:08:01.800 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-06-13T11:08:01.800 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-06-13T11:08:01.800 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-06-13T11:08:01.800 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-06-13T11:08:01.800 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-06-13T11:08:01.800 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-06-13T11:08:01.800 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-06-13T11:08:01.800 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/172 2024-06-13T11:08:01.800 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-06-13T11:08:01.800 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-06-13T11:08:01.800 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-06-13T11:08:01.800 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.29.0-2.el9.noarch 122/172 2024-06-13T11:08:01.801 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-06-13T11:08:01.801 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-06-13T11:08:01.801 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-06-13T11:08:01.801 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-06-13T11:08:01.801 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-06-13T11:08:01.801 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-06-13T11:08:01.801 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-06-13T11:08:01.801 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-06-13T11:08:01.801 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-06-13T11:08:01.801 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-06-13T11:08:01.801 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-06-13T11:08:01.801 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-06-13T11:08:01.802 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-06-13T11:08:01.802 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-06-13T11:08:01.802 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-06-13T11:08:01.802 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-06-13T11:08:01.802 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-06-13T11:08:01.802 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-06-13T11:08:01.802 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-06-13T11:08:01.802 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-06-13T11:08:01.802 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-06-13T11:08:01.802 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-06-13T11:08:01.802 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-06-13T11:08:01.802 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-06-13T11:08:01.802 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-06-13T11:08:01.803 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-06-13T11:08:01.803 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/172 2024-06-13T11:08:01.803 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-06-13T11:08:01.803 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/172 2024-06-13T11:08:01.803 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-06-13T11:08:01.803 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/172 2024-06-13T11:08:01.803 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-06-13T11:08:01.803 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/172 2024-06-13T11:08:01.803 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-06-13T11:08:01.803 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/172 2024-06-13T11:08:01.803 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-06-13T11:08:01.803 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/172 2024-06-13T11:08:01.803 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-06-13T11:08:01.803 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-06-13T11:08:01.804 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-06-13T11:08:01.804 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-06-13T11:08:01.804 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-06-13T11:08:01.804 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-06-13T11:08:01.804 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-06-13T11:08:01.804 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.2-1.el9.x86_64 167/172 2024-06-13T11:08:01.804 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-06-13T11:08:01.804 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.2-1.el9.x86_64 169/172 2024-06-13T11:08:01.804 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-06-13T11:08:01.804 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-6.4.0-1.el9.x86_64 171/172 2024-06-13T11:08:04.108 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T11:08:04.109 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:08:04.109 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-06-13T11:08:04.109 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-13T11:08:04.109 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-13T11:08:04.109 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-13T11:08:04.109 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-13T11:08:04.109 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-13T11:08:04.109 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-13T11:08:04.109 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-13T11:08:04.109 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.109 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.110 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-1:3.2.2-1.el9.x86_64 2024-06-13T11:08:04.110 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs-1:3.2.2-1.el9.x86_64 2024-06-13T11:08:04.110 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-6.4.0-1.el9.x86_64 2024-06-13T11:08:04.110 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-06-13T11:08:04.110 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-13T11:08:04.110 INFO:teuthology.orchestra.run.smithi002.stdout: automake-1.16.2-8.el9.noarch 2024-06-13T11:08:04.110 INFO:teuthology.orchestra.run.smithi002.stdout: bison-3.7.4-5.el9.x86_64 2024-06-13T11:08:04.110 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-13T11:08:04.110 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.110 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.110 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.110 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.111 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:08:04.111 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.111 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.111 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.111 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:08:04.111 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:08:04.111 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:08:04.111 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:08:04.111 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:08:04.111 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.111 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.111 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:08:04.111 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.112 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.112 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.112 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:08:04.112 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:08:04.112 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.112 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.112 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T11:08:04.112 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-13T11:08:04.112 INFO:teuthology.orchestra.run.smithi002.stdout: flex-2.6.4-9.el9.x86_64 2024-06-13T11:08:04.112 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-13T11:08:04.112 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-13T11:08:04.112 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-13T11:08:04.112 INFO:teuthology.orchestra.run.smithi002.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-13T11:08:04.113 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-13T11:08:04.113 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-13T11:08:04.113 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-13T11:08:04.113 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-13T11:08:04.113 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-13T11:08:04.113 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.113 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.113 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.113 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-13T11:08:04.113 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-13T11:08:04.113 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-13T11:08:04.113 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-13T11:08:04.113 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-13T11:08:04.114 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.114 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.114 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-13T11:08:04.114 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.114 INFO:teuthology.orchestra.run.smithi002.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-13T11:08:04.114 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-13T11:08:04.114 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-13T11:08:04.114 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-13T11:08:04.114 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-13T11:08:04.114 INFO:teuthology.orchestra.run.smithi002.stdout: lua-5.4.4-4.el9.x86_64 2024-06-13T11:08:04.114 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-13T11:08:04.114 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-13T11:08:04.114 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-13T11:08:04.115 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-13T11:08:04.115 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel-1:3.2.2-1.el9.x86_64 2024-06-13T11:08:04.115 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-13T11:08:04.115 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-13.14-1.el9.x86_64 2024-06-13T11:08:04.115 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-13T11:08:04.115 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-13T11:08:04.115 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-13T11:08:04.115 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-13T11:08:04.115 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-13T11:08:04.115 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-13T11:08:04.115 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-13T11:08:04.115 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-13T11:08:04.115 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-13T11:08:04.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-13T11:08:04.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-13T11:08:04.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-13T11:08:04.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-13T11:08:04.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-13T11:08:04.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-13T11:08:04.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-13T11:08:04.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-13T11:08:04.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-13T11:08:04.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.29.0-2.el9.noarch 2024-06-13T11:08:04.117 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-13T11:08:04.117 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-13T11:08:04.117 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-13T11:08:04.117 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-13T11:08:04.117 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-13T11:08:04.117 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-13T11:08:04.117 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-13T11:08:04.117 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-13T11:08:04.117 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-13T11:08:04.117 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-13T11:08:04.117 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-13T11:08:04.117 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-13T11:08:04.118 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-13T11:08:04.118 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-13T11:08:04.118 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-13T11:08:04.118 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-13T11:08:04.118 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-13T11:08:04.118 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-13T11:08:04.118 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-13T11:08:04.118 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-13T11:08:04.118 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-13T11:08:04.118 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-06-13T11:08:04.118 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-13T11:08:04.118 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-13T11:08:04.118 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-13T11:08:04.119 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-13T11:08:04.119 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-13T11:08:04.119 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-13T11:08:04.119 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-13T11:08:04.119 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-13T11:08:04.119 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-13T11:08:04.119 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.119 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.119 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-13T11:08:04.119 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-13T11:08:04.119 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-13T11:08:04.119 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.119 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-13T11:08:04.120 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-13T11:08:04.120 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-13T11:08:04.120 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-13T11:08:04.120 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-13T11:08:04.120 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-13T11:08:04.120 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-13T11:08:04.120 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-13T11:08:04.120 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-13T11:08:04.120 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-13T11:08:04.120 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-13T11:08:04.120 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-13T11:08:04.120 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-13T11:08:04.120 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-13T11:08:04.121 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-13T11:08:04.121 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.121 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.121 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T11:08:04.121 INFO:teuthology.orchestra.run.smithi002.stdout: re2-1:20211101-3.el9.x86_64 2024-06-13T11:08:04.121 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-6.el9.x86_64 2024-06-13T11:08:04.121 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-13T11:08:04.121 INFO:teuthology.orchestra.run.smithi002.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-13T11:08:04.121 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel-6.4.0-1.el9.x86_64 2024-06-13T11:08:04.121 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-13T11:08:04.122 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-13T11:08:04.122 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:08:04.122 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-06-13T11:08:04.730 DEBUG:teuthology.parallel:result is None 2024-06-13T11:08:04.731 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T11:08:04.869 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-13T11:08:04.926 INFO:teuthology.orchestra.run.smithi002.stdout:19.0.0-2946.g3d89accf.el9 2024-06-13T11:08:04.927 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-13T11:08:04.927 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-13T11:08:04.929 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T11:08:05.155 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-13T11:08:05.180 INFO:teuthology.orchestra.run.smithi077.stdout:19.0.0-2946.g3d89accf.el9 2024-06-13T11:08:05.181 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-13T11:08:05.181 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-13T11:08:05.183 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T11:08:05.315 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-13T11:08:05.341 INFO:teuthology.orchestra.run.smithi178.stdout:19.0.0-2946.g3d89accf.el9 2024-06-13T11:08:05.342 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-13T11:08:05.342 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-13T11:08:05.345 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-13T11:08:05.346 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:08:05.346 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-13T11:08:05.423 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-06-13T11:08:05.424 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-13T11:08:05.455 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-13T11:08:05.456 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-13T11:08:05.487 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-13T11:08:05.487 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:08:05.487 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-06-13T11:08:05.556 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-13T11:08:05.662 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-06-13T11:08:05.662 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2024-06-13T11:08:05.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-13T11:08:05.758 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-13T11:08:05.758 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2024-06-13T11:08:05.786 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-13T11:08:05.853 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-13T11:08:05.853 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:08:05.854 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-13T11:08:05.922 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-13T11:08:06.042 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-06-13T11:08:06.042 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-13T11:08:06.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-13T11:08:06.131 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-13T11:08:06.131 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-13T11:08:06.155 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-13T11:08:06.231 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-13T11:08:06.231 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:08:06.232 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-06-13T11:08:06.300 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-13T11:08:06.411 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-06-13T11:08:06.411 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2024-06-13T11:08:06.435 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-13T11:08:06.498 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-13T11:08:06.498 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2024-06-13T11:08:06.521 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-13T11:08:06.585 INFO:teuthology.run_tasks:Running task cephadm... 2024-06-13T11:08:06.678 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-06-13T11:08:06.678 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T11:08:06.679 INFO:tasks.cephadm:Cluster fsid is 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:08:06.679 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-06-13T11:08:06.679 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.2', 'mon.b': '172.21.15.77', 'mon.c': '172.21.15.178'} 2024-06-13T11:08:06.679 INFO:tasks.cephadm:First mon is mon.a on smithi002 2024-06-13T11:08:06.680 INFO:tasks.cephadm:First mgr is x 2024-06-13T11:08:06.680 INFO:tasks.cephadm:Normalizing hostnames... 2024-06-13T11:08:06.680 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname $(hostname -s) 2024-06-13T11:08:06.749 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname $(hostname -s) 2024-06-13T11:08:06.773 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname $(hostname -s) 2024-06-13T11:08:06.796 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-06-13T11:08:06.796 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T11:08:06.940 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/55273/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2946-g3d89accf', 'node_name': '172.21.2.14+braggi14', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2946.g3d89accf'}, 'url': 'https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-30 17:04:17.570799', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-06-13T11:08:07.152 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 3d89accfe3201286f000e065a1faea2a88c7a6ba from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T11:08:07.154 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm 2024-06-13T11:08:07.154 DEBUG:teuthology.orchestra.run.smithi002:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-13T11:08:08.316 INFO:teuthology.orchestra.run.smithi002.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 13 11:08 /home/ubuntu/cephtest/cephadm 2024-06-13T11:08:08.317 DEBUG:teuthology.orchestra.run.smithi077:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-13T11:08:09.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 13 11:08 /home/ubuntu/cephtest/cephadm 2024-06-13T11:08:09.772 DEBUG:teuthology.orchestra.run.smithi178:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-13T11:08:11.050 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 13 11:08 /home/ubuntu/cephtest/cephadm 2024-06-13T11:08:11.051 DEBUG:teuthology.orchestra.run.smithi002:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-13T11:08:11.114 DEBUG:teuthology.orchestra.run.smithi077:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-13T11:08:11.133 DEBUG:teuthology.orchestra.run.smithi178:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-13T11:08:11.167 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba on all hosts... 2024-06-13T11:08:11.168 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-13T11:08:11.173 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-13T11:08:11.175 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-13T11:08:11.976 INFO:teuthology.orchestra.run.smithi178.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-13T11:08:12.001 INFO:teuthology.orchestra.run.smithi077.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-13T11:08:12.399 INFO:teuthology.orchestra.run.smithi002.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-13T11:08:46.392 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-06-13T11:08:46.393 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-13T11:08:46.393 INFO:teuthology.orchestra.run.smithi178.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-13T11:08:46.393 INFO:teuthology.orchestra.run.smithi178.stdout: "repo_digests": [ 2024-06-13T11:08:46.393 INFO:teuthology.orchestra.run.smithi178.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-13T11:08:46.393 INFO:teuthology.orchestra.run.smithi178.stdout: ] 2024-06-13T11:08:46.393 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-06-13T11:08:49.106 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-06-13T11:08:49.106 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-13T11:08:49.106 INFO:teuthology.orchestra.run.smithi077.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-13T11:08:49.106 INFO:teuthology.orchestra.run.smithi077.stdout: "repo_digests": [ 2024-06-13T11:08:49.106 INFO:teuthology.orchestra.run.smithi077.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-13T11:08:49.106 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-06-13T11:08:49.106 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-06-13T11:08:55.885 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:08:55.885 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-13T11:08:55.885 INFO:teuthology.orchestra.run.smithi002.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-13T11:08:55.885 INFO:teuthology.orchestra.run.smithi002.stdout: "repo_digests": [ 2024-06-13T11:08:55.885 INFO:teuthology.orchestra.run.smithi002.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-13T11:08:55.885 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T11:08:55.885 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:08:55.937 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph 2024-06-13T11:08:56.036 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph 2024-06-13T11:08:56.068 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph 2024-06-13T11:08:56.100 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /etc/ceph 2024-06-13T11:08:56.193 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /etc/ceph 2024-06-13T11:08:56.221 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /etc/ceph 2024-06-13T11:08:56.249 INFO:tasks.cephadm:Writing seed config... 2024-06-13T11:08:56.250 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-06-13T11:08:56.250 INFO:tasks.cephadm: override: [client] debug client = 20 2024-06-13T11:08:56.250 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-06-13T11:08:56.250 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-06-13T11:08:56.250 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-06-13T11:08:56.250 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-06-13T11:08:56.251 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-06-13T11:08:56.251 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-06-13T11:08:56.251 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-06-13T11:08:56.251 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-06-13T11:08:56.251 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-06-13T11:08:56.251 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-06-13T11:08:56.251 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-06-13T11:08:56.251 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-06-13T11:08:56.251 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-06-13T11:08:56.251 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-06-13T11:08:56.251 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-06-13T11:08:56.251 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-06-13T11:08:56.251 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-06-13T11:08:56.251 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-06-13T11:08:56.251 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-06-13T11:08:56.252 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-06-13T11:08:56.252 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-06-13T11:08:56.252 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-06-13T11:08:56.252 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-06-13T11:08:56.252 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-06-13T11:08:56.252 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-06-13T11:08:56.252 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-06-13T11:08:56.252 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-06-13T11:08:56.252 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-06-13T11:08:56.252 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-06-13T11:08:56.252 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-06-13T11:08:56.252 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-06-13T11:08:56.252 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-06-13T11:08:56.252 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-06-13T11:08:56.253 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-06-13T11:08:56.253 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-06-13T11:08:56.253 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-06-13T11:08:56.253 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-06-13T11:08:56.253 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-06-13T11:08:56.253 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-06-13T11:08:56.253 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-06-13T11:08:56.253 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-06-13T11:08:56.253 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-06-13T11:08:56.253 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-06-13T11:08:56.253 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-06-13T11:08:56.254 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:08:56.254 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-06-13T11:08:56.314 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 3611563c-2975-11ef-bc9c-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-06-13T11:08:56.314 DEBUG:teuthology.orchestra.run.smithi002:mon.a> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mon.a.service 2024-06-13T11:08:56.362 DEBUG:teuthology.orchestra.run.smithi002:mgr.x> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mgr.x.service 2024-06-13T11:08:56.408 INFO:tasks.cephadm:Bootstrapping... 2024-06-13T11:08:56.408 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba -v bootstrap --fsid 3611563c-2975-11ef-bc9c-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.2 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-06-13T11:08:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-06-13T11:08:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba', '-v', 'bootstrap', '--fsid', '3611563c-2975-11ef-bc9c-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.2', '--skip-admin-label'] 2024-06-13T11:08:56.688 INFO:teuthology.orchestra.run.smithi002.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-06-13T11:08:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying podman|docker is present... 2024-06-13T11:08:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.1.0 2024-06-13T11:08:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying lvm2 is present... 2024-06-13T11:08:56.752 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying time synchronization is in place... 2024-06-13T11:08:56.769 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-13T11:08:56.769 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-13T11:08:56.785 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-13T11:08:56.785 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-06-13T11:08:56.807 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-06-13T11:08:56.826 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-06-13T11:08:56.826 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-06-13T11:08:56.826 INFO:teuthology.orchestra.run.smithi002.stdout:Repeating the final host check... 2024-06-13T11:08:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.1.0 2024-06-13T11:08:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:podman (/bin/podman) version 5.1.0 is present 2024-06-13T11:08:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl is present 2024-06-13T11:08:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:lvcreate is present 2024-06-13T11:08:56.897 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-13T11:08:56.897 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-13T11:08:56.913 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-13T11:08:56.913 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-06-13T11:08:56.930 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-06-13T11:08:56.947 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-06-13T11:08:56.947 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-06-13T11:08:56.948 INFO:teuthology.orchestra.run.smithi002.stdout:Host looks OK 2024-06-13T11:08:56.948 INFO:teuthology.orchestra.run.smithi002.stdout:Cluster fsid: 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:08:56.948 INFO:teuthology.orchestra.run.smithi002.stdout:Acquiring lock 139911096952192 on /run/cephadm/3611563c-2975-11ef-bc9c-c7b262605968.lock 2024-06-13T11:08:56.949 INFO:teuthology.orchestra.run.smithi002.stdout:Lock 139911096952192 acquired on /run/cephadm/3611563c-2975-11ef-bc9c-c7b262605968.lock 2024-06-13T11:08:56.950 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 3300 ... 2024-06-13T11:08:56.951 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 6789 ... 2024-06-13T11:08:56.952 INFO:teuthology.orchestra.run.smithi002.stdout:Base mon IP(s) is [172.21.15.2:3300, 172.21.15.2:6789], mon addrv is [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-06-13T11:08:56.967 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.2 metric 100 2024-06-13T11:08:56.967 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.2 metric 100 2024-06-13T11:08:56.980 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-06-13T11:08:56.980 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-06-13T11:08:56.980 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-06-13T11:08:56.992 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-06-13T11:08:56.992 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-06-13T11:08:56.992 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-13T11:08:56.992 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-06-13T11:08:56.992 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2024-06-13T11:08:56.992 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-13T11:08:56.994 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-06-13T11:08:56.995 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-06-13T11:08:56.995 INFO:teuthology.orchestra.run.smithi002.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-06-13T11:08:56.997 INFO:teuthology.orchestra.run.smithi002.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-06-13T11:08:57.000 INFO:teuthology.orchestra.run.smithi002.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-13T11:08:57.585 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 2024-06-13T11:08:57.585 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-13T11:08:57.585 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Getting image source signatures 2024-06-13T11:08:57.585 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:53b2d4191269e9d20972bfa652565296fad6514cf6a3d99f19db644875f67876 2024-06-13T11:08:57.585 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:3ca969c7b6d79946c6f10490fffc00028babe7df67f50ed53c7bc209325e0612 2024-06-13T11:08:57.586 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying config sha256:b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 2024-06-13T11:08:57.586 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Writing manifest to image destination 2024-06-13T11:08:58.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph: stdout ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-13T11:08:58.840 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph version: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-13T11:08:58.840 INFO:teuthology.orchestra.run.smithi002.stdout:Extracting ceph user uid/gid from container image... 2024-06-13T11:08:59.938 INFO:teuthology.orchestra.run.smithi002.stdout:stat: stdout 167 167 2024-06-13T11:08:59.939 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial keys... 2024-06-13T11:09:00.946 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQBM02pmlUOlFhAACe/JzoA5tDKflRn7vqYntw== 2024-06-13T11:09:02.037 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQBN02pmq6dpGRAAfdmDfmqZfPpgc4xYP6XDDA== 2024-06-13T11:09:03.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQBO02pm891YHxAA+wCJm69KuV3E4tDPnhtK6Q== 2024-06-13T11:09:03.151 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial monmap... 2024-06-13T11:09:04.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-13T11:09:04.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-06-13T11:09:04.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:09:04.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-13T11:09:04.271 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool for a [v2:172.21.15.2:3300,v1:172.21.15.2:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-13T11:09:04.271 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = quincy 2024-06-13T11:09:04.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: set fsid to 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:09:04.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-13T11:09:04.271 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:09:04.272 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mon... 2024-06-13T11:09:05.472 INFO:teuthology.orchestra.run.smithi002.stdout:create mon.a on 2024-06-13T11:09:05.804 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-06-13T11:09:06.060 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-06-13T11:09:06.366 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-3611563c-2975-11ef-bc9c-c7b262605968.target → /etc/systemd/system/ceph-3611563c-2975-11ef-bc9c-c7b262605968.target. 2024-06-13T11:09:06.369 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-3611563c-2975-11ef-bc9c-c7b262605968.target → /etc/systemd/system/ceph-3611563c-2975-11ef-bc9c-c7b262605968.target. 2024-06-13T11:09:06.762 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3611563c-2975-11ef-bc9c-c7b262605968@mon.a 2024-06-13T11:09:06.762 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3611563c-2975-11ef-bc9c-c7b262605968@mon.a.service: Unit ceph-3611563c-2975-11ef-bc9c-c7b262605968@mon.a.service not loaded. 2024-06-13T11:09:07.079 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3611563c-2975-11ef-bc9c-c7b262605968.target.wants/ceph-3611563c-2975-11ef-bc9c-c7b262605968@mon.a.service → /etc/systemd/system/ceph-3611563c-2975-11ef-bc9c-c7b262605968@.service. 2024-06-13T11:09:07.759 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:07 smithi002 podman[31827]: 2024-06-13 11:09:07.748505088 +0000 UTC m=+0.378648485 container init a0a62a6dd42bdb842b955cd68cd7723413d66d6d1b9141da3dd8f17108875172 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-06-13T11:09:07.760 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:07 smithi002 podman[31827]: 2024-06-13 11:09:07.759193628 +0000 UTC m=+0.389336988 container start a0a62a6dd42bdb842b955cd68cd7723413d66d6d1b9141da3dd8f17108875172 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-06-13T11:09:07.887 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-13T11:09:07.887 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-06-13T11:09:07.907 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-13T11:09:07.907 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-06-13T11:09:07.907 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-06-13T11:09:07.907 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-06-13T11:09:07.908 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon to start... 2024-06-13T11:09:07.909 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon... 2024-06-13T11:09:08.056 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:07 smithi002 ceph-mon[31846]: mkfs 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:09:08.057 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:07 smithi002 ceph-mon[31846]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-13T11:09:08.057 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:07 smithi002 bash[31827]: a0a62a6dd42bdb842b955cd68cd7723413d66d6d1b9141da3dd8f17108875172 2024-06-13T11:09:08.057 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:07 smithi002 systemd[1]: Started Ceph mon.a for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:09:09.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:08 smithi002 ceph-mon[31846]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-13T11:09:09.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:08 smithi002 ceph-mon[31846]: monmap epoch 1 2024-06-13T11:09:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:08 smithi002 ceph-mon[31846]: fsid 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:09:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:08 smithi002 ceph-mon[31846]: last_changed 2024-06-13T11:09:03.629613+0000 2024-06-13T11:09:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:08 smithi002 ceph-mon[31846]: created 2024-06-13T11:09:03.629613+0000 2024-06-13T11:09:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:08 smithi002 ceph-mon[31846]: min_mon_release 19 (squid) 2024-06-13T11:09:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:08 smithi002 ceph-mon[31846]: election_strategy: 1 2024-06-13T11:09:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:08 smithi002 ceph-mon[31846]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T11:09:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:08 smithi002 ceph-mon[31846]: fsmap 2024-06-13T11:09:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:08 smithi002 ceph-mon[31846]: osdmap e1: 0 total, 0 up, 0 in 2024-06-13T11:09:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:08 smithi002 ceph-mon[31846]: mgrmap e1: no daemons active 2024-06-13T11:09:09.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:08 smithi002 ceph-mon[31846]: from='client.? 172.21.15.2:0/2368169170' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-06-13T11:09:09.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout cluster: 2024-06-13T11:09:09.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout id: 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:09:09.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-06-13T11:09:09.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T11:09:09.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout services: 2024-06-13T11:09:09.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.753692s) 2024-06-13T11:09:09.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-06-13T11:09:09.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-06-13T11:09:09.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T11:09:09.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout data: 2024-06-13T11:09:09.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-06-13T11:09:09.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-06-13T11:09:09.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-06-13T11:09:09.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pgs: 2024-06-13T11:09:09.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T11:09:09.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.497+0000 7fe5fdc00700 1 Processor -- start 2024-06-13T11:09:09.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.497+0000 7fe5fdc00700 1 -- start start 2024-06-13T11:09:09.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.498+0000 7fe5fdc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5f8106290 0x7fe5f81066b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:09.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.498+0000 7fe5fdc00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f8106c80 con 0x7fe5f8106290 2024-06-13T11:09:09.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.498+0000 7fe5f6a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5f8106290 0x7fe5f81066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:09.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.499+0000 7fe5f6a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5f8106290 0x7fe5f81066b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56182/0 (socket says 172.21.15.2:56182) 2024-06-13T11:09:09.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.499+0000 7fe5f6a00700 1 -- 172.21.15.2:0/3685491475 learned_addr learned my addr 172.21.15.2:0/3685491475 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:09.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.499+0000 7fe5f6a00700 1 -- 172.21.15.2:0/3685491475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f8109220 con 0x7fe5f8106290 2024-06-13T11:09:09.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.499+0000 7fe5f6a00700 1 --2- 172.21.15.2:0/3685491475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5f8106290 0x7fe5f81066b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80098a0 tx=0x7fe5e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffac452f0f491a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:09.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.500+0000 7fe5f5600700 1 -- 172.21.15.2:0/3685491475 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e8004160 con 0x7fe5f8106290 2024-06-13T11:09:09.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.500+0000 7fe5f5600700 1 -- 172.21.15.2:0/3685491475 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e8004300 con 0x7fe5f8106290 2024-06-13T11:09:09.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.500+0000 7fe5f5600700 1 -- 172.21.15.2:0/3685491475 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e80036a0 con 0x7fe5f8106290 2024-06-13T11:09:09.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.500+0000 7fe5fdc00700 1 -- 172.21.15.2:0/3685491475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5f8106290 msgr2=0x7fe5f81066b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:09.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.500+0000 7fe5fdc00700 1 --2- 172.21.15.2:0/3685491475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5f8106290 0x7fe5f81066b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80098a0 tx=0x7fe5e8009bb0 comp rx=0 tx=0).stop 2024-06-13T11:09:09.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.500+0000 7fe5fdc00700 1 -- 172.21.15.2:0/3685491475 shutdown_connections 2024-06-13T11:09:09.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.500+0000 7fe5fdc00700 1 --2- 172.21.15.2:0/3685491475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5f8106290 0x7fe5f81066b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:09.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.500+0000 7fe5fdc00700 1 -- 172.21.15.2:0/3685491475 >> 172.21.15.2:0/3685491475 conn(0x7fe5f8101bc0 msgr2=0x7fe5f8104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:09.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.501+0000 7fe5fdc00700 1 -- 172.21.15.2:0/3685491475 shutdown_connections 2024-06-13T11:09:09.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.501+0000 7fe5fdc00700 1 -- 172.21.15.2:0/3685491475 wait complete. 2024-06-13T11:09:09.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.502+0000 7fe5fdc00700 1 Processor -- start 2024-06-13T11:09:09.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.502+0000 7fe5fdc00700 1 -- start start 2024-06-13T11:09:09.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.502+0000 7fe5fdc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5f8106290 0x7fe5f819d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:09.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.502+0000 7fe5fdc00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f8109750 con 0x7fe5f8106290 2024-06-13T11:09:09.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.503+0000 7fe5f6a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5f8106290 0x7fe5f819d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:09.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.503+0000 7fe5f6a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5f8106290 0x7fe5f819d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56198/0 (socket says 172.21.15.2:56198) 2024-06-13T11:09:09.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.503+0000 7fe5f6a00700 1 -- 172.21.15.2:0/2368169170 learned_addr learned my addr 172.21.15.2:0/2368169170 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:09.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.503+0000 7fe5f6a00700 1 -- 172.21.15.2:0/2368169170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f819ddd0 con 0x7fe5f8106290 2024-06-13T11:09:09.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.503+0000 7fe5f6a00700 1 --2- 172.21.15.2:0/2368169170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5f8106290 0x7fe5f819d890 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8000c00 tx=0x7fe5e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:09.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.504+0000 7fe5ef400700 1 -- 172.21.15.2:0/2368169170 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e8003db0 con 0x7fe5f8106290 2024-06-13T11:09:09.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.504+0000 7fe5ef400700 1 -- 172.21.15.2:0/2368169170 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e8011630 con 0x7fe5f8106290 2024-06-13T11:09:09.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.504+0000 7fe5ef400700 1 -- 172.21.15.2:0/2368169170 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5e8011950 con 0x7fe5f8106290 2024-06-13T11:09:09.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.504+0000 7fe5fdc00700 1 -- 172.21.15.2:0/2368169170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f819e060 con 0x7fe5f8106290 2024-06-13T11:09:09.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.504+0000 7fe5fdc00700 1 -- 172.21.15.2:0/2368169170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f81a0d50 con 0x7fe5f8106290 2024-06-13T11:09:09.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.504+0000 7fe5ef400700 1 -- 172.21.15.2:0/2368169170 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe5e801a460 con 0x7fe5f8106290 2024-06-13T11:09:09.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.504+0000 7fe5ef400700 1 -- 172.21.15.2:0/2368169170 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe5e801b780 con 0x7fe5f8106290 2024-06-13T11:09:09.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.505+0000 7fe5fdc00700 1 -- 172.21.15.2:0/2368169170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f8063af0 con 0x7fe5f8106290 2024-06-13T11:09:09.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.509+0000 7fe5ef400700 1 -- 172.21.15.2:0/2368169170 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe5e8031020 con 0x7fe5f8106290 2024-06-13T11:09:09.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.590+0000 7fe5fdc00700 1 -- 172.21.15.2:0/2368169170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fe5f81a0f20 con 0x7fe5f8106290 2024-06-13T11:09:09.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.590+0000 7fe5ef400700 1 -- 172.21.15.2:0/2368169170 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fe5f81a0f20 con 0x7fe5f8106290 2024-06-13T11:09:09.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.591+0000 7fe5fdc00700 1 -- 172.21.15.2:0/2368169170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5f8106290 msgr2=0x7fe5f819d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:09.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.591+0000 7fe5fdc00700 1 --2- 172.21.15.2:0/2368169170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5f8106290 0x7fe5f819d890 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8000c00 tx=0x7fe5e8004750 comp rx=0 tx=0).stop 2024-06-13T11:09:09.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.592+0000 7fe5fdc00700 1 -- 172.21.15.2:0/2368169170 shutdown_connections 2024-06-13T11:09:09.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.592+0000 7fe5fdc00700 1 --2- 172.21.15.2:0/2368169170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5f8106290 0x7fe5f819d890 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:09.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.592+0000 7fe5fdc00700 1 -- 172.21.15.2:0/2368169170 >> 172.21.15.2:0/2368169170 conn(0x7fe5f8101bc0 msgr2=0x7fe5f81080f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:09.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.592+0000 7fe5fdc00700 1 -- 172.21.15.2:0/2368169170 shutdown_connections 2024-06-13T11:09:09.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:08.592+0000 7fe5fdc00700 1 -- 172.21.15.2:0/2368169170 wait complete. 2024-06-13T11:09:09.273 INFO:teuthology.orchestra.run.smithi002.stdout:mon is available 2024-06-13T11:09:09.273 INFO:teuthology.orchestra.run.smithi002.stdout:Assimilating anything we can from ceph.conf... 2024-06-13T11:09:10.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:10 smithi002 ceph-mon[31846]: from='client.? 172.21.15.2:0/3616335315' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-13T11:09:10.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:10 smithi002 ceph-mon[31846]: from='client.? 172.21.15.2:0/3616335315' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-06-13T11:09:10.631 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T11:09:10.631 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-06-13T11:09:10.631 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:09:10.631 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-06-13T11:09:10.631 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-13T11:09:10.631 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-13T11:09:10.631 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-13T11:09:10.631 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-13T11:09:10.631 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T11:09:10.631 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-13T11:09:10.632 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-13T11:09:10.632 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T11:09:10.632 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-06-13T11:09:10.632 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-13T11:09:10.632 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-13T11:09:10.632 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-13T11:09:10.632 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-13T11:09:10.632 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-13T11:09:10.632 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.878+0000 7f064da00700 1 Processor -- start 2024-06-13T11:09:10.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.878+0000 7f064da00700 1 -- start start 2024-06-13T11:09:10.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.879+0000 7f064da00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f064810a130 0x7f064810a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:10.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.879+0000 7f064da00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f064810ab20 con 0x7f064810a130 2024-06-13T11:09:10.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.880+0000 7f0646a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f064810a130 0x7f064810a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:10.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.880+0000 7f0646a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f064810a130 0x7f064810a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56206/0 (socket says 172.21.15.2:56206) 2024-06-13T11:09:10.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.880+0000 7f0646a00700 1 -- 172.21.15.2:0/2201091536 learned_addr learned my addr 172.21.15.2:0/2201091536 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:10.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.880+0000 7f0646a00700 1 -- 172.21.15.2:0/2201091536 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064810b390 con 0x7f064810a130 2024-06-13T11:09:10.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.881+0000 7f0646a00700 1 --2- 172.21.15.2:0/2201091536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f064810a130 0x7f064810a550 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f06380098a0 tx=0x7f0638009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d913f759f87ab1 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:10.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.881+0000 7f0646000700 1 -- 172.21.15.2:0/2201091536 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0638004160 con 0x7f064810a130 2024-06-13T11:09:10.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.881+0000 7f0646000700 1 -- 172.21.15.2:0/2201091536 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0638004300 con 0x7f064810a130 2024-06-13T11:09:10.633 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.881+0000 7f0646000700 1 -- 172.21.15.2:0/2201091536 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06380036a0 con 0x7f064810a130 2024-06-13T11:09:10.634 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.882+0000 7f064da00700 1 -- 172.21.15.2:0/2201091536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f064810a130 msgr2=0x7f064810a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:10.634 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.882+0000 7f064da00700 1 --2- 172.21.15.2:0/2201091536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f064810a130 0x7f064810a550 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f06380098a0 tx=0x7f0638009bb0 comp rx=0 tx=0).stop 2024-06-13T11:09:10.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.882+0000 7f064da00700 1 -- 172.21.15.2:0/2201091536 shutdown_connections 2024-06-13T11:09:10.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.882+0000 7f064da00700 1 --2- 172.21.15.2:0/2201091536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f064810a130 0x7f064810a550 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:10.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.882+0000 7f064da00700 1 -- 172.21.15.2:0/2201091536 >> 172.21.15.2:0/2201091536 conn(0x7f064807d6e0 msgr2=0x7f064807daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:10.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.882+0000 7f064da00700 1 -- 172.21.15.2:0/2201091536 shutdown_connections 2024-06-13T11:09:10.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.882+0000 7f064da00700 1 -- 172.21.15.2:0/2201091536 wait complete. 2024-06-13T11:09:10.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.883+0000 7f064da00700 1 Processor -- start 2024-06-13T11:09:10.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.883+0000 7f064da00700 1 -- start start 2024-06-13T11:09:10.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.884+0000 7f064da00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f064810a130 0x7f064819d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:10.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.884+0000 7f064da00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f064810b8c0 con 0x7f064810a130 2024-06-13T11:09:10.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.884+0000 7f0646a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f064810a130 0x7f064819d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:10.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.884+0000 7f0646a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f064810a130 0x7f064819d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56222/0 (socket says 172.21.15.2:56222) 2024-06-13T11:09:10.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.884+0000 7f0646a00700 1 -- 172.21.15.2:0/3616335315 learned_addr learned my addr 172.21.15.2:0/3616335315 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:10.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.884+0000 7f0646a00700 1 -- 172.21.15.2:0/3616335315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064819dd70 con 0x7f064810a130 2024-06-13T11:09:10.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.885+0000 7f0646a00700 1 --2- 172.21.15.2:0/3616335315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f064810a130 0x7f064819d830 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0638000c00 tx=0x7f0638004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:10.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.885+0000 7f063f400700 1 -- 172.21.15.2:0/3616335315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0638003db0 con 0x7f064810a130 2024-06-13T11:09:10.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.885+0000 7f063f400700 1 -- 172.21.15.2:0/3616335315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0638011630 con 0x7f064810a130 2024-06-13T11:09:10.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.885+0000 7f063f400700 1 -- 172.21.15.2:0/3616335315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0638011950 con 0x7f064810a130 2024-06-13T11:09:10.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.885+0000 7f064da00700 1 -- 172.21.15.2:0/3616335315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064819e000 con 0x7f064810a130 2024-06-13T11:09:10.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.886+0000 7f064da00700 1 -- 172.21.15.2:0/3616335315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06481a0ca0 con 0x7f064810a130 2024-06-13T11:09:10.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.886+0000 7f063f400700 1 -- 172.21.15.2:0/3616335315 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0638011af0 con 0x7f064810a130 2024-06-13T11:09:10.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.886+0000 7f063f400700 1 -- 172.21.15.2:0/3616335315 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f063801c450 con 0x7f064810a130 2024-06-13T11:09:10.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.887+0000 7f064da00700 1 -- 172.21.15.2:0/3616335315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0648063af0 con 0x7f064810a130 2024-06-13T11:09:10.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.890+0000 7f063f400700 1 -- 172.21.15.2:0/3616335315 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0638032020 con 0x7f064810a130 2024-06-13T11:09:10.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.968+0000 7f064da00700 1 -- 172.21.15.2:0/3616335315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f064802de20 con 0x7f064810a130 2024-06-13T11:09:10.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.975+0000 7f063f400700 1 -- 172.21.15.2:0/3616335315 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+427 (secure 0 0 0) 0x7f0638004260 con 0x7f064810a130 2024-06-13T11:09:10.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.977+0000 7f064da00700 1 -- 172.21.15.2:0/3616335315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f064810a130 msgr2=0x7f064819d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:10.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.977+0000 7f064da00700 1 --2- 172.21.15.2:0/3616335315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f064810a130 0x7f064819d830 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0638000c00 tx=0x7f0638004750 comp rx=0 tx=0).stop 2024-06-13T11:09:10.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.977+0000 7f064da00700 1 -- 172.21.15.2:0/3616335315 shutdown_connections 2024-06-13T11:09:10.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.977+0000 7f064da00700 1 --2- 172.21.15.2:0/3616335315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f064810a130 0x7f064819d830 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:10.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.977+0000 7f064da00700 1 -- 172.21.15.2:0/3616335315 >> 172.21.15.2:0/3616335315 conn(0x7f064807d6e0 msgr2=0x7f0648194450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:10.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.978+0000 7f064da00700 1 -- 172.21.15.2:0/3616335315 shutdown_connections 2024-06-13T11:09:10.640 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:09.978+0000 7f064da00700 1 -- 172.21.15.2:0/3616335315 wait complete. 2024-06-13T11:09:10.640 INFO:teuthology.orchestra.run.smithi002.stdout:Generating new minimal ceph.conf... 2024-06-13T11:09:11.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:11 smithi002 ceph-mon[31846]: from='client.? 172.21.15.2:0/4133341680' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:09:11.957 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.223+0000 7fd3cca00700 1 Processor -- start 2024-06-13T11:09:11.957 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.223+0000 7fd3cca00700 1 -- start start 2024-06-13T11:09:11.957 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.223+0000 7fd3cca00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c810a170 0x7fd3c810a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:11.957 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.224+0000 7fd3cca00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c810ab60 con 0x7fd3c810a170 2024-06-13T11:09:11.957 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.224+0000 7fd3c5e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c810a170 0x7fd3c810a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:11.957 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.224+0000 7fd3c5e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c810a170 0x7fd3c810a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56232/0 (socket says 172.21.15.2:56232) 2024-06-13T11:09:11.957 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.224+0000 7fd3c5e00700 1 -- 172.21.15.2:0/2111803171 learned_addr learned my addr 172.21.15.2:0/2111803171 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:11.957 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.224+0000 7fd3c5e00700 1 -- 172.21.15.2:0/2111803171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c810b3c0 con 0x7fd3c810a170 2024-06-13T11:09:11.958 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.225+0000 7fd3c5e00700 1 --2- 172.21.15.2:0/2111803171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c810a170 0x7fd3c810a590 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80098a0 tx=0x7fd3b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173c1a03f8afeaa4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:11.958 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.225+0000 7fd3c5400700 1 -- 172.21.15.2:0/2111803171 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3b8004160 con 0x7fd3c810a170 2024-06-13T11:09:11.958 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.225+0000 7fd3c5400700 1 -- 172.21.15.2:0/2111803171 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd3b8004300 con 0x7fd3c810a170 2024-06-13T11:09:11.958 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.225+0000 7fd3c5400700 1 -- 172.21.15.2:0/2111803171 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3b8011b50 con 0x7fd3c810a170 2024-06-13T11:09:11.958 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.226+0000 7fd3cca00700 1 -- 172.21.15.2:0/2111803171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c810a170 msgr2=0x7fd3c810a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:11.958 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.226+0000 7fd3cca00700 1 --2- 172.21.15.2:0/2111803171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c810a170 0x7fd3c810a590 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80098a0 tx=0x7fd3b8009bb0 comp rx=0 tx=0).stop 2024-06-13T11:09:11.958 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.226+0000 7fd3cca00700 1 -- 172.21.15.2:0/2111803171 shutdown_connections 2024-06-13T11:09:11.958 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.226+0000 7fd3cca00700 1 --2- 172.21.15.2:0/2111803171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c810a170 0x7fd3c810a590 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:11.958 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.226+0000 7fd3cca00700 1 -- 172.21.15.2:0/2111803171 >> 172.21.15.2:0/2111803171 conn(0x7fd3c807d6e0 msgr2=0x7fd3c807db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:11.958 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.226+0000 7fd3cca00700 1 -- 172.21.15.2:0/2111803171 shutdown_connections 2024-06-13T11:09:11.958 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.226+0000 7fd3cca00700 1 -- 172.21.15.2:0/2111803171 wait complete. 2024-06-13T11:09:11.958 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.227+0000 7fd3cca00700 1 Processor -- start 2024-06-13T11:09:11.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.228+0000 7fd3cca00700 1 -- start start 2024-06-13T11:09:11.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.228+0000 7fd3cca00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c810a170 0x7fd3c819e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:11.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.228+0000 7fd3cca00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c810e5f0 con 0x7fd3c810a170 2024-06-13T11:09:11.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.228+0000 7fd3c5e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c810a170 0x7fd3c819e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:11.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.228+0000 7fd3c5e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c810a170 0x7fd3c819e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56246/0 (socket says 172.21.15.2:56246) 2024-06-13T11:09:11.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.228+0000 7fd3c5e00700 1 -- 172.21.15.2:0/4133341680 learned_addr learned my addr 172.21.15.2:0/4133341680 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:11.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.229+0000 7fd3c5e00700 1 -- 172.21.15.2:0/4133341680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c819e630 con 0x7fd3c810a170 2024-06-13T11:09:11.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.229+0000 7fd3c5e00700 1 --2- 172.21.15.2:0/4133341680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c810a170 0x7fd3c819e0f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8011b60 tx=0x7fd3b8011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:11.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.229+0000 7fd3bea00700 1 -- 172.21.15.2:0/4133341680 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3b8003970 con 0x7fd3c810a170 2024-06-13T11:09:11.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.229+0000 7fd3bea00700 1 -- 172.21.15.2:0/4133341680 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd3b8003b10 con 0x7fd3c810a170 2024-06-13T11:09:11.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.229+0000 7fd3bea00700 1 -- 172.21.15.2:0/4133341680 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3b8024580 con 0x7fd3c810a170 2024-06-13T11:09:11.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.229+0000 7fd3cca00700 1 -- 172.21.15.2:0/4133341680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c819e8c0 con 0x7fd3c810a170 2024-06-13T11:09:11.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.229+0000 7fd3cca00700 1 -- 172.21.15.2:0/4133341680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c81a15b0 con 0x7fd3c810a170 2024-06-13T11:09:11.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.230+0000 7fd3bea00700 1 -- 172.21.15.2:0/4133341680 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd3b8024bc0 con 0x7fd3c810a170 2024-06-13T11:09:11.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.230+0000 7fd3bea00700 1 -- 172.21.15.2:0/4133341680 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd3b8011e00 con 0x7fd3c810a170 2024-06-13T11:09:11.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.231+0000 7fd3cca00700 1 -- 172.21.15.2:0/4133341680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3c810e770 con 0x7fd3c810a170 2024-06-13T11:09:11.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.234+0000 7fd3bea00700 1 -- 172.21.15.2:0/4133341680 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd3b8043dd0 con 0x7fd3c810a170 2024-06-13T11:09:11.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.312+0000 7fd3cca00700 1 -- 172.21.15.2:0/4133341680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fd3c8063af0 con 0x7fd3c810a170 2024-06-13T11:09:11.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.312+0000 7fd3bea00700 1 -- 172.21.15.2:0/4133341680 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7fd3b8032020 con 0x7fd3c810a170 2024-06-13T11:09:11.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.314+0000 7fd3cca00700 1 -- 172.21.15.2:0/4133341680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c810a170 msgr2=0x7fd3c819e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:11.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.314+0000 7fd3cca00700 1 --2- 172.21.15.2:0/4133341680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c810a170 0x7fd3c819e0f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8011b60 tx=0x7fd3b8011c40 comp rx=0 tx=0).stop 2024-06-13T11:09:11.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.314+0000 7fd3cca00700 1 -- 172.21.15.2:0/4133341680 shutdown_connections 2024-06-13T11:09:11.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.314+0000 7fd3cca00700 1 --2- 172.21.15.2:0/4133341680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c810a170 0x7fd3c819e0f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:11.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.314+0000 7fd3cca00700 1 -- 172.21.15.2:0/4133341680 >> 172.21.15.2:0/4133341680 conn(0x7fd3c807d6e0 msgr2=0x7fd3c8107d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:11.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.314+0000 7fd3cca00700 1 -- 172.21.15.2:0/4133341680 shutdown_connections 2024-06-13T11:09:11.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:11.314+0000 7fd3cca00700 1 -- 172.21.15.2:0/4133341680 wait complete. 2024-06-13T11:09:11.961 INFO:teuthology.orchestra.run.smithi002.stdout:Restarting the monitor... 2024-06-13T11:09:12.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:11 smithi002 systemd[1]: Stopping Ceph mon.a for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:09:12.814 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:12 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a[31842]: 2024-06-13T11:09:12.484+0000 7fd4e5200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:09:12.815 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:12 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a[31842]: 2024-06-13T11:09:12.484+0000 7fd4e5200700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-06-13T11:09:12.815 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:12 smithi002 podman[32091]: 2024-06-13 11:09:12.567366286 +0000 UTC m=+0.217445566 container died a0a62a6dd42bdb842b955cd68cd7723413d66d6d1b9141da3dd8f17108875172 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:09:13.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:12 smithi002 podman[32091]: 2024-06-13 11:09:12.926737676 +0000 UTC m=+0.576816949 container cleanup a0a62a6dd42bdb842b955cd68cd7723413d66d6d1b9141da3dd8f17108875172 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-06-13T11:09:13.102 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:12 smithi002 bash[32091]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a 2024-06-13T11:09:13.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:13 smithi002 podman[32103]: 2024-06-13 11:09:13.102478645 +0000 UTC m=+0.517117830 container remove a0a62a6dd42bdb842b955cd68cd7723413d66d6d1b9141da3dd8f17108875172 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:09:13.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:13 smithi002 systemd[1]: ceph-3611563c-2975-11ef-bc9c-c7b262605968@mon.a.service: Deactivated successfully. 2024-06-13T11:09:13.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:13 smithi002 systemd[1]: Stopped Ceph mon.a for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:09:13.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:13 smithi002 systemd[1]: ceph-3611563c-2975-11ef-bc9c-c7b262605968@mon.a.service: Consumed 1.949s CPU time. 2024-06-13T11:09:13.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:13 smithi002 systemd[1]: Starting Ceph mon.a for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:09:14.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:13 smithi002 podman[32192]: 2024-06-13 11:09:13.870182219 +0000 UTC m=+0.033028992 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T11:09:19.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:18 smithi002 podman[32192]: 2024-06-13 11:09:18.746147802 +0000 UTC m=+4.908994613 container create 1e16928c773b1282405e332223cd653c2f6dd7122075faf6cbe7f59b91600652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:09:22.766 INFO:teuthology.orchestra.run.smithi002.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-06-13T11:09:23.027 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 podman[32192]: 2024-06-13 11:09:22.66436047 +0000 UTC m=+8.827207328 container init 1e16928c773b1282405e332223cd653c2f6dd7122075faf6cbe7f59b91600652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5) 2024-06-13T11:09:23.027 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 podman[32192]: 2024-06-13 11:09:22.675572266 +0000 UTC m=+8.838419080 container start 1e16928c773b1282405e332223cd653c2f6dd7122075faf6cbe7f59b91600652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-06-13T11:09:23.027 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: set uid:gid to 167:167 (ceph:ceph) 2024-06-13T11:09:23.027 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc), process ceph-mon, pid 2 2024-06-13T11:09:23.027 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: pidfile_write: ignore empty --pid-file 2024-06-13T11:09:23.027 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: load: jerasure load: lrc 2024-06-13T11:09:23.027 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: RocksDB version: 7.9.2 2024-06-13T11:09:23.027 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Git sha 0 2024-06-13T11:09:23.028 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Compile date 2024-05-30 15:42:47 2024-06-13T11:09:23.028 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: DB SUMMARY 2024-06-13T11:09:23.028 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: DB Session ID: 35XNWH1L7ENCV8XY2ZIB 2024-06-13T11:09:23.028 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: CURRENT file: CURRENT 2024-06-13T11:09:23.028 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: IDENTITY file: IDENTITY 2024-06-13T11:09:23.028 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-06-13T11:09:23.028 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-06-13T11:09:23.028 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104694 ; 2024-06-13T11:09:23.028 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.error_if_exists: 0 2024-06-13T11:09:23.028 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.create_if_missing: 0 2024-06-13T11:09:23.028 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.paranoid_checks: 1 2024-06-13T11:09:23.028 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-13T11:09:23.029 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-13T11:09:23.029 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-13T11:09:23.029 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.env: 0x5642664bbc60 2024-06-13T11:09:23.029 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.fs: PosixFileSystem 2024-06-13T11:09:23.029 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.info_log: 0x56426f7b1b60 2024-06-13T11:09:23.029 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_file_opening_threads: 16 2024-06-13T11:09:23.029 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.statistics: (nil) 2024-06-13T11:09:23.030 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.use_fsync: 0 2024-06-13T11:09:23.030 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_log_file_size: 0 2024-06-13T11:09:23.030 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-13T11:09:23.030 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-13T11:09:23.030 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.keep_log_file_num: 1000 2024-06-13T11:09:23.030 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.recycle_log_file_num: 0 2024-06-13T11:09:23.030 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.allow_fallocate: 1 2024-06-13T11:09:23.030 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.allow_mmap_reads: 0 2024-06-13T11:09:23.030 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.allow_mmap_writes: 0 2024-06-13T11:09:23.030 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.use_direct_reads: 0 2024-06-13T11:09:23.030 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-13T11:09:23.030 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.create_missing_column_families: 0 2024-06-13T11:09:23.031 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.db_log_dir: 2024-06-13T11:09:23.031 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.wal_dir: 2024-06-13T11:09:23.031 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-13T11:09:23.031 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-13T11:09:23.031 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-13T11:09:23.031 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-13T11:09:23.031 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-13T11:09:23.031 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-13T11:09:23.031 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.advise_random_on_open: 1 2024-06-13T11:09:23.031 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.db_write_buffer_size: 0 2024-06-13T11:09:23.031 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.write_buffer_manager: 0x56426f7821e0 2024-06-13T11:09:23.032 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-13T11:09:23.032 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-13T11:09:23.032 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-13T11:09:23.032 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.rate_limiter: (nil) 2024-06-13T11:09:23.032 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-13T11:09:23.032 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.wal_recovery_mode: 2 2024-06-13T11:09:23.032 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.enable_thread_tracking: 0 2024-06-13T11:09:23.032 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.enable_pipelined_write: 0 2024-06-13T11:09:23.032 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.unordered_write: 0 2024-06-13T11:09:23.032 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-13T11:09:23.032 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-13T11:09:23.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-13T11:09:23.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-13T11:09:23.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.row_cache: None 2024-06-13T11:09:23.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.wal_filter: None 2024-06-13T11:09:23.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-13T11:09:23.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.allow_ingest_behind: 0 2024-06-13T11:09:23.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.two_write_queues: 0 2024-06-13T11:09:23.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.manual_wal_flush: 0 2024-06-13T11:09:23.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.wal_compression: 0 2024-06-13T11:09:23.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.atomic_flush: 0 2024-06-13T11:09:23.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-13T11:09:23.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-13T11:09:23.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-13T11:09:23.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.log_readahead_size: 0 2024-06-13T11:09:23.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-13T11:09:23.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.best_efforts_recovery: 0 2024-06-13T11:09:23.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-13T11:09:23.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-13T11:09:23.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.allow_data_in_errors: 0 2024-06-13T11:09:23.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.db_host_id: __hostname__ 2024-06-13T11:09:23.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-13T11:09:23.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_background_jobs: 2 2024-06-13T11:09:23.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_background_compactions: -1 2024-06-13T11:09:23.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_subcompactions: 1 2024-06-13T11:09:23.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-13T11:09:23.034 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-13T11:09:23.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-13T11:09:23.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_total_wal_size: 0 2024-06-13T11:09:23.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-13T11:09:23.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-13T11:09:23.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-13T11:09:23.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-13T11:09:23.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_open_files: -1 2024-06-13T11:09:23.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.bytes_per_sync: 0 2024-06-13T11:09:23.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-13T11:09:23.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-13T11:09:23.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compaction_readahead_size: 0 2024-06-13T11:09:23.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_background_flushes: -1 2024-06-13T11:09:23.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Compression algorithms supported: 2024-06-13T11:09:23.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-13T11:09:23.036 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: kZSTD supported: 0 2024-06-13T11:09:23.036 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: kXpressCompression supported: 0 2024-06-13T11:09:23.036 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: kLZ4HCCompression supported: 1 2024-06-13T11:09:23.036 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: kZlibCompression supported: 1 2024-06-13T11:09:23.036 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: kSnappyCompression supported: 1 2024-06-13T11:09:23.036 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: kLZ4Compression supported: 1 2024-06-13T11:09:23.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: kBZip2Compression supported: 0 2024-06-13T11:09:23.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-13T11:09:23.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-13T11:09:23.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-06-13T11:09:23.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-13T11:09:23.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-13T11:09:23.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.merge_operator: 2024-06-13T11:09:23.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compaction_filter: None 2024-06-13T11:09:23.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compaction_filter_factory: None 2024-06-13T11:09:23.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.sst_partitioner_factory: None 2024-06-13T11:09:23.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-13T11:09:23.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-13T11:09:23.038 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56426f7b1c80) 2024-06-13T11:09:23.038 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks: 1 2024-06-13T11:09:23.038 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-13T11:09:23.038 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-13T11:09:23.038 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_top_level_index_and_filter: 1 2024-06-13T11:09:23.038 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_type: 0 2024-06-13T11:09:23.038 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_index_type: 0 2024-06-13T11:09:23.038 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_shortening: 1 2024-06-13T11:09:23.039 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-13T11:09:23.039 INFO:journalctl@ceph.mon.a.smithi002.stdout: checksum: 4 2024-06-13T11:09:23.039 INFO:journalctl@ceph.mon.a.smithi002.stdout: no_block_cache: 0 2024-06-13T11:09:23.039 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache: 0x56426f7b3090 2024-06-13T11:09:23.039 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_name: BinnedLRUCache 2024-06-13T11:09:23.039 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_options: 2024-06-13T11:09:23.039 INFO:journalctl@ceph.mon.a.smithi002.stdout: capacity : 536870912 2024-06-13T11:09:23.039 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_shard_bits : 4 2024-06-13T11:09:23.039 INFO:journalctl@ceph.mon.a.smithi002.stdout: strict_capacity_limit : 0 2024-06-13T11:09:23.039 INFO:journalctl@ceph.mon.a.smithi002.stdout: high_pri_pool_ratio: 0.000 2024-06-13T11:09:23.039 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_compressed: (nil) 2024-06-13T11:09:23.039 INFO:journalctl@ceph.mon.a.smithi002.stdout: persistent_cache: (nil) 2024-06-13T11:09:23.039 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size: 4096 2024-06-13T11:09:23.039 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size_deviation: 10 2024-06-13T11:09:23.040 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_restart_interval: 16 2024-06-13T11:09:23.040 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_block_restart_interval: 1 2024-06-13T11:09:23.040 INFO:journalctl@ceph.mon.a.smithi002.stdout: metadata_block_size: 4096 2024-06-13T11:09:23.040 INFO:journalctl@ceph.mon.a.smithi002.stdout: partition_filters: 0 2024-06-13T11:09:23.040 INFO:journalctl@ceph.mon.a.smithi002.stdout: use_delta_encoding: 1 2024-06-13T11:09:23.040 INFO:journalctl@ceph.mon.a.smithi002.stdout: filter_policy: bloomfilter 2024-06-13T11:09:23.040 INFO:journalctl@ceph.mon.a.smithi002.stdout: whole_key_filtering: 1 2024-06-13T11:09:23.040 INFO:journalctl@ceph.mon.a.smithi002.stdout: verify_compression: 0 2024-06-13T11:09:23.040 INFO:journalctl@ceph.mon.a.smithi002.stdout: read_amp_bytes_per_bit: 0 2024-06-13T11:09:23.040 INFO:journalctl@ceph.mon.a.smithi002.stdout: format_version: 5 2024-06-13T11:09:23.040 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_index_compression: 1 2024-06-13T11:09:23.040 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_align: 0 2024-06-13T11:09:23.040 INFO:journalctl@ceph.mon.a.smithi002.stdout: max_auto_readahead_size: 262144 2024-06-13T11:09:23.041 INFO:journalctl@ceph.mon.a.smithi002.stdout: prepopulate_block_cache: 0 2024-06-13T11:09:23.041 INFO:journalctl@ceph.mon.a.smithi002.stdout: initial_auto_readahead_size: 8192 2024-06-13T11:09:23.041 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_file_reads_for_auto_readahead: 2 2024-06-13T11:09:23.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.write_buffer_size: 33554432 2024-06-13T11:09:23.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_write_buffer_number: 2 2024-06-13T11:09:23.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compression: NoCompression 2024-06-13T11:09:23.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.bottommost_compression: Disabled 2024-06-13T11:09:23.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.prefix_extractor: nullptr 2024-06-13T11:09:23.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-13T11:09:23.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.num_levels: 7 2024-06-13T11:09:23.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-13T11:09:23.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-13T11:09:23.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-13T11:09:23.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-13T11:09:23.042 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-13T11:09:23.042 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-13T11:09:23.042 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-13T11:09:23.042 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-13T11:09:23.042 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-13T11:09:23.042 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-13T11:09:23.042 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-13T11:09:23.042 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-13T11:09:23.042 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-13T11:09:23.042 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compression_opts.level: 32767 2024-06-13T11:09:23.042 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compression_opts.strategy: 0 2024-06-13T11:09:23.042 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-13T11:09:23.042 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-13T11:09:23.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-13T11:09:23.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-13T11:09:23.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compression_opts.enabled: false 2024-06-13T11:09:23.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-13T11:09:23.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-13T11:09:23.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-13T11:09:23.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-13T11:09:23.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.target_file_size_base: 67108864 2024-06-13T11:09:23.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-13T11:09:23.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-13T11:09:23.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-13T11:09:23.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-13T11:09:23.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-13T11:09:23.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-13T11:09:23.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-13T11:09:23.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-13T11:09:23.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-13T11:09:23.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-13T11:09:23.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-13T11:09:23.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-13T11:09:23.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-13T11:09:23.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-13T11:09:23.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.arena_block_size: 1048576 2024-06-13T11:09:23.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-13T11:09:23.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-13T11:09:23.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.disable_auto_compactions: 0 2024-06-13T11:09:23.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-13T11:09:23.045 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-13T11:09:23.045 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-13T11:09:23.045 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-13T11:09:23.045 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-13T11:09:23.045 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-13T11:09:23.045 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-13T11:09:23.045 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-13T11:09:23.045 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-13T11:09:23.045 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-13T11:09:23.045 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.table_properties_collectors: 2024-06-13T11:09:23.045 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.inplace_update_support: 0 2024-06-13T11:09:23.045 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-13T11:09:23.045 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-13T11:09:23.045 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-13T11:09:23.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-13T11:09:23.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.bloom_locality: 0 2024-06-13T11:09:23.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.max_successive_merges: 0 2024-06-13T11:09:23.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-13T11:09:23.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.paranoid_file_checks: 0 2024-06-13T11:09:23.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.force_consistency_checks: 1 2024-06-13T11:09:23.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.report_bg_io_stats: 0 2024-06-13T11:09:23.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.ttl: 2592000 2024-06-13T11:09:23.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-13T11:09:23.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-13T11:09:23.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-13T11:09:23.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.enable_blob_files: false 2024-06-13T11:09:23.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.min_blob_size: 0 2024-06-13T11:09:23.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.blob_file_size: 268435456 2024-06-13T11:09:23.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-13T11:09:23.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-13T11:09:23.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-13T11:09:23.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-13T11:09:23.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-13T11:09:23.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.blob_file_starting_level: 0 2024-06-13T11:09:23.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-13T11:09:23.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-06-13T11:09:23.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-06-13T11:09:23.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ea8b603a-fad0-4234-b75f-85fd44e89452 2024-06-13T11:09:23.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718276962734171, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-06-13T11:09:23.048 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-06-13T11:09:23.048 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718276962736403, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99783, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 97695, "index_size": 306, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14165, "raw_average_key_size": 49, "raw_value_size": 90034, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1718276962, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ea8b603a-fad0-4234-b75f-85fd44e89452", "db_session_id": "35XNWH1L7ENCV8XY2ZIB", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-06-13T11:09:23.048 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718276962736589, "job": 1, "event": "recovery_finished"} 2024-06-13T11:09:23.048 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-06-13T11:09:23.048 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-13T11:09:23.048 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56426f8a2000 2024-06-13T11:09:23.048 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: DB pointer 0x56426f88c000 2024-06-13T11:09:23.048 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-13T11:09:23.048 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-13T11:09:23.048 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** DB Stats ** 2024-06-13T11:09:23.048 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-13T11:09:23.048 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-13T11:09:23.048 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-13T11:09:23.049 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-13T11:09:23.049 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-13T11:09:23.049 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-13T11:09:23.049 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-13T11:09:23.049 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-06-13T11:09:23.049 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-06-13T11:09:23.049 INFO:journalctl@ceph.mon.a.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-13T11:09:23.049 INFO:journalctl@ceph.mon.a.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-13T11:09:23.049 INFO:journalctl@ceph.mon.a.smithi002.stdout: L0 2/0 99.28 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 61.7 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-06-13T11:09:23.049 INFO:journalctl@ceph.mon.a.smithi002.stdout: Sum 2/0 99.28 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 61.7 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-06-13T11:09:23.049 INFO:journalctl@ceph.mon.a.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 61.7 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-06-13T11:09:23.049 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-06-13T11:09:23.049 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-06-13T11:09:23.050 INFO:journalctl@ceph.mon.a.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-13T11:09:23.050 INFO:journalctl@ceph.mon.a.smithi002.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-13T11:09:23.050 INFO:journalctl@ceph.mon.a.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 61.7 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-06-13T11:09:23.050 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-06-13T11:09:23.050 INFO:journalctl@ceph.mon.a.smithi002.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-13T11:09:23.050 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-06-13T11:09:23.050 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-13T11:09:23.050 INFO:journalctl@ceph.mon.a.smithi002.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-13T11:09:23.050 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-13T11:09:23.050 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-13T11:09:23.050 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-13T11:09:23.050 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-13T11:09:23.050 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative compaction: 0.00 GB write, 12.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-13T11:09:23.051 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval compaction: 0.00 GB write, 12.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-13T11:09:23.051 INFO:journalctl@ceph.mon.a.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-13T11:09:23.051 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache BinnedLRUCache@0x56426f7b3090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.2e-05 secs_since: 0 2024-06-13T11:09:23.051 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-06-13T11:09:23.051 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-06-13T11:09:23.051 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-13T11:09:23.051 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: starting mon.a rank 0 at public addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] at bind addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:09:23.051 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: mon.a@-1(???) e1 preinit fsid 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:09:23.051 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: mon.a@-1(???).mds e1 new map 2024-06-13T11:09:23.051 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: mon.a@-1(???).mds e1 print_map 2024-06-13T11:09:23.051 INFO:journalctl@ceph.mon.a.smithi002.stdout: e1 2024-06-13T11:09:23.051 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-13T11:09:23.051 INFO:journalctl@ceph.mon.a.smithi002.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-13T11:09:23.052 INFO:journalctl@ceph.mon.a.smithi002.stdout: legacy client fscid: -1 2024-06-13T11:09:23.052 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-06-13T11:09:23.052 INFO:journalctl@ceph.mon.a.smithi002.stdout: No filesystems configured 2024-06-13T11:09:23.052 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-13T11:09:23.052 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T11:09:23.052 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T11:09:23.052 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T11:09:23.052 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-06-13T11:09:23.052 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 bash[32192]: 1e16928c773b1282405e332223cd653c2f6dd7122075faf6cbe7f59b91600652 2024-06-13T11:09:23.052 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 systemd[1]: Started Ceph mon.a for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:09:23.052 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-13T11:09:23.052 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: monmap epoch 1 2024-06-13T11:09:23.052 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: fsid 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:09:23.053 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: last_changed 2024-06-13T11:09:03.629613+0000 2024-06-13T11:09:23.053 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: created 2024-06-13T11:09:03.629613+0000 2024-06-13T11:09:23.053 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: min_mon_release 19 (squid) 2024-06-13T11:09:23.053 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: election_strategy: 1 2024-06-13T11:09:23.053 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T11:09:23.053 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: fsmap 2024-06-13T11:09:23.053 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: osdmap e1: 0 total, 0 up, 0 in 2024-06-13T11:09:23.053 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:22 smithi002 ceph-mon[32210]: mgrmap e1: no daemons active 2024-06-13T11:09:24.043 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.335+0000 7f892d600700 1 Processor -- start 2024-06-13T11:09:24.043 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.335+0000 7f892d600700 1 -- start start 2024-06-13T11:09:24.043 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.335+0000 7f892d600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f892810a170 0x7f892810a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:24.044 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.335+0000 7f892d600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f892810ab60 con 0x7f892810a170 2024-06-13T11:09:24.044 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.336+0000 7f8926a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f892810a170 0x7f892810a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:24.044 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.336+0000 7f8926a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f892810a170 0x7f892810a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40208/0 (socket says 172.21.15.2:40208) 2024-06-13T11:09:24.044 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.336+0000 7f8926a00700 1 -- 172.21.15.2:0/286473931 learned_addr learned my addr 172.21.15.2:0/286473931 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:24.044 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.337+0000 7f8926a00700 1 -- 172.21.15.2:0/286473931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892810b390 con 0x7f892810a170 2024-06-13T11:09:24.044 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.337+0000 7f8926a00700 1 --2- 172.21.15.2:0/286473931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f892810a170 0x7f892810a590 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f89180098a0 tx=0x7f8918009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45373cbe460e1684 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:24.044 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.338+0000 7f8925600700 1 -- 172.21.15.2:0/286473931 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8918004160 con 0x7f892810a170 2024-06-13T11:09:24.044 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.338+0000 7f8925600700 1 -- 172.21.15.2:0/286473931 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8918004300 con 0x7f892810a170 2024-06-13T11:09:24.044 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.338+0000 7f8925600700 1 -- 172.21.15.2:0/286473931 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8918011b50 con 0x7f892810a170 2024-06-13T11:09:24.044 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.338+0000 7f892d600700 1 -- 172.21.15.2:0/286473931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f892810a170 msgr2=0x7f892810a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:24.044 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.338+0000 7f892d600700 1 --2- 172.21.15.2:0/286473931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f892810a170 0x7f892810a590 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f89180098a0 tx=0x7f8918009bb0 comp rx=0 tx=0).stop 2024-06-13T11:09:24.044 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.339+0000 7f892d600700 1 -- 172.21.15.2:0/286473931 shutdown_connections 2024-06-13T11:09:24.044 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.339+0000 7f892d600700 1 --2- 172.21.15.2:0/286473931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f892810a170 0x7f892810a590 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:24.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.339+0000 7f892d600700 1 -- 172.21.15.2:0/286473931 >> 172.21.15.2:0/286473931 conn(0x7f892807d5c0 msgr2=0x7f892807d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:24.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.339+0000 7f892d600700 1 -- 172.21.15.2:0/286473931 shutdown_connections 2024-06-13T11:09:24.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.339+0000 7f892d600700 1 -- 172.21.15.2:0/286473931 wait complete. 2024-06-13T11:09:24.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.340+0000 7f892d600700 1 Processor -- start 2024-06-13T11:09:24.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.340+0000 7f892d600700 1 -- start start 2024-06-13T11:09:24.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.340+0000 7f892d600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f892810a170 0x7f892819e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:24.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.340+0000 7f892d600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f892810e5c0 con 0x7f892810a170 2024-06-13T11:09:24.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.341+0000 7f8926a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f892810a170 0x7f892819e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:24.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.341+0000 7f8926a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f892810a170 0x7f892819e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40214/0 (socket says 172.21.15.2:40214) 2024-06-13T11:09:24.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.341+0000 7f8926a00700 1 -- 172.21.15.2:0/907359248 learned_addr learned my addr 172.21.15.2:0/907359248 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:24.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.341+0000 7f8926a00700 1 -- 172.21.15.2:0/907359248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892819e5c0 con 0x7f892810a170 2024-06-13T11:09:24.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.341+0000 7f8926a00700 1 --2- 172.21.15.2:0/907359248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f892810a170 0x7f892819e080 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8918011b60 tx=0x7f8918011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:24.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.342+0000 7f891f400700 1 -- 172.21.15.2:0/907359248 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8918003b20 con 0x7f892810a170 2024-06-13T11:09:24.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.342+0000 7f891f400700 1 -- 172.21.15.2:0/907359248 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8918003cc0 con 0x7f892810a170 2024-06-13T11:09:24.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.342+0000 7f891f400700 1 -- 172.21.15.2:0/907359248 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89180247d0 con 0x7f892810a170 2024-06-13T11:09:24.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.342+0000 7f892d600700 1 -- 172.21.15.2:0/907359248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892819e850 con 0x7f892810a170 2024-06-13T11:09:24.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.342+0000 7f892d600700 1 -- 172.21.15.2:0/907359248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89281a1540 con 0x7f892810a170 2024-06-13T11:09:24.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.342+0000 7f891f400700 1 -- 172.21.15.2:0/907359248 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8918022020 con 0x7f892810a170 2024-06-13T11:09:24.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.342+0000 7f891f400700 1 -- 172.21.15.2:0/907359248 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8918011e00 con 0x7f892810a170 2024-06-13T11:09:24.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.343+0000 7f892d600700 1 -- 172.21.15.2:0/907359248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f892810e740 con 0x7f892810a170 2024-06-13T11:09:24.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.346+0000 7f891f400700 1 -- 172.21.15.2:0/907359248 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f891802dcf0 con 0x7f892810a170 2024-06-13T11:09:24.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.424+0000 7f892d600700 1 -- 172.21.15.2:0/907359248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f8928063af0 con 0x7f892810a170 2024-06-13T11:09:24.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.428+0000 7f891f400700 1 -- 172.21.15.2:0/907359248 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f891801aba0 con 0x7f892810a170 2024-06-13T11:09:24.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.429+0000 7f892d600700 1 -- 172.21.15.2:0/907359248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f892810a170 msgr2=0x7f892819e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:24.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.429+0000 7f892d600700 1 --2- 172.21.15.2:0/907359248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f892810a170 0x7f892819e080 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8918011b60 tx=0x7f8918011c40 comp rx=0 tx=0).stop 2024-06-13T11:09:24.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.429+0000 7f892d600700 1 -- 172.21.15.2:0/907359248 shutdown_connections 2024-06-13T11:09:24.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.429+0000 7f892d600700 1 --2- 172.21.15.2:0/907359248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f892810a170 0x7f892819e080 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:24.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.429+0000 7f892d600700 1 -- 172.21.15.2:0/907359248 >> 172.21.15.2:0/907359248 conn(0x7f892807d5c0 msgr2=0x7f8928107ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:24.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.430+0000 7f892d600700 1 -- 172.21.15.2:0/907359248 shutdown_connections 2024-06-13T11:09:24.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:23.430+0000 7f892d600700 1 -- 172.21.15.2:0/907359248 wait complete. 2024-06-13T11:09:24.049 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote config to /etc/ceph/ceph.conf 2024-06-13T11:09:24.066 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-06-13T11:09:24.066 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mgr... 2024-06-13T11:09:24.067 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:9283 ... 2024-06-13T11:09:24.068 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:8765 ... 2024-06-13T11:09:24.514 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3611563c-2975-11ef-bc9c-c7b262605968@mgr.x 2024-06-13T11:09:24.514 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3611563c-2975-11ef-bc9c-c7b262605968@mgr.x.service: Unit ceph-3611563c-2975-11ef-bc9c-c7b262605968@mgr.x.service not loaded. 2024-06-13T11:09:24.773 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3611563c-2975-11ef-bc9c-c7b262605968.target.wants/ceph-3611563c-2975-11ef-bc9c-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-3611563c-2975-11ef-bc9c-c7b262605968@.service. 2024-06-13T11:09:24.815 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:24 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/907359248' entity='client.admin' 2024-06-13T11:09:25.146 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:24 smithi002 systemd[1]: Starting Ceph mgr.x for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:09:25.457 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:25 smithi002 podman[32424]: 2024-06-13 11:09:25.203643723 +0000 UTC m=+0.130530376 container create 98d7585ac6f823ff17cb17ae86602aaeee18e485456979ff372a84eb0dfade3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:09:25.457 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:25 smithi002 podman[32424]: 2024-06-13 11:09:25.111271405 +0000 UTC m=+0.038158039 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T11:09:25.458 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:25 smithi002 podman[32424]: 2024-06-13 11:09:25.457091175 +0000 UTC m=+0.383977872 container init 98d7585ac6f823ff17cb17ae86602aaeee18e485456979ff372a84eb0dfade3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-06-13T11:09:25.587 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-13T11:09:25.587 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-06-13T11:09:25.604 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-13T11:09:25.605 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-06-13T11:09:25.605 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-06-13T11:09:25.605 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-06-13T11:09:25.626 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-13T11:09:25.626 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-06-13T11:09:25.642 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-13T11:09:25.642 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-06-13T11:09:25.643 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-06-13T11:09:25.643 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-06-13T11:09:25.643 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr to start... 2024-06-13T11:09:25.643 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr... 2024-06-13T11:09:25.722 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:25 smithi002 podman[32424]: 2024-06-13 11:09:25.466281328 +0000 UTC m=+0.393167951 container start 98d7585ac6f823ff17cb17ae86602aaeee18e485456979ff372a84eb0dfade3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=squid-3d89acc) 2024-06-13T11:09:25.722 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:25 smithi002 bash[32424]: 98d7585ac6f823ff17cb17ae86602aaeee18e485456979ff372a84eb0dfade3e 2024-06-13T11:09:25.722 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:25 smithi002 systemd[1]: Started Ceph mgr.x for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:09:25.982 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:25 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:25.721+0000 7fc8fc254200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T11:09:26.310 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:25 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:25.985+0000 7fc8fc254200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:09:26.311 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:26 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:26.144+0000 7fc8fc254200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T11:09:26.587 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:26 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2637343806' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-13T11:09:26.896 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:26 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:26.586+0000 7fc8fc254200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T11:09:26.896 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:26 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:26.705+0000 7fc8fc254200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T11:09:26.921 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T11:09:26.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-06-13T11:09:26.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "3611563c-2975-11ef-bc9c-c7b262605968", 2024-06-13T11:09:26.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-06-13T11:09:26.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-13T11:09:26.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-13T11:09:26.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-13T11:09:26.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:26.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-13T11:09:26.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-13T11:09:26.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-06-13T11:09:26.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T11:09:26.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-13T11:09:26.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-06-13T11:09:26.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T11:09:26.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-06-13T11:09:26.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-13T11:09:26.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T11:09:26.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-13T11:09:26.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-13T11:09:26.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:26.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-13T11:09:26.926 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T11:09:26.926 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-13T11:09:26.926 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-13T11:09:26.926 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-13T11:09:26.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-13T11:09:26.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-13T11:09:26.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-13T11:09:26.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:26.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-13T11:09:26.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-13T11:09:26.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-13T11:09:26.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-13T11:09:26.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-13T11:09:26.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-13T11:09:26.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-13T11:09:26.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-13T11:09:26.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-13T11:09:26.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:26.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-13T11:09:26.934 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T11:09:26.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-13T11:09:26.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-13T11:09:26.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:26.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-13T11:09:26.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-13T11:09:26.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-13T11:09:26.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-13T11:09:26.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-13T11:09:26.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-13T11:09:26.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-06-13T11:09:26.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T11:09:26.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-13T11:09:26.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:26.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-13T11:09:26.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T11:09:26.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-06-13T11:09:07.839661+0000", 2024-06-13T11:09:26.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-13T11:09:26.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:26.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-13T11:09:26.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-06-13T11:09:26.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.221+0000 7f9646a00700 1 Processor -- start 2024-06-13T11:09:26.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.221+0000 7f9646a00700 1 -- start start 2024-06-13T11:09:26.936 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.221+0000 7f9646a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9640107f10 0x7f9640108350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:26.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.221+0000 7f9646a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9640108890 con 0x7f9640107f10 2024-06-13T11:09:26.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.222+0000 7f963fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9640107f10 0x7f9640108350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:26.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.222+0000 7f963fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9640107f10 0x7f9640108350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42418/0 (socket says 172.21.15.2:42418) 2024-06-13T11:09:26.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.222+0000 7f963fe00700 1 -- 172.21.15.2:0/2666656640 learned_addr learned my addr 172.21.15.2:0/2666656640 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:26.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.223+0000 7f963fe00700 1 -- 172.21.15.2:0/2666656640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96401090f0 con 0x7f9640107f10 2024-06-13T11:09:26.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.223+0000 7f963fe00700 1 --2- 172.21.15.2:0/2666656640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9640107f10 0x7f9640108350 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f96300098a0 tx=0x7f9630009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4dd3b89fdab67e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:26.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.223+0000 7f963ea00700 1 -- 172.21.15.2:0/2666656640 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9630004160 con 0x7f9640107f10 2024-06-13T11:09:26.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.223+0000 7f963ea00700 1 -- 172.21.15.2:0/2666656640 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9630004300 con 0x7f9640107f10 2024-06-13T11:09:26.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.224+0000 7f963ea00700 1 -- 172.21.15.2:0/2666656640 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9630011b50 con 0x7f9640107f10 2024-06-13T11:09:26.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.224+0000 7f9646a00700 1 -- 172.21.15.2:0/2666656640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9640107f10 msgr2=0x7f9640108350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:26.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.224+0000 7f9646a00700 1 --2- 172.21.15.2:0/2666656640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9640107f10 0x7f9640108350 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f96300098a0 tx=0x7f9630009bb0 comp rx=0 tx=0).stop 2024-06-13T11:09:26.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.224+0000 7f9646a00700 1 -- 172.21.15.2:0/2666656640 shutdown_connections 2024-06-13T11:09:26.937 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.224+0000 7f9646a00700 1 --2- 172.21.15.2:0/2666656640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9640107f10 0x7f9640108350 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:26.938 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.224+0000 7f9646a00700 1 -- 172.21.15.2:0/2666656640 >> 172.21.15.2:0/2666656640 conn(0x7f96401034e0 msgr2=0x7f9640105940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:26.938 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.225+0000 7f9646a00700 1 -- 172.21.15.2:0/2666656640 shutdown_connections 2024-06-13T11:09:26.938 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.225+0000 7f9646a00700 1 -- 172.21.15.2:0/2666656640 wait complete. 2024-06-13T11:09:26.938 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.226+0000 7f9646a00700 1 Processor -- start 2024-06-13T11:09:26.938 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.226+0000 7f9646a00700 1 -- start start 2024-06-13T11:09:26.938 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.227+0000 7f9646a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9640107f10 0x7f964019beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:26.938 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.227+0000 7f9646a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9640108a10 con 0x7f9640107f10 2024-06-13T11:09:26.938 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.227+0000 7f963fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9640107f10 0x7f964019beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:26.938 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.227+0000 7f963fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9640107f10 0x7f964019beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42420/0 (socket says 172.21.15.2:42420) 2024-06-13T11:09:26.938 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.227+0000 7f963fe00700 1 -- 172.21.15.2:0/2637343806 learned_addr learned my addr 172.21.15.2:0/2637343806 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:26.939 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.227+0000 7f963fe00700 1 -- 172.21.15.2:0/2637343806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964019c3f0 con 0x7f9640107f10 2024-06-13T11:09:26.939 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.228+0000 7f963fe00700 1 --2- 172.21.15.2:0/2637343806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9640107f10 0x7f964019beb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9630000c00 tx=0x7f9630011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:26.939 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.228+0000 7f963cc00700 1 -- 172.21.15.2:0/2637343806 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9630003b20 con 0x7f9640107f10 2024-06-13T11:09:26.939 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.228+0000 7f963cc00700 1 -- 172.21.15.2:0/2637343806 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9630003cc0 con 0x7f9640107f10 2024-06-13T11:09:26.939 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.228+0000 7f963cc00700 1 -- 172.21.15.2:0/2637343806 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9630024910 con 0x7f9640107f10 2024-06-13T11:09:26.939 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.228+0000 7f9646a00700 1 -- 172.21.15.2:0/2637343806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f964019c680 con 0x7f9640107f10 2024-06-13T11:09:26.939 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.228+0000 7f9646a00700 1 -- 172.21.15.2:0/2637343806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f964019f370 con 0x7f9640107f10 2024-06-13T11:09:26.939 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.229+0000 7f963cc00700 1 -- 172.21.15.2:0/2637343806 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9630022020 con 0x7f9640107f10 2024-06-13T11:09:26.939 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.229+0000 7f963cc00700 1 -- 172.21.15.2:0/2637343806 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9630011e00 con 0x7f9640107f10 2024-06-13T11:09:26.939 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.230+0000 7f9646a00700 1 -- 172.21.15.2:0/2637343806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9640063af0 con 0x7f9640107f10 2024-06-13T11:09:26.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.233+0000 7f963cc00700 1 -- 172.21.15.2:0/2637343806 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f963002d3f0 con 0x7f9640107f10 2024-06-13T11:09:26.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.311+0000 7f9646a00700 1 -- 172.21.15.2:0/2637343806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f964019f540 con 0x7f9640107f10 2024-06-13T11:09:26.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.312+0000 7f963cc00700 1 -- 172.21.15.2:0/2637343806 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f963001acd0 con 0x7f9640107f10 2024-06-13T11:09:26.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.313+0000 7f9646a00700 1 -- 172.21.15.2:0/2637343806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9640107f10 msgr2=0x7f964019beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:26.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.313+0000 7f9646a00700 1 --2- 172.21.15.2:0/2637343806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9640107f10 0x7f964019beb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9630000c00 tx=0x7f9630011c10 comp rx=0 tx=0).stop 2024-06-13T11:09:26.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.313+0000 7f9646a00700 1 -- 172.21.15.2:0/2637343806 shutdown_connections 2024-06-13T11:09:26.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.313+0000 7f9646a00700 1 --2- 172.21.15.2:0/2637343806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9640107f10 0x7f964019beb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:26.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.313+0000 7f9646a00700 1 -- 172.21.15.2:0/2637343806 >> 172.21.15.2:0/2637343806 conn(0x7f96401034e0 msgr2=0x7f9640104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:26.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.314+0000 7f9646a00700 1 -- 172.21.15.2:0/2637343806 shutdown_connections 2024-06-13T11:09:26.940 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:26.314+0000 7f9646a00700 1 -- 172.21.15.2:0/2637343806 wait complete. 2024-06-13T11:09:26.940 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (1/15)... 2024-06-13T11:09:28.646 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:28 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:28.371+0000 7fc8fc254200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T11:09:28.646 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:28 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:28.606+0000 7fc8fc254200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T11:09:29.080 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:28 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:28.824+0000 7fc8fc254200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T11:09:29.343 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:29 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:29.219+0000 7fc8fc254200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T11:09:29.594 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:29 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:29.348+0000 7fc8fc254200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T11:09:29.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:29 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2577575328' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-13T11:09:29.880 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:29 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:29.614+0000 7fc8fc254200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T11:09:29.880 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:29 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:29.880+0000 7fc8fc254200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:09:30.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T11:09:30.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-06-13T11:09:30.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "3611563c-2975-11ef-bc9c-c7b262605968", 2024-06-13T11:09:30.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-06-13T11:09:30.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-13T11:09:30.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-13T11:09:30.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-13T11:09:30.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:30.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-13T11:09:30.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-13T11:09:30.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-06-13T11:09:30.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T11:09:30.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-13T11:09:30.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-06-13T11:09:30.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T11:09:30.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-06-13T11:09:30.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-13T11:09:30.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T11:09:30.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-13T11:09:30.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-13T11:09:30.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:30.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-13T11:09:30.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T11:09:30.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-13T11:09:30.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-13T11:09:30.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-13T11:09:30.255 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-13T11:09:30.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-13T11:09:30.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-13T11:09:30.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:30.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-13T11:09:30.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-13T11:09:30.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-13T11:09:30.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-13T11:09:30.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-13T11:09:30.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-13T11:09:30.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-13T11:09:30.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-13T11:09:30.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-13T11:09:30.256 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:30.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-13T11:09:30.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T11:09:30.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-13T11:09:30.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-13T11:09:30.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:30.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-13T11:09:30.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-13T11:09:30.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-13T11:09:30.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-13T11:09:30.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-13T11:09:30.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-13T11:09:30.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-06-13T11:09:30.257 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T11:09:30.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-13T11:09:30.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:30.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-13T11:09:30.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T11:09:30.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-06-13T11:09:07.839661+0000", 2024-06-13T11:09:30.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-13T11:09:30.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:30.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-13T11:09:30.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-06-13T11:09:30.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.503+0000 7f2ba1800700 1 Processor -- start 2024-06-13T11:09:30.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.503+0000 7f2ba1800700 1 -- start start 2024-06-13T11:09:30.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.504+0000 7f2ba1800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c07e740 0x7f2b9c07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:30.258 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.504+0000 7f2ba1800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9c07d170 con 0x7f2b9c07e740 2024-06-13T11:09:30.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.504+0000 7f2b9aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c07e740 0x7f2b9c07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:30.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.504+0000 7f2b9aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c07e740 0x7f2b9c07cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42432/0 (socket says 172.21.15.2:42432) 2024-06-13T11:09:30.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.504+0000 7f2b9aa00700 1 -- 172.21.15.2:0/4138421126 learned_addr learned my addr 172.21.15.2:0/4138421126 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:30.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.505+0000 7f2b9aa00700 1 -- 172.21.15.2:0/4138421126 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9c07d2f0 con 0x7f2b9c07e740 2024-06-13T11:09:30.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.505+0000 7f2b9aa00700 1 --2- 172.21.15.2:0/4138421126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c07e740 0x7f2b9c07cba0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0098a0 tx=0x7f2b8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b112276d798a1e1 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:30.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.505+0000 7f2b99600700 1 -- 172.21.15.2:0/4138421126 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c004160 con 0x7f2b9c07e740 2024-06-13T11:09:30.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.505+0000 7f2b99600700 1 -- 172.21.15.2:0/4138421126 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2b8c004300 con 0x7f2b9c07e740 2024-06-13T11:09:30.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.505+0000 7f2b99600700 1 -- 172.21.15.2:0/4138421126 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c011b50 con 0x7f2b9c07e740 2024-06-13T11:09:30.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.506+0000 7f2ba1800700 1 -- 172.21.15.2:0/4138421126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c07e740 msgr2=0x7f2b9c07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:30.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.506+0000 7f2ba1800700 1 --2- 172.21.15.2:0/4138421126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c07e740 0x7f2b9c07cba0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0098a0 tx=0x7f2b8c009bb0 comp rx=0 tx=0).stop 2024-06-13T11:09:30.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.506+0000 7f2ba1800700 1 -- 172.21.15.2:0/4138421126 shutdown_connections 2024-06-13T11:09:30.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.506+0000 7f2ba1800700 1 --2- 172.21.15.2:0/4138421126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c07e740 0x7f2b9c07cba0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:30.259 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.506+0000 7f2ba1800700 1 -- 172.21.15.2:0/4138421126 >> 172.21.15.2:0/4138421126 conn(0x7f2b9c103530 msgr2=0x7f2b9c105950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:30.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.507+0000 7f2ba1800700 1 -- 172.21.15.2:0/4138421126 shutdown_connections 2024-06-13T11:09:30.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.507+0000 7f2ba1800700 1 -- 172.21.15.2:0/4138421126 wait complete. 2024-06-13T11:09:30.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.508+0000 7f2ba1800700 1 Processor -- start 2024-06-13T11:09:30.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.508+0000 7f2ba1800700 1 -- start start 2024-06-13T11:09:30.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.508+0000 7f2ba1800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c19e2c0 0x7f2b9c19e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:30.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.508+0000 7f2ba1800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9c10e4c0 con 0x7f2b9c19e2c0 2024-06-13T11:09:30.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.508+0000 7f2b9aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c19e2c0 0x7f2b9c19e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:30.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.508+0000 7f2b9aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c19e2c0 0x7f2b9c19e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42438/0 (socket says 172.21.15.2:42438) 2024-06-13T11:09:30.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.508+0000 7f2b9aa00700 1 -- 172.21.15.2:0/2577575328 learned_addr learned my addr 172.21.15.2:0/2577575328 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:30.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.509+0000 7f2b9aa00700 1 -- 172.21.15.2:0/2577575328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9c19ec20 con 0x7f2b9c19e2c0 2024-06-13T11:09:30.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.509+0000 7f2b9aa00700 1 --2- 172.21.15.2:0/2577575328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c19e2c0 0x7f2b9c19e6e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c000c00 tx=0x7f2b8c0119e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:30.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.509+0000 7f2b93400700 1 -- 172.21.15.2:0/2577575328 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c0038b0 con 0x7f2b9c19e2c0 2024-06-13T11:09:30.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.509+0000 7f2b93400700 1 -- 172.21.15.2:0/2577575328 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2b8c01a440 con 0x7f2b9c19e2c0 2024-06-13T11:09:30.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.509+0000 7f2b93400700 1 -- 172.21.15.2:0/2577575328 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c01b5b0 con 0x7f2b9c19e2c0 2024-06-13T11:09:30.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.509+0000 7f2ba1800700 1 -- 172.21.15.2:0/2577575328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b9c19eeb0 con 0x7f2b9c19e2c0 2024-06-13T11:09:30.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.510+0000 7f2ba1800700 1 -- 172.21.15.2:0/2577575328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b9c1a1990 con 0x7f2b9c19e2c0 2024-06-13T11:09:30.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.510+0000 7f2b93400700 1 -- 172.21.15.2:0/2577575328 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2b8c01bae0 con 0x7f2b9c19e2c0 2024-06-13T11:09:30.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.510+0000 7f2b93400700 1 -- 172.21.15.2:0/2577575328 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2b8c02e730 con 0x7f2b9c19e2c0 2024-06-13T11:09:30.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.511+0000 7f2ba1800700 1 -- 172.21.15.2:0/2577575328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b9c063af0 con 0x7f2b9c19e2c0 2024-06-13T11:09:30.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.513+0000 7f2b93400700 1 -- 172.21.15.2:0/2577575328 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f2b8c004260 con 0x7f2b9c19e2c0 2024-06-13T11:09:30.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.594+0000 7f2ba1800700 1 -- 172.21.15.2:0/2577575328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2b9c1a1ce0 con 0x7f2b9c19e2c0 2024-06-13T11:09:30.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.595+0000 7f2b93400700 1 -- 172.21.15.2:0/2577575328 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f2b8c01a5f0 con 0x7f2b9c19e2c0 2024-06-13T11:09:30.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.597+0000 7f2ba1800700 1 -- 172.21.15.2:0/2577575328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c19e2c0 msgr2=0x7f2b9c19e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:30.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.597+0000 7f2ba1800700 1 --2- 172.21.15.2:0/2577575328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c19e2c0 0x7f2b9c19e6e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c000c00 tx=0x7f2b8c0119e0 comp rx=0 tx=0).stop 2024-06-13T11:09:30.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.597+0000 7f2ba1800700 1 -- 172.21.15.2:0/2577575328 shutdown_connections 2024-06-13T11:09:30.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.597+0000 7f2ba1800700 1 --2- 172.21.15.2:0/2577575328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c19e2c0 0x7f2b9c19e6e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:30.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.597+0000 7f2ba1800700 1 -- 172.21.15.2:0/2577575328 >> 172.21.15.2:0/2577575328 conn(0x7f2b9c103530 msgr2=0x7f2b9c104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:30.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.597+0000 7f2ba1800700 1 -- 172.21.15.2:0/2577575328 shutdown_connections 2024-06-13T11:09:30.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:29.597+0000 7f2ba1800700 1 -- 172.21.15.2:0/2577575328 wait complete. 2024-06-13T11:09:30.262 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (2/15)... 2024-06-13T11:09:31.145 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:30 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:30.718+0000 7fc8fc254200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T11:09:31.646 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:31 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:31.287+0000 7fc8fc254200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T11:09:31.646 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:31 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:31.417+0000 7fc8fc254200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T11:09:32.145 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:31 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:31.689+0000 7fc8fc254200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T11:09:32.739 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:32 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:32.407+0000 7fc8fc254200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T11:09:32.739 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:32 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:32.534+0000 7fc8fc254200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T11:09:32.989 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:32 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:32.877+0000 7fc8fc254200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T11:09:33.368 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:33 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/771463646' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-13T11:09:33.368 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:33 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:33.076+0000 7fc8fc254200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T11:09:33.368 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:33 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:33.204+0000 7fc8fc254200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T11:09:33.368 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:33 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:33.367+0000 7fc8fc254200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T11:09:33.748 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T11:09:33.749 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-06-13T11:09:33.750 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "3611563c-2975-11ef-bc9c-c7b262605968", 2024-06-13T11:09:33.750 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-06-13T11:09:33.750 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-13T11:09:33.750 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-13T11:09:33.750 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-13T11:09:33.750 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:33.750 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-13T11:09:33.750 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-13T11:09:33.750 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-06-13T11:09:33.750 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T11:09:33.750 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-13T11:09:33.751 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-06-13T11:09:33.751 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T11:09:33.752 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-06-13T11:09:33.752 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-13T11:09:33.752 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T11:09:33.752 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-13T11:09:33.752 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-13T11:09:33.752 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:33.752 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-13T11:09:33.752 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T11:09:33.752 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-13T11:09:33.753 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-13T11:09:33.753 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-13T11:09:33.756 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-13T11:09:33.756 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-13T11:09:33.757 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-13T11:09:33.757 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:33.757 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-13T11:09:33.757 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-13T11:09:33.757 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-13T11:09:33.757 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-13T11:09:33.757 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-13T11:09:33.757 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-13T11:09:33.757 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-13T11:09:33.757 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-13T11:09:33.757 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-13T11:09:33.757 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:33.757 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-13T11:09:33.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T11:09:33.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-13T11:09:33.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-13T11:09:33.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:33.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-13T11:09:33.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-13T11:09:33.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-13T11:09:33.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-13T11:09:33.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-13T11:09:33.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-13T11:09:33.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-06-13T11:09:33.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T11:09:33.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-13T11:09:33.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:33.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-13T11:09:33.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T11:09:33.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-06-13T11:09:07.839661+0000", 2024-06-13T11:09:33.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-13T11:09:33.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:33.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-13T11:09:33.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-06-13T11:09:33.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.897+0000 7f5263000700 1 Processor -- start 2024-06-13T11:09:33.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.897+0000 7f5263000700 1 -- start start 2024-06-13T11:09:33.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.898+0000 7f5263000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c07de70 0x7f525c07c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:33.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.898+0000 7f5263000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f525c07c8a0 con 0x7f525c07de70 2024-06-13T11:09:33.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.898+0000 7f5261c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c07de70 0x7f525c07c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:33.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.898+0000 7f5261c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c07de70 0x7f525c07c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42446/0 (socket says 172.21.15.2:42446) 2024-06-13T11:09:33.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.898+0000 7f5261c00700 1 -- 172.21.15.2:0/2026073086 learned_addr learned my addr 172.21.15.2:0/2026073086 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:33.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.899+0000 7f5261c00700 1 -- 172.21.15.2:0/2026073086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c07ca20 con 0x7f525c07de70 2024-06-13T11:09:33.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.899+0000 7f5261c00700 1 --2- 172.21.15.2:0/2026073086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c07de70 0x7f525c07c2d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f52500098a0 tx=0x7f5250009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9481e98b68aba3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:33.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.899+0000 7f525be00700 1 -- 172.21.15.2:0/2026073086 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5250004160 con 0x7f525c07de70 2024-06-13T11:09:33.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.899+0000 7f525be00700 1 -- 172.21.15.2:0/2026073086 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5250004300 con 0x7f525c07de70 2024-06-13T11:09:33.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.899+0000 7f525be00700 1 -- 172.21.15.2:0/2026073086 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5250011b50 con 0x7f525c07de70 2024-06-13T11:09:33.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.900+0000 7f5263000700 1 -- 172.21.15.2:0/2026073086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c07de70 msgr2=0x7f525c07c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:33.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.900+0000 7f5263000700 1 --2- 172.21.15.2:0/2026073086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c07de70 0x7f525c07c2d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f52500098a0 tx=0x7f5250009bb0 comp rx=0 tx=0).stop 2024-06-13T11:09:33.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.900+0000 7f5263000700 1 -- 172.21.15.2:0/2026073086 shutdown_connections 2024-06-13T11:09:33.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.900+0000 7f5263000700 1 --2- 172.21.15.2:0/2026073086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c07de70 0x7f525c07c2d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:33.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.900+0000 7f5263000700 1 -- 172.21.15.2:0/2026073086 >> 172.21.15.2:0/2026073086 conn(0x7f525c103390 msgr2=0x7f525c1057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:33.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.900+0000 7f5263000700 1 -- 172.21.15.2:0/2026073086 shutdown_connections 2024-06-13T11:09:33.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.900+0000 7f5263000700 1 -- 172.21.15.2:0/2026073086 wait complete. 2024-06-13T11:09:33.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.901+0000 7f5263000700 1 Processor -- start 2024-06-13T11:09:33.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.902+0000 7f5263000700 1 -- start start 2024-06-13T11:09:33.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.902+0000 7f5263000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c07de70 0x7f525c19def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:33.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.902+0000 7f5263000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f525c10e2d0 con 0x7f525c07de70 2024-06-13T11:09:33.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.902+0000 7f5261c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c07de70 0x7f525c19def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:33.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.902+0000 7f5261c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c07de70 0x7f525c19def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42462/0 (socket says 172.21.15.2:42462) 2024-06-13T11:09:33.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.902+0000 7f5261c00700 1 -- 172.21.15.2:0/771463646 learned_addr learned my addr 172.21.15.2:0/771463646 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:33.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.903+0000 7f5261c00700 1 -- 172.21.15.2:0/771463646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c19e430 con 0x7f525c07de70 2024-06-13T11:09:33.766 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.903+0000 7f5261c00700 1 --2- 172.21.15.2:0/771463646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c07de70 0x7f525c19def0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5250009fb0 tx=0x7f5250011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:33.766 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.903+0000 7f525a000700 1 -- 172.21.15.2:0/771463646 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52500038b0 con 0x7f525c07de70 2024-06-13T11:09:33.766 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.903+0000 7f525a000700 1 -- 172.21.15.2:0/771463646 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5250011e50 con 0x7f525c07de70 2024-06-13T11:09:33.766 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.903+0000 7f5263000700 1 -- 172.21.15.2:0/771463646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525c19e6c0 con 0x7f525c07de70 2024-06-13T11:09:33.766 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.903+0000 7f525a000700 1 -- 172.21.15.2:0/771463646 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5250019550 con 0x7f525c07de70 2024-06-13T11:09:33.766 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.903+0000 7f5263000700 1 -- 172.21.15.2:0/771463646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525c1a13b0 con 0x7f525c07de70 2024-06-13T11:09:33.766 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.904+0000 7f525a000700 1 -- 172.21.15.2:0/771463646 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5250019be0 con 0x7f525c07de70 2024-06-13T11:09:33.766 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.904+0000 7f525a000700 1 -- 172.21.15.2:0/771463646 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5250024730 con 0x7f525c07de70 2024-06-13T11:09:33.766 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.905+0000 7f5263000700 1 -- 172.21.15.2:0/771463646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525c063af0 con 0x7f525c07de70 2024-06-13T11:09:33.766 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.909+0000 7f525a000700 1 -- 172.21.15.2:0/771463646 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5250003a50 con 0x7f525c07de70 2024-06-13T11:09:33.766 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.988+0000 7f5263000700 1 -- 172.21.15.2:0/771463646 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f525c1a1580 con 0x7f525c07de70 2024-06-13T11:09:33.766 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.988+0000 7f525a000700 1 -- 172.21.15.2:0/771463646 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f52500249d0 con 0x7f525c07de70 2024-06-13T11:09:33.766 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.990+0000 7f5263000700 1 -- 172.21.15.2:0/771463646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c07de70 msgr2=0x7f525c19def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:33.767 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.990+0000 7f5263000700 1 --2- 172.21.15.2:0/771463646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c07de70 0x7f525c19def0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5250009fb0 tx=0x7f5250011bf0 comp rx=0 tx=0).stop 2024-06-13T11:09:33.767 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.990+0000 7f5263000700 1 -- 172.21.15.2:0/771463646 shutdown_connections 2024-06-13T11:09:33.767 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.990+0000 7f5263000700 1 --2- 172.21.15.2:0/771463646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c07de70 0x7f525c19def0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:33.767 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.990+0000 7f5263000700 1 -- 172.21.15.2:0/771463646 >> 172.21.15.2:0/771463646 conn(0x7f525c103390 msgr2=0x7f525c103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:33.767 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.990+0000 7f5263000700 1 -- 172.21.15.2:0/771463646 shutdown_connections 2024-06-13T11:09:33.767 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:32.990+0000 7f5263000700 1 -- 172.21.15.2:0/771463646 wait complete. 2024-06-13T11:09:33.767 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (3/15)... 2024-06-13T11:09:34.145 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:33 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:33.788+0000 7fc8fc254200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T11:09:34.868 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:34 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:34.577+0000 7fc8fc254200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T11:09:35.145 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:34 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:34.867+0000 7fc8fc254200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T11:09:35.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:34 smithi002 ceph-mon[32210]: Activating manager daemon x 2024-06-13T11:09:35.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:34 smithi002 ceph-mon[32210]: mgrmap e2: x(active, starting, since 0.00677723s) 2024-06-13T11:09:35.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:34 smithi002 ceph-mon[32210]: from='mgr.14100 172.21.15.2:0/1471080261' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-13T11:09:35.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:34 smithi002 ceph-mon[32210]: from='mgr.14100 172.21.15.2:0/1471080261' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-13T11:09:35.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:34 smithi002 ceph-mon[32210]: from='mgr.14100 172.21.15.2:0/1471080261' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-13T11:09:35.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:34 smithi002 ceph-mon[32210]: from='mgr.14100 172.21.15.2:0/1471080261' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:09:35.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:34 smithi002 ceph-mon[32210]: from='mgr.14100 172.21.15.2:0/1471080261' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-13T11:09:35.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:34 smithi002 ceph-mon[32210]: Manager daemon x is now available 2024-06-13T11:09:35.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:34 smithi002 ceph-mon[32210]: from='mgr.14100 172.21.15.2:0/1471080261' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T11:09:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:34 smithi002 ceph-mon[32210]: from='mgr.14100 172.21.15.2:0/1471080261' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T11:09:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:34 smithi002 ceph-mon[32210]: from='mgr.14100 172.21.15.2:0/1471080261' entity='mgr.x' 2024-06-13T11:09:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:34 smithi002 ceph-mon[32210]: from='mgr.14100 172.21.15.2:0/1471080261' entity='mgr.x' 2024-06-13T11:09:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:34 smithi002 ceph-mon[32210]: from='mgr.14100 172.21.15.2:0/1471080261' entity='mgr.x' 2024-06-13T11:09:37.087 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:36 smithi002 ceph-mon[32210]: mgrmap e3: x(active, since 1.02097s) 2024-06-13T11:09:37.087 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:36 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3177789244' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-13T11:09:37.485 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T11:09:37.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-06-13T11:09:37.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "3611563c-2975-11ef-bc9c-c7b262605968", 2024-06-13T11:09:37.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-06-13T11:09:37.486 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-13T11:09:37.487 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-13T11:09:37.487 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-13T11:09:37.487 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:37.487 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-13T11:09:37.488 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-13T11:09:37.488 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-06-13T11:09:37.489 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T11:09:37.490 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-13T11:09:37.490 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-06-13T11:09:37.490 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T11:09:37.490 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-06-13T11:09:37.490 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-13T11:09:37.490 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T11:09:37.490 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-13T11:09:37.490 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-13T11:09:37.490 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:37.490 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-13T11:09:37.490 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T11:09:37.490 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-13T11:09:37.490 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-13T11:09:37.491 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-13T11:09:37.491 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-13T11:09:37.491 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-13T11:09:37.492 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-13T11:09:37.492 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:37.492 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-13T11:09:37.492 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-13T11:09:37.492 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-13T11:09:37.492 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-13T11:09:37.493 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-13T11:09:37.493 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-13T11:09:37.493 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-13T11:09:37.493 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-13T11:09:37.493 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-13T11:09:37.493 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:37.495 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-13T11:09:37.495 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T11:09:37.495 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-13T11:09:37.495 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-13T11:09:37.495 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:37.495 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-13T11:09:37.495 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-13T11:09:37.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-13T11:09:37.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-13T11:09:37.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-13T11:09:37.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-13T11:09:37.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-06-13T11:09:37.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T11:09:37.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-13T11:09:37.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:37.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-13T11:09:37.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T11:09:37.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-06-13T11:09:07.839661+0000", 2024-06-13T11:09:37.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-13T11:09:37.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T11:09:37.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-13T11:09:37.501 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-06-13T11:09:37.502 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.354+0000 7f45c4600700 1 Processor -- start 2024-06-13T11:09:37.502 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.354+0000 7f45c4600700 1 -- start start 2024-06-13T11:09:37.502 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.355+0000 7f45c4600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45bc108a30 0x7f45bc10ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:37.502 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.355+0000 7f45c4600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f45bc07c6c0 con 0x7f45bc108a30 2024-06-13T11:09:37.502 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.355+0000 7f45c1c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45bc108a30 0x7f45bc10ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:37.502 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.355+0000 7f45c1c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45bc108a30 0x7f45bc10ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35606/0 (socket says 172.21.15.2:35606) 2024-06-13T11:09:37.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.355+0000 7f45c1c00700 1 -- 172.21.15.2:0/742443631 learned_addr learned my addr 172.21.15.2:0/742443631 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:37.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.356+0000 7f45c1c00700 1 -- 172.21.15.2:0/742443631 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45bc10b360 con 0x7f45bc108a30 2024-06-13T11:09:37.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.356+0000 7f45c1c00700 1 --2- 172.21.15.2:0/742443631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45bc108a30 0x7f45bc10ae20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f45b00098a0 tx=0x7f45b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c39217d44b3c5c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:37.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.357+0000 7f45bbe00700 1 -- 172.21.15.2:0/742443631 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45b0004160 con 0x7f45bc108a30 2024-06-13T11:09:37.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.357+0000 7f45bbe00700 1 -- 172.21.15.2:0/742443631 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f45b0004300 con 0x7f45bc108a30 2024-06-13T11:09:37.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.357+0000 7f45bbe00700 1 -- 172.21.15.2:0/742443631 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45b0011b50 con 0x7f45bc108a30 2024-06-13T11:09:37.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.357+0000 7f45c4600700 1 -- 172.21.15.2:0/742443631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45bc108a30 msgr2=0x7f45bc10ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:37.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.357+0000 7f45c4600700 1 --2- 172.21.15.2:0/742443631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45bc108a30 0x7f45bc10ae20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f45b00098a0 tx=0x7f45b0009bb0 comp rx=0 tx=0).stop 2024-06-13T11:09:37.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.358+0000 7f45c4600700 1 -- 172.21.15.2:0/742443631 shutdown_connections 2024-06-13T11:09:37.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.358+0000 7f45c4600700 1 --2- 172.21.15.2:0/742443631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45bc108a30 0x7f45bc10ae20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:37.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.358+0000 7f45c4600700 1 -- 172.21.15.2:0/742443631 >> 172.21.15.2:0/742443631 conn(0x7f45bc102440 msgr2=0x7f45bc1048a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:37.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.358+0000 7f45c4600700 1 -- 172.21.15.2:0/742443631 shutdown_connections 2024-06-13T11:09:37.503 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.358+0000 7f45c4600700 1 -- 172.21.15.2:0/742443631 wait complete. 2024-06-13T11:09:37.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.359+0000 7f45c4600700 1 Processor -- start 2024-06-13T11:09:37.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.359+0000 7f45c4600700 1 -- start start 2024-06-13T11:09:37.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.359+0000 7f45c4600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45bc108a30 0x7f45bc19e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:37.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.359+0000 7f45c4600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f45bc10c2a0 con 0x7f45bc108a30 2024-06-13T11:09:37.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.360+0000 7f45c1c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45bc108a30 0x7f45bc19e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:37.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.360+0000 7f45c1c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45bc108a30 0x7f45bc19e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35618/0 (socket says 172.21.15.2:35618) 2024-06-13T11:09:37.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.360+0000 7f45c1c00700 1 -- 172.21.15.2:0/3177789244 learned_addr learned my addr 172.21.15.2:0/3177789244 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:37.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.360+0000 7f45c1c00700 1 -- 172.21.15.2:0/3177789244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45bc19e540 con 0x7f45bc108a30 2024-06-13T11:09:37.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.360+0000 7f45c1c00700 1 --2- 172.21.15.2:0/3177789244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45bc108a30 0x7f45bc19e000 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f45b0011670 tx=0x7f45b0011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:37.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.361+0000 7f45ba000700 1 -- 172.21.15.2:0/3177789244 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45b00039c0 con 0x7f45bc108a30 2024-06-13T11:09:37.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.361+0000 7f45ba000700 1 -- 172.21.15.2:0/3177789244 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f45b0011e50 con 0x7f45bc108a30 2024-06-13T11:09:37.504 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.361+0000 7f45c4600700 1 -- 172.21.15.2:0/3177789244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45bc19e7d0 con 0x7f45bc108a30 2024-06-13T11:09:37.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.361+0000 7f45ba000700 1 -- 172.21.15.2:0/3177789244 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45b001a5c0 con 0x7f45bc108a30 2024-06-13T11:09:37.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.361+0000 7f45c4600700 1 -- 172.21.15.2:0/3177789244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45bc1a14c0 con 0x7f45bc108a30 2024-06-13T11:09:37.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.362+0000 7f45c4600700 1 -- 172.21.15.2:0/3177789244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45bc063af0 con 0x7f45bc108a30 2024-06-13T11:09:37.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.362+0000 7f45ba000700 1 -- 172.21.15.2:0/3177789244 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f45b0024430 con 0x7f45bc108a30 2024-06-13T11:09:37.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.363+0000 7f45ba000700 1 --2- 172.21.15.2:0/3177789244 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f45a4038ea0 0x7f45a403b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:37.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.363+0000 7f45ba000700 1 -- 172.21.15.2:0/3177789244 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f45b004d1f0 con 0x7f45bc108a30 2024-06-13T11:09:37.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.363+0000 7f45c1200700 1 --2- 172.21.15.2:0/3177789244 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f45a4038ea0 0x7f45a403b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:37.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.364+0000 7f45c1200700 1 --2- 172.21.15.2:0/3177789244 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f45a4038ea0 0x7f45a403b360 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f45a8006fd0 tx=0x7f45a8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:37.505 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.370+0000 7f45ba000700 1 -- 172.21.15.2:0/3177789244 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f45b0003b60 con 0x7f45bc108a30 2024-06-13T11:09:37.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.690+0000 7f45c4600700 1 -- 172.21.15.2:0/3177789244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f45bc1a1690 con 0x7f45bc108a30 2024-06-13T11:09:37.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.691+0000 7f45ba000700 1 -- 172.21.15.2:0/3177789244 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f45bc1a1690 con 0x7f45bc108a30 2024-06-13T11:09:37.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.695+0000 7f45c4600700 1 -- 172.21.15.2:0/3177789244 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f45a4038ea0 msgr2=0x7f45a403b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:37.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.695+0000 7f45c4600700 1 --2- 172.21.15.2:0/3177789244 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f45a4038ea0 0x7f45a403b360 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f45a8006fd0 tx=0x7f45a8006e40 comp rx=0 tx=0).stop 2024-06-13T11:09:37.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.695+0000 7f45c4600700 1 -- 172.21.15.2:0/3177789244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45bc108a30 msgr2=0x7f45bc19e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:37.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.695+0000 7f45c4600700 1 --2- 172.21.15.2:0/3177789244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45bc108a30 0x7f45bc19e000 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f45b0011670 tx=0x7f45b0011b60 comp rx=0 tx=0).stop 2024-06-13T11:09:37.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.695+0000 7f45c4600700 1 -- 172.21.15.2:0/3177789244 shutdown_connections 2024-06-13T11:09:37.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.695+0000 7f45c4600700 1 --2- 172.21.15.2:0/3177789244 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f45a4038ea0 0x7f45a403b360 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:37.506 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.695+0000 7f45c4600700 1 --2- 172.21.15.2:0/3177789244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45bc108a30 0x7f45bc19e000 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:37.507 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.695+0000 7f45c4600700 1 -- 172.21.15.2:0/3177789244 >> 172.21.15.2:0/3177789244 conn(0x7f45bc102440 msgr2=0x7f45bc102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:37.507 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.695+0000 7f45c4600700 1 -- 172.21.15.2:0/3177789244 shutdown_connections 2024-06-13T11:09:37.507 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:36.695+0000 7f45c4600700 1 -- 172.21.15.2:0/3177789244 wait complete. 2024-06-13T11:09:37.507 INFO:teuthology.orchestra.run.smithi002.stdout:mgr is available 2024-06-13T11:09:38.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:37 smithi002 ceph-mon[32210]: mgrmap e4: x(active, since 2s) 2024-06-13T11:09:39.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:38 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1058261303' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-13T11:09:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T11:09:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-06-13T11:09:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:09:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-13T11:09:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-13T11:09:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-13T11:09:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-13T11:09:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T11:09:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-13T11:09:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-13T11:09:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T11:09:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-06-13T11:09:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-13T11:09:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-13T11:09:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-13T11:09:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-13T11:09:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-13T11:09:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.182+0000 7f8990a00700 1 Processor -- start 2024-06-13T11:09:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.182+0000 7f8990a00700 1 -- start start 2024-06-13T11:09:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.182+0000 7f8990a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898c10a170 0x7f898c10a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.182+0000 7f8990a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f898c10ab60 con 0x7f898c10a170 2024-06-13T11:09:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.183+0000 7f8989e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898c10a170 0x7f898c10a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.183+0000 7f8989e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898c10a170 0x7f898c10a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35628/0 (socket says 172.21.15.2:35628) 2024-06-13T11:09:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.183+0000 7f8989e00700 1 -- 172.21.15.2:0/1764908165 learned_addr learned my addr 172.21.15.2:0/1764908165 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.183+0000 7f8989e00700 1 -- 172.21.15.2:0/1764908165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898c10b390 con 0x7f898c10a170 2024-06-13T11:09:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.184+0000 7f8989e00700 1 --2- 172.21.15.2:0/1764908165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898c10a170 0x7f898c10a590 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f897c0098a0 tx=0x7f897c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa2bbd4392ad58f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.184+0000 7f8989400700 1 -- 172.21.15.2:0/1764908165 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c004160 con 0x7f898c10a170 2024-06-13T11:09:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.184+0000 7f8989400700 1 -- 172.21.15.2:0/1764908165 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f897c004300 con 0x7f898c10a170 2024-06-13T11:09:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.184+0000 7f8989400700 1 -- 172.21.15.2:0/1764908165 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c011b50 con 0x7f898c10a170 2024-06-13T11:09:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.184+0000 7f8990a00700 1 -- 172.21.15.2:0/1764908165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898c10a170 msgr2=0x7f898c10a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.184+0000 7f8990a00700 1 --2- 172.21.15.2:0/1764908165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898c10a170 0x7f898c10a590 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f897c0098a0 tx=0x7f897c009bb0 comp rx=0 tx=0).stop 2024-06-13T11:09:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.185+0000 7f8990a00700 1 -- 172.21.15.2:0/1764908165 shutdown_connections 2024-06-13T11:09:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.185+0000 7f8990a00700 1 --2- 172.21.15.2:0/1764908165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898c10a170 0x7f898c10a590 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.185+0000 7f8990a00700 1 -- 172.21.15.2:0/1764908165 >> 172.21.15.2:0/1764908165 conn(0x7f898c07d5c0 msgr2=0x7f898c07d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.185+0000 7f8990a00700 1 -- 172.21.15.2:0/1764908165 shutdown_connections 2024-06-13T11:09:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.185+0000 7f8990a00700 1 -- 172.21.15.2:0/1764908165 wait complete. 2024-06-13T11:09:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.186+0000 7f8990a00700 1 Processor -- start 2024-06-13T11:09:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.186+0000 7f8990a00700 1 -- start start 2024-06-13T11:09:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.186+0000 7f8990a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898c10a170 0x7f898c19e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.186+0000 7f8990a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f898c10e5c0 con 0x7f898c10a170 2024-06-13T11:09:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.187+0000 7f8989e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898c10a170 0x7f898c19e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.187+0000 7f8989e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898c10a170 0x7f898c19e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35632/0 (socket says 172.21.15.2:35632) 2024-06-13T11:09:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.187+0000 7f8989e00700 1 -- 172.21.15.2:0/1058261303 learned_addr learned my addr 172.21.15.2:0/1058261303 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.187+0000 7f8989e00700 1 -- 172.21.15.2:0/1058261303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898c19e5c0 con 0x7f898c10a170 2024-06-13T11:09:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.187+0000 7f8989e00700 1 --2- 172.21.15.2:0/1058261303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898c10a170 0x7f898c19e080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f897c011b60 tx=0x7f897c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.188+0000 7f8982a00700 1 -- 172.21.15.2:0/1058261303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c003b20 con 0x7f898c10a170 2024-06-13T11:09:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.188+0000 7f8982a00700 1 -- 172.21.15.2:0/1058261303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f897c003cc0 con 0x7f898c10a170 2024-06-13T11:09:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.188+0000 7f8990a00700 1 -- 172.21.15.2:0/1058261303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898c19e850 con 0x7f898c10a170 2024-06-13T11:09:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.188+0000 7f8982a00700 1 -- 172.21.15.2:0/1058261303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c0247d0 con 0x7f898c10a170 2024-06-13T11:09:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.188+0000 7f8990a00700 1 -- 172.21.15.2:0/1058261303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f898c1a1540 con 0x7f898c10a170 2024-06-13T11:09:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.189+0000 7f8982a00700 1 -- 172.21.15.2:0/1058261303 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f897c022020 con 0x7f898c10a170 2024-06-13T11:09:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.189+0000 7f8990a00700 1 -- 172.21.15.2:0/1058261303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f898c10e740 con 0x7f898c10a170 2024-06-13T11:09:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.189+0000 7f8982a00700 1 --2- 172.21.15.2:0/1058261303 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f8970039050 0x7f897003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.189+0000 7f8982a00700 1 -- 172.21.15.2:0/1058261303 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f897c011e00 con 0x7f898c10a170 2024-06-13T11:09:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.190+0000 7f8983e00700 1 --2- 172.21.15.2:0/1058261303 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f8970039050 0x7f897003b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.191+0000 7f8983e00700 1 --2- 172.21.15.2:0/1058261303 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f8970039050 0x7f897003b510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8974006fd0 tx=0x7f8974006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.195+0000 7f8982a00700 1 -- 172.21.15.2:0/1058261303 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f897c04ca40 con 0x7f898c10a170 2024-06-13T11:09:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.421+0000 7f8990a00700 1 -- 172.21.15.2:0/1058261303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f898c063af0 con 0x7f898c10a170 2024-06-13T11:09:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.422+0000 7f8982a00700 1 -- 172.21.15.2:0/1058261303 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+373 (secure 0 0 0) 0x7f897c01aba0 con 0x7f898c10a170 2024-06-13T11:09:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.425+0000 7f8990a00700 1 -- 172.21.15.2:0/1058261303 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f8970039050 msgr2=0x7f897003b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.425+0000 7f8990a00700 1 --2- 172.21.15.2:0/1058261303 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f8970039050 0x7f897003b510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8974006fd0 tx=0x7f8974006e40 comp rx=0 tx=0).stop 2024-06-13T11:09:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.425+0000 7f8990a00700 1 -- 172.21.15.2:0/1058261303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898c10a170 msgr2=0x7f898c19e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.425+0000 7f8990a00700 1 --2- 172.21.15.2:0/1058261303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898c10a170 0x7f898c19e080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f897c011b60 tx=0x7f897c011c40 comp rx=0 tx=0).stop 2024-06-13T11:09:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.425+0000 7f8990a00700 1 -- 172.21.15.2:0/1058261303 shutdown_connections 2024-06-13T11:09:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.425+0000 7f8990a00700 1 --2- 172.21.15.2:0/1058261303 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f8970039050 0x7f897003b510 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.425+0000 7f8990a00700 1 --2- 172.21.15.2:0/1058261303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898c10a170 0x7f898c19e080 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.425+0000 7f8990a00700 1 -- 172.21.15.2:0/1058261303 >> 172.21.15.2:0/1058261303 conn(0x7f898c07d5c0 msgr2=0x7f898c107ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.426+0000 7f8990a00700 1 -- 172.21.15.2:0/1058261303 shutdown_connections 2024-06-13T11:09:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:38.426+0000 7f8990a00700 1 -- 172.21.15.2:0/1058261303 wait complete. 2024-06-13T11:09:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling cephadm module... 2024-06-13T11:09:40.395 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:40 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: ignoring --setuser ceph since I am not root 2024-06-13T11:09:40.396 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:40 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: ignoring --setgroup ceph since I am not root 2024-06-13T11:09:40.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:40 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1632714106' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-06-13T11:09:40.692 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:40 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:40.441+0000 7f5993d0d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T11:09:40.692 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:40 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:40.691+0000 7f5993d0d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:09:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.788+0000 7f9d6f600700 1 Processor -- start 2024-06-13T11:09:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.788+0000 7f9d6f600700 1 -- start start 2024-06-13T11:09:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.789+0000 7f9d6f600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d6810a170 0x7f9d6810a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.789+0000 7f9d6f600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6810ab60 con 0x7f9d6810a170 2024-06-13T11:09:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.789+0000 7f9d6cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d6810a170 0x7f9d6810a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.789+0000 7f9d6cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d6810a170 0x7f9d6810a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35636/0 (socket says 172.21.15.2:35636) 2024-06-13T11:09:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.789+0000 7f9d6cc00700 1 -- 172.21.15.2:0/496327239 learned_addr learned my addr 172.21.15.2:0/496327239 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.790+0000 7f9d6cc00700 1 -- 172.21.15.2:0/496327239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6810b3c0 con 0x7f9d6810a170 2024-06-13T11:09:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.790+0000 7f9d6cc00700 1 --2- 172.21.15.2:0/496327239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d6810a170 0x7f9d6810a590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c0098a0 tx=0x7f9d5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc36e037fc9c4670 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.791+0000 7f9d67400700 1 -- 172.21.15.2:0/496327239 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d5c004160 con 0x7f9d6810a170 2024-06-13T11:09:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.791+0000 7f9d67400700 1 -- 172.21.15.2:0/496327239 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d5c004300 con 0x7f9d6810a170 2024-06-13T11:09:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.791+0000 7f9d67400700 1 -- 172.21.15.2:0/496327239 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d5c011b50 con 0x7f9d6810a170 2024-06-13T11:09:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.791+0000 7f9d6f600700 1 -- 172.21.15.2:0/496327239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d6810a170 msgr2=0x7f9d6810a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.791+0000 7f9d6f600700 1 --2- 172.21.15.2:0/496327239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d6810a170 0x7f9d6810a590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c0098a0 tx=0x7f9d5c009bb0 comp rx=0 tx=0).stop 2024-06-13T11:09:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.792+0000 7f9d6f600700 1 -- 172.21.15.2:0/496327239 shutdown_connections 2024-06-13T11:09:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.792+0000 7f9d6f600700 1 --2- 172.21.15.2:0/496327239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d6810a170 0x7f9d6810a590 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.792+0000 7f9d6f600700 1 -- 172.21.15.2:0/496327239 >> 172.21.15.2:0/496327239 conn(0x7f9d6807d6e0 msgr2=0x7f9d6807db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.792+0000 7f9d6f600700 1 -- 172.21.15.2:0/496327239 shutdown_connections 2024-06-13T11:09:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.792+0000 7f9d6f600700 1 -- 172.21.15.2:0/496327239 wait complete. 2024-06-13T11:09:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.793+0000 7f9d6f600700 1 Processor -- start 2024-06-13T11:09:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.793+0000 7f9d6f600700 1 -- start start 2024-06-13T11:09:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.793+0000 7f9d6f600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d6810a170 0x7f9d6819e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.793+0000 7f9d6f600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6810e5f0 con 0x7f9d6810a170 2024-06-13T11:09:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.794+0000 7f9d6cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d6810a170 0x7f9d6819e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.794+0000 7f9d6cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d6810a170 0x7f9d6819e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35650/0 (socket says 172.21.15.2:35650) 2024-06-13T11:09:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.794+0000 7f9d6cc00700 1 -- 172.21.15.2:0/1632714106 learned_addr learned my addr 172.21.15.2:0/1632714106 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.794+0000 7f9d6cc00700 1 -- 172.21.15.2:0/1632714106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6819e630 con 0x7f9d6810a170 2024-06-13T11:09:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.794+0000 7f9d6cc00700 1 --2- 172.21.15.2:0/1632714106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d6810a170 0x7f9d6819e0f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c011b60 tx=0x7f9d5c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.795+0000 7f9d65600700 1 -- 172.21.15.2:0/1632714106 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d5c003970 con 0x7f9d6810a170 2024-06-13T11:09:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.795+0000 7f9d65600700 1 -- 172.21.15.2:0/1632714106 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d5c003b10 con 0x7f9d6810a170 2024-06-13T11:09:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.795+0000 7f9d65600700 1 -- 172.21.15.2:0/1632714106 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d5c024580 con 0x7f9d6810a170 2024-06-13T11:09:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.795+0000 7f9d6f600700 1 -- 172.21.15.2:0/1632714106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d6819e8c0 con 0x7f9d6810a170 2024-06-13T11:09:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.795+0000 7f9d6f600700 1 -- 172.21.15.2:0/1632714106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d681a15b0 con 0x7f9d6810a170 2024-06-13T11:09:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.796+0000 7f9d65600700 1 -- 172.21.15.2:0/1632714106 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f9d5c01a430 con 0x7f9d6810a170 2024-06-13T11:09:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.796+0000 7f9d6f600700 1 -- 172.21.15.2:0/1632714106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d6810e770 con 0x7f9d6810a170 2024-06-13T11:09:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.796+0000 7f9d65600700 1 --2- 172.21.15.2:0/1632714106 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f9d50039050 0x7f9d5003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.796+0000 7f9d65600700 1 -- 172.21.15.2:0/1632714106 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9d5c011e00 con 0x7f9d6810a170 2024-06-13T11:09:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.797+0000 7f9d67e00700 1 --2- 172.21.15.2:0/1632714106 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f9d50039050 0x7f9d5003b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.798+0000 7f9d67e00700 1 --2- 172.21.15.2:0/1632714106 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f9d50039050 0x7f9d5003b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9d54006fd0 tx=0x7f9d54006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:39.802+0000 7f9d65600700 1 -- 172.21.15.2:0/1632714106 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9d5c003d70 con 0x7f9d6810a170 2024-06-13T11:09:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:40.091+0000 7f9d6f600700 1 -- 172.21.15.2:0/1632714106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f9d681a1c00 con 0x7f9d6810a170 2024-06-13T11:09:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:40.144+0000 7f9d65600700 1 -- 172.21.15.2:0/1632714106 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f9d5c01a720 con 0x7f9d6810a170 2024-06-13T11:09:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:40.148+0000 7f9d65600700 1 -- 172.21.15.2:0/1632714106 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f9d5c0247e0 con 0x7f9d6810a170 2024-06-13T11:09:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:40.149+0000 7f9d6f600700 1 -- 172.21.15.2:0/1632714106 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f9d50039050 msgr2=0x7f9d5003b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:40.149+0000 7f9d6f600700 1 --2- 172.21.15.2:0/1632714106 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f9d50039050 0x7f9d5003b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9d54006fd0 tx=0x7f9d54006e40 comp rx=0 tx=0).stop 2024-06-13T11:09:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:40.149+0000 7f9d6f600700 1 -- 172.21.15.2:0/1632714106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d6810a170 msgr2=0x7f9d6819e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:40.149+0000 7f9d6f600700 1 --2- 172.21.15.2:0/1632714106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d6810a170 0x7f9d6819e0f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c011b60 tx=0x7f9d5c011c40 comp rx=0 tx=0).stop 2024-06-13T11:09:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:40.149+0000 7f9d6f600700 1 -- 172.21.15.2:0/1632714106 shutdown_connections 2024-06-13T11:09:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:40.150+0000 7f9d6f600700 1 --2- 172.21.15.2:0/1632714106 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f9d50039050 0x7f9d5003b510 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:40.150+0000 7f9d6f600700 1 --2- 172.21.15.2:0/1632714106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d6810a170 0x7f9d6819e0f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:40.150+0000 7f9d6f600700 1 -- 172.21.15.2:0/1632714106 >> 172.21.15.2:0/1632714106 conn(0x7f9d6807d6e0 msgr2=0x7f9d68107d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:40.150+0000 7f9d6f600700 1 -- 172.21.15.2:0/1632714106 shutdown_connections 2024-06-13T11:09:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:40.150+0000 7f9d6f600700 1 -- 172.21.15.2:0/1632714106 wait complete. 2024-06-13T11:09:41.010 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:40 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:40.828+0000 7f5993d0d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T11:09:41.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:41 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1632714106' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-06-13T11:09:41.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:41 smithi002 ceph-mon[32210]: mgrmap e5: x(active, since 5s) 2024-06-13T11:09:41.264 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:41 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:41.257+0000 7f5993d0d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T11:09:41.626 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:41 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:41.377+0000 7f5993d0d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T11:09:42.374 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:42 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1563031022' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-13T11:09:42.382 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-06-13T11:09:42.382 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-06-13T11:09:42.383 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-13T11:09:42.383 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-13T11:09:42.383 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-13T11:09:42.383 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-06-13T11:09:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.417+0000 7fd1bf000700 1 Processor -- start 2024-06-13T11:09:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.417+0000 7fd1bf000700 1 -- start start 2024-06-13T11:09:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.417+0000 7fd1bf000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b8107f90 0x7fd1b81083b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.417+0000 7fd1bf000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b8108980 con 0x7fd1b8107f90 2024-06-13T11:09:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.417+0000 7fd1b7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b8107f90 0x7fd1b81083b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.418+0000 7fd1b7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b8107f90 0x7fd1b81083b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35668/0 (socket says 172.21.15.2:35668) 2024-06-13T11:09:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.418+0000 7fd1b7e00700 1 -- 172.21.15.2:0/1304869102 learned_addr learned my addr 172.21.15.2:0/1304869102 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.418+0000 7fd1b7e00700 1 -- 172.21.15.2:0/1304869102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b8109190 con 0x7fd1b8107f90 2024-06-13T11:09:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.418+0000 7fd1b7e00700 1 --2- 172.21.15.2:0/1304869102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b8107f90 0x7fd1b81083b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80098a0 tx=0x7fd1a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89cd7793f997a5ad server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.419+0000 7fd1b6a00700 1 -- 172.21.15.2:0/1304869102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1a8004160 con 0x7fd1b8107f90 2024-06-13T11:09:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.419+0000 7fd1b6a00700 1 -- 172.21.15.2:0/1304869102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd1a8004300 con 0x7fd1b8107f90 2024-06-13T11:09:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.419+0000 7fd1b6a00700 1 -- 172.21.15.2:0/1304869102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1a8011b50 con 0x7fd1b8107f90 2024-06-13T11:09:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.419+0000 7fd1bf000700 1 -- 172.21.15.2:0/1304869102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b8107f90 msgr2=0x7fd1b81083b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:42.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.419+0000 7fd1bf000700 1 --2- 172.21.15.2:0/1304869102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b8107f90 0x7fd1b81083b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80098a0 tx=0x7fd1a8009bb0 comp rx=0 tx=0).stop 2024-06-13T11:09:42.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.420+0000 7fd1bf000700 1 -- 172.21.15.2:0/1304869102 shutdown_connections 2024-06-13T11:09:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.420+0000 7fd1bf000700 1 --2- 172.21.15.2:0/1304869102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b8107f90 0x7fd1b81083b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.420+0000 7fd1bf000700 1 -- 172.21.15.2:0/1304869102 >> 172.21.15.2:0/1304869102 conn(0x7fd1b8103570 msgr2=0x7fd1b8105990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.420+0000 7fd1bf000700 1 -- 172.21.15.2:0/1304869102 shutdown_connections 2024-06-13T11:09:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.420+0000 7fd1bf000700 1 -- 172.21.15.2:0/1304869102 wait complete. 2024-06-13T11:09:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.421+0000 7fd1bf000700 1 Processor -- start 2024-06-13T11:09:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.421+0000 7fd1bf000700 1 -- start start 2024-06-13T11:09:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.421+0000 7fd1bf000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b8107f90 0x7fd1b807db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.421+0000 7fd1bf000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b810c3c0 con 0x7fd1b8107f90 2024-06-13T11:09:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.421+0000 7fd1b7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b8107f90 0x7fd1b807db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.422+0000 7fd1b7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b8107f90 0x7fd1b807db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35678/0 (socket says 172.21.15.2:35678) 2024-06-13T11:09:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.422+0000 7fd1b7e00700 1 -- 172.21.15.2:0/1563031022 learned_addr learned my addr 172.21.15.2:0/1563031022 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.422+0000 7fd1b7e00700 1 -- 172.21.15.2:0/1563031022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b807e080 con 0x7fd1b8107f90 2024-06-13T11:09:42.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.422+0000 7fd1b7e00700 1 --2- 172.21.15.2:0/1563031022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b8107f90 0x7fd1b807db40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8011850 tx=0x7fd1a8011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:42.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.422+0000 7fd1b4c00700 1 -- 172.21.15.2:0/1563031022 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1a801e070 con 0x7fd1b8107f90 2024-06-13T11:09:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.423+0000 7fd1b4c00700 1 -- 172.21.15.2:0/1563031022 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd1a8003af0 con 0x7fd1b8107f90 2024-06-13T11:09:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.423+0000 7fd1bf000700 1 -- 172.21.15.2:0/1563031022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1b807c270 con 0x7fd1b8107f90 2024-06-13T11:09:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.423+0000 7fd1b4c00700 1 -- 172.21.15.2:0/1563031022 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1a801a5a0 con 0x7fd1b8107f90 2024-06-13T11:09:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.423+0000 7fd1bf000700 1 -- 172.21.15.2:0/1563031022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1b807c7b0 con 0x7fd1b8107f90 2024-06-13T11:09:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.424+0000 7fd1b4c00700 1 -- 172.21.15.2:0/1563031022 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fd1a8023460 con 0x7fd1b8107f90 2024-06-13T11:09:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.424+0000 7fd1bf000700 1 -- 172.21.15.2:0/1563031022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1b8063af0 con 0x7fd1b8107f90 2024-06-13T11:09:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.424+0000 7fd1b4c00700 1 --2- 172.21.15.2:0/1563031022 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7fd19c039100 0x7fd19c03b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.424+0000 7fd1b4c00700 1 -- 172.21.15.2:0/1563031022 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd1a8011e00 con 0x7fd1b8107f90 2024-06-13T11:09:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.424+0000 7fd1b7400700 1 -- 172.21.15.2:0/1563031022 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7fd19c039100 msgr2=0x7fd19c03b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2666864285 2024-06-13T11:09:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.425+0000 7fd1b7400700 1 --2- 172.21.15.2:0/1563031022 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7fd19c039100 0x7fd19c03b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:09:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.430+0000 7fd1b4c00700 1 -- 172.21.15.2:0/1563031022 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd1a802c3f0 con 0x7fd1b8107f90 2024-06-13T11:09:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.626+0000 7fd1b7400700 1 -- 172.21.15.2:0/1563031022 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7fd19c039100 msgr2=0x7fd19c03b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2666864285 2024-06-13T11:09:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.626+0000 7fd1b7400700 1 --2- 172.21.15.2:0/1563031022 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7fd19c039100 0x7fd19c03b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T11:09:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.717+0000 7fd1bf000700 1 -- 172.21.15.2:0/1563031022 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fd1b81a1f80 con 0x7fd1b8107f90 2024-06-13T11:09:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.718+0000 7fd1b4c00700 1 -- 172.21.15.2:0/1563031022 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fd1a8023750 con 0x7fd1b8107f90 2024-06-13T11:09:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.720+0000 7fd1bf000700 1 -- 172.21.15.2:0/1563031022 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7fd19c039100 msgr2=0x7fd19c03b5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:09:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.720+0000 7fd1bf000700 1 --2- 172.21.15.2:0/1563031022 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7fd19c039100 0x7fd19c03b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.720+0000 7fd1bf000700 1 -- 172.21.15.2:0/1563031022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b8107f90 msgr2=0x7fd1b807db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.720+0000 7fd1bf000700 1 --2- 172.21.15.2:0/1563031022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b8107f90 0x7fd1b807db40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8011850 tx=0x7fd1a8011c10 comp rx=0 tx=0).stop 2024-06-13T11:09:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.721+0000 7fd1bf000700 1 -- 172.21.15.2:0/1563031022 shutdown_connections 2024-06-13T11:09:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.721+0000 7fd1bf000700 1 --2- 172.21.15.2:0/1563031022 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7fd19c039100 0x7fd19c03b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.721+0000 7fd1bf000700 1 --2- 172.21.15.2:0/1563031022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b8107f90 0x7fd1b807db40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.721+0000 7fd1bf000700 1 -- 172.21.15.2:0/1563031022 >> 172.21.15.2:0/1563031022 conn(0x7fd1b8103570 msgr2=0x7fd1b81040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.721+0000 7fd1bf000700 1 -- 172.21.15.2:0/1563031022 shutdown_connections 2024-06-13T11:09:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:41.721+0000 7fd1bf000700 1 -- 172.21.15.2:0/1563031022 wait complete. 2024-06-13T11:09:42.396 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-06-13T11:09:42.396 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 5... 2024-06-13T11:09:43.290 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:43 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:43.006+0000 7f5993d0d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T11:09:43.381 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:43 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:43.241+0000 7f5993d0d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T11:09:43.645 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:43 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:43.462+0000 7f5993d0d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T11:09:43.985 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:43 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:43.857+0000 7f5993d0d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T11:09:44.244 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:43 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:43.984+0000 7f5993d0d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T11:09:44.508 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:44 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:44.244+0000 7f5993d0d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T11:09:44.895 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:44 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:44.508+0000 7f5993d0d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:09:45.645 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:45 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:45.334+0000 7f5993d0d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T11:09:46.319 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:45 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:45.908+0000 7f5993d0d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T11:09:46.319 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:46 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:46.042+0000 7f5993d0d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T11:09:46.319 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:46 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:46.319+0000 7f5993d0d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T11:09:47.395 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:46 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:46.993+0000 7f5993d0d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T11:09:47.396 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:47 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:47.121+0000 7f5993d0d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T11:09:47.780 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:47 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:47.459+0000 7f5993d0d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T11:09:47.780 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:47 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:47.647+0000 7f5993d0d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T11:09:47.780 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:47 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:47.779+0000 7f5993d0d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T11:09:48.146 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:47 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:47.940+0000 7f5993d0d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T11:09:48.645 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:48 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:48.320+0000 7f5993d0d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T11:09:49.395 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:49 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:49.112+0000 7f5993d0d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T11:09:49.896 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:49 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:09:49.415+0000 7f5993d0d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T11:09:49.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:49 smithi002 ceph-mon[32210]: Active manager daemon x restarted 2024-06-13T11:09:49.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:49 smithi002 ceph-mon[32210]: Activating manager daemon x 2024-06-13T11:09:49.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:49 smithi002 ceph-mon[32210]: osdmap e2: 0 total, 0 up, 0 in 2024-06-13T11:09:49.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:49 smithi002 ceph-mon[32210]: mgrmap e6: x(active, starting, since 0.00518219s) 2024-06-13T11:09:49.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:49 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:09:49.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:49 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-13T11:09:49.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:49 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-13T11:09:49.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:49 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-13T11:09:49.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:49 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-13T11:09:49.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:49 smithi002 ceph-mon[32210]: Manager daemon x is now available 2024-06-13T11:09:49.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:49 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' 2024-06-13T11:09:49.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:49 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' 2024-06-13T11:09:50.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:50 smithi002 ceph-mon[32210]: Found migration_current of "None". Setting to last migration. 2024-06-13T11:09:50.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:50 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:09:50.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:50 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:09:50.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:50 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T11:09:50.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:50 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T11:09:50.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:50 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' 2024-06-13T11:09:50.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:50 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' 2024-06-13T11:09:50.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:50 smithi002 ceph-mon[32210]: mgrmap e7: x(active, since 1.01548s) 2024-06-13T11:09:51.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-06-13T11:09:51.260 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-06-13T11:09:51.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-13T11:09:51.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-06-13T11:09:51.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.079+0000 7f70d1c00700 1 Processor -- start 2024-06-13T11:09:51.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.080+0000 7f70d1c00700 1 -- start start 2024-06-13T11:09:51.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.080+0000 7f70d1c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc07deb0 0x7f70cc07c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:51.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.080+0000 7f70d1c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc07c8e0 con 0x7f70cc07deb0 2024-06-13T11:09:51.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.080+0000 7f70caa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc07deb0 0x7f70cc07c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:51.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.081+0000 7f70caa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc07deb0 0x7f70cc07c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35686/0 (socket says 172.21.15.2:35686) 2024-06-13T11:09:51.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.081+0000 7f70caa00700 1 -- 172.21.15.2:0/2720033908 learned_addr learned my addr 172.21.15.2:0/2720033908 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:51.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.081+0000 7f70caa00700 1 -- 172.21.15.2:0/2720033908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70cc07ca60 con 0x7f70cc07deb0 2024-06-13T11:09:51.264 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.081+0000 7f70caa00700 1 --2- 172.21.15.2:0/2720033908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc07deb0 0x7f70cc07c310 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f70bc009e80 tx=0x7f70bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e248829883d4b20 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:51.264 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.082+0000 7f70c9600700 1 -- 172.21.15.2:0/2720033908 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70bc017070 con 0x7f70cc07deb0 2024-06-13T11:09:51.264 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.082+0000 7f70c9600700 1 -- 172.21.15.2:0/2720033908 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f70bc00b8c0 con 0x7f70cc07deb0 2024-06-13T11:09:51.264 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.082+0000 7f70c9600700 1 -- 172.21.15.2:0/2720033908 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70bc0045c0 con 0x7f70cc07deb0 2024-06-13T11:09:51.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.082+0000 7f70d1c00700 1 -- 172.21.15.2:0/2720033908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc07deb0 msgr2=0x7f70cc07c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:51.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.082+0000 7f70d1c00700 1 --2- 172.21.15.2:0/2720033908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc07deb0 0x7f70cc07c310 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f70bc009e80 tx=0x7f70bc00b330 comp rx=0 tx=0).stop 2024-06-13T11:09:51.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.083+0000 7f70d1c00700 1 -- 172.21.15.2:0/2720033908 shutdown_connections 2024-06-13T11:09:51.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.083+0000 7f70d1c00700 1 --2- 172.21.15.2:0/2720033908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc07deb0 0x7f70cc07c310 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:51.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.083+0000 7f70d1c00700 1 -- 172.21.15.2:0/2720033908 >> 172.21.15.2:0/2720033908 conn(0x7f70cc1034e0 msgr2=0x7f70cc105940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:51.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.083+0000 7f70d1c00700 1 -- 172.21.15.2:0/2720033908 shutdown_connections 2024-06-13T11:09:51.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.083+0000 7f70d1c00700 1 -- 172.21.15.2:0/2720033908 wait complete. 2024-06-13T11:09:51.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.084+0000 7f70d1c00700 1 Processor -- start 2024-06-13T11:09:51.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.085+0000 7f70d1c00700 1 -- start start 2024-06-13T11:09:51.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.085+0000 7f70d1c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc07deb0 0x7f70cc19e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:51.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.085+0000 7f70d1c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc10e4b0 con 0x7f70cc07deb0 2024-06-13T11:09:51.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.085+0000 7f70caa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc07deb0 0x7f70cc19e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:51.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.085+0000 7f70caa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc07deb0 0x7f70cc19e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35694/0 (socket says 172.21.15.2:35694) 2024-06-13T11:09:51.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.085+0000 7f70caa00700 1 -- 172.21.15.2:0/3231778380 learned_addr learned my addr 172.21.15.2:0/3231778380 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:51.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.086+0000 7f70caa00700 1 -- 172.21.15.2:0/3231778380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70cc19e5a0 con 0x7f70cc07deb0 2024-06-13T11:09:51.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.086+0000 7f70caa00700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc07deb0 0x7f70cc19e060 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f70bc009530 tx=0x7f70bc00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:51.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.086+0000 7f70c3400700 1 -- 172.21.15.2:0/3231778380 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70bc020020 con 0x7f70cc07deb0 2024-06-13T11:09:51.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.086+0000 7f70c3400700 1 -- 172.21.15.2:0/3231778380 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f70bc003b50 con 0x7f70cc07deb0 2024-06-13T11:09:51.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.086+0000 7f70c3400700 1 -- 172.21.15.2:0/3231778380 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70bc017040 con 0x7f70cc07deb0 2024-06-13T11:09:51.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.086+0000 7f70d1c00700 1 -- 172.21.15.2:0/3231778380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70cc19e830 con 0x7f70cc07deb0 2024-06-13T11:09:51.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.087+0000 7f70d1c00700 1 -- 172.21.15.2:0/3231778380 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70cc1a1520 con 0x7f70cc07deb0 2024-06-13T11:09:51.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.088+0000 7f70c3400700 1 -- 172.21.15.2:0/3231778380 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f70bc023020 con 0x7f70cc07deb0 2024-06-13T11:09:51.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.089+0000 7f70c3400700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f70b00390f0 0x7f70b003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:51.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.089+0000 7f70c3400700 1 -- 172.21.15.2:0/3231778380 --> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f70b003bcc0 con 0x7f70b00390f0 2024-06-13T11:09:51.269 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.089+0000 7f70c3400700 1 -- 172.21.15.2:0/3231778380 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f70bc00f050 con 0x7f70cc07deb0 2024-06-13T11:09:51.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.089+0000 7f70ca000700 1 -- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f70b00390f0 msgr2=0x7f70b003b5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2666864285 2024-06-13T11:09:51.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.089+0000 7f70ca000700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f70b00390f0 0x7f70b003b5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:09:51.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.290+0000 7f70ca000700 1 -- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f70b00390f0 msgr2=0x7f70b003b5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2666864285 2024-06-13T11:09:51.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.290+0000 7f70ca000700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f70b00390f0 0x7f70b003b5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T11:09:51.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.691+0000 7f70ca000700 1 -- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f70b00390f0 msgr2=0x7f70b003b5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2666864285 2024-06-13T11:09:51.270 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:43.691+0000 7f70ca000700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f70b00390f0 0x7f70b003b5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-13T11:09:51.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:44.492+0000 7f70ca000700 1 -- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f70b00390f0 msgr2=0x7f70b003b5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2666864285 2024-06-13T11:09:51.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:44.492+0000 7f70ca000700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f70b00390f0 0x7f70b003b5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-13T11:09:51.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:46.094+0000 7f70ca000700 1 -- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f70b00390f0 msgr2=0x7f70b003b5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2666864285 2024-06-13T11:09:51.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:46.094+0000 7f70ca000700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f70b00390f0 0x7f70b003b5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-13T11:09:51.271 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:49.297+0000 7f70ca000700 1 -- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f70b00390f0 msgr2=0x7f70b003b5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2666864285 2024-06-13T11:09:51.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:49.298+0000 7f70ca000700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f70b00390f0 0x7f70b003b5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-06-13T11:09:51.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:49.422+0000 7f70c3400700 1 -- 172.21.15.2:0/3231778380 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f70bc012950 con 0x7f70cc07deb0 2024-06-13T11:09:51.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:49.422+0000 7f70c3400700 1 -- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f70b00390f0 msgr2=0x7f70b003b5b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:09:51.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:49.422+0000 7f70c3400700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f70b00390f0 0x7f70b003b5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:51.272 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.427+0000 7f70c3400700 1 -- 172.21.15.2:0/3231778380 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f70bc04e590 con 0x7f70cc07deb0 2024-06-13T11:09:51.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.427+0000 7f70c3400700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f70b003ca20 0x7f70b003ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:51.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.427+0000 7f70c3400700 1 -- 172.21.15.2:0/3231778380 --> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f70bc027e70 con 0x7f70b003ca20 2024-06-13T11:09:51.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.429+0000 7f70ca000700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f70b003ca20 0x7f70b003ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:51.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.432+0000 7f70ca000700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f70b003ca20 0x7f70b003ee10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f70b8003a10 tx=0x7f70b80092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:51.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.433+0000 7f70c3400700 1 -- 172.21.15.2:0/3231778380 <== mgr.14120 v2:172.21.15.2:6800/1821969949 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f70bc027e70 con 0x7f70b003ca20 2024-06-13T11:09:51.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.442+0000 7f70d1c00700 1 -- 172.21.15.2:0/3231778380 --> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f70cc063af0 con 0x7f70b003ca20 2024-06-13T11:09:51.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.442+0000 7f70c3400700 1 -- 172.21.15.2:0/3231778380 <== mgr.14120 v2:172.21.15.2:6800/1821969949 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f70cc063af0 con 0x7f70b003ca20 2024-06-13T11:09:51.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.442+0000 7f70d1c00700 1 -- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f70b003ca20 msgr2=0x7f70b003ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:51.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.442+0000 7f70d1c00700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f70b003ca20 0x7f70b003ee10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f70b8003a10 tx=0x7f70b80092b0 comp rx=0 tx=0).stop 2024-06-13T11:09:51.275 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.442+0000 7f70d1c00700 1 -- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc07deb0 msgr2=0x7f70cc19e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:51.275 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.442+0000 7f70d1c00700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc07deb0 0x7f70cc19e060 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f70bc009530 tx=0x7f70bc00bd50 comp rx=0 tx=0).stop 2024-06-13T11:09:51.275 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.443+0000 7f70d1c00700 1 -- 172.21.15.2:0/3231778380 shutdown_connections 2024-06-13T11:09:51.276 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.443+0000 7f70d1c00700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f70b003ca20 0x7f70b003ee10 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:51.276 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.443+0000 7f70d1c00700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70cc07deb0 0x7f70cc19e060 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:51.276 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.443+0000 7f70d1c00700 1 --2- 172.21.15.2:0/3231778380 >> [v2:172.21.15.2:6800/2666864285,v1:172.21.15.2:6801/2666864285] conn(0x7f70b00390f0 0x7f70b003b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:51.276 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.443+0000 7f70d1c00700 1 -- 172.21.15.2:0/3231778380 >> 172.21.15.2:0/3231778380 conn(0x7f70cc1034e0 msgr2=0x7f70cc104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:51.276 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.443+0000 7f70d1c00700 1 -- 172.21.15.2:0/3231778380 shutdown_connections 2024-06-13T11:09:51.276 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:50.443+0000 7f70d1c00700 1 -- 172.21.15.2:0/3231778380 wait complete. 2024-06-13T11:09:51.277 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 5 is available 2024-06-13T11:09:51.277 INFO:teuthology.orchestra.run.smithi002.stdout:Setting orchestrator backend to cephadm... 2024-06-13T11:09:51.595 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:51 smithi002 ceph-mon[32210]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-13T11:09:51.595 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:51 smithi002 ceph-mon[32210]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-13T11:09:52.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:52 smithi002 ceph-mon[32210]: [13/Jun/2024:11:09:51] ENGINE Bus STARTING 2024-06-13T11:09:52.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:52 smithi002 ceph-mon[32210]: [13/Jun/2024:11:09:51] ENGINE Serving on http://172.21.15.2:8765 2024-06-13T11:09:52.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:52 smithi002 ceph-mon[32210]: mgrmap e8: x(active, since 2s) 2024-06-13T11:09:52.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:52 smithi002 ceph-mon[32210]: [13/Jun/2024:11:09:51] ENGINE Serving on https://172.21.15.2:7150 2024-06-13T11:09:52.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:52 smithi002 ceph-mon[32210]: [13/Jun/2024:11:09:51] ENGINE Bus STARTED 2024-06-13T11:09:52.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:52 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:09:52.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:52 smithi002 ceph-mon[32210]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:09:52.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:52 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' 2024-06-13T11:09:52.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:52 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:09:53.082 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.903+0000 7fe1cb200700 1 Processor -- start 2024-06-13T11:09:53.082 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.903+0000 7fe1cb200700 1 -- start start 2024-06-13T11:09:53.082 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.904+0000 7fe1cb200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1cc07de70 0x7fe1cc07c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:53.082 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.904+0000 7fe1cb200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc07c8a0 con 0x7fe1cc07de70 2024-06-13T11:09:53.082 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.904+0000 7fe1c9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1cc07de70 0x7fe1cc07c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:53.082 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.904+0000 7fe1c9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1cc07de70 0x7fe1cc07c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38748/0 (socket says 172.21.15.2:38748) 2024-06-13T11:09:53.082 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.904+0000 7fe1c9e00700 1 -- 172.21.15.2:0/3993469014 learned_addr learned my addr 172.21.15.2:0/3993469014 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:53.082 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.905+0000 7fe1c9e00700 1 -- 172.21.15.2:0/3993469014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc07ca20 con 0x7fe1cc07de70 2024-06-13T11:09:53.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.905+0000 7fe1c9e00700 1 --2- 172.21.15.2:0/3993469014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1cc07de70 0x7fe1cc07c2d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0098a0 tx=0x7fe1bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b5879994dd69e0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:53.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.905+0000 7fe1c8a00700 1 -- 172.21.15.2:0/3993469014 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1bc004160 con 0x7fe1cc07de70 2024-06-13T11:09:53.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.905+0000 7fe1c8a00700 1 -- 172.21.15.2:0/3993469014 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe1bc004300 con 0x7fe1cc07de70 2024-06-13T11:09:53.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.905+0000 7fe1c8a00700 1 -- 172.21.15.2:0/3993469014 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1bc011b50 con 0x7fe1cc07de70 2024-06-13T11:09:53.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.906+0000 7fe1cb200700 1 -- 172.21.15.2:0/3993469014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1cc07de70 msgr2=0x7fe1cc07c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.906+0000 7fe1cb200700 1 --2- 172.21.15.2:0/3993469014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1cc07de70 0x7fe1cc07c2d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0098a0 tx=0x7fe1bc009bb0 comp rx=0 tx=0).stop 2024-06-13T11:09:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.906+0000 7fe1cb200700 1 -- 172.21.15.2:0/3993469014 shutdown_connections 2024-06-13T11:09:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.906+0000 7fe1cb200700 1 --2- 172.21.15.2:0/3993469014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1cc07de70 0x7fe1cc07c2d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.906+0000 7fe1cb200700 1 -- 172.21.15.2:0/3993469014 >> 172.21.15.2:0/3993469014 conn(0x7fe1cc1033b0 msgr2=0x7fe1cc1057d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.906+0000 7fe1cb200700 1 -- 172.21.15.2:0/3993469014 shutdown_connections 2024-06-13T11:09:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.906+0000 7fe1cb200700 1 -- 172.21.15.2:0/3993469014 wait complete. 2024-06-13T11:09:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.907+0000 7fe1cb200700 1 Processor -- start 2024-06-13T11:09:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.907+0000 7fe1cb200700 1 -- start start 2024-06-13T11:09:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.908+0000 7fe1cb200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1cc07de70 0x7fe1cc19df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.908+0000 7fe1cb200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc10e2f0 con 0x7fe1cc07de70 2024-06-13T11:09:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.908+0000 7fe1c9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1cc07de70 0x7fe1cc19df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.908+0000 7fe1c9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1cc07de70 0x7fe1cc19df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38758/0 (socket says 172.21.15.2:38758) 2024-06-13T11:09:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.908+0000 7fe1c9e00700 1 -- 172.21.15.2:0/1524959073 learned_addr learned my addr 172.21.15.2:0/1524959073 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.908+0000 7fe1c9e00700 1 -- 172.21.15.2:0/1524959073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc19e470 con 0x7fe1cc07de70 2024-06-13T11:09:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.909+0000 7fe1c9e00700 1 --2- 172.21.15.2:0/1524959073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1cc07de70 0x7fe1cc19df30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc011850 tx=0x7fe1bc011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.909+0000 7fe1c2a00700 1 -- 172.21.15.2:0/1524959073 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1bc003af0 con 0x7fe1cc07de70 2024-06-13T11:09:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.909+0000 7fe1c2a00700 1 -- 172.21.15.2:0/1524959073 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe1bc020070 con 0x7fe1cc07de70 2024-06-13T11:09:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.909+0000 7fe1c2a00700 1 -- 172.21.15.2:0/1524959073 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1bc0195a0 con 0x7fe1cc07de70 2024-06-13T11:09:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.909+0000 7fe1cb200700 1 -- 172.21.15.2:0/1524959073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1cc19e700 con 0x7fe1cc07de70 2024-06-13T11:09:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.909+0000 7fe1cb200700 1 -- 172.21.15.2:0/1524959073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1cc1a13f0 con 0x7fe1cc07de70 2024-06-13T11:09:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.910+0000 7fe1c2a00700 1 -- 172.21.15.2:0/1524959073 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe1bc019850 con 0x7fe1cc07de70 2024-06-13T11:09:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.910+0000 7fe1cb200700 1 -- 172.21.15.2:0/1524959073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1cc063af0 con 0x7fe1cc07de70 2024-06-13T11:09:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.911+0000 7fe1c2a00700 1 --2- 172.21.15.2:0/1524959073 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fe1b00390a0 0x7fe1b003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.911+0000 7fe1c2a00700 1 -- 172.21.15.2:0/1524959073 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe1bc011e00 con 0x7fe1cc07de70 2024-06-13T11:09:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.911+0000 7fe1c9400700 1 --2- 172.21.15.2:0/1524959073 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fe1b00390a0 0x7fe1b003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.912+0000 7fe1c9400700 1 --2- 172.21.15.2:0/1524959073 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fe1b00390a0 0x7fe1b003b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8006fd0 tx=0x7fe1b8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:51.916+0000 7fe1c2a00700 1 -- 172.21.15.2:0/1524959073 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe1bc00e260 con 0x7fe1cc07de70 2024-06-13T11:09:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:52.160+0000 7fe1cb200700 1 -- 172.21.15.2:0/1524959073 --> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fe1cc104670 con 0x7fe1b00390a0 2024-06-13T11:09:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:52.171+0000 7fe1c2a00700 1 -- 172.21.15.2:0/1524959073 <== mgr.14120 v2:172.21.15.2:6800/1821969949 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe1cc104670 con 0x7fe1b00390a0 2024-06-13T11:09:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:52.174+0000 7fe1cb200700 1 -- 172.21.15.2:0/1524959073 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fe1b00390a0 msgr2=0x7fe1b003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:52.174+0000 7fe1cb200700 1 --2- 172.21.15.2:0/1524959073 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fe1b00390a0 0x7fe1b003b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8006fd0 tx=0x7fe1b8006e40 comp rx=0 tx=0).stop 2024-06-13T11:09:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:52.174+0000 7fe1cb200700 1 -- 172.21.15.2:0/1524959073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1cc07de70 msgr2=0x7fe1cc19df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:53.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:52.174+0000 7fe1cb200700 1 --2- 172.21.15.2:0/1524959073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1cc07de70 0x7fe1cc19df30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc011850 tx=0x7fe1bc011c10 comp rx=0 tx=0).stop 2024-06-13T11:09:53.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:52.175+0000 7fe1cb200700 1 -- 172.21.15.2:0/1524959073 shutdown_connections 2024-06-13T11:09:53.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:52.175+0000 7fe1cb200700 1 --2- 172.21.15.2:0/1524959073 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fe1b00390a0 0x7fe1b003b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:53.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:52.175+0000 7fe1cb200700 1 --2- 172.21.15.2:0/1524959073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1cc07de70 0x7fe1cc19df30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:53.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:52.175+0000 7fe1cb200700 1 -- 172.21.15.2:0/1524959073 >> 172.21.15.2:0/1524959073 conn(0x7fe1cc1033b0 msgr2=0x7fe1cc103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:53.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:52.175+0000 7fe1cb200700 1 -- 172.21.15.2:0/1524959073 shutdown_connections 2024-06-13T11:09:53.090 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:52.175+0000 7fe1cb200700 1 -- 172.21.15.2:0/1524959073 wait complete. 2024-06-13T11:09:54.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:54 smithi002 ceph-mon[32210]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:09:54.716 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout value unchanged 2024-06-13T11:09:54.716 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.727+0000 7fcfa1800700 1 Processor -- start 2024-06-13T11:09:54.717 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.727+0000 7fcfa1800700 1 -- start start 2024-06-13T11:09:54.717 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.728+0000 7fcfa1800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf9c10a170 0x7fcf9c10a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:54.717 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.728+0000 7fcfa1800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c10ab60 con 0x7fcf9c10a170 2024-06-13T11:09:54.717 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.728+0000 7fcf9aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf9c10a170 0x7fcf9c10a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:54.717 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.728+0000 7fcf9aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf9c10a170 0x7fcf9c10a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38760/0 (socket says 172.21.15.2:38760) 2024-06-13T11:09:54.717 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.728+0000 7fcf9aa00700 1 -- 172.21.15.2:0/2247489226 learned_addr learned my addr 172.21.15.2:0/2247489226 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:54.717 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.729+0000 7fcf9aa00700 1 -- 172.21.15.2:0/2247489226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9c10b3c0 con 0x7fcf9c10a170 2024-06-13T11:09:54.717 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.729+0000 7fcf9aa00700 1 --2- 172.21.15.2:0/2247489226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf9c10a170 0x7fcf9c10a590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0098a0 tx=0x7fcf8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def9e8e4566db4c2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:54.717 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.729+0000 7fcf99600700 1 -- 172.21.15.2:0/2247489226 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf8c004160 con 0x7fcf9c10a170 2024-06-13T11:09:54.717 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.729+0000 7fcf99600700 1 -- 172.21.15.2:0/2247489226 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcf8c004300 con 0x7fcf9c10a170 2024-06-13T11:09:54.717 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.729+0000 7fcf99600700 1 -- 172.21.15.2:0/2247489226 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf8c011b50 con 0x7fcf9c10a170 2024-06-13T11:09:54.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.730+0000 7fcfa1800700 1 -- 172.21.15.2:0/2247489226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf9c10a170 msgr2=0x7fcf9c10a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:54.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.730+0000 7fcfa1800700 1 --2- 172.21.15.2:0/2247489226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf9c10a170 0x7fcf9c10a590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0098a0 tx=0x7fcf8c009bb0 comp rx=0 tx=0).stop 2024-06-13T11:09:54.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.730+0000 7fcfa1800700 1 -- 172.21.15.2:0/2247489226 shutdown_connections 2024-06-13T11:09:54.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.730+0000 7fcfa1800700 1 --2- 172.21.15.2:0/2247489226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf9c10a170 0x7fcf9c10a590 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:54.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.730+0000 7fcfa1800700 1 -- 172.21.15.2:0/2247489226 >> 172.21.15.2:0/2247489226 conn(0x7fcf9c07d6e0 msgr2=0x7fcf9c07db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:54.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.731+0000 7fcfa1800700 1 -- 172.21.15.2:0/2247489226 shutdown_connections 2024-06-13T11:09:54.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.731+0000 7fcfa1800700 1 -- 172.21.15.2:0/2247489226 wait complete. 2024-06-13T11:09:54.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.732+0000 7fcfa1800700 1 Processor -- start 2024-06-13T11:09:54.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.732+0000 7fcfa1800700 1 -- start start 2024-06-13T11:09:54.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.732+0000 7fcfa1800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf9c10a170 0x7fcf9c19e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:54.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.732+0000 7fcfa1800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c10e5f0 con 0x7fcf9c10a170 2024-06-13T11:09:54.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.732+0000 7fcf9aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf9c10a170 0x7fcf9c19e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:54.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.733+0000 7fcf9aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf9c10a170 0x7fcf9c19e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38766/0 (socket says 172.21.15.2:38766) 2024-06-13T11:09:54.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.733+0000 7fcf9aa00700 1 -- 172.21.15.2:0/494748466 learned_addr learned my addr 172.21.15.2:0/494748466 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:54.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.733+0000 7fcf9aa00700 1 -- 172.21.15.2:0/494748466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9c19e650 con 0x7fcf9c10a170 2024-06-13T11:09:54.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.733+0000 7fcf9aa00700 1 --2- 172.21.15.2:0/494748466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf9c10a170 0x7fcf9c19e110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009fb0 tx=0x7fcf8c011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:54.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.734+0000 7fcf93400700 1 -- 172.21.15.2:0/494748466 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf8c0038b0 con 0x7fcf9c10a170 2024-06-13T11:09:54.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.734+0000 7fcf93400700 1 -- 172.21.15.2:0/494748466 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcf8c011e50 con 0x7fcf9c10a170 2024-06-13T11:09:54.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.734+0000 7fcfa1800700 1 -- 172.21.15.2:0/494748466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9c19e8e0 con 0x7fcf9c10a170 2024-06-13T11:09:54.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.734+0000 7fcf93400700 1 -- 172.21.15.2:0/494748466 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf8c0193c0 con 0x7fcf9c10a170 2024-06-13T11:09:54.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.734+0000 7fcfa1800700 1 -- 172.21.15.2:0/494748466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf9c1a15d0 con 0x7fcf9c10a170 2024-06-13T11:09:54.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.735+0000 7fcfa1800700 1 -- 172.21.15.2:0/494748466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf9c10e770 con 0x7fcf9c10a170 2024-06-13T11:09:54.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.735+0000 7fcf93400700 1 -- 172.21.15.2:0/494748466 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fcf8c003a50 con 0x7fcf9c10a170 2024-06-13T11:09:54.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.735+0000 7fcf93400700 1 --2- 172.21.15.2:0/494748466 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fcf80039000 0x7fcf8003b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:54.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.736+0000 7fcf93400700 1 -- 172.21.15.2:0/494748466 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcf8c04d270 con 0x7fcf9c10a170 2024-06-13T11:09:54.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.736+0000 7fcf9a000700 1 --2- 172.21.15.2:0/494748466 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fcf80039000 0x7fcf8003b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:54.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.736+0000 7fcf9a000700 1 --2- 172.21.15.2:0/494748466 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fcf80039000 0x7fcf8003b4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcf88006fd0 tx=0x7fcf88006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:54.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.742+0000 7fcf93400700 1 -- 172.21.15.2:0/494748466 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcf8c04cc00 con 0x7fcf9c10a170 2024-06-13T11:09:54.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.971+0000 7fcfa1800700 1 -- 172.21.15.2:0/494748466 --> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fcf9c108450 con 0x7fcf80039000 2024-06-13T11:09:54.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.973+0000 7fcf93400700 1 -- 172.21.15.2:0/494748466 <== mgr.14120 v2:172.21.15.2:6800/1821969949 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fcf9c108450 con 0x7fcf80039000 2024-06-13T11:09:54.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.975+0000 7fcfa1800700 1 -- 172.21.15.2:0/494748466 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fcf80039000 msgr2=0x7fcf8003b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:54.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.975+0000 7fcfa1800700 1 --2- 172.21.15.2:0/494748466 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fcf80039000 0x7fcf8003b4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcf88006fd0 tx=0x7fcf88006e40 comp rx=0 tx=0).stop 2024-06-13T11:09:54.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.975+0000 7fcfa1800700 1 -- 172.21.15.2:0/494748466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf9c10a170 msgr2=0x7fcf9c19e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:54.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.975+0000 7fcfa1800700 1 --2- 172.21.15.2:0/494748466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf9c10a170 0x7fcf9c19e110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009fb0 tx=0x7fcf8c011bf0 comp rx=0 tx=0).stop 2024-06-13T11:09:54.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.975+0000 7fcfa1800700 1 -- 172.21.15.2:0/494748466 shutdown_connections 2024-06-13T11:09:54.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.975+0000 7fcfa1800700 1 --2- 172.21.15.2:0/494748466 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fcf80039000 0x7fcf8003b4c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:54.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.975+0000 7fcfa1800700 1 --2- 172.21.15.2:0/494748466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf9c10a170 0x7fcf9c19e110 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:54.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.976+0000 7fcfa1800700 1 -- 172.21.15.2:0/494748466 >> 172.21.15.2:0/494748466 conn(0x7fcf9c07d6e0 msgr2=0x7fcf9c107d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:54.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.976+0000 7fcfa1800700 1 -- 172.21.15.2:0/494748466 shutdown_connections 2024-06-13T11:09:54.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:53.976+0000 7fcfa1800700 1 -- 172.21.15.2:0/494748466 wait complete. 2024-06-13T11:09:54.725 INFO:teuthology.orchestra.run.smithi002.stdout:Generating ssh key... 2024-06-13T11:09:56.288 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: Generating public/private rsa key pair. 2024-06-13T11:09:56.288 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: Your identification has been saved in /tmp/tmpqdlj0vkj/key. 2024-06-13T11:09:56.288 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: Your public key has been saved in /tmp/tmpqdlj0vkj/key.pub. 2024-06-13T11:09:56.288 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: The key fingerprint is: 2024-06-13T11:09:56.288 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: SHA256:S7JtOFDJT7eq4o0X3BXBXBf4PsWwPN0MVgM5YAJASSI ceph-3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:09:56.288 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: The key's randomart image is: 2024-06-13T11:09:56.288 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: +---[RSA 3072]----+ 2024-06-13T11:09:56.288 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: | E .o+o..+.=oo=+.| 2024-06-13T11:09:56.288 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: | . .o . * .++ .| 2024-06-13T11:09:56.288 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: | + . .. +.B.| 2024-06-13T11:09:56.289 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: | . o ... = *| 2024-06-13T11:09:56.289 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: | ....S.. . o | 2024-06-13T11:09:56.289 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: | .o*.o o | 2024-06-13T11:09:56.289 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: | +.= . | 2024-06-13T11:09:56.289 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: | .o.+ | 2024-06-13T11:09:56.289 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: | .ooo | 2024-06-13T11:09:56.289 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:09:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: +----[SHA256]-----+ 2024-06-13T11:09:56.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.446+0000 7fe2be200700 1 Processor -- start 2024-06-13T11:09:56.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.446+0000 7fe2be200700 1 -- start start 2024-06-13T11:09:56.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.446+0000 7fe2be200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b807e6e0 0x7fe2b807cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:56.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.446+0000 7fe2be200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b807d110 con 0x7fe2b807e6e0 2024-06-13T11:09:56.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.447+0000 7fe2b7400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b807e6e0 0x7fe2b807cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:56.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.447+0000 7fe2b7400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b807e6e0 0x7fe2b807cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38768/0 (socket says 172.21.15.2:38768) 2024-06-13T11:09:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.447+0000 7fe2b7400700 1 -- 172.21.15.2:0/1863710658 learned_addr learned my addr 172.21.15.2:0/1863710658 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.447+0000 7fe2b7400700 1 -- 172.21.15.2:0/1863710658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b807d290 con 0x7fe2b807e6e0 2024-06-13T11:09:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.448+0000 7fe2b7400700 1 --2- 172.21.15.2:0/1863710658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b807e6e0 0x7fe2b807cb40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80098a0 tx=0x7fe2a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e8fb3d45ec2e06 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.448+0000 7fe2b6a00700 1 -- 172.21.15.2:0/1863710658 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a8004160 con 0x7fe2b807e6e0 2024-06-13T11:09:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.448+0000 7fe2b6a00700 1 -- 172.21.15.2:0/1863710658 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe2a8004300 con 0x7fe2b807e6e0 2024-06-13T11:09:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.448+0000 7fe2b6a00700 1 -- 172.21.15.2:0/1863710658 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a8011b50 con 0x7fe2b807e6e0 2024-06-13T11:09:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.448+0000 7fe2be200700 1 -- 172.21.15.2:0/1863710658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b807e6e0 msgr2=0x7fe2b807cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.448+0000 7fe2be200700 1 --2- 172.21.15.2:0/1863710658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b807e6e0 0x7fe2b807cb40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80098a0 tx=0x7fe2a8009bb0 comp rx=0 tx=0).stop 2024-06-13T11:09:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.449+0000 7fe2be200700 1 -- 172.21.15.2:0/1863710658 shutdown_connections 2024-06-13T11:09:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.449+0000 7fe2be200700 1 --2- 172.21.15.2:0/1863710658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b807e6e0 0x7fe2b807cb40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.449+0000 7fe2be200700 1 -- 172.21.15.2:0/1863710658 >> 172.21.15.2:0/1863710658 conn(0x7fe2b81034f0 msgr2=0x7fe2b8105930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.449+0000 7fe2be200700 1 -- 172.21.15.2:0/1863710658 shutdown_connections 2024-06-13T11:09:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.449+0000 7fe2be200700 1 -- 172.21.15.2:0/1863710658 wait complete. 2024-06-13T11:09:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.450+0000 7fe2be200700 1 Processor -- start 2024-06-13T11:09:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.450+0000 7fe2be200700 1 -- start start 2024-06-13T11:09:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.450+0000 7fe2be200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b807e6e0 0x7fe2b819e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.450+0000 7fe2be200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b810e4b0 con 0x7fe2b807e6e0 2024-06-13T11:09:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.451+0000 7fe2b7400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b807e6e0 0x7fe2b819e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.451+0000 7fe2b7400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b807e6e0 0x7fe2b819e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38780/0 (socket says 172.21.15.2:38780) 2024-06-13T11:09:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.451+0000 7fe2b7400700 1 -- 172.21.15.2:0/4186715690 learned_addr learned my addr 172.21.15.2:0/4186715690 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.451+0000 7fe2b7400700 1 -- 172.21.15.2:0/4186715690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b819e570 con 0x7fe2b807e6e0 2024-06-13T11:09:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.451+0000 7fe2b7400700 1 --2- 172.21.15.2:0/4186715690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b807e6e0 0x7fe2b819e030 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8011b60 tx=0x7fe2a8011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.452+0000 7fe2b4c00700 1 -- 172.21.15.2:0/4186715690 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a8003b20 con 0x7fe2b807e6e0 2024-06-13T11:09:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.452+0000 7fe2b4c00700 1 -- 172.21.15.2:0/4186715690 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe2a8003cc0 con 0x7fe2b807e6e0 2024-06-13T11:09:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.452+0000 7fe2b4c00700 1 -- 172.21.15.2:0/4186715690 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a8024840 con 0x7fe2b807e6e0 2024-06-13T11:09:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.452+0000 7fe2be200700 1 -- 172.21.15.2:0/4186715690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b819e800 con 0x7fe2b807e6e0 2024-06-13T11:09:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.452+0000 7fe2be200700 1 -- 172.21.15.2:0/4186715690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b81a14f0 con 0x7fe2b807e6e0 2024-06-13T11:09:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.453+0000 7fe2b4c00700 1 -- 172.21.15.2:0/4186715690 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe2a8022020 con 0x7fe2b807e6e0 2024-06-13T11:09:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.453+0000 7fe2be200700 1 -- 172.21.15.2:0/4186715690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2b8063af0 con 0x7fe2b807e6e0 2024-06-13T11:09:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.453+0000 7fe2b4c00700 1 --2- 172.21.15.2:0/4186715690 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fe29c039100 0x7fe29c03b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.454+0000 7fe2b4c00700 1 -- 172.21.15.2:0/4186715690 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe2a8011e00 con 0x7fe2b807e6e0 2024-06-13T11:09:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.454+0000 7fe2aea00700 1 --2- 172.21.15.2:0/4186715690 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fe29c039100 0x7fe29c03b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.455+0000 7fe2aea00700 1 --2- 172.21.15.2:0/4186715690 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fe29c039100 0x7fe29c03b5c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000ad30 tx=0x7fe2a00093f0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.459+0000 7fe2b4c00700 1 -- 172.21.15.2:0/4186715690 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe2a801a7b0 con 0x7fe2b807e6e0 2024-06-13T11:09:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.690+0000 7fe2be200700 1 -- 172.21.15.2:0/4186715690 --> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fe2b8104740 con 0x7fe29c039100 2024-06-13T11:09:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.975+0000 7fe2b4c00700 1 -- 172.21.15.2:0/4186715690 <== mgr.14120 v2:172.21.15.2:6800/1821969949 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe2b8104740 con 0x7fe29c039100 2024-06-13T11:09:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.978+0000 7fe2be200700 1 -- 172.21.15.2:0/4186715690 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fe29c039100 msgr2=0x7fe29c03b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.979+0000 7fe2be200700 1 --2- 172.21.15.2:0/4186715690 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fe29c039100 0x7fe29c03b5c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000ad30 tx=0x7fe2a00093f0 comp rx=0 tx=0).stop 2024-06-13T11:09:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.979+0000 7fe2be200700 1 -- 172.21.15.2:0/4186715690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b807e6e0 msgr2=0x7fe2b819e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.979+0000 7fe2be200700 1 --2- 172.21.15.2:0/4186715690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b807e6e0 0x7fe2b819e030 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8011b60 tx=0x7fe2a8011c40 comp rx=0 tx=0).stop 2024-06-13T11:09:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.979+0000 7fe2be200700 1 -- 172.21.15.2:0/4186715690 shutdown_connections 2024-06-13T11:09:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.979+0000 7fe2be200700 1 --2- 172.21.15.2:0/4186715690 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fe29c039100 0x7fe29c03b5c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.979+0000 7fe2be200700 1 --2- 172.21.15.2:0/4186715690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b807e6e0 0x7fe2b819e030 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.979+0000 7fe2be200700 1 -- 172.21.15.2:0/4186715690 >> 172.21.15.2:0/4186715690 conn(0x7fe2b81034f0 msgr2=0x7fe2b8104030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:56.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.979+0000 7fe2be200700 1 -- 172.21.15.2:0/4186715690 shutdown_connections 2024-06-13T11:09:56.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:55.979+0000 7fe2be200700 1 -- 172.21.15.2:0/4186715690 wait complete. 2024-06-13T11:09:57.228 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:56 smithi002 ceph-mon[32210]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:09:57.228 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:56 smithi002 ceph-mon[32210]: Generating ssh key... 2024-06-13T11:09:57.228 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:56 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' 2024-06-13T11:09:57.228 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:56 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' 2024-06-13T11:09:58.273 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1sJkrYXnpDnHx0kcTvVgnu9H8ROrwEBm+lxCmj8oa5rVXYDaGwlqnYPrTQnAq4TkFie9PJLvrfozDtsPfESbtb/RZu18DuS40coTjSC9wfTTcZrtuyRZnWdEY2BODKeutPSxVB2IUdMCvoB9PTLp1y1G481xIBdBd1Y6uAb7JPyAUz5i/l41j1kKznlaU6hnKxcloi2lVPi81EWna8FZpR1Vm0W/T0rhbF9K83vRmh/+fpFdlwa3I9lJkrAItoMD3DVe5izw/o5FzTD5W0vkW3CJcGpJANZopjrQXLXwNIZc8AEMfVeqPPnRf6lY1ILqC6y1G6IEysG9glQVxy96WJiU5teVUCqbp1VakwcWiHYhQtbBitj4ntM2mCWEyZc/orXJbtgL0AdEYUa2a9XrRqT7P8JRe2KbCxrkTOB8PoFVAN5AssIullCHAHYl2IFTdsxGpJDNPlbFW3Q8VF9IB8oKK9Iq+lrGV6pfPc02i6qBMOD/xY2Yo3taMVEis5HU= ceph-3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:09:58.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.227+0000 7fc1e7200700 1 Processor -- start 2024-06-13T11:09:58.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.227+0000 7fc1e7200700 1 -- start start 2024-06-13T11:09:58.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.228+0000 7fc1e7200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1e807de50 0x7fc1e807c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:58.274 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.228+0000 7fc1e7200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e807c880 con 0x7fc1e807de50 2024-06-13T11:09:58.275 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.229+0000 7fc1e5e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1e807de50 0x7fc1e807c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:58.275 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.229+0000 7fc1e5e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1e807de50 0x7fc1e807c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52298/0 (socket says 172.21.15.2:52298) 2024-06-13T11:09:58.275 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.229+0000 7fc1e5e00700 1 -- 172.21.15.2:0/2038540523 learned_addr learned my addr 172.21.15.2:0/2038540523 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:58.276 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.229+0000 7fc1e5e00700 1 -- 172.21.15.2:0/2038540523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e807ca00 con 0x7fc1e807de50 2024-06-13T11:09:58.276 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.229+0000 7fc1e5e00700 1 --2- 172.21.15.2:0/2038540523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1e807de50 0x7fc1e807c2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80098a0 tx=0x7fc1d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d64adb683fefa0e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:58.276 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.230+0000 7fc1e4a00700 1 -- 172.21.15.2:0/2038540523 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d8004160 con 0x7fc1e807de50 2024-06-13T11:09:58.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.230+0000 7fc1e4a00700 1 -- 172.21.15.2:0/2038540523 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc1d8004300 con 0x7fc1e807de50 2024-06-13T11:09:58.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.230+0000 7fc1e4a00700 1 -- 172.21.15.2:0/2038540523 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d8011b50 con 0x7fc1e807de50 2024-06-13T11:09:58.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.230+0000 7fc1e7200700 1 -- 172.21.15.2:0/2038540523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1e807de50 msgr2=0x7fc1e807c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:58.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.230+0000 7fc1e7200700 1 --2- 172.21.15.2:0/2038540523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1e807de50 0x7fc1e807c2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80098a0 tx=0x7fc1d8009bb0 comp rx=0 tx=0).stop 2024-06-13T11:09:58.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.231+0000 7fc1e7200700 1 -- 172.21.15.2:0/2038540523 shutdown_connections 2024-06-13T11:09:58.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.231+0000 7fc1e7200700 1 --2- 172.21.15.2:0/2038540523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1e807de50 0x7fc1e807c2b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:58.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.231+0000 7fc1e7200700 1 -- 172.21.15.2:0/2038540523 >> 172.21.15.2:0/2038540523 conn(0x7fc1e8103390 msgr2=0x7fc1e81057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:58.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.231+0000 7fc1e7200700 1 -- 172.21.15.2:0/2038540523 shutdown_connections 2024-06-13T11:09:58.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.231+0000 7fc1e7200700 1 -- 172.21.15.2:0/2038540523 wait complete. 2024-06-13T11:09:58.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.232+0000 7fc1e7200700 1 Processor -- start 2024-06-13T11:09:58.281 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.232+0000 7fc1e7200700 1 -- start start 2024-06-13T11:09:58.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.232+0000 7fc1e7200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1e807de50 0x7fc1e819ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:58.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.232+0000 7fc1e7200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e810e2f0 con 0x7fc1e807de50 2024-06-13T11:09:58.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.232+0000 7fc1e5e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1e807de50 0x7fc1e819ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:58.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.232+0000 7fc1e5e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1e807de50 0x7fc1e819ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52312/0 (socket says 172.21.15.2:52312) 2024-06-13T11:09:58.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.232+0000 7fc1e5e00700 1 -- 172.21.15.2:0/962338098 learned_addr learned my addr 172.21.15.2:0/962338098 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:09:58.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.233+0000 7fc1e5e00700 1 -- 172.21.15.2:0/962338098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e819e410 con 0x7fc1e807de50 2024-06-13T11:09:58.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.233+0000 7fc1e5e00700 1 --2- 172.21.15.2:0/962338098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1e807de50 0x7fc1e819ded0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8011b60 tx=0x7fc1d8011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:58.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.233+0000 7fc1dea00700 1 -- 172.21.15.2:0/962338098 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d8003970 con 0x7fc1e807de50 2024-06-13T11:09:58.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.233+0000 7fc1dea00700 1 -- 172.21.15.2:0/962338098 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc1d8003b10 con 0x7fc1e807de50 2024-06-13T11:09:58.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.233+0000 7fc1dea00700 1 -- 172.21.15.2:0/962338098 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d8024610 con 0x7fc1e807de50 2024-06-13T11:09:58.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.233+0000 7fc1e7200700 1 -- 172.21.15.2:0/962338098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e819e6a0 con 0x7fc1e807de50 2024-06-13T11:09:58.282 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.233+0000 7fc1e7200700 1 -- 172.21.15.2:0/962338098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e81a1390 con 0x7fc1e807de50 2024-06-13T11:09:58.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.235+0000 7fc1dea00700 1 -- 172.21.15.2:0/962338098 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fc1d801a9f0 con 0x7fc1e807de50 2024-06-13T11:09:58.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.235+0000 7fc1e7200700 1 -- 172.21.15.2:0/962338098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e8063af0 con 0x7fc1e807de50 2024-06-13T11:09:58.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.235+0000 7fc1dea00700 1 --2- 172.21.15.2:0/962338098 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fc1cc039050 0x7fc1cc03b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:09:58.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.235+0000 7fc1dea00700 1 -- 172.21.15.2:0/962338098 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc1d8011e00 con 0x7fc1e807de50 2024-06-13T11:09:58.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.235+0000 7fc1e5400700 1 --2- 172.21.15.2:0/962338098 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fc1cc039050 0x7fc1cc03b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:09:58.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.236+0000 7fc1e5400700 1 --2- 172.21.15.2:0/962338098 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fc1cc039050 0x7fc1cc03b510 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4006fd0 tx=0x7fc1d4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:09:58.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.241+0000 7fc1dea00700 1 -- 172.21.15.2:0/962338098 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc1d800b3e0 con 0x7fc1e807de50 2024-06-13T11:09:58.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.461+0000 7fc1e7200700 1 -- 172.21.15.2:0/962338098 --> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fc1e8104630 con 0x7fc1cc039050 2024-06-13T11:09:58.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.463+0000 7fc1dea00700 1 -- 172.21.15.2:0/962338098 <== mgr.14120 v2:172.21.15.2:6800/1821969949 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fc1e8104630 con 0x7fc1cc039050 2024-06-13T11:09:58.283 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.467+0000 7fc1e7200700 1 -- 172.21.15.2:0/962338098 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fc1cc039050 msgr2=0x7fc1cc03b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:58.285 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.467+0000 7fc1e7200700 1 --2- 172.21.15.2:0/962338098 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fc1cc039050 0x7fc1cc03b510 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4006fd0 tx=0x7fc1d4006e40 comp rx=0 tx=0).stop 2024-06-13T11:09:58.285 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.467+0000 7fc1e7200700 1 -- 172.21.15.2:0/962338098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1e807de50 msgr2=0x7fc1e819ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:09:58.285 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.467+0000 7fc1e7200700 1 --2- 172.21.15.2:0/962338098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1e807de50 0x7fc1e819ded0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8011b60 tx=0x7fc1d8011c40 comp rx=0 tx=0).stop 2024-06-13T11:09:58.285 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.467+0000 7fc1e7200700 1 -- 172.21.15.2:0/962338098 shutdown_connections 2024-06-13T11:09:58.285 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.467+0000 7fc1e7200700 1 --2- 172.21.15.2:0/962338098 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fc1cc039050 0x7fc1cc03b510 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:58.285 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.467+0000 7fc1e7200700 1 --2- 172.21.15.2:0/962338098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1e807de50 0x7fc1e819ded0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:09:58.285 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.467+0000 7fc1e7200700 1 -- 172.21.15.2:0/962338098 >> 172.21.15.2:0/962338098 conn(0x7fc1e8103390 msgr2=0x7fc1e8103f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:09:58.285 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.467+0000 7fc1e7200700 1 -- 172.21.15.2:0/962338098 shutdown_connections 2024-06-13T11:09:58.285 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:57.467+0000 7fc1e7200700 1 -- 172.21.15.2:0/962338098 wait complete. 2024-06-13T11:09:58.286 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-06-13T11:09:58.286 INFO:teuthology.orchestra.run.smithi002.stdout:Adding key to root@localhost authorized_keys... 2024-06-13T11:09:58.286 INFO:teuthology.orchestra.run.smithi002.stdout:Adding host smithi002... 2024-06-13T11:09:58.578 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:58 smithi002 ceph-mon[32210]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:09:59.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:09:59 smithi002 ceph-mon[32210]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:10:01.509 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:01 smithi002 ceph-mon[32210]: Deploying cephadm binary to smithi002 2024-06-13T11:10:06.296 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Added host 'smithi002' with addr '172.21.15.2' 2024-06-13T11:10:06.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.883+0000 7fbd04000700 1 Processor -- start 2024-06-13T11:10:06.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.883+0000 7fbd04000700 1 -- start start 2024-06-13T11:10:06.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.883+0000 7fbd04000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcfc07e740 0x7fbcfc07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:06.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.883+0000 7fbd04000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc07d170 con 0x7fbcfc07e740 2024-06-13T11:10:06.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.884+0000 7fbd01600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcfc07e740 0x7fbcfc07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:06.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.884+0000 7fbd01600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcfc07e740 0x7fbcfc07cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52328/0 (socket says 172.21.15.2:52328) 2024-06-13T11:10:06.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.884+0000 7fbd01600700 1 -- 172.21.15.2:0/1764857434 learned_addr learned my addr 172.21.15.2:0/1764857434 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:06.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.885+0000 7fbd01600700 1 -- 172.21.15.2:0/1764857434 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcfc07d2f0 con 0x7fbcfc07e740 2024-06-13T11:10:06.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.885+0000 7fbd01600700 1 --2- 172.21.15.2:0/1764857434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcfc07e740 0x7fbcfc07cba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00098a0 tx=0x7fbcf0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea8441e1780c46c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:06.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.885+0000 7fbcfbe00700 1 -- 172.21.15.2:0/1764857434 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf0004160 con 0x7fbcfc07e740 2024-06-13T11:10:06.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.885+0000 7fbcfbe00700 1 -- 172.21.15.2:0/1764857434 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbcf0004300 con 0x7fbcfc07e740 2024-06-13T11:10:06.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.885+0000 7fbcfbe00700 1 -- 172.21.15.2:0/1764857434 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf0011b50 con 0x7fbcfc07e740 2024-06-13T11:10:06.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.886+0000 7fbd04000700 1 -- 172.21.15.2:0/1764857434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcfc07e740 msgr2=0x7fbcfc07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:06.298 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.886+0000 7fbd04000700 1 --2- 172.21.15.2:0/1764857434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcfc07e740 0x7fbcfc07cba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00098a0 tx=0x7fbcf0009bb0 comp rx=0 tx=0).stop 2024-06-13T11:10:06.298 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.886+0000 7fbd04000700 1 -- 172.21.15.2:0/1764857434 shutdown_connections 2024-06-13T11:10:06.298 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.886+0000 7fbd04000700 1 --2- 172.21.15.2:0/1764857434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcfc07e740 0x7fbcfc07cba0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:06.298 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.886+0000 7fbd04000700 1 -- 172.21.15.2:0/1764857434 >> 172.21.15.2:0/1764857434 conn(0x7fbcfc103580 msgr2=0x7fbcfc1059a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:06.298 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.886+0000 7fbd04000700 1 -- 172.21.15.2:0/1764857434 shutdown_connections 2024-06-13T11:10:06.298 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.886+0000 7fbd04000700 1 -- 172.21.15.2:0/1764857434 wait complete. 2024-06-13T11:10:06.298 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.887+0000 7fbd04000700 1 Processor -- start 2024-06-13T11:10:06.298 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.888+0000 7fbd04000700 1 -- start start 2024-06-13T11:10:06.298 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.888+0000 7fbd04000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcfc07e740 0x7fbcfc19e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:06.298 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.888+0000 7fbd04000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc10e4d0 con 0x7fbcfc07e740 2024-06-13T11:10:06.298 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.888+0000 7fbd01600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcfc07e740 0x7fbcfc19e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:06.298 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.888+0000 7fbd01600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcfc07e740 0x7fbcfc19e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52334/0 (socket says 172.21.15.2:52334) 2024-06-13T11:10:06.298 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.888+0000 7fbd01600700 1 -- 172.21.15.2:0/1673004920 learned_addr learned my addr 172.21.15.2:0/1673004920 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:06.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.888+0000 7fbd01600700 1 -- 172.21.15.2:0/1673004920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcfc19e610 con 0x7fbcfc07e740 2024-06-13T11:10:06.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.889+0000 7fbd01600700 1 --2- 172.21.15.2:0/1673004920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcfc07e740 0x7fbcfc19e0d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0011670 tx=0x7fbcf0011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:06.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.889+0000 7fbcfa000700 1 -- 172.21.15.2:0/1673004920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf00039c0 con 0x7fbcfc07e740 2024-06-13T11:10:06.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.889+0000 7fbcfa000700 1 -- 172.21.15.2:0/1673004920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbcf0011e50 con 0x7fbcfc07e740 2024-06-13T11:10:06.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.889+0000 7fbcfa000700 1 -- 172.21.15.2:0/1673004920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcf001a430 con 0x7fbcfc07e740 2024-06-13T11:10:06.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.889+0000 7fbd04000700 1 -- 172.21.15.2:0/1673004920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcfc19e8a0 con 0x7fbcfc07e740 2024-06-13T11:10:06.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.889+0000 7fbd04000700 1 -- 172.21.15.2:0/1673004920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcfc1a1590 con 0x7fbcfc07e740 2024-06-13T11:10:06.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.890+0000 7fbcfa000700 1 -- 172.21.15.2:0/1673004920 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fbcf0024430 con 0x7fbcfc07e740 2024-06-13T11:10:06.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.890+0000 7fbd04000700 1 -- 172.21.15.2:0/1673004920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcfc063af0 con 0x7fbcfc07e740 2024-06-13T11:10:06.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.891+0000 7fbcfa000700 1 --2- 172.21.15.2:0/1673004920 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fbce4039050 0x7fbce403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:06.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.891+0000 7fbcfa000700 1 -- 172.21.15.2:0/1673004920 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbcf004d270 con 0x7fbcfc07e740 2024-06-13T11:10:06.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.891+0000 7fbd00c00700 1 --2- 172.21.15.2:0/1673004920 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fbce4039050 0x7fbce403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:06.299 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.892+0000 7fbd00c00700 1 --2- 172.21.15.2:0/1673004920 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fbce4039050 0x7fbce403b510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbce8006fd0 tx=0x7fbce8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:06.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:58.897+0000 7fbcfa000700 1 -- 172.21.15.2:0/1673004920 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbcf004cbc0 con 0x7fbcfc07e740 2024-06-13T11:10:06.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:09:59.133+0000 7fbd04000700 1 -- 172.21.15.2:0/1673004920 --> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}) -- 0x7fbcfc104810 con 0x7fbce4039050 2024-06-13T11:10:06.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:05.593+0000 7fbcfa000700 1 -- 172.21.15.2:0/1673004920 <== mgr.14120 v2:172.21.15.2:6800/1821969949 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7fbcfc104810 con 0x7fbce4039050 2024-06-13T11:10:06.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:05.597+0000 7fbd04000700 1 -- 172.21.15.2:0/1673004920 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fbce4039050 msgr2=0x7fbce403b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:06.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:05.597+0000 7fbd04000700 1 --2- 172.21.15.2:0/1673004920 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fbce4039050 0x7fbce403b510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbce8006fd0 tx=0x7fbce8006e40 comp rx=0 tx=0).stop 2024-06-13T11:10:06.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:05.597+0000 7fbd04000700 1 -- 172.21.15.2:0/1673004920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcfc07e740 msgr2=0x7fbcfc19e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:06.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:05.597+0000 7fbd04000700 1 --2- 172.21.15.2:0/1673004920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcfc07e740 0x7fbcfc19e0d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0011670 tx=0x7fbcf0011b60 comp rx=0 tx=0).stop 2024-06-13T11:10:06.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:05.597+0000 7fbd04000700 1 -- 172.21.15.2:0/1673004920 shutdown_connections 2024-06-13T11:10:06.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:05.597+0000 7fbd04000700 1 --2- 172.21.15.2:0/1673004920 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7fbce4039050 0x7fbce403b510 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:06.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:05.597+0000 7fbd04000700 1 --2- 172.21.15.2:0/1673004920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcfc07e740 0x7fbcfc19e0d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:06.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:05.597+0000 7fbd04000700 1 -- 172.21.15.2:0/1673004920 >> 172.21.15.2:0/1673004920 conn(0x7fbcfc103580 msgr2=0x7fbcfc104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:06.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:05.598+0000 7fbd04000700 1 -- 172.21.15.2:0/1673004920 shutdown_connections 2024-06-13T11:10:06.300 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:05.598+0000 7fbd04000700 1 -- 172.21.15.2:0/1673004920 wait complete. 2024-06-13T11:10:06.300 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mon service... 2024-06-13T11:10:06.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:06 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' 2024-06-13T11:10:06.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:06 smithi002 ceph-mon[32210]: Added host smithi002 2024-06-13T11:10:06.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:06 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:10:08.458 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:08 smithi002 ceph-mon[32210]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:10:08.458 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:08 smithi002 ceph-mon[32210]: Saving service mon spec with placement count:5 2024-06-13T11:10:08.458 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:08 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' 2024-06-13T11:10:08.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-06-13T11:10:08.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.969+0000 7f24a3200700 1 Processor -- start 2024-06-13T11:10:08.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.969+0000 7f24a3200700 1 -- start start 2024-06-13T11:10:08.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.970+0000 7f24a3200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c081f60 0x7f249c082380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:08.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.970+0000 7f24a3200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f249c082950 con 0x7f249c081f60 2024-06-13T11:10:08.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.970+0000 7f249be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c081f60 0x7f249c082380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:08.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.970+0000 7f249be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c081f60 0x7f249c082380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56506/0 (socket says 172.21.15.2:56506) 2024-06-13T11:10:08.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.970+0000 7f249be00700 1 -- 172.21.15.2:0/246712435 learned_addr learned my addr 172.21.15.2:0/246712435 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:08.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.971+0000 7f249be00700 1 -- 172.21.15.2:0/246712435 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249c10f730 con 0x7f249c081f60 2024-06-13T11:10:08.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.971+0000 7f249be00700 1 --2- 172.21.15.2:0/246712435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c081f60 0x7f249c082380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f248c0098a0 tx=0x7f248c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d841d51c335b8d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:08.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.971+0000 7f249aa00700 1 -- 172.21.15.2:0/246712435 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f248c004160 con 0x7f249c081f60 2024-06-13T11:10:08.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.972+0000 7f249aa00700 1 -- 172.21.15.2:0/246712435 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f248c004300 con 0x7f249c081f60 2024-06-13T11:10:08.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.972+0000 7f249aa00700 1 -- 172.21.15.2:0/246712435 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f248c011b50 con 0x7f249c081f60 2024-06-13T11:10:08.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.972+0000 7f24a3200700 1 -- 172.21.15.2:0/246712435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c081f60 msgr2=0x7f249c082380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:08.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.972+0000 7f24a3200700 1 --2- 172.21.15.2:0/246712435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c081f60 0x7f249c082380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f248c0098a0 tx=0x7f248c009bb0 comp rx=0 tx=0).stop 2024-06-13T11:10:08.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.973+0000 7f24a3200700 1 -- 172.21.15.2:0/246712435 shutdown_connections 2024-06-13T11:10:08.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.973+0000 7f24a3200700 1 --2- 172.21.15.2:0/246712435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c081f60 0x7f249c082380 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:08.470 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.973+0000 7f24a3200700 1 -- 172.21.15.2:0/246712435 >> 172.21.15.2:0/246712435 conn(0x7f249c07d570 msgr2=0x7f249c07f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:08.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.973+0000 7f24a3200700 1 -- 172.21.15.2:0/246712435 shutdown_connections 2024-06-13T11:10:08.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.973+0000 7f24a3200700 1 -- 172.21.15.2:0/246712435 wait complete. 2024-06-13T11:10:08.471 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.974+0000 7f24a3200700 1 Processor -- start 2024-06-13T11:10:08.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.974+0000 7f24a3200700 1 -- start start 2024-06-13T11:10:08.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.974+0000 7f24a3200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c081f60 0x7f249c1a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:08.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.974+0000 7f24a3200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f249c1129f0 con 0x7f249c081f60 2024-06-13T11:10:08.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.975+0000 7f249be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c081f60 0x7f249c1a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:08.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.975+0000 7f249be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c081f60 0x7f249c1a2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56520/0 (socket says 172.21.15.2:56520) 2024-06-13T11:10:08.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.975+0000 7f249be00700 1 -- 172.21.15.2:0/2967055688 learned_addr learned my addr 172.21.15.2:0/2967055688 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:08.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.975+0000 7f249be00700 1 -- 172.21.15.2:0/2967055688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249c1a29a0 con 0x7f249c081f60 2024-06-13T11:10:08.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.975+0000 7f249be00700 1 --2- 172.21.15.2:0/2967055688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c081f60 0x7f249c1a2460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f248c011b60 tx=0x7f248c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:08.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.976+0000 7f2498c00700 1 -- 172.21.15.2:0/2967055688 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f248c003b20 con 0x7f249c081f60 2024-06-13T11:10:08.473 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.976+0000 7f2498c00700 1 -- 172.21.15.2:0/2967055688 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f248c003cc0 con 0x7f249c081f60 2024-06-13T11:10:08.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.976+0000 7f2498c00700 1 -- 172.21.15.2:0/2967055688 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f248c0247d0 con 0x7f249c081f60 2024-06-13T11:10:08.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.976+0000 7f24a3200700 1 -- 172.21.15.2:0/2967055688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f249c1a2c30 con 0x7f249c081f60 2024-06-13T11:10:08.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.976+0000 7f24a3200700 1 -- 172.21.15.2:0/2967055688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f249c1a5920 con 0x7f249c081f60 2024-06-13T11:10:08.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.977+0000 7f24a3200700 1 -- 172.21.15.2:0/2967055688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f249c112b70 con 0x7f249c081f60 2024-06-13T11:10:08.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.977+0000 7f2498c00700 1 -- 172.21.15.2:0/2967055688 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f248c022020 con 0x7f249c081f60 2024-06-13T11:10:08.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.977+0000 7f2498c00700 1 --2- 172.21.15.2:0/2967055688 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f24800390a0 0x7f248003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:08.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.978+0000 7f2498c00700 1 -- 172.21.15.2:0/2967055688 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f248c011e00 con 0x7f249c081f60 2024-06-13T11:10:08.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.978+0000 7f249b400700 1 --2- 172.21.15.2:0/2967055688 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f24800390a0 0x7f248003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:08.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.978+0000 7f249b400700 1 --2- 172.21.15.2:0/2967055688 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f24800390a0 0x7f248003b560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2488006fd0 tx=0x7f2488006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:08.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:06.983+0000 7f2498c00700 1 -- 172.21.15.2:0/2967055688 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f248c04ca50 con 0x7f249c081f60 2024-06-13T11:10:08.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:07.270+0000 7f24a3200700 1 -- 172.21.15.2:0/2967055688 --> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f249c07e740 con 0x7f24800390a0 2024-06-13T11:10:08.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:07.278+0000 7f2498c00700 1 -- 172.21.15.2:0/2967055688 <== mgr.14120 v2:172.21.15.2:6800/1821969949 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f249c07e740 con 0x7f24800390a0 2024-06-13T11:10:08.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:07.281+0000 7f24a3200700 1 -- 172.21.15.2:0/2967055688 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f24800390a0 msgr2=0x7f248003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:08.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:07.281+0000 7f24a3200700 1 --2- 172.21.15.2:0/2967055688 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f24800390a0 0x7f248003b560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2488006fd0 tx=0x7f2488006e40 comp rx=0 tx=0).stop 2024-06-13T11:10:08.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:07.281+0000 7f24a3200700 1 -- 172.21.15.2:0/2967055688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c081f60 msgr2=0x7f249c1a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:08.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:07.281+0000 7f24a3200700 1 --2- 172.21.15.2:0/2967055688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c081f60 0x7f249c1a2460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f248c011b60 tx=0x7f248c011c40 comp rx=0 tx=0).stop 2024-06-13T11:10:08.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:07.281+0000 7f24a3200700 1 -- 172.21.15.2:0/2967055688 shutdown_connections 2024-06-13T11:10:08.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:07.281+0000 7f24a3200700 1 --2- 172.21.15.2:0/2967055688 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f24800390a0 0x7f248003b560 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:08.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:07.281+0000 7f24a3200700 1 --2- 172.21.15.2:0/2967055688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c081f60 0x7f249c1a2460 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:08.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:07.281+0000 7f24a3200700 1 -- 172.21.15.2:0/2967055688 >> 172.21.15.2:0/2967055688 conn(0x7f249c07d570 msgr2=0x7f249c07e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:08.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:07.281+0000 7f24a3200700 1 -- 172.21.15.2:0/2967055688 shutdown_connections 2024-06-13T11:10:08.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:07.282+0000 7f24a3200700 1 -- 172.21.15.2:0/2967055688 wait complete. 2024-06-13T11:10:08.479 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mgr service... 2024-06-13T11:10:10.215 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:09 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' 2024-06-13T11:10:10.215 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:09 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' 2024-06-13T11:10:10.231 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-06-13T11:10:10.231 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.365+0000 7f7c66a00700 1 Processor -- start 2024-06-13T11:10:10.231 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.365+0000 7f7c66a00700 1 -- start start 2024-06-13T11:10:10.231 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.366+0000 7f7c66a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6007de90 0x7f7c6007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:10.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.366+0000 7f7c66a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6007c8c0 con 0x7f7c6007de90 2024-06-13T11:10:10.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.366+0000 7f7c5fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6007de90 0x7f7c6007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:10.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.366+0000 7f7c5fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6007de90 0x7f7c6007c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56530/0 (socket says 172.21.15.2:56530) 2024-06-13T11:10:10.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.366+0000 7f7c5fe00700 1 -- 172.21.15.2:0/709712105 learned_addr learned my addr 172.21.15.2:0/709712105 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:10.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.367+0000 7f7c5fe00700 1 -- 172.21.15.2:0/709712105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6007ca40 con 0x7f7c6007de90 2024-06-13T11:10:10.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.367+0000 7f7c5fe00700 1 --2- 172.21.15.2:0/709712105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6007de90 0x7f7c6007c2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c500098a0 tx=0x7f7c50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0704ccb17ca8a9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:10.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.367+0000 7f7c5ea00700 1 -- 172.21.15.2:0/709712105 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c50004160 con 0x7f7c6007de90 2024-06-13T11:10:10.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.367+0000 7f7c5ea00700 1 -- 172.21.15.2:0/709712105 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c50004300 con 0x7f7c6007de90 2024-06-13T11:10:10.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.367+0000 7f7c5ea00700 1 -- 172.21.15.2:0/709712105 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c50011b20 con 0x7f7c6007de90 2024-06-13T11:10:10.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.368+0000 7f7c66a00700 1 -- 172.21.15.2:0/709712105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6007de90 msgr2=0x7f7c6007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:10.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.368+0000 7f7c66a00700 1 --2- 172.21.15.2:0/709712105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6007de90 0x7f7c6007c2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c500098a0 tx=0x7f7c50009bb0 comp rx=0 tx=0).stop 2024-06-13T11:10:10.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.368+0000 7f7c66a00700 1 -- 172.21.15.2:0/709712105 shutdown_connections 2024-06-13T11:10:10.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.368+0000 7f7c66a00700 1 --2- 172.21.15.2:0/709712105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6007de90 0x7f7c6007c2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:10.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.368+0000 7f7c66a00700 1 -- 172.21.15.2:0/709712105 >> 172.21.15.2:0/709712105 conn(0x7f7c601034e0 msgr2=0x7f7c60105940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:10.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.369+0000 7f7c66a00700 1 -- 172.21.15.2:0/709712105 shutdown_connections 2024-06-13T11:10:10.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.369+0000 7f7c66a00700 1 -- 172.21.15.2:0/709712105 wait complete. 2024-06-13T11:10:10.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.370+0000 7f7c66a00700 1 Processor -- start 2024-06-13T11:10:10.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.371+0000 7f7c66a00700 1 -- start start 2024-06-13T11:10:10.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.371+0000 7f7c66a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6007de90 0x7f7c6019dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:10.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.371+0000 7f7c66a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6010e5a0 con 0x7f7c6007de90 2024-06-13T11:10:10.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.372+0000 7f7c5fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6007de90 0x7f7c6019dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:10.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.372+0000 7f7c5fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6007de90 0x7f7c6019dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56546/0 (socket says 172.21.15.2:56546) 2024-06-13T11:10:10.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.372+0000 7f7c5fe00700 1 -- 172.21.15.2:0/2021578979 learned_addr learned my addr 172.21.15.2:0/2021578979 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:10.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.372+0000 7f7c5fe00700 1 -- 172.21.15.2:0/2021578979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6019e530 con 0x7f7c6007de90 2024-06-13T11:10:10.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.372+0000 7f7c5fe00700 1 --2- 172.21.15.2:0/2021578979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6007de90 0x7f7c6019dff0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7c500117e0 tx=0x7f7c50011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:10.233 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.373+0000 7f7c5cc00700 1 -- 172.21.15.2:0/2021578979 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c50003bf0 con 0x7f7c6007de90 2024-06-13T11:10:10.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.373+0000 7f7c5cc00700 1 -- 172.21.15.2:0/2021578979 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c5001a910 con 0x7f7c6007de90 2024-06-13T11:10:10.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.373+0000 7f7c5cc00700 1 -- 172.21.15.2:0/2021578979 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c50024970 con 0x7f7c6007de90 2024-06-13T11:10:10.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.373+0000 7f7c66a00700 1 -- 172.21.15.2:0/2021578979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6019e7c0 con 0x7f7c6007de90 2024-06-13T11:10:10.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.373+0000 7f7c66a00700 1 -- 172.21.15.2:0/2021578979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c6019ec20 con 0x7f7c6007de90 2024-06-13T11:10:10.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.374+0000 7f7c66a00700 1 -- 172.21.15.2:0/2021578979 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c60063af0 con 0x7f7c6007de90 2024-06-13T11:10:10.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.374+0000 7f7c5cc00700 1 -- 172.21.15.2:0/2021578979 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f7c50022020 con 0x7f7c6007de90 2024-06-13T11:10:10.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.375+0000 7f7c5cc00700 1 --2- 172.21.15.2:0/2021578979 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7c44039050 0x7f7c4403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:10.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.375+0000 7f7c5cc00700 1 -- 172.21.15.2:0/2021578979 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7c5004d7c0 con 0x7f7c6007de90 2024-06-13T11:10:10.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.375+0000 7f7c5f400700 1 --2- 172.21.15.2:0/2021578979 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7c44039050 0x7f7c4403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:10.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.376+0000 7f7c5f400700 1 --2- 172.21.15.2:0/2021578979 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7c44039050 0x7f7c4403b510 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c006fd0 tx=0x7f7c4c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:10.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.381+0000 7f7c5cc00700 1 -- 172.21.15.2:0/2021578979 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7c5001ab70 con 0x7f7c6007de90 2024-06-13T11:10:10.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.627+0000 7f7c66a00700 1 -- 172.21.15.2:0/2021578979 --> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f7c601046e0 con 0x7f7c44039050 2024-06-13T11:10:10.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.635+0000 7f7c5cc00700 1 -- 172.21.15.2:0/2021578979 <== mgr.14120 v2:172.21.15.2:6800/1821969949 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7c601046e0 con 0x7f7c44039050 2024-06-13T11:10:10.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.637+0000 7f7c66a00700 1 -- 172.21.15.2:0/2021578979 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7c44039050 msgr2=0x7f7c4403b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:10.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.637+0000 7f7c66a00700 1 --2- 172.21.15.2:0/2021578979 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7c44039050 0x7f7c4403b510 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c006fd0 tx=0x7f7c4c006e40 comp rx=0 tx=0).stop 2024-06-13T11:10:10.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.637+0000 7f7c66a00700 1 -- 172.21.15.2:0/2021578979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6007de90 msgr2=0x7f7c6019dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:10.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.637+0000 7f7c66a00700 1 --2- 172.21.15.2:0/2021578979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6007de90 0x7f7c6019dff0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7c500117e0 tx=0x7f7c50011ba0 comp rx=0 tx=0).stop 2024-06-13T11:10:10.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.637+0000 7f7c66a00700 1 -- 172.21.15.2:0/2021578979 shutdown_connections 2024-06-13T11:10:10.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.637+0000 7f7c66a00700 1 --2- 172.21.15.2:0/2021578979 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7c44039050 0x7f7c4403b510 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:10.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.637+0000 7f7c66a00700 1 --2- 172.21.15.2:0/2021578979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c6007de90 0x7f7c6019dff0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:10.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.637+0000 7f7c66a00700 1 -- 172.21.15.2:0/2021578979 >> 172.21.15.2:0/2021578979 conn(0x7f7c601034e0 msgr2=0x7f7c60103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:10.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.638+0000 7f7c66a00700 1 -- 172.21.15.2:0/2021578979 shutdown_connections 2024-06-13T11:10:10.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:09.638+0000 7f7c66a00700 1 -- 172.21.15.2:0/2021578979 wait complete. 2024-06-13T11:10:11.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:10 smithi002 ceph-mon[32210]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:10:11.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:10 smithi002 ceph-mon[32210]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:10:11.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:10 smithi002 ceph-mon[32210]: Saving service mgr spec with placement count:2 2024-06-13T11:10:11.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:10 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' 2024-06-13T11:10:12.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:12 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/211238714' entity='client.admin' 2024-06-13T11:10:12.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.825+0000 7f3a42e00700 1 Processor -- start 2024-06-13T11:10:12.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.825+0000 7f3a42e00700 1 -- start start 2024-06-13T11:10:12.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.826+0000 7f3a42e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a3c107f10 0x7f3a3c108350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:12.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.826+0000 7f3a42e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c108890 con 0x7f3a3c107f10 2024-06-13T11:10:12.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.826+0000 7f3a3be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a3c107f10 0x7f3a3c108350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:12.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.826+0000 7f3a3be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a3c107f10 0x7f3a3c108350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56548/0 (socket says 172.21.15.2:56548) 2024-06-13T11:10:12.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.826+0000 7f3a3be00700 1 -- 172.21.15.2:0/1674503005 learned_addr learned my addr 172.21.15.2:0/1674503005 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:12.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.827+0000 7f3a3be00700 1 -- 172.21.15.2:0/1674503005 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3c1090f0 con 0x7f3a3c107f10 2024-06-13T11:10:12.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.827+0000 7f3a3be00700 1 --2- 172.21.15.2:0/1674503005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a3c107f10 0x7f3a3c108350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0098a0 tx=0x7f3a2c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5981f4115f76e3f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:12.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.827+0000 7f3a3aa00700 1 -- 172.21.15.2:0/1674503005 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a2c004160 con 0x7f3a3c107f10 2024-06-13T11:10:12.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.828+0000 7f3a3aa00700 1 -- 172.21.15.2:0/1674503005 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a2c004300 con 0x7f3a3c107f10 2024-06-13T11:10:12.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.828+0000 7f3a3aa00700 1 -- 172.21.15.2:0/1674503005 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a2c011b20 con 0x7f3a3c107f10 2024-06-13T11:10:12.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.828+0000 7f3a42e00700 1 -- 172.21.15.2:0/1674503005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a3c107f10 msgr2=0x7f3a3c108350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:12.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.828+0000 7f3a42e00700 1 --2- 172.21.15.2:0/1674503005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a3c107f10 0x7f3a3c108350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0098a0 tx=0x7f3a2c009bb0 comp rx=0 tx=0).stop 2024-06-13T11:10:12.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.829+0000 7f3a42e00700 1 -- 172.21.15.2:0/1674503005 shutdown_connections 2024-06-13T11:10:12.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.829+0000 7f3a42e00700 1 --2- 172.21.15.2:0/1674503005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a3c107f10 0x7f3a3c108350 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:12.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.829+0000 7f3a42e00700 1 -- 172.21.15.2:0/1674503005 >> 172.21.15.2:0/1674503005 conn(0x7f3a3c1034e0 msgr2=0x7f3a3c105940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:12.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.829+0000 7f3a42e00700 1 -- 172.21.15.2:0/1674503005 shutdown_connections 2024-06-13T11:10:12.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.829+0000 7f3a42e00700 1 -- 172.21.15.2:0/1674503005 wait complete. 2024-06-13T11:10:12.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.830+0000 7f3a42e00700 1 Processor -- start 2024-06-13T11:10:12.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.830+0000 7f3a42e00700 1 -- start start 2024-06-13T11:10:12.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.830+0000 7f3a42e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a3c107f10 0x7f3a3c19be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:12.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.830+0000 7f3a42e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c10c3b0 con 0x7f3a3c107f10 2024-06-13T11:10:12.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.831+0000 7f3a3be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a3c107f10 0x7f3a3c19be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:12.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.831+0000 7f3a3be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a3c107f10 0x7f3a3c19be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56550/0 (socket says 172.21.15.2:56550) 2024-06-13T11:10:12.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.831+0000 7f3a3be00700 1 -- 172.21.15.2:0/211238714 learned_addr learned my addr 172.21.15.2:0/211238714 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:12.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.831+0000 7f3a3be00700 1 -- 172.21.15.2:0/211238714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3c19c360 con 0x7f3a3c107f10 2024-06-13T11:10:12.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.831+0000 7f3a3be00700 1 --2- 172.21.15.2:0/211238714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a3c107f10 0x7f3a3c19be20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009fb0 tx=0x7f3a2c011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:12.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.832+0000 7f3a38c00700 1 -- 172.21.15.2:0/211238714 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a2c003af0 con 0x7f3a3c107f10 2024-06-13T11:10:12.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.832+0000 7f3a38c00700 1 -- 172.21.15.2:0/211238714 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a2c003c90 con 0x7f3a3c107f10 2024-06-13T11:10:12.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.832+0000 7f3a42e00700 1 -- 172.21.15.2:0/211238714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a3c19c5f0 con 0x7f3a3c107f10 2024-06-13T11:10:12.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.832+0000 7f3a38c00700 1 -- 172.21.15.2:0/211238714 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a2c024840 con 0x7f3a3c107f10 2024-06-13T11:10:12.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.832+0000 7f3a42e00700 1 -- 172.21.15.2:0/211238714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a3c19ca50 con 0x7f3a3c107f10 2024-06-13T11:10:12.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.833+0000 7f3a38c00700 1 -- 172.21.15.2:0/211238714 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3a2c022020 con 0x7f3a3c107f10 2024-06-13T11:10:12.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.833+0000 7f3a42e00700 1 -- 172.21.15.2:0/211238714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a3c063af0 con 0x7f3a3c107f10 2024-06-13T11:10:12.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.834+0000 7f3a38c00700 1 --2- 172.21.15.2:0/211238714 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f3a20039000 0x7f3a2003b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:12.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.834+0000 7f3a38c00700 1 -- 172.21.15.2:0/211238714 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3a2c04d300 con 0x7f3a3c107f10 2024-06-13T11:10:12.395 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.834+0000 7f3a3b400700 1 --2- 172.21.15.2:0/211238714 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f3a20039000 0x7f3a2003b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:12.397 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.835+0000 7f3a3b400700 1 --2- 172.21.15.2:0/211238714 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f3a20039000 0x7f3a2003b4c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3a28006fd0 tx=0x7f3a28006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:12.397 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:10.839+0000 7f3a38c00700 1 -- 172.21.15.2:0/211238714 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3a2c011e20 con 0x7f3a3c107f10 2024-06-13T11:10:12.397 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:11.090+0000 7f3a42e00700 1 -- 172.21.15.2:0/211238714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f3a3c19f3a0 con 0x7f3a3c107f10 2024-06-13T11:10:12.397 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:11.093+0000 7f3a38c00700 1 -- 172.21.15.2:0/211238714 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f3a2c04cbd0 con 0x7f3a3c107f10 2024-06-13T11:10:12.397 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:11.097+0000 7f3a42e00700 1 -- 172.21.15.2:0/211238714 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f3a20039000 msgr2=0x7f3a2003b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:12.397 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:11.097+0000 7f3a42e00700 1 --2- 172.21.15.2:0/211238714 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f3a20039000 0x7f3a2003b4c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3a28006fd0 tx=0x7f3a28006e40 comp rx=0 tx=0).stop 2024-06-13T11:10:12.397 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:11.097+0000 7f3a42e00700 1 -- 172.21.15.2:0/211238714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a3c107f10 msgr2=0x7f3a3c19be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:12.397 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:11.097+0000 7f3a42e00700 1 --2- 172.21.15.2:0/211238714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a3c107f10 0x7f3a3c19be20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009fb0 tx=0x7f3a2c011ba0 comp rx=0 tx=0).stop 2024-06-13T11:10:12.398 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:11.097+0000 7f3a42e00700 1 -- 172.21.15.2:0/211238714 shutdown_connections 2024-06-13T11:10:12.398 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:11.097+0000 7f3a42e00700 1 --2- 172.21.15.2:0/211238714 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f3a20039000 0x7f3a2003b4c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:12.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:11.097+0000 7f3a42e00700 1 --2- 172.21.15.2:0/211238714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a3c107f10 0x7f3a3c19be20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:12.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:11.097+0000 7f3a42e00700 1 -- 172.21.15.2:0/211238714 >> 172.21.15.2:0/211238714 conn(0x7f3a3c1034e0 msgr2=0x7f3a3c104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:12.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:11.097+0000 7f3a42e00700 1 -- 172.21.15.2:0/211238714 shutdown_connections 2024-06-13T11:10:12.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:11.098+0000 7f3a42e00700 1 -- 172.21.15.2:0/211238714 wait complete. 2024-06-13T11:10:13.302 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:13 smithi002 ceph-mon[32210]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:10:13.302 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:13 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' 2024-06-13T11:10:13.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.049+0000 7f8a28a00700 1 Processor -- start 2024-06-13T11:10:13.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.049+0000 7f8a28a00700 1 -- start start 2024-06-13T11:10:13.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.050+0000 7f8a28a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a2407e740 0x7f8a2407cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:13.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.050+0000 7f8a28a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2407d170 con 0x7f8a2407e740 2024-06-13T11:10:13.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.050+0000 7f8a21e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a2407e740 0x7f8a2407cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:13.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.051+0000 7f8a21e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a2407e740 0x7f8a2407cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56560/0 (socket says 172.21.15.2:56560) 2024-06-13T11:10:13.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.051+0000 7f8a21e00700 1 -- 172.21.15.2:0/2357905282 learned_addr learned my addr 172.21.15.2:0/2357905282 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:13.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.051+0000 7f8a21e00700 1 -- 172.21.15.2:0/2357905282 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2407d2f0 con 0x7f8a2407e740 2024-06-13T11:10:13.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.051+0000 7f8a21e00700 1 --2- 172.21.15.2:0/2357905282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a2407e740 0x7f8a2407cba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8a140098a0 tx=0x7f8a14009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fc80c8aee6e00b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:13.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.052+0000 7f8a20a00700 1 -- 172.21.15.2:0/2357905282 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a14004160 con 0x7f8a2407e740 2024-06-13T11:10:13.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.052+0000 7f8a20a00700 1 -- 172.21.15.2:0/2357905282 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a14004300 con 0x7f8a2407e740 2024-06-13T11:10:13.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.052+0000 7f8a20a00700 1 -- 172.21.15.2:0/2357905282 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a14011b20 con 0x7f8a2407e740 2024-06-13T11:10:13.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.053+0000 7f8a28a00700 1 -- 172.21.15.2:0/2357905282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a2407e740 msgr2=0x7f8a2407cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:13.895 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.053+0000 7f8a28a00700 1 --2- 172.21.15.2:0/2357905282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a2407e740 0x7f8a2407cba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8a140098a0 tx=0x7f8a14009bb0 comp rx=0 tx=0).stop 2024-06-13T11:10:13.895 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.053+0000 7f8a28a00700 1 -- 172.21.15.2:0/2357905282 shutdown_connections 2024-06-13T11:10:13.895 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.053+0000 7f8a28a00700 1 --2- 172.21.15.2:0/2357905282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a2407e740 0x7f8a2407cba0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:13.895 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.053+0000 7f8a28a00700 1 -- 172.21.15.2:0/2357905282 >> 172.21.15.2:0/2357905282 conn(0x7f8a24103500 msgr2=0x7f8a24105940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:13.895 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.053+0000 7f8a28a00700 1 -- 172.21.15.2:0/2357905282 shutdown_connections 2024-06-13T11:10:13.895 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.053+0000 7f8a28a00700 1 -- 172.21.15.2:0/2357905282 wait complete. 2024-06-13T11:10:13.895 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.054+0000 7f8a28a00700 1 Processor -- start 2024-06-13T11:10:13.895 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.055+0000 7f8a28a00700 1 -- start start 2024-06-13T11:10:13.895 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.055+0000 7f8a28a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a2407e740 0x7f8a2419e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:13.895 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.055+0000 7f8a28a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2410e5d0 con 0x7f8a2407e740 2024-06-13T11:10:13.895 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.055+0000 7f8a21e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a2407e740 0x7f8a2419e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:13.895 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.055+0000 7f8a21e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a2407e740 0x7f8a2419e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56570/0 (socket says 172.21.15.2:56570) 2024-06-13T11:10:13.896 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.055+0000 7f8a21e00700 1 -- 172.21.15.2:0/2146027956 learned_addr learned my addr 172.21.15.2:0/2146027956 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:13.896 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.056+0000 7f8a21e00700 1 -- 172.21.15.2:0/2146027956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2419e580 con 0x7f8a2407e740 2024-06-13T11:10:13.896 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.056+0000 7f8a21e00700 1 --2- 172.21.15.2:0/2146027956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a2407e740 0x7f8a2419e040 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8a140117e0 tx=0x7f8a14011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:13.896 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.056+0000 7f8a1aa00700 1 -- 172.21.15.2:0/2146027956 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a14003bf0 con 0x7f8a2407e740 2024-06-13T11:10:13.896 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.056+0000 7f8a1aa00700 1 -- 172.21.15.2:0/2146027956 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a14003d90 con 0x7f8a2407e740 2024-06-13T11:10:13.896 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.056+0000 7f8a1aa00700 1 -- 172.21.15.2:0/2146027956 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a140247d0 con 0x7f8a2407e740 2024-06-13T11:10:13.896 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.056+0000 7f8a28a00700 1 -- 172.21.15.2:0/2146027956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2419e810 con 0x7f8a2407e740 2024-06-13T11:10:13.896 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.056+0000 7f8a28a00700 1 -- 172.21.15.2:0/2146027956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a2419ec70 con 0x7f8a2407e740 2024-06-13T11:10:13.896 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.058+0000 7f8a28a00700 1 -- 172.21.15.2:0/2146027956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a24063af0 con 0x7f8a2407e740 2024-06-13T11:10:13.896 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.058+0000 7f8a1aa00700 1 -- 172.21.15.2:0/2146027956 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f8a14022020 con 0x7f8a2407e740 2024-06-13T11:10:13.896 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.059+0000 7f8a1aa00700 1 --2- 172.21.15.2:0/2146027956 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f8a08039050 0x7f8a0803b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:13.896 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.059+0000 7f8a1aa00700 1 -- 172.21.15.2:0/2146027956 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8a1404d220 con 0x7f8a2407e740 2024-06-13T11:10:13.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.059+0000 7f8a21400700 1 --2- 172.21.15.2:0/2146027956 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f8a08039050 0x7f8a0803b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:13.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.060+0000 7f8a21400700 1 --2- 172.21.15.2:0/2146027956 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f8a08039050 0x7f8a0803b510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a10006fd0 tx=0x7f8a10006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:13.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.064+0000 7f8a1aa00700 1 -- 172.21.15.2:0/2146027956 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8a14011e20 con 0x7f8a2407e740 2024-06-13T11:10:13.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.298+0000 7f8a28a00700 1 -- 172.21.15.2:0/2146027956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f8a241a1640 con 0x7f8a2407e740 2024-06-13T11:10:13.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.302+0000 7f8a1aa00700 1 -- 172.21.15.2:0/2146027956 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f8a14016c70 con 0x7f8a2407e740 2024-06-13T11:10:13.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.305+0000 7f8a28a00700 1 -- 172.21.15.2:0/2146027956 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f8a08039050 msgr2=0x7f8a0803b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:13.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.305+0000 7f8a28a00700 1 --2- 172.21.15.2:0/2146027956 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f8a08039050 0x7f8a0803b510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a10006fd0 tx=0x7f8a10006e40 comp rx=0 tx=0).stop 2024-06-13T11:10:13.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.305+0000 7f8a28a00700 1 -- 172.21.15.2:0/2146027956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a2407e740 msgr2=0x7f8a2419e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:13.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.305+0000 7f8a28a00700 1 --2- 172.21.15.2:0/2146027956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a2407e740 0x7f8a2419e040 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8a140117e0 tx=0x7f8a14011c10 comp rx=0 tx=0).stop 2024-06-13T11:10:13.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.306+0000 7f8a28a00700 1 -- 172.21.15.2:0/2146027956 shutdown_connections 2024-06-13T11:10:13.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.306+0000 7f8a28a00700 1 --2- 172.21.15.2:0/2146027956 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f8a08039050 0x7f8a0803b510 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:13.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.306+0000 7f8a28a00700 1 --2- 172.21.15.2:0/2146027956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a2407e740 0x7f8a2419e040 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:13.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.306+0000 7f8a28a00700 1 -- 172.21.15.2:0/2146027956 >> 172.21.15.2:0/2146027956 conn(0x7f8a24103500 msgr2=0x7f8a24103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:13.897 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.306+0000 7f8a28a00700 1 -- 172.21.15.2:0/2146027956 shutdown_connections 2024-06-13T11:10:13.898 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:13.306+0000 7f8a28a00700 1 -- 172.21.15.2:0/2146027956 wait complete. 2024-06-13T11:10:13.898 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling the dashboard module... 2024-06-13T11:10:14.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:14 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2146027956' entity='client.admin' 2024-06-13T11:10:14.522 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:14 smithi002 ceph-mon[32210]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:10:16.021 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:15 smithi002 ceph-mon[32210]: from='mgr.14120 172.21.15.2:0/69988025' entity='mgr.x' 2024-06-13T11:10:16.021 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:15 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3216082250' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-06-13T11:10:16.022 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:15 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: ignoring --setuser ceph since I am not root 2024-06-13T11:10:16.022 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:15 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: ignoring --setgroup ceph since I am not root 2024-06-13T11:10:16.322 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:16 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:16.060+0000 7f567cf62200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T11:10:16.645 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:16 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:16.321+0000 7f567cf62200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:10:16.646 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:16 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:16.459+0000 7f567cf62200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T11:10:16.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:16 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3216082250' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-06-13T11:10:16.992 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:16 smithi002 ceph-mon[32210]: mgrmap e9: x(active, since 26s) 2024-06-13T11:10:16.992 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:16 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:16.873+0000 7f567cf62200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T11:10:16.993 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:16 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:16.992+0000 7f567cf62200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T11:10:17.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.522+0000 7f6b5a000700 1 Processor -- start 2024-06-13T11:10:17.199 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.522+0000 7f6b5a000700 1 -- start start 2024-06-13T11:10:17.199 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.523+0000 7f6b5a000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b54106e50 0x7f6b54107270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:17.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.523+0000 7f6b5a000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6b541077b0 con 0x7f6b54106e50 2024-06-13T11:10:17.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.523+0000 7f6b53400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b54106e50 0x7f6b54107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:17.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.523+0000 7f6b53400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b54106e50 0x7f6b54107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56574/0 (socket says 172.21.15.2:56574) 2024-06-13T11:10:17.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.523+0000 7f6b53400700 1 -- 172.21.15.2:0/319814303 learned_addr learned my addr 172.21.15.2:0/319814303 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:17.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.524+0000 7f6b53400700 1 -- 172.21.15.2:0/319814303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b54107fb0 con 0x7f6b54106e50 2024-06-13T11:10:17.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.524+0000 7f6b53400700 1 --2- 172.21.15.2:0/319814303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b54106e50 0x7f6b54107270 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6b440098a0 tx=0x7f6b44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3989c9542412d40 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:17.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.525+0000 7f6b52000700 1 -- 172.21.15.2:0/319814303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b44004160 con 0x7f6b54106e50 2024-06-13T11:10:17.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.525+0000 7f6b52000700 1 -- 172.21.15.2:0/319814303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b44004300 con 0x7f6b54106e50 2024-06-13T11:10:17.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.525+0000 7f6b52000700 1 -- 172.21.15.2:0/319814303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b44011b20 con 0x7f6b54106e50 2024-06-13T11:10:17.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.525+0000 7f6b5a000700 1 -- 172.21.15.2:0/319814303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b54106e50 msgr2=0x7f6b54107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:17.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.525+0000 7f6b5a000700 1 --2- 172.21.15.2:0/319814303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b54106e50 0x7f6b54107270 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6b440098a0 tx=0x7f6b44009bb0 comp rx=0 tx=0).stop 2024-06-13T11:10:17.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.526+0000 7f6b5a000700 1 -- 172.21.15.2:0/319814303 shutdown_connections 2024-06-13T11:10:17.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.526+0000 7f6b5a000700 1 --2- 172.21.15.2:0/319814303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b54106e50 0x7f6b54107270 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:17.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.526+0000 7f6b5a000700 1 -- 172.21.15.2:0/319814303 >> 172.21.15.2:0/319814303 conn(0x7f6b541023f0 msgr2=0x7f6b54104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:17.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.526+0000 7f6b5a000700 1 -- 172.21.15.2:0/319814303 shutdown_connections 2024-06-13T11:10:17.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.526+0000 7f6b5a000700 1 -- 172.21.15.2:0/319814303 wait complete. 2024-06-13T11:10:17.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.527+0000 7f6b5a000700 1 Processor -- start 2024-06-13T11:10:17.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.527+0000 7f6b5a000700 1 -- start start 2024-06-13T11:10:17.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.528+0000 7f6b5a000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b54106e50 0x7f6b5419be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:17.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.528+0000 7f6b5a000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5410b3f0 con 0x7f6b54106e50 2024-06-13T11:10:17.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.528+0000 7f6b53400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b54106e50 0x7f6b5419be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:17.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.528+0000 7f6b53400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b54106e50 0x7f6b5419be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56588/0 (socket says 172.21.15.2:56588) 2024-06-13T11:10:17.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.528+0000 7f6b53400700 1 -- 172.21.15.2:0/3216082250 learned_addr learned my addr 172.21.15.2:0/3216082250 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:17.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.528+0000 7f6b53400700 1 -- 172.21.15.2:0/3216082250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5419c3b0 con 0x7f6b54106e50 2024-06-13T11:10:17.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.529+0000 7f6b53400700 1 --2- 172.21.15.2:0/3216082250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b54106e50 0x7f6b5419be70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b44011b60 tx=0x7f6b44011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:17.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.529+0000 7f6b4be00700 1 -- 172.21.15.2:0/3216082250 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b44003b60 con 0x7f6b54106e50 2024-06-13T11:10:17.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.529+0000 7f6b4be00700 1 -- 172.21.15.2:0/3216082250 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b4401a910 con 0x7f6b54106e50 2024-06-13T11:10:17.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.529+0000 7f6b5a000700 1 -- 172.21.15.2:0/3216082250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5419c640 con 0x7f6b54106e50 2024-06-13T11:10:17.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.529+0000 7f6b4be00700 1 -- 172.21.15.2:0/3216082250 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b44024930 con 0x7f6b54106e50 2024-06-13T11:10:17.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.529+0000 7f6b5a000700 1 -- 172.21.15.2:0/3216082250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b5419caa0 con 0x7f6b54106e50 2024-06-13T11:10:17.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.531+0000 7f6b4be00700 1 -- 172.21.15.2:0/3216082250 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6b44022020 con 0x7f6b54106e50 2024-06-13T11:10:17.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.531+0000 7f6b5a000700 1 -- 172.21.15.2:0/3216082250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b54063af0 con 0x7f6b54106e50 2024-06-13T11:10:17.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.531+0000 7f6b4be00700 1 --2- 172.21.15.2:0/3216082250 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f6b380390a0 0x7f6b3803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:17.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.531+0000 7f6b4be00700 1 -- 172.21.15.2:0/3216082250 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6b4404d210 con 0x7f6b54106e50 2024-06-13T11:10:17.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.531+0000 7f6b52a00700 1 --2- 172.21.15.2:0/3216082250 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f6b380390a0 0x7f6b3803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:17.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.532+0000 7f6b52a00700 1 --2- 172.21.15.2:0/3216082250 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f6b380390a0 0x7f6b3803b560 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6b40006fd0 tx=0x7f6b40006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:17.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.541+0000 7f6b4be00700 1 -- 172.21.15.2:0/3216082250 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6b4400b3e0 con 0x7f6b54106e50 2024-06-13T11:10:17.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:14.844+0000 7f6b5a000700 1 -- 172.21.15.2:0/3216082250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f6b540630a0 con 0x7f6b54106e50 2024-06-13T11:10:17.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:15.713+0000 7f6b4be00700 1 -- 172.21.15.2:0/3216082250 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f6b4402dde0 con 0x7f6b54106e50 2024-06-13T11:10:17.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:15.718+0000 7f6b4be00700 1 -- 172.21.15.2:0/3216082250 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f6b44024ad0 con 0x7f6b54106e50 2024-06-13T11:10:17.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:15.718+0000 7f6b5a000700 1 -- 172.21.15.2:0/3216082250 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f6b380390a0 msgr2=0x7f6b3803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:17.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:15.718+0000 7f6b5a000700 1 --2- 172.21.15.2:0/3216082250 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f6b380390a0 0x7f6b3803b560 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6b40006fd0 tx=0x7f6b40006e40 comp rx=0 tx=0).stop 2024-06-13T11:10:17.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:15.719+0000 7f6b5a000700 1 -- 172.21.15.2:0/3216082250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b54106e50 msgr2=0x7f6b5419be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:17.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:15.719+0000 7f6b5a000700 1 --2- 172.21.15.2:0/3216082250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b54106e50 0x7f6b5419be70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b44011b60 tx=0x7f6b44011c40 comp rx=0 tx=0).stop 2024-06-13T11:10:17.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:15.719+0000 7f6b5a000700 1 -- 172.21.15.2:0/3216082250 shutdown_connections 2024-06-13T11:10:17.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:15.719+0000 7f6b5a000700 1 --2- 172.21.15.2:0/3216082250 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f6b380390a0 0x7f6b3803b560 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:17.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:15.719+0000 7f6b5a000700 1 --2- 172.21.15.2:0/3216082250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b54106e50 0x7f6b5419be70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:17.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:15.719+0000 7f6b5a000700 1 -- 172.21.15.2:0/3216082250 >> 172.21.15.2:0/3216082250 conn(0x7f6b541023f0 msgr2=0x7f6b54103240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:17.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:15.720+0000 7f6b5a000700 1 -- 172.21.15.2:0/3216082250 shutdown_connections 2024-06-13T11:10:17.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:15.720+0000 7f6b5a000700 1 -- 172.21.15.2:0/3216082250 wait complete. 2024-06-13T11:10:18.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:18 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2259579792' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-13T11:10:18.750 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:18 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:18.610+0000 7f567cf62200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T11:10:18.761 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-06-13T11:10:18.761 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-06-13T11:10:18.767 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-13T11:10:18.767 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-13T11:10:18.767 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-13T11:10:18.767 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-06-13T11:10:18.767 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.791+0000 7f7013000700 1 Processor -- start 2024-06-13T11:10:18.767 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.792+0000 7f7013000700 1 -- start start 2024-06-13T11:10:18.767 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.792+0000 7f7013000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f700c107f90 0x7f700c1083b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:18.768 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.792+0000 7f7013000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f700c108980 con 0x7f700c107f90 2024-06-13T11:10:18.768 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.793+0000 7f700be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f700c107f90 0x7f700c1083b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:18.768 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.793+0000 7f700be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f700c107f90 0x7f700c1083b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52886/0 (socket says 172.21.15.2:52886) 2024-06-13T11:10:18.768 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.793+0000 7f700be00700 1 -- 172.21.15.2:0/4019491974 learned_addr learned my addr 172.21.15.2:0/4019491974 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:18.768 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.793+0000 7f700be00700 1 -- 172.21.15.2:0/4019491974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700c109190 con 0x7f700c107f90 2024-06-13T11:10:18.768 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.794+0000 7f700be00700 1 --2- 172.21.15.2:0/4019491974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f700c107f90 0x7f700c1083b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0098a0 tx=0x7f6ffc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67b1c543f18364c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:18.768 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.794+0000 7f700b400700 1 -- 172.21.15.2:0/4019491974 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ffc004160 con 0x7f700c107f90 2024-06-13T11:10:18.768 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.794+0000 7f700b400700 1 -- 172.21.15.2:0/4019491974 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ffc004300 con 0x7f700c107f90 2024-06-13T11:10:18.768 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.794+0000 7f700b400700 1 -- 172.21.15.2:0/4019491974 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ffc011b20 con 0x7f700c107f90 2024-06-13T11:10:18.768 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.794+0000 7f7013000700 1 -- 172.21.15.2:0/4019491974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f700c107f90 msgr2=0x7f700c1083b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:18.768 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.794+0000 7f7013000700 1 --2- 172.21.15.2:0/4019491974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f700c107f90 0x7f700c1083b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0098a0 tx=0x7f6ffc009bb0 comp rx=0 tx=0).stop 2024-06-13T11:10:18.768 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.795+0000 7f7013000700 1 -- 172.21.15.2:0/4019491974 shutdown_connections 2024-06-13T11:10:18.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.795+0000 7f7013000700 1 --2- 172.21.15.2:0/4019491974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f700c107f90 0x7f700c1083b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:18.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.795+0000 7f7013000700 1 -- 172.21.15.2:0/4019491974 >> 172.21.15.2:0/4019491974 conn(0x7f700c103570 msgr2=0x7f700c105990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:18.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.795+0000 7f7013000700 1 -- 172.21.15.2:0/4019491974 shutdown_connections 2024-06-13T11:10:18.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.795+0000 7f7013000700 1 -- 172.21.15.2:0/4019491974 wait complete. 2024-06-13T11:10:18.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.796+0000 7f7013000700 1 Processor -- start 2024-06-13T11:10:18.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.796+0000 7f7013000700 1 -- start start 2024-06-13T11:10:18.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.796+0000 7f7013000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f700c107f90 0x7f700c19e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:18.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.796+0000 7f7013000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f700c10c540 con 0x7f700c107f90 2024-06-13T11:10:18.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.797+0000 7f700be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f700c107f90 0x7f700c19e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:18.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.797+0000 7f700be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f700c107f90 0x7f700c19e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52900/0 (socket says 172.21.15.2:52900) 2024-06-13T11:10:18.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.797+0000 7f700be00700 1 -- 172.21.15.2:0/2259579792 learned_addr learned my addr 172.21.15.2:0/2259579792 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:18.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.797+0000 7f700be00700 1 -- 172.21.15.2:0/2259579792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700c19e5b0 con 0x7f700c107f90 2024-06-13T11:10:18.769 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.797+0000 7f700be00700 1 --2- 172.21.15.2:0/2259579792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f700c107f90 0x7f700c19e070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0117e0 tx=0x7f6ffc011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:18.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.797+0000 7f7009600700 1 -- 172.21.15.2:0/2259579792 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ffc003bf0 con 0x7f700c107f90 2024-06-13T11:10:18.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.798+0000 7f7009600700 1 -- 172.21.15.2:0/2259579792 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ffc01a910 con 0x7f700c107f90 2024-06-13T11:10:18.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.798+0000 7f7013000700 1 -- 172.21.15.2:0/2259579792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f700c19e840 con 0x7f700c107f90 2024-06-13T11:10:18.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.798+0000 7f7009600700 1 -- 172.21.15.2:0/2259579792 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ffc0249a0 con 0x7f700c107f90 2024-06-13T11:10:18.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.798+0000 7f7013000700 1 -- 172.21.15.2:0/2259579792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f700c19eca0 con 0x7f700c107f90 2024-06-13T11:10:18.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.799+0000 7f7009600700 1 -- 172.21.15.2:0/2259579792 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f6ffc022020 con 0x7f700c107f90 2024-06-13T11:10:18.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.799+0000 7f7013000700 1 -- 172.21.15.2:0/2259579792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f700c063af0 con 0x7f700c107f90 2024-06-13T11:10:18.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.799+0000 7f7009600700 1 --2- 172.21.15.2:0/2259579792 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f6ff0039050 0x7f6ff003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:18.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.799+0000 7f7009600700 1 -- 172.21.15.2:0/2259579792 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6ffc04d4a0 con 0x7f700c107f90 2024-06-13T11:10:18.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.800+0000 7f7003e00700 1 -- 172.21.15.2:0/2259579792 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f6ff0039050 msgr2=0x7f6ff003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1821969949 2024-06-13T11:10:18.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.800+0000 7f7003e00700 1 --2- 172.21.15.2:0/2259579792 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f6ff0039050 0x7f6ff003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:10:18.770 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:17.805+0000 7f7009600700 1 -- 172.21.15.2:0/2259579792 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6ffc011e20 con 0x7f700c107f90 2024-06-13T11:10:18.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:18.001+0000 7f7003e00700 1 -- 172.21.15.2:0/2259579792 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f6ff0039050 msgr2=0x7f6ff003b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1821969949 2024-06-13T11:10:18.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:18.001+0000 7f7003e00700 1 --2- 172.21.15.2:0/2259579792 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f6ff0039050 0x7f6ff003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T11:10:18.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:18.087+0000 7f7013000700 1 -- 172.21.15.2:0/2259579792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f700c1a15f0 con 0x7f700c107f90 2024-06-13T11:10:18.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:18.088+0000 7f7009600700 1 -- 172.21.15.2:0/2259579792 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f6ffc004300 con 0x7f700c107f90 2024-06-13T11:10:18.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:18.091+0000 7f7013000700 1 -- 172.21.15.2:0/2259579792 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f6ff0039050 msgr2=0x7f6ff003b510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:10:18.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:18.091+0000 7f7013000700 1 --2- 172.21.15.2:0/2259579792 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f6ff0039050 0x7f6ff003b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:18.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:18.091+0000 7f7013000700 1 -- 172.21.15.2:0/2259579792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f700c107f90 msgr2=0x7f700c19e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:18.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:18.091+0000 7f7013000700 1 --2- 172.21.15.2:0/2259579792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f700c107f90 0x7f700c19e070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0117e0 tx=0x7f6ffc011c10 comp rx=0 tx=0).stop 2024-06-13T11:10:18.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:18.091+0000 7f7013000700 1 -- 172.21.15.2:0/2259579792 shutdown_connections 2024-06-13T11:10:18.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:18.091+0000 7f7013000700 1 --2- 172.21.15.2:0/2259579792 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f6ff0039050 0x7f6ff003b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:18.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:18.091+0000 7f7013000700 1 --2- 172.21.15.2:0/2259579792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f700c107f90 0x7f700c19e070 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:18.771 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:18.091+0000 7f7013000700 1 -- 172.21.15.2:0/2259579792 >> 172.21.15.2:0/2259579792 conn(0x7f700c103570 msgr2=0x7f700c103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:18.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:18.091+0000 7f7013000700 1 -- 172.21.15.2:0/2259579792 shutdown_connections 2024-06-13T11:10:18.772 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:18.091+0000 7f7013000700 1 -- 172.21.15.2:0/2259579792 wait complete. 2024-06-13T11:10:18.772 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-06-13T11:10:18.772 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 9... 2024-06-13T11:10:19.017 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:18 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:18.850+0000 7f567cf62200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T11:10:19.330 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:19 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:19.075+0000 7f567cf62200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T11:10:19.602 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:19 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:19.474+0000 7f567cf62200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T11:10:19.602 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:19 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:19.601+0000 7f567cf62200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T11:10:20.127 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:19 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:19.862+0000 7f567cf62200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T11:10:20.127 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:20 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:20.127+0000 7f567cf62200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:10:21.145 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:20 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:20.971+0000 7f567cf62200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T11:10:21.895 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:21 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:21.546+0000 7f567cf62200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T11:10:21.895 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:21 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:21.681+0000 7f567cf62200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T11:10:22.343 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:21 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:21.959+0000 7f567cf62200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T11:10:23.126 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:22 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:22.658+0000 7f567cf62200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T11:10:23.127 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:22 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:22.786+0000 7f567cf62200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T11:10:23.127 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:23 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:23.126+0000 7f567cf62200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T11:10:23.395 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:23 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:23.312+0000 7f567cf62200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T11:10:23.896 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:23 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:23.443+0000 7f567cf62200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T11:10:23.896 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:23 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:23.603+0000 7f567cf62200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T11:10:24.395 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:23 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:23.980+0000 7f567cf62200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T11:10:25.079 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:24 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:24.773+0000 7f567cf62200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T11:10:25.395 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:10:25 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:10:25.079+0000 7f567cf62200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T11:10:25.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:25 smithi002 ceph-mon[32210]: Active manager daemon x restarted 2024-06-13T11:10:25.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:25 smithi002 ceph-mon[32210]: Activating manager daemon x 2024-06-13T11:10:25.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:25 smithi002 ceph-mon[32210]: osdmap e3: 0 total, 0 up, 0 in 2024-06-13T11:10:25.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:25 smithi002 ceph-mon[32210]: mgrmap e10: x(active, starting, since 0.00504272s) 2024-06-13T11:10:25.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:10:25.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-13T11:10:25.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-13T11:10:25.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-13T11:10:25.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-13T11:10:25.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:25 smithi002 ceph-mon[32210]: Manager daemon x is now available 2024-06-13T11:10:26.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:10:26.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T11:10:26.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T11:10:26.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:26 smithi002 ceph-mon[32210]: mgrmap e11: x(active, since 1.01109s) 2024-06-13T11:10:27.062 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-06-13T11:10:27.062 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-06-13T11:10:27.063 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-13T11:10:27.063 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-06-13T11:10:27.063 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.329+0000 7f7459c00700 1 Processor -- start 2024-06-13T11:10:27.063 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.329+0000 7f7459c00700 1 -- start start 2024-06-13T11:10:27.063 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.330+0000 7f7459c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7454107ef0 0x7f7454108330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:27.063 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.330+0000 7f7459c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7454108870 con 0x7f7454107ef0 2024-06-13T11:10:27.063 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.330+0000 7f7452a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7454107ef0 0x7f7454108330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:27.063 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.330+0000 7f7452a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7454107ef0 0x7f7454108330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52906/0 (socket says 172.21.15.2:52906) 2024-06-13T11:10:27.063 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.330+0000 7f7452a00700 1 -- 172.21.15.2:0/2396262350 learned_addr learned my addr 172.21.15.2:0/2396262350 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:27.063 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.331+0000 7f7452a00700 1 -- 172.21.15.2:0/2396262350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74541090d0 con 0x7f7454107ef0 2024-06-13T11:10:27.063 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.331+0000 7f7452a00700 1 --2- 172.21.15.2:0/2396262350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7454107ef0 0x7f7454108330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f74440098a0 tx=0x7f7444009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44cc918891d046d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:27.063 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.331+0000 7f7451600700 1 -- 172.21.15.2:0/2396262350 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7444004160 con 0x7f7454107ef0 2024-06-13T11:10:27.064 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.331+0000 7f7451600700 1 -- 172.21.15.2:0/2396262350 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7444004300 con 0x7f7454107ef0 2024-06-13T11:10:27.064 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.331+0000 7f7451600700 1 -- 172.21.15.2:0/2396262350 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7444011b20 con 0x7f7454107ef0 2024-06-13T11:10:27.064 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.332+0000 7f7459c00700 1 -- 172.21.15.2:0/2396262350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7454107ef0 msgr2=0x7f7454108330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:27.064 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.332+0000 7f7459c00700 1 --2- 172.21.15.2:0/2396262350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7454107ef0 0x7f7454108330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f74440098a0 tx=0x7f7444009bb0 comp rx=0 tx=0).stop 2024-06-13T11:10:27.064 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.332+0000 7f7459c00700 1 -- 172.21.15.2:0/2396262350 shutdown_connections 2024-06-13T11:10:27.064 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.332+0000 7f7459c00700 1 --2- 172.21.15.2:0/2396262350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7454107ef0 0x7f7454108330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:27.064 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.332+0000 7f7459c00700 1 -- 172.21.15.2:0/2396262350 >> 172.21.15.2:0/2396262350 conn(0x7f74541034a0 msgr2=0x7f7454105920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:27.064 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.332+0000 7f7459c00700 1 -- 172.21.15.2:0/2396262350 shutdown_connections 2024-06-13T11:10:27.064 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.332+0000 7f7459c00700 1 -- 172.21.15.2:0/2396262350 wait complete. 2024-06-13T11:10:27.064 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.334+0000 7f7459c00700 1 Processor -- start 2024-06-13T11:10:27.064 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.334+0000 7f7459c00700 1 -- start start 2024-06-13T11:10:27.064 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.335+0000 7f7459c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7454107ef0 0x7f745407db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:27.065 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.335+0000 7f7459c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f745410c390 con 0x7f7454107ef0 2024-06-13T11:10:27.065 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.335+0000 7f7452a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7454107ef0 0x7f745407db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:27.065 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.335+0000 7f7452a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7454107ef0 0x7f745407db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52916/0 (socket says 172.21.15.2:52916) 2024-06-13T11:10:27.066 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.335+0000 7f7452a00700 1 -- 172.21.15.2:0/3129104800 learned_addr learned my addr 172.21.15.2:0/3129104800 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:27.066 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.335+0000 7f7452a00700 1 -- 172.21.15.2:0/3129104800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745407e080 con 0x7f7454107ef0 2024-06-13T11:10:27.066 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.336+0000 7f7452a00700 1 --2- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7454107ef0 0x7f745407db40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f74440117e0 tx=0x7f7444011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:27.066 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.336+0000 7f744b400700 1 -- 172.21.15.2:0/3129104800 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7444003bf0 con 0x7f7454107ef0 2024-06-13T11:10:27.066 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.336+0000 7f744b400700 1 -- 172.21.15.2:0/3129104800 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f744401a910 con 0x7f7454107ef0 2024-06-13T11:10:27.066 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.336+0000 7f744b400700 1 -- 172.21.15.2:0/3129104800 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7444024970 con 0x7f7454107ef0 2024-06-13T11:10:27.066 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.336+0000 7f7459c00700 1 -- 172.21.15.2:0/3129104800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f745407c270 con 0x7f7454107ef0 2024-06-13T11:10:27.066 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.336+0000 7f7459c00700 1 -- 172.21.15.2:0/3129104800 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f745407c730 con 0x7f7454107ef0 2024-06-13T11:10:27.066 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.337+0000 7f744b400700 1 -- 172.21.15.2:0/3129104800 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f7444022020 con 0x7f7454107ef0 2024-06-13T11:10:27.066 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.338+0000 7f744b400700 1 --2- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7438039100 0x7f743803b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:27.066 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.338+0000 7f744b400700 1 -- 172.21.15.2:0/3129104800 --> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f743803bcd0 con 0x7f7438039100 2024-06-13T11:10:27.067 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.338+0000 7f744b400700 1 -- 172.21.15.2:0/3129104800 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f744404d430 con 0x7f7454107ef0 2024-06-13T11:10:27.067 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.338+0000 7f7452000700 1 -- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7438039100 msgr2=0x7f743803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1821969949 2024-06-13T11:10:27.067 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.338+0000 7f7452000700 1 --2- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7438039100 0x7f743803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:10:27.067 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.539+0000 7f7452000700 1 -- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7438039100 msgr2=0x7f743803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1821969949 2024-06-13T11:10:27.067 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.539+0000 7f7452000700 1 --2- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7438039100 0x7f743803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T11:10:27.067 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.940+0000 7f7452000700 1 -- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7438039100 msgr2=0x7f743803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1821969949 2024-06-13T11:10:27.067 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:19.940+0000 7f7452000700 1 --2- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7438039100 0x7f743803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-13T11:10:27.067 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:20.741+0000 7f7452000700 1 -- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7438039100 msgr2=0x7f743803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1821969949 2024-06-13T11:10:27.067 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:20.741+0000 7f7452000700 1 --2- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7438039100 0x7f743803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-13T11:10:27.067 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:22.343+0000 7f7452000700 1 -- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7438039100 msgr2=0x7f743803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1821969949 2024-06-13T11:10:27.067 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:22.343+0000 7f7452000700 1 --2- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7438039100 0x7f743803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-13T11:10:27.067 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:25.088+0000 7f744b400700 1 -- 172.21.15.2:0/3129104800 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f744401a430 con 0x7f7454107ef0 2024-06-13T11:10:27.067 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:25.089+0000 7f744b400700 1 -- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7438039100 msgr2=0x7f743803b5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:10:27.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:25.089+0000 7f744b400700 1 --2- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7438039100 0x7f743803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:27.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.093+0000 7f744b400700 1 -- 172.21.15.2:0/3129104800 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f74440188a0 con 0x7f7454107ef0 2024-06-13T11:10:27.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.093+0000 7f744b400700 1 --2- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f743803cbc0 0x7f743803efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:27.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.093+0000 7f744b400700 1 -- 172.21.15.2:0/3129104800 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f744400fec0 con 0x7f743803cbc0 2024-06-13T11:10:27.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.095+0000 7f7452000700 1 --2- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f743803cbc0 0x7f743803efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:27.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.096+0000 7f7452000700 1 --2- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f743803cbc0 0x7f743803efb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7440003a10 tx=0x7f7440009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:27.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.097+0000 7f744b400700 1 -- 172.21.15.2:0/3129104800 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f744400fec0 con 0x7f743803cbc0 2024-06-13T11:10:27.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.104+0000 7f7459c00700 1 -- 172.21.15.2:0/3129104800 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f7454063af0 con 0x7f743803cbc0 2024-06-13T11:10:27.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.105+0000 7f744b400700 1 -- 172.21.15.2:0/3129104800 <== mgr.14152 v2:172.21.15.2:6800/3387272091 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f7454063af0 con 0x7f743803cbc0 2024-06-13T11:10:27.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.105+0000 7f7459c00700 1 -- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f743803cbc0 msgr2=0x7f743803efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:27.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.105+0000 7f7459c00700 1 --2- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f743803cbc0 0x7f743803efb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7440003a10 tx=0x7f7440009270 comp rx=0 tx=0).stop 2024-06-13T11:10:27.068 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.105+0000 7f7459c00700 1 -- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7454107ef0 msgr2=0x7f745407db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:27.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.105+0000 7f7459c00700 1 --2- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7454107ef0 0x7f745407db40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f74440117e0 tx=0x7f7444011ba0 comp rx=0 tx=0).stop 2024-06-13T11:10:27.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.106+0000 7f7459c00700 1 -- 172.21.15.2:0/3129104800 shutdown_connections 2024-06-13T11:10:27.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.106+0000 7f7459c00700 1 --2- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f743803cbc0 0x7f743803efb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:27.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.106+0000 7f7459c00700 1 --2- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7454107ef0 0x7f745407db40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:27.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.106+0000 7f7459c00700 1 --2- 172.21.15.2:0/3129104800 >> [v2:172.21.15.2:6800/1821969949,v1:172.21.15.2:6801/1821969949] conn(0x7f7438039100 0x7f743803b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:27.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.106+0000 7f7459c00700 1 -- 172.21.15.2:0/3129104800 >> 172.21.15.2:0/3129104800 conn(0x7f74541034a0 msgr2=0x7f7454103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:27.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.106+0000 7f7459c00700 1 -- 172.21.15.2:0/3129104800 shutdown_connections 2024-06-13T11:10:27.069 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:26.106+0000 7f7459c00700 1 -- 172.21.15.2:0/3129104800 wait complete. 2024-06-13T11:10:27.069 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 9 is available 2024-06-13T11:10:27.069 INFO:teuthology.orchestra.run.smithi002.stdout:Generating a dashboard self-signed certificate... 2024-06-13T11:10:27.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:27 smithi002 ceph-mon[32210]: [13/Jun/2024:11:10:25] ENGINE Bus STARTING 2024-06-13T11:10:27.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:27 smithi002 ceph-mon[32210]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-13T11:10:27.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:27 smithi002 ceph-mon[32210]: [13/Jun/2024:11:10:26] ENGINE Serving on https://172.21.15.2:7150 2024-06-13T11:10:27.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:27 smithi002 ceph-mon[32210]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-13T11:10:27.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:27 smithi002 ceph-mon[32210]: [13/Jun/2024:11:10:26] ENGINE Serving on http://172.21.15.2:8765 2024-06-13T11:10:27.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:27 smithi002 ceph-mon[32210]: [13/Jun/2024:11:10:26] ENGINE Bus STARTED 2024-06-13T11:10:28.408 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:28 smithi002 ceph-mon[32210]: mgrmap e12: x(active, since 2s) 2024-06-13T11:10:28.408 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:28 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:29.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-06-13T11:10:29.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.008+0000 7f581d600700 1 Processor -- start 2024-06-13T11:10:29.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.008+0000 7f581d600700 1 -- start start 2024-06-13T11:10:29.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.008+0000 7f581d600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818108a90 0x7f581810ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:29.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.008+0000 7f581d600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f581807be00 con 0x7f5818108a90 2024-06-13T11:10:29.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.009+0000 7f5816a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818108a90 0x7f581810ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:29.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.009+0000 7f5816a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818108a90 0x7f581810ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51208/0 (socket says 172.21.15.2:51208) 2024-06-13T11:10:29.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.009+0000 7f5816a00700 1 -- 172.21.15.2:0/2439596767 learned_addr learned my addr 172.21.15.2:0/2439596767 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:29.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.009+0000 7f5816a00700 1 -- 172.21.15.2:0/2439596767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581810b3c0 con 0x7f5818108a90 2024-06-13T11:10:29.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.009+0000 7f5816a00700 1 --2- 172.21.15.2:0/2439596767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818108a90 0x7f581810ae80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58080098a0 tx=0x7f5808009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03619497e965ba0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:29.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.010+0000 7f5815600700 1 -- 172.21.15.2:0/2439596767 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5808004160 con 0x7f5818108a90 2024-06-13T11:10:29.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.010+0000 7f5815600700 1 -- 172.21.15.2:0/2439596767 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5808004300 con 0x7f5818108a90 2024-06-13T11:10:29.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.010+0000 7f5815600700 1 -- 172.21.15.2:0/2439596767 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5808011b20 con 0x7f5818108a90 2024-06-13T11:10:29.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.011+0000 7f581d600700 1 -- 172.21.15.2:0/2439596767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818108a90 msgr2=0x7f581810ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:29.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.011+0000 7f581d600700 1 --2- 172.21.15.2:0/2439596767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818108a90 0x7f581810ae80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58080098a0 tx=0x7f5808009bb0 comp rx=0 tx=0).stop 2024-06-13T11:10:29.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.011+0000 7f581d600700 1 -- 172.21.15.2:0/2439596767 shutdown_connections 2024-06-13T11:10:29.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.011+0000 7f581d600700 1 --2- 172.21.15.2:0/2439596767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818108a90 0x7f581810ae80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:29.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.011+0000 7f581d600700 1 -- 172.21.15.2:0/2439596767 >> 172.21.15.2:0/2439596767 conn(0x7f5818102440 msgr2=0x7f5818104880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:29.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.011+0000 7f581d600700 1 -- 172.21.15.2:0/2439596767 shutdown_connections 2024-06-13T11:10:29.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.011+0000 7f581d600700 1 -- 172.21.15.2:0/2439596767 wait complete. 2024-06-13T11:10:29.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.012+0000 7f581d600700 1 Processor -- start 2024-06-13T11:10:29.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.013+0000 7f581d600700 1 -- start start 2024-06-13T11:10:29.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.013+0000 7f581d600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818108a90 0x7f5818108310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:29.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.013+0000 7f581d600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f581810c3c0 con 0x7f5818108a90 2024-06-13T11:10:29.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.013+0000 7f5816a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818108a90 0x7f5818108310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:29.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.014+0000 7f5816a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818108a90 0x7f5818108310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51216/0 (socket says 172.21.15.2:51216) 2024-06-13T11:10:29.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.014+0000 7f5816a00700 1 -- 172.21.15.2:0/3910388567 learned_addr learned my addr 172.21.15.2:0/3910388567 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:29.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.014+0000 7f5816a00700 1 -- 172.21.15.2:0/3910388567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5818108850 con 0x7f5818108a90 2024-06-13T11:10:29.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.014+0000 7f5816a00700 1 --2- 172.21.15.2:0/3910388567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818108a90 0x7f5818108310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f58080116a0 tx=0x7f5808011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:29.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.015+0000 7f580f400700 1 -- 172.21.15.2:0/3910388567 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5808003a40 con 0x7f5818108a90 2024-06-13T11:10:29.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.015+0000 7f580f400700 1 -- 172.21.15.2:0/3910388567 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5808003be0 con 0x7f5818108a90 2024-06-13T11:10:29.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.015+0000 7f581d600700 1 -- 172.21.15.2:0/3910388567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5818106a40 con 0x7f5818108a90 2024-06-13T11:10:29.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.015+0000 7f580f400700 1 -- 172.21.15.2:0/3910388567 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580801a750 con 0x7f5818108a90 2024-06-13T11:10:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.015+0000 7f581d600700 1 -- 172.21.15.2:0/3910388567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5818106f00 con 0x7f5818108a90 2024-06-13T11:10:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.016+0000 7f580f400700 1 -- 172.21.15.2:0/3910388567 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f5808024430 con 0x7f5818108a90 2024-06-13T11:10:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.016+0000 7f581d600700 1 -- 172.21.15.2:0/3910388567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5818063af0 con 0x7f5818108a90 2024-06-13T11:10:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.017+0000 7f580f400700 1 --2- 172.21.15.2:0/3910388567 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f57fc0390b0 0x7f57fc03b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.017+0000 7f580f400700 1 -- 172.21.15.2:0/3910388567 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f580804d740 con 0x7f5818108a90 2024-06-13T11:10:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.017+0000 7f5816000700 1 --2- 172.21.15.2:0/3910388567 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f57fc0390b0 0x7f57fc03b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.018+0000 7f5816000700 1 --2- 172.21.15.2:0/3910388567 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f57fc0390b0 0x7f57fc03b570 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5804006fd0 tx=0x7f5804006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.023+0000 7f580f400700 1 -- 172.21.15.2:0/3910388567 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5808011e20 con 0x7f5818108a90 2024-06-13T11:10:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.260+0000 7f581d600700 1 -- 172.21.15.2:0/3910388567 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f5818107810 con 0x7f57fc0390b0 2024-06-13T11:10:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.344+0000 7f580f400700 1 -- 172.21.15.2:0/3910388567 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f5818107810 con 0x7f57fc0390b0 2024-06-13T11:10:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.347+0000 7f581d600700 1 -- 172.21.15.2:0/3910388567 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f57fc0390b0 msgr2=0x7f57fc03b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.347+0000 7f581d600700 1 --2- 172.21.15.2:0/3910388567 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f57fc0390b0 0x7f57fc03b570 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5804006fd0 tx=0x7f5804006e40 comp rx=0 tx=0).stop 2024-06-13T11:10:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.347+0000 7f581d600700 1 -- 172.21.15.2:0/3910388567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818108a90 msgr2=0x7f5818108310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.347+0000 7f581d600700 1 --2- 172.21.15.2:0/3910388567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818108a90 0x7f5818108310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f58080116a0 tx=0x7f5808011ba0 comp rx=0 tx=0).stop 2024-06-13T11:10:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.347+0000 7f581d600700 1 -- 172.21.15.2:0/3910388567 shutdown_connections 2024-06-13T11:10:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.347+0000 7f581d600700 1 --2- 172.21.15.2:0/3910388567 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f57fc0390b0 0x7f57fc03b570 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.347+0000 7f581d600700 1 --2- 172.21.15.2:0/3910388567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5818108a90 0x7f5818108310 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.347+0000 7f581d600700 1 -- 172.21.15.2:0/3910388567 >> 172.21.15.2:0/3910388567 conn(0x7f5818102440 msgr2=0x7f5818102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.348+0000 7f581d600700 1 -- 172.21.15.2:0/3910388567 shutdown_connections 2024-06-13T11:10:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:28.348+0000 7f581d600700 1 -- 172.21.15.2:0/3910388567 wait complete. 2024-06-13T11:10:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial admin user... 2024-06-13T11:10:29.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:29 smithi002 ceph-mon[32210]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:10:29.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:29 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:29.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:29 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:31.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$abcun7K5Y0RhOcsH7AtmwuTjriJiHn32CEgfoSS9JQJMrkFZaawTG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1718277030, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-06-13T11:10:31.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.776+0000 7fefc1800700 1 Processor -- start 2024-06-13T11:10:31.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.776+0000 7fefc1800700 1 -- start start 2024-06-13T11:10:31.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.777+0000 7fefc1800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefbc1088e0 0x7fefbc10acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:31.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.777+0000 7fefc1800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fefbc07c730 con 0x7fefbc1088e0 2024-06-13T11:10:31.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.777+0000 7fefbbe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefbc1088e0 0x7fefbc10acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:31.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.778+0000 7fefbbe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefbc1088e0 0x7fefbc10acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51232/0 (socket says 172.21.15.2:51232) 2024-06-13T11:10:31.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.778+0000 7fefbbe00700 1 -- 172.21.15.2:0/2908113998 learned_addr learned my addr 172.21.15.2:0/2908113998 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:31.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.778+0000 7fefbbe00700 1 -- 172.21.15.2:0/2908113998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefbc10b210 con 0x7fefbc1088e0 2024-06-13T11:10:31.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.778+0000 7fefbbe00700 1 --2- 172.21.15.2:0/2908113998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefbc1088e0 0x7fefbc10acd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fefac0098a0 tx=0x7fefac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b739eb101a09ebc2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:31.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.779+0000 7fefbaa00700 1 -- 172.21.15.2:0/2908113998 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefac004160 con 0x7fefbc1088e0 2024-06-13T11:10:31.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.779+0000 7fefbaa00700 1 -- 172.21.15.2:0/2908113998 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefac004300 con 0x7fefbc1088e0 2024-06-13T11:10:31.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.779+0000 7fefbaa00700 1 -- 172.21.15.2:0/2908113998 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefac011b20 con 0x7fefbc1088e0 2024-06-13T11:10:31.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.780+0000 7fefc1800700 1 -- 172.21.15.2:0/2908113998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefbc1088e0 msgr2=0x7fefbc10acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:31.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.780+0000 7fefc1800700 1 --2- 172.21.15.2:0/2908113998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefbc1088e0 0x7fefbc10acd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fefac0098a0 tx=0x7fefac009bb0 comp rx=0 tx=0).stop 2024-06-13T11:10:31.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.780+0000 7fefc1800700 1 -- 172.21.15.2:0/2908113998 shutdown_connections 2024-06-13T11:10:31.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.780+0000 7fefc1800700 1 --2- 172.21.15.2:0/2908113998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefbc1088e0 0x7fefbc10acd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:31.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.780+0000 7fefc1800700 1 -- 172.21.15.2:0/2908113998 >> 172.21.15.2:0/2908113998 conn(0x7fefbc1022b0 msgr2=0x7fefbc1046d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:31.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.780+0000 7fefc1800700 1 -- 172.21.15.2:0/2908113998 shutdown_connections 2024-06-13T11:10:31.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.780+0000 7fefc1800700 1 -- 172.21.15.2:0/2908113998 wait complete. 2024-06-13T11:10:31.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.781+0000 7fefc1800700 1 Processor -- start 2024-06-13T11:10:31.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.781+0000 7fefc1800700 1 -- start start 2024-06-13T11:10:31.036 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.782+0000 7fefc1800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefbc1088e0 0x7fefbc108160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:31.036 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.782+0000 7fefc1800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fefbc10c2d0 con 0x7fefbc1088e0 2024-06-13T11:10:31.036 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.782+0000 7fefbbe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefbc1088e0 0x7fefbc108160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:31.036 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.782+0000 7fefbbe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefbc1088e0 0x7fefbc108160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51242/0 (socket says 172.21.15.2:51242) 2024-06-13T11:10:31.036 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.782+0000 7fefbbe00700 1 -- 172.21.15.2:0/2468401374 learned_addr learned my addr 172.21.15.2:0/2468401374 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:31.036 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.783+0000 7fefbbe00700 1 -- 172.21.15.2:0/2468401374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefbc1086a0 con 0x7fefbc1088e0 2024-06-13T11:10:31.036 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.783+0000 7fefbbe00700 1 --2- 172.21.15.2:0/2468401374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefbc1088e0 0x7fefbc108160 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fefac011b60 tx=0x7fefac011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:31.036 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.783+0000 7fefb8c00700 1 -- 172.21.15.2:0/2468401374 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefac003b60 con 0x7fefbc1088e0 2024-06-13T11:10:31.036 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.783+0000 7fefb8c00700 1 -- 172.21.15.2:0/2468401374 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefac01a910 con 0x7fefbc1088e0 2024-06-13T11:10:31.036 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.783+0000 7fefb8c00700 1 -- 172.21.15.2:0/2468401374 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefac024930 con 0x7fefbc1088e0 2024-06-13T11:10:31.037 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.783+0000 7fefc1800700 1 -- 172.21.15.2:0/2468401374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefbc106890 con 0x7fefbc1088e0 2024-06-13T11:10:31.037 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.783+0000 7fefc1800700 1 -- 172.21.15.2:0/2468401374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefbc106d50 con 0x7fefbc1088e0 2024-06-13T11:10:31.037 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.785+0000 7fefb8c00700 1 -- 172.21.15.2:0/2468401374 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fefac022020 con 0x7fefbc1088e0 2024-06-13T11:10:31.039 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.785+0000 7fefc1800700 1 -- 172.21.15.2:0/2468401374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefbc063af0 con 0x7fefbc1088e0 2024-06-13T11:10:31.039 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.785+0000 7fefb8c00700 1 --2- 172.21.15.2:0/2468401374 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fefa00390a0 0x7fefa003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:31.039 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.785+0000 7fefb8c00700 1 -- 172.21.15.2:0/2468401374 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fefac04d440 con 0x7fefbc1088e0 2024-06-13T11:10:31.039 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.786+0000 7fefbb400700 1 --2- 172.21.15.2:0/2468401374 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fefa00390a0 0x7fefa003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:31.039 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.786+0000 7fefbb400700 1 --2- 172.21.15.2:0/2468401374 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fefa00390a0 0x7fefa003b560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fefa8006fd0 tx=0x7fefa8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:31.039 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:29.791+0000 7fefb8c00700 1 -- 172.21.15.2:0/2468401374 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fefac00b3e0 con 0x7fefbc1088e0 2024-06-13T11:10:31.039 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:30.084+0000 7fefc1800700 1 -- 172.21.15.2:0/2468401374 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fefbc1073a0 con 0x7fefa00390a0 2024-06-13T11:10:31.039 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:30.367+0000 7fefb8c00700 1 -- 172.21.15.2:0/2468401374 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fefbc1073a0 con 0x7fefa00390a0 2024-06-13T11:10:31.039 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:30.371+0000 7fefc1800700 1 -- 172.21.15.2:0/2468401374 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fefa00390a0 msgr2=0x7fefa003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:31.039 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:30.371+0000 7fefc1800700 1 --2- 172.21.15.2:0/2468401374 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fefa00390a0 0x7fefa003b560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fefa8006fd0 tx=0x7fefa8006e40 comp rx=0 tx=0).stop 2024-06-13T11:10:31.040 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:30.371+0000 7fefc1800700 1 -- 172.21.15.2:0/2468401374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefbc1088e0 msgr2=0x7fefbc108160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:31.040 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:30.371+0000 7fefc1800700 1 --2- 172.21.15.2:0/2468401374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefbc1088e0 0x7fefbc108160 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fefac011b60 tx=0x7fefac011c40 comp rx=0 tx=0).stop 2024-06-13T11:10:31.040 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:30.371+0000 7fefc1800700 1 -- 172.21.15.2:0/2468401374 shutdown_connections 2024-06-13T11:10:31.040 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:30.371+0000 7fefc1800700 1 --2- 172.21.15.2:0/2468401374 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fefa00390a0 0x7fefa003b560 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:31.040 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:30.371+0000 7fefc1800700 1 --2- 172.21.15.2:0/2468401374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefbc1088e0 0x7fefbc108160 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:31.040 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:30.371+0000 7fefc1800700 1 -- 172.21.15.2:0/2468401374 >> 172.21.15.2:0/2468401374 conn(0x7fefbc1022b0 msgr2=0x7fefbc102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:31.040 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:30.371+0000 7fefc1800700 1 -- 172.21.15.2:0/2468401374 shutdown_connections 2024-06-13T11:10:31.040 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:30.371+0000 7fefc1800700 1 -- 172.21.15.2:0/2468401374 wait complete. 2024-06-13T11:10:31.040 INFO:teuthology.orchestra.run.smithi002.stdout:Fetching dashboard port number... 2024-06-13T11:10:31.231 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:31.231 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:30 smithi002 ceph-mon[32210]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:10:31.231 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:32.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:31 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/4061994670' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-06-13T11:10:32.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 8443 2024-06-13T11:10:32.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.648+0000 7fbbab800700 1 Processor -- start 2024-06-13T11:10:32.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.648+0000 7fbbab800700 1 -- start start 2024-06-13T11:10:32.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.648+0000 7fbbab800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbba407de90 0x7fbba407c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:32.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.648+0000 7fbbab800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbba407c8c0 con 0x7fbba407de90 2024-06-13T11:10:32.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.649+0000 7fbba8e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbba407de90 0x7fbba407c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:32.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.649+0000 7fbba8e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbba407de90 0x7fbba407c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51256/0 (socket says 172.21.15.2:51256) 2024-06-13T11:10:32.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.649+0000 7fbba8e00700 1 -- 172.21.15.2:0/1125218359 learned_addr learned my addr 172.21.15.2:0/1125218359 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:32.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.649+0000 7fbba8e00700 1 -- 172.21.15.2:0/1125218359 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba407ca40 con 0x7fbba407de90 2024-06-13T11:10:32.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.650+0000 7fbba8e00700 1 --2- 172.21.15.2:0/1125218359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbba407de90 0x7fbba407c2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbb980098a0 tx=0x7fbb98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d841f4c6436fa9b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:32.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.650+0000 7fbba3400700 1 -- 172.21.15.2:0/1125218359 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb98004160 con 0x7fbba407de90 2024-06-13T11:10:32.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.650+0000 7fbba3400700 1 -- 172.21.15.2:0/1125218359 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb98004300 con 0x7fbba407de90 2024-06-13T11:10:32.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.650+0000 7fbba3400700 1 -- 172.21.15.2:0/1125218359 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb98011b20 con 0x7fbba407de90 2024-06-13T11:10:32.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.651+0000 7fbbab800700 1 -- 172.21.15.2:0/1125218359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbba407de90 msgr2=0x7fbba407c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:32.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.651+0000 7fbbab800700 1 --2- 172.21.15.2:0/1125218359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbba407de90 0x7fbba407c2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbb980098a0 tx=0x7fbb98009bb0 comp rx=0 tx=0).stop 2024-06-13T11:10:32.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.651+0000 7fbbab800700 1 -- 172.21.15.2:0/1125218359 shutdown_connections 2024-06-13T11:10:32.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.651+0000 7fbbab800700 1 --2- 172.21.15.2:0/1125218359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbba407de90 0x7fbba407c2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:32.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.651+0000 7fbbab800700 1 -- 172.21.15.2:0/1125218359 >> 172.21.15.2:0/1125218359 conn(0x7fbba41034e0 msgr2=0x7fbba4105940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:32.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.651+0000 7fbbab800700 1 -- 172.21.15.2:0/1125218359 shutdown_connections 2024-06-13T11:10:32.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.651+0000 7fbbab800700 1 -- 172.21.15.2:0/1125218359 wait complete. 2024-06-13T11:10:32.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.652+0000 7fbbab800700 1 Processor -- start 2024-06-13T11:10:32.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.652+0000 7fbbab800700 1 -- start start 2024-06-13T11:10:32.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.652+0000 7fbbab800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbba407de90 0x7fbba419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:32.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.653+0000 7fbbab800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbba410e5a0 con 0x7fbba407de90 2024-06-13T11:10:32.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.653+0000 7fbba8e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbba407de90 0x7fbba419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:32.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.653+0000 7fbba8e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbba407de90 0x7fbba419dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51266/0 (socket says 172.21.15.2:51266) 2024-06-13T11:10:32.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.653+0000 7fbba8e00700 1 -- 172.21.15.2:0/4061994670 learned_addr learned my addr 172.21.15.2:0/4061994670 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:32.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.653+0000 7fbba8e00700 1 -- 172.21.15.2:0/4061994670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba419e530 con 0x7fbba407de90 2024-06-13T11:10:32.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.654+0000 7fbba8e00700 1 --2- 172.21.15.2:0/4061994670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbba407de90 0x7fbba419dff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb980117e0 tx=0x7fbb98011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:32.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.654+0000 7fbba1600700 1 -- 172.21.15.2:0/4061994670 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb98003bf0 con 0x7fbba407de90 2024-06-13T11:10:32.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.654+0000 7fbba1600700 1 -- 172.21.15.2:0/4061994670 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb9801a910 con 0x7fbba407de90 2024-06-13T11:10:32.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.654+0000 7fbba1600700 1 -- 172.21.15.2:0/4061994670 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb98024970 con 0x7fbba407de90 2024-06-13T11:10:32.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.654+0000 7fbbab800700 1 -- 172.21.15.2:0/4061994670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba419e7c0 con 0x7fbba407de90 2024-06-13T11:10:32.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.654+0000 7fbbab800700 1 -- 172.21.15.2:0/4061994670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba419ec20 con 0x7fbba407de90 2024-06-13T11:10:32.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.655+0000 7fbbab800700 1 -- 172.21.15.2:0/4061994670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba4063af0 con 0x7fbba407de90 2024-06-13T11:10:32.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.655+0000 7fbba1600700 1 -- 172.21.15.2:0/4061994670 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fbb98022020 con 0x7fbba407de90 2024-06-13T11:10:32.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.657+0000 7fbba1600700 1 --2- 172.21.15.2:0/4061994670 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fbb8c0390a0 0x7fbb8c03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:32.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.658+0000 7fbba1600700 1 -- 172.21.15.2:0/4061994670 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbb9804d670 con 0x7fbba407de90 2024-06-13T11:10:32.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.658+0000 7fbba3e00700 1 --2- 172.21.15.2:0/4061994670 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fbb8c0390a0 0x7fbb8c03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:32.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.659+0000 7fbba3e00700 1 --2- 172.21.15.2:0/4061994670 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fbb8c0390a0 0x7fbb8c03b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbb90006fd0 tx=0x7fbb90006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:32.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.662+0000 7fbba1600700 1 -- 172.21.15.2:0/4061994670 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbb980212c0 con 0x7fbba407de90 2024-06-13T11:10:32.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.897+0000 7fbbab800700 1 -- 172.21.15.2:0/4061994670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fbba41a16f0 con 0x7fbba407de90 2024-06-13T11:10:32.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.898+0000 7fbba1600700 1 -- 172.21.15.2:0/4061994670 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fbb9801ab70 con 0x7fbba407de90 2024-06-13T11:10:32.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.901+0000 7fbbab800700 1 -- 172.21.15.2:0/4061994670 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fbb8c0390a0 msgr2=0x7fbb8c03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:32.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.901+0000 7fbbab800700 1 --2- 172.21.15.2:0/4061994670 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fbb8c0390a0 0x7fbb8c03b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbb90006fd0 tx=0x7fbb90006e40 comp rx=0 tx=0).stop 2024-06-13T11:10:32.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.901+0000 7fbbab800700 1 -- 172.21.15.2:0/4061994670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbba407de90 msgr2=0x7fbba419dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:32.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.901+0000 7fbbab800700 1 --2- 172.21.15.2:0/4061994670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbba407de90 0x7fbba419dff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb980117e0 tx=0x7fbb98011ba0 comp rx=0 tx=0).stop 2024-06-13T11:10:32.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.901+0000 7fbbab800700 1 -- 172.21.15.2:0/4061994670 shutdown_connections 2024-06-13T11:10:32.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.901+0000 7fbbab800700 1 --2- 172.21.15.2:0/4061994670 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fbb8c0390a0 0x7fbb8c03b560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:32.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.901+0000 7fbbab800700 1 --2- 172.21.15.2:0/4061994670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbba407de90 0x7fbba419dff0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:32.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.901+0000 7fbbab800700 1 -- 172.21.15.2:0/4061994670 >> 172.21.15.2:0/4061994670 conn(0x7fbba41034e0 msgr2=0x7fbba4103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:32.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.902+0000 7fbbab800700 1 -- 172.21.15.2:0/4061994670 shutdown_connections 2024-06-13T11:10:32.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:31.902+0000 7fbbab800700 1 -- 172.21.15.2:0/4061994670 wait complete. 2024-06-13T11:10:32.629 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-13T11:10:32.630 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-06-13T11:10:32.652 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-13T11:10:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-06-13T11:10:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-06-13T11:10:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-06-13T11:10:32.660 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph Dashboard is now available at: 2024-06-13T11:10:32.660 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:10:32.660 INFO:teuthology.orchestra.run.smithi002.stdout: URL: https://smithi002.front.sepia.ceph.com:8443/ 2024-06-13T11:10:32.660 INFO:teuthology.orchestra.run.smithi002.stdout: User: admin 2024-06-13T11:10:32.661 INFO:teuthology.orchestra.run.smithi002.stdout: Password: q79dcay3fm 2024-06-13T11:10:32.661 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:10:32.661 INFO:teuthology.orchestra.run.smithi002.stdout:Saving cluster configuration to /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config directory 2024-06-13T11:10:32.663 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling autotune for osd_memory_target 2024-06-13T11:10:33.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:32 smithi002 ceph-mon[32210]: mgrmap e13: x(active, since 6s) 2024-06-13T11:10:34.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.680+0000 7f00ae800700 1 Processor -- start 2024-06-13T11:10:34.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.681+0000 7f00ae800700 1 -- start start 2024-06-13T11:10:34.575 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.681+0000 7f00ae800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a8107f10 0x7f00a8108350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:34.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.681+0000 7f00ae800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f00a8108890 con 0x7f00a8107f10 2024-06-13T11:10:34.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.681+0000 7f00a7400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a8107f10 0x7f00a8108350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:34.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.681+0000 7f00a7400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a8107f10 0x7f00a8108350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51270/0 (socket says 172.21.15.2:51270) 2024-06-13T11:10:34.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.681+0000 7f00a7400700 1 -- 172.21.15.2:0/1344584564 learned_addr learned my addr 172.21.15.2:0/1344584564 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:34.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.682+0000 7f00a7400700 1 -- 172.21.15.2:0/1344584564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a81090f0 con 0x7f00a8107f10 2024-06-13T11:10:34.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.682+0000 7f00a7400700 1 --2- 172.21.15.2:0/1344584564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a8107f10 0x7f00a8108350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f00980098a0 tx=0x7f0098009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d8ee50f2ac1451 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:34.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.683+0000 7f00a6000700 1 -- 172.21.15.2:0/1344584564 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0098004160 con 0x7f00a8107f10 2024-06-13T11:10:34.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.683+0000 7f00a6000700 1 -- 172.21.15.2:0/1344584564 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0098004300 con 0x7f00a8107f10 2024-06-13T11:10:34.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.683+0000 7f00a6000700 1 -- 172.21.15.2:0/1344584564 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0098011b20 con 0x7f00a8107f10 2024-06-13T11:10:34.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.683+0000 7f00ae800700 1 -- 172.21.15.2:0/1344584564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a8107f10 msgr2=0x7f00a8108350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:34.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.683+0000 7f00ae800700 1 --2- 172.21.15.2:0/1344584564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a8107f10 0x7f00a8108350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f00980098a0 tx=0x7f0098009bb0 comp rx=0 tx=0).stop 2024-06-13T11:10:34.576 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.684+0000 7f00ae800700 1 -- 172.21.15.2:0/1344584564 shutdown_connections 2024-06-13T11:10:34.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.684+0000 7f00ae800700 1 --2- 172.21.15.2:0/1344584564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a8107f10 0x7f00a8108350 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:34.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.684+0000 7f00ae800700 1 -- 172.21.15.2:0/1344584564 >> 172.21.15.2:0/1344584564 conn(0x7f00a81034e0 msgr2=0x7f00a8105940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:34.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.684+0000 7f00ae800700 1 -- 172.21.15.2:0/1344584564 shutdown_connections 2024-06-13T11:10:34.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.684+0000 7f00ae800700 1 -- 172.21.15.2:0/1344584564 wait complete. 2024-06-13T11:10:34.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.685+0000 7f00ae800700 1 Processor -- start 2024-06-13T11:10:34.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.685+0000 7f00ae800700 1 -- start start 2024-06-13T11:10:34.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.686+0000 7f00ae800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a8107f10 0x7f00a807db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:34.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.686+0000 7f00ae800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f00a810c3b0 con 0x7f00a8107f10 2024-06-13T11:10:34.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.686+0000 7f00a7400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a8107f10 0x7f00a807db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:34.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.686+0000 7f00a7400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a8107f10 0x7f00a807db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51284/0 (socket says 172.21.15.2:51284) 2024-06-13T11:10:34.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.686+0000 7f00a7400700 1 -- 172.21.15.2:0/356603280 learned_addr learned my addr 172.21.15.2:0/356603280 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:34.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.687+0000 7f00a7400700 1 -- 172.21.15.2:0/356603280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a807e080 con 0x7f00a8107f10 2024-06-13T11:10:34.577 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.687+0000 7f00a7400700 1 --2- 172.21.15.2:0/356603280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a8107f10 0x7f00a807db40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f00980117e0 tx=0x7f0098011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:34.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.687+0000 7f009fe00700 1 -- 172.21.15.2:0/356603280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0098003bf0 con 0x7f00a8107f10 2024-06-13T11:10:34.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.687+0000 7f009fe00700 1 -- 172.21.15.2:0/356603280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f009801a910 con 0x7f00a8107f10 2024-06-13T11:10:34.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.687+0000 7f009fe00700 1 -- 172.21.15.2:0/356603280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00980249a0 con 0x7f00a8107f10 2024-06-13T11:10:34.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.687+0000 7f00ae800700 1 -- 172.21.15.2:0/356603280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a807c270 con 0x7f00a8107f10 2024-06-13T11:10:34.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.688+0000 7f00ae800700 1 -- 172.21.15.2:0/356603280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a807c730 con 0x7f00a8107f10 2024-06-13T11:10:34.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.689+0000 7f009fe00700 1 -- 172.21.15.2:0/356603280 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f0098022020 con 0x7f00a8107f10 2024-06-13T11:10:34.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.689+0000 7f00ae800700 1 -- 172.21.15.2:0/356603280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a8063af0 con 0x7f00a8107f10 2024-06-13T11:10:34.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.689+0000 7f009fe00700 1 --2- 172.21.15.2:0/356603280 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f008c0391a0 0x7f008c03b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:34.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.689+0000 7f009fe00700 1 -- 172.21.15.2:0/356603280 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f009804d600 con 0x7f00a8107f10 2024-06-13T11:10:34.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.690+0000 7f00a6a00700 1 --2- 172.21.15.2:0/356603280 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f008c0391a0 0x7f008c03b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:34.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.690+0000 7f00a6a00700 1 --2- 172.21.15.2:0/356603280 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f008c0391a0 0x7f008c03b660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0094006fd0 tx=0x7f0094006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:34.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.695+0000 7f009fe00700 1 -- 172.21.15.2:0/356603280 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0098011e20 con 0x7f00a8107f10 2024-06-13T11:10:34.578 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.927+0000 7f00ae800700 1 -- 172.21.15.2:0/356603280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f00a807c9b0 con 0x7f00a8107f10 2024-06-13T11:10:34.579 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.928+0000 7f009fe00700 1 -- 172.21.15.2:0/356603280 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f0098004300 con 0x7f00a8107f10 2024-06-13T11:10:34.579 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.931+0000 7f00ae800700 1 -- 172.21.15.2:0/356603280 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f008c0391a0 msgr2=0x7f008c03b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:34.579 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.931+0000 7f00ae800700 1 --2- 172.21.15.2:0/356603280 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f008c0391a0 0x7f008c03b660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0094006fd0 tx=0x7f0094006e40 comp rx=0 tx=0).stop 2024-06-13T11:10:34.579 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.931+0000 7f00ae800700 1 -- 172.21.15.2:0/356603280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a8107f10 msgr2=0x7f00a807db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:34.579 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.931+0000 7f00ae800700 1 --2- 172.21.15.2:0/356603280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a8107f10 0x7f00a807db40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f00980117e0 tx=0x7f0098011c10 comp rx=0 tx=0).stop 2024-06-13T11:10:34.579 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.931+0000 7f00ae800700 1 -- 172.21.15.2:0/356603280 shutdown_connections 2024-06-13T11:10:34.579 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.931+0000 7f00ae800700 1 --2- 172.21.15.2:0/356603280 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f008c0391a0 0x7f008c03b660 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:34.579 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.931+0000 7f00ae800700 1 --2- 172.21.15.2:0/356603280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a8107f10 0x7f00a807db40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:34.579 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.931+0000 7f00ae800700 1 -- 172.21.15.2:0/356603280 >> 172.21.15.2:0/356603280 conn(0x7f00a81034e0 msgr2=0x7f00a8103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:34.579 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.931+0000 7f00ae800700 1 -- 172.21.15.2:0/356603280 shutdown_connections 2024-06-13T11:10:34.579 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:33.931+0000 7f00ae800700 1 -- 172.21.15.2:0/356603280 wait complete. 2024-06-13T11:10:36.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.167+0000 7f75dea00700 1 Processor -- start 2024-06-13T11:10:36.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.167+0000 7f75dea00700 1 -- start start 2024-06-13T11:10:36.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.168+0000 7f75dea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75d8106800 0x7f75d8106c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:36.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.168+0000 7f75dea00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f75d807c710 con 0x7f75d8106800 2024-06-13T11:10:36.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.168+0000 7f75d7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75d8106800 0x7f75d8106c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:36.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.168+0000 7f75d7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75d8106800 0x7f75d8106c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51286/0 (socket says 172.21.15.2:51286) 2024-06-13T11:10:36.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.168+0000 7f75d7e00700 1 -- 172.21.15.2:0/1620033124 learned_addr learned my addr 172.21.15.2:0/1620033124 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:36.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.169+0000 7f75d7e00700 1 -- 172.21.15.2:0/1620033124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d8107160 con 0x7f75d8106800 2024-06-13T11:10:36.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.169+0000 7f75d7e00700 1 --2- 172.21.15.2:0/1620033124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75d8106800 0x7f75d8106c20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f75c80098a0 tx=0x7f75c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee18abeb731e77b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:36.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.170+0000 7f75d6a00700 1 -- 172.21.15.2:0/1620033124 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75c8004160 con 0x7f75d8106800 2024-06-13T11:10:36.215 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.170+0000 7f75d6a00700 1 -- 172.21.15.2:0/1620033124 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75c8004300 con 0x7f75d8106800 2024-06-13T11:10:36.215 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.170+0000 7f75d6a00700 1 -- 172.21.15.2:0/1620033124 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75c8011b20 con 0x7f75d8106800 2024-06-13T11:10:36.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.170+0000 7f75dea00700 1 -- 172.21.15.2:0/1620033124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75d8106800 msgr2=0x7f75d8106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:36.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.170+0000 7f75dea00700 1 --2- 172.21.15.2:0/1620033124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75d8106800 0x7f75d8106c20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f75c80098a0 tx=0x7f75c8009bb0 comp rx=0 tx=0).stop 2024-06-13T11:10:36.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.171+0000 7f75dea00700 1 -- 172.21.15.2:0/1620033124 shutdown_connections 2024-06-13T11:10:36.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.171+0000 7f75dea00700 1 --2- 172.21.15.2:0/1620033124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75d8106800 0x7f75d8106c20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:36.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.171+0000 7f75dea00700 1 -- 172.21.15.2:0/1620033124 >> 172.21.15.2:0/1620033124 conn(0x7f75d8102480 msgr2=0x7f75d81048a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:36.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.171+0000 7f75dea00700 1 -- 172.21.15.2:0/1620033124 shutdown_connections 2024-06-13T11:10:36.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.171+0000 7f75dea00700 1 -- 172.21.15.2:0/1620033124 wait complete. 2024-06-13T11:10:36.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.172+0000 7f75dea00700 1 Processor -- start 2024-06-13T11:10:36.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.172+0000 7f75dea00700 1 -- start start 2024-06-13T11:10:36.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.172+0000 7f75dea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75d8106800 0x7f75d819e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:36.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.173+0000 7f75dea00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f75d8108230 con 0x7f75d8106800 2024-06-13T11:10:36.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.173+0000 7f75d7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75d8106800 0x7f75d819e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:36.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.173+0000 7f75d7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75d8106800 0x7f75d819e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51298/0 (socket says 172.21.15.2:51298) 2024-06-13T11:10:36.219 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.173+0000 7f75d7e00700 1 -- 172.21.15.2:0/247896016 learned_addr learned my addr 172.21.15.2:0/247896016 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:36.219 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.173+0000 7f75d7e00700 1 -- 172.21.15.2:0/247896016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d819e5f0 con 0x7f75d8106800 2024-06-13T11:10:36.219 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.173+0000 7f75d7e00700 1 --2- 172.21.15.2:0/247896016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75d8106800 0x7f75d819e0b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f75c8011b60 tx=0x7f75c8011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:36.219 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.174+0000 7f75d4c00700 1 -- 172.21.15.2:0/247896016 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75c8003b60 con 0x7f75d8106800 2024-06-13T11:10:36.219 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.174+0000 7f75d4c00700 1 -- 172.21.15.2:0/247896016 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75c801a910 con 0x7f75d8106800 2024-06-13T11:10:36.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.174+0000 7f75dea00700 1 -- 172.21.15.2:0/247896016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d819e880 con 0x7f75d8106800 2024-06-13T11:10:36.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.174+0000 7f75d4c00700 1 -- 172.21.15.2:0/247896016 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75c8024930 con 0x7f75d8106800 2024-06-13T11:10:36.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.174+0000 7f75dea00700 1 -- 172.21.15.2:0/247896016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d819ece0 con 0x7f75d8106800 2024-06-13T11:10:36.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.175+0000 7f75dea00700 1 -- 172.21.15.2:0/247896016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d8063af0 con 0x7f75d8106800 2024-06-13T11:10:36.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.176+0000 7f75d4c00700 1 -- 172.21.15.2:0/247896016 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f75c8022020 con 0x7f75d8106800 2024-06-13T11:10:36.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.176+0000 7f75d4c00700 1 --2- 172.21.15.2:0/247896016 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f75bc0391a0 0x7f75bc03b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:36.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.176+0000 7f75d4c00700 1 -- 172.21.15.2:0/247896016 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f75c804d440 con 0x7f75d8106800 2024-06-13T11:10:36.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.177+0000 7f75d7400700 1 --2- 172.21.15.2:0/247896016 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f75bc0391a0 0x7f75bc03b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:36.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.177+0000 7f75d7400700 1 --2- 172.21.15.2:0/247896016 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f75bc0391a0 0x7f75bc03b660 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f75c4006fd0 tx=0x7f75c4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:36.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.182+0000 7f75d4c00700 1 -- 172.21.15.2:0/247896016 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f75c800b3e0 con 0x7f75d8106800 2024-06-13T11:10:36.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.530+0000 7f75dea00700 1 -- 172.21.15.2:0/247896016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f75d80630a0 con 0x7f75d8106800 2024-06-13T11:10:36.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.537+0000 7f75d4c00700 1 -- 172.21.15.2:0/247896016 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f75c802dde0 con 0x7f75d8106800 2024-06-13T11:10:36.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.539+0000 7f75dea00700 1 -- 172.21.15.2:0/247896016 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f75bc0391a0 msgr2=0x7f75bc03b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:36.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.539+0000 7f75dea00700 1 --2- 172.21.15.2:0/247896016 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f75bc0391a0 0x7f75bc03b660 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f75c4006fd0 tx=0x7f75c4006e40 comp rx=0 tx=0).stop 2024-06-13T11:10:36.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.539+0000 7f75dea00700 1 -- 172.21.15.2:0/247896016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75d8106800 msgr2=0x7f75d819e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:36.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.539+0000 7f75dea00700 1 --2- 172.21.15.2:0/247896016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75d8106800 0x7f75d819e0b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f75c8011b60 tx=0x7f75c8011c40 comp rx=0 tx=0).stop 2024-06-13T11:10:36.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.540+0000 7f75dea00700 1 -- 172.21.15.2:0/247896016 shutdown_connections 2024-06-13T11:10:36.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.540+0000 7f75dea00700 1 --2- 172.21.15.2:0/247896016 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f75bc0391a0 0x7f75bc03b660 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:36.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.540+0000 7f75dea00700 1 --2- 172.21.15.2:0/247896016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75d8106800 0x7f75d819e0b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:36.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.540+0000 7f75dea00700 1 -- 172.21.15.2:0/247896016 >> 172.21.15.2:0/247896016 conn(0x7f75d8102480 msgr2=0x7f75d8194cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:36.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.540+0000 7f75dea00700 1 -- 172.21.15.2:0/247896016 shutdown_connections 2024-06-13T11:10:36.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T11:10:35.540+0000 7f75dea00700 1 -- 172.21.15.2:0/247896016 wait complete. 2024-06-13T11:10:36.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-06-13T11:10:36.223 INFO:teuthology.orchestra.run.smithi002.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-06-13T11:10:36.223 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:10:36.223 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-06-13T11:10:36.223 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:10:36.223 INFO:teuthology.orchestra.run.smithi002.stdout:Or, if you are only running a single cluster on this host: 2024-06-13T11:10:36.223 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:10:36.223 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-06-13T11:10:36.223 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:10:36.224 INFO:teuthology.orchestra.run.smithi002.stdout:Please consider enabling telemetry to help improve Ceph: 2024-06-13T11:10:36.224 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:10:36.224 INFO:teuthology.orchestra.run.smithi002.stdout: ceph telemetry on 2024-06-13T11:10:36.224 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:10:36.224 INFO:teuthology.orchestra.run.smithi002.stdout:For more information see: 2024-06-13T11:10:36.224 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:10:36.224 INFO:teuthology.orchestra.run.smithi002.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-06-13T11:10:36.224 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:10:36.224 INFO:teuthology.orchestra.run.smithi002.stdout:Bootstrap complete. 2024-06-13T11:10:36.337 INFO:tasks.cephadm:Fetching config... 2024-06-13T11:10:36.338 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:10:36.338 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-06-13T11:10:36.397 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-06-13T11:10:36.397 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:10:36.397 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-06-13T11:10:36.442 INFO:tasks.cephadm:Fetching mon keyring... 2024-06-13T11:10:36.442 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:10:36.442 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/keyring of=/dev/stdout 2024-06-13T11:10:36.570 INFO:tasks.cephadm:Fetching pub ssh key... 2024-06-13T11:10:36.571 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:10:36.571 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-06-13T11:10:36.672 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-06-13T11:10:36.672 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1sJkrYXnpDnHx0kcTvVgnu9H8ROrwEBm+lxCmj8oa5rVXYDaGwlqnYPrTQnAq4TkFie9PJLvrfozDtsPfESbtb/RZu18DuS40coTjSC9wfTTcZrtuyRZnWdEY2BODKeutPSxVB2IUdMCvoB9PTLp1y1G481xIBdBd1Y6uAb7JPyAUz5i/l41j1kKznlaU6hnKxcloi2lVPi81EWna8FZpR1Vm0W/T0rhbF9K83vRmh/+fpFdlwa3I9lJkrAItoMD3DVe5izw/o5FzTD5W0vkW3CJcGpJANZopjrQXLXwNIZc8AEMfVeqPPnRf6lY1ILqC6y1G6IEysG9glQVxy96WJiU5teVUCqbp1VakwcWiHYhQtbBitj4ntM2mCWEyZc/orXJbtgL0AdEYUa2a9XrRqT7P8JRe2KbCxrkTOB8PoFVAN5AssIullCHAHYl2IFTdsxGpJDNPlbFW3Q8VF9IB8oKK9Iq+lrGV6pfPc02i6qBMOD/xY2Yo3taMVEis5HU= ceph-3611563c-2975-11ef-bc9c-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-13T11:10:36.778 INFO:teuthology.orchestra.run.smithi002.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1sJkrYXnpDnHx0kcTvVgnu9H8ROrwEBm+lxCmj8oa5rVXYDaGwlqnYPrTQnAq4TkFie9PJLvrfozDtsPfESbtb/RZu18DuS40coTjSC9wfTTcZrtuyRZnWdEY2BODKeutPSxVB2IUdMCvoB9PTLp1y1G481xIBdBd1Y6uAb7JPyAUz5i/l41j1kKznlaU6hnKxcloi2lVPi81EWna8FZpR1Vm0W/T0rhbF9K83vRmh/+fpFdlwa3I9lJkrAItoMD3DVe5izw/o5FzTD5W0vkW3CJcGpJANZopjrQXLXwNIZc8AEMfVeqPPnRf6lY1ILqC6y1G6IEysG9glQVxy96WJiU5teVUCqbp1VakwcWiHYhQtbBitj4ntM2mCWEyZc/orXJbtgL0AdEYUa2a9XrRqT7P8JRe2KbCxrkTOB8PoFVAN5AssIullCHAHYl2IFTdsxGpJDNPlbFW3Q8VF9IB8oKK9Iq+lrGV6pfPc02i6qBMOD/xY2Yo3taMVEis5HU= ceph-3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:10:36.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:36 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/247896016' entity='client.admin' 2024-06-13T11:10:36.838 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1sJkrYXnpDnHx0kcTvVgnu9H8ROrwEBm+lxCmj8oa5rVXYDaGwlqnYPrTQnAq4TkFie9PJLvrfozDtsPfESbtb/RZu18DuS40coTjSC9wfTTcZrtuyRZnWdEY2BODKeutPSxVB2IUdMCvoB9PTLp1y1G481xIBdBd1Y6uAb7JPyAUz5i/l41j1kKznlaU6hnKxcloi2lVPi81EWna8FZpR1Vm0W/T0rhbF9K83vRmh/+fpFdlwa3I9lJkrAItoMD3DVe5izw/o5FzTD5W0vkW3CJcGpJANZopjrQXLXwNIZc8AEMfVeqPPnRf6lY1ILqC6y1G6IEysG9glQVxy96WJiU5teVUCqbp1VakwcWiHYhQtbBitj4ntM2mCWEyZc/orXJbtgL0AdEYUa2a9XrRqT7P8JRe2KbCxrkTOB8PoFVAN5AssIullCHAHYl2IFTdsxGpJDNPlbFW3Q8VF9IB8oKK9Iq+lrGV6pfPc02i6qBMOD/xY2Yo3taMVEis5HU= ceph-3611563c-2975-11ef-bc9c-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-13T11:10:36.877 INFO:teuthology.orchestra.run.smithi077.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1sJkrYXnpDnHx0kcTvVgnu9H8ROrwEBm+lxCmj8oa5rVXYDaGwlqnYPrTQnAq4TkFie9PJLvrfozDtsPfESbtb/RZu18DuS40coTjSC9wfTTcZrtuyRZnWdEY2BODKeutPSxVB2IUdMCvoB9PTLp1y1G481xIBdBd1Y6uAb7JPyAUz5i/l41j1kKznlaU6hnKxcloi2lVPi81EWna8FZpR1Vm0W/T0rhbF9K83vRmh/+fpFdlwa3I9lJkrAItoMD3DVe5izw/o5FzTD5W0vkW3CJcGpJANZopjrQXLXwNIZc8AEMfVeqPPnRf6lY1ILqC6y1G6IEysG9glQVxy96WJiU5teVUCqbp1VakwcWiHYhQtbBitj4ntM2mCWEyZc/orXJbtgL0AdEYUa2a9XrRqT7P8JRe2KbCxrkTOB8PoFVAN5AssIullCHAHYl2IFTdsxGpJDNPlbFW3Q8VF9IB8oKK9Iq+lrGV6pfPc02i6qBMOD/xY2Yo3taMVEis5HU= ceph-3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:10:36.888 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1sJkrYXnpDnHx0kcTvVgnu9H8ROrwEBm+lxCmj8oa5rVXYDaGwlqnYPrTQnAq4TkFie9PJLvrfozDtsPfESbtb/RZu18DuS40coTjSC9wfTTcZrtuyRZnWdEY2BODKeutPSxVB2IUdMCvoB9PTLp1y1G481xIBdBd1Y6uAb7JPyAUz5i/l41j1kKznlaU6hnKxcloi2lVPi81EWna8FZpR1Vm0W/T0rhbF9K83vRmh/+fpFdlwa3I9lJkrAItoMD3DVe5izw/o5FzTD5W0vkW3CJcGpJANZopjrQXLXwNIZc8AEMfVeqPPnRf6lY1ILqC6y1G6IEysG9glQVxy96WJiU5teVUCqbp1VakwcWiHYhQtbBitj4ntM2mCWEyZc/orXJbtgL0AdEYUa2a9XrRqT7P8JRe2KbCxrkTOB8PoFVAN5AssIullCHAHYl2IFTdsxGpJDNPlbFW3Q8VF9IB8oKK9Iq+lrGV6pfPc02i6qBMOD/xY2Yo3taMVEis5HU= ceph-3611563c-2975-11ef-bc9c-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-13T11:10:36.929 INFO:teuthology.orchestra.run.smithi178.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1sJkrYXnpDnHx0kcTvVgnu9H8ROrwEBm+lxCmj8oa5rVXYDaGwlqnYPrTQnAq4TkFie9PJLvrfozDtsPfESbtb/RZu18DuS40coTjSC9wfTTcZrtuyRZnWdEY2BODKeutPSxVB2IUdMCvoB9PTLp1y1G481xIBdBd1Y6uAb7JPyAUz5i/l41j1kKznlaU6hnKxcloi2lVPi81EWna8FZpR1Vm0W/T0rhbF9K83vRmh/+fpFdlwa3I9lJkrAItoMD3DVe5izw/o5FzTD5W0vkW3CJcGpJANZopjrQXLXwNIZc8AEMfVeqPPnRf6lY1ILqC6y1G6IEysG9glQVxy96WJiU5teVUCqbp1VakwcWiHYhQtbBitj4ntM2mCWEyZc/orXJbtgL0AdEYUa2a9XrRqT7P8JRe2KbCxrkTOB8PoFVAN5AssIullCHAHYl2IFTdsxGpJDNPlbFW3Q8VF9IB8oKK9Iq+lrGV6pfPc02i6qBMOD/xY2Yo3taMVEis5HU= ceph-3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:10:36.941 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-06-13T11:10:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:10:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.148+0000 7fed66000700 1 -- 172.21.15.2:0/1955151878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed600764c0 msgr2=0x7fed60074920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.148+0000 7fed66000700 1 --2- 172.21.15.2:0/1955151878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed600764c0 0x7fed60074920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fed50009910 tx=0x7fed50009c20 comp rx=0 tx=0).stop 2024-06-13T11:10:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.148+0000 7fed66000700 1 -- 172.21.15.2:0/1955151878 shutdown_connections 2024-06-13T11:10:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.148+0000 7fed66000700 1 --2- 172.21.15.2:0/1955151878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed600764c0 0x7fed60074920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:40.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.148+0000 7fed66000700 1 -- 172.21.15.2:0/1955151878 >> 172.21.15.2:0/1955151878 conn(0x7fed600fd490 msgr2=0x7fed600ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:40.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.148+0000 7fed66000700 1 -- 172.21.15.2:0/1955151878 shutdown_connections 2024-06-13T11:10:40.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.148+0000 7fed66000700 1 -- 172.21.15.2:0/1955151878 wait complete. 2024-06-13T11:10:40.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.149+0000 7fed66000700 1 Processor -- start 2024-06-13T11:10:40.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.149+0000 7fed66000700 1 -- start start 2024-06-13T11:10:40.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.150+0000 7fed66000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed600764c0 0x7fed601997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:40.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.150+0000 7fed66000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fed6010a180 con 0x7fed600764c0 2024-06-13T11:10:40.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.150+0000 7fed5f400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed600764c0 0x7fed601997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:40.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.150+0000 7fed5f400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed600764c0 0x7fed601997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39346/0 (socket says 172.21.15.2:39346) 2024-06-13T11:10:40.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.150+0000 7fed5f400700 1 -- 172.21.15.2:0/1938823190 learned_addr learned my addr 172.21.15.2:0/1938823190 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:40.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.150+0000 7fed5f400700 1 -- 172.21.15.2:0/1938823190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed60199d30 con 0x7fed600764c0 2024-06-13T11:10:40.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.151+0000 7fed5f400700 1 --2- 172.21.15.2:0/1938823190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed600764c0 0x7fed601997f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fed50006010 tx=0x7fed50005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:40.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.151+0000 7fed57e00700 1 -- 172.21.15.2:0/1938823190 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed50027070 con 0x7fed600764c0 2024-06-13T11:10:40.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.151+0000 7fed57e00700 1 -- 172.21.15.2:0/1938823190 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed5000be40 con 0x7fed600764c0 2024-06-13T11:10:40.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.151+0000 7fed66000700 1 -- 172.21.15.2:0/1938823190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed60199fc0 con 0x7fed600764c0 2024-06-13T11:10:40.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.151+0000 7fed57e00700 1 -- 172.21.15.2:0/1938823190 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed5000f460 con 0x7fed600764c0 2024-06-13T11:10:40.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.151+0000 7fed66000700 1 -- 172.21.15.2:0/1938823190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed6019ccb0 con 0x7fed600764c0 2024-06-13T11:10:40.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.153+0000 7fed66000700 1 -- 172.21.15.2:0/1938823190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed6010a900 con 0x7fed600764c0 2024-06-13T11:10:40.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.153+0000 7fed57e00700 1 -- 172.21.15.2:0/1938823190 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fed5002a070 con 0x7fed600764c0 2024-06-13T11:10:40.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.154+0000 7fed57e00700 1 --2- 172.21.15.2:0/1938823190 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fed44039150 0x7fed4403b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:40.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.154+0000 7fed57e00700 1 -- 172.21.15.2:0/1938823190 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fed5001e030 con 0x7fed600764c0 2024-06-13T11:10:40.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.154+0000 7fed5ea00700 1 --2- 172.21.15.2:0/1938823190 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fed44039150 0x7fed4403b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:40.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.155+0000 7fed5ea00700 1 --2- 172.21.15.2:0/1938823190 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fed44039150 0x7fed4403b610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fed4c006fd0 tx=0x7fed4c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:40.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.159+0000 7fed57e00700 1 -- 172.21.15.2:0/1938823190 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fed50013070 con 0x7fed600764c0 2024-06-13T11:10:40.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.388+0000 7fed66000700 1 -- 172.21.15.2:0/1938823190 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fed6002ddb0 con 0x7fed600764c0 2024-06-13T11:10:40.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.393+0000 7fed57e00700 1 -- 172.21.15.2:0/1938823190 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fed500310c0 con 0x7fed600764c0 2024-06-13T11:10:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.396+0000 7fed66000700 1 -- 172.21.15.2:0/1938823190 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fed44039150 msgr2=0x7fed4403b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.396+0000 7fed66000700 1 --2- 172.21.15.2:0/1938823190 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fed44039150 0x7fed4403b610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fed4c006fd0 tx=0x7fed4c006e40 comp rx=0 tx=0).stop 2024-06-13T11:10:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.396+0000 7fed66000700 1 -- 172.21.15.2:0/1938823190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed600764c0 msgr2=0x7fed601997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.396+0000 7fed66000700 1 --2- 172.21.15.2:0/1938823190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed600764c0 0x7fed601997f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fed50006010 tx=0x7fed50005050 comp rx=0 tx=0).stop 2024-06-13T11:10:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.396+0000 7fed66000700 1 -- 172.21.15.2:0/1938823190 shutdown_connections 2024-06-13T11:10:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.396+0000 7fed66000700 1 --2- 172.21.15.2:0/1938823190 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fed44039150 0x7fed4403b610 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.396+0000 7fed66000700 1 --2- 172.21.15.2:0/1938823190 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed600764c0 0x7fed601997f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:40.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.396+0000 7fed66000700 1 -- 172.21.15.2:0/1938823190 >> 172.21.15.2:0/1938823190 conn(0x7fed600fd490 msgr2=0x7fed600fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.397+0000 7fed66000700 1 -- 172.21.15.2:0/1938823190 shutdown_connections 2024-06-13T11:10:40.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:40.397+0000 7fed66000700 1 -- 172.21.15.2:0/1938823190 wait complete. 2024-06-13T11:10:41.247 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-06-13T11:10:41.247 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-06-13T11:10:41.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:41 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1938823190' entity='client.admin' 2024-06-13T11:10:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:10:43.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:43 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:43.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:43 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:43.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:43 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:10:43.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:43 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:43.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:43 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:10:43.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:43 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.977+0000 7fe158600700 1 -- 172.21.15.2:0/3807571933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe150101ea0 msgr2=0x7fe1501022c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.977+0000 7fe158600700 1 --2- 172.21.15.2:0/3807571933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe150101ea0 0x7fe1501022c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe144009910 tx=0x7fe144009c20 comp rx=0 tx=0).stop 2024-06-13T11:10:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.978+0000 7fe158600700 1 -- 172.21.15.2:0/3807571933 shutdown_connections 2024-06-13T11:10:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.978+0000 7fe158600700 1 --2- 172.21.15.2:0/3807571933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe150101ea0 0x7fe1501022c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.978+0000 7fe158600700 1 -- 172.21.15.2:0/3807571933 >> 172.21.15.2:0/3807571933 conn(0x7fe1500fd490 msgr2=0x7fe1500ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.978+0000 7fe158600700 1 -- 172.21.15.2:0/3807571933 shutdown_connections 2024-06-13T11:10:43.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.978+0000 7fe158600700 1 -- 172.21.15.2:0/3807571933 wait complete. 2024-06-13T11:10:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.979+0000 7fe158600700 1 Processor -- start 2024-06-13T11:10:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.979+0000 7fe158600700 1 -- start start 2024-06-13T11:10:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.979+0000 7fe158600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe150101ea0 0x7fe150199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.979+0000 7fe158600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe150107ef0 con 0x7fe150101ea0 2024-06-13T11:10:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.980+0000 7fe155c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe150101ea0 0x7fe150199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.980+0000 7fe155c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe150101ea0 0x7fe150199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39370/0 (socket says 172.21.15.2:39370) 2024-06-13T11:10:43.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.980+0000 7fe155c00700 1 -- 172.21.15.2:0/4184188291 learned_addr learned my addr 172.21.15.2:0/4184188291 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:43.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.980+0000 7fe155c00700 1 -- 172.21.15.2:0/4184188291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe150199d80 con 0x7fe150101ea0 2024-06-13T11:10:43.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.980+0000 7fe155c00700 1 --2- 172.21.15.2:0/4184188291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe150101ea0 0x7fe150199840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe144006010 tx=0x7fe144005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.981+0000 7fe14e000700 1 -- 172.21.15.2:0/4184188291 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe144027070 con 0x7fe150101ea0 2024-06-13T11:10:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.981+0000 7fe14e000700 1 -- 172.21.15.2:0/4184188291 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe14400be40 con 0x7fe150101ea0 2024-06-13T11:10:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.981+0000 7fe14e000700 1 -- 172.21.15.2:0/4184188291 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe14400f460 con 0x7fe150101ea0 2024-06-13T11:10:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.981+0000 7fe158600700 1 -- 172.21.15.2:0/4184188291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe15019a010 con 0x7fe150101ea0 2024-06-13T11:10:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.981+0000 7fe158600700 1 -- 172.21.15.2:0/4184188291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe15019cd00 con 0x7fe150101ea0 2024-06-13T11:10:43.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.982+0000 7fe14e000700 1 -- 172.21.15.2:0/4184188291 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fe14402a070 con 0x7fe150101ea0 2024-06-13T11:10:43.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.982+0000 7fe158600700 1 -- 172.21.15.2:0/4184188291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe150108670 con 0x7fe150101ea0 2024-06-13T11:10:43.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.983+0000 7fe14e000700 1 --2- 172.21.15.2:0/4184188291 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe138039150 0x7fe13803b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:43.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.983+0000 7fe14e000700 1 -- 172.21.15.2:0/4184188291 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe14401e030 con 0x7fe150101ea0 2024-06-13T11:10:43.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.983+0000 7fe155200700 1 --2- 172.21.15.2:0/4184188291 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe138039150 0x7fe13803b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:43.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.984+0000 7fe155200700 1 --2- 172.21.15.2:0/4184188291 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe138039150 0x7fe13803b610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe13c006fd0 tx=0x7fe13c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:43.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:43.989+0000 7fe14e000700 1 -- 172.21.15.2:0/4184188291 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe144013070 con 0x7fe150101ea0 2024-06-13T11:10:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:44.226+0000 7fe158600700 1 -- 172.21.15.2:0/4184188291 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fe15002ddb0 con 0x7fe138039150 2024-06-13T11:10:44.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:44.235+0000 7fe14e000700 1 -- 172.21.15.2:0/4184188291 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe15002ddb0 con 0x7fe138039150 2024-06-13T11:10:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:44.238+0000 7fe158600700 1 -- 172.21.15.2:0/4184188291 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe138039150 msgr2=0x7fe13803b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:44.238+0000 7fe158600700 1 --2- 172.21.15.2:0/4184188291 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe138039150 0x7fe13803b610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe13c006fd0 tx=0x7fe13c006e40 comp rx=0 tx=0).stop 2024-06-13T11:10:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:44.238+0000 7fe158600700 1 -- 172.21.15.2:0/4184188291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe150101ea0 msgr2=0x7fe150199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:44.238+0000 7fe158600700 1 --2- 172.21.15.2:0/4184188291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe150101ea0 0x7fe150199840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe144006010 tx=0x7fe144005050 comp rx=0 tx=0).stop 2024-06-13T11:10:44.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:44.238+0000 7fe158600700 1 -- 172.21.15.2:0/4184188291 shutdown_connections 2024-06-13T11:10:44.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:44.238+0000 7fe158600700 1 --2- 172.21.15.2:0/4184188291 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe138039150 0x7fe13803b610 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:44.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:44.238+0000 7fe158600700 1 --2- 172.21.15.2:0/4184188291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe150101ea0 0x7fe150199840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:44.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:44.238+0000 7fe158600700 1 -- 172.21.15.2:0/4184188291 >> 172.21.15.2:0/4184188291 conn(0x7fe1500fd490 msgr2=0x7fe1500ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:44.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:44.239+0000 7fe158600700 1 -- 172.21.15.2:0/4184188291 shutdown_connections 2024-06-13T11:10:44.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:44.239+0000 7fe158600700 1 -- 172.21.15.2:0/4184188291 wait complete. 2024-06-13T11:10:44.968 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi077 2024-06-13T11:10:44.968 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-06-13T11:10:44.968 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/etc/ceph/ceph.conf 2024-06-13T11:10:44.989 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-06-13T11:10:44.989 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:10:45.049 INFO:tasks.cephadm:Adding host smithi077 to orchestrator... 2024-06-13T11:10:45.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch host add smithi077 2024-06-13T11:10:45.466 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:10:45.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:45 smithi002 ceph-mon[32210]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:10:45.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:45 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:45.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:45 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:10:45.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:45 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:10:45.612 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:45 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:10:45.612 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:45 smithi002 ceph-mon[32210]: Updating smithi002:/etc/ceph/ceph.conf 2024-06-13T11:10:46.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:46 smithi002 ceph-mon[32210]: Updating smithi002:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:10:46.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:46 smithi002 ceph-mon[32210]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:10:46.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:46 smithi002 ceph-mon[32210]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:10:47.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.409+0000 7faf07800700 1 -- 172.21.15.2:0/3632488366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf00102100 msgr2=0x7faf001024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:47.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.409+0000 7faf07800700 1 --2- 172.21.15.2:0/3632488366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf00102100 0x7faf001024e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faef0009910 tx=0x7faef0009c20 comp rx=0 tx=0).stop 2024-06-13T11:10:47.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.410+0000 7faf07800700 1 -- 172.21.15.2:0/3632488366 shutdown_connections 2024-06-13T11:10:47.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.410+0000 7faf07800700 1 --2- 172.21.15.2:0/3632488366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf00102100 0x7faf001024e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:47.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.410+0000 7faf07800700 1 -- 172.21.15.2:0/3632488366 >> 172.21.15.2:0/3632488366 conn(0x7faf000fd9d0 msgr2=0x7faf000ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:47.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.410+0000 7faf07800700 1 -- 172.21.15.2:0/3632488366 shutdown_connections 2024-06-13T11:10:47.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.410+0000 7faf07800700 1 -- 172.21.15.2:0/3632488366 wait complete. 2024-06-13T11:10:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.411+0000 7faf07800700 1 Processor -- start 2024-06-13T11:10:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.411+0000 7faf07800700 1 -- start start 2024-06-13T11:10:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.411+0000 7faf07800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf00102100 0x7faf0019f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.411+0000 7faf07800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faf0010c4d0 con 0x7faf00102100 2024-06-13T11:10:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.412+0000 7faf04e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf00102100 0x7faf0019f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.412+0000 7faf04e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf00102100 0x7faf0019f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39004/0 (socket says 172.21.15.2:39004) 2024-06-13T11:10:47.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.412+0000 7faf04e00700 1 -- 172.21.15.2:0/1872396425 learned_addr learned my addr 172.21.15.2:0/1872396425 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:47.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.412+0000 7faf04e00700 1 -- 172.21.15.2:0/1872396425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0019fd20 con 0x7faf00102100 2024-06-13T11:10:47.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.412+0000 7faf04e00700 1 --2- 172.21.15.2:0/1872396425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf00102100 0x7faf0019f7e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faef0005850 tx=0x7faef0005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:47.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.413+0000 7faefe000700 1 -- 172.21.15.2:0/1872396425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef0026070 con 0x7faf00102100 2024-06-13T11:10:47.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.413+0000 7faefe000700 1 -- 172.21.15.2:0/1872396425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faef000bbd0 con 0x7faf00102100 2024-06-13T11:10:47.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.413+0000 7faefe000700 1 -- 172.21.15.2:0/1872396425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef0003970 con 0x7faf00102100 2024-06-13T11:10:47.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.413+0000 7faf07800700 1 -- 172.21.15.2:0/1872396425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf001a0010 con 0x7faf00102100 2024-06-13T11:10:47.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.413+0000 7faf07800700 1 -- 172.21.15.2:0/1872396425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf001999a0 con 0x7faf00102100 2024-06-13T11:10:47.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.414+0000 7faefe000700 1 -- 172.21.15.2:0/1872396425 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7faef0029070 con 0x7faf00102100 2024-06-13T11:10:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.414+0000 7faef6a00700 1 -- 172.21.15.2:0/1872396425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf001035e0 con 0x7faf00102100 2024-06-13T11:10:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.415+0000 7faefe000700 1 --2- 172.21.15.2:0/1872396425 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7faee4039150 0x7faee403b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.415+0000 7faefe000700 1 -- 172.21.15.2:0/1872396425 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7faef001e070 con 0x7faf00102100 2024-06-13T11:10:47.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.415+0000 7faef7e00700 1 --2- 172.21.15.2:0/1872396425 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7faee4039150 0x7faee403b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:47.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.416+0000 7faef7e00700 1 --2- 172.21.15.2:0/1872396425 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7faee4039150 0x7faee403b610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faee8006fd0 tx=0x7faee8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:47.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.421+0000 7faefe000700 1 -- 172.21.15.2:0/1872396425 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7faef0013070 con 0x7faf00102100 2024-06-13T11:10:47.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:47 smithi002 ceph-mon[32210]: Updating smithi002:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T11:10:47.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:47 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:47.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:47 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:47.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:47 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:47.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:47.653+0000 7faef6a00700 1 -- 172.21.15.2:0/1872396425 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi077", "target": ["mon-mgr", ""]}) -- 0x7faf00063af0 con 0x7faee4039150 2024-06-13T11:10:48.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:48 smithi002 ceph-mon[32210]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:10:48.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:48 smithi002 ceph-mon[32210]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi077", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:10:49.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:49 smithi002 ceph-mon[32210]: Deploying cephadm binary to smithi077 2024-06-13T11:10:50.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:50 smithi002 ceph-mon[32210]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:10:52.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:52.612+0000 7faefe000700 1 -- 172.21.15.2:0/1872396425 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7faf00063af0 con 0x7faee4039150 2024-06-13T11:10:52.612 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi077' with addr '172.21.15.77' 2024-06-13T11:10:52.612 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:52 smithi002 ceph-mon[32210]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:10:52.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:52.617+0000 7faef6a00700 1 -- 172.21.15.2:0/1872396425 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7faee4039150 msgr2=0x7faee403b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:52.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:52.617+0000 7faef6a00700 1 --2- 172.21.15.2:0/1872396425 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7faee4039150 0x7faee403b610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faee8006fd0 tx=0x7faee8006e40 comp rx=0 tx=0).stop 2024-06-13T11:10:52.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:52.617+0000 7faef6a00700 1 -- 172.21.15.2:0/1872396425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf00102100 msgr2=0x7faf0019f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:52.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:52.617+0000 7faef6a00700 1 --2- 172.21.15.2:0/1872396425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf00102100 0x7faf0019f7e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faef0005850 tx=0x7faef0005030 comp rx=0 tx=0).stop 2024-06-13T11:10:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:52.617+0000 7faef6a00700 1 -- 172.21.15.2:0/1872396425 shutdown_connections 2024-06-13T11:10:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:52.617+0000 7faef6a00700 1 --2- 172.21.15.2:0/1872396425 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7faee4039150 0x7faee403b610 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:52.617+0000 7faef6a00700 1 --2- 172.21.15.2:0/1872396425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf00102100 0x7faf0019f7e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:52.617+0000 7faef6a00700 1 -- 172.21.15.2:0/1872396425 >> 172.21.15.2:0/1872396425 conn(0x7faf000fd9d0 msgr2=0x7faf000761a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:52.618+0000 7faef6a00700 1 -- 172.21.15.2:0/1872396425 shutdown_connections 2024-06-13T11:10:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:52.618+0000 7faef6a00700 1 -- 172.21.15.2:0/1872396425 wait complete. 2024-06-13T11:10:53.322 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch host ls --format=json 2024-06-13T11:10:53.792 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:10:53.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:53 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:53.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:53 smithi002 ceph-mon[32210]: Added host smithi077 2024-06-13T11:10:53.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:53 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:10:53.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:53 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:54.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:54 smithi002 ceph-mon[32210]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:10:54.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:54 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:55.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.846+0000 7fc56fa00700 1 -- 172.21.15.2:0/1717640398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc568074830 msgr2=0x7fc568074c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:55.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.846+0000 7fc56fa00700 1 --2- 172.21.15.2:0/1717640398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc568074830 0x7fc568074c10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009910 tx=0x7fc55c009c20 comp rx=0 tx=0).stop 2024-06-13T11:10:55.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.846+0000 7fc56fa00700 1 -- 172.21.15.2:0/1717640398 shutdown_connections 2024-06-13T11:10:55.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.846+0000 7fc56fa00700 1 --2- 172.21.15.2:0/1717640398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc568074830 0x7fc568074c10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:55.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.846+0000 7fc56fa00700 1 -- 172.21.15.2:0/1717640398 >> 172.21.15.2:0/1717640398 conn(0x7fc5680fd9d0 msgr2=0x7fc5680ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:55.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.846+0000 7fc56fa00700 1 -- 172.21.15.2:0/1717640398 shutdown_connections 2024-06-13T11:10:55.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.846+0000 7fc56fa00700 1 -- 172.21.15.2:0/1717640398 wait complete. 2024-06-13T11:10:55.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.847+0000 7fc56fa00700 1 Processor -- start 2024-06-13T11:10:55.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.847+0000 7fc56fa00700 1 -- start start 2024-06-13T11:10:55.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.848+0000 7fc56fa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc568074830 0x7fc56819e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:55.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.848+0000 7fc56fa00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc568112b40 con 0x7fc568074830 2024-06-13T11:10:55.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.848+0000 7fc56d000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc568074830 0x7fc56819e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:55.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.848+0000 7fc56d000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc568074830 0x7fc56819e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39028/0 (socket says 172.21.15.2:39028) 2024-06-13T11:10:55.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.848+0000 7fc56d000700 1 -- 172.21.15.2:0/3843870941 learned_addr learned my addr 172.21.15.2:0/3843870941 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:55.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.849+0000 7fc56d000700 1 -- 172.21.15.2:0/3843870941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56819e590 con 0x7fc568074830 2024-06-13T11:10:55.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.849+0000 7fc56d000700 1 --2- 172.21.15.2:0/3843870941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc568074830 0x7fc56819e050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc55c006010 tx=0x7fc55c005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:55.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.849+0000 7fc565600700 1 -- 172.21.15.2:0/3843870941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc55c026070 con 0x7fc568074830 2024-06-13T11:10:55.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.849+0000 7fc56fa00700 1 -- 172.21.15.2:0/3843870941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56819e820 con 0x7fc568074830 2024-06-13T11:10:55.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.849+0000 7fc565600700 1 -- 172.21.15.2:0/3843870941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc55c00bc30 con 0x7fc568074830 2024-06-13T11:10:55.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.849+0000 7fc565600700 1 -- 172.21.15.2:0/3843870941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc55c003ab0 con 0x7fc568074830 2024-06-13T11:10:55.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.849+0000 7fc56fa00700 1 -- 172.21.15.2:0/3843870941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc56819ec80 con 0x7fc568074830 2024-06-13T11:10:55.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.850+0000 7fc565600700 1 -- 172.21.15.2:0/3843870941 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fc55c029070 con 0x7fc568074830 2024-06-13T11:10:55.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.851+0000 7fc565600700 1 --2- 172.21.15.2:0/3843870941 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc5500390f0 0x7fc55003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:55.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.851+0000 7fc565600700 1 -- 172.21.15.2:0/3843870941 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc55c01e070 con 0x7fc568074830 2024-06-13T11:10:55.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.851+0000 7fc56fa00700 1 -- 172.21.15.2:0/3843870941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc568075f70 con 0x7fc568074830 2024-06-13T11:10:55.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.851+0000 7fc567e00700 1 --2- 172.21.15.2:0/3843870941 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc5500390f0 0x7fc55003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:55.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.852+0000 7fc567e00700 1 --2- 172.21.15.2:0/3843870941 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc5500390f0 0x7fc55003b5b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc554006fd0 tx=0x7fc554006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:55.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:55.857+0000 7fc565600700 1 -- 172.21.15.2:0/3843870941 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc55c030020 con 0x7fc568074830 2024-06-13T11:10:56.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:56.093+0000 7fc56fa00700 1 -- 172.21.15.2:0/3843870941 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc56819f3b0 con 0x7fc5500390f0 2024-06-13T11:10:56.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:56.095+0000 7fc565600700 1 -- 172.21.15.2:0/3843870941 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7fc56819f3b0 con 0x7fc5500390f0 2024-06-13T11:10:56.095 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:10:56.096 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.77", "hostname": "smithi077", "labels": [], "status": ""}] 2024-06-13T11:10:56.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:56.098+0000 7fc56fa00700 1 -- 172.21.15.2:0/3843870941 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc5500390f0 msgr2=0x7fc55003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:56.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:56.098+0000 7fc56fa00700 1 --2- 172.21.15.2:0/3843870941 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc5500390f0 0x7fc55003b5b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc554006fd0 tx=0x7fc554006e40 comp rx=0 tx=0).stop 2024-06-13T11:10:56.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:56.098+0000 7fc56fa00700 1 -- 172.21.15.2:0/3843870941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc568074830 msgr2=0x7fc56819e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:56.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:56.098+0000 7fc56fa00700 1 --2- 172.21.15.2:0/3843870941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc568074830 0x7fc56819e050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc55c006010 tx=0x7fc55c005050 comp rx=0 tx=0).stop 2024-06-13T11:10:56.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:56.099+0000 7fc56fa00700 1 -- 172.21.15.2:0/3843870941 shutdown_connections 2024-06-13T11:10:56.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:56.099+0000 7fc56fa00700 1 --2- 172.21.15.2:0/3843870941 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc5500390f0 0x7fc55003b5b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:56.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:56.099+0000 7fc56fa00700 1 --2- 172.21.15.2:0/3843870941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc568074830 0x7fc56819e050 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:56.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:56.099+0000 7fc56fa00700 1 -- 172.21.15.2:0/3843870941 >> 172.21.15.2:0/3843870941 conn(0x7fc5680fd9d0 msgr2=0x7fc5680ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:56.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:56.099+0000 7fc56fa00700 1 -- 172.21.15.2:0/3843870941 shutdown_connections 2024-06-13T11:10:56.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:56.099+0000 7fc56fa00700 1 -- 172.21.15.2:0/3843870941 wait complete. 2024-06-13T11:10:56.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:56 smithi002 ceph-mon[32210]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:10:56.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:56 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:56.964 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi178 2024-06-13T11:10:56.964 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-13T11:10:56.965 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/etc/ceph/ceph.conf 2024-06-13T11:10:56.984 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-13T11:10:56.984 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:10:57.041 INFO:tasks.cephadm:Adding host smithi178 to orchestrator... 2024-06-13T11:10:57.042 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch host add smithi178 2024-06-13T11:10:57.507 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:10:57.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:57 smithi002 ceph-mon[32210]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:10:58.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:58 smithi002 ceph-mon[32210]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:10:58.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:58 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:58.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:58 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:58.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:58 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:58.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:58 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:10:58.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:58 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi077", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:10:59.564 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:59 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:10:59.564 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:59 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:10:59.564 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:59 smithi002 ceph-mon[32210]: Updating smithi077:/etc/ceph/ceph.conf 2024-06-13T11:10:59.564 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:10:59 smithi002 ceph-mon[32210]: Updating smithi077:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:10:59.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.563+0000 7f22bf600700 1 -- 172.21.15.2:0/976068680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22b8074860 msgr2=0x7f22b8074c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:10:59.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.563+0000 7f22bf600700 1 --2- 172.21.15.2:0/976068680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22b8074860 0x7f22b8074c40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22a800b0a0 tx=0x7f22a800b3b0 comp rx=0 tx=0).stop 2024-06-13T11:10:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.564+0000 7f22bf600700 1 -- 172.21.15.2:0/976068680 shutdown_connections 2024-06-13T11:10:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.564+0000 7f22bf600700 1 --2- 172.21.15.2:0/976068680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22b8074860 0x7f22b8074c40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:10:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.564+0000 7f22bf600700 1 -- 172.21.15.2:0/976068680 >> 172.21.15.2:0/976068680 conn(0x7f22b80fd9d0 msgr2=0x7f22b80ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:10:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.564+0000 7f22bf600700 1 -- 172.21.15.2:0/976068680 shutdown_connections 2024-06-13T11:10:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.564+0000 7f22bf600700 1 -- 172.21.15.2:0/976068680 wait complete. 2024-06-13T11:10:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.565+0000 7f22bf600700 1 Processor -- start 2024-06-13T11:10:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.565+0000 7f22bf600700 1 -- start start 2024-06-13T11:10:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.566+0000 7f22bf600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22b8074860 0x7f22b819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.566+0000 7f22bf600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f22b810e740 con 0x7f22b8074860 2024-06-13T11:10:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.566+0000 7f22bcc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22b8074860 0x7f22b819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.566+0000 7f22bcc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22b8074860 0x7f22b819f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39922/0 (socket says 172.21.15.2:39922) 2024-06-13T11:10:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.566+0000 7f22bcc00700 1 -- 172.21.15.2:0/1412731083 learned_addr learned my addr 172.21.15.2:0/1412731083 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:10:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.566+0000 7f22bcc00700 1 -- 172.21.15.2:0/1412731083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b819fd50 con 0x7f22b8074860 2024-06-13T11:10:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.567+0000 7f22bcc00700 1 --2- 172.21.15.2:0/1412731083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22b8074860 0x7f22b819f810 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f22a8000f80 tx=0x7f22a800bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.567+0000 7f22b6000700 1 -- 172.21.15.2:0/1412731083 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a8020020 con 0x7f22b8074860 2024-06-13T11:10:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.567+0000 7f22b6000700 1 -- 172.21.15.2:0/1412731083 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22a8018040 con 0x7f22b8074860 2024-06-13T11:10:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.567+0000 7f22bf600700 1 -- 172.21.15.2:0/1412731083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b819ffe0 con 0x7f22b8074860 2024-06-13T11:10:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.567+0000 7f22b6000700 1 -- 172.21.15.2:0/1412731083 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a8017070 con 0x7f22b8074860 2024-06-13T11:10:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.567+0000 7f22bf600700 1 -- 172.21.15.2:0/1412731083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b81999d0 con 0x7f22b8074860 2024-06-13T11:10:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.569+0000 7f22b6000700 1 -- 172.21.15.2:0/1412731083 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f22a8023020 con 0x7f22b8074860 2024-06-13T11:10:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.569+0000 7f22bf600700 1 -- 172.21.15.2:0/1412731083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b8075f10 con 0x7f22b8074860 2024-06-13T11:10:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.569+0000 7f22b6000700 1 --2- 172.21.15.2:0/1412731083 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f229c039190 0x7f229c03b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:10:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.569+0000 7f22b6000700 1 -- 172.21.15.2:0/1412731083 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f22a800f050 con 0x7f22b8074860 2024-06-13T11:10:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.570+0000 7f22afe00700 1 --2- 172.21.15.2:0/1412731083 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f229c039190 0x7f229c03b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:10:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.571+0000 7f22afe00700 1 --2- 172.21.15.2:0/1412731083 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f229c039190 0x7f229c03b650 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f22a0006fd0 tx=0x7f22a0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:10:59.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.576+0000 7f22b6000700 1 -- 172.21.15.2:0/1412731083 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f22a802a020 con 0x7f22b8074860 2024-06-13T11:10:59.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:10:59.812+0000 7f22bf600700 1 -- 172.21.15.2:0/1412731083 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}) -- 0x7f22b819af00 con 0x7f229c039190 2024-06-13T11:11:00.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:00 smithi002 ceph-mon[32210]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:11:00.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:00 smithi002 ceph-mon[32210]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:00.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:00 smithi002 ceph-mon[32210]: Updating smithi077:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T11:11:00.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:00.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:00.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:00.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:00 smithi002 ceph-mon[32210]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:11:01.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:01 smithi002 ceph-mon[32210]: Deploying cephadm binary to smithi178 2024-06-13T11:11:02.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:02 smithi002 ceph-mon[32210]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:04.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:04.807+0000 7f22b6000700 1 -- 172.21.15.2:0/1412731083 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f22b819af00 con 0x7f229c039190 2024-06-13T11:11:04.807 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi178' with addr '172.21.15.178' 2024-06-13T11:11:04.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:04 smithi002 ceph-mon[32210]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:04.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:04.811+0000 7f22bf600700 1 -- 172.21.15.2:0/1412731083 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f229c039190 msgr2=0x7f229c03b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:04.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:04.811+0000 7f22bf600700 1 --2- 172.21.15.2:0/1412731083 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f229c039190 0x7f229c03b650 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f22a0006fd0 tx=0x7f22a0006e40 comp rx=0 tx=0).stop 2024-06-13T11:11:04.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:04.811+0000 7f22bf600700 1 -- 172.21.15.2:0/1412731083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22b8074860 msgr2=0x7f22b819f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:04.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:04.811+0000 7f22bf600700 1 --2- 172.21.15.2:0/1412731083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22b8074860 0x7f22b819f810 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f22a8000f80 tx=0x7f22a800bd20 comp rx=0 tx=0).stop 2024-06-13T11:11:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:04.811+0000 7f22bf600700 1 -- 172.21.15.2:0/1412731083 shutdown_connections 2024-06-13T11:11:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:04.811+0000 7f22bf600700 1 --2- 172.21.15.2:0/1412731083 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f229c039190 0x7f229c03b650 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:04.811+0000 7f22bf600700 1 --2- 172.21.15.2:0/1412731083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22b8074860 0x7f22b819f810 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:04.811+0000 7f22bf600700 1 -- 172.21.15.2:0/1412731083 >> 172.21.15.2:0/1412731083 conn(0x7f22b80fd9d0 msgr2=0x7f22b81061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:04.811+0000 7f22bf600700 1 -- 172.21.15.2:0/1412731083 shutdown_connections 2024-06-13T11:11:04.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:04.811+0000 7f22bf600700 1 -- 172.21.15.2:0/1412731083 wait complete. 2024-06-13T11:11:05.495 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch host ls --format=json 2024-06-13T11:11:05.949 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:11:06.094 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:05 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:06.094 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:05 smithi002 ceph-mon[32210]: Added host smithi178 2024-06-13T11:11:06.094 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:05 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:06.094 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:05 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:07.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:06 smithi002 ceph-mon[32210]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:07.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.141+0000 7fc478800700 1 -- 172.21.15.2:0/2477336361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc470074860 msgr2=0x7fc470074c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.141+0000 7fc478800700 1 --2- 172.21.15.2:0/2477336361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc470074860 0x7fc470074c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc464009910 tx=0x7fc464009c20 comp rx=0 tx=0).stop 2024-06-13T11:11:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.141+0000 7fc478800700 1 -- 172.21.15.2:0/2477336361 shutdown_connections 2024-06-13T11:11:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.141+0000 7fc478800700 1 --2- 172.21.15.2:0/2477336361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc470074860 0x7fc470074c40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.141+0000 7fc478800700 1 -- 172.21.15.2:0/2477336361 >> 172.21.15.2:0/2477336361 conn(0x7fc4700fd9d0 msgr2=0x7fc4700ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.141+0000 7fc478800700 1 -- 172.21.15.2:0/2477336361 shutdown_connections 2024-06-13T11:11:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.141+0000 7fc478800700 1 -- 172.21.15.2:0/2477336361 wait complete. 2024-06-13T11:11:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.142+0000 7fc478800700 1 Processor -- start 2024-06-13T11:11:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.142+0000 7fc478800700 1 -- start start 2024-06-13T11:11:08.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.142+0000 7fc478800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc470074860 0x7fc47019f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:08.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.142+0000 7fc478800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc47010e740 con 0x7fc470074860 2024-06-13T11:11:08.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.143+0000 7fc475e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc470074860 0x7fc47019f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:08.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.143+0000 7fc475e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc470074860 0x7fc47019f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46456/0 (socket says 172.21.15.2:46456) 2024-06-13T11:11:08.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.143+0000 7fc475e00700 1 -- 172.21.15.2:0/416683932 learned_addr learned my addr 172.21.15.2:0/416683932 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:11:08.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.143+0000 7fc475e00700 1 -- 172.21.15.2:0/416683932 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47019fe20 con 0x7fc470074860 2024-06-13T11:11:08.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.144+0000 7fc475e00700 1 --2- 172.21.15.2:0/416683932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc470074860 0x7fc47019f8e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc464006010 tx=0x7fc464005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.144+0000 7fc46aa00700 1 -- 172.21.15.2:0/416683932 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc464026070 con 0x7fc470074860 2024-06-13T11:11:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.144+0000 7fc46aa00700 1 -- 172.21.15.2:0/416683932 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc46400bc30 con 0x7fc470074860 2024-06-13T11:11:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.144+0000 7fc478800700 1 -- 172.21.15.2:0/416683932 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4701a00b0 con 0x7fc470074860 2024-06-13T11:11:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.144+0000 7fc46aa00700 1 -- 172.21.15.2:0/416683932 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4640039a0 con 0x7fc470074860 2024-06-13T11:11:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.144+0000 7fc478800700 1 -- 172.21.15.2:0/416683932 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc470199aa0 con 0x7fc470074860 2024-06-13T11:11:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.145+0000 7fc46aa00700 1 -- 172.21.15.2:0/416683932 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fc464029070 con 0x7fc470074860 2024-06-13T11:11:08.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.145+0000 7fc478800700 1 -- 172.21.15.2:0/416683932 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc470075f10 con 0x7fc470074860 2024-06-13T11:11:08.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.146+0000 7fc46aa00700 1 --2- 172.21.15.2:0/416683932 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc458039150 0x7fc45803b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:08.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.146+0000 7fc46aa00700 1 -- 172.21.15.2:0/416683932 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc46401e070 con 0x7fc470074860 2024-06-13T11:11:08.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.146+0000 7fc475400700 1 --2- 172.21.15.2:0/416683932 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc458039150 0x7fc45803b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:08.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.147+0000 7fc475400700 1 --2- 172.21.15.2:0/416683932 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc458039150 0x7fc45803b610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc460006fd0 tx=0x7fc460006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:08.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.152+0000 7fc46aa00700 1 -- 172.21.15.2:0/416683932 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc464013070 con 0x7fc470074860 2024-06-13T11:11:08.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.383+0000 7fc478800700 1 -- 172.21.15.2:0/416683932 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc47019afd0 con 0x7fc458039150 2024-06-13T11:11:08.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.385+0000 7fc46aa00700 1 -- 172.21.15.2:0/416683932 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+238 (secure 0 0 0) 0x7fc47019afd0 con 0x7fc458039150 2024-06-13T11:11:08.385 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:11:08.385 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.77", "hostname": "smithi077", "labels": [], "status": ""}, {"addr": "172.21.15.178", "hostname": "smithi178", "labels": [], "status": ""}] 2024-06-13T11:11:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.389+0000 7fc478800700 1 -- 172.21.15.2:0/416683932 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc458039150 msgr2=0x7fc45803b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:08.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.389+0000 7fc478800700 1 --2- 172.21.15.2:0/416683932 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc458039150 0x7fc45803b610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc460006fd0 tx=0x7fc460006e40 comp rx=0 tx=0).stop 2024-06-13T11:11:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.389+0000 7fc478800700 1 -- 172.21.15.2:0/416683932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc470074860 msgr2=0x7fc47019f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.389+0000 7fc478800700 1 --2- 172.21.15.2:0/416683932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc470074860 0x7fc47019f8e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc464006010 tx=0x7fc464005030 comp rx=0 tx=0).stop 2024-06-13T11:11:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.389+0000 7fc478800700 1 -- 172.21.15.2:0/416683932 shutdown_connections 2024-06-13T11:11:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.389+0000 7fc478800700 1 --2- 172.21.15.2:0/416683932 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc458039150 0x7fc45803b610 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.389+0000 7fc478800700 1 --2- 172.21.15.2:0/416683932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc470074860 0x7fc47019f8e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.389+0000 7fc478800700 1 -- 172.21.15.2:0/416683932 >> 172.21.15.2:0/416683932 conn(0x7fc4700fd9d0 msgr2=0x7fc4701061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.389+0000 7fc478800700 1 -- 172.21.15.2:0/416683932 shutdown_connections 2024-06-13T11:11:08.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:08.389+0000 7fc478800700 1 -- 172.21.15.2:0/416683932 wait complete. 2024-06-13T11:11:08.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:08 smithi002 ceph-mon[32210]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:08.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:08 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:09.157 INFO:tasks.cephadm:Setting crush tunables to default 2024-06-13T11:11:09.157 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd crush tunables default 2024-06-13T11:11:09.626 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:11:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:09 smithi002 ceph-mon[32210]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:11:10.787 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:10 smithi002 ceph-mon[32210]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:11.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.604+0000 7f8e62c00700 1 -- 172.21.15.2:0/4204235766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e5c102100 msgr2=0x7f8e5c1024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:11.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.604+0000 7f8e62c00700 1 --2- 172.21.15.2:0/4204235766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e5c102100 0x7f8e5c1024e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009910 tx=0x7f8e4c009c20 comp rx=0 tx=0).stop 2024-06-13T11:11:11.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.604+0000 7f8e62c00700 1 -- 172.21.15.2:0/4204235766 shutdown_connections 2024-06-13T11:11:11.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.604+0000 7f8e62c00700 1 --2- 172.21.15.2:0/4204235766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e5c102100 0x7f8e5c1024e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:11.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.604+0000 7f8e62c00700 1 -- 172.21.15.2:0/4204235766 >> 172.21.15.2:0/4204235766 conn(0x7f8e5c0fd9d0 msgr2=0x7f8e5c0ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:11.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.605+0000 7f8e62c00700 1 -- 172.21.15.2:0/4204235766 shutdown_connections 2024-06-13T11:11:11.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.605+0000 7f8e62c00700 1 -- 172.21.15.2:0/4204235766 wait complete. 2024-06-13T11:11:11.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.606+0000 7f8e62c00700 1 Processor -- start 2024-06-13T11:11:11.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.606+0000 7f8e62c00700 1 -- start start 2024-06-13T11:11:11.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.606+0000 7f8e62c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e5c102100 0x7f8e5c19f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:11.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.606+0000 7f8e62c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c10c4d0 con 0x7f8e5c102100 2024-06-13T11:11:11.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.607+0000 7f8e5be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e5c102100 0x7f8e5c19f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:11.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.607+0000 7f8e5be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e5c102100 0x7f8e5c19f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46482/0 (socket says 172.21.15.2:46482) 2024-06-13T11:11:11.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.607+0000 7f8e5be00700 1 -- 172.21.15.2:0/1137932341 learned_addr learned my addr 172.21.15.2:0/1137932341 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:11:11.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.607+0000 7f8e5be00700 1 -- 172.21.15.2:0/1137932341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5c19fda0 con 0x7f8e5c102100 2024-06-13T11:11:11.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.607+0000 7f8e5be00700 1 --2- 172.21.15.2:0/1137932341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e5c102100 0x7f8e5c19f860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c006010 tx=0x7f8e4c005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:11.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.608+0000 7f8e58c00700 1 -- 172.21.15.2:0/1137932341 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e4c026070 con 0x7f8e5c102100 2024-06-13T11:11:11.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.608+0000 7f8e58c00700 1 -- 172.21.15.2:0/1137932341 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e4c00bbd0 con 0x7f8e5c102100 2024-06-13T11:11:11.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.608+0000 7f8e62c00700 1 -- 172.21.15.2:0/1137932341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e5c1a0090 con 0x7f8e5c102100 2024-06-13T11:11:11.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.608+0000 7f8e58c00700 1 -- 172.21.15.2:0/1137932341 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e4c003910 con 0x7f8e5c102100 2024-06-13T11:11:11.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.608+0000 7f8e62c00700 1 -- 172.21.15.2:0/1137932341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e5c199a20 con 0x7f8e5c102100 2024-06-13T11:11:11.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.609+0000 7f8e62c00700 1 -- 172.21.15.2:0/1137932341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e5c1035e0 con 0x7f8e5c102100 2024-06-13T11:11:11.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.609+0000 7f8e58c00700 1 -- 172.21.15.2:0/1137932341 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f8e4c029070 con 0x7f8e5c102100 2024-06-13T11:11:11.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.609+0000 7f8e58c00700 1 --2- 172.21.15.2:0/1137932341 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8e400390f0 0x7f8e4003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:11.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.610+0000 7f8e58c00700 1 -- 172.21.15.2:0/1137932341 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8e4c01e070 con 0x7f8e5c102100 2024-06-13T11:11:11.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.610+0000 7f8e5b400700 1 --2- 172.21.15.2:0/1137932341 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8e400390f0 0x7f8e4003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:11.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.611+0000 7f8e5b400700 1 --2- 172.21.15.2:0/1137932341 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8e400390f0 0x7f8e4003b5b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8e48006fd0 tx=0x7f8e48006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:11.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.615+0000 7f8e58c00700 1 -- 172.21.15.2:0/1137932341 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8e4c013070 con 0x7f8e5c102100 2024-06-13T11:11:11.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:11.854+0000 7f8e62c00700 1 -- 172.21.15.2:0/1137932341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8e5c19af50 con 0x7f8e5c102100 2024-06-13T11:11:12.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:11 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:12.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:11 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:12.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:11 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:12.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:11 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:12.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:11 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi178", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:11:12.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:11 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:12.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:11 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:12.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:11 smithi002 ceph-mon[32210]: Updating smithi178:/etc/ceph/ceph.conf 2024-06-13T11:11:12.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:12.811+0000 7f8e58c00700 1 -- 172.21.15.2:0/1137932341 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f8e4c030090 con 0x7f8e5c102100 2024-06-13T11:11:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:12.815+0000 7f8e62c00700 1 -- 172.21.15.2:0/1137932341 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8e400390f0 msgr2=0x7f8e4003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:12.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:12.815+0000 7f8e62c00700 1 --2- 172.21.15.2:0/1137932341 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8e400390f0 0x7f8e4003b5b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8e48006fd0 tx=0x7f8e48006e40 comp rx=0 tx=0).stop 2024-06-13T11:11:12.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:12.815+0000 7f8e62c00700 1 -- 172.21.15.2:0/1137932341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e5c102100 msgr2=0x7f8e5c19f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:12.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:12.815+0000 7f8e62c00700 1 --2- 172.21.15.2:0/1137932341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e5c102100 0x7f8e5c19f860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c006010 tx=0x7f8e4c005030 comp rx=0 tx=0).stop 2024-06-13T11:11:12.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:12.815+0000 7f8e62c00700 1 -- 172.21.15.2:0/1137932341 shutdown_connections 2024-06-13T11:11:12.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:12.815+0000 7f8e62c00700 1 --2- 172.21.15.2:0/1137932341 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8e400390f0 0x7f8e4003b5b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:12.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:12.815+0000 7f8e62c00700 1 --2- 172.21.15.2:0/1137932341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e5c102100 0x7f8e5c19f860 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:12.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:12.815+0000 7f8e62c00700 1 -- 172.21.15.2:0/1137932341 >> 172.21.15.2:0/1137932341 conn(0x7f8e5c0fd9d0 msgr2=0x7f8e5c0746c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:12.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:12.815+0000 7f8e62c00700 1 -- 172.21.15.2:0/1137932341 shutdown_connections 2024-06-13T11:11:12.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:12.815+0000 7f8e62c00700 1 -- 172.21.15.2:0/1137932341 wait complete. 2024-06-13T11:11:12.816 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-06-13T11:11:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:12 smithi002 ceph-mon[32210]: Updating smithi178:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:11:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:12 smithi002 ceph-mon[32210]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:12 smithi002 ceph-mon[32210]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:11:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:12 smithi002 ceph-mon[32210]: Updating smithi178:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T11:11:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:12 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1137932341' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-13T11:11:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:13.679 INFO:tasks.cephadm:Adding mon.a on smithi002 2024-06-13T11:11:13.679 INFO:tasks.cephadm:Adding mon.b on smithi077 2024-06-13T11:11:13.679 INFO:tasks.cephadm:Adding mon.c on smithi178 2024-06-13T11:11:13.679 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch apply mon '3;smithi002:172.21.15.2=a;smithi077:172.21.15.77=b;smithi178:172.21.15.178=c' 2024-06-13T11:11:13.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:13 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1137932341' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-13T11:11:13.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:13 smithi002 ceph-mon[32210]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T11:11:13.915 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:11:15.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:14 smithi002 ceph-mon[32210]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:15.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.375+0000 7f6761599700 1 -- 172.21.15.178:0/1720198180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f675c1065e0 msgr2=0x7f675c1069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:15.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.375+0000 7f6761599700 1 --2- 172.21.15.178:0/1720198180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f675c1065e0 0x7f675c1069c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f674c00b0a0 tx=0x7f674c00b3b0 comp rx=0 tx=0).stop 2024-06-13T11:11:15.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.375+0000 7f6761599700 1 -- 172.21.15.178:0/1720198180 shutdown_connections 2024-06-13T11:11:15.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.375+0000 7f6761599700 1 --2- 172.21.15.178:0/1720198180 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f675c1065e0 0x7f675c1069c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:15.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.375+0000 7f6761599700 1 -- 172.21.15.178:0/1720198180 >> 172.21.15.178:0/1720198180 conn(0x7f675c077510 msgr2=0x7f675c077920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:15.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.375+0000 7f6761599700 1 -- 172.21.15.178:0/1720198180 shutdown_connections 2024-06-13T11:11:15.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.375+0000 7f6761599700 1 -- 172.21.15.178:0/1720198180 wait complete. 2024-06-13T11:11:15.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.376+0000 7f6761599700 1 Processor -- start 2024-06-13T11:11:15.376 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.376+0000 7f6761599700 1 -- start start 2024-06-13T11:11:15.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.376+0000 7f6761599700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f675c1065e0 0x7f675c1987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:15.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.376+0000 7f6761599700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f675c10aba0 con 0x7f675c1065e0 2024-06-13T11:11:15.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.377+0000 7f675affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f675c1065e0 0x7f675c1987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:15.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.377+0000 7f675affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f675c1065e0 0x7f675c1987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.178:33736/0 (socket says 172.21.15.178:33736) 2024-06-13T11:11:15.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.377+0000 7f675affd700 1 -- 172.21.15.178:0/3707740510 learned_addr learned my addr 172.21.15.178:0/3707740510 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-13T11:11:15.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.378+0000 7f675affd700 1 -- 172.21.15.178:0/3707740510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f675c198ce0 con 0x7f675c1065e0 2024-06-13T11:11:15.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.378+0000 7f675affd700 1 --2- 172.21.15.178:0/3707740510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f675c1065e0 0x7f675c1987a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f674c0062a0 tx=0x7f674c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:15.378 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.378+0000 7f6743fff700 1 -- 172.21.15.178:0/3707740510 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f674c017040 con 0x7f675c1065e0 2024-06-13T11:11:15.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.378+0000 7f6761599700 1 -- 172.21.15.178:0/3707740510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f675c198f70 con 0x7f675c1065e0 2024-06-13T11:11:15.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.378+0000 7f6761599700 1 -- 172.21.15.178:0/3707740510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f675c1993d0 con 0x7f675c1065e0 2024-06-13T11:11:15.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.378+0000 7f6743fff700 1 -- 172.21.15.178:0/3707740510 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f674c022070 con 0x7f675c1065e0 2024-06-13T11:11:15.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.378+0000 7f6743fff700 1 -- 172.21.15.178:0/3707740510 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f674c004700 con 0x7f675c1065e0 2024-06-13T11:11:15.379 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.379+0000 7f6761599700 1 -- 172.21.15.178:0/3707740510 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6748005330 con 0x7f675c1065e0 2024-06-13T11:11:15.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.380+0000 7f6743fff700 1 -- 172.21.15.178:0/3707740510 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f674c0048a0 con 0x7f675c1065e0 2024-06-13T11:11:15.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.380+0000 7f6743fff700 1 --2- 172.21.15.178:0/3707740510 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f67440390f0 0x7f674403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:15.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.380+0000 7f6743fff700 1 -- 172.21.15.178:0/3707740510 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f674c00f050 con 0x7f675c1065e0 2024-06-13T11:11:15.380 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.380+0000 7f675a7fc700 1 --2- 172.21.15.178:0/3707740510 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f67440390f0 0x7f674403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:15.381 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.381+0000 7f675a7fc700 1 --2- 172.21.15.178:0/3707740510 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f67440390f0 0x7f674403b5b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6750006fd0 tx=0x7f6750006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:15.396 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.396+0000 7f6743fff700 1 -- 172.21.15.178:0/3707740510 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f674c007e20 con 0x7f675c1065e0 2024-06-13T11:11:15.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.603+0000 7f6761599700 1 -- 172.21.15.178:0/3707740510 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi077:172.21.15.77=b;smithi178:172.21.15.178=c", "target": ["mon-mgr", ""]}) -- 0x7f6748000c70 con 0x7f67440390f0 2024-06-13T11:11:15.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.618+0000 7f6743fff700 1 -- 172.21.15.178:0/3707740510 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f6748000c70 con 0x7f67440390f0 2024-06-13T11:11:15.618 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled mon update... 2024-06-13T11:11:15.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.620+0000 7f6761599700 1 -- 172.21.15.178:0/3707740510 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f67440390f0 msgr2=0x7f674403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:15.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.620+0000 7f6761599700 1 --2- 172.21.15.178:0/3707740510 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f67440390f0 0x7f674403b5b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6750006fd0 tx=0x7f6750006e40 comp rx=0 tx=0).stop 2024-06-13T11:11:15.620 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.620+0000 7f6761599700 1 -- 172.21.15.178:0/3707740510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f675c1065e0 msgr2=0x7f675c1987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.620+0000 7f6761599700 1 --2- 172.21.15.178:0/3707740510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f675c1065e0 0x7f675c1987a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f674c0062a0 tx=0x7f674c003ce0 comp rx=0 tx=0).stop 2024-06-13T11:11:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.621+0000 7f6761599700 1 -- 172.21.15.178:0/3707740510 shutdown_connections 2024-06-13T11:11:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.621+0000 7f6761599700 1 --2- 172.21.15.178:0/3707740510 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f67440390f0 0x7f674403b5b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.621+0000 7f6761599700 1 --2- 172.21.15.178:0/3707740510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f675c1065e0 0x7f675c1987a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.621+0000 7f6761599700 1 -- 172.21.15.178:0/3707740510 >> 172.21.15.178:0/3707740510 conn(0x7f675c077510 msgr2=0x7f675c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.621+0000 7f6761599700 1 -- 172.21.15.178:0/3707740510 shutdown_connections 2024-06-13T11:11:15.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:15.621+0000 7f6761599700 1 -- 172.21.15.178:0/3707740510 wait complete. 2024-06-13T11:11:16.220 DEBUG:teuthology.orchestra.run.smithi077:mon.b> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mon.b.service 2024-06-13T11:11:16.222 DEBUG:teuthology.orchestra.run.smithi178:mon.c> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mon.c.service 2024-06-13T11:11:16.225 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-13T11:11:16.225 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph mon dump -f json 2024-06-13T11:11:16.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:16 smithi002 ceph-mon[32210]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:16.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:16 smithi002 ceph-mon[32210]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi077:172.21.15.77=b;smithi178:172.21.15.178=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:11:16.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:16 smithi002 ceph-mon[32210]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi077:172.21.15.77=b;smithi178:172.21.15.178=c;count:3 2024-06-13T11:11:16.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:16 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:16.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:16 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:16.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:16 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:16.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:16 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:16.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:16 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:16.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:16 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T11:11:16.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:16 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:16.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:16 smithi002 ceph-mon[32210]: Deploying daemon mon.c on smithi178 2024-06-13T11:11:17.914 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:11:18.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:18 smithi002 ceph-mon[32210]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:20.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.205+0000 7f4059615700 1 -- 172.21.15.178:0/710621506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40541020d0 msgr2=0x7f40541024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:20.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.205+0000 7f4059615700 1 --2- 172.21.15.178:0/710621506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40541020d0 0x7f40541024b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4044009910 tx=0x7f4044009c20 comp rx=0 tx=0).stop 2024-06-13T11:11:20.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.205+0000 7f4059615700 1 -- 172.21.15.178:0/710621506 shutdown_connections 2024-06-13T11:11:20.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.205+0000 7f4059615700 1 --2- 172.21.15.178:0/710621506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40541020d0 0x7f40541024b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:20.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.205+0000 7f4059615700 1 -- 172.21.15.178:0/710621506 >> 172.21.15.178:0/710621506 conn(0x7f40540fd9a0 msgr2=0x7f40540ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:20.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.205+0000 7f4059615700 1 -- 172.21.15.178:0/710621506 shutdown_connections 2024-06-13T11:11:20.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.206+0000 7f4059615700 1 -- 172.21.15.178:0/710621506 wait complete. 2024-06-13T11:11:20.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.206+0000 7f4059615700 1 Processor -- start 2024-06-13T11:11:20.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.207+0000 7f4059615700 1 -- start start 2024-06-13T11:11:20.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.207+0000 7f4059615700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40541020d0 0x7f405419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:20.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.207+0000 7f4059615700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f405410c4a0 con 0x7f40541020d0 2024-06-13T11:11:20.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.207+0000 7f4052ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40541020d0 0x7f405419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:20.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.207+0000 7f4052ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40541020d0 0x7f405419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.178:40976/0 (socket says 172.21.15.178:40976) 2024-06-13T11:11:20.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.207+0000 7f4052ffd700 1 -- 172.21.15.178:0/524510897 learned_addr learned my addr 172.21.15.178:0/524510897 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-13T11:11:20.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.208+0000 7f4052ffd700 1 -- 172.21.15.178:0/524510897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405419dba0 con 0x7f40541020d0 2024-06-13T11:11:20.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.208+0000 7f4052ffd700 1 --2- 172.21.15.178:0/524510897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40541020d0 0x7f405419d660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4044005850 tx=0x7f4044005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:20.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.209+0000 7f403bfff700 1 -- 172.21.15.178:0/524510897 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4044026070 con 0x7f40541020d0 2024-06-13T11:11:20.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.209+0000 7f4059615700 1 -- 172.21.15.178:0/524510897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405419de90 con 0x7f40541020d0 2024-06-13T11:11:20.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.209+0000 7f4059615700 1 -- 172.21.15.178:0/524510897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40541977e0 con 0x7f40541020d0 2024-06-13T11:11:20.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.209+0000 7f403bfff700 1 -- 172.21.15.178:0/524510897 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f404400bbd0 con 0x7f40541020d0 2024-06-13T11:11:20.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.209+0000 7f403bfff700 1 -- 172.21.15.178:0/524510897 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4044030060 con 0x7f40541020d0 2024-06-13T11:11:20.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.210+0000 7f4059615700 1 -- 172.21.15.178:0/524510897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4040005330 con 0x7f40541020d0 2024-06-13T11:11:20.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.210+0000 7f403bfff700 1 -- 172.21.15.178:0/524510897 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f4044029070 con 0x7f40541020d0 2024-06-13T11:11:20.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.211+0000 7f403bfff700 1 --2- 172.21.15.178:0/524510897 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f403c0390f0 0x7f403c03b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:20.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.211+0000 7f403bfff700 1 -- 172.21.15.178:0/524510897 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f404401e070 con 0x7f40541020d0 2024-06-13T11:11:20.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.211+0000 7f40527fc700 1 --2- 172.21.15.178:0/524510897 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f403c0390f0 0x7f403c03b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:20.212 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.212+0000 7f40527fc700 1 --2- 172.21.15.178:0/524510897 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f403c0390f0 0x7f403c03b5b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4048006fd0 tx=0x7f4048006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:20.226 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.227+0000 7f403bfff700 1 -- 172.21.15.178:0/524510897 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4044013070 con 0x7f40541020d0 2024-06-13T11:11:20.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.512+0000 7f4059615700 1 -- 172.21.15.178:0/524510897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4040005620 con 0x7f40541020d0 2024-06-13T11:11:20.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.513+0000 7f403bfff700 1 -- 172.21.15.178:0/524510897 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f40440047f0 con 0x7f40541020d0 2024-06-13T11:11:20.513 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:11:20.513 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":1,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","modified":"2024-06-13T11:09:03.629613Z","created":"2024-06-13T11:09:03.629613Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-13T11:11:20.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.515+0000 7f4059615700 1 -- 172.21.15.178:0/524510897 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f403c0390f0 msgr2=0x7f403c03b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:20.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.515+0000 7f4059615700 1 --2- 172.21.15.178:0/524510897 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f403c0390f0 0x7f403c03b5b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4048006fd0 tx=0x7f4048006e40 comp rx=0 tx=0).stop 2024-06-13T11:11:20.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.515+0000 7f4059615700 1 -- 172.21.15.178:0/524510897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40541020d0 msgr2=0x7f405419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:20.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.515+0000 7f4059615700 1 --2- 172.21.15.178:0/524510897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40541020d0 0x7f405419d660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4044005850 tx=0x7f4044005030 comp rx=0 tx=0).stop 2024-06-13T11:11:20.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.515+0000 7f4059615700 1 -- 172.21.15.178:0/524510897 shutdown_connections 2024-06-13T11:11:20.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.515+0000 7f4059615700 1 --2- 172.21.15.178:0/524510897 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f403c0390f0 0x7f403c03b5b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:20.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.515+0000 7f4059615700 1 --2- 172.21.15.178:0/524510897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40541020d0 0x7f405419d660 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:20.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.515+0000 7f4059615700 1 -- 172.21.15.178:0/524510897 >> 172.21.15.178:0/524510897 conn(0x7f40540fd9a0 msgr2=0x7f4054103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:20.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.515+0000 7f4059615700 1 -- 172.21.15.178:0/524510897 shutdown_connections 2024-06-13T11:11:20.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:20.515+0000 7f4059615700 1 -- 172.21.15.178:0/524510897 wait complete. 2024-06-13T11:11:20.516 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 1 2024-06-13T11:11:20.604 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: mon.c@-1(synchronizing).mds e1 print_map 2024-06-13T11:11:20.604 INFO:journalctl@ceph.mon.c.smithi178.stdout: e1 2024-06-13T11:11:20.604 INFO:journalctl@ceph.mon.c.smithi178.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-13T11:11:20.604 INFO:journalctl@ceph.mon.c.smithi178.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-13T11:11:20.604 INFO:journalctl@ceph.mon.c.smithi178.stdout: legacy client fscid: -1 2024-06-13T11:11:20.605 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2024-06-13T11:11:20.605 INFO:journalctl@ceph.mon.c.smithi178.stdout: No filesystems configured 2024-06-13T11:11:20.605 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-06-13T11:11:20.605 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-06-13T11:11:20.605 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-06-13T11:11:20.605 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-06-13T11:11:20.605 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-06-13T11:11:20.605 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-06-13T11:11:20.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-13T11:11:20.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T11:11:20.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T11:11:20.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T11:11:20.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: Deploying cephadm binary to smithi077 2024-06-13T11:11:20.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:20.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:20.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: Added host smithi077 2024-06-13T11:11:20.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:20.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:20.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:20.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:11:20.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:20.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.950 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.950 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi077", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:11:20.950 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:20.950 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:20.950 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: Updating smithi077:/etc/ceph/ceph.conf 2024-06-13T11:11:20.950 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: Updating smithi077:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:11:20.950 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:11:20.950 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:20.950 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: Updating smithi077:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T11:11:20.951 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.951 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.951 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.951 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:11:20.951 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: Deploying cephadm binary to smithi178 2024-06-13T11:11:20.951 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:20.951 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:20.951 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.951 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: Added host smithi178 2024-06-13T11:11:20.952 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:20.952 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.952 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:20.952 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.952 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:20.952 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.952 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:11:20.952 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:20.952 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.952 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.952 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.953 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.953 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi178", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:11:20.953 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:20.953 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:20.953 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: Updating smithi178:/etc/ceph/ceph.conf 2024-06-13T11:11:20.953 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: Updating smithi178:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:11:20.953 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:20.953 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:11:20.953 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: Updating smithi178:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T11:11:20.953 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1137932341' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-13T11:11:20.953 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.954 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.954 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.954 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1137932341' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-13T11:11:20.954 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T11:11:20.954 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:20.954 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:20.954 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi077:172.21.15.77=b;smithi178:172.21.15.178=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:11:20.954 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi077:172.21.15.77=b;smithi178:172.21.15.178=c;count:3 2024-06-13T11:11:20.954 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.954 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:20.954 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:20.955 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:20.955 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:20.955 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T11:11:20.955 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:20.955 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: Deploying daemon mon.c on smithi178 2024-06-13T11:11:20.955 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:20.955 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:20 smithi178 ceph-mon[36913]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-06-13T11:11:21.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:21 smithi178 bash[36880]: 3394830722fca6061a684a98778e8eff09ec44819365830261553f8ac31b7c13 2024-06-13T11:11:21.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:21 smithi178 systemd[1]: Started Ceph mon.c for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:11:22.483 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-13T11:11:22.483 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph mon dump -f json 2024-06-13T11:11:22.728 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:11:25.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.651+0000 7f2f34618700 1 -- 172.21.15.178:0/3495489336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c103240 msgr2=0x7f2f2c103620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:25.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.651+0000 7f2f34618700 1 --2- 172.21.15.178:0/3495489336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c103240 0x7f2f2c103620 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2f24005fa0 tx=0x7f2f2400fe80 comp rx=0 tx=0).stop 2024-06-13T11:11:25.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.651+0000 7f2f34618700 1 -- 172.21.15.178:0/3495489336 shutdown_connections 2024-06-13T11:11:25.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.651+0000 7f2f34618700 1 --2- 172.21.15.178:0/3495489336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c103240 0x7f2f2c103620 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:25.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.651+0000 7f2f34618700 1 -- 172.21.15.178:0/3495489336 >> 172.21.15.178:0/3495489336 conn(0x7f2f2c0fc9f0 msgr2=0x7f2f2c0fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:25.656 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.651+0000 7f2f34618700 1 -- 172.21.15.178:0/3495489336 shutdown_connections 2024-06-13T11:11:25.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.651+0000 7f2f34618700 1 -- 172.21.15.178:0/3495489336 wait complete. 2024-06-13T11:11:25.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.652+0000 7f2f34618700 1 Processor -- start 2024-06-13T11:11:25.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.652+0000 7f2f34618700 1 -- start start 2024-06-13T11:11:25.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.652+0000 7f2f34618700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c103240 0x7f2f2c100ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:25.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.652+0000 7f2f34618700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f2c1013e0 0x7f2f2c101860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:25.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.652+0000 7f2f34618700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2c10c6a0 con 0x7f2f2c103240 2024-06-13T11:11:25.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.652+0000 7f2f34618700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2c10c520 con 0x7f2f2c1013e0 2024-06-13T11:11:25.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.652+0000 7f2f31bb3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f2c1013e0 0x7f2f2c101860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:25.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.652+0000 7f2f31bb3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f2c1013e0 0x7f2f2c101860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:45972/0 (socket says 172.21.15.178:45972) 2024-06-13T11:11:25.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.652+0000 7f2f31bb3700 1 -- 172.21.15.178:0/3009761774 learned_addr learned my addr 172.21.15.178:0/3009761774 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-13T11:11:25.657 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.652+0000 7f2f31bb3700 1 -- 172.21.15.178:0/3009761774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f2c1013e0 msgr2=0x7f2f2c101860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-06-13T11:11:25.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.652+0000 7f2f31bb3700 1 -- 172.21.15.178:0/3009761774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f2c1013e0 msgr2=0x7f2f2c101860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-13T11:11:25.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.652+0000 7f2f31bb3700 1 --2- 172.21.15.178:0/3009761774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f2c1013e0 0x7f2f2c101860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T11:11:25.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.652+0000 7f2f31bb3700 1 --2- 172.21.15.178:0/3009761774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f2c1013e0 0x7f2f2c101860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:11:25.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.653+0000 7f2f323b4700 1 --2- 172.21.15.178:0/3009761774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c103240 0x7f2f2c100ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:25.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.653+0000 7f2f323b4700 1 -- 172.21.15.178:0/3009761774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f2c1013e0 msgr2=0x7f2f2c101860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:11:25.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.653+0000 7f2f323b4700 1 --2- 172.21.15.178:0/3009761774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f2c1013e0 0x7f2f2c101860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:25.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.653+0000 7f2f323b4700 1 -- 172.21.15.178:0/3009761774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2c102dc0 con 0x7f2f2c103240 2024-06-13T11:11:25.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.654+0000 7f2f323b4700 1 --2- 172.21.15.178:0/3009761774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c103240 0x7f2f2c100ea0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2f24000c00 tx=0x7f2f24003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:25.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.654+0000 7f2f237fe700 1 -- 172.21.15.178:0/3009761774 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2f24005010 con 0x7f2f2c103240 2024-06-13T11:11:25.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.654+0000 7f2f34618700 1 -- 172.21.15.178:0/3009761774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f2c1a3e60 con 0x7f2f2c103240 2024-06-13T11:11:25.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.654+0000 7f2f34618700 1 -- 172.21.15.178:0/3009761774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f2c1a42c0 con 0x7f2f2c103240 2024-06-13T11:11:25.658 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.654+0000 7f2f237fe700 1 -- 172.21.15.178:0/3009761774 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f24005690 con 0x7f2f2c103240 2024-06-13T11:11:25.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.654+0000 7f2f237fe700 1 -- 172.21.15.178:0/3009761774 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2f24011df0 con 0x7f2f2c103240 2024-06-13T11:11:25.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.655+0000 7f2f34618700 1 -- 172.21.15.178:0/3009761774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f2c06aec0 con 0x7f2f2c103240 2024-06-13T11:11:25.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.656+0000 7f2f237fe700 1 -- 172.21.15.178:0/3009761774 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f2f2402d070 con 0x7f2f2c103240 2024-06-13T11:11:25.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.656+0000 7f2f237fe700 1 --2- 172.21.15.178:0/3009761774 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2f18039030 0x7f2f1803b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:25.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.656+0000 7f2f237fe700 1 -- 172.21.15.178:0/3009761774 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2f24022070 con 0x7f2f2c103240 2024-06-13T11:11:25.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.656+0000 7f2f31bb3700 1 --2- 172.21.15.178:0/3009761774 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2f18039030 0x7f2f1803b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:25.659 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.658+0000 7f2f31bb3700 1 --2- 172.21.15.178:0/3009761774 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2f18039030 0x7f2f1803b4f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c009180 tx=0x7f2f1c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:25.671 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.671+0000 7f2f237fe700 1 -- 172.21.15.178:0/3009761774 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2f2401b9b0 con 0x7f2f2c103240 2024-06-13T11:11:25.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:11:25.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: mon.a calling monitor election 2024-06-13T11:11:25.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:25.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:25.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:25.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:25.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: mon.c calling monitor election 2024-06-13T11:11:25.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:25.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:25.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:25.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:25.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-13T11:11:25.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: monmap epoch 2 2024-06-13T11:11:25.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: fsid 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:11:25.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: last_changed 2024-06-13T11:11:20.611340+0000 2024-06-13T11:11:25.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: created 2024-06-13T11:09:03.629613+0000 2024-06-13T11:11:25.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: min_mon_release 19 (squid) 2024-06-13T11:11:25.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: election_strategy: 1 2024-06-13T11:11:25.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T11:11:25.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-13T11:11:25.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: fsmap 2024-06-13T11:11:25.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T11:11:25.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: mgrmap e13: x(active, since 60s) 2024-06-13T11:11:25.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: overall HEALTH_OK 2024-06-13T11:11:25.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:25.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:25.953 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.954+0000 7f2f34618700 1 -- 172.21.15.178:0/3009761774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f2f2c1a45e0 con 0x7f2f2c103240 2024-06-13T11:11:25.954 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.955+0000 7f2f237fe700 1 -- 172.21.15.178:0/3009761774 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f2f2401a330 con 0x7f2f2c103240 2024-06-13T11:11:25.955 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:11:25.955 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":2,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","modified":"2024-06-13T11:11:20.611340Z","created":"2024-06-13T11:09:03.629613Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-13T11:11:25.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.957+0000 7f2f34618700 1 -- 172.21.15.178:0/3009761774 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2f18039030 msgr2=0x7f2f1803b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:25.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.957+0000 7f2f34618700 1 --2- 172.21.15.178:0/3009761774 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2f18039030 0x7f2f1803b4f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c009180 tx=0x7f2f1c008040 comp rx=0 tx=0).stop 2024-06-13T11:11:25.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.957+0000 7f2f34618700 1 -- 172.21.15.178:0/3009761774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c103240 msgr2=0x7f2f2c100ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:25.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.957+0000 7f2f34618700 1 --2- 172.21.15.178:0/3009761774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c103240 0x7f2f2c100ea0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2f24000c00 tx=0x7f2f24003cd0 comp rx=0 tx=0).stop 2024-06-13T11:11:25.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.957+0000 7f2f34618700 1 -- 172.21.15.178:0/3009761774 shutdown_connections 2024-06-13T11:11:25.957 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.957+0000 7f2f34618700 1 --2- 172.21.15.178:0/3009761774 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2f18039030 0x7f2f1803b4f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:25.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.957+0000 7f2f34618700 1 --2- 172.21.15.178:0/3009761774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f2c103240 0x7f2f2c100ea0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:25.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.957+0000 7f2f34618700 1 --2- 172.21.15.178:0/3009761774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f2c1013e0 0x7f2f2c101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:25.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.957+0000 7f2f34618700 1 -- 172.21.15.178:0/3009761774 >> 172.21.15.178:0/3009761774 conn(0x7f2f2c0fc9f0 msgr2=0x7f2f2c103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:25.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.957+0000 7f2f34618700 1 -- 172.21.15.178:0/3009761774 shutdown_connections 2024-06-13T11:11:25.958 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:25.957+0000 7f2f34618700 1 -- 172.21.15.178:0/3009761774 wait complete. 2024-06-13T11:11:25.958 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 2 2024-06-13T11:11:26.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:11:26.106 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: mon.a calling monitor election 2024-06-13T11:11:26.107 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:26.107 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:26.107 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:26.107 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:26.107 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: mon.c calling monitor election 2024-06-13T11:11:26.107 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:26.108 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:26.108 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:26.108 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:26.108 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-13T11:11:26.108 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: monmap epoch 2 2024-06-13T11:11:26.108 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: fsid 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:11:26.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: last_changed 2024-06-13T11:11:20.611340+0000 2024-06-13T11:11:26.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: created 2024-06-13T11:09:03.629613+0000 2024-06-13T11:11:26.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: min_mon_release 19 (squid) 2024-06-13T11:11:26.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: election_strategy: 1 2024-06-13T11:11:26.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T11:11:26.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-13T11:11:26.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: fsmap 2024-06-13T11:11:26.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T11:11:26.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: mgrmap e13: x(active, since 60s) 2024-06-13T11:11:26.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: overall HEALTH_OK 2024-06-13T11:11:26.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:26.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:26.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:26 smithi002 ceph-mon[32210]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:26.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:26.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T11:11:26.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:26.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:26 smithi002 ceph-mon[32210]: Deploying daemon mon.b on smithi077 2024-06-13T11:11:26.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:26 smithi002 ceph-mon[32210]: from='client.? 172.21.15.178:0/3009761774' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-13T11:11:26.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:26.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:26 smithi178 ceph-mon[36913]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:26.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:26.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T11:11:26.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:26.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:26 smithi178 ceph-mon[36913]: Deploying daemon mon.b on smithi077 2024-06-13T11:11:26.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:26 smithi178 ceph-mon[36913]: from='client.? 172.21.15.178:0/3009761774' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-13T11:11:26.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:27.546 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-13T11:11:27.547 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph mon dump -f json 2024-06-13T11:11:27.784 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:11:28.955 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:28 smithi178 ceph-mon[36913]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:29.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:28 smithi002 ceph-mon[32210]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:29.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.153+0000 7fad4da2f700 1 -- 172.21.15.178:0/3926124240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad481066a0 msgr2=0x7fad48106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:29.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.153+0000 7fad4da2f700 1 --2- 172.21.15.178:0/3926124240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad481066a0 0x7fad48106a80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fad38009910 tx=0x7fad38009c20 comp rx=0 tx=0).stop 2024-06-13T11:11:29.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.154+0000 7fad4da2f700 1 -- 172.21.15.178:0/3926124240 shutdown_connections 2024-06-13T11:11:29.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.154+0000 7fad4da2f700 1 --2- 172.21.15.178:0/3926124240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad481066a0 0x7fad48106a80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:29.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.154+0000 7fad4da2f700 1 -- 172.21.15.178:0/3926124240 >> 172.21.15.178:0/3926124240 conn(0x7fad48077370 msgr2=0x7fad48077780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:29.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.154+0000 7fad4da2f700 1 -- 172.21.15.178:0/3926124240 shutdown_connections 2024-06-13T11:11:29.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.154+0000 7fad4da2f700 1 -- 172.21.15.178:0/3926124240 wait complete. 2024-06-13T11:11:29.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.154+0000 7fad4da2f700 1 Processor -- start 2024-06-13T11:11:29.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.154+0000 7fad4da2f700 1 -- start start 2024-06-13T11:11:29.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.155+0000 7fad4da2f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad481066a0 0x7fad480fd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:29.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.155+0000 7fad4da2f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad480fdcb0 0x7fad480fe130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:29.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.155+0000 7fad4da2f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fad4810ac50 con 0x7fad480fdcb0 2024-06-13T11:11:29.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.155+0000 7fad4da2f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fad4810aad0 con 0x7fad481066a0 2024-06-13T11:11:29.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.155+0000 7fad46ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad481066a0 0x7fad480fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:29.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.155+0000 7fad46ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad481066a0 0x7fad480fd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:45986/0 (socket says 172.21.15.178:45986) 2024-06-13T11:11:29.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.155+0000 7fad46ffd700 1 -- 172.21.15.178:0/2739472081 learned_addr learned my addr 172.21.15.178:0/2739472081 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-13T11:11:29.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.155+0000 7fad46ffd700 1 -- 172.21.15.178:0/2739472081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad481066a0 msgr2=0x7fad480fd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-06-13T11:11:29.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.155+0000 7fad46ffd700 1 -- 172.21.15.178:0/2739472081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad481066a0 msgr2=0x7fad480fd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-13T11:11:29.156 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.155+0000 7fad46ffd700 1 --2- 172.21.15.178:0/2739472081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad481066a0 0x7fad480fd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T11:11:29.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.155+0000 7fad46ffd700 1 --2- 172.21.15.178:0/2739472081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad481066a0 0x7fad480fd770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:11:29.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.155+0000 7fad467fc700 1 --2- 172.21.15.178:0/2739472081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad480fdcb0 0x7fad480fe130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:29.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.156+0000 7fad467fc700 1 -- 172.21.15.178:0/2739472081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad481066a0 msgr2=0x7fad480fd770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:11:29.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.156+0000 7fad467fc700 1 --2- 172.21.15.178:0/2739472081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad481066a0 0x7fad480fd770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:29.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.156+0000 7fad467fc700 1 -- 172.21.15.178:0/2739472081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad480ff690 con 0x7fad480fdcb0 2024-06-13T11:11:29.157 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.156+0000 7fad467fc700 1 --2- 172.21.15.178:0/2739472081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad480fdcb0 0x7fad480fe130 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00b4d0 tx=0x7fad3c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:29.158 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.156+0000 7fad4ca2d700 1 -- 172.21.15.178:0/2739472081 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fad3c011630 con 0x7fad480fdcb0 2024-06-13T11:11:29.158 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.157+0000 7fad4da2f700 1 -- 172.21.15.178:0/2739472081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad481a3e80 con 0x7fad480fdcb0 2024-06-13T11:11:29.158 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.157+0000 7fad4da2f700 1 -- 172.21.15.178:0/2739472081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad481a4390 con 0x7fad480fdcb0 2024-06-13T11:11:29.158 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.157+0000 7fad4ca2d700 1 -- 172.21.15.178:0/2739472081 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad3c011cb0 con 0x7fad480fdcb0 2024-06-13T11:11:29.158 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.157+0000 7fad4ca2d700 1 -- 172.21.15.178:0/2739472081 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fad3c01ae20 con 0x7fad480fdcb0 2024-06-13T11:11:29.158 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.157+0000 7fad4da2f700 1 -- 172.21.15.178:0/2739472081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad34005330 con 0x7fad480fdcb0 2024-06-13T11:11:29.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.158+0000 7fad4ca2d700 1 -- 172.21.15.178:0/2739472081 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fad3c018020 con 0x7fad480fdcb0 2024-06-13T11:11:29.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.158+0000 7fad4ca2d700 1 --2- 172.21.15.178:0/2739472081 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fad30038e90 0x7fad3003b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:29.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.158+0000 7fad4ca2d700 1 -- 172.21.15.178:0/2739472081 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fad3c04ba00 con 0x7fad480fdcb0 2024-06-13T11:11:29.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.159+0000 7fad46ffd700 1 --2- 172.21.15.178:0/2739472081 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fad30038e90 0x7fad3003b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:29.159 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.160+0000 7fad46ffd700 1 --2- 172.21.15.178:0/2739472081 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fad30038e90 0x7fad3003b350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fad38000c00 tx=0x7fad3800b580 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:29.174 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.174+0000 7fad4ca2d700 1 -- 172.21.15.178:0/2739472081 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fad3c01f020 con 0x7fad480fdcb0 2024-06-13T11:11:29.447 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.447+0000 7fad4da2f700 1 -- 172.21.15.178:0/2739472081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fad340058f0 con 0x7fad480fdcb0 2024-06-13T11:11:29.448 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.448+0000 7fad4ca2d700 1 -- 172.21.15.178:0/2739472081 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7fad3c016220 con 0x7fad480fdcb0 2024-06-13T11:11:29.448 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:11:29.448 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":2,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","modified":"2024-06-13T11:11:20.611340Z","created":"2024-06-13T11:09:03.629613Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-13T11:11:29.450 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.451+0000 7fad4da2f700 1 -- 172.21.15.178:0/2739472081 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fad30038e90 msgr2=0x7fad3003b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:29.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.451+0000 7fad4da2f700 1 --2- 172.21.15.178:0/2739472081 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fad30038e90 0x7fad3003b350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fad38000c00 tx=0x7fad3800b580 comp rx=0 tx=0).stop 2024-06-13T11:11:29.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.451+0000 7fad4da2f700 1 -- 172.21.15.178:0/2739472081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad480fdcb0 msgr2=0x7fad480fe130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:29.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.451+0000 7fad4da2f700 1 --2- 172.21.15.178:0/2739472081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad480fdcb0 0x7fad480fe130 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00b4d0 tx=0x7fad3c00b890 comp rx=0 tx=0).stop 2024-06-13T11:11:29.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.451+0000 7fad4da2f700 1 -- 172.21.15.178:0/2739472081 shutdown_connections 2024-06-13T11:11:29.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.451+0000 7fad4da2f700 1 --2- 172.21.15.178:0/2739472081 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fad30038e90 0x7fad3003b350 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:29.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.451+0000 7fad4da2f700 1 --2- 172.21.15.178:0/2739472081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad481066a0 0x7fad480fd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:29.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.451+0000 7fad4da2f700 1 --2- 172.21.15.178:0/2739472081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad480fdcb0 0x7fad480fe130 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:29.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.451+0000 7fad4da2f700 1 -- 172.21.15.178:0/2739472081 >> 172.21.15.178:0/2739472081 conn(0x7fad48077370 msgr2=0x7fad4810b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:29.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.451+0000 7fad4da2f700 1 -- 172.21.15.178:0/2739472081 shutdown_connections 2024-06-13T11:11:29.451 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:29.451+0000 7fad4da2f700 1 -- 172.21.15.178:0/2739472081 wait complete. 2024-06-13T11:11:29.452 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 2 2024-06-13T11:11:29.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 podman[36391]: 2024-06-13 11:11:29.364146143 +0000 UTC m=+0.017023723 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:11:30.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 podman[36391]: 2024-06-13 11:11:29.661896692 +0000 UTC m=+0.314774268 container init 6d9175ddbfb3042f56af4c41cb3ad429372c23e9d1804622731380fb1d5e0e07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-06-13T11:11:30.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 podman[36391]: 2024-06-13 11:11:29.664785246 +0000 UTC m=+0.317662816 container start 6d9175ddbfb3042f56af4c41cb3ad429372c23e9d1804622731380fb1d5e0e07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-b, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-06-13T11:11:30.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: set uid:gid to 167:167 (ceph:ceph) 2024-06-13T11:11:30.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc), process ceph-mon, pid 2 2024-06-13T11:11:30.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pidfile_write: ignore empty --pid-file 2024-06-13T11:11:30.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: load: jerasure load: lrc 2024-06-13T11:11:30.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: RocksDB version: 7.9.2 2024-06-13T11:11:30.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Git sha 0 2024-06-13T11:11:30.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Compile date 2024-05-30 15:42:47 2024-06-13T11:11:30.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: DB SUMMARY 2024-06-13T11:11:30.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: DB Session ID: VEE5YJCM9HW3DMZ3EUQQ 2024-06-13T11:11:30.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: CURRENT file: CURRENT 2024-06-13T11:11:30.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: IDENTITY file: IDENTITY 2024-06-13T11:11:30.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-06-13T11:11:30.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-06-13T11:11:30.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-06-13T11:11:30.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.error_if_exists: 0 2024-06-13T11:11:30.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.create_if_missing: 0 2024-06-13T11:11:30.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.paranoid_checks: 1 2024-06-13T11:11:30.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-13T11:11:30.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-13T11:11:30.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-13T11:11:30.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.env: 0x562cdb9b2c60 2024-06-13T11:11:30.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.fs: PosixFileSystem 2024-06-13T11:11:30.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.info_log: 0x562cdd185b20 2024-06-13T11:11:30.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_file_opening_threads: 16 2024-06-13T11:11:30.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.statistics: (nil) 2024-06-13T11:11:30.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.use_fsync: 0 2024-06-13T11:11:30.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_log_file_size: 0 2024-06-13T11:11:30.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-13T11:11:30.044 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-13T11:11:30.044 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.keep_log_file_num: 1000 2024-06-13T11:11:30.044 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.recycle_log_file_num: 0 2024-06-13T11:11:30.044 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.allow_fallocate: 1 2024-06-13T11:11:30.044 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.allow_mmap_reads: 0 2024-06-13T11:11:30.044 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.allow_mmap_writes: 0 2024-06-13T11:11:30.044 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.use_direct_reads: 0 2024-06-13T11:11:30.044 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-13T11:11:30.044 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.create_missing_column_families: 0 2024-06-13T11:11:30.044 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.db_log_dir: 2024-06-13T11:11:30.044 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.wal_dir: 2024-06-13T11:11:30.044 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-13T11:11:30.045 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-13T11:11:30.045 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-13T11:11:30.045 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-13T11:11:30.045 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-13T11:11:30.045 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-13T11:11:30.045 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.advise_random_on_open: 1 2024-06-13T11:11:30.045 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.db_write_buffer_size: 0 2024-06-13T11:11:30.045 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.write_buffer_manager: 0x562cdd1561e0 2024-06-13T11:11:30.045 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-13T11:11:30.045 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-13T11:11:30.045 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-13T11:11:30.045 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.rate_limiter: (nil) 2024-06-13T11:11:30.045 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-13T11:11:30.046 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.wal_recovery_mode: 2 2024-06-13T11:11:30.046 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.enable_thread_tracking: 0 2024-06-13T11:11:30.046 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.enable_pipelined_write: 0 2024-06-13T11:11:30.046 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.unordered_write: 0 2024-06-13T11:11:30.046 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-13T11:11:30.046 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-13T11:11:30.046 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-13T11:11:30.046 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-13T11:11:30.046 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.row_cache: None 2024-06-13T11:11:30.046 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.wal_filter: None 2024-06-13T11:11:30.048 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-13T11:11:30.048 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.allow_ingest_behind: 0 2024-06-13T11:11:30.048 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.two_write_queues: 0 2024-06-13T11:11:30.048 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.manual_wal_flush: 0 2024-06-13T11:11:30.048 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.wal_compression: 0 2024-06-13T11:11:30.048 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.atomic_flush: 0 2024-06-13T11:11:30.048 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-13T11:11:30.048 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-13T11:11:30.048 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-13T11:11:30.048 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.log_readahead_size: 0 2024-06-13T11:11:30.048 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-13T11:11:30.048 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.best_efforts_recovery: 0 2024-06-13T11:11:30.049 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-13T11:11:30.049 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-13T11:11:30.049 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.allow_data_in_errors: 0 2024-06-13T11:11:30.049 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.db_host_id: __hostname__ 2024-06-13T11:11:30.049 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-13T11:11:30.049 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_background_jobs: 2 2024-06-13T11:11:30.049 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_background_compactions: -1 2024-06-13T11:11:30.049 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_subcompactions: 1 2024-06-13T11:11:30.049 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-13T11:11:30.049 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-13T11:11:30.049 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-13T11:11:30.049 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_total_wal_size: 0 2024-06-13T11:11:30.050 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-13T11:11:30.050 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-13T11:11:30.050 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-13T11:11:30.050 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-13T11:11:30.050 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_open_files: -1 2024-06-13T11:11:30.050 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.bytes_per_sync: 0 2024-06-13T11:11:30.050 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-13T11:11:30.050 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-13T11:11:30.050 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compaction_readahead_size: 0 2024-06-13T11:11:30.050 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_background_flushes: -1 2024-06-13T11:11:30.050 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Compression algorithms supported: 2024-06-13T11:11:30.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-13T11:11:30.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: kZSTD supported: 0 2024-06-13T11:11:30.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: kXpressCompression supported: 0 2024-06-13T11:11:30.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: kLZ4HCCompression supported: 1 2024-06-13T11:11:30.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: kZlibCompression supported: 1 2024-06-13T11:11:30.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: kSnappyCompression supported: 1 2024-06-13T11:11:30.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: kLZ4Compression supported: 1 2024-06-13T11:11:30.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: kBZip2Compression supported: 0 2024-06-13T11:11:30.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-13T11:11:30.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-13T11:11:30.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-06-13T11:11:30.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-13T11:11:30.051 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-13T11:11:30.052 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.merge_operator: 2024-06-13T11:11:30.052 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compaction_filter: None 2024-06-13T11:11:30.052 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compaction_filter_factory: None 2024-06-13T11:11:30.052 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.sst_partitioner_factory: None 2024-06-13T11:11:30.052 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-13T11:11:30.052 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-13T11:11:30.052 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562cdd185c40) 2024-06-13T11:11:30.052 INFO:journalctl@ceph.mon.b.smithi077.stdout: cache_index_and_filter_blocks: 1 2024-06-13T11:11:30.052 INFO:journalctl@ceph.mon.b.smithi077.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-13T11:11:30.052 INFO:journalctl@ceph.mon.b.smithi077.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-13T11:11:30.052 INFO:journalctl@ceph.mon.b.smithi077.stdout: pin_top_level_index_and_filter: 1 2024-06-13T11:11:30.053 INFO:journalctl@ceph.mon.b.smithi077.stdout: index_type: 0 2024-06-13T11:11:30.053 INFO:journalctl@ceph.mon.b.smithi077.stdout: data_block_index_type: 0 2024-06-13T11:11:30.053 INFO:journalctl@ceph.mon.b.smithi077.stdout: index_shortening: 1 2024-06-13T11:11:30.053 INFO:journalctl@ceph.mon.b.smithi077.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-13T11:11:30.053 INFO:journalctl@ceph.mon.b.smithi077.stdout: checksum: 4 2024-06-13T11:11:30.053 INFO:journalctl@ceph.mon.b.smithi077.stdout: no_block_cache: 0 2024-06-13T11:11:30.053 INFO:journalctl@ceph.mon.b.smithi077.stdout: block_cache: 0x562cdd187090 2024-06-13T11:11:30.053 INFO:journalctl@ceph.mon.b.smithi077.stdout: block_cache_name: BinnedLRUCache 2024-06-13T11:11:30.053 INFO:journalctl@ceph.mon.b.smithi077.stdout: block_cache_options: 2024-06-13T11:11:30.053 INFO:journalctl@ceph.mon.b.smithi077.stdout: capacity : 536870912 2024-06-13T11:11:30.053 INFO:journalctl@ceph.mon.b.smithi077.stdout: num_shard_bits : 4 2024-06-13T11:11:30.053 INFO:journalctl@ceph.mon.b.smithi077.stdout: strict_capacity_limit : 0 2024-06-13T11:11:30.054 INFO:journalctl@ceph.mon.b.smithi077.stdout: high_pri_pool_ratio: 0.000 2024-06-13T11:11:30.054 INFO:journalctl@ceph.mon.b.smithi077.stdout: block_cache_compressed: (nil) 2024-06-13T11:11:30.054 INFO:journalctl@ceph.mon.b.smithi077.stdout: persistent_cache: (nil) 2024-06-13T11:11:30.054 INFO:journalctl@ceph.mon.b.smithi077.stdout: block_size: 4096 2024-06-13T11:11:30.054 INFO:journalctl@ceph.mon.b.smithi077.stdout: block_size_deviation: 10 2024-06-13T11:11:30.054 INFO:journalctl@ceph.mon.b.smithi077.stdout: block_restart_interval: 16 2024-06-13T11:11:30.054 INFO:journalctl@ceph.mon.b.smithi077.stdout: index_block_restart_interval: 1 2024-06-13T11:11:30.054 INFO:journalctl@ceph.mon.b.smithi077.stdout: metadata_block_size: 4096 2024-06-13T11:11:30.054 INFO:journalctl@ceph.mon.b.smithi077.stdout: partition_filters: 0 2024-06-13T11:11:30.054 INFO:journalctl@ceph.mon.b.smithi077.stdout: use_delta_encoding: 1 2024-06-13T11:11:30.054 INFO:journalctl@ceph.mon.b.smithi077.stdout: filter_policy: bloomfilter 2024-06-13T11:11:30.054 INFO:journalctl@ceph.mon.b.smithi077.stdout: whole_key_filtering: 1 2024-06-13T11:11:30.054 INFO:journalctl@ceph.mon.b.smithi077.stdout: verify_compression: 0 2024-06-13T11:11:30.055 INFO:journalctl@ceph.mon.b.smithi077.stdout: read_amp_bytes_per_bit: 0 2024-06-13T11:11:30.055 INFO:journalctl@ceph.mon.b.smithi077.stdout: format_version: 5 2024-06-13T11:11:30.055 INFO:journalctl@ceph.mon.b.smithi077.stdout: enable_index_compression: 1 2024-06-13T11:11:30.055 INFO:journalctl@ceph.mon.b.smithi077.stdout: block_align: 0 2024-06-13T11:11:30.055 INFO:journalctl@ceph.mon.b.smithi077.stdout: max_auto_readahead_size: 262144 2024-06-13T11:11:30.055 INFO:journalctl@ceph.mon.b.smithi077.stdout: prepopulate_block_cache: 0 2024-06-13T11:11:30.055 INFO:journalctl@ceph.mon.b.smithi077.stdout: initial_auto_readahead_size: 8192 2024-06-13T11:11:30.055 INFO:journalctl@ceph.mon.b.smithi077.stdout: num_file_reads_for_auto_readahead: 2 2024-06-13T11:11:30.055 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.write_buffer_size: 33554432 2024-06-13T11:11:30.055 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_write_buffer_number: 2 2024-06-13T11:11:30.055 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compression: NoCompression 2024-06-13T11:11:30.055 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.bottommost_compression: Disabled 2024-06-13T11:11:30.056 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.prefix_extractor: nullptr 2024-06-13T11:11:30.056 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-13T11:11:30.056 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.num_levels: 7 2024-06-13T11:11:30.056 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-13T11:11:30.056 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-13T11:11:30.056 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-13T11:11:30.056 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-13T11:11:30.056 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-13T11:11:30.056 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-13T11:11:30.056 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-13T11:11:30.056 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-13T11:11:30.056 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-13T11:11:30.056 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-13T11:11:30.056 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-13T11:11:30.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-13T11:11:30.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-13T11:11:30.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compression_opts.level: 32767 2024-06-13T11:11:30.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compression_opts.strategy: 0 2024-06-13T11:11:30.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-13T11:11:30.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-13T11:11:30.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-13T11:11:30.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-13T11:11:30.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compression_opts.enabled: false 2024-06-13T11:11:30.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-13T11:11:30.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-13T11:11:30.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-13T11:11:30.057 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-13T11:11:30.058 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.target_file_size_base: 67108864 2024-06-13T11:11:30.058 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-13T11:11:30.058 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-13T11:11:30.058 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-13T11:11:30.058 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-13T11:11:30.058 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-13T11:11:30.058 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-13T11:11:30.058 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-13T11:11:30.058 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-13T11:11:30.058 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-13T11:11:30.058 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-13T11:11:30.058 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-13T11:11:30.058 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-13T11:11:30.059 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-13T11:11:30.059 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-13T11:11:30.059 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.arena_block_size: 1048576 2024-06-13T11:11:30.059 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-13T11:11:30.059 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-13T11:11:30.059 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.disable_auto_compactions: 0 2024-06-13T11:11:30.059 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-13T11:11:30.059 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-13T11:11:30.059 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-13T11:11:30.059 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-13T11:11:30.059 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-13T11:11:30.059 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-13T11:11:30.060 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-13T11:11:30.060 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-13T11:11:30.060 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-13T11:11:30.060 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-13T11:11:30.060 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.table_properties_collectors: 2024-06-13T11:11:30.060 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.inplace_update_support: 0 2024-06-13T11:11:30.060 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-13T11:11:30.060 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-13T11:11:30.060 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-13T11:11:30.060 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-13T11:11:30.060 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.bloom_locality: 0 2024-06-13T11:11:30.060 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.max_successive_merges: 0 2024-06-13T11:11:30.060 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-13T11:11:30.060 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.paranoid_file_checks: 0 2024-06-13T11:11:30.061 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.force_consistency_checks: 1 2024-06-13T11:11:30.061 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.report_bg_io_stats: 0 2024-06-13T11:11:30.061 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.ttl: 2592000 2024-06-13T11:11:30.061 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-13T11:11:30.061 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-13T11:11:30.061 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-13T11:11:30.061 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.enable_blob_files: false 2024-06-13T11:11:30.061 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.min_blob_size: 0 2024-06-13T11:11:30.061 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.blob_file_size: 268435456 2024-06-13T11:11:30.061 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-13T11:11:30.061 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-13T11:11:30.061 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-13T11:11:30.061 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-13T11:11:30.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-13T11:11:30.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.blob_file_starting_level: 0 2024-06-13T11:11:30.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-13T11:11:30.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-13T11:11:30.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-06-13T11:11:30.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: dba4c986-a226-49e5-8300-201fb68d863d 2024-06-13T11:11:30.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718277089693938, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-06-13T11:11:30.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-06-13T11:11:30.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718277089694356, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1718277089, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "dba4c986-a226-49e5-8300-201fb68d863d", "db_session_id": "VEE5YJCM9HW3DMZ3EUQQ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-06-13T11:11:30.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718277089694436, "job": 1, "event": "recovery_finished"} 2024-06-13T11:11:30.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-06-13T11:11:30.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-13T11:11:30.062 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562cdd276000 2024-06-13T11:11:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: DB pointer 0x562cdd260000 2024-06-13T11:11:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-13T11:11:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-13T11:11:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout: ** DB Stats ** 2024-06-13T11:11:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-13T11:11:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-13T11:11:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-13T11:11:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-13T11:11:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-13T11:11:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-13T11:11:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-13T11:11:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout: 2024-06-13T11:11:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout: ** Compaction Stats [default] ** 2024-06-13T11:11:30.063 INFO:journalctl@ceph.mon.b.smithi077.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-13T11:11:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-13T11:11:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-13T11:11:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-13T11:11:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-13T11:11:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout: 2024-06-13T11:11:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout: ** Compaction Stats [default] ** 2024-06-13T11:11:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-13T11:11:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-13T11:11:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-13T11:11:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout: 2024-06-13T11:11:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-13T11:11:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout: 2024-06-13T11:11:30.064 INFO:journalctl@ceph.mon.b.smithi077.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-13T11:11:30.065 INFO:journalctl@ceph.mon.b.smithi077.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-13T11:11:30.065 INFO:journalctl@ceph.mon.b.smithi077.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-13T11:11:30.065 INFO:journalctl@ceph.mon.b.smithi077.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-13T11:11:30.065 INFO:journalctl@ceph.mon.b.smithi077.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-13T11:11:30.065 INFO:journalctl@ceph.mon.b.smithi077.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-13T11:11:30.065 INFO:journalctl@ceph.mon.b.smithi077.stdout: Cumulative compaction: 0.00 GB write, 0.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-13T11:11:30.065 INFO:journalctl@ceph.mon.b.smithi077.stdout: Interval compaction: 0.00 GB write, 0.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-13T11:11:30.065 INFO:journalctl@ceph.mon.b.smithi077.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-13T11:11:30.065 INFO:journalctl@ceph.mon.b.smithi077.stdout: Block cache BinnedLRUCache@0x562cdd187090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-06-13T11:11:30.065 INFO:journalctl@ceph.mon.b.smithi077.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-06-13T11:11:30.066 INFO:journalctl@ceph.mon.b.smithi077.stdout: 2024-06-13T11:11:30.066 INFO:journalctl@ceph.mon.b.smithi077.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-13T11:11:30.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-06-13T11:11:30.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: using public_addr v2:172.21.15.77:0/0 -> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-06-13T11:11:30.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: starting mon.b rank -1 at public addrs [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] at bind addrs [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:11:30.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.b@-1(???) e0 preinit fsid 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:11:30.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.b@-1(synchronizing).mds e1 new map 2024-06-13T11:11:30.066 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.b@-1(synchronizing).mds e1 print_map 2024-06-13T11:11:30.066 INFO:journalctl@ceph.mon.b.smithi077.stdout: e1 2024-06-13T11:11:30.066 INFO:journalctl@ceph.mon.b.smithi077.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-13T11:11:30.066 INFO:journalctl@ceph.mon.b.smithi077.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-13T11:11:30.066 INFO:journalctl@ceph.mon.b.smithi077.stdout: legacy client fscid: -1 2024-06-13T11:11:30.067 INFO:journalctl@ceph.mon.b.smithi077.stdout: 2024-06-13T11:11:30.067 INFO:journalctl@ceph.mon.b.smithi077.stdout: No filesystems configured 2024-06-13T11:11:30.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-06-13T11:11:30.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-06-13T11:11:30.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-06-13T11:11:30.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-06-13T11:11:30.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-06-13T11:11:30.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-06-13T11:11:30.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-13T11:11:30.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T11:11:30.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T11:11:30.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T11:11:30.067 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: Deploying cephadm binary to smithi077 2024-06-13T11:11:30.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: Added host smithi077 2024-06-13T11:11:30.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:30.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:11:30.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.068 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi077", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:11:30.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:30.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:30.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: Updating smithi077:/etc/ceph/ceph.conf 2024-06-13T11:11:30.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: Updating smithi077:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:11:30.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:11:30.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: Updating smithi077:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T11:11:30.069 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:11:30.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: Deploying cephadm binary to smithi178 2024-06-13T11:11:30.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: Added host smithi178 2024-06-13T11:11:30.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:30.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.070 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:11:30.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi178", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:11:30.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:30.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:30.071 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: Updating smithi178:/etc/ceph/ceph.conf 2024-06-13T11:11:30.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: Updating smithi178:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:11:30.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:11:30.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: Updating smithi178:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T11:11:30.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1137932341' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-13T11:11:30.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1137932341' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-13T11:11:30.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T11:11:30.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.072 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi077:172.21.15.77=b;smithi178:172.21.15.178=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:11:30.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi077:172.21.15.77=b;smithi178:172.21.15.178=c;count:3 2024-06-13T11:11:30.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:30.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:30.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:30.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T11:11:30.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:30.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: Deploying daemon mon.c on smithi178 2024-06-13T11:11:30.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.073 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:11:30.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.a calling monitor election 2024-06-13T11:11:30.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:30.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:30.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:30.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.c calling monitor election 2024-06-13T11:11:30.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:30.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:30.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:30.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-13T11:11:30.074 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: monmap epoch 2 2024-06-13T11:11:30.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: fsid 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:11:30.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: last_changed 2024-06-13T11:11:20.611340+0000 2024-06-13T11:11:30.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: created 2024-06-13T11:09:03.629613+0000 2024-06-13T11:11:30.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: min_mon_release 19 (squid) 2024-06-13T11:11:30.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: election_strategy: 1 2024-06-13T11:11:30.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T11:11:30.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-13T11:11:30.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: fsmap 2024-06-13T11:11:30.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T11:11:30.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mgrmap e13: x(active, since 60s) 2024-06-13T11:11:30.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: overall HEALTH_OK 2024-06-13T11:11:30.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.075 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:30.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T11:11:30.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:30.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: Deploying daemon mon.b on smithi077 2024-06-13T11:11:30.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='client.? 172.21.15.178:0/3009761774' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-13T11:11:30.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:30.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:30.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 ceph-mon[36410]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-06-13T11:11:30.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 bash[36391]: 6d9175ddbfb3042f56af4c41cb3ad429372c23e9d1804622731380fb1d5e0e07 2024-06-13T11:11:30.076 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:29 smithi077 systemd[1]: Started Ceph mon.b for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:11:30.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:29 smithi002 ceph-mon[32210]: from='client.? 172.21.15.178:0/2739472081' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-13T11:11:30.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:29 smithi178 ceph-mon[36913]: from='client.? 172.21.15.178:0/2739472081' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-13T11:11:30.951 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-13T11:11:30.951 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph mon dump -f json 2024-06-13T11:11:31.186 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:11:35.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:35.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: mon.c calling monitor election 2024-06-13T11:11:35.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:11:35.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: mon.a calling monitor election 2024-06-13T11:11:35.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:35.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:35.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-13T11:11:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: monmap epoch 3 2024-06-13T11:11:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: fsid 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:11:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: last_changed 2024-06-13T11:11:29.718776+0000 2024-06-13T11:11:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: created 2024-06-13T11:09:03.629613+0000 2024-06-13T11:11:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: min_mon_release 19 (squid) 2024-06-13T11:11:35.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: election_strategy: 1 2024-06-13T11:11:35.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T11:11:35.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-13T11:11:35.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: 2: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-06-13T11:11:35.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: fsmap 2024-06-13T11:11:35.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T11:11:35.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: mgrmap e13: x(active, since 69s) 2024-06-13T11:11:35.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: overall HEALTH_OK 2024-06-13T11:11:35.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:35.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:35.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:35.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: mon.c calling monitor election 2024-06-13T11:11:35.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:11:35.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: mon.a calling monitor election 2024-06-13T11:11:35.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:35.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:35.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:35.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:35.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:35.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:35.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:35.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:35.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:35.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-13T11:11:35.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: monmap epoch 3 2024-06-13T11:11:35.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: fsid 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:11:35.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: last_changed 2024-06-13T11:11:29.718776+0000 2024-06-13T11:11:35.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: created 2024-06-13T11:09:03.629613+0000 2024-06-13T11:11:35.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: min_mon_release 19 (squid) 2024-06-13T11:11:35.199 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: election_strategy: 1 2024-06-13T11:11:35.199 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T11:11:35.199 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-13T11:11:35.199 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: 2: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-06-13T11:11:35.199 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: fsmap 2024-06-13T11:11:35.199 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T11:11:35.199 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: mgrmap e13: x(active, since 69s) 2024-06-13T11:11:35.199 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: overall HEALTH_OK 2024-06-13T11:11:35.199 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:35.199 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:35.527 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.527+0000 7f248963d700 1 -- 172.21.15.178:0/1089091537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24841008c0 msgr2=0x7f2470005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:35.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.527+0000 7f248963d700 1 --2- 172.21.15.178:0/1089091537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24841008c0 0x7f2470005610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2474005fa0 tx=0x7f247400ffc0 comp rx=0 tx=0).stop 2024-06-13T11:11:35.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.527+0000 7f248963d700 1 -- 172.21.15.178:0/1089091537 shutdown_connections 2024-06-13T11:11:35.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.527+0000 7f248963d700 1 --2- 172.21.15.178:0/1089091537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24841008c0 0x7f2470005610 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:35.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.527+0000 7f248963d700 1 -- 172.21.15.178:0/1089091537 >> 172.21.15.178:0/1089091537 conn(0x7f2484077310 msgr2=0x7f2484077720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:35.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.527+0000 7f248963d700 1 -- 172.21.15.178:0/1089091537 shutdown_connections 2024-06-13T11:11:35.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.527+0000 7f248963d700 1 -- 172.21.15.178:0/1089091537 wait complete. 2024-06-13T11:11:35.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.528+0000 7f248963d700 1 Processor -- start 2024-06-13T11:11:35.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.528+0000 7f248963d700 1 -- start start 2024-06-13T11:11:35.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.528+0000 7f248963d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24841008c0 0x7f2484199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:35.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.528+0000 7f248963d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f248419a340 0x7f248419e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:35.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f248963d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f248419ec10 0x7f248419f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:35.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f248963d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2484109fd0 con 0x7f24841008c0 2024-06-13T11:11:35.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f248963d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2484109e50 con 0x7f248419ec10 2024-06-13T11:11:35.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f248963d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f248410a150 con 0x7f248419a340 2024-06-13T11:11:35.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f247a7fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f248419a340 0x7f248419e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:35.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f247a7fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f248419a340 0x7f248419e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:39190/0 (socket says 172.21.15.178:39190) 2024-06-13T11:11:35.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f247a7fc700 1 -- 172.21.15.178:0/2986996876 learned_addr learned my addr 172.21.15.178:0/2986996876 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-13T11:11:35.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f247a7fc700 1 -- 172.21.15.178:0/2986996876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f248419a340 msgr2=0x7f248419e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-06-13T11:11:35.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f24837fe700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f248419ec10 0x7f248419f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:35.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f247a7fc700 1 -- 172.21.15.178:0/2986996876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f248419a340 msgr2=0x7f248419e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-13T11:11:35.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f247a7fc700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f248419a340 0x7f248419e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T11:11:35.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f2482ffd700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24841008c0 0x7f2484199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:35.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f247a7fc700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f248419a340 0x7f248419e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:11:35.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f24837fe700 1 -- 172.21.15.178:0/2986996876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f248419ec10 msgr2=0x7f248419f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-06-13T11:11:35.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f24837fe700 1 -- 172.21.15.178:0/2986996876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f248419ec10 msgr2=0x7f248419f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-13T11:11:35.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f24837fe700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f248419ec10 0x7f248419f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T11:11:35.531 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f24837fe700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f248419ec10 0x7f248419f0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:11:35.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f2482ffd700 1 -- 172.21.15.178:0/2986996876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f248419a340 msgr2=0x7f248419e6d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:11:35.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f2482ffd700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f248419a340 0x7f248419e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:35.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f2482ffd700 1 -- 172.21.15.178:0/2986996876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f248419ec10 msgr2=0x7f248419f0c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:11:35.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f2482ffd700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f248419ec10 0x7f248419f0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:35.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.529+0000 7f2482ffd700 1 -- 172.21.15.178:0/2986996876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24841a6980 con 0x7f24841008c0 2024-06-13T11:11:35.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.530+0000 7f2482ffd700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24841008c0 0x7f2484199e00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f24740137f0 tx=0x7f2474013d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:35.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.530+0000 7f2480ff9700 1 -- 172.21.15.178:0/2986996876 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2474004240 con 0x7f24841008c0 2024-06-13T11:11:35.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.530+0000 7f248963d700 1 -- 172.21.15.178:0/2986996876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24841a6b50 con 0x7f24841008c0 2024-06-13T11:11:35.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.530+0000 7f2480ff9700 1 -- 172.21.15.178:0/2986996876 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2474004c70 con 0x7f24841008c0 2024-06-13T11:11:35.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.530+0000 7f2480ff9700 1 -- 172.21.15.178:0/2986996876 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2474003e60 con 0x7f24841008c0 2024-06-13T11:11:35.532 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.530+0000 7f248963d700 1 -- 172.21.15.178:0/2986996876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24841a70e0 con 0x7f24841008c0 2024-06-13T11:11:35.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.531+0000 7f2480ff9700 1 -- 172.21.15.178:0/2986996876 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f2474004790 con 0x7f24841008c0 2024-06-13T11:11:35.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.531+0000 7f2480ff9700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2464039580 0x7f246403ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:35.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.531+0000 7f248963d700 1 -- 172.21.15.178:0/2986996876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2484063af0 con 0x7f24841008c0 2024-06-13T11:11:35.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.531+0000 7f2480ff9700 1 -- 172.21.15.178:0/2986996876 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f247404e370 con 0x7f24841008c0 2024-06-13T11:11:35.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.532+0000 7f247a7fc700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2464039580 0x7f246403ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:35.534 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.533+0000 7f247a7fc700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2464039580 0x7f246403ba40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f246c009180 tx=0x7f246c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:35.547 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.547+0000 7f2480ff9700 1 -- 172.21.15.178:0/2986996876 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2474010e80 con 0x7f24841008c0 2024-06-13T11:11:35.877 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.878+0000 7f248963d700 1 -- 172.21.15.178:0/2986996876 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f248402dca0 con 0x7f24841008c0 2024-06-13T11:11:35.878 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.879+0000 7f2480ff9700 1 -- 172.21.15.178:0/2986996876 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1275 (secure 0 0 0) 0x7f2474004a80 con 0x7f24841008c0 2024-06-13T11:11:35.878 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-13T11:11:35.879 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":3,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","modified":"2024-06-13T11:11:29.718776Z","created":"2024-06-13T11:09:03.629613Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-13T11:11:35.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.881+0000 7f248963d700 1 -- 172.21.15.178:0/2986996876 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2464039580 msgr2=0x7f246403ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:35.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.881+0000 7f248963d700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2464039580 0x7f246403ba40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f246c009180 tx=0x7f246c008040 comp rx=0 tx=0).stop 2024-06-13T11:11:35.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.881+0000 7f248963d700 1 -- 172.21.15.178:0/2986996876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24841008c0 msgr2=0x7f2484199e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:35.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.881+0000 7f248963d700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24841008c0 0x7f2484199e00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f24740137f0 tx=0x7f2474013d80 comp rx=0 tx=0).stop 2024-06-13T11:11:35.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.881+0000 7f248963d700 1 -- 172.21.15.178:0/2986996876 shutdown_connections 2024-06-13T11:11:35.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.881+0000 7f248963d700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2464039580 0x7f246403ba40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:35.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.881+0000 7f248963d700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24841008c0 0x7f2484199e00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:35.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.881+0000 7f248963d700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f248419ec10 0x7f248419f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:35.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.881+0000 7f248963d700 1 --2- 172.21.15.178:0/2986996876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f248419a340 0x7f248419e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:35.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.881+0000 7f248963d700 1 -- 172.21.15.178:0/2986996876 >> 172.21.15.178:0/2986996876 conn(0x7f2484077310 msgr2=0x7f2484101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:35.881 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.881+0000 7f248963d700 1 -- 172.21.15.178:0/2986996876 shutdown_connections 2024-06-13T11:11:35.882 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:35.881+0000 7f248963d700 1 -- 172.21.15.178:0/2986996876 wait complete. 2024-06-13T11:11:35.882 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 3 2024-06-13T11:11:36.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:35 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:36.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:35 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:36.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:35 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:36.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:35 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:36.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:35 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:36.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:35 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:36.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:35 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:36.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:35 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:36.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:35 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:36.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:35 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:37.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: from='client.? 172.21.15.178:0/2739472081' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-13T11:11:37.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:37.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: mon.c calling monitor election 2024-06-13T11:11:37.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:11:37.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: mon.a calling monitor election 2024-06-13T11:11:37.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:37.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:11:37.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:37.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:37.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:37.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:37.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:37.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:37.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:37.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-13T11:11:37.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: monmap epoch 3 2024-06-13T11:11:37.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: fsid 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:11:37.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: last_changed 2024-06-13T11:11:29.718776+0000 2024-06-13T11:11:37.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: created 2024-06-13T11:09:03.629613+0000 2024-06-13T11:11:37.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: min_mon_release 19 (squid) 2024-06-13T11:11:37.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: election_strategy: 1 2024-06-13T11:11:37.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T11:11:37.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-13T11:11:37.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: 2: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-06-13T11:11:37.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: fsmap 2024-06-13T11:11:37.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T11:11:37.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: mgrmap e13: x(active, since 69s) 2024-06-13T11:11:37.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: overall HEALTH_OK 2024-06-13T11:11:37.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:37.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:37.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:37.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:37.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:37.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:37.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:37.044 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-06-13T11:11:37.044 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph config generate-minimal-conf 2024-06-13T11:11:37.475 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:11:37.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: mon.b calling monitor election 2024-06-13T11:11:37.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: Updating smithi002:/etc/ceph/ceph.conf 2024-06-13T11:11:37.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: Updating smithi077:/etc/ceph/ceph.conf 2024-06-13T11:11:37.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: Updating smithi178:/etc/ceph/ceph.conf 2024-06-13T11:11:37.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: mon.b calling monitor election 2024-06-13T11:11:37.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: mon.c calling monitor election 2024-06-13T11:11:37.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: mon.a calling monitor election 2024-06-13T11:11:37.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-13T11:11:37.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: monmap epoch 3 2024-06-13T11:11:37.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: fsid 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:11:37.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: last_changed 2024-06-13T11:11:29.718776+0000 2024-06-13T11:11:37.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: created 2024-06-13T11:09:03.629613+0000 2024-06-13T11:11:37.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: min_mon_release 19 (squid) 2024-06-13T11:11:37.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: election_strategy: 1 2024-06-13T11:11:37.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T11:11:37.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-13T11:11:37.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: 2: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-06-13T11:11:37.858 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: fsmap 2024-06-13T11:11:37.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T11:11:37.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: mgrmap e13: x(active, since 71s) 2024-06-13T11:11:37.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: overall HEALTH_OK 2024-06-13T11:11:37.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: Updating smithi178:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:11:37.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:37.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:37.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:37.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:37 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:37.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: mon.b calling monitor election 2024-06-13T11:11:37.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: Updating smithi002:/etc/ceph/ceph.conf 2024-06-13T11:11:37.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: Updating smithi077:/etc/ceph/ceph.conf 2024-06-13T11:11:37.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: Updating smithi178:/etc/ceph/ceph.conf 2024-06-13T11:11:37.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: mon.b calling monitor election 2024-06-13T11:11:37.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: mon.c calling monitor election 2024-06-13T11:11:37.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: mon.a calling monitor election 2024-06-13T11:11:37.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-13T11:11:37.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: monmap epoch 3 2024-06-13T11:11:37.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: fsid 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:11:37.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: last_changed 2024-06-13T11:11:29.718776+0000 2024-06-13T11:11:37.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: created 2024-06-13T11:09:03.629613+0000 2024-06-13T11:11:37.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: min_mon_release 19 (squid) 2024-06-13T11:11:37.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: election_strategy: 1 2024-06-13T11:11:37.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T11:11:37.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-13T11:11:37.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: 2: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-06-13T11:11:37.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: fsmap 2024-06-13T11:11:37.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T11:11:37.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: mgrmap e13: x(active, since 71s) 2024-06-13T11:11:37.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: overall HEALTH_OK 2024-06-13T11:11:37.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: Updating smithi178:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:11:37.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:37.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:37.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:37.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:37 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: mon.b calling monitor election 2024-06-13T11:11:38.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: Updating smithi002:/etc/ceph/ceph.conf 2024-06-13T11:11:38.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: Updating smithi077:/etc/ceph/ceph.conf 2024-06-13T11:11:38.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: Updating smithi178:/etc/ceph/ceph.conf 2024-06-13T11:11:38.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: mon.b calling monitor election 2024-06-13T11:11:38.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: mon.c calling monitor election 2024-06-13T11:11:38.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: mon.a calling monitor election 2024-06-13T11:11:38.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-13T11:11:38.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: monmap epoch 3 2024-06-13T11:11:38.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: fsid 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:11:38.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: last_changed 2024-06-13T11:11:29.718776+0000 2024-06-13T11:11:38.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: created 2024-06-13T11:09:03.629613+0000 2024-06-13T11:11:38.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: min_mon_release 19 (squid) 2024-06-13T11:11:38.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: election_strategy: 1 2024-06-13T11:11:38.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T11:11:38.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-13T11:11:38.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: 2: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-06-13T11:11:38.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: fsmap 2024-06-13T11:11:38.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T11:11:38.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: mgrmap e13: x(active, since 71s) 2024-06-13T11:11:38.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: overall HEALTH_OK 2024-06-13T11:11:38.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: Updating smithi178:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:11:38.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:37 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.817 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:38 smithi002 ceph-mon[32210]: Updating smithi077:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:11:38.817 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:38 smithi002 ceph-mon[32210]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:38.817 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:38 smithi002 ceph-mon[32210]: Updating smithi002:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:11:38.817 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:38.817 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.817 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.817 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.817 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.817 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.817 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.818 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.818 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T11:11:38.818 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T11:11:38.818 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:38.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:38 smithi178 ceph-mon[36913]: Updating smithi077:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:11:38.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:38 smithi178 ceph-mon[36913]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:38.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:38 smithi178 ceph-mon[36913]: Updating smithi002:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:11:38.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:38.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:38.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T11:11:38.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T11:11:38.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:39.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:38 smithi077 ceph-mon[36410]: Updating smithi077:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:11:39.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:38 smithi077 ceph-mon[36410]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:39.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:38 smithi077 ceph-mon[36410]: Updating smithi002:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:11:39.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:11:39.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:39.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:39.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:39.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:39.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:39.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:39.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:39.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T11:11:39.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T11:11:39.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:39.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.644+0000 7feacf000700 1 -- 172.21.15.2:0/3692951687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feac8104310 msgr2=0x7feac81046f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:39.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.644+0000 7feacf000700 1 --2- 172.21.15.2:0/3692951687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feac8104310 0x7feac81046f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feab8009910 tx=0x7feab8009c20 comp rx=0 tx=0).stop 2024-06-13T11:11:39.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.644+0000 7feacf000700 1 -- 172.21.15.2:0/3692951687 shutdown_connections 2024-06-13T11:11:39.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.644+0000 7feacf000700 1 --2- 172.21.15.2:0/3692951687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feac8104310 0x7feac81046f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:39.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.644+0000 7feacf000700 1 -- 172.21.15.2:0/3692951687 >> 172.21.15.2:0/3692951687 conn(0x7feac80ffba0 msgr2=0x7feac8101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:39.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.644+0000 7feacf000700 1 -- 172.21.15.2:0/3692951687 shutdown_connections 2024-06-13T11:11:39.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:39 smithi002 ceph-mon[32210]: Reconfiguring mon.a (unknown last config time)... 2024-06-13T11:11:39.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:39 smithi002 ceph-mon[32210]: Reconfiguring daemon mon.a on smithi002 2024-06-13T11:11:39.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.645+0000 7feacf000700 1 -- 172.21.15.2:0/3692951687 wait complete. 2024-06-13T11:11:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.646+0000 7feacf000700 1 Processor -- start 2024-06-13T11:11:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.646+0000 7feacf000700 1 -- start start 2024-06-13T11:11:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.646+0000 7feacf000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feac8104310 0x7feac8199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.646+0000 7feacf000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feac819a410 0x7feac819e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.646+0000 7feacf000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feac819ece0 0x7feac819f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.646+0000 7feacf000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feac810e6e0 con 0x7feac819a410 2024-06-13T11:11:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.646+0000 7feacf000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7feac810e560 con 0x7feac8104310 2024-06-13T11:11:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.646+0000 7feacf000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7feac810e860 con 0x7feac819ece0 2024-06-13T11:11:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.647+0000 7feabf400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feac819a410 0x7feac819e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.647+0000 7feabf400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feac819a410 0x7feac819e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35824/0 (socket says 172.21.15.2:35824) 2024-06-13T11:11:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.647+0000 7feabf400700 1 -- 172.21.15.2:0/4235367467 learned_addr learned my addr 172.21.15.2:0/4235367467 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:11:39.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.647+0000 7feac7e00700 1 --2- 172.21.15.2:0/4235367467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feac8104310 0x7feac8199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:39.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.647+0000 7feacd000700 1 --2- 172.21.15.2:0/4235367467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feac819ece0 0x7feac819f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:39.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.647+0000 7feac7e00700 1 -- 172.21.15.2:0/4235367467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feac819ece0 msgr2=0x7feac819f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:39.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.647+0000 7feac7e00700 1 --2- 172.21.15.2:0/4235367467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feac819ece0 0x7feac819f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:39.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.647+0000 7feac7e00700 1 -- 172.21.15.2:0/4235367467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feac819a410 msgr2=0x7feac819e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:39.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.647+0000 7feac7e00700 1 --2- 172.21.15.2:0/4235367467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feac819a410 0x7feac819e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:39.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.647+0000 7feac7e00700 1 -- 172.21.15.2:0/4235367467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac81a6a50 con 0x7feac8104310 2024-06-13T11:11:39.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.648+0000 7feac7e00700 1 --2- 172.21.15.2:0/4235367467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feac8104310 0x7feac8199ed0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7feab8005950 tx=0x7feab8004f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:39.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.648+0000 7feac5600700 1 -- 172.21.15.2:0/4235367467 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8026070 con 0x7feac8104310 2024-06-13T11:11:39.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.648+0000 7feac5600700 1 -- 172.21.15.2:0/4235367467 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feab800b6f0 con 0x7feac8104310 2024-06-13T11:11:39.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.648+0000 7feac5600700 1 -- 172.21.15.2:0/4235367467 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8009e60 con 0x7feac8104310 2024-06-13T11:11:39.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.648+0000 7feacf000700 1 -- 172.21.15.2:0/4235367467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac81a6c80 con 0x7feac8104310 2024-06-13T11:11:39.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.648+0000 7feacf000700 1 -- 172.21.15.2:0/4235367467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac81a71c0 con 0x7feac8104310 2024-06-13T11:11:39.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.649+0000 7feac5600700 1 -- 172.21.15.2:0/4235367467 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7feab8029070 con 0x7feac8104310 2024-06-13T11:11:39.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.649+0000 7feacf000700 1 -- 172.21.15.2:0/4235367467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feac8063af0 con 0x7feac8104310 2024-06-13T11:11:39.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.650+0000 7feac5600700 1 --2- 172.21.15.2:0/4235367467 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7feaac039580 0x7feaac03ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:39.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.650+0000 7feac5600700 1 -- 172.21.15.2:0/4235367467 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7feab804cd60 con 0x7feac8104310 2024-06-13T11:11:39.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.650+0000 7feabf400700 1 --2- 172.21.15.2:0/4235367467 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7feaac039580 0x7feaac03ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:39.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.651+0000 7feabf400700 1 --2- 172.21.15.2:0/4235367467 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7feaac039580 0x7feaac03ba40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feab000e330 tx=0x7feab000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:39.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.655+0000 7feac5600700 1 -- 172.21.15.2:0/4235367467 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7feab8052020 con 0x7feac8104310 2024-06-13T11:11:39.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.902+0000 7feacf000700 1 -- 172.21.15.2:0/4235367467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7feac81a7390 con 0x7feac8104310 2024-06-13T11:11:39.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.903+0000 7feac5600700 1 -- 172.21.15.2:0/4235367467 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+271 (secure 0 0 0) 0x7feab8030020 con 0x7feac8104310 2024-06-13T11:11:39.902 INFO:teuthology.orchestra.run.smithi002.stdout:# minimal ceph.conf for 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:11:39.902 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-06-13T11:11:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:11:39.903 INFO:teuthology.orchestra.run.smithi002.stdout: mon_host = [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-06-13T11:11:39.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.906+0000 7feacf000700 1 -- 172.21.15.2:0/4235367467 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7feaac039580 msgr2=0x7feaac03ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:39.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.906+0000 7feacf000700 1 --2- 172.21.15.2:0/4235367467 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7feaac039580 0x7feaac03ba40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feab000e330 tx=0x7feab000b040 comp rx=0 tx=0).stop 2024-06-13T11:11:39.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.906+0000 7feacf000700 1 -- 172.21.15.2:0/4235367467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feac8104310 msgr2=0x7feac8199ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:39.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.906+0000 7feacf000700 1 --2- 172.21.15.2:0/4235367467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feac8104310 0x7feac8199ed0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7feab8005950 tx=0x7feab8004f80 comp rx=0 tx=0).stop 2024-06-13T11:11:39.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.906+0000 7feacf000700 1 -- 172.21.15.2:0/4235367467 shutdown_connections 2024-06-13T11:11:39.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.906+0000 7feacf000700 1 --2- 172.21.15.2:0/4235367467 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7feaac039580 0x7feaac03ba40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:39.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.906+0000 7feacf000700 1 --2- 172.21.15.2:0/4235367467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feac819ece0 0x7feac819f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:39.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.906+0000 7feacf000700 1 --2- 172.21.15.2:0/4235367467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feac8104310 0x7feac8199ed0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:39.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.906+0000 7feacf000700 1 --2- 172.21.15.2:0/4235367467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feac819a410 0x7feac819e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:39.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.906+0000 7feacf000700 1 -- 172.21.15.2:0/4235367467 >> 172.21.15.2:0/4235367467 conn(0x7feac80ffba0 msgr2=0x7feac8105ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:39.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.906+0000 7feacf000700 1 -- 172.21.15.2:0/4235367467 shutdown_connections 2024-06-13T11:11:39.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:39.906+0000 7feacf000700 1 -- 172.21.15.2:0/4235367467 wait complete. 2024-06-13T11:11:39.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:39 smithi178 ceph-mon[36913]: Reconfiguring mon.a (unknown last config time)... 2024-06-13T11:11:39.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:39 smithi178 ceph-mon[36913]: Reconfiguring daemon mon.a on smithi002 2024-06-13T11:11:40.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:39 smithi077 ceph-mon[36410]: Reconfiguring mon.a (unknown last config time)... 2024-06-13T11:11:40.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:39 smithi077 ceph-mon[36410]: Reconfiguring daemon mon.a on smithi002 2024-06-13T11:11:40.696 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:40 smithi002 ceph-mon[32210]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:40.697 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:40 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/4235367467' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:40.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:40 smithi178 ceph-mon[36913]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:40.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:40 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/4235367467' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:41.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:40 smithi077 ceph-mon[36410]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:41.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:40 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/4235367467' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:41.245 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-06-13T11:11:41.347 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:11:41.348 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.conf 2024-06-13T11:11:41.439 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:11:41.439 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:11:41.555 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-06-13T11:11:41.555 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.conf 2024-06-13T11:11:41.581 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-06-13T11:11:41.581 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:11:41.646 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-13T11:11:41.646 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.conf 2024-06-13T11:11:41.677 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-13T11:11:41.677 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:11:41.745 INFO:tasks.cephadm:Adding mgr.x on smithi002 2024-06-13T11:11:41.745 INFO:tasks.cephadm:Adding mgr.y on smithi077 2024-06-13T11:11:41.745 INFO:tasks.cephadm:Adding mgr.z on smithi178 2024-06-13T11:11:41.745 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch apply mgr '3;smithi002=x;smithi077=y;smithi178=z' 2024-06-13T11:11:42.018 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:11:42.243 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:42.243 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:42.243 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:41 smithi178 ceph-mon[36913]: Reconfiguring mon.b (monmap changed)... 2024-06-13T11:11:42.243 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T11:11:42.243 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T11:11:42.244 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:42.244 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:41 smithi178 ceph-mon[36913]: Reconfiguring daemon mon.b on smithi077 2024-06-13T11:11:42.244 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:41 smithi178 ceph-mon[36913]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:41 smithi077 ceph-mon[36410]: Reconfiguring mon.b (monmap changed)... 2024-06-13T11:11:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T11:11:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T11:11:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:41 smithi077 ceph-mon[36410]: Reconfiguring daemon mon.b on smithi077 2024-06-13T11:11:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:41 smithi077 ceph-mon[36410]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:42.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:42.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:42.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:41 smithi002 ceph-mon[32210]: Reconfiguring mon.b (monmap changed)... 2024-06-13T11:11:42.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T11:11:42.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T11:11:42.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:42.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:41 smithi002 ceph-mon[32210]: Reconfiguring daemon mon.b on smithi077 2024-06-13T11:11:42.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:41 smithi002 ceph-mon[32210]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:43.637 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.632+0000 7f73ed5f6700 1 -- 172.21.15.178:0/2844473263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e8102030 msgr2=0x7f73e8102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:43.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.632+0000 7f73ed5f6700 1 --2- 172.21.15.178:0/2844473263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e8102030 0x7f73e8102450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009910 tx=0x7f73d8009c20 comp rx=0 tx=0).stop 2024-06-13T11:11:43.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.632+0000 7f73ed5f6700 1 -- 172.21.15.178:0/2844473263 shutdown_connections 2024-06-13T11:11:43.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.632+0000 7f73ed5f6700 1 --2- 172.21.15.178:0/2844473263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e8102030 0x7f73e8102450 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:43.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.632+0000 7f73ed5f6700 1 -- 172.21.15.178:0/2844473263 >> 172.21.15.178:0/2844473263 conn(0x7f73e80fd5d0 msgr2=0x7f73e80ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:43.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.632+0000 7f73ed5f6700 1 -- 172.21.15.178:0/2844473263 shutdown_connections 2024-06-13T11:11:43.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.632+0000 7f73ed5f6700 1 -- 172.21.15.178:0/2844473263 wait complete. 2024-06-13T11:11:43.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.632+0000 7f73ed5f6700 1 Processor -- start 2024-06-13T11:11:43.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.632+0000 7f73ed5f6700 1 -- start start 2024-06-13T11:11:43.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.632+0000 7f73ed5f6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e8197a30 0x7f73e8197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:43.638 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.632+0000 7f73ed5f6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e8198390 0x7f73e819d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:43.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73ed5f6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73e819d560 0x7f73e819f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:43.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73ed5f6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f73e8108070 con 0x7f73e8198390 2024-06-13T11:11:43.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73ed5f6700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f73e8107ef0 con 0x7f73e819d560 2024-06-13T11:11:43.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73ed5f6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f73e81081f0 con 0x7f73e8197a30 2024-06-13T11:11:43.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73e6ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e8197a30 0x7f73e8197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:43.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73e6ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e8197a30 0x7f73e8197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:39194/0 (socket says 172.21.15.178:39194) 2024-06-13T11:11:43.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73e6ffd700 1 -- 172.21.15.178:0/2212321882 learned_addr learned my addr 172.21.15.178:0/2212321882 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-13T11:11:43.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73e6ffd700 1 -- 172.21.15.178:0/2212321882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73e819d560 msgr2=0x7f73e819f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:43.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73e6ffd700 1 --2- 172.21.15.178:0/2212321882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73e819d560 0x7f73e819f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:43.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73e6ffd700 1 -- 172.21.15.178:0/2212321882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e8198390 msgr2=0x7f73e819d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:43.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73e6ffd700 1 --2- 172.21.15.178:0/2212321882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e8198390 0x7f73e819d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:43.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73e6ffd700 1 -- 172.21.15.178:0/2212321882 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e81a0280 con 0x7f73e8197a30 2024-06-13T11:11:43.639 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73e6ffd700 1 --2- 172.21.15.178:0/2212321882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e8197a30 0x7f73e8197e50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f73d800b5c0 tx=0x7f73d8005010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:43.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73cffff700 1 -- 172.21.15.178:0/2212321882 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d8026070 con 0x7f73e8197a30 2024-06-13T11:11:43.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73cffff700 1 -- 172.21.15.178:0/2212321882 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73d8005da0 con 0x7f73e8197a30 2024-06-13T11:11:43.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73ed5f6700 1 -- 172.21.15.178:0/2212321882 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73e81a0510 con 0x7f73e8197a30 2024-06-13T11:11:43.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73cffff700 1 -- 172.21.15.178:0/2212321882 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d800fe60 con 0x7f73e8197a30 2024-06-13T11:11:43.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.633+0000 7f73ed5f6700 1 -- 172.21.15.178:0/2212321882 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73e81a0a20 con 0x7f73e8197a30 2024-06-13T11:11:43.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.634+0000 7f73cffff700 1 -- 172.21.15.178:0/2212321882 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f73d8029070 con 0x7f73e8197a30 2024-06-13T11:11:43.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.634+0000 7f73ed5f6700 1 -- 172.21.15.178:0/2212321882 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73e8063af0 con 0x7f73e8197a30 2024-06-13T11:11:43.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.634+0000 7f73cffff700 1 --2- 172.21.15.178:0/2212321882 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f73d0039580 0x7f73d003ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:43.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.634+0000 7f73cffff700 1 -- 172.21.15.178:0/2212321882 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f73d804d090 con 0x7f73e8197a30 2024-06-13T11:11:43.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.635+0000 7f73e67fc700 1 --2- 172.21.15.178:0/2212321882 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f73d0039580 0x7f73d003ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:43.640 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.636+0000 7f73e67fc700 1 --2- 172.21.15.178:0/2212321882 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f73d0039580 0x7f73d003ba40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0098e0 tx=0x7f73dc006dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:43.641 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.640+0000 7f73cffff700 1 -- 172.21.15.178:0/2212321882 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f73d8013070 con 0x7f73e8197a30 2024-06-13T11:11:43.857 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.857+0000 7f73ed5f6700 1 -- 172.21.15.178:0/2212321882 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi077=y;smithi178=z", "target": ["mon-mgr", ""]}) -- 0x7f73e8062960 con 0x7f73d0039580 2024-06-13T11:11:43.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:43 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:43.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:43 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:43.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:43 smithi178 ceph-mon[36913]: Reconfiguring mon.c (monmap changed)... 2024-06-13T11:11:43.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:43 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T11:11:43.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:43 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T11:11:43.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:43 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:43.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:43 smithi178 ceph-mon[36913]: Reconfiguring daemon mon.c on smithi178 2024-06-13T11:11:43.871 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.871+0000 7f73cffff700 1 -- 172.21.15.178:0/2212321882 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f73e8062960 con 0x7f73d0039580 2024-06-13T11:11:43.871 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled mgr update... 2024-06-13T11:11:43.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.874+0000 7f73ed5f6700 1 -- 172.21.15.178:0/2212321882 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f73d0039580 msgr2=0x7f73d003ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:43.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.874+0000 7f73ed5f6700 1 --2- 172.21.15.178:0/2212321882 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f73d0039580 0x7f73d003ba40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0098e0 tx=0x7f73dc006dd0 comp rx=0 tx=0).stop 2024-06-13T11:11:43.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.874+0000 7f73ed5f6700 1 -- 172.21.15.178:0/2212321882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e8197a30 msgr2=0x7f73e8197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:43.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.874+0000 7f73ed5f6700 1 --2- 172.21.15.178:0/2212321882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e8197a30 0x7f73e8197e50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f73d800b5c0 tx=0x7f73d8005010 comp rx=0 tx=0).stop 2024-06-13T11:11:43.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.874+0000 7f73ed5f6700 1 -- 172.21.15.178:0/2212321882 shutdown_connections 2024-06-13T11:11:43.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.874+0000 7f73ed5f6700 1 --2- 172.21.15.178:0/2212321882 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f73d0039580 0x7f73d003ba40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:43.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.874+0000 7f73ed5f6700 1 --2- 172.21.15.178:0/2212321882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73e819d560 0x7f73e819f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:43.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.874+0000 7f73ed5f6700 1 --2- 172.21.15.178:0/2212321882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e8197a30 0x7f73e8197e50 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:43.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.874+0000 7f73ed5f6700 1 --2- 172.21.15.178:0/2212321882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e8198390 0x7f73e819d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:43.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.874+0000 7f73ed5f6700 1 -- 172.21.15.178:0/2212321882 >> 172.21.15.178:0/2212321882 conn(0x7f73e80fd5d0 msgr2=0x7f73e80fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:43.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.874+0000 7f73ed5f6700 1 -- 172.21.15.178:0/2212321882 shutdown_connections 2024-06-13T11:11:43.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:11:43.874+0000 7f73ed5f6700 1 -- 172.21.15.178:0/2212321882 wait complete. 2024-06-13T11:11:43.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:43 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:43.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:43 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:43.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:43 smithi002 ceph-mon[32210]: Reconfiguring mon.c (monmap changed)... 2024-06-13T11:11:43.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:43 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T11:11:43.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:43 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T11:11:43.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:43 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:43.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:43 smithi002 ceph-mon[32210]: Reconfiguring daemon mon.c on smithi178 2024-06-13T11:11:44.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:43 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:44.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:43 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:44.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:43 smithi077 ceph-mon[36410]: Reconfiguring mon.c (monmap changed)... 2024-06-13T11:11:44.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:43 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T11:11:44.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:43 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T11:11:44.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:43 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:44.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:43 smithi077 ceph-mon[36410]: Reconfiguring daemon mon.c on smithi178 2024-06-13T11:11:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:44 smithi002 ceph-mon[32210]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:44 smithi002 ceph-mon[32210]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi077=y;smithi178=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:11:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:44 smithi002 ceph-mon[32210]: Saving service mgr spec with placement smithi002=x;smithi077=y;smithi178=z;count:3 2024-06-13T11:11:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T11:11:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-13T11:11:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T11:11:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:45.147 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:44 smithi178 ceph-mon[36913]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:45.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:44 smithi178 ceph-mon[36913]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi077=y;smithi178=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:11:45.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:44 smithi178 ceph-mon[36913]: Saving service mgr spec with placement smithi002=x;smithi077=y;smithi178=z;count:3 2024-06-13T11:11:45.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:45.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:45.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:45.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:45.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:45.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:45.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:45.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T11:11:45.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-13T11:11:45.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T11:11:45.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:45.199 DEBUG:teuthology.orchestra.run.smithi077:mgr.y> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mgr.y.service 2024-06-13T11:11:45.202 DEBUG:teuthology.orchestra.run.smithi178:mgr.z> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mgr.z.service 2024-06-13T11:11:45.204 INFO:tasks.cephadm:Deploying OSDs... 2024-06-13T11:11:45.204 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:11:45.204 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-06-13T11:11:45.225 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:44 smithi077 ceph-mon[36410]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:45.225 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:44 smithi077 ceph-mon[36410]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi077=y;smithi178=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:11:45.225 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:44 smithi077 ceph-mon[36410]: Saving service mgr spec with placement smithi002=x;smithi077=y;smithi178=z;count:3 2024-06-13T11:11:45.225 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:45.225 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:45.225 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:45.225 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:45.226 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:45.226 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:45.226 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:45.226 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T11:11:45.226 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-13T11:11:45.226 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T11:11:45.226 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:45.265 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-13T11:11:45.266 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-06-13T11:11:45.323 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-13T11:11:45.323 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:11:45.323 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-06-13T11:11:45.323 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:11:45.323 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:11:45.323 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-06-13 11:10:40.769048133 +0000 2024-06-13T11:11:45.323 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-06-13 11:04:47.064183531 +0000 2024-06-13T11:11:45.323 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-06-13 11:04:47.064183531 +0000 2024-06-13T11:11:45.323 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-06-13 11:04:47.064183531 +0000 2024-06-13T11:11:45.323 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-13T11:11:45.409 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-06-13T11:11:45.409 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-06-13T11:11:45.409 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000276943 s, 1.8 MB/s 2024-06-13T11:11:45.413 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-13T11:11:45.473 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-06-13T11:11:45.531 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-13T11:11:45.531 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:11:45.531 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-06-13T11:11:45.531 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:11:45.531 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:11:45.531 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-06-13 11:10:40.857046193 +0000 2024-06-13T11:11:45.531 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-06-13 11:04:47.658169987 +0000 2024-06-13T11:11:45.531 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-06-13 11:04:47.658169987 +0000 2024-06-13T11:11:45.531 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-06-13 11:04:47.658169987 +0000 2024-06-13T11:11:45.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-13T11:11:45.615 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-06-13T11:11:45.616 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-06-13T11:11:45.616 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000283275 s, 1.8 MB/s 2024-06-13T11:11:45.620 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-13T11:11:45.681 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-06-13T11:11:45.738 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-13T11:11:45.738 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:11:45.738 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-06-13T11:11:45.738 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:11:45.738 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:11:45.738 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-06-13 11:10:40.935044473 +0000 2024-06-13T11:11:45.738 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-06-13 11:04:48.250156489 +0000 2024-06-13T11:11:45.738 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-06-13 11:04:48.250156489 +0000 2024-06-13T11:11:45.738 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-06-13 11:04:48.250156489 +0000 2024-06-13T11:11:45.739 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-13T11:11:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-06-13T11:11:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-06-13T11:11:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000284568 s, 1.8 MB/s 2024-06-13T11:11:45.825 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-13T11:11:45.885 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-06-13T11:11:45.939 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-13T11:11:45.939 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:11:45.939 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-06-13T11:11:45.939 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:11:45.939 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:11:45.939 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-06-13 11:10:41.019042620 +0000 2024-06-13T11:11:45.939 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-06-13 11:04:48.840143037 +0000 2024-06-13T11:11:45.939 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-06-13 11:04:48.840143037 +0000 2024-06-13T11:11:45.939 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-06-13 11:04:48.840143037 +0000 2024-06-13T11:11:45.940 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-13T11:11:46.022 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-06-13T11:11:46.023 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-06-13T11:11:46.023 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000278868 s, 1.8 MB/s 2024-06-13T11:11:46.026 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-13T11:11:46.088 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-06-13T11:11:46.088 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2024-06-13T11:11:46.107 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-13T11:11:46.107 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2024-06-13T11:11:46.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:45 smithi178 ceph-mon[36913]: Deploying daemon mgr.z on smithi178 2024-06-13T11:11:46.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:45 smithi002 ceph-mon[32210]: Deploying daemon mgr.z on smithi178 2024-06-13T11:11:46.165 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-13T11:11:46.165 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:11:46.165 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-06-13T11:11:46.165 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:11:46.166 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:11:46.166 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-06-13 11:11:29.174447727 +0000 2024-06-13T11:11:46.166 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-06-13 11:03:12.171009138 +0000 2024-06-13T11:11:46.166 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-06-13 11:03:12.171009138 +0000 2024-06-13T11:11:46.166 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-06-13 11:03:12.171009138 +0000 2024-06-13T11:11:46.166 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-13T11:11:46.228 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:45 smithi077 ceph-mon[36410]: Deploying daemon mgr.z on smithi178 2024-06-13T11:11:46.231 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-06-13T11:11:46.231 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-06-13T11:11:46.231 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000236867 s, 2.2 MB/s 2024-06-13T11:11:46.233 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-13T11:11:46.297 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2024-06-13T11:11:46.358 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-13T11:11:46.359 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:11:46.359 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-06-13T11:11:46.359 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:11:46.359 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:11:46.359 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-06-13 11:11:29.174447727 +0000 2024-06-13T11:11:46.359 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-06-13 11:03:12.511001941 +0000 2024-06-13T11:11:46.359 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-06-13 11:03:12.511001941 +0000 2024-06-13T11:11:46.359 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-06-13 11:03:12.511001941 +0000 2024-06-13T11:11:46.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-13T11:11:46.424 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-06-13T11:11:46.425 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-06-13T11:11:46.425 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000229128 s, 2.2 MB/s 2024-06-13T11:11:46.426 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-13T11:11:46.489 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2024-06-13T11:11:46.548 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-13T11:11:46.548 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:11:46.549 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-06-13T11:11:46.549 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:11:46.549 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:11:46.549 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-06-13 11:11:29.174447727 +0000 2024-06-13T11:11:46.549 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-06-13 11:03:12.837995019 +0000 2024-06-13T11:11:46.549 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-06-13 11:03:12.837995019 +0000 2024-06-13T11:11:46.549 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-06-13 11:03:12.837995019 +0000 2024-06-13T11:11:46.549 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-13T11:11:46.614 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-06-13T11:11:46.614 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-06-13T11:11:46.615 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000207365 s, 2.5 MB/s 2024-06-13T11:11:46.616 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-13T11:11:46.674 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2024-06-13T11:11:46.697 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:46 smithi178 systemd[1]: Starting Ceph mgr.z for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:11:46.732 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-13T11:11:46.732 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:11:46.732 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-06-13T11:11:46.732 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:11:46.732 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:11:46.732 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-06-13 11:11:29.175447707 +0000 2024-06-13T11:11:46.732 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-06-13 11:03:13.173987907 +0000 2024-06-13T11:11:46.732 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-06-13 11:03:13.173987907 +0000 2024-06-13T11:11:46.732 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-06-13 11:03:13.173987907 +0000 2024-06-13T11:11:46.733 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-13T11:11:46.796 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-06-13T11:11:46.796 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-06-13T11:11:46.796 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000187487 s, 2.7 MB/s 2024-06-13T11:11:46.797 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-13T11:11:46.854 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-13T11:11:46.854 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2024-06-13T11:11:46.871 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-13T11:11:46.872 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2024-06-13T11:11:46.925 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-13T11:11:46.926 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:11:46.926 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-06-13T11:11:46.926 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:11:46.926 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:11:46.926 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-06-13 11:11:46.513466543 +0000 2024-06-13T11:11:46.926 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-06-13 11:03:16.862209789 +0000 2024-06-13T11:11:46.926 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-06-13 11:03:16.862209789 +0000 2024-06-13T11:11:46.926 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-06-13 11:03:16.862209789 +0000 2024-06-13T11:11:46.934 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-13T11:11:47.017 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-06-13T11:11:47.017 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-06-13T11:11:47.017 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000109423 s, 4.7 MB/s 2024-06-13T11:11:47.018 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-13T11:11:47.051 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:46 smithi178 ceph-mon[36913]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:47.052 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:46 smithi178 podman[38667]: 2024-06-13 11:11:46.69057516 +0000 UTC m=+0.017517304 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:11:47.052 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:46 smithi178 podman[38667]: 2024-06-13 11:11:46.806422544 +0000 UTC m=+0.133364677 container create 6cbea389b2bef336218624bb7d0edef1b6349cb10739a7843bc8d6d51fb5e7a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-06-13T11:11:47.052 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:47 smithi178 podman[38667]: 2024-06-13 11:11:47.025807085 +0000 UTC m=+0.352749225 container init 6cbea389b2bef336218624bb7d0edef1b6349cb10739a7843bc8d6d51fb5e7a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:11:47.052 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:47 smithi178 podman[38667]: 2024-06-13 11:11:47.028398586 +0000 UTC m=+0.355340720 container start 6cbea389b2bef336218624bb7d0edef1b6349cb10739a7843bc8d6d51fb5e7a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-06-13T11:11:47.052 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:47 smithi178 ceph-mgr[38736]: -- 172.21.15.178:0/2588709227 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d86ceb25a0 con 0x55d86ce87000 2024-06-13T11:11:47.068 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2024-06-13T11:11:47.124 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-13T11:11:47.124 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:11:47.124 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-06-13T11:11:47.124 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:11:47.124 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:11:47.125 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-06-13 11:11:46.513466543 +0000 2024-06-13T11:11:47.125 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-06-13 11:03:17.168204098 +0000 2024-06-13T11:11:47.125 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-06-13 11:03:17.168204098 +0000 2024-06-13T11:11:47.125 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-06-13 11:03:17.168204098 +0000 2024-06-13T11:11:47.125 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-13T11:11:47.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:46 smithi002 ceph-mon[32210]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:47.187 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-06-13T11:11:47.188 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-06-13T11:11:47.188 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 8.8388e-05 s, 5.8 MB/s 2024-06-13T11:11:47.189 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-13T11:11:47.245 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2024-06-13T11:11:47.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:46 smithi077 ceph-mon[36410]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:47.300 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-13T11:11:47.300 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:11:47.300 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-06-13T11:11:47.300 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:11:47.300 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:11:47.300 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-06-13 11:11:46.513466543 +0000 2024-06-13T11:11:47.300 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-06-13 11:03:17.488198146 +0000 2024-06-13T11:11:47.300 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-06-13 11:03:17.488198146 +0000 2024-06-13T11:11:47.301 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-06-13 11:03:17.488198146 +0000 2024-06-13T11:11:47.301 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-13T11:11:47.361 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:47 smithi178 bash[38667]: 6cbea389b2bef336218624bb7d0edef1b6349cb10739a7843bc8d6d51fb5e7a0 2024-06-13T11:11:47.361 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:47 smithi178 systemd[1]: Started Ceph mgr.z for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:11:47.361 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:47 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:47.192+0000 7f4417e71200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T11:11:47.363 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-06-13T11:11:47.363 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-06-13T11:11:47.363 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 9.4052e-05 s, 5.4 MB/s 2024-06-13T11:11:47.364 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-13T11:11:47.420 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2024-06-13T11:11:47.475 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-13T11:11:47.475 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T11:11:47.475 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-06-13T11:11:47.475 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:11:47.475 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T11:11:47.476 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-06-13 11:11:46.514466526 +0000 2024-06-13T11:11:47.476 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-06-13 11:03:17.802192307 +0000 2024-06-13T11:11:47.476 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-06-13 11:03:17.802192307 +0000 2024-06-13T11:11:47.476 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-06-13 11:03:17.802192307 +0000 2024-06-13T11:11:47.476 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-13T11:11:47.537 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-06-13T11:11:47.538 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-06-13T11:11:47.538 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 9.2472e-05 s, 5.5 MB/s 2024-06-13T11:11:47.539 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-13T11:11:47.595 INFO:tasks.cephadm:Deploying osd.0 on smithi002 with /dev/vg_nvme/lv_4... 2024-06-13T11:11:47.595 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-13T11:11:47.696 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:47 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:47.383+0000 7f4417e71200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:11:47.697 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:47 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:47.488+0000 7f4417e71200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T11:11:48.058 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:11:48.189 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:47 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:47.807+0000 7f4417e71200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T11:11:48.189 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:47 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:47.891+0000 7f4417e71200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T11:11:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:48 smithi178 ceph-mon[36913]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T11:11:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-13T11:11:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T11:11:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:48 smithi178 ceph-mon[36913]: Deploying daemon mgr.y on smithi077 2024-06-13T11:11:48.499 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:48 smithi002 ceph-mon[32210]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:48.500 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:48.500 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:48.500 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:48.500 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T11:11:48.500 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-13T11:11:48.500 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T11:11:48.500 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:48.500 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:48 smithi002 ceph-mon[32210]: Deploying daemon mgr.y on smithi077 2024-06-13T11:11:48.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:48 smithi077 ceph-mon[36410]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:48.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:48.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:48.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:48.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T11:11:48.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-13T11:11:48.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T11:11:48.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:48.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:48 smithi077 ceph-mon[36410]: Deploying daemon mgr.y on smithi077 2024-06-13T11:11:49.447 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:49.117+0000 7f4417e71200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T11:11:49.447 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:49.286+0000 7f4417e71200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T11:11:49.540 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:49 smithi077 systemd[1]: Starting Ceph mgr.y for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:11:49.749 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:49.459+0000 7f4417e71200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T11:11:49.750 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:49.750+0000 7f4417e71200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T11:11:49.814 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:49 smithi077 podman[37765]: 2024-06-13 11:11:49.544942408 +0000 UTC m=+0.109018018 container create 21341fdae483de4a588b0f88a8c7817e8f2693465faece328fbf97aacb45e31a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-06-13T11:11:49.814 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:49 smithi077 podman[37765]: 2024-06-13 11:11:49.453150344 +0000 UTC m=+0.017225922 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:11:49.814 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:49 smithi077 podman[37765]: 2024-06-13 11:11:49.788852806 +0000 UTC m=+0.352928374 container init 21341fdae483de4a588b0f88a8c7817e8f2693465faece328fbf97aacb45e31a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:11:49.814 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:49 smithi077 podman[37765]: 2024-06-13 11:11:49.791409733 +0000 UTC m=+0.355485301 container start 21341fdae483de4a588b0f88a8c7817e8f2693465faece328fbf97aacb45e31a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-06-13T11:11:50.046 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:49.842+0000 7f4417e71200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T11:11:50.046 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:50 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:50.046+0000 7f4417e71200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T11:11:50.129 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:49 smithi077 ceph-mgr[37785]: -- 172.21.15.77:0/1775075901 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5622a6e145a0 con 0x5622a6de9000 2024-06-13T11:11:50.129 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:49 smithi077 bash[37765]: 21341fdae483de4a588b0f88a8c7817e8f2693465faece328fbf97aacb45e31a 2024-06-13T11:11:50.129 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:49 smithi077 systemd[1]: Started Ceph mgr.y for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:11:50.129 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:49 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:49.943+0000 7f436434c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T11:11:50.130 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:50 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:50.130+0000 7f436434c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:11:50.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:50 smithi002 ceph-mon[32210]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:50.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:50 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:50.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:50 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:50.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:50 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:50.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:50 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:50.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:50 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:50.447 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:50 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:50.240+0000 7f4417e71200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:11:50.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:50 smithi178 ceph-mon[36913]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:50.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:50 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:50.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:50 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:50.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:50 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:50.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:50 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:50.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:50 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:50.541 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:50 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:50.233+0000 7f436434c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T11:11:50.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:50 smithi077 ceph-mon[36410]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:50.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:50 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:50.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:50 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:50.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:50 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:50.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:50 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:50.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:50 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:50.972 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-13T11:11:50.972 INFO:teuthology.orchestra.run.smithi002.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-13T11:11:50.972 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 10+0 records in 2024-06-13T11:11:50.972 INFO:teuthology.orchestra.run.smithi002.stderr:10+0 records out 2024-06-13T11:11:50.973 INFO:teuthology.orchestra.run.smithi002.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.038537 s, 272 MB/s 2024-06-13T11:11:50.973 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping successful for: 2024-06-13T11:11:51.027 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:50 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:50.554+0000 7f436434c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T11:11:51.027 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:50 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:50.641+0000 7f436434c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T11:11:51.196 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:50 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:50.882+0000 7f4417e71200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T11:11:51.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:51 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:51.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:51 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:51.627 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:51 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:51.627 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:51 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:51.318+0000 7f4417e71200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T11:11:51.627 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:51 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:51.415+0000 7f4417e71200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T11:11:51.946 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:51 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:51.627+0000 7f4417e71200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T11:11:52.023 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_4 2024-06-13T11:11:52.222 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:51 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:51.893+0000 7f436434c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T11:11:52.222 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:52.056+0000 7f436434c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T11:11:52.222 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:52.223+0000 7f436434c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T11:11:52.446 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:52.177+0000 7f4417e71200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T11:11:52.447 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:52.269+0000 7f4417e71200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T11:11:52.449 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:11:52.763 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:52 smithi002 ceph-mon[32210]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:52.763 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:52.763 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:52.763 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:52.763 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:52.763 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:52.763 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:52.763 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:52.763 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T11:11:52.764 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T11:11:52.764 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:52.790 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:52.505+0000 7f436434c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T11:11:52.790 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:52.596+0000 7f436434c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T11:11:52.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-mon[36410]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:52.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:52.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:52.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:52.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:52.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:52.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:52.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:52.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T11:11:52.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T11:11:52.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:52.857 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:52.511+0000 7f4417e71200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T11:11:52.857 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:52.644+0000 7f4417e71200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T11:11:52.857 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:52.739+0000 7f4417e71200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T11:11:52.857 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:52.857+0000 7f4417e71200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T11:11:52.857 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-mon[36913]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:52.857 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:52.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:52.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:52.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:52.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:52.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:52.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:52.858 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T11:11:52.859 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T11:11:52.859 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:53.290 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:52.794+0000 7f436434c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T11:11:53.290 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:52 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:52.982+0000 7f436434c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:11:53.447 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:53 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:53.158+0000 7f4417e71200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T11:11:53.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:53 smithi002 ceph-mon[32210]: Reconfiguring mgr.x (unknown last config time)... 2024-06-13T11:11:53.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:53 smithi002 ceph-mon[32210]: Reconfiguring daemon mgr.x on smithi002 2024-06-13T11:11:53.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:53 smithi077 ceph-mon[36410]: Reconfiguring mgr.x (unknown last config time)... 2024-06-13T11:11:53.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:53 smithi077 ceph-mon[36410]: Reconfiguring daemon mgr.x on smithi002 2024-06-13T11:11:53.790 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:53 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:53.597+0000 7f436434c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T11:11:53.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:53 smithi178 ceph-mon[36913]: Reconfiguring mgr.x (unknown last config time)... 2024-06-13T11:11:53.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:53 smithi178 ceph-mon[36913]: Reconfiguring daemon mgr.x on smithi002 2024-06-13T11:11:53.947 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:53 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:53.757+0000 7f4417e71200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T11:11:54.290 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:54 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:54.022+0000 7f436434c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T11:11:54.290 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:54 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:54.120+0000 7f436434c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T11:11:54.447 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:11:53 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:11:53.975+0000 7f4417e71200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T11:11:54.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:54 smithi002 ceph-mon[32210]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:54.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:54 smithi002 ceph-mon[32210]: from='mgr.? 172.21.15.178:0/1013059211' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-13T11:11:54.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:54 smithi002 ceph-mon[32210]: Standby manager daemon z started 2024-06-13T11:11:54.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:54 smithi002 ceph-mon[32210]: from='mgr.? 172.21.15.178:0/1013059211' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T11:11:54.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:54 smithi002 ceph-mon[32210]: from='mgr.? 172.21.15.178:0/1013059211' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-13T11:11:54.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:54 smithi002 ceph-mon[32210]: from='mgr.? 172.21.15.178:0/1013059211' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T11:11:54.790 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:54 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:54.319+0000 7f436434c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T11:11:54.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:54 smithi077 ceph-mon[36410]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:54.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:54 smithi077 ceph-mon[36410]: from='mgr.? 172.21.15.178:0/1013059211' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-13T11:11:54.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:54 smithi077 ceph-mon[36410]: Standby manager daemon z started 2024-06-13T11:11:54.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:54 smithi077 ceph-mon[36410]: from='mgr.? 172.21.15.178:0/1013059211' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T11:11:54.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:54 smithi077 ceph-mon[36410]: from='mgr.? 172.21.15.178:0/1013059211' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-13T11:11:54.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:54 smithi077 ceph-mon[36410]: from='mgr.? 172.21.15.178:0/1013059211' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T11:11:54.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:54 smithi178 ceph-mon[36913]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:54.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:54 smithi178 ceph-mon[36913]: from='mgr.? 172.21.15.178:0/1013059211' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-13T11:11:54.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:54 smithi178 ceph-mon[36913]: Standby manager daemon z started 2024-06-13T11:11:54.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:54 smithi178 ceph-mon[36913]: from='mgr.? 172.21.15.178:0/1013059211' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T11:11:54.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:54 smithi178 ceph-mon[36913]: from='mgr.? 172.21.15.178:0/1013059211' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-13T11:11:54.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:54 smithi178 ceph-mon[36913]: from='mgr.? 172.21.15.178:0/1013059211' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T11:11:55.191 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:54 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:54.857+0000 7f436434c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T11:11:55.191 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:54 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:54.949+0000 7f436434c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T11:11:55.538 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:55 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:55.192+0000 7f436434c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T11:11:55.538 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:55 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:55.325+0000 7f436434c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T11:11:55.538 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:55 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:55.426+0000 7f436434c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T11:11:55.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:55 smithi002 ceph-mon[32210]: mgrmap e14: x(active, since 89s), standbys: z 2024-06-13T11:11:55.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:55 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-13T11:11:55.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:55 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:55.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:55 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:55.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:55 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:55.790 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:55 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:55.550+0000 7f436434c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T11:11:55.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:55 smithi077 ceph-mon[36410]: mgrmap e14: x(active, since 89s), standbys: z 2024-06-13T11:11:55.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:55 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-13T11:11:55.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:55 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:55.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:55 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:55.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:55 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:55.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.867+0000 7f3d47c00700 1 -- 172.21.15.2:0/2874602116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d40074ef0 msgr2=0x7f3d40075370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:55.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.867+0000 7f3d47c00700 1 --2- 172.21.15.2:0/2874602116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d40074ef0 0x7f3d40075370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c0098f0 tx=0x7f3d2c009c00 comp rx=0 tx=0).stop 2024-06-13T11:11:55.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.867+0000 7f3d47c00700 1 -- 172.21.15.2:0/2874602116 shutdown_connections 2024-06-13T11:11:55.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.867+0000 7f3d47c00700 1 --2- 172.21.15.2:0/2874602116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d4010a3d0 0x7f3d4010c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:55.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.867+0000 7f3d47c00700 1 --2- 172.21.15.2:0/2874602116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d400764c0 0x7f3d40074920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:55.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.867+0000 7f3d47c00700 1 --2- 172.21.15.2:0/2874602116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d40074ef0 0x7f3d40075370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:55.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.867+0000 7f3d47c00700 1 -- 172.21.15.2:0/2874602116 >> 172.21.15.2:0/2874602116 conn(0x7f3d400fda60 msgr2=0x7f3d400ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:11:55.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.867+0000 7f3d47c00700 1 -- 172.21.15.2:0/2874602116 shutdown_connections 2024-06-13T11:11:55.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.868+0000 7f3d47c00700 1 -- 172.21.15.2:0/2874602116 wait complete. 2024-06-13T11:11:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.869+0000 7f3d47c00700 1 Processor -- start 2024-06-13T11:11:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.869+0000 7f3d47c00700 1 -- start start 2024-06-13T11:11:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.870+0000 7f3d47c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d40074ef0 0x7f3d4019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.870+0000 7f3d47c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d400764c0 0x7f3d4019af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.870+0000 7f3d47c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d4010a3d0 0x7f3d401a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.870+0000 7f3d47c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3d40110350 con 0x7f3d40074ef0 2024-06-13T11:11:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.870+0000 7f3d47c00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3d401101d0 con 0x7f3d4010a3d0 2024-06-13T11:11:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.870+0000 7f3d47c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3d401104d0 con 0x7f3d400764c0 2024-06-13T11:11:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.870+0000 7f3d45200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d40074ef0 0x7f3d4019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.870+0000 7f3d45200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d40074ef0 0x7f3d4019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36628/0 (socket says 172.21.15.2:36628) 2024-06-13T11:11:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.870+0000 7f3d45200700 1 -- 172.21.15.2:0/1521759425 learned_addr learned my addr 172.21.15.2:0/1521759425 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:11:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.870+0000 7f3d45c00700 1 --2- 172.21.15.2:0/1521759425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d4010a3d0 0x7f3d401a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.870+0000 7f3d3fe00700 1 --2- 172.21.15.2:0/1521759425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d400764c0 0x7f3d4019af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.871+0000 7f3d45c00700 1 -- 172.21.15.2:0/1521759425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d400764c0 msgr2=0x7f3d4019af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.871+0000 7f3d45c00700 1 --2- 172.21.15.2:0/1521759425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d400764c0 0x7f3d4019af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.871+0000 7f3d45c00700 1 -- 172.21.15.2:0/1521759425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d40074ef0 msgr2=0x7f3d4019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:11:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.871+0000 7f3d45c00700 1 --2- 172.21.15.2:0/1521759425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d40074ef0 0x7f3d4019aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:11:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.871+0000 7f3d45c00700 1 -- 172.21.15.2:0/1521759425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d401a2680 con 0x7f3d4010a3d0 2024-06-13T11:11:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.871+0000 7f3d45c00700 1 --2- 172.21.15.2:0/1521759425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d4010a3d0 0x7f3d401a1fe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009cd0 tx=0x7f3d3800c620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.871+0000 7f3d3d600700 1 -- 172.21.15.2:0/1521759425 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3800cd10 con 0x7f3d4010a3d0 2024-06-13T11:11:55.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.871+0000 7f3d3d600700 1 -- 172.21.15.2:0/1521759425 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d38003a00 con 0x7f3d4010a3d0 2024-06-13T11:11:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.871+0000 7f3d47c00700 1 -- 172.21.15.2:0/1521759425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d401a2910 con 0x7f3d4010a3d0 2024-06-13T11:11:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.871+0000 7f3d3d600700 1 -- 172.21.15.2:0/1521759425 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d380045a0 con 0x7f3d4010a3d0 2024-06-13T11:11:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.871+0000 7f3d47c00700 1 -- 172.21.15.2:0/1521759425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d401a2e50 con 0x7f3d4010a3d0 2024-06-13T11:11:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.873+0000 7f3d47c00700 1 -- 172.21.15.2:0/1521759425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d40069180 con 0x7f3d4010a3d0 2024-06-13T11:11:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.873+0000 7f3d3d600700 1 -- 172.21.15.2:0/1521759425 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) ==== 92059+0+0 (secure 0 0 0) 0x7f3d3801a020 con 0x7f3d4010a3d0 2024-06-13T11:11:55.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.874+0000 7f3d3d600700 1 --2- 172.21.15.2:0/1521759425 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f3d2806df60 0x7f3d28070420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:11:55.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.874+0000 7f3d3d600700 1 -- 172.21.15.2:0/1521759425 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3d3808c3b0 con 0x7f3d4010a3d0 2024-06-13T11:11:55.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.875+0000 7f3d45200700 1 --2- 172.21.15.2:0/1521759425 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f3d2806df60 0x7f3d28070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:11:55.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.875+0000 7f3d45200700 1 --2- 172.21.15.2:0/1521759425 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f3d2806df60 0x7f3d28070420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009d00 tx=0x7f3d34009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:11:55.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:55.879+0000 7f3d3d600700 1 -- 172.21.15.2:0/1521759425 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3d38010040 con 0x7f3d4010a3d0 2024-06-13T11:11:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:55 smithi178 ceph-mon[36913]: mgrmap e14: x(active, since 89s), standbys: z 2024-06-13T11:11:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:55 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-13T11:11:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:55 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:55 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:55 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:11:56.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:56.128+0000 7f3d47c00700 1 -- 172.21.15.2:0/1521759425 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3d400628d0 con 0x7f3d2806df60 2024-06-13T11:11:56.290 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:55 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:55.864+0000 7f436434c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T11:11:56.540 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:56 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:56.481+0000 7f436434c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T11:11:56.853 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:56 smithi002 ceph-mon[32210]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:56.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:56 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:56.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:56 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:56.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:56 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:56.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:56 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:11:56.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:56 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:11:56.854 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:56 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:56.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:56 smithi178 ceph-mon[36913]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:56.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:56 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:56.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:56 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:56.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:56 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:56.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:56 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:11:56.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:56 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:11:56.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:56 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:57.040 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:11:56 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:11:56.719+0000 7f436434c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T11:11:57.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:56 smithi077 ceph-mon[36410]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:57.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:56 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:57.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:56 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:11:57.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:56 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:11:57.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:56 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:11:57.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:56 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:11:57.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:56 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:11:57.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:11:57.560+0000 7f3d3d600700 1 -- 172.21.15.2:0/1521759425 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7f3d38012070 con 0x7f3d4010a3d0 2024-06-13T11:11:57.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:57 smithi077 ceph-mon[36410]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:11:57.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:57 smithi077 ceph-mon[36410]: from='mgr.? 172.21.15.77:0/3927592852' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-13T11:11:57.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:57 smithi077 ceph-mon[36410]: Standby manager daemon y started 2024-06-13T11:11:57.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:57 smithi077 ceph-mon[36410]: from='mgr.? 172.21.15.77:0/3927592852' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T11:11:57.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:57 smithi077 ceph-mon[36410]: from='mgr.? 172.21.15.77:0/3927592852' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-13T11:11:57.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:57 smithi077 ceph-mon[36410]: from='mgr.? 172.21.15.77:0/3927592852' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T11:11:57.806 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:57 smithi002 ceph-mon[32210]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:11:57.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:57 smithi002 ceph-mon[32210]: from='mgr.? 172.21.15.77:0/3927592852' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-13T11:11:57.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:57 smithi002 ceph-mon[32210]: Standby manager daemon y started 2024-06-13T11:11:57.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:57 smithi002 ceph-mon[32210]: from='mgr.? 172.21.15.77:0/3927592852' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T11:11:57.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:57 smithi002 ceph-mon[32210]: from='mgr.? 172.21.15.77:0/3927592852' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-13T11:11:57.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:57 smithi002 ceph-mon[32210]: from='mgr.? 172.21.15.77:0/3927592852' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T11:11:57.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:57 smithi178 ceph-mon[36913]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:11:57.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:57 smithi178 ceph-mon[36913]: from='mgr.? 172.21.15.77:0/3927592852' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-13T11:11:57.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:57 smithi178 ceph-mon[36913]: Standby manager daemon y started 2024-06-13T11:11:57.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:57 smithi178 ceph-mon[36913]: from='mgr.? 172.21.15.77:0/3927592852' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T11:11:57.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:57 smithi178 ceph-mon[36913]: from='mgr.? 172.21.15.77:0/3927592852' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-13T11:11:57.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:57 smithi178 ceph-mon[36913]: from='mgr.? 172.21.15.77:0/3927592852' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T11:11:58.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:58 smithi002 ceph-mon[32210]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:58.717 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:58 smithi002 ceph-mon[32210]: mgrmap e15: x(active, since 92s), standbys: z, y 2024-06-13T11:11:58.717 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:11:58 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-13T11:11:58.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:58 smithi178 ceph-mon[36913]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:58.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:58 smithi178 ceph-mon[36913]: mgrmap e15: x(active, since 92s), standbys: z, y 2024-06-13T11:11:58.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:11:58 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-13T11:11:59.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:58 smithi077 ceph-mon[36410]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:11:59.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:58 smithi077 ceph-mon[36410]: mgrmap e15: x(active, since 92s), standbys: z, y 2024-06-13T11:11:59.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:11:58 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-13T11:12:00.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:00 smithi002 ceph-mon[32210]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:00.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:00 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/499284568' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5614d91-49a7-4983-a309-0de3b3e6263c"}]: dispatch 2024-06-13T11:12:00.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:00 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5614d91-49a7-4983-a309-0de3b3e6263c"}]: dispatch 2024-06-13T11:12:00.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:00 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5614d91-49a7-4983-a309-0de3b3e6263c"}]': finished 2024-06-13T11:12:00.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:00 smithi002 ceph-mon[32210]: osdmap e5: 1 total, 0 up, 1 in 2024-06-13T11:12:00.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:00 smithi178 ceph-mon[36913]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:00 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/499284568' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5614d91-49a7-4983-a309-0de3b3e6263c"}]: dispatch 2024-06-13T11:12:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:00 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5614d91-49a7-4983-a309-0de3b3e6263c"}]: dispatch 2024-06-13T11:12:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:00 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5614d91-49a7-4983-a309-0de3b3e6263c"}]': finished 2024-06-13T11:12:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:00 smithi178 ceph-mon[36913]: osdmap e5: 1 total, 0 up, 1 in 2024-06-13T11:12:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:00 smithi077 ceph-mon[36410]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:00 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/499284568' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5614d91-49a7-4983-a309-0de3b3e6263c"}]: dispatch 2024-06-13T11:12:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:00 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f5614d91-49a7-4983-a309-0de3b3e6263c"}]: dispatch 2024-06-13T11:12:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:00 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5614d91-49a7-4983-a309-0de3b3e6263c"}]': finished 2024-06-13T11:12:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:00 smithi077 ceph-mon[36410]: osdmap e5: 1 total, 0 up, 1 in 2024-06-13T11:12:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:01.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:01 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3865810659' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:12:01.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:01 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3865810659' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:12:02.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:01 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3865810659' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:12:02.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:02 smithi002 ceph-mon[32210]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:02.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:02 smithi178 ceph-mon[36913]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:03.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:02 smithi077 ceph-mon[36410]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:04.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:04 smithi002 ceph-mon[32210]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:04.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:04 smithi178 ceph-mon[36913]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:05.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:04 smithi077 ceph-mon[36410]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:06.844 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:06 smithi002 ceph-mon[32210]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:06.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:06 smithi178 ceph-mon[36913]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:06.983 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:06 smithi077 ceph-mon[36410]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:08.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:08 smithi002 ceph-mon[32210]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:08.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:08 smithi178 ceph-mon[36913]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:09.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:08 smithi077 ceph-mon[36410]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:09.871 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:09 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-13T11:12:09.871 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:09 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:09.871 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:09 smithi002 ceph-mon[32210]: Deploying daemon osd.0 on smithi002 2024-06-13T11:12:09.945 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:09 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-13T11:12:09.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:09 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:09.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:09 smithi178 ceph-mon[36913]: Deploying daemon osd.0 on smithi002 2024-06-13T11:12:10.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:09 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-13T11:12:10.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:09 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:10.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:09 smithi077 ceph-mon[36410]: Deploying daemon osd.0 on smithi002 2024-06-13T11:12:10.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:10 smithi002 ceph-mon[32210]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:10.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:10 smithi178 ceph-mon[36913]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:11.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:10 smithi077 ceph-mon[36410]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:12.886 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:12 smithi002 ceph-mon[32210]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:12.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:12 smithi178 ceph-mon[36913]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:13.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:12 smithi077 ceph-mon[36410]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:14.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:14 smithi002 ceph-mon[32210]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:14.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:14 smithi178 ceph-mon[36913]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:15.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:14 smithi077 ceph-mon[36410]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:16.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:16 smithi002 ceph-mon[32210]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:16.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:16 smithi178 ceph-mon[36913]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:17.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:16 smithi077 ceph-mon[36410]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:17.963 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:17 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:17.964 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:17 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:17.964 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:17 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:12:18.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:17 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:18.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:17 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:18.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:17 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:12:18.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:17 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:18.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:17 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:18.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:17 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:12:19.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:18 smithi077 ceph-mon[36410]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:19.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:18 smithi002 ceph-mon[32210]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:19.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:18 smithi178 ceph-mon[36913]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:21.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:20 smithi077 ceph-mon[36410]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:21.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:20 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:21.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:20 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:21.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:20 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:21.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:20 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:12:21.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:20 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:21.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:20 smithi077 ceph-mon[36410]: from='osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-13T11:12:21.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:20 smithi002 ceph-mon[32210]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:21.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:20 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:21.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:20 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:21.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:20 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:21.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:20 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:12:21.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:20 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:21.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:20 smithi002 ceph-mon[32210]: from='osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-13T11:12:21.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:20 smithi178 ceph-mon[36913]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:21.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:21.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:21.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:21.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:12:21.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:21.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:20 smithi178 ceph-mon[36913]: from='osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-13T11:12:21.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:12:21.275+0000 7f3d3d600700 1 -- 172.21.15.2:0/1521759425 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3d400628d0 con 0x7f3d2806df60 2024-06-13T11:12:21.275 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 0 on host 'smithi002' 2024-06-13T11:12:21.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:12:21.279+0000 7f3d47c00700 1 -- 172.21.15.2:0/1521759425 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f3d2806df60 msgr2=0x7f3d28070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:12:21.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:12:21.279+0000 7f3d47c00700 1 --2- 172.21.15.2:0/1521759425 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f3d2806df60 0x7f3d28070420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009d00 tx=0x7f3d34009260 comp rx=0 tx=0).stop 2024-06-13T11:12:21.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:12:21.279+0000 7f3d47c00700 1 -- 172.21.15.2:0/1521759425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d4010a3d0 msgr2=0x7f3d401a1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:12:21.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:12:21.279+0000 7f3d47c00700 1 --2- 172.21.15.2:0/1521759425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d4010a3d0 0x7f3d401a1fe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009cd0 tx=0x7f3d3800c620 comp rx=0 tx=0).stop 2024-06-13T11:12:21.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:12:21.279+0000 7f3d47c00700 1 -- 172.21.15.2:0/1521759425 shutdown_connections 2024-06-13T11:12:21.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:12:21.279+0000 7f3d47c00700 1 --2- 172.21.15.2:0/1521759425 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f3d2806df60 0x7f3d28070420 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:21.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:12:21.279+0000 7f3d47c00700 1 --2- 172.21.15.2:0/1521759425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d40074ef0 0x7f3d4019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:21.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:12:21.279+0000 7f3d47c00700 1 --2- 172.21.15.2:0/1521759425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d4010a3d0 0x7f3d401a1fe0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:21.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:12:21.279+0000 7f3d47c00700 1 --2- 172.21.15.2:0/1521759425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d400764c0 0x7f3d4019af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:21.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:12:21.279+0000 7f3d47c00700 1 -- 172.21.15.2:0/1521759425 >> 172.21.15.2:0/1521759425 conn(0x7f3d400fda60 msgr2=0x7f3d401062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:12:21.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:12:21.279+0000 7f3d47c00700 1 -- 172.21.15.2:0/1521759425 shutdown_connections 2024-06-13T11:12:21.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:12:21.279+0000 7f3d47c00700 1 -- 172.21.15.2:0/1521759425 wait complete. 2024-06-13T11:12:22.146 DEBUG:teuthology.orchestra.run.smithi002:osd.0> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.0.service 2024-06-13T11:12:22.153 INFO:tasks.cephadm:Deploying osd.1 on smithi077 with /dev/vg_nvme/lv_4... 2024-06-13T11:12:22.154 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-13T11:12:22.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:21 smithi077 ceph-mon[36410]: from='osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-13T11:12:22.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:21 smithi077 ceph-mon[36410]: osdmap e6: 1 total, 0 up, 1 in 2024-06-13T11:12:22.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:21 smithi077 ceph-mon[36410]: from='osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:12:22.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:21 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:22.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:21 smithi077 ceph-mon[36410]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:22.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:21 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:22.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:21 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:22.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:21 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:12:22.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:21 smithi002 ceph-mon[32210]: from='osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-13T11:12:22.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:21 smithi002 ceph-mon[32210]: osdmap e6: 1 total, 0 up, 1 in 2024-06-13T11:12:22.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:21 smithi002 ceph-mon[32210]: from='osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:12:22.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:21 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:22.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:21 smithi002 ceph-mon[32210]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:22.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:21 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:22.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:21 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:22.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:21 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:12:22.397 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T11:12:22.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:21 smithi178 ceph-mon[36913]: from='osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-13T11:12:22.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:21 smithi178 ceph-mon[36913]: osdmap e6: 1 total, 0 up, 1 in 2024-06-13T11:12:22.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:21 smithi178 ceph-mon[36913]: from='osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:12:22.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:21 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:22.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:21 smithi178 ceph-mon[36913]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:22.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:21 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:22.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:21 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:22.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:21 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:12:22.995 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:12:22 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-0[46524]: 2024-06-13T11:12:22.697+0000 7efc78e00700 -1 osd.0 0 waiting for initial osdmap 2024-06-13T11:12:22.995 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:12:22 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-0[46524]: 2024-06-13T11:12:22.709+0000 7efc6e200700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:12:23.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:22 smithi077 ceph-mon[36410]: from='osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T11:12:23.079 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:22 smithi077 ceph-mon[36410]: osdmap e7: 1 total, 0 up, 1 in 2024-06-13T11:12:23.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:22 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:23.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:22 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:23.080 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:22 smithi077 ceph-mon[36410]: from='osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834]' entity='osd.0' 2024-06-13T11:12:23.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:22 smithi002 ceph-mon[32210]: from='osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T11:12:23.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:22 smithi002 ceph-mon[32210]: osdmap e7: 1 total, 0 up, 1 in 2024-06-13T11:12:23.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:22 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:23.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:22 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:23.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:22 smithi002 ceph-mon[32210]: from='osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834]' entity='osd.0' 2024-06-13T11:12:23.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:22 smithi178 ceph-mon[36913]: from='osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T11:12:23.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:22 smithi178 ceph-mon[36913]: osdmap e7: 1 total, 0 up, 1 in 2024-06-13T11:12:23.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:22 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:23.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:22 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:23.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:22 smithi178 ceph-mon[36913]: from='osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834]' entity='osd.0' 2024-06-13T11:12:24.127 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-13T11:12:24.127 INFO:teuthology.orchestra.run.smithi077.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-13T11:12:24.127 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10+0 records in 2024-06-13T11:12:24.127 INFO:teuthology.orchestra.run.smithi077.stderr:10+0 records out 2024-06-13T11:12:24.127 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113218 s, 926 MB/s 2024-06-13T11:12:24.127 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping successful for: 2024-06-13T11:12:24.242 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:23 smithi002 ceph-mon[32210]: purged_snaps scrub starts 2024-06-13T11:12:24.242 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:23 smithi002 ceph-mon[32210]: purged_snaps scrub ok 2024-06-13T11:12:24.242 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:23 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:24.242 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:23 smithi002 ceph-mon[32210]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:24.243 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:23 smithi002 ceph-mon[32210]: osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834] boot 2024-06-13T11:12:24.243 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:23 smithi002 ceph-mon[32210]: osdmap e8: 1 total, 1 up, 1 in 2024-06-13T11:12:24.243 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:23 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:24.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:23 smithi077 ceph-mon[36410]: purged_snaps scrub starts 2024-06-13T11:12:24.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:23 smithi077 ceph-mon[36410]: purged_snaps scrub ok 2024-06-13T11:12:24.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:23 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:24.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:23 smithi077 ceph-mon[36410]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:24.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:23 smithi077 ceph-mon[36410]: osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834] boot 2024-06-13T11:12:24.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:23 smithi077 ceph-mon[36410]: osdmap e8: 1 total, 1 up, 1 in 2024-06-13T11:12:24.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:23 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:24.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:23 smithi178 ceph-mon[36913]: purged_snaps scrub starts 2024-06-13T11:12:24.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:23 smithi178 ceph-mon[36913]: purged_snaps scrub ok 2024-06-13T11:12:24.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:23 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:24.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:23 smithi178 ceph-mon[36913]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T11:12:24.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:23 smithi178 ceph-mon[36913]: osd.0 [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834] boot 2024-06-13T11:12:24.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:23 smithi178 ceph-mon[36913]: osdmap e8: 1 total, 1 up, 1 in 2024-06-13T11:12:24.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:23 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:12:24.796 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_4 2024-06-13T11:12:25.036 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T11:12:25.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:25 smithi077 ceph-mon[36410]: osdmap e9: 1 total, 1 up, 1 in 2024-06-13T11:12:26.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:25 smithi002 ceph-mon[32210]: osdmap e9: 1 total, 1 up, 1 in 2024-06-13T11:12:26.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:25 smithi178 ceph-mon[36913]: osdmap e9: 1 total, 1 up, 1 in 2024-06-13T11:12:26.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 -- 172.21.15.77:0/2749463460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2120102f90 msgr2=0x7f2120109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:12:26.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 --2- 172.21.15.77:0/2749463460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2120102f90 0x7f2120109840 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f211800b0d0 tx=0x7f211800b3e0 comp rx=0 tx=0).stop 2024-06-13T11:12:26.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 -- 172.21.15.77:0/2749463460 shutdown_connections 2024-06-13T11:12:26.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 --2- 172.21.15.77:0/2749463460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21201013f0 0x7f2120101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:26.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 --2- 172.21.15.77:0/2749463460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2120102f90 0x7f2120109840 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:26.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 --2- 172.21.15.77:0/2749463460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21201025f0 0x7f2120102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:26.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 -- 172.21.15.77:0/2749463460 >> 172.21.15.77:0/2749463460 conn(0x7f21200fc990 msgr2=0x7f21200fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:12:26.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 -- 172.21.15.77:0/2749463460 shutdown_connections 2024-06-13T11:12:26.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 -- 172.21.15.77:0/2749463460 wait complete. 2024-06-13T11:12:26.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 Processor -- start 2024-06-13T11:12:26.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 -- start start 2024-06-13T11:12:26.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21201013f0 0x7f212006b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:12:26.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21201025f0 0x7f212019d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:12:26.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2120102f90 0x7f212019fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:12:26.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f212010d0d0 con 0x7f2120102f90 2024-06-13T11:12:26.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f212010cf50 con 0x7f21201013f0 2024-06-13T11:12:26.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.582+0000 7f2128774700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f212010d250 con 0x7f21201025f0 2024-06-13T11:12:26.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.583+0000 7f2126510700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21201013f0 0x7f212006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:12:26.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.583+0000 7f2126510700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21201013f0 0x7f212006b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47434/0 (socket says 172.21.15.77:47434) 2024-06-13T11:12:26.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.583+0000 7f2126510700 1 -- 172.21.15.77:0/2770157032 learned_addr learned my addr 172.21.15.77:0/2770157032 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-06-13T11:12:26.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.583+0000 7f2125d0f700 1 --2- 172.21.15.77:0/2770157032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21201025f0 0x7f212019d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:12:26.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.583+0000 7f2126510700 1 -- 172.21.15.77:0/2770157032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21201025f0 msgr2=0x7f212019d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:12:26.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.583+0000 7f2126510700 1 --2- 172.21.15.77:0/2770157032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21201025f0 0x7f212019d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:26.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.583+0000 7f2126510700 1 -- 172.21.15.77:0/2770157032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2120102f90 msgr2=0x7f212019fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:12:26.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.583+0000 7f2126510700 1 --2- 172.21.15.77:0/2770157032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2120102f90 0x7f212019fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:26.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.583+0000 7f2126510700 1 -- 172.21.15.77:0/2770157032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21201a03f0 con 0x7f21201013f0 2024-06-13T11:12:26.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.583+0000 7f2126510700 1 --2- 172.21.15.77:0/2770157032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21201013f0 0x7f212006b720 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f211c00b500 tx=0x7f211c00b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:12:26.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.583+0000 7f21177fe700 1 -- 172.21.15.77:0/2770157032 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c015020 con 0x7f21201013f0 2024-06-13T11:12:26.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.583+0000 7f21177fe700 1 -- 172.21.15.77:0/2770157032 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f211c011d10 con 0x7f21201013f0 2024-06-13T11:12:26.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.583+0000 7f21177fe700 1 -- 172.21.15.77:0/2770157032 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c00f2e0 con 0x7f21201013f0 2024-06-13T11:12:26.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.583+0000 7f2128774700 1 -- 172.21.15.77:0/2770157032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21201a06e0 con 0x7f21201013f0 2024-06-13T11:12:26.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.583+0000 7f2128774700 1 -- 172.21.15.77:0/2770157032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21201a0cf0 con 0x7f21201013f0 2024-06-13T11:12:26.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.584+0000 7f2128774700 1 -- 172.21.15.77:0/2770157032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2120069180 con 0x7f21201013f0 2024-06-13T11:12:26.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.585+0000 7f21177fe700 1 -- 172.21.15.77:0/2770157032 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7f211c018020 con 0x7f21201013f0 2024-06-13T11:12:26.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.586+0000 7f21177fe700 1 --2- 172.21.15.77:0/2770157032 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f210c0a2c10 0x7f210c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:12:26.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.586+0000 7f21177fe700 1 -- 172.21.15.77:0/2770157032 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f211c0ccd10 con 0x7f21201013f0 2024-06-13T11:12:26.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.586+0000 7f2125d0f700 1 --2- 172.21.15.77:0/2770157032 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f210c0a2c10 0x7f210c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:12:26.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.587+0000 7f2125d0f700 1 --2- 172.21.15.77:0/2770157032 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f210c0a2c10 0x7f210c0a50d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2110005950 tx=0x7f21100058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:12:26.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.590+0000 7f21177fe700 1 -- 172.21.15.77:0/2770157032 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f211c01f020 con 0x7f21201013f0 2024-06-13T11:12:26.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:26.797+0000 7f2128774700 1 -- 172.21.15.77:0/2770157032 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f21200628d0 con 0x7f210c0a2c10 2024-06-13T11:12:26.846 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:26 smithi002 ceph-mon[32210]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:27.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:26 smithi077 ceph-mon[36410]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:27.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:26 smithi178 ceph-mon[36913]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:28.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:27 smithi077 ceph-mon[36410]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:12:28.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:12:28.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:12:28.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:28.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:28.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:28.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:12:28.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:28.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:28.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:12:28.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:28.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:27 smithi002 ceph-mon[32210]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:12:28.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:12:28.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:12:28.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:28.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:28.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:28.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:12:28.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:28.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:28.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:12:28.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:28.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:27 smithi178 ceph-mon[36913]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:12:28.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:12:28.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:12:28.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:28.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:28.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:28.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:12:28.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:28.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:28.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:12:28.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:29.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:28 smithi077 ceph-mon[36410]: Detected new or changed devices on smithi002 2024-06-13T11:12:29.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:28 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi002 to 17094M 2024-06-13T11:12:29.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:28 smithi077 ceph-mon[36410]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:29.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:28 smithi002 ceph-mon[32210]: Detected new or changed devices on smithi002 2024-06-13T11:12:29.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:28 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi002 to 17094M 2024-06-13T11:12:29.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:28 smithi002 ceph-mon[32210]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:29.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:28 smithi178 ceph-mon[36913]: Detected new or changed devices on smithi002 2024-06-13T11:12:29.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:28 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi002 to 17094M 2024-06-13T11:12:29.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:28 smithi178 ceph-mon[36913]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:30.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:29 smithi077 ceph-mon[36410]: from='client.? 172.21.15.77:0/3621675929' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9dbe278-309f-4726-828a-da922f486b82"}]: dispatch 2024-06-13T11:12:30.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:29 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9dbe278-309f-4726-828a-da922f486b82"}]: dispatch 2024-06-13T11:12:30.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:29 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9dbe278-309f-4726-828a-da922f486b82"}]': finished 2024-06-13T11:12:30.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:29 smithi077 ceph-mon[36410]: osdmap e10: 2 total, 1 up, 2 in 2024-06-13T11:12:30.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:30.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:29 smithi002 ceph-mon[32210]: from='client.? 172.21.15.77:0/3621675929' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9dbe278-309f-4726-828a-da922f486b82"}]: dispatch 2024-06-13T11:12:30.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:29 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9dbe278-309f-4726-828a-da922f486b82"}]: dispatch 2024-06-13T11:12:30.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:29 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9dbe278-309f-4726-828a-da922f486b82"}]': finished 2024-06-13T11:12:30.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:29 smithi002 ceph-mon[32210]: osdmap e10: 2 total, 1 up, 2 in 2024-06-13T11:12:30.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:29 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:30.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:29 smithi178 ceph-mon[36913]: from='client.? 172.21.15.77:0/3621675929' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9dbe278-309f-4726-828a-da922f486b82"}]: dispatch 2024-06-13T11:12:30.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:29 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9dbe278-309f-4726-828a-da922f486b82"}]: dispatch 2024-06-13T11:12:30.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:29 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9dbe278-309f-4726-828a-da922f486b82"}]': finished 2024-06-13T11:12:30.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:29 smithi178 ceph-mon[36913]: osdmap e10: 2 total, 1 up, 2 in 2024-06-13T11:12:30.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:29 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:31.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:30 smithi077 ceph-mon[36410]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:31.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:30 smithi077 ceph-mon[36410]: from='client.? 172.21.15.77:0/256230922' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:12:31.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:30 smithi002 ceph-mon[32210]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:31.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:30 smithi002 ceph-mon[32210]: from='client.? 172.21.15.77:0/256230922' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:12:31.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:30 smithi178 ceph-mon[36913]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:31.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:30 smithi178 ceph-mon[36913]: from='client.? 172.21.15.77:0/256230922' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:12:33.026 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:32 smithi077 ceph-mon[36410]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:33.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:32 smithi002 ceph-mon[32210]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:33.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:32 smithi178 ceph-mon[36913]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:34.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:34 smithi077 ceph-mon[36410]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:35.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:34 smithi002 ceph-mon[32210]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:35.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:34 smithi178 ceph-mon[36913]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:37.009 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:36 smithi077 ceph-mon[36410]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:37.010 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-13T11:12:37.010 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:37.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:36 smithi002 ceph-mon[32210]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:37.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-13T11:12:37.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:37.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:36 smithi178 ceph-mon[36913]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:37.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-13T11:12:37.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:38.018 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:37 smithi077 ceph-mon[36410]: Deploying daemon osd.1 on smithi077 2024-06-13T11:12:38.028 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:37 smithi002 ceph-mon[32210]: Deploying daemon osd.1 on smithi077 2024-06-13T11:12:38.098 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:37 smithi178 ceph-mon[36913]: Deploying daemon osd.1 on smithi077 2024-06-13T11:12:38.991 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:38 smithi077 ceph-mon[36410]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:39.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:38 smithi002 ceph-mon[32210]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:39.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:38 smithi178 ceph-mon[36913]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:41.007 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:40 smithi077 ceph-mon[36410]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:41.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:40 smithi002 ceph-mon[32210]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:41.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:40 smithi178 ceph-mon[36913]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:42.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:42 smithi002 ceph-mon[32210]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:42.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:42 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:42.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:42 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:42.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:42 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:12:42.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:42 smithi178 ceph-mon[36913]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:42.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:42 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:42.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:42 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:42.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:42 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:12:42.981 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:42 smithi077 ceph-mon[36410]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:42.981 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:42 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:42.981 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:42 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:42.981 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:42 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:12:45.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:44 smithi002 ceph-mon[32210]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:12:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:44 smithi178 ceph-mon[36913]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:12:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:45.208 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:44 smithi077 ceph-mon[36410]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:45.208 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:45.208 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:45.208 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:45.208 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:12:45.208 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:45.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:45.288+0000 7f21177fe700 1 -- 172.21.15.77:0/2770157032 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f21200628d0 con 0x7f210c0a2c10 2024-06-13T11:12:45.288 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 1 on host 'smithi077' 2024-06-13T11:12:45.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:45.290+0000 7f2128774700 1 -- 172.21.15.77:0/2770157032 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f210c0a2c10 msgr2=0x7f210c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:12:45.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:45.290+0000 7f2128774700 1 --2- 172.21.15.77:0/2770157032 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f210c0a2c10 0x7f210c0a50d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2110005950 tx=0x7f21100058e0 comp rx=0 tx=0).stop 2024-06-13T11:12:45.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:45.290+0000 7f2128774700 1 -- 172.21.15.77:0/2770157032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21201013f0 msgr2=0x7f212006b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:12:45.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:45.290+0000 7f2128774700 1 --2- 172.21.15.77:0/2770157032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21201013f0 0x7f212006b720 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f211c00b500 tx=0x7f211c00b8c0 comp rx=0 tx=0).stop 2024-06-13T11:12:45.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:45.290+0000 7f2128774700 1 -- 172.21.15.77:0/2770157032 shutdown_connections 2024-06-13T11:12:45.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:45.290+0000 7f2128774700 1 --2- 172.21.15.77:0/2770157032 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f210c0a2c10 0x7f210c0a50d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:45.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:45.290+0000 7f2128774700 1 --2- 172.21.15.77:0/2770157032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2120102f90 0x7f212019fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:45.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:45.290+0000 7f2128774700 1 --2- 172.21.15.77:0/2770157032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21201013f0 0x7f212006b720 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:45.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:45.290+0000 7f2128774700 1 --2- 172.21.15.77:0/2770157032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21201025f0 0x7f212019d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:45.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:45.290+0000 7f2128774700 1 -- 172.21.15.77:0/2770157032 >> 172.21.15.77:0/2770157032 conn(0x7f21200fc990 msgr2=0x7f21201058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:12:45.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:45.290+0000 7f2128774700 1 -- 172.21.15.77:0/2770157032 shutdown_connections 2024-06-13T11:12:45.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:12:45.290+0000 7f2128774700 1 -- 172.21.15.77:0/2770157032 wait complete. 2024-06-13T11:12:45.844 DEBUG:teuthology.orchestra.run.smithi077:osd.1> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.1.service 2024-06-13T11:12:45.847 INFO:tasks.cephadm:Deploying osd.2 on smithi178 with /dev/vg_nvme/lv_4... 2024-06-13T11:12:45.847 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-13T11:12:46.088 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:12:46.484 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:46 smithi178 ceph-mon[36913]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:46.484 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:46 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:46.484 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:46 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:46.484 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:46 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:12:46.484 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:46 smithi178 ceph-mon[36913]: from='osd.1 [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-13T11:12:46.484 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:46 smithi178 ceph-mon[36913]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-13T11:12:46.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:46 smithi077 ceph-mon[36410]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:46.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:46 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:46.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:46 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:46.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:46 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:12:46.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:46 smithi077 ceph-mon[36410]: from='osd.1 [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-13T11:12:46.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:46 smithi077 ceph-mon[36410]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-13T11:12:46.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:46 smithi002 ceph-mon[32210]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:46.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:46 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:46.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:46 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:46.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:46 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:12:46.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:46 smithi002 ceph-mon[32210]: from='osd.1 [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-13T11:12:46.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:46 smithi002 ceph-mon[32210]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-13T11:12:47.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:47 smithi178 ceph-mon[36913]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-13T11:12:47.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:47 smithi178 ceph-mon[36913]: from='osd.1 [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:12:47.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:47 smithi178 ceph-mon[36913]: osdmap e11: 2 total, 1 up, 2 in 2024-06-13T11:12:47.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:47 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:47.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:47 smithi178 ceph-mon[36913]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:12:47.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:47 smithi077 ceph-mon[36410]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-13T11:12:47.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:47 smithi077 ceph-mon[36410]: from='osd.1 [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:12:47.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:47 smithi077 ceph-mon[36410]: osdmap e11: 2 total, 1 up, 2 in 2024-06-13T11:12:47.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:47 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:47.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:47 smithi077 ceph-mon[36410]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:12:47.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:47 smithi002 ceph-mon[32210]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-13T11:12:47.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:47 smithi002 ceph-mon[32210]: from='osd.1 [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:12:47.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:47 smithi002 ceph-mon[32210]: osdmap e11: 2 total, 1 up, 2 in 2024-06-13T11:12:47.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:47 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:47.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:47 smithi002 ceph-mon[32210]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:12:47.918 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-13T11:12:47.919 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-13T11:12:47.919 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2024-06-13T11:12:47.919 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2024-06-13T11:12:47.919 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00851267 s, 1.2 GB/s 2024-06-13T11:12:47.919 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2024-06-13T11:12:48.009 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:12:47 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-1[40966]: 2024-06-13T11:12:47.722+0000 7fd251c0a700 -1 osd.1 0 waiting for initial osdmap 2024-06-13T11:12:48.009 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:12:47 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-1[40966]: 2024-06-13T11:12:47.726+0000 7fd2499f5700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:12:48.515 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi178:vg_nvme/lv_4 2024-06-13T11:12:48.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:48 smithi178 ceph-mon[36913]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:48.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:48 smithi178 ceph-mon[36913]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-06-13T11:12:48.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:48 smithi178 ceph-mon[36913]: osdmap e12: 2 total, 1 up, 2 in 2024-06-13T11:12:48.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:48.539 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:48.539 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:48 smithi178 ceph-mon[36913]: from='osd.1 ' entity='osd.1' 2024-06-13T11:12:48.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:48 smithi077 ceph-mon[36410]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:48.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:48 smithi077 ceph-mon[36410]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-06-13T11:12:48.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:48 smithi077 ceph-mon[36410]: osdmap e12: 2 total, 1 up, 2 in 2024-06-13T11:12:48.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:48.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:48.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:48 smithi077 ceph-mon[36410]: from='osd.1 ' entity='osd.1' 2024-06-13T11:12:48.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:48 smithi002 ceph-mon[32210]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:48.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:48 smithi002 ceph-mon[32210]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-06-13T11:12:48.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:48 smithi002 ceph-mon[32210]: osdmap e12: 2 total, 1 up, 2 in 2024-06-13T11:12:48.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:48.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:48.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:48 smithi002 ceph-mon[32210]: from='osd.1 ' entity='osd.1' 2024-06-13T11:12:48.749 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:12:49.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:49 smithi178 ceph-mon[36913]: purged_snaps scrub starts 2024-06-13T11:12:49.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:49 smithi178 ceph-mon[36913]: purged_snaps scrub ok 2024-06-13T11:12:49.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:49 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:49.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:49 smithi178 ceph-mon[36913]: osd.1 [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713] boot 2024-06-13T11:12:49.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:49 smithi178 ceph-mon[36913]: osdmap e13: 2 total, 2 up, 2 in 2024-06-13T11:12:49.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:49 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:49.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:49 smithi178 ceph-mon[36913]: Detected new or changed devices on smithi077 2024-06-13T11:12:49.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:49 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:49.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:49 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:49.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:49 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:12:49.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:49 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi077 to 17088M 2024-06-13T11:12:49.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:49 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:49.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:49 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:49.448 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:49 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:12:49.448 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:49 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:49.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:49 smithi077 ceph-mon[36410]: purged_snaps scrub starts 2024-06-13T11:12:49.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:49 smithi077 ceph-mon[36410]: purged_snaps scrub ok 2024-06-13T11:12:49.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:49 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:49.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:49 smithi077 ceph-mon[36410]: osd.1 [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713] boot 2024-06-13T11:12:49.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:49 smithi077 ceph-mon[36410]: osdmap e13: 2 total, 2 up, 2 in 2024-06-13T11:12:49.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:49 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:49.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:49 smithi077 ceph-mon[36410]: Detected new or changed devices on smithi077 2024-06-13T11:12:49.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:49 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:49.542 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:49 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:49.542 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:49 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:12:49.542 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:49 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi077 to 17088M 2024-06-13T11:12:49.542 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:49 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:49.542 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:49 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:49.542 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:49 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:12:49.542 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:49 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:49.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:49 smithi002 ceph-mon[32210]: purged_snaps scrub starts 2024-06-13T11:12:49.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:49 smithi002 ceph-mon[32210]: purged_snaps scrub ok 2024-06-13T11:12:49.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:49 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:49.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:49 smithi002 ceph-mon[32210]: osd.1 [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713] boot 2024-06-13T11:12:49.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:49 smithi002 ceph-mon[32210]: osdmap e13: 2 total, 2 up, 2 in 2024-06-13T11:12:49.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:49 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:12:49.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:49 smithi002 ceph-mon[32210]: Detected new or changed devices on smithi077 2024-06-13T11:12:49.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:49 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:49.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:49 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:49.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:49 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:12:49.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:49 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi077 to 17088M 2024-06-13T11:12:49.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:49 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:49.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:49 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:49.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:49 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:12:49.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:49 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:12:50.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.269+0000 7fe6dab9a700 1 -- 172.21.15.178:0/3470644654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d41058d0 msgr2=0x7fe6d4107cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:12:50.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.269+0000 7fe6dab9a700 1 --2- 172.21.15.178:0/3470644654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d41058d0 0x7fe6d4107cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009990 tx=0x7fe6c0009ca0 comp rx=0 tx=0).stop 2024-06-13T11:12:50.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.270+0000 7fe6dab9a700 1 -- 172.21.15.178:0/3470644654 shutdown_connections 2024-06-13T11:12:50.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.270+0000 7fe6dab9a700 1 --2- 172.21.15.178:0/3470644654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d4108200 0x7fe6d410a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:50.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.270+0000 7fe6dab9a700 1 --2- 172.21.15.178:0/3470644654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d4102fa0 0x7fe6d4105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:50.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.270+0000 7fe6dab9a700 1 --2- 172.21.15.178:0/3470644654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d41058d0 0x7fe6d4107cc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:50.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.270+0000 7fe6dab9a700 1 -- 172.21.15.178:0/3470644654 >> 172.21.15.178:0/3470644654 conn(0x7fe6d40fc9b0 msgr2=0x7fe6d40fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:12:50.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.270+0000 7fe6dab9a700 1 -- 172.21.15.178:0/3470644654 shutdown_connections 2024-06-13T11:12:50.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.270+0000 7fe6dab9a700 1 -- 172.21.15.178:0/3470644654 wait complete. 2024-06-13T11:12:50.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.270+0000 7fe6dab9a700 1 Processor -- start 2024-06-13T11:12:50.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.270+0000 7fe6dab9a700 1 -- start start 2024-06-13T11:12:50.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.270+0000 7fe6dab9a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d4102fa0 0x7fe6d4198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:12:50.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.270+0000 7fe6dab9a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d41058d0 0x7fe6d4198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:12:50.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.270+0000 7fe6dab9a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d4108200 0x7fe6d419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:12:50.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.270+0000 7fe6dab9a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d410e180 con 0x7fe6d4102fa0 2024-06-13T11:12:50.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.270+0000 7fe6dab9a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d410e000 con 0x7fe6d41058d0 2024-06-13T11:12:50.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.270+0000 7fe6dab9a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d410e300 con 0x7fe6d4108200 2024-06-13T11:12:50.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.271+0000 7fe6d9137700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d4108200 0x7fe6d419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:12:50.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.271+0000 7fe6d9137700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d4108200 0x7fe6d419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46432/0 (socket says 172.21.15.178:46432) 2024-06-13T11:12:50.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.271+0000 7fe6d9137700 1 -- 172.21.15.178:0/3170776113 learned_addr learned my addr 172.21.15.178:0/3170776113 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-13T11:12:50.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.271+0000 7fe6d3fff700 1 --2- 172.21.15.178:0/3170776113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d41058d0 0x7fe6d4198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:12:50.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.271+0000 7fe6d9137700 1 -- 172.21.15.178:0/3170776113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d41058d0 msgr2=0x7fe6d4198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:12:50.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.271+0000 7fe6d9137700 1 --2- 172.21.15.178:0/3170776113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d41058d0 0x7fe6d4198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:50.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.271+0000 7fe6d9137700 1 -- 172.21.15.178:0/3170776113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d4102fa0 msgr2=0x7fe6d4198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:12:50.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.271+0000 7fe6d9137700 1 --2- 172.21.15.178:0/3170776113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d4102fa0 0x7fe6d4198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:12:50.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.271+0000 7fe6d9137700 1 -- 172.21.15.178:0/3170776113 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d41a03c0 con 0x7fe6d4108200 2024-06-13T11:12:50.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.271+0000 7fe6d9137700 1 --2- 172.21.15.178:0/3170776113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d4108200 0x7fe6d419fd20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00ba10 tx=0x7fe6cc00bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:12:50.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.271+0000 7fe6d1ffb700 1 -- 172.21.15.178:0/3170776113 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc019070 con 0x7fe6d4108200 2024-06-13T11:12:50.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.271+0000 7fe6d1ffb700 1 -- 172.21.15.178:0/3170776113 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6cc00ce10 con 0x7fe6d4108200 2024-06-13T11:12:50.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.271+0000 7fe6dab9a700 1 -- 172.21.15.178:0/3170776113 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d41a06b0 con 0x7fe6d4108200 2024-06-13T11:12:50.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.271+0000 7fe6d1ffb700 1 -- 172.21.15.178:0/3170776113 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc012340 con 0x7fe6d4108200 2024-06-13T11:12:50.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.272+0000 7fe6dab9a700 1 -- 172.21.15.178:0/3170776113 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d41a0c70 con 0x7fe6d4108200 2024-06-13T11:12:50.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.272+0000 7fe6dab9a700 1 -- 172.21.15.178:0/3170776113 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d4069180 con 0x7fe6d4108200 2024-06-13T11:12:50.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.273+0000 7fe6d1ffb700 1 -- 172.21.15.178:0/3170776113 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7fe6cc01c070 con 0x7fe6d4108200 2024-06-13T11:12:50.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.274+0000 7fe6d1ffb700 1 --2- 172.21.15.178:0/3170776113 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe6c40a2c10 0x7fe6c40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:12:50.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.274+0000 7fe6d1ffb700 1 -- 172.21.15.178:0/3170776113 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2309+0+0 (secure 0 0 0) 0x7fe6cc0cca80 con 0x7fe6d4108200 2024-06-13T11:12:50.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.274+0000 7fe6d8936700 1 --2- 172.21.15.178:0/3170776113 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe6c40a2c10 0x7fe6c40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:12:50.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.276+0000 7fe6d8936700 1 --2- 172.21.15.178:0/3170776113 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe6c40a2c10 0x7fe6c40a50d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8005950 tx=0x7fe6c80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:12:50.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.279+0000 7fe6d1ffb700 1 -- 172.21.15.178:0/3170776113 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe6cc09b230 con 0x7fe6d4108200 2024-06-13T11:12:50.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:12:50.481+0000 7fe6dab9a700 1 -- 172.21.15.178:0/3170776113 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe6d40628d0 con 0x7fe6c40a2c10 2024-06-13T11:12:51.107 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:50 smithi178 ceph-mon[36913]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:51.107 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:50 smithi178 ceph-mon[36913]: osdmap e14: 2 total, 2 up, 2 in 2024-06-13T11:12:51.107 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:50 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:12:51.107 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:50 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:12:51.107 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:50 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:51.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:50 smithi002 ceph-mon[32210]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:51.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:50 smithi002 ceph-mon[32210]: osdmap e14: 2 total, 2 up, 2 in 2024-06-13T11:12:51.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:50 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:12:51.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:50 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:12:51.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:50 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:51.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:50 smithi077 ceph-mon[36410]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-13T11:12:51.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:50 smithi077 ceph-mon[36410]: osdmap e14: 2 total, 2 up, 2 in 2024-06-13T11:12:51.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:50 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:12:51.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:50 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:12:51.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:50 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:12:51.987 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:51 smithi178 ceph-mon[36913]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:12:52.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:51 smithi002 ceph-mon[32210]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:12:52.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:51 smithi077 ceph-mon[36410]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:12:53.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:52 smithi002 ceph-mon[32210]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:12:53.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:52 smithi178 ceph-mon[36913]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:12:53.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:52 smithi077 ceph-mon[36410]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:12:54.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:53 smithi002 ceph-mon[32210]: from='client.? 172.21.15.178:0/2031713604' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04c267dc-7454-418f-9965-3ff96ef280ce"}]: dispatch 2024-06-13T11:12:54.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:53 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04c267dc-7454-418f-9965-3ff96ef280ce"}]: dispatch 2024-06-13T11:12:54.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:53 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04c267dc-7454-418f-9965-3ff96ef280ce"}]': finished 2024-06-13T11:12:54.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:53 smithi002 ceph-mon[32210]: osdmap e15: 3 total, 2 up, 3 in 2024-06-13T11:12:54.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:53 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:12:54.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:53 smithi002 ceph-mon[32210]: from='client.? 172.21.15.178:0/669118191' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:12:54.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:53 smithi178 ceph-mon[36913]: from='client.? 172.21.15.178:0/2031713604' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04c267dc-7454-418f-9965-3ff96ef280ce"}]: dispatch 2024-06-13T11:12:54.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:53 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04c267dc-7454-418f-9965-3ff96ef280ce"}]: dispatch 2024-06-13T11:12:54.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:53 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04c267dc-7454-418f-9965-3ff96ef280ce"}]': finished 2024-06-13T11:12:54.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:53 smithi178 ceph-mon[36913]: osdmap e15: 3 total, 2 up, 3 in 2024-06-13T11:12:54.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:53 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:12:54.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:53 smithi178 ceph-mon[36913]: from='client.? 172.21.15.178:0/669118191' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:12:54.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:53 smithi077 ceph-mon[36410]: from='client.? 172.21.15.178:0/2031713604' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04c267dc-7454-418f-9965-3ff96ef280ce"}]: dispatch 2024-06-13T11:12:54.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:53 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04c267dc-7454-418f-9965-3ff96ef280ce"}]: dispatch 2024-06-13T11:12:54.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:53 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04c267dc-7454-418f-9965-3ff96ef280ce"}]': finished 2024-06-13T11:12:54.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:53 smithi077 ceph-mon[36410]: osdmap e15: 3 total, 2 up, 3 in 2024-06-13T11:12:54.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:53 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:12:54.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:53 smithi077 ceph-mon[36410]: from='client.? 172.21.15.178:0/669118191' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:12:55.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:54 smithi002 ceph-mon[32210]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:12:55.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:54 smithi178 ceph-mon[36913]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:12:55.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:54 smithi077 ceph-mon[36410]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:12:56.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:56 smithi178 ceph-mon[36913]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:12:57.092 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:56 smithi077 ceph-mon[36410]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:12:57.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:56 smithi002 ceph-mon[32210]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:12:58.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:12:58 smithi002 ceph-mon[32210]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:12:59.115 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:12:58 smithi178 ceph-mon[36913]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:12:59.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:12:58 smithi077 ceph-mon[36410]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:01.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:00 smithi178 ceph-mon[36913]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:01.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-13T11:13:01.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:01.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:00 smithi002 ceph-mon[32210]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:01.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-13T11:13:01.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:01.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:00 smithi077 ceph-mon[36410]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:01.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-13T11:13:01.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:02.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:01 smithi002 ceph-mon[32210]: Deploying daemon osd.2 on smithi178 2024-06-13T11:13:02.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:01 smithi178 ceph-mon[36913]: Deploying daemon osd.2 on smithi178 2024-06-13T11:13:02.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:01 smithi077 ceph-mon[36410]: Deploying daemon osd.2 on smithi178 2024-06-13T11:13:03.133 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:02 smithi178 ceph-mon[36913]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:03.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:02 smithi002 ceph-mon[32210]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:03.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:02 smithi077 ceph-mon[36410]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:05.087 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:04 smithi178 ceph-mon[36913]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:05.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:04 smithi002 ceph-mon[32210]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:05.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:04 smithi077 ceph-mon[36410]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:06.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:06 smithi002 ceph-mon[32210]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:06.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:06.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:06.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:13:06.649 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:06 smithi178 ceph-mon[36913]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:06.649 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:06.649 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:06.649 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:13:06.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:06 smithi077 ceph-mon[36410]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:06.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:06.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:06.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:13:08.920 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:08 smithi178 ceph-mon[36913]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:08.920 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:08 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:08.920 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:08 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:08.920 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:08 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:08.920 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:08 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:13:08.920 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:08 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:08.979 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:13:08.980+0000 7fe6d1ffb700 1 -- 172.21.15.178:0/3170776113 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe6d40628d0 con 0x7fe6c40a2c10 2024-06-13T11:13:08.979 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 2 on host 'smithi178' 2024-06-13T11:13:08.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:13:08.982+0000 7fe6dab9a700 1 -- 172.21.15.178:0/3170776113 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe6c40a2c10 msgr2=0x7fe6c40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:13:08.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:13:08.982+0000 7fe6dab9a700 1 --2- 172.21.15.178:0/3170776113 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe6c40a2c10 0x7fe6c40a50d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8005950 tx=0x7fe6c80058e0 comp rx=0 tx=0).stop 2024-06-13T11:13:08.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:13:08.982+0000 7fe6dab9a700 1 -- 172.21.15.178:0/3170776113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d4108200 msgr2=0x7fe6d419fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:13:08.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:13:08.982+0000 7fe6dab9a700 1 --2- 172.21.15.178:0/3170776113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d4108200 0x7fe6d419fd20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00ba10 tx=0x7fe6cc00bd20 comp rx=0 tx=0).stop 2024-06-13T11:13:08.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:13:08.982+0000 7fe6dab9a700 1 -- 172.21.15.178:0/3170776113 shutdown_connections 2024-06-13T11:13:08.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:13:08.982+0000 7fe6dab9a700 1 --2- 172.21.15.178:0/3170776113 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe6c40a2c10 0x7fe6c40a50d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:08.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:13:08.982+0000 7fe6dab9a700 1 --2- 172.21.15.178:0/3170776113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6d4102fa0 0x7fe6d4198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:08.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:13:08.982+0000 7fe6dab9a700 1 --2- 172.21.15.178:0/3170776113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6d4108200 0x7fe6d419fd20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:08.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:13:08.982+0000 7fe6dab9a700 1 --2- 172.21.15.178:0/3170776113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6d41058d0 0x7fe6d4198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:08.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:13:08.982+0000 7fe6dab9a700 1 -- 172.21.15.178:0/3170776113 >> 172.21.15.178:0/3170776113 conn(0x7fe6d40fc9b0 msgr2=0x7fe6d41038e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:13:08.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:13:08.982+0000 7fe6dab9a700 1 -- 172.21.15.178:0/3170776113 shutdown_connections 2024-06-13T11:13:08.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:13:08.982+0000 7fe6dab9a700 1 -- 172.21.15.178:0/3170776113 wait complete. 2024-06-13T11:13:09.023 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:08 smithi002 ceph-mon[32210]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:09.023 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:08 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:09.023 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:08 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:09.023 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:08 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:09.023 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:08 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:13:09.023 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:08 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:09.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:08 smithi077 ceph-mon[36410]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:09.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:08 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:09.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:08 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:09.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:08 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:09.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:08 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:13:09.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:08 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:09.634 DEBUG:teuthology.orchestra.run.smithi178:osd.2> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.2.service 2024-06-13T11:13:09.677 INFO:tasks.cephadm:Deploying osd.3 on smithi002 with /dev/vg_nvme/lv_3... 2024-06-13T11:13:09.677 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-13T11:13:10.141 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:13:10.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:09 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:10.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:09 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:10.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:09 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:13:10.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:09 smithi002 ceph-mon[32210]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:10.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:09 smithi002 ceph-mon[32210]: from='osd.2 [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-13T11:13:10.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:09 smithi002 ceph-mon[32210]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-13T11:13:10.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:09 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:10.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:09 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:10.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:09 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:13:10.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:09 smithi077 ceph-mon[36410]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:10.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:09 smithi077 ceph-mon[36410]: from='osd.2 [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-13T11:13:10.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:09 smithi077 ceph-mon[36410]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-13T11:13:10.333 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:09 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:10.333 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:09 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:10.334 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:09 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:13:10.334 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:09 smithi178 ceph-mon[36913]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:10.334 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:09 smithi178 ceph-mon[36913]: from='osd.2 [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-13T11:13:10.334 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:09 smithi178 ceph-mon[36913]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-13T11:13:11.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:10 smithi178 ceph-mon[36913]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-13T11:13:11.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:10 smithi178 ceph-mon[36913]: from='osd.2 [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:13:11.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:10 smithi178 ceph-mon[36913]: osdmap e16: 3 total, 2 up, 3 in 2024-06-13T11:13:11.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:10 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:13:11.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:10 smithi178 ceph-mon[36913]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:13:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:10 smithi077 ceph-mon[36410]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-13T11:13:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:10 smithi077 ceph-mon[36410]: from='osd.2 [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:13:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:10 smithi077 ceph-mon[36410]: osdmap e16: 3 total, 2 up, 3 in 2024-06-13T11:13:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:10 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:13:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:10 smithi077 ceph-mon[36410]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:13:11.300 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:10 smithi002 ceph-mon[32210]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-13T11:13:11.300 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:10 smithi002 ceph-mon[32210]: from='osd.2 [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:13:11.300 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:10 smithi002 ceph-mon[32210]: osdmap e16: 3 total, 2 up, 3 in 2024-06-13T11:13:11.300 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:10 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:13:11.300 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:10 smithi002 ceph-mon[32210]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:13:11.697 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:13:11 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-2[42188]: 2024-06-13T11:13:11.460+0000 7fd14179d700 -1 osd.2 0 waiting for initial osdmap 2024-06-13T11:13:11.697 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:13:11 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-2[42188]: 2024-06-13T11:13:11.464+0000 7fd139588700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:13:12.066 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:12 smithi002 ceph-mon[32210]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-13T11:13:12.066 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:12 smithi002 ceph-mon[32210]: osdmap e17: 3 total, 2 up, 3 in 2024-06-13T11:13:12.066 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:13:12.066 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:12 smithi002 ceph-mon[32210]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:12.066 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:12 smithi002 ceph-mon[32210]: from='osd.2 ' entity='osd.2' 2024-06-13T11:13:12.066 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:13:12.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:12 smithi178 ceph-mon[36913]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-13T11:13:12.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:12 smithi178 ceph-mon[36913]: osdmap e17: 3 total, 2 up, 3 in 2024-06-13T11:13:12.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:13:12.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:12 smithi178 ceph-mon[36913]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:12.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:12 smithi178 ceph-mon[36913]: from='osd.2 ' entity='osd.2' 2024-06-13T11:13:12.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:13:12.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:12 smithi077 ceph-mon[36410]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-13T11:13:12.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:12 smithi077 ceph-mon[36410]: osdmap e17: 3 total, 2 up, 3 in 2024-06-13T11:13:12.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:13:12.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:12 smithi077 ceph-mon[36410]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-13T11:13:12.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:12 smithi077 ceph-mon[36410]: from='osd.2 ' entity='osd.2' 2024-06-13T11:13:12.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:13:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-13T11:13:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-13T11:13:12.950 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 10+0 records in 2024-06-13T11:13:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:10+0 records out 2024-06-13T11:13:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0321689 s, 326 MB/s 2024-06-13T11:13:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping successful for: 2024-06-13T11:13:13.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:13 smithi077 ceph-mon[36410]: purged_snaps scrub starts 2024-06-13T11:13:13.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:13 smithi077 ceph-mon[36410]: purged_snaps scrub ok 2024-06-13T11:13:13.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:13 smithi077 ceph-mon[36410]: osd.2 [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575] boot 2024-06-13T11:13:13.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:13 smithi077 ceph-mon[36410]: osdmap e18: 3 total, 3 up, 3 in 2024-06-13T11:13:13.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:13:13.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:13 smithi077 ceph-mon[36410]: Detected new or changed devices on smithi178 2024-06-13T11:13:13.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:13.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:13.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:13:13.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:13 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi178 to 17088M 2024-06-13T11:13:13.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:13.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:13.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:13:13.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:13.315 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:13 smithi002 ceph-mon[32210]: purged_snaps scrub starts 2024-06-13T11:13:13.315 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:13 smithi002 ceph-mon[32210]: purged_snaps scrub ok 2024-06-13T11:13:13.315 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:13 smithi002 ceph-mon[32210]: osd.2 [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575] boot 2024-06-13T11:13:13.315 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:13 smithi002 ceph-mon[32210]: osdmap e18: 3 total, 3 up, 3 in 2024-06-13T11:13:13.315 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:13:13.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:13 smithi002 ceph-mon[32210]: Detected new or changed devices on smithi178 2024-06-13T11:13:13.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:13.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:13.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:13:13.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:13 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi178 to 17088M 2024-06-13T11:13:13.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:13.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:13.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:13:13.316 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:13.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:13 smithi178 ceph-mon[36913]: purged_snaps scrub starts 2024-06-13T11:13:13.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:13 smithi178 ceph-mon[36913]: purged_snaps scrub ok 2024-06-13T11:13:13.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:13 smithi178 ceph-mon[36913]: osd.2 [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575] boot 2024-06-13T11:13:13.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:13 smithi178 ceph-mon[36913]: osdmap e18: 3 total, 3 up, 3 in 2024-06-13T11:13:13.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:13:13.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:13 smithi178 ceph-mon[36913]: Detected new or changed devices on smithi178 2024-06-13T11:13:13.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:13.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:13.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:13:13.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:13 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi178 to 17088M 2024-06-13T11:13:13.448 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:13.448 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:13.448 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:13:13.448 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:13.706 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_3 2024-06-13T11:13:14.135 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:13:14.287 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:14 smithi002 ceph-mon[32210]: pgmap v92: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:14.288 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:14 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-13T11:13:14.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:14 smithi077 ceph-mon[36410]: pgmap v92: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:14.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:14 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-13T11:13:14.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:14 smithi178 ceph-mon[36913]: pgmap v92: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:14.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:14 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-13T11:13:15.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:15 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-13T11:13:15.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:15 smithi077 ceph-mon[36410]: osdmap e19: 3 total, 3 up, 3 in 2024-06-13T11:13:15.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:15 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T11:13:15.328 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:15 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-13T11:13:15.329 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:15 smithi002 ceph-mon[32210]: osdmap e19: 3 total, 3 up, 3 in 2024-06-13T11:13:15.329 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:15 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T11:13:15.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:15 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-13T11:13:15.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:15 smithi178 ceph-mon[36913]: osdmap e19: 3 total, 3 up, 3 in 2024-06-13T11:13:15.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:15 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T11:13:16.033 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:13:15 smithi002 sudo[51150]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-13T11:13:16.033 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:13:15 smithi002 sudo[51150]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T11:13:16.034 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:13:15 smithi002 sudo[51150]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T11:13:16.034 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:13:15 smithi002 sudo[51150]: pam_unix(sudo:session): session closed for user root 2024-06-13T11:13:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.208+0000 7f64c4c00700 1 -- 172.21.15.2:0/900612872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64c01013f0 msgr2=0x7f64c0101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:13:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.208+0000 7f64c4c00700 1 --2- 172.21.15.2:0/900612872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64c01013f0 0x7f64c0101810 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f64b00099c0 tx=0x7f64b0009cd0 comp rx=0 tx=0).stop 2024-06-13T11:13:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.208+0000 7f64c4c00700 1 -- 172.21.15.2:0/900612872 shutdown_connections 2024-06-13T11:13:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.208+0000 7f64c4c00700 1 --2- 172.21.15.2:0/900612872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64c0102f90 0x7f64c0109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.208+0000 7f64c4c00700 1 --2- 172.21.15.2:0/900612872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64c01013f0 0x7f64c0101810 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.208+0000 7f64c4c00700 1 --2- 172.21.15.2:0/900612872 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64c01025f0 0x7f64c0102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.208+0000 7f64c4c00700 1 -- 172.21.15.2:0/900612872 >> 172.21.15.2:0/900612872 conn(0x7f64c00fc990 msgr2=0x7f64c00fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:13:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.208+0000 7f64c4c00700 1 -- 172.21.15.2:0/900612872 shutdown_connections 2024-06-13T11:13:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.208+0000 7f64c4c00700 1 -- 172.21.15.2:0/900612872 wait complete. 2024-06-13T11:13:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.210+0000 7f64c4c00700 1 Processor -- start 2024-06-13T11:13:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.210+0000 7f64c4c00700 1 -- start start 2024-06-13T11:13:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.210+0000 7f64c4c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64c01013f0 0x7f64c019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:13:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.210+0000 7f64c4c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64c01025f0 0x7f64c019af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:13:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.210+0000 7f64c4c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64c0102f90 0x7f64c01a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:13:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.210+0000 7f64c4c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f64c010d010 con 0x7f64c01013f0 2024-06-13T11:13:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.210+0000 7f64c4c00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f64c010ce90 con 0x7f64c0102f90 2024-06-13T11:13:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.210+0000 7f64c4c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f64c010d190 con 0x7f64c01025f0 2024-06-13T11:13:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.211+0000 7f64bde00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64c01013f0 0x7f64c019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:13:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.211+0000 7f64bde00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64c01013f0 0x7f64c019aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48000/0 (socket says 172.21.15.2:48000) 2024-06-13T11:13:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.211+0000 7f64bde00700 1 -- 172.21.15.2:0/1116919826 learned_addr learned my addr 172.21.15.2:0/1116919826 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:13:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.211+0000 7f64bd400700 1 --2- 172.21.15.2:0/1116919826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64c01025f0 0x7f64c019af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:13:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.211+0000 7f64be800700 1 --2- 172.21.15.2:0/1116919826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64c0102f90 0x7f64c01a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:13:16.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.211+0000 7f64be800700 1 -- 172.21.15.2:0/1116919826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64c01025f0 msgr2=0x7f64c019af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:13:16.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.211+0000 7f64be800700 1 --2- 172.21.15.2:0/1116919826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64c01025f0 0x7f64c019af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:16.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.211+0000 7f64be800700 1 -- 172.21.15.2:0/1116919826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64c01013f0 msgr2=0x7f64c019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:13:16.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.211+0000 7f64be800700 1 --2- 172.21.15.2:0/1116919826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64c01013f0 0x7f64c019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:16.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.211+0000 7f64be800700 1 -- 172.21.15.2:0/1116919826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c01a2670 con 0x7f64c0102f90 2024-06-13T11:13:16.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.211+0000 7f64bde00700 1 --2- 172.21.15.2:0/1116919826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64c01013f0 0x7f64c019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:13:16.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.212+0000 7f64be800700 1 --2- 172.21.15.2:0/1116919826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64c0102f90 0x7f64c01a1fd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f64b800efc0 tx=0x7f64b800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:13:16.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.212+0000 7f64b6a00700 1 -- 172.21.15.2:0/1116919826 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b80092e0 con 0x7f64c0102f90 2024-06-13T11:13:16.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.212+0000 7f64b6a00700 1 -- 172.21.15.2:0/1116919826 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64b8004bb0 con 0x7f64c0102f90 2024-06-13T11:13:16.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.212+0000 7f64b6a00700 1 -- 172.21.15.2:0/1116919826 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b8004280 con 0x7f64c0102f90 2024-06-13T11:13:16.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.212+0000 7f64c4c00700 1 -- 172.21.15.2:0/1116919826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c01a2900 con 0x7f64c0102f90 2024-06-13T11:13:16.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.212+0000 7f64c4c00700 1 -- 172.21.15.2:0/1116919826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c01a2df0 con 0x7f64c0102f90 2024-06-13T11:13:16.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.214+0000 7f64c4c00700 1 -- 172.21.15.2:0/1116919826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c0069180 con 0x7f64c0102f90 2024-06-13T11:13:16.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.216+0000 7f64b6a00700 1 -- 172.21.15.2:0/1116919826 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7f64b801b030 con 0x7f64c0102f90 2024-06-13T11:13:16.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.217+0000 7f64b6a00700 1 --2- 172.21.15.2:0/1116919826 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f64a40a2c10 0x7f64a40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:13:16.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.217+0000 7f64b6a00700 1 -- 172.21.15.2:0/1116919826 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3237+0+0 (secure 0 0 0) 0x7f64b80cdbd0 con 0x7f64c0102f90 2024-06-13T11:13:16.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.217+0000 7f64bde00700 1 --2- 172.21.15.2:0/1116919826 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f64a40a2c10 0x7f64a40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:13:16.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.218+0000 7f64bde00700 1 --2- 172.21.15.2:0/1116919826 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f64a40a2c10 0x7f64a40a50d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f64b00038c0 tx=0x7f64b0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:13:16.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.219+0000 7f64b6a00700 1 -- 172.21.15.2:0/1116919826 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f64b8022020 con 0x7f64c0102f90 2024-06-13T11:13:16.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:16 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-13T11:13:16.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:16 smithi077 ceph-mon[36410]: osdmap e20: 3 total, 3 up, 3 in 2024-06-13T11:13:16.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:16 smithi077 ceph-mon[36410]: pgmap v95: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:16.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:16 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-13T11:13:16.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:16 smithi002 ceph-mon[32210]: osdmap e20: 3 total, 3 up, 3 in 2024-06-13T11:13:16.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:16 smithi002 ceph-mon[32210]: pgmap v95: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:16.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:16 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-13T11:13:16.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:16 smithi178 ceph-mon[36913]: osdmap e20: 3 total, 3 up, 3 in 2024-06-13T11:13:16.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:16 smithi178 ceph-mon[36913]: pgmap v95: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:16.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:16.467+0000 7f64c4c00700 1 -- 172.21.15.2:0/1116919826 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f64c00febc0 con 0x7f64a40a2c10 2024-06-13T11:13:16.895 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:13:16 smithi002 sudo[51180]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-13T11:13:16.895 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:13:16 smithi002 sudo[51180]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T11:13:16.896 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:13:16 smithi002 sudo[51180]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T11:13:16.896 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:13:16 smithi002 sudo[51180]: pam_unix(sudo:session): session closed for user root 2024-06-13T11:13:16.976 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:13:16 smithi077 sudo[44747]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-13T11:13:16.977 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:13:16 smithi077 sudo[44747]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T11:13:16.977 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:13:16 smithi077 sudo[44747]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T11:13:16.977 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:13:16 smithi077 sudo[44747]: pam_unix(sudo:session): session closed for user root 2024-06-13T11:13:17.290 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:13:16 smithi077 sudo[44750]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-13T11:13:17.290 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:13:16 smithi077 sudo[44750]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T11:13:17.290 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:13:16 smithi077 sudo[44750]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T11:13:17.290 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:13:16 smithi077 sudo[44750]: pam_unix(sudo:session): session closed for user root 2024-06-13T11:13:17.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:17 smithi077 ceph-mon[36410]: osdmap e21: 3 total, 3 up, 3 in 2024-06-13T11:13:17.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:17 smithi077 ceph-mon[36410]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:13:17.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:17 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:13:17.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:17 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:13:17.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:17 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:17.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:17 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:17.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:17 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:17.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:17 smithi002 ceph-mon[32210]: osdmap e21: 3 total, 3 up, 3 in 2024-06-13T11:13:17.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:17 smithi002 ceph-mon[32210]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:13:17.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:17 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:13:17.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:17 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:13:17.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:17 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:17.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:17 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:17.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:17 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:17.446 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:13:17 smithi178 sudo[46222]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-13T11:13:17.446 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:13:17 smithi178 sudo[46222]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T11:13:17.446 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:13:17 smithi178 sudo[46222]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T11:13:17.447 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:13:17 smithi178 sudo[46222]: pam_unix(sudo:session): session closed for user root 2024-06-13T11:13:17.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:17 smithi178 ceph-mon[36913]: osdmap e21: 3 total, 3 up, 3 in 2024-06-13T11:13:17.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:17 smithi178 ceph-mon[36913]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:13:17.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:17 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:13:17.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:17 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:13:17.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:17 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:17.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:17 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:17.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:17 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:17.947 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:13:17 smithi178 sudo[46225]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-13T11:13:17.947 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:13:17 smithi178 sudo[46225]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T11:13:17.947 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:13:17 smithi178 sudo[46225]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T11:13:17.947 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:13:17 smithi178 sudo[46225]: pam_unix(sudo:session): session closed for user root 2024-06-13T11:13:18.466 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:18 smithi002 sudo[51319]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-13T11:13:18.466 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:18 smithi002 sudo[51319]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T11:13:18.466 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:18 smithi002 sudo[51319]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T11:13:18.466 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:18 smithi002 sudo[51319]: pam_unix(sudo:session): session closed for user root 2024-06-13T11:13:19.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:18 smithi002 sudo[51345]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-13T11:13:19.016 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:18 smithi002 sudo[51345]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T11:13:19.016 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:18 smithi002 sudo[51345]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T11:13:19.016 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:18 smithi002 sudo[51345]: pam_unix(sudo:session): session closed for user root 2024-06-13T11:13:19.269 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:19 smithi178 sudo[46228]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-13T11:13:19.269 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:19 smithi178 sudo[46228]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T11:13:19.269 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:19 smithi178 sudo[46228]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T11:13:19.269 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:19 smithi178 sudo[46228]: pam_unix(sudo:session): session closed for user root 2024-06-13T11:13:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:19.283+0000 7f64b6a00700 1 -- 172.21.15.2:0/1116919826 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f64b8012050 con 0x7f64c0102f90 2024-06-13T11:13:19.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:19 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:19.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:19 smithi002 ceph-mon[32210]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T11:13:19.533 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:19 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:19.533 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:19 smithi077 ceph-mon[36410]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T11:13:19.533 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:19 smithi077 sudo[44753]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-13T11:13:19.533 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:19 smithi077 sudo[44753]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T11:13:19.533 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:19 smithi077 sudo[44753]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T11:13:19.533 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:19 smithi077 sudo[44753]: pam_unix(sudo:session): session closed for user root 2024-06-13T11:13:19.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:19 smithi178 sudo[46231]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-13T11:13:19.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:19 smithi178 sudo[46231]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T11:13:19.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:19 smithi178 sudo[46231]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T11:13:19.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:19 smithi178 sudo[46231]: pam_unix(sudo:session): session closed for user root 2024-06-13T11:13:19.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:19 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:19.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:19 smithi178 ceph-mon[36913]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T11:13:19.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:19 smithi077 sudo[44756]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-13T11:13:19.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:19 smithi077 sudo[44756]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T11:13:19.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:19 smithi077 sudo[44756]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T11:13:19.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:19 smithi077 sudo[44756]: pam_unix(sudo:session): session closed for user root 2024-06-13T11:13:20.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: pgmap v97: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:20.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T11:13:20.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:13:20.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:13:20.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:13:20.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T11:13:20.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:13:20.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:13:20.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:13:20.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: pgmap v98: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:20.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T11:13:20.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T11:13:20.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-06-13T11:13:20.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:13:20.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:13:20.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:13:20.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:20 smithi077 ceph-mon[36410]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T11:13:20.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: pgmap v97: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:20.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T11:13:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:13:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:13:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:13:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T11:13:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:13:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:13:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:13:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: pgmap v98: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T11:13:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T11:13:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-06-13T11:13:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:13:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:13:20.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:13:20.648 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:20 smithi002 ceph-mon[32210]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T11:13:20.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: pgmap v97: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:20.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T11:13:20.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:13:20.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:13:20.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:13:20.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T11:13:20.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:13:20.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:13:20.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:13:20.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: pgmap v98: 1 pgs: 1 creating+peering; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:20.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T11:13:20.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T11:13:20.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-06-13T11:13:20.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:13:20.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:13:20.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:13:20.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:20 smithi178 ceph-mon[36913]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T11:13:21.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:21 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2759942058' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3847bd4f-ca04-41de-9d88-e1523dd7ff8d"}]: dispatch 2024-06-13T11:13:21.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:21 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2759942058' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3847bd4f-ca04-41de-9d88-e1523dd7ff8d"}]': finished 2024-06-13T11:13:21.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:21 smithi077 ceph-mon[36410]: osdmap e22: 4 total, 3 up, 4 in 2024-06-13T11:13:21.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:21 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:13:21.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:21 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2759942058' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3847bd4f-ca04-41de-9d88-e1523dd7ff8d"}]: dispatch 2024-06-13T11:13:21.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:21 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2759942058' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3847bd4f-ca04-41de-9d88-e1523dd7ff8d"}]': finished 2024-06-13T11:13:21.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:21 smithi002 ceph-mon[32210]: osdmap e22: 4 total, 3 up, 4 in 2024-06-13T11:13:21.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:21 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:13:21.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:21 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2759942058' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3847bd4f-ca04-41de-9d88-e1523dd7ff8d"}]: dispatch 2024-06-13T11:13:21.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:21 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2759942058' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3847bd4f-ca04-41de-9d88-e1523dd7ff8d"}]': finished 2024-06-13T11:13:21.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:21 smithi178 ceph-mon[36913]: osdmap e22: 4 total, 3 up, 4 in 2024-06-13T11:13:21.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:21 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:13:22.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:22 smithi077 ceph-mon[36410]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:22.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:22 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3564198284' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:13:22.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:22 smithi002 ceph-mon[32210]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:22.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:22 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3564198284' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:13:22.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:22 smithi178 ceph-mon[36913]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:22.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:22 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3564198284' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:13:24.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:24 smithi077 ceph-mon[36410]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:24.541 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:24 smithi002 ceph-mon[32210]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:24.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:24 smithi178 ceph-mon[36913]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:26.548 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:26 smithi002 ceph-mon[32210]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 55 KiB/s wr, 5 op/s 2024-06-13T11:13:26.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:26 smithi178 ceph-mon[36913]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 55 KiB/s wr, 5 op/s 2024-06-13T11:13:26.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:26 smithi077 ceph-mon[36410]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 55 KiB/s wr, 5 op/s 2024-06-13T11:13:28.592 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:28 smithi077 ceph-mon[36410]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 39 KiB/s wr, 3 op/s 2024-06-13T11:13:28.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:28 smithi002 ceph-mon[32210]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 39 KiB/s wr, 3 op/s 2024-06-13T11:13:28.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:28 smithi178 ceph-mon[36913]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 39 KiB/s wr, 3 op/s 2024-06-13T11:13:30.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:30 smithi002 ceph-mon[32210]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 30 KiB/s wr, 2 op/s 2024-06-13T11:13:30.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-13T11:13:30.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:30.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:30 smithi002 ceph-mon[32210]: Deploying daemon osd.3 on smithi002 2024-06-13T11:13:30.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:30 smithi178 ceph-mon[36913]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 30 KiB/s wr, 2 op/s 2024-06-13T11:13:30.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-13T11:13:30.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:30.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:30 smithi178 ceph-mon[36913]: Deploying daemon osd.3 on smithi002 2024-06-13T11:13:30.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:30 smithi077 ceph-mon[36410]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 30 KiB/s wr, 2 op/s 2024-06-13T11:13:30.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-13T11:13:30.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:30.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:30 smithi077 ceph-mon[36410]: Deploying daemon osd.3 on smithi002 2024-06-13T11:13:32.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:32 smithi002 ceph-mon[32210]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 948 B/s rd, 24 KiB/s wr, 2 op/s 2024-06-13T11:13:32.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:32 smithi178 ceph-mon[36913]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 948 B/s rd, 24 KiB/s wr, 2 op/s 2024-06-13T11:13:32.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:32 smithi077 ceph-mon[36410]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 948 B/s rd, 24 KiB/s wr, 2 op/s 2024-06-13T11:13:34.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:34 smithi002 ceph-mon[32210]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-06-13T11:13:34.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:34 smithi178 ceph-mon[36913]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-06-13T11:13:34.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:34 smithi077 ceph-mon[36410]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-06-13T11:13:36.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:36 smithi002 ceph-mon[32210]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-06-13T11:13:36.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:36 smithi178 ceph-mon[36913]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-06-13T11:13:36.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:36 smithi077 ceph-mon[36410]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-06-13T11:13:38.764 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:38 smithi002 ceph-mon[32210]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:38.764 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:38.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:38.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:13:38.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:38 smithi178 ceph-mon[36913]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:38.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:38.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:38.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:13:39.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:38 smithi077 ceph-mon[36410]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:39.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:39.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:39.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:13:40.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:40 smithi002 ceph-mon[32210]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:40.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:40 smithi178 ceph-mon[36913]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:41.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:40 smithi077 ceph-mon[36410]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:42.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:42.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:42.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:42.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:13:42.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:42.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:42.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:42.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:42.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:13:42.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:42.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:42.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:42.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:42.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:13:42.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:42.716 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 3 on host 'smithi002' 2024-06-13T11:13:42.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:42.715+0000 7f64b6a00700 1 -- 172.21.15.2:0/1116919826 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f64c00febc0 con 0x7f64a40a2c10 2024-06-13T11:13:42.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:42.719+0000 7f64c4c00700 1 -- 172.21.15.2:0/1116919826 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f64a40a2c10 msgr2=0x7f64a40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:13:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:42.719+0000 7f64c4c00700 1 --2- 172.21.15.2:0/1116919826 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f64a40a2c10 0x7f64a40a50d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f64b00038c0 tx=0x7f64b0005fb0 comp rx=0 tx=0).stop 2024-06-13T11:13:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:42.719+0000 7f64c4c00700 1 -- 172.21.15.2:0/1116919826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64c0102f90 msgr2=0x7f64c01a1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:13:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:42.719+0000 7f64c4c00700 1 --2- 172.21.15.2:0/1116919826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64c0102f90 0x7f64c01a1fd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f64b800efc0 tx=0x7f64b800c3a0 comp rx=0 tx=0).stop 2024-06-13T11:13:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:42.719+0000 7f64c4c00700 1 -- 172.21.15.2:0/1116919826 shutdown_connections 2024-06-13T11:13:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:42.719+0000 7f64c4c00700 1 --2- 172.21.15.2:0/1116919826 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f64a40a2c10 0x7f64a40a50d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:42.719+0000 7f64c4c00700 1 --2- 172.21.15.2:0/1116919826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64c01013f0 0x7f64c019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:42.719+0000 7f64c4c00700 1 --2- 172.21.15.2:0/1116919826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64c0102f90 0x7f64c01a1fd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:42.719+0000 7f64c4c00700 1 --2- 172.21.15.2:0/1116919826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64c01025f0 0x7f64c019af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:42.719+0000 7f64c4c00700 1 -- 172.21.15.2:0/1116919826 >> 172.21.15.2:0/1116919826 conn(0x7f64c00fc990 msgr2=0x7f64c00fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:13:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:42.719+0000 7f64c4c00700 1 -- 172.21.15.2:0/1116919826 shutdown_connections 2024-06-13T11:13:42.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:13:42.719+0000 7f64c4c00700 1 -- 172.21.15.2:0/1116919826 wait complete. 2024-06-13T11:13:42.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:42 smithi002 ceph-mon[32210]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:42.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:42 smithi002 ceph-mon[32210]: from='osd.3 [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-13T11:13:42.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:42 smithi002 ceph-mon[32210]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-13T11:13:42.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:42 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:42.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:42 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:42.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:42 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:13:43.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:42 smithi178 ceph-mon[36913]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:42 smithi178 ceph-mon[36913]: from='osd.3 [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-13T11:13:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:42 smithi178 ceph-mon[36913]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-13T11:13:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:42 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:42 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:42 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:13:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:42 smithi077 ceph-mon[36410]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:42 smithi077 ceph-mon[36410]: from='osd.3 [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-13T11:13:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:42 smithi077 ceph-mon[36410]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-13T11:13:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:42 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:42 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:42 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:13:43.480 DEBUG:teuthology.orchestra.run.smithi002:osd.3> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.3.service 2024-06-13T11:13:43.485 INFO:tasks.cephadm:Deploying osd.4 on smithi077 with /dev/vg_nvme/lv_3... 2024-06-13T11:13:43.485 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-13T11:13:43.727 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T11:13:44.006 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:43 smithi002 ceph-mon[32210]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-13T11:13:44.006 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:43 smithi002 ceph-mon[32210]: osdmap e23: 4 total, 3 up, 4 in 2024-06-13T11:13:44.006 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:43 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:13:44.006 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:43 smithi002 ceph-mon[32210]: from='osd.3 [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:13:44.006 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:43 smithi002 ceph-mon[32210]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:13:44.007 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:13:43 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-3[53449]: 2024-06-13T11:13:43.849+0000 7fc883000700 -1 osd.3 0 waiting for initial osdmap 2024-06-13T11:13:44.007 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:13:43 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-3[53449]: 2024-06-13T11:13:43.859+0000 7fc87de00700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:13:44.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:43 smithi077 ceph-mon[36410]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-13T11:13:44.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:43 smithi077 ceph-mon[36410]: osdmap e23: 4 total, 3 up, 4 in 2024-06-13T11:13:44.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:43 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:13:44.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:43 smithi077 ceph-mon[36410]: from='osd.3 [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:13:44.091 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:43 smithi077 ceph-mon[36410]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:13:44.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:43 smithi178 ceph-mon[36913]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-13T11:13:44.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:43 smithi178 ceph-mon[36913]: osdmap e23: 4 total, 3 up, 4 in 2024-06-13T11:13:44.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:43 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:13:44.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:43 smithi178 ceph-mon[36913]: from='osd.3 [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:13:44.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:43 smithi178 ceph-mon[36913]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:13:44.973 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:44 smithi077 ceph-mon[36410]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:44.973 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:44 smithi077 ceph-mon[36410]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T11:13:44.973 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:44 smithi077 ceph-mon[36410]: osdmap e24: 4 total, 3 up, 4 in 2024-06-13T11:13:44.973 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:13:44.973 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:13:44.973 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:44 smithi077 ceph-mon[36410]: osd.3 [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353] boot 2024-06-13T11:13:44.973 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:44 smithi077 ceph-mon[36410]: osdmap e25: 4 total, 4 up, 4 in 2024-06-13T11:13:44.973 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:13:45.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:44 smithi002 ceph-mon[32210]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:45.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:44 smithi002 ceph-mon[32210]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T11:13:45.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:44 smithi002 ceph-mon[32210]: osdmap e24: 4 total, 3 up, 4 in 2024-06-13T11:13:45.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:13:45.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:13:45.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:44 smithi002 ceph-mon[32210]: osd.3 [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353] boot 2024-06-13T11:13:45.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:44 smithi002 ceph-mon[32210]: osdmap e25: 4 total, 4 up, 4 in 2024-06-13T11:13:45.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:13:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:44 smithi178 ceph-mon[36913]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-06-13T11:13:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:44 smithi178 ceph-mon[36913]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T11:13:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:44 smithi178 ceph-mon[36913]: osdmap e24: 4 total, 3 up, 4 in 2024-06-13T11:13:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:13:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:13:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:44 smithi178 ceph-mon[36913]: osd.3 [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353] boot 2024-06-13T11:13:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:44 smithi178 ceph-mon[36913]: osdmap e25: 4 total, 4 up, 4 in 2024-06-13T11:13:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:13:45.641 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-13T11:13:45.641 INFO:teuthology.orchestra.run.smithi077.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-13T11:13:45.641 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10+0 records in 2024-06-13T11:13:45.641 INFO:teuthology.orchestra.run.smithi077.stderr:10+0 records out 2024-06-13T11:13:45.641 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0132502 s, 791 MB/s 2024-06-13T11:13:45.641 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping successful for: 2024-06-13T11:13:45.959 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:45 smithi077 ceph-mon[36410]: purged_snaps scrub starts 2024-06-13T11:13:45.959 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:45 smithi077 ceph-mon[36410]: purged_snaps scrub ok 2024-06-13T11:13:45.959 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:45 smithi077 ceph-mon[36410]: osdmap e26: 4 total, 4 up, 4 in 2024-06-13T11:13:46.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:45 smithi002 ceph-mon[32210]: purged_snaps scrub starts 2024-06-13T11:13:46.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:45 smithi002 ceph-mon[32210]: purged_snaps scrub ok 2024-06-13T11:13:46.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:45 smithi002 ceph-mon[32210]: osdmap e26: 4 total, 4 up, 4 in 2024-06-13T11:13:46.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:45 smithi178 ceph-mon[36913]: purged_snaps scrub starts 2024-06-13T11:13:46.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:45 smithi178 ceph-mon[36913]: purged_snaps scrub ok 2024-06-13T11:13:46.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:45 smithi178 ceph-mon[36913]: osdmap e26: 4 total, 4 up, 4 in 2024-06-13T11:13:46.297 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_3 2024-06-13T11:13:46.538 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T11:13:47.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:46 smithi002 ceph-mon[32210]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:13:47.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:46 smithi002 ceph-mon[32210]: osdmap e27: 4 total, 4 up, 4 in 2024-06-13T11:13:47.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:46 smithi178 ceph-mon[36913]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:13:47.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:46 smithi178 ceph-mon[36913]: osdmap e27: 4 total, 4 up, 4 in 2024-06-13T11:13:47.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:46 smithi077 ceph-mon[36410]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:13:47.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:46 smithi077 ceph-mon[36410]: osdmap e27: 4 total, 4 up, 4 in 2024-06-13T11:13:48.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.206+0000 7f6828d1a700 1 -- 172.21.15.77:0/2336302769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68241036f0 msgr2=0x7f6824103b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:13:48.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.206+0000 7f6828d1a700 1 --2- 172.21.15.77:0/2336302769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68241036f0 0x7f6824103b50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f68140099c0 tx=0x7f6814009cd0 comp rx=0 tx=0).stop 2024-06-13T11:13:48.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.206+0000 7f6828d1a700 1 -- 172.21.15.77:0/2336302769 shutdown_connections 2024-06-13T11:13:48.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.206+0000 7f6828d1a700 1 --2- 172.21.15.77:0/2336302769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68241024f0 0x7f6824102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:48.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.206+0000 7f6828d1a700 1 --2- 172.21.15.77:0/2336302769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6824104090 0x7f682410a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:48.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.206+0000 7f6828d1a700 1 --2- 172.21.15.77:0/2336302769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68241036f0 0x7f6824103b50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:48.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.206+0000 7f6828d1a700 1 -- 172.21.15.77:0/2336302769 >> 172.21.15.77:0/2336302769 conn(0x7f68240fda90 msgr2=0x7f68240ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:13:48.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.206+0000 7f6828d1a700 1 -- 172.21.15.77:0/2336302769 shutdown_connections 2024-06-13T11:13:48.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.206+0000 7f6828d1a700 1 -- 172.21.15.77:0/2336302769 wait complete. 2024-06-13T11:13:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.207+0000 7f6828d1a700 1 Processor -- start 2024-06-13T11:13:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.207+0000 7f6828d1a700 1 -- start start 2024-06-13T11:13:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.207+0000 7f6828d1a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68241024f0 0x7f6824076230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:13:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.207+0000 7f6828d1a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68241036f0 0x7f6824074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:13:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.207+0000 7f6828d1a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6824104090 0x7f6824074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:13:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.207+0000 7f6828d1a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f682410e1d0 con 0x7f68241024f0 2024-06-13T11:13:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.207+0000 7f6828d1a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f682410e050 con 0x7f68241036f0 2024-06-13T11:13:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.207+0000 7f6828d1a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f682410e350 con 0x7f6824104090 2024-06-13T11:13:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.207+0000 7f6821d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68241036f0 0x7f6824074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:13:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.208+0000 7f6821d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68241036f0 0x7f6824074880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39896/0 (socket says 172.21.15.77:39896) 2024-06-13T11:13:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.208+0000 7f6821d9b700 1 -- 172.21.15.77:0/2585000678 learned_addr learned my addr 172.21.15.77:0/2585000678 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-06-13T11:13:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.208+0000 7f6822d9d700 1 --2- 172.21.15.77:0/2585000678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6824104090 0x7f6824074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:13:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.208+0000 7f6821d9b700 1 -- 172.21.15.77:0/2585000678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6824104090 msgr2=0x7f6824074dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:13:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.208+0000 7f6821d9b700 1 --2- 172.21.15.77:0/2585000678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6824104090 0x7f6824074dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.208+0000 7f6821d9b700 1 -- 172.21.15.77:0/2585000678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68241024f0 msgr2=0x7f6824076230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:13:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.208+0000 7f6821d9b700 1 --2- 172.21.15.77:0/2585000678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68241024f0 0x7f6824076230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:13:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.208+0000 7f6821d9b700 1 -- 172.21.15.77:0/2585000678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6824075670 con 0x7f68241036f0 2024-06-13T11:13:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.208+0000 7f6821d9b700 1 --2- 172.21.15.77:0/2585000678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68241036f0 0x7f6824074880 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6814003890 tx=0x7f6814003730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:13:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.208+0000 7f68137fe700 1 -- 172.21.15.77:0/2585000678 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6814027070 con 0x7f68241036f0 2024-06-13T11:13:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.208+0000 7f6828d1a700 1 -- 172.21.15.77:0/2585000678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68241a29c0 con 0x7f68241036f0 2024-06-13T11:13:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.208+0000 7f68137fe700 1 -- 172.21.15.77:0/2585000678 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6814022470 con 0x7f68241036f0 2024-06-13T11:13:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.208+0000 7f68137fe700 1 -- 172.21.15.77:0/2585000678 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681400f6c0 con 0x7f68241036f0 2024-06-13T11:13:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.208+0000 7f6828d1a700 1 -- 172.21.15.77:0/2585000678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68241a2e90 con 0x7f68241036f0 2024-06-13T11:13:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.209+0000 7f6828d1a700 1 -- 172.21.15.77:0/2585000678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6804005360 con 0x7f68241036f0 2024-06-13T11:13:48.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.210+0000 7f68137fe700 1 -- 172.21.15.77:0/2585000678 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f681402a070 con 0x7f68241036f0 2024-06-13T11:13:48.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.211+0000 7f68137fe700 1 --2- 172.21.15.77:0/2585000678 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f680c0a2c20 0x7f680c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:13:48.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.211+0000 7f68137fe700 1 -- 172.21.15.77:0/2585000678 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3669+0+0 (secure 0 0 0) 0x7f68140cf290 con 0x7f68241036f0 2024-06-13T11:13:48.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.211+0000 7f682259c700 1 --2- 172.21.15.77:0/2585000678 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f680c0a2c20 0x7f680c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:13:48.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.212+0000 7f682259c700 1 --2- 172.21.15.77:0/2585000678 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f680c0a2c20 0x7f680c0a50e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6824103550 tx=0x7f6818006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:13:48.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.215+0000 7f68137fe700 1 -- 172.21.15.77:0/2585000678 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6814031070 con 0x7f68241036f0 2024-06-13T11:13:48.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:13:48.423+0000 7f6828d1a700 1 -- 172.21.15.77:0/2585000678 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6804000bf0 con 0x7f680c0a2c20 2024-06-13T11:13:49.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:48 smithi077 ceph-mon[36410]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:13:49.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:48 smithi077 ceph-mon[36410]: osdmap e28: 4 total, 4 up, 4 in 2024-06-13T11:13:49.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:49.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:49.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:13:49.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:13:49.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:49.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:49.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:13:49.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:49.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:13:49.140 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:13:49.140 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:48 smithi002 ceph-mon[32210]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:13:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:48 smithi002 ceph-mon[32210]: osdmap e28: 4 total, 4 up, 4 in 2024-06-13T11:13:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:13:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:13:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:13:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:13:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:13:49.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:48 smithi178 ceph-mon[36913]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:13:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:48 smithi178 ceph-mon[36913]: osdmap e28: 4 total, 4 up, 4 in 2024-06-13T11:13:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:13:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:13:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:49.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:13:49.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:13:49.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:13:49.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:13:49.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:49.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:49 smithi178 ceph-mon[36913]: Detected new or changed devices on smithi002 2024-06-13T11:13:49.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:49 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi002 to 8547M 2024-06-13T11:13:49.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:49 smithi178 ceph-mon[36913]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:13:49.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:49 smithi178 ceph-mon[36913]: osdmap e29: 4 total, 4 up, 4 in 2024-06-13T11:13:50.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:49 smithi002 ceph-mon[32210]: Detected new or changed devices on smithi002 2024-06-13T11:13:50.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:49 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi002 to 8547M 2024-06-13T11:13:50.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:49 smithi002 ceph-mon[32210]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:13:50.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:49 smithi002 ceph-mon[32210]: osdmap e29: 4 total, 4 up, 4 in 2024-06-13T11:13:50.240 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:49 smithi077 ceph-mon[36410]: Detected new or changed devices on smithi002 2024-06-13T11:13:50.240 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:49 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi002 to 8547M 2024-06-13T11:13:50.240 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:49 smithi077 ceph-mon[36410]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:13:50.240 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:49 smithi077 ceph-mon[36410]: osdmap e29: 4 total, 4 up, 4 in 2024-06-13T11:13:51.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:50 smithi002 ceph-mon[32210]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:13:51.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:50 smithi178 ceph-mon[36913]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:13:51.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:50 smithi077 ceph-mon[36410]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:13:52.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:51 smithi178 ceph-mon[36913]: from='client.? 172.21.15.77:0/4074807852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34d7d2e8-3dee-42b9-a6cb-d4162b122b48"}]: dispatch 2024-06-13T11:13:52.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:51 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34d7d2e8-3dee-42b9-a6cb-d4162b122b48"}]: dispatch 2024-06-13T11:13:52.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:51 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34d7d2e8-3dee-42b9-a6cb-d4162b122b48"}]': finished 2024-06-13T11:13:52.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:51 smithi178 ceph-mon[36913]: osdmap e30: 5 total, 4 up, 5 in 2024-06-13T11:13:52.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:51 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:13:52.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:51 smithi178 ceph-mon[36913]: from='client.? 172.21.15.77:0/3729050477' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:13:52.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:51 smithi077 ceph-mon[36410]: from='client.? 172.21.15.77:0/4074807852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34d7d2e8-3dee-42b9-a6cb-d4162b122b48"}]: dispatch 2024-06-13T11:13:52.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:51 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34d7d2e8-3dee-42b9-a6cb-d4162b122b48"}]: dispatch 2024-06-13T11:13:52.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:51 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34d7d2e8-3dee-42b9-a6cb-d4162b122b48"}]': finished 2024-06-13T11:13:52.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:51 smithi077 ceph-mon[36410]: osdmap e30: 5 total, 4 up, 5 in 2024-06-13T11:13:52.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:51 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:13:52.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:51 smithi077 ceph-mon[36410]: from='client.? 172.21.15.77:0/3729050477' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:13:52.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:51 smithi002 ceph-mon[32210]: from='client.? 172.21.15.77:0/4074807852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34d7d2e8-3dee-42b9-a6cb-d4162b122b48"}]: dispatch 2024-06-13T11:13:52.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:51 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34d7d2e8-3dee-42b9-a6cb-d4162b122b48"}]: dispatch 2024-06-13T11:13:52.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:51 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34d7d2e8-3dee-42b9-a6cb-d4162b122b48"}]': finished 2024-06-13T11:13:52.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:51 smithi002 ceph-mon[32210]: osdmap e30: 5 total, 4 up, 5 in 2024-06-13T11:13:52.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:51 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:13:52.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:51 smithi002 ceph-mon[32210]: from='client.? 172.21.15.77:0/3729050477' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:13:53.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:52 smithi178 ceph-mon[36913]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-06-13T11:13:53.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:52 smithi077 ceph-mon[36410]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-06-13T11:13:53.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:52 smithi002 ceph-mon[32210]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-06-13T11:13:55.159 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:54 smithi077 ceph-mon[36410]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-13T11:13:55.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:54 smithi178 ceph-mon[36913]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-13T11:13:55.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:54 smithi002 ceph-mon[32210]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-13T11:13:57.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:56 smithi178 ceph-mon[36913]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-06-13T11:13:57.198 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:56 smithi002 ceph-mon[32210]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-06-13T11:13:57.224 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:56 smithi077 ceph-mon[36410]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-06-13T11:13:59.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:58 smithi178 ceph-mon[36913]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-06-13T11:13:59.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:58 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-13T11:13:59.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:58 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:59.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:58 smithi077 ceph-mon[36410]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-06-13T11:13:59.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:58 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-13T11:13:59.216 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:58 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:13:59.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:58 smithi002 ceph-mon[32210]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-06-13T11:13:59.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:58 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-13T11:13:59.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:58 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:00.037 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:13:59 smithi077 ceph-mon[36410]: Deploying daemon osd.4 on smithi077 2024-06-13T11:14:00.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:13:59 smithi178 ceph-mon[36913]: Deploying daemon osd.4 on smithi077 2024-06-13T11:14:00.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:13:59 smithi002 ceph-mon[32210]: Deploying daemon osd.4 on smithi077 2024-06-13T11:14:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:00 smithi077 ceph-mon[36410]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-13T11:14:01.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:00 smithi178 ceph-mon[36913]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-13T11:14:01.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:00 smithi002 ceph-mon[32210]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-13T11:14:03.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:02 smithi077 ceph-mon[36410]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:03.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:02 smithi178 ceph-mon[36913]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:03.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:02 smithi002 ceph-mon[32210]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:04.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:03 smithi178 ceph-mon[36913]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:04.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:03 smithi077 ceph-mon[36410]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:04.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:03 smithi002 ceph-mon[32210]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:05.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:04 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:14:05.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:04 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:05.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:04 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:05.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:04 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:14:05.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:04 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:05.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:04 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:05.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:04 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:14:05.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:04 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:05.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:04 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:06.056 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:05 smithi077 ceph-mon[36410]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:06.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:05 smithi178 ceph-mon[36913]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:06.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:05 smithi002 ceph-mon[32210]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:07.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:14:07.782+0000 7f68137fe700 1 -- 172.21.15.77:0/2585000678 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6804000bf0 con 0x7f680c0a2c20 2024-06-13T11:14:07.782 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 4 on host 'smithi077' 2024-06-13T11:14:07.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:14:07.784+0000 7f6828d1a700 1 -- 172.21.15.77:0/2585000678 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f680c0a2c20 msgr2=0x7f680c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:14:07.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:14:07.784+0000 7f6828d1a700 1 --2- 172.21.15.77:0/2585000678 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f680c0a2c20 0x7f680c0a50e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6824103550 tx=0x7f6818006d20 comp rx=0 tx=0).stop 2024-06-13T11:14:07.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:14:07.784+0000 7f6828d1a700 1 -- 172.21.15.77:0/2585000678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68241036f0 msgr2=0x7f6824074880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:14:07.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:14:07.784+0000 7f6828d1a700 1 --2- 172.21.15.77:0/2585000678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68241036f0 0x7f6824074880 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6814003890 tx=0x7f6814003730 comp rx=0 tx=0).stop 2024-06-13T11:14:07.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:14:07.784+0000 7f6828d1a700 1 -- 172.21.15.77:0/2585000678 shutdown_connections 2024-06-13T11:14:07.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:14:07.784+0000 7f6828d1a700 1 --2- 172.21.15.77:0/2585000678 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f680c0a2c20 0x7f680c0a50e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:07.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:14:07.784+0000 7f6828d1a700 1 --2- 172.21.15.77:0/2585000678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68241024f0 0x7f6824076230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:07.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:14:07.784+0000 7f6828d1a700 1 --2- 172.21.15.77:0/2585000678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6824104090 0x7f6824074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:07.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:14:07.784+0000 7f6828d1a700 1 --2- 172.21.15.77:0/2585000678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68241036f0 0x7f6824074880 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:07.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:14:07.784+0000 7f6828d1a700 1 -- 172.21.15.77:0/2585000678 >> 172.21.15.77:0/2585000678 conn(0x7f68240fda90 msgr2=0x7f6824106ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:14:07.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:14:07.784+0000 7f6828d1a700 1 -- 172.21.15.77:0/2585000678 shutdown_connections 2024-06-13T11:14:07.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:14:07.784+0000 7f6828d1a700 1 -- 172.21.15.77:0/2585000678 wait complete. 2024-06-13T11:14:08.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:07 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:08.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:07 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:08.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:07 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:08.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:07 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:14:08.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:07 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:08.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:07 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:08.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:07 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:08.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:07 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:08.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:07 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:08.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:07 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:08.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:07 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:14:08.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:07 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:08.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:07 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:08.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:07 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:08.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:07 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:08.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:07 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:08.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:07 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:08.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:07 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:14:08.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:07 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:08.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:07 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:08.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:07 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:08.526 DEBUG:teuthology.orchestra.run.smithi077:osd.4> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.4.service 2024-06-13T11:14:08.528 INFO:tasks.cephadm:Deploying osd.5 on smithi178 with /dev/vg_nvme/lv_3... 2024-06-13T11:14:08.529 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-13T11:14:08.766 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:14:09.031 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:08 smithi077 ceph-mon[36410]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:09.031 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:08 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:14:09.031 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:08 smithi077 ceph-mon[36410]: from='osd.4 [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-13T11:14:09.031 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:08 smithi077 ceph-mon[36410]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-13T11:14:09.103 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:08 smithi178 ceph-mon[36913]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:09.103 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:08 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:14:09.103 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:08 smithi178 ceph-mon[36913]: from='osd.4 [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-13T11:14:09.103 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:08 smithi178 ceph-mon[36913]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-13T11:14:09.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:08 smithi002 ceph-mon[32210]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:09.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:08 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:14:09.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:08 smithi002 ceph-mon[32210]: from='osd.4 [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-13T11:14:09.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:08 smithi002 ceph-mon[32210]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-13T11:14:10.119 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:09 smithi178 ceph-mon[36913]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-13T11:14:10.119 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:09 smithi178 ceph-mon[36913]: from='osd.4 [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:14:10.119 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:09 smithi178 ceph-mon[36913]: osdmap e31: 5 total, 4 up, 5 in 2024-06-13T11:14:10.119 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:09 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:14:10.119 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:09 smithi178 ceph-mon[36913]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:14:10.136 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:09 smithi077 ceph-mon[36410]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-13T11:14:10.136 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:09 smithi077 ceph-mon[36410]: from='osd.4 [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:14:10.136 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:09 smithi077 ceph-mon[36410]: osdmap e31: 5 total, 4 up, 5 in 2024-06-13T11:14:10.136 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:09 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:14:10.136 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:09 smithi077 ceph-mon[36410]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:14:10.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:09 smithi002 ceph-mon[32210]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-13T11:14:10.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:09 smithi002 ceph-mon[32210]: from='osd.4 [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:14:10.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:09 smithi002 ceph-mon[32210]: osdmap e31: 5 total, 4 up, 5 in 2024-06-13T11:14:10.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:09 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:14:10.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:09 smithi002 ceph-mon[32210]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:14:10.488 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:14:10 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4[47483]: 2024-06-13T11:14:10.269+0000 7f9f08f28700 -1 osd.4 0 waiting for initial osdmap 2024-06-13T11:14:10.488 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:14:10 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4[47483]: 2024-06-13T11:14:10.274+0000 7f9f00512700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:14:10.811 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-13T11:14:10.811 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-13T11:14:10.811 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2024-06-13T11:14:10.811 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2024-06-13T11:14:10.811 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0085816 s, 1.2 GB/s 2024-06-13T11:14:10.811 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2024-06-13T11:14:11.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:10 smithi002 ceph-mon[32210]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:11.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:10 smithi002 ceph-mon[32210]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-06-13T11:14:11.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:10 smithi002 ceph-mon[32210]: osdmap e32: 5 total, 4 up, 5 in 2024-06-13T11:14:11.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:10 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:14:11.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:10 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:14:11.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:10 smithi002 ceph-mon[32210]: from='osd.4 ' entity='osd.4' 2024-06-13T11:14:11.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:10 smithi178 ceph-mon[36913]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:11.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:10 smithi178 ceph-mon[36913]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-06-13T11:14:11.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:10 smithi178 ceph-mon[36913]: osdmap e32: 5 total, 4 up, 5 in 2024-06-13T11:14:11.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:10 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:14:11.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:10 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:14:11.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:10 smithi178 ceph-mon[36913]: from='osd.4 ' entity='osd.4' 2024-06-13T11:14:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:10 smithi077 ceph-mon[36410]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:10 smithi077 ceph-mon[36410]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-06-13T11:14:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:10 smithi077 ceph-mon[36410]: osdmap e32: 5 total, 4 up, 5 in 2024-06-13T11:14:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:10 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:14:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:10 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:14:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:10 smithi077 ceph-mon[36410]: from='osd.4 ' entity='osd.4' 2024-06-13T11:14:11.469 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi178:vg_nvme/lv_3 2024-06-13T11:14:11.699 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:14:12.144 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:11 smithi178 ceph-mon[36913]: purged_snaps scrub starts 2024-06-13T11:14:12.144 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:11 smithi178 ceph-mon[36913]: purged_snaps scrub ok 2024-06-13T11:14:12.144 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:11 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:14:12.144 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:11 smithi178 ceph-mon[36913]: osd.4 [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904] boot 2024-06-13T11:14:12.144 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:11 smithi178 ceph-mon[36913]: osdmap e33: 5 total, 5 up, 5 in 2024-06-13T11:14:12.144 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:11 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:14:12.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:11 smithi002 ceph-mon[32210]: purged_snaps scrub starts 2024-06-13T11:14:12.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:11 smithi002 ceph-mon[32210]: purged_snaps scrub ok 2024-06-13T11:14:12.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:11 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:14:12.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:11 smithi002 ceph-mon[32210]: osd.4 [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904] boot 2024-06-13T11:14:12.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:11 smithi002 ceph-mon[32210]: osdmap e33: 5 total, 5 up, 5 in 2024-06-13T11:14:12.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:11 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:14:12.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:11 smithi077 ceph-mon[36410]: purged_snaps scrub starts 2024-06-13T11:14:12.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:11 smithi077 ceph-mon[36410]: purged_snaps scrub ok 2024-06-13T11:14:12.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:11 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:14:12.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:11 smithi077 ceph-mon[36410]: osd.4 [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904] boot 2024-06-13T11:14:12.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:11 smithi077 ceph-mon[36410]: osdmap e33: 5 total, 5 up, 5 in 2024-06-13T11:14:12.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:11 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:14:13.102 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:12 smithi178 ceph-mon[36913]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:13.102 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:13.102 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:13.102 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:14:13.102 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:14:13.102 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:13.103 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:13.103 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:14:13.103 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:12 smithi002 ceph-mon[32210]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:14:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:14:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:14:13.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:13.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.206+0000 7f8e03f0a700 1 -- 172.21.15.178:0/701876881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dfc101e50 msgr2=0x7f8dfc1022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:14:13.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.206+0000 7f8e03f0a700 1 --2- 172.21.15.178:0/701876881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dfc101e50 0x7f8dfc1022b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00aaa0 tx=0x7f8dec00adb0 comp rx=0 tx=0).stop 2024-06-13T11:14:13.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.206+0000 7f8e03f0a700 1 -- 172.21.15.178:0/701876881 shutdown_connections 2024-06-13T11:14:13.207 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.206+0000 7f8e03f0a700 1 --2- 172.21.15.178:0/701876881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dfc1027f0 0x7f8dfc1090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:13.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.206+0000 7f8e03f0a700 1 --2- 172.21.15.178:0/701876881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dfc100c50 0x7f8dfc101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:13.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.206+0000 7f8e03f0a700 1 --2- 172.21.15.178:0/701876881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dfc101e50 0x7f8dfc1022b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:13.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.206+0000 7f8e03f0a700 1 -- 172.21.15.178:0/701876881 >> 172.21.15.178:0/701876881 conn(0x7f8dfc0fc1f0 msgr2=0x7f8dfc0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:14:13.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.206+0000 7f8e03f0a700 1 -- 172.21.15.178:0/701876881 shutdown_connections 2024-06-13T11:14:13.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.206+0000 7f8e03f0a700 1 -- 172.21.15.178:0/701876881 wait complete. 2024-06-13T11:14:13.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.206+0000 7f8e03f0a700 1 Processor -- start 2024-06-13T11:14:13.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.206+0000 7f8e03f0a700 1 -- start start 2024-06-13T11:14:13.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e03f0a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dfc100c50 0x7f8dfc198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:14:13.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e03f0a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dfc101e50 0x7f8dfc198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:14:13.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e03f0a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dfc1027f0 0x7f8dfc19fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:14:13.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e03f0a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc10c100 con 0x7f8dfc1027f0 2024-06-13T11:14:13.208 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e03f0a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc10bf80 con 0x7f8dfc100c50 2024-06-13T11:14:13.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e03f0a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc10c280 con 0x7f8dfc101e50 2024-06-13T11:14:13.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e014a5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dfc101e50 0x7f8dfc198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:14:13.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e014a5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dfc101e50 0x7f8dfc198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:52830/0 (socket says 172.21.15.178:52830) 2024-06-13T11:14:13.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e014a5700 1 -- 172.21.15.178:0/493929102 learned_addr learned my addr 172.21.15.178:0/493929102 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-13T11:14:13.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e014a5700 1 -- 172.21.15.178:0/493929102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dfc100c50 msgr2=0x7f8dfc198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:14:13.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e01ca6700 1 --2- 172.21.15.178:0/493929102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dfc100c50 0x7f8dfc198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:14:13.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e014a5700 1 --2- 172.21.15.178:0/493929102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dfc100c50 0x7f8dfc198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:13.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e014a5700 1 -- 172.21.15.178:0/493929102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dfc1027f0 msgr2=0x7f8dfc19fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:14:13.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e014a5700 1 --2- 172.21.15.178:0/493929102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dfc1027f0 0x7f8dfc19fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:13.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e014a5700 1 -- 172.21.15.178:0/493929102 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dfc1a0590 con 0x7f8dfc101e50 2024-06-13T11:14:13.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e014a5700 1 --2- 172.21.15.178:0/493929102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dfc101e50 0x7f8dfc198e70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8dec004800 tx=0x7f8dec004250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:14:13.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8df2ffd700 1 -- 172.21.15.178:0/493929102 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec023020 con 0x7f8dfc101e50 2024-06-13T11:14:13.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8df2ffd700 1 -- 172.21.15.178:0/493929102 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dec0039d0 con 0x7f8dfc101e50 2024-06-13T11:14:13.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e03f0a700 1 -- 172.21.15.178:0/493929102 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dfc1a0820 con 0x7f8dfc101e50 2024-06-13T11:14:13.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8df2ffd700 1 -- 172.21.15.178:0/493929102 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec016820 con 0x7f8dfc101e50 2024-06-13T11:14:13.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.207+0000 7f8e03f0a700 1 -- 172.21.15.178:0/493929102 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dfc1a0cf0 con 0x7f8dfc101e50 2024-06-13T11:14:13.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.208+0000 7f8e03f0a700 1 -- 172.21.15.178:0/493929102 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dfc1a0f50 con 0x7f8dfc101e50 2024-06-13T11:14:13.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.209+0000 7f8df2ffd700 1 -- 172.21.15.178:0/493929102 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f8dec026020 con 0x7f8dfc101e50 2024-06-13T11:14:13.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.210+0000 7f8df2ffd700 1 --2- 172.21.15.178:0/493929102 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8de80a2c20 0x7f8de80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:14:13.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.210+0000 7f8df2ffd700 1 -- 172.21.15.178:0/493929102 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7f8dec0cfa90 con 0x7f8dfc101e50 2024-06-13T11:14:13.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.210+0000 7f8e01ca6700 1 --2- 172.21.15.178:0/493929102 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8de80a2c20 0x7f8de80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:14:13.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.211+0000 7f8e01ca6700 1 --2- 172.21.15.178:0/493929102 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8de80a2c20 0x7f8de80a50e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8df4006fd0 tx=0x7f8df4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:14:13.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.215+0000 7f8df2ffd700 1 -- 172.21.15.178:0/493929102 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8dec02d020 con 0x7f8dfc101e50 2024-06-13T11:14:13.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:12 smithi077 ceph-mon[36410]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-06-13T11:14:13.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:13.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:13.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:14:13.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:14:13.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:13.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:13.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:14:13.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:13.415 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:13.416+0000 7f8e03f0a700 1 -- 172.21.15.178:0/493929102 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8dfc1089b0 con 0x7f8de80a2c20 2024-06-13T11:14:14.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:13 smithi002 ceph-mon[32210]: Detected new or changed devices on smithi077 2024-06-13T11:14:14.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:13 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi077 to 8544M 2024-06-13T11:14:14.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:13 smithi002 ceph-mon[32210]: osdmap e34: 5 total, 5 up, 5 in 2024-06-13T11:14:14.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:14:14.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:14:14.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:14.175 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:13 smithi178 ceph-mon[36913]: Detected new or changed devices on smithi077 2024-06-13T11:14:14.175 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:13 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi077 to 8544M 2024-06-13T11:14:14.175 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:13 smithi178 ceph-mon[36913]: osdmap e34: 5 total, 5 up, 5 in 2024-06-13T11:14:14.175 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:14:14.175 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:14:14.176 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:14.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:13 smithi077 ceph-mon[36410]: Detected new or changed devices on smithi077 2024-06-13T11:14:14.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:13 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi077 to 8544M 2024-06-13T11:14:14.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:13 smithi077 ceph-mon[36410]: osdmap e34: 5 total, 5 up, 5 in 2024-06-13T11:14:14.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:14:14.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:14:14.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:15.111 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:14 smithi178 ceph-mon[36913]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:15.112 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:14 smithi178 ceph-mon[36913]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:14:15.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:14 smithi002 ceph-mon[32210]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:15.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:14 smithi002 ceph-mon[32210]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:14:15.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:14 smithi077 ceph-mon[36410]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:15.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:14 smithi077 ceph-mon[36410]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:14:17.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:16 smithi002 ceph-mon[32210]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:17.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:16 smithi002 ceph-mon[32210]: from='client.? 172.21.15.178:0/899745105' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0468aefc-c3c8-4758-9bbf-1225b7a5ae79"}]: dispatch 2024-06-13T11:14:17.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:16 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0468aefc-c3c8-4758-9bbf-1225b7a5ae79"}]: dispatch 2024-06-13T11:14:17.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:16 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0468aefc-c3c8-4758-9bbf-1225b7a5ae79"}]': finished 2024-06-13T11:14:17.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:16 smithi002 ceph-mon[32210]: osdmap e35: 6 total, 5 up, 6 in 2024-06-13T11:14:17.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:16 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T11:14:17.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:16 smithi002 ceph-mon[32210]: from='client.? 172.21.15.178:0/1528763372' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:14:17.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:16 smithi178 ceph-mon[36913]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:17.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:16 smithi178 ceph-mon[36913]: from='client.? 172.21.15.178:0/899745105' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0468aefc-c3c8-4758-9bbf-1225b7a5ae79"}]: dispatch 2024-06-13T11:14:17.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:16 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0468aefc-c3c8-4758-9bbf-1225b7a5ae79"}]: dispatch 2024-06-13T11:14:17.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:16 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0468aefc-c3c8-4758-9bbf-1225b7a5ae79"}]': finished 2024-06-13T11:14:17.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:16 smithi178 ceph-mon[36913]: osdmap e35: 6 total, 5 up, 6 in 2024-06-13T11:14:17.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:16 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T11:14:17.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:16 smithi178 ceph-mon[36913]: from='client.? 172.21.15.178:0/1528763372' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:14:17.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:16 smithi077 ceph-mon[36410]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:17.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:16 smithi077 ceph-mon[36410]: from='client.? 172.21.15.178:0/899745105' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0468aefc-c3c8-4758-9bbf-1225b7a5ae79"}]: dispatch 2024-06-13T11:14:17.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:16 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0468aefc-c3c8-4758-9bbf-1225b7a5ae79"}]: dispatch 2024-06-13T11:14:17.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:16 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0468aefc-c3c8-4758-9bbf-1225b7a5ae79"}]': finished 2024-06-13T11:14:17.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:16 smithi077 ceph-mon[36410]: osdmap e35: 6 total, 5 up, 6 in 2024-06-13T11:14:17.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:16 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T11:14:17.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:16 smithi077 ceph-mon[36410]: from='client.? 172.21.15.178:0/1528763372' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:14:19.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:18 smithi002 ceph-mon[32210]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:19.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:18 smithi178 ceph-mon[36913]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:19.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:18 smithi077 ceph-mon[36410]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:21.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:20 smithi002 ceph-mon[32210]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:21.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:20 smithi178 ceph-mon[36913]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:21.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:20 smithi077 ceph-mon[36410]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:22.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:22 smithi178 ceph-mon[36913]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:23.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:22 smithi002 ceph-mon[32210]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:23.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:22 smithi077 ceph-mon[36410]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:24.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:23 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-13T11:14:24.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:23 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:24.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:23 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-13T11:14:24.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:23 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:24.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:23 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-13T11:14:24.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:23 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:25.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:24 smithi002 ceph-mon[32210]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:25.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:24 smithi002 ceph-mon[32210]: Deploying daemon osd.5 on smithi178 2024-06-13T11:14:25.176 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:24 smithi178 ceph-mon[36913]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:25.177 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:24 smithi178 ceph-mon[36913]: Deploying daemon osd.5 on smithi178 2024-06-13T11:14:25.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:24 smithi077 ceph-mon[36410]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:25.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:24 smithi077 ceph-mon[36410]: Deploying daemon osd.5 on smithi178 2024-06-13T11:14:27.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:26 smithi002 ceph-mon[32210]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:27.179 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:26 smithi178 ceph-mon[36913]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:27.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:26 smithi077 ceph-mon[36410]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:29.152 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:28 smithi178 ceph-mon[36913]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:29.152 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:28 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:29.152 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:28 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:29.152 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:28 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:14:29.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:28 smithi077 ceph-mon[36410]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:29.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:28 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:29.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:28 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:29.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:28 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:14:29.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:28 smithi002 ceph-mon[32210]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:29.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:28 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:29.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:28 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:29.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:28 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:14:31.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:30 smithi178 ceph-mon[36913]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:31.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:30 smithi002 ceph-mon[32210]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:31.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:30 smithi077 ceph-mon[36410]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:32.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:32.304+0000 7f8df2ffd700 1 -- 172.21.15.178:0/493929102 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8dfc1089b0 con 0x7f8de80a2c20 2024-06-13T11:14:32.304 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 5 on host 'smithi178' 2024-06-13T11:14:32.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:32.306+0000 7f8e03f0a700 1 -- 172.21.15.178:0/493929102 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8de80a2c20 msgr2=0x7f8de80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:14:32.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:32.306+0000 7f8e03f0a700 1 --2- 172.21.15.178:0/493929102 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8de80a2c20 0x7f8de80a50e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8df4006fd0 tx=0x7f8df4008040 comp rx=0 tx=0).stop 2024-06-13T11:14:32.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:32.306+0000 7f8e03f0a700 1 -- 172.21.15.178:0/493929102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dfc101e50 msgr2=0x7f8dfc198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:14:32.306 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:32.306+0000 7f8e03f0a700 1 --2- 172.21.15.178:0/493929102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dfc101e50 0x7f8dfc198e70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8dec004800 tx=0x7f8dec004250 comp rx=0 tx=0).stop 2024-06-13T11:14:32.307 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:32.306+0000 7f8e03f0a700 1 -- 172.21.15.178:0/493929102 shutdown_connections 2024-06-13T11:14:32.307 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:32.306+0000 7f8e03f0a700 1 --2- 172.21.15.178:0/493929102 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8de80a2c20 0x7f8de80a50e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:32.307 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:32.306+0000 7f8e03f0a700 1 --2- 172.21.15.178:0/493929102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dfc1027f0 0x7f8dfc19fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:32.307 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:32.306+0000 7f8e03f0a700 1 --2- 172.21.15.178:0/493929102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8dfc100c50 0x7f8dfc198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:32.307 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:32.306+0000 7f8e03f0a700 1 --2- 172.21.15.178:0/493929102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dfc101e50 0x7f8dfc198e70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:32.307 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:32.306+0000 7f8e03f0a700 1 -- 172.21.15.178:0/493929102 >> 172.21.15.178:0/493929102 conn(0x7f8dfc0fc1f0 msgr2=0x7f8dfc107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:14:32.307 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:32.307+0000 7f8e03f0a700 1 -- 172.21.15.178:0/493929102 shutdown_connections 2024-06-13T11:14:32.307 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:14:32.307+0000 7f8e03f0a700 1 -- 172.21.15.178:0/493929102 wait complete. 2024-06-13T11:14:32.986 DEBUG:teuthology.orchestra.run.smithi178:osd.5> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.5.service 2024-06-13T11:14:32.988 INFO:tasks.cephadm:Deploying osd.6 on smithi002 with /dev/vg_nvme/lv_2... 2024-06-13T11:14:32.988 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-13T11:14:33.165 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:32 smithi178 ceph-mon[36913]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:33.166 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:32 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:33.166 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:32 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:33.166 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:32 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:33.166 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:32 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:33.166 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:32 smithi178 ceph-mon[36913]: from='osd.5 [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-13T11:14:33.166 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:32 smithi178 ceph-mon[36913]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-13T11:14:33.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:32 smithi077 ceph-mon[36410]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:33.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:32 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:33.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:32 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:33.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:32 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:33.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:32 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:33.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:32 smithi077 ceph-mon[36410]: from='osd.5 [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-13T11:14:33.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:32 smithi077 ceph-mon[36410]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-13T11:14:33.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:32 smithi002 ceph-mon[32210]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:33.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:32 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:33.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:32 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:33.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:32 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:33.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:32 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:33.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:32 smithi002 ceph-mon[32210]: from='osd.5 [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-13T11:14:33.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:32 smithi002 ceph-mon[32210]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-13T11:14:33.457 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:14:34.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:34 smithi002 ceph-mon[32210]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:34.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:34 smithi002 ceph-mon[32210]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-13T11:14:34.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:34 smithi002 ceph-mon[32210]: from='osd.5 [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:14:34.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:34 smithi002 ceph-mon[32210]: osdmap e36: 6 total, 5 up, 6 in 2024-06-13T11:14:34.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T11:14:34.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:34 smithi002 ceph-mon[32210]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:14:34.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:34 smithi178 ceph-mon[36913]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:34.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:34 smithi178 ceph-mon[36913]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-13T11:14:34.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:34 smithi178 ceph-mon[36913]: from='osd.5 [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:14:34.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:34 smithi178 ceph-mon[36913]: osdmap e36: 6 total, 5 up, 6 in 2024-06-13T11:14:34.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T11:14:34.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:34 smithi178 ceph-mon[36913]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:14:34.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:34 smithi077 ceph-mon[36410]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:34.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:34 smithi077 ceph-mon[36410]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-13T11:14:34.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:34 smithi077 ceph-mon[36410]: from='osd.5 [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:14:34.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:34 smithi077 ceph-mon[36410]: osdmap e36: 6 total, 5 up, 6 in 2024-06-13T11:14:34.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:34 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T11:14:34.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:34 smithi077 ceph-mon[36410]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:14:35.197 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:14:34 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:14:34.946+0000 7fbafc8fd700 -1 osd.5 0 waiting for initial osdmap 2024-06-13T11:14:35.197 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:14:34 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:14:34.953+0000 7fbaf46e8700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:14:35.618 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:35 smithi002 ceph-mon[32210]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-13T11:14:35.618 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:35 smithi002 ceph-mon[32210]: osdmap e37: 6 total, 5 up, 6 in 2024-06-13T11:14:35.618 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:35 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T11:14:35.618 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:35 smithi002 ceph-mon[32210]: from='osd.5 ' entity='osd.5' 2024-06-13T11:14:35.619 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:35 smithi002 ceph-mon[32210]: osd.5 [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887] boot 2024-06-13T11:14:35.619 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:35 smithi002 ceph-mon[32210]: osdmap e38: 6 total, 6 up, 6 in 2024-06-13T11:14:35.619 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:35 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T11:14:35.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:35 smithi178 ceph-mon[36913]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-13T11:14:35.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:35 smithi178 ceph-mon[36913]: osdmap e37: 6 total, 5 up, 6 in 2024-06-13T11:14:35.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:35 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T11:14:35.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:35 smithi178 ceph-mon[36913]: from='osd.5 ' entity='osd.5' 2024-06-13T11:14:35.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:35 smithi178 ceph-mon[36913]: osd.5 [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887] boot 2024-06-13T11:14:35.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:35 smithi178 ceph-mon[36913]: osdmap e38: 6 total, 6 up, 6 in 2024-06-13T11:14:35.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:35 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T11:14:35.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:35 smithi077 ceph-mon[36410]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-13T11:14:35.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:35 smithi077 ceph-mon[36410]: osdmap e37: 6 total, 5 up, 6 in 2024-06-13T11:14:35.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:35 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T11:14:35.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:35 smithi077 ceph-mon[36410]: from='osd.5 ' entity='osd.5' 2024-06-13T11:14:35.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:35 smithi077 ceph-mon[36410]: osd.5 [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887] boot 2024-06-13T11:14:35.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:35 smithi077 ceph-mon[36410]: osdmap e38: 6 total, 6 up, 6 in 2024-06-13T11:14:35.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:35 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T11:14:36.511 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-13T11:14:36.512 INFO:teuthology.orchestra.run.smithi002.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-13T11:14:36.512 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 10+0 records in 2024-06-13T11:14:36.512 INFO:teuthology.orchestra.run.smithi002.stderr:10+0 records out 2024-06-13T11:14:36.512 INFO:teuthology.orchestra.run.smithi002.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0331661 s, 316 MB/s 2024-06-13T11:14:36.512 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping successful for: 2024-06-13T11:14:36.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:36 smithi178 ceph-mon[36913]: purged_snaps scrub starts 2024-06-13T11:14:36.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:36 smithi178 ceph-mon[36913]: purged_snaps scrub ok 2024-06-13T11:14:36.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:36 smithi178 ceph-mon[36913]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:36.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:36.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:36.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:14:36.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:14:36.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:36.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:36.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:14:36.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:36.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:14:36.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:36.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:14:36.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:36.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:36 smithi178 ceph-mon[36913]: osdmap e39: 6 total, 6 up, 6 in 2024-06-13T11:14:36.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:36 smithi077 ceph-mon[36410]: purged_snaps scrub starts 2024-06-13T11:14:36.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:36 smithi077 ceph-mon[36410]: purged_snaps scrub ok 2024-06-13T11:14:36.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:36 smithi077 ceph-mon[36410]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:36.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:36.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:36.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:14:36.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:14:36.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:36.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:36.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:14:36.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:36.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:14:36.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:36.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:14:36.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:36.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:36 smithi077 ceph-mon[36410]: osdmap e39: 6 total, 6 up, 6 in 2024-06-13T11:14:36.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:36 smithi002 ceph-mon[32210]: purged_snaps scrub starts 2024-06-13T11:14:36.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:36 smithi002 ceph-mon[32210]: purged_snaps scrub ok 2024-06-13T11:14:36.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:36 smithi002 ceph-mon[32210]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-06-13T11:14:36.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:36.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:36.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:14:36.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:14:36.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:36.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:36.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:14:36.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:36.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:14:36.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:36.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:14:36.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:14:36.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:36 smithi002 ceph-mon[32210]: osdmap e39: 6 total, 6 up, 6 in 2024-06-13T11:14:37.502 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_2 2024-06-13T11:14:37.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:37 smithi077 ceph-mon[36410]: Detected new or changed devices on smithi178 2024-06-13T11:14:37.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:37 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi178 to 8544M 2024-06-13T11:14:37.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:37 smithi077 ceph-mon[36410]: osdmap e40: 6 total, 6 up, 6 in 2024-06-13T11:14:37.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:37 smithi002 ceph-mon[32210]: Detected new or changed devices on smithi178 2024-06-13T11:14:37.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:37 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi178 to 8544M 2024-06-13T11:14:37.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:37 smithi002 ceph-mon[32210]: osdmap e40: 6 total, 6 up, 6 in 2024-06-13T11:14:37.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:37 smithi178 ceph-mon[36913]: Detected new or changed devices on smithi178 2024-06-13T11:14:37.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:37 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi178 to 8544M 2024-06-13T11:14:37.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:37 smithi178 ceph-mon[36913]: osdmap e40: 6 total, 6 up, 6 in 2024-06-13T11:14:37.978 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:14:38.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:38 smithi077 ceph-mon[36410]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:38.848 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:38 smithi178 ceph-mon[36913]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:38.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:38 smithi002 ceph-mon[32210]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:39.563 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:39 smithi002 ceph-mon[32210]: osdmap e41: 6 total, 6 up, 6 in 2024-06-13T11:14:39.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:39 smithi077 ceph-mon[36410]: osdmap e41: 6 total, 6 up, 6 in 2024-06-13T11:14:39.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:39 smithi178 ceph-mon[36913]: osdmap e41: 6 total, 6 up, 6 in 2024-06-13T11:14:40.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.089+0000 7f26de600700 1 -- 172.21.15.2:0/3318684577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26d810a3c0 msgr2=0x7f26d810c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:14:40.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.089+0000 7f26de600700 1 --2- 172.21.15.2:0/3318684577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26d810a3c0 0x7f26d810c850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009990 tx=0x7f26d0009ca0 comp rx=0 tx=0).stop 2024-06-13T11:14:40.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.089+0000 7f26de600700 1 -- 172.21.15.2:0/3318684577 shutdown_connections 2024-06-13T11:14:40.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.089+0000 7f26de600700 1 --2- 172.21.15.2:0/3318684577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26d810a3c0 0x7f26d810c850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:40.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.089+0000 7f26de600700 1 --2- 172.21.15.2:0/3318684577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26d80764c0 0x7f26d8074920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:40.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.089+0000 7f26de600700 1 --2- 172.21.15.2:0/3318684577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26d8074ef0 0x7f26d8075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:40.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.089+0000 7f26de600700 1 -- 172.21.15.2:0/3318684577 >> 172.21.15.2:0/3318684577 conn(0x7f26d80fda90 msgr2=0x7f26d80ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:14:40.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.089+0000 7f26de600700 1 -- 172.21.15.2:0/3318684577 shutdown_connections 2024-06-13T11:14:40.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.089+0000 7f26de600700 1 -- 172.21.15.2:0/3318684577 wait complete. 2024-06-13T11:14:40.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.090+0000 7f26de600700 1 Processor -- start 2024-06-13T11:14:40.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.090+0000 7f26de600700 1 -- start start 2024-06-13T11:14:40.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.090+0000 7f26de600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26d8074ef0 0x7f26d819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:14:40.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26de600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26d80764c0 0x7f26d819ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:14:40.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26de600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26d810a3c0 0x7f26d81a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:14:40.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26de600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f26d8110320 con 0x7f26d810a3c0 2024-06-13T11:14:40.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26de600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f26d81101a0 con 0x7f26d80764c0 2024-06-13T11:14:40.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26de600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f26d81104a0 con 0x7f26d8074ef0 2024-06-13T11:14:40.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26d7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26d810a3c0 0x7f26d81a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:14:40.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26cea00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26d80764c0 0x7f26d819ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:14:40.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26cea00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26d80764c0 0x7f26d819ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:47754/0 (socket says 172.21.15.2:47754) 2024-06-13T11:14:40.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26cea00700 1 -- 172.21.15.2:0/1720041182 learned_addr learned my addr 172.21.15.2:0/1720041182 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:14:40.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26d7400700 1 --2- 172.21.15.2:0/1720041182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26d8074ef0 0x7f26d819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:14:40.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26d7e00700 1 -- 172.21.15.2:0/1720041182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26d8074ef0 msgr2=0x7f26d819a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:14:40.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26d7e00700 1 --2- 172.21.15.2:0/1720041182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26d8074ef0 0x7f26d819a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:40.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26d7e00700 1 -- 172.21.15.2:0/1720041182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26d80764c0 msgr2=0x7f26d819ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:14:40.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26d7e00700 1 --2- 172.21.15.2:0/1720041182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26d80764c0 0x7f26d819ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:14:40.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26d7e00700 1 -- 172.21.15.2:0/1720041182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d81a2540 con 0x7f26d810a3c0 2024-06-13T11:14:40.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26d7400700 1 --2- 172.21.15.2:0/1720041182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26d8074ef0 0x7f26d819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:14:40.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.091+0000 7f26cea00700 1 --2- 172.21.15.2:0/1720041182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26d80764c0 0x7f26d819ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:14:40.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.092+0000 7f26d7e00700 1 --2- 172.21.15.2:0/1720041182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26d810a3c0 0x7f26d81a1ea0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f26d000b7b0 tx=0x7f26d000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:14:40.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.092+0000 7f26d4c00700 1 -- 172.21.15.2:0/1720041182 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0027070 con 0x7f26d810a3c0 2024-06-13T11:14:40.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.092+0000 7f26de600700 1 -- 172.21.15.2:0/1720041182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d81a27d0 con 0x7f26d810a3c0 2024-06-13T11:14:40.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.092+0000 7f26d4c00700 1 -- 172.21.15.2:0/1720041182 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26d0003d70 con 0x7f26d810a3c0 2024-06-13T11:14:40.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.092+0000 7f26d4c00700 1 -- 172.21.15.2:0/1720041182 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d000f6c0 con 0x7f26d810a3c0 2024-06-13T11:14:40.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.092+0000 7f26de600700 1 -- 172.21.15.2:0/1720041182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d81a2c80 con 0x7f26d810a3c0 2024-06-13T11:14:40.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.094+0000 7f26de600700 1 -- 172.21.15.2:0/1720041182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26d8069180 con 0x7f26d810a3c0 2024-06-13T11:14:40.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.097+0000 7f26d4c00700 1 -- 172.21.15.2:0/1720041182 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f26d002a070 con 0x7f26d810a3c0 2024-06-13T11:14:40.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.099+0000 7f26d4c00700 1 --2- 172.21.15.2:0/1720041182 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f26bc0a2ca0 0x7f26bc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:14:40.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.099+0000 7f26d4c00700 1 -- 172.21.15.2:0/1720041182 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4533+0+0 (secure 0 0 0) 0x7f26d00cfa50 con 0x7f26d810a3c0 2024-06-13T11:14:40.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.099+0000 7f26d7400700 1 --2- 172.21.15.2:0/1720041182 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f26bc0a2ca0 0x7f26bc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:14:40.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.100+0000 7f26d7400700 1 --2- 172.21.15.2:0/1720041182 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f26bc0a2ca0 0x7f26bc0a5160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f26d80768a0 tx=0x7f26c800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:14:40.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.102+0000 7f26d4c00700 1 -- 172.21.15.2:0/1720041182 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f26d0031020 con 0x7f26d810a3c0 2024-06-13T11:14:40.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:14:40.340+0000 7f26de600700 1 -- 172.21.15.2:0/1720041182 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f26d80628d0 con 0x7f26bc0a2ca0 2024-06-13T11:14:40.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:40 smithi002 ceph-mon[32210]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:40.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:40 smithi002 ceph-mon[32210]: osdmap e42: 6 total, 6 up, 6 in 2024-06-13T11:14:40.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:14:40.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:14:40.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:40.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:40 smithi077 ceph-mon[36410]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:40.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:40 smithi077 ceph-mon[36410]: osdmap e42: 6 total, 6 up, 6 in 2024-06-13T11:14:40.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:14:40.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:14:40.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:40.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:40 smithi178 ceph-mon[36913]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:40.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:40 smithi178 ceph-mon[36913]: osdmap e42: 6 total, 6 up, 6 in 2024-06-13T11:14:40.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:14:40.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:14:40.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:41.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:41 smithi002 ceph-mon[32210]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:14:41.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:41 smithi077 ceph-mon[36410]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:14:41.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:41 smithi178 ceph-mon[36913]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:14:42.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:42 smithi002 ceph-mon[32210]: pgmap v160: 1 pgs: 1 peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-06-13T11:14:42.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:42 smithi077 ceph-mon[36410]: pgmap v160: 1 pgs: 1 peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-06-13T11:14:42.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:42 smithi178 ceph-mon[36913]: pgmap v160: 1 pgs: 1 peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-06-13T11:14:44.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:44 smithi077 ceph-mon[36410]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-13T11:14:44.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:44 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3281455582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a186a4a-0e28-47bd-b5ad-9bf8079f74c7"}]: dispatch 2024-06-13T11:14:44.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:44 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3281455582' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a186a4a-0e28-47bd-b5ad-9bf8079f74c7"}]': finished 2024-06-13T11:14:44.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:44 smithi077 ceph-mon[36410]: osdmap e43: 7 total, 6 up, 7 in 2024-06-13T11:14:44.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:14:44.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:44 smithi002 ceph-mon[32210]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-13T11:14:44.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:44 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3281455582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a186a4a-0e28-47bd-b5ad-9bf8079f74c7"}]: dispatch 2024-06-13T11:14:44.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:44 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3281455582' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a186a4a-0e28-47bd-b5ad-9bf8079f74c7"}]': finished 2024-06-13T11:14:44.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:44 smithi002 ceph-mon[32210]: osdmap e43: 7 total, 6 up, 7 in 2024-06-13T11:14:44.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:14:44.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:44 smithi178 ceph-mon[36913]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-13T11:14:44.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:44 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3281455582' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a186a4a-0e28-47bd-b5ad-9bf8079f74c7"}]: dispatch 2024-06-13T11:14:44.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:44 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3281455582' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a186a4a-0e28-47bd-b5ad-9bf8079f74c7"}]': finished 2024-06-13T11:14:44.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:44 smithi178 ceph-mon[36913]: osdmap e43: 7 total, 6 up, 7 in 2024-06-13T11:14:44.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:14:45.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:45 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3020092578' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:14:45.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:45 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3020092578' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:14:45.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:45 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3020092578' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:14:46.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:46 smithi077 ceph-mon[36410]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-06-13T11:14:46.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:46 smithi002 ceph-mon[32210]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-06-13T11:14:46.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:46 smithi178 ceph-mon[36913]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-06-13T11:14:48.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:48 smithi077 ceph-mon[36410]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-13T11:14:48.862 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:48 smithi002 ceph-mon[32210]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-13T11:14:48.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:48 smithi178 ceph-mon[36913]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-13T11:14:50.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:50 smithi077 ceph-mon[36410]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:50.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:50 smithi002 ceph-mon[32210]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:50.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:50 smithi178 ceph-mon[36913]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:52.635 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:52 smithi002 ceph-mon[32210]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:52.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:52 smithi077 ceph-mon[36410]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:52.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:52 smithi178 ceph-mon[36913]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:54.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:54 smithi077 ceph-mon[36410]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:54.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:54 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-13T11:14:54.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:54 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:54.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:54 smithi002 ceph-mon[32210]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:54.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:54 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-13T11:14:54.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:54 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:54.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:54 smithi178 ceph-mon[36913]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:54.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:54 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-13T11:14:54.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:54 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:14:55.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:55 smithi077 ceph-mon[36410]: Deploying daemon osd.6 on smithi002 2024-06-13T11:14:55.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:55 smithi002 ceph-mon[32210]: Deploying daemon osd.6 on smithi002 2024-06-13T11:14:55.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:55 smithi178 ceph-mon[36913]: Deploying daemon osd.6 on smithi002 2024-06-13T11:14:56.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:56 smithi002 ceph-mon[32210]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:56.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:56 smithi077 ceph-mon[36410]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:56.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:56 smithi178 ceph-mon[36913]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:58.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:14:58 smithi002 ceph-mon[32210]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:58.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:14:58 smithi077 ceph-mon[36410]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:14:58.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:14:58 smithi178 ceph-mon[36913]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:00.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:00 smithi002 ceph-mon[32210]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:00.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:00 smithi178 ceph-mon[36913]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:00 smithi077 ceph-mon[36410]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:02.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:02 smithi002 ceph-mon[32210]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:02.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:02 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:02.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:02 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:02.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:02 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:15:02.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:02 smithi178 ceph-mon[36913]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:02.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:02 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:02.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:02 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:02.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:02 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:15:03.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:02 smithi077 ceph-mon[36410]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:03.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:02 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:03.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:02 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:03.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:02 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:15:04.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:04 smithi002 ceph-mon[32210]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:04.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:04 smithi178 ceph-mon[36913]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:05.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:04 smithi077 ceph-mon[36410]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:06.800 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:06 smithi002 ceph-mon[32210]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:06.800 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:06.800 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:06.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:06 smithi178 ceph-mon[36913]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:06.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:06.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:07.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:06 smithi077 ceph-mon[36410]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:07.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:07.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:07.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:15:07.350+0000 7f26d4c00700 1 -- 172.21.15.2:0/1720041182 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f26d80628d0 con 0x7f26bc0a2ca0 2024-06-13T11:15:07.351 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 6 on host 'smithi002' 2024-06-13T11:15:07.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:15:07.354+0000 7f26de600700 1 -- 172.21.15.2:0/1720041182 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f26bc0a2ca0 msgr2=0x7f26bc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:15:07.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:15:07.354+0000 7f26de600700 1 --2- 172.21.15.2:0/1720041182 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f26bc0a2ca0 0x7f26bc0a5160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f26d80768a0 tx=0x7f26c800b040 comp rx=0 tx=0).stop 2024-06-13T11:15:07.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:15:07.354+0000 7f26de600700 1 -- 172.21.15.2:0/1720041182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26d810a3c0 msgr2=0x7f26d81a1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:15:07.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:15:07.354+0000 7f26de600700 1 --2- 172.21.15.2:0/1720041182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26d810a3c0 0x7f26d81a1ea0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f26d000b7b0 tx=0x7f26d000bbb0 comp rx=0 tx=0).stop 2024-06-13T11:15:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:15:07.355+0000 7f26de600700 1 -- 172.21.15.2:0/1720041182 shutdown_connections 2024-06-13T11:15:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:15:07.355+0000 7f26de600700 1 --2- 172.21.15.2:0/1720041182 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f26bc0a2ca0 0x7f26bc0a5160 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:15:07.355+0000 7f26de600700 1 --2- 172.21.15.2:0/1720041182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26d810a3c0 0x7f26d81a1ea0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:15:07.355+0000 7f26de600700 1 --2- 172.21.15.2:0/1720041182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26d8074ef0 0x7f26d819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:15:07.355+0000 7f26de600700 1 --2- 172.21.15.2:0/1720041182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26d80764c0 0x7f26d819ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:15:07.355+0000 7f26de600700 1 -- 172.21.15.2:0/1720041182 >> 172.21.15.2:0/1720041182 conn(0x7f26d80fda90 msgr2=0x7f26d81062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:15:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:15:07.355+0000 7f26de600700 1 -- 172.21.15.2:0/1720041182 shutdown_connections 2024-06-13T11:15:07.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:15:07.355+0000 7f26de600700 1 -- 172.21.15.2:0/1720041182 wait complete. 2024-06-13T11:15:07.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:07 smithi002 ceph-mon[32210]: from='osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-13T11:15:07.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:07 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:07.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:07 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:07.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:07 smithi178 ceph-mon[36913]: from='osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-13T11:15:07.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:07 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:07.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:07 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:08.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:07 smithi077 ceph-mon[36410]: from='osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-13T11:15:08.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:07 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:08.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:07 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:08.242 DEBUG:teuthology.orchestra.run.smithi002:osd.6> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.6.service 2024-06-13T11:15:08.248 INFO:tasks.cephadm:Deploying osd.7 on smithi077 with /dev/vg_nvme/lv_2... 2024-06-13T11:15:08.248 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-13T11:15:08.495 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T11:15:08.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:08 smithi002 ceph-mon[32210]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:08.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:08 smithi002 ceph-mon[32210]: from='osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-13T11:15:08.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:08 smithi002 ceph-mon[32210]: osdmap e44: 7 total, 6 up, 7 in 2024-06-13T11:15:08.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:08 smithi002 ceph-mon[32210]: from='osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:15:08.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:08 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:15:08.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:08 smithi002 ceph-mon[32210]: from='osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T11:15:08.835 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:08 smithi002 ceph-mon[32210]: osdmap e45: 7 total, 6 up, 7 in 2024-06-13T11:15:08.848 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:08 smithi178 ceph-mon[36913]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:08.848 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:08 smithi178 ceph-mon[36913]: from='osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-13T11:15:08.848 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:08 smithi178 ceph-mon[36913]: osdmap e44: 7 total, 6 up, 7 in 2024-06-13T11:15:08.848 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:08 smithi178 ceph-mon[36913]: from='osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:15:08.848 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:08 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:15:08.848 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:08 smithi178 ceph-mon[36913]: from='osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T11:15:08.849 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:08 smithi178 ceph-mon[36913]: osdmap e45: 7 total, 6 up, 7 in 2024-06-13T11:15:08.864 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:08 smithi077 ceph-mon[36410]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:08.864 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:08 smithi077 ceph-mon[36410]: from='osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-13T11:15:08.864 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:08 smithi077 ceph-mon[36410]: osdmap e44: 7 total, 6 up, 7 in 2024-06-13T11:15:08.864 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:08 smithi077 ceph-mon[36410]: from='osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:15:08.864 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:08 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:15:08.865 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:08 smithi077 ceph-mon[36410]: from='osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T11:15:08.865 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:08 smithi077 ceph-mon[36410]: osdmap e45: 7 total, 6 up, 7 in 2024-06-13T11:15:09.585 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:15:09 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:15:09.196+0000 7fed42c00700 -1 osd.6 0 waiting for initial osdmap 2024-06-13T11:15:09.585 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:15:09 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:15:09.227+0000 7fed38a00700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:15:09.885 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:09 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:15:09.885 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:09 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:15:09.885 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:09 smithi077 ceph-mon[36410]: from='osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584]' entity='osd.6' 2024-06-13T11:15:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:09 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:15:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:09 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:15:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:09 smithi002 ceph-mon[32210]: from='osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584]' entity='osd.6' 2024-06-13T11:15:09.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:09 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:15:09.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:09 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:15:09.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:09 smithi178 ceph-mon[36913]: from='osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584]' entity='osd.6' 2024-06-13T11:15:10.469 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-13T11:15:10.469 INFO:teuthology.orchestra.run.smithi077.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-13T11:15:10.470 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10+0 records in 2024-06-13T11:15:10.470 INFO:teuthology.orchestra.run.smithi077.stderr:10+0 records out 2024-06-13T11:15:10.470 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.013069 s, 802 MB/s 2024-06-13T11:15:10.470 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping successful for: 2024-06-13T11:15:10.842 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:10 smithi077 ceph-mon[36410]: purged_snaps scrub starts 2024-06-13T11:15:10.842 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:10 smithi077 ceph-mon[36410]: purged_snaps scrub ok 2024-06-13T11:15:10.842 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:10 smithi077 ceph-mon[36410]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:10.842 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:10 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:15:10.842 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:10 smithi077 ceph-mon[36410]: osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584] boot 2024-06-13T11:15:10.842 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:10 smithi077 ceph-mon[36410]: osdmap e46: 7 total, 7 up, 7 in 2024-06-13T11:15:10.843 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:10 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:15:10.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:10 smithi002 ceph-mon[32210]: purged_snaps scrub starts 2024-06-13T11:15:10.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:10 smithi002 ceph-mon[32210]: purged_snaps scrub ok 2024-06-13T11:15:10.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:10 smithi002 ceph-mon[32210]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:10.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:10 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:15:10.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:10 smithi002 ceph-mon[32210]: osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584] boot 2024-06-13T11:15:10.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:10 smithi002 ceph-mon[32210]: osdmap e46: 7 total, 7 up, 7 in 2024-06-13T11:15:10.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:10 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:15:10.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:10 smithi178 ceph-mon[36913]: purged_snaps scrub starts 2024-06-13T11:15:10.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:10 smithi178 ceph-mon[36913]: purged_snaps scrub ok 2024-06-13T11:15:10.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:10 smithi178 ceph-mon[36913]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 536 GiB / 536 GiB avail 2024-06-13T11:15:10.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:10 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:15:10.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:10 smithi178 ceph-mon[36913]: osd.6 [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584] boot 2024-06-13T11:15:10.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:10 smithi178 ceph-mon[36913]: osdmap e46: 7 total, 7 up, 7 in 2024-06-13T11:15:10.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:10 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:15:11.152 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_2 2024-06-13T11:15:11.388 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T11:15:12.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:12 smithi077 ceph-mon[36410]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:12.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:12 smithi077 ceph-mon[36410]: osdmap e47: 7 total, 7 up, 7 in 2024-06-13T11:15:12.868 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:12 smithi002 ceph-mon[32210]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:12.868 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:12 smithi002 ceph-mon[32210]: osdmap e47: 7 total, 7 up, 7 in 2024-06-13T11:15:12.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:12 smithi178 ceph-mon[36913]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:12.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:12 smithi178 ceph-mon[36913]: osdmap e47: 7 total, 7 up, 7 in 2024-06-13T11:15:13.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.072+0000 7ff7258b6700 1 -- 172.21.15.77:0/1118463712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7201030d0 msgr2=0x7ff720109960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:15:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.072+0000 7ff7258b6700 1 --2- 172.21.15.77:0/1118463712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7201030d0 0x7ff720109960 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff71800b0a0 tx=0x7ff71800b3b0 comp rx=0 tx=0).stop 2024-06-13T11:15:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.072+0000 7ff7258b6700 1 -- 172.21.15.77:0/1118463712 shutdown_connections 2024-06-13T11:15:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.072+0000 7ff7258b6700 1 --2- 172.21.15.77:0/1118463712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7201019f0 0x7ff720101e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.072+0000 7ff7258b6700 1 --2- 172.21.15.77:0/1118463712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7201030d0 0x7ff720109960 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.072+0000 7ff7258b6700 1 --2- 172.21.15.77:0/1118463712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff720102710 0x7ff720102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.072+0000 7ff7258b6700 1 -- 172.21.15.77:0/1118463712 >> 172.21.15.77:0/1118463712 conn(0x7ff7200fc1f0 msgr2=0x7ff7200fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:15:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.072+0000 7ff7258b6700 1 -- 172.21.15.77:0/1118463712 shutdown_connections 2024-06-13T11:15:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.072+0000 7ff7258b6700 1 -- 172.21.15.77:0/1118463712 wait complete. 2024-06-13T11:15:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.072+0000 7ff7258b6700 1 Processor -- start 2024-06-13T11:15:13.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.072+0000 7ff7258b6700 1 -- start start 2024-06-13T11:15:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff7258b6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7201019f0 0x7ff7201010b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:15:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff7258b6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff720102710 0x7ff72019d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:15:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff7258b6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7201030d0 0x7ff72019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:15:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff7258b6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff72010d1f0 con 0x7ff7201030d0 2024-06-13T11:15:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff7258b6700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff72010d070 con 0x7ff720102710 2024-06-13T11:15:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff7258b6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff72010d370 con 0x7ff7201019f0 2024-06-13T11:15:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff71e7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff720102710 0x7ff72019d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:15:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff71e7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff720102710 0x7ff72019d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57422/0 (socket says 172.21.15.77:57422) 2024-06-13T11:15:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff71e7fc700 1 -- 172.21.15.77:0/290195957 learned_addr learned my addr 172.21.15.77:0/290195957 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-06-13T11:15:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff71effd700 1 --2- 172.21.15.77:0/290195957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7201019f0 0x7ff7201010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:15:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff71e7fc700 1 -- 172.21.15.77:0/290195957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7201019f0 msgr2=0x7ff7201010b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:15:13.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff71e7fc700 1 --2- 172.21.15.77:0/290195957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7201019f0 0x7ff7201010b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff71e7fc700 1 -- 172.21.15.77:0/290195957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7201030d0 msgr2=0x7ff72019fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:15:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff71e7fc700 1 --2- 172.21.15.77:0/290195957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7201030d0 0x7ff72019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff71e7fc700 1 -- 172.21.15.77:0/290195957 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7201a04b0 con 0x7ff720102710 2024-06-13T11:15:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff71effd700 1 --2- 172.21.15.77:0/290195957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7201019f0 0x7ff7201010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:15:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff71e7fc700 1 --2- 172.21.15.77:0/290195957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff720102710 0x7ff72019d5a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff71000b500 tx=0x7ff71000b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:15:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff7248b4700 1 -- 172.21.15.77:0/290195957 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff710015020 con 0x7ff720102710 2024-06-13T11:15:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff7258b6700 1 -- 172.21.15.77:0/290195957 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7201a07a0 con 0x7ff720102710 2024-06-13T11:15:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff7248b4700 1 -- 172.21.15.77:0/290195957 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff710011d10 con 0x7ff720102710 2024-06-13T11:15:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff7248b4700 1 -- 172.21.15.77:0/290195957 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71000f2e0 con 0x7ff720102710 2024-06-13T11:15:13.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.073+0000 7ff7258b6700 1 -- 172.21.15.77:0/290195957 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7201a0d60 con 0x7ff720102710 2024-06-13T11:15:13.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.074+0000 7ff7258b6700 1 -- 172.21.15.77:0/290195957 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff720069180 con 0x7ff720102710 2024-06-13T11:15:13.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.076+0000 7ff7248b4700 1 -- 172.21.15.77:0/290195957 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff710018020 con 0x7ff720102710 2024-06-13T11:15:13.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.076+0000 7ff7248b4700 1 --2- 172.21.15.77:0/290195957 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff7080a2c20 0x7ff7080a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:15:13.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.076+0000 7ff7248b4700 1 -- 172.21.15.77:0/290195957 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7ff7100ce150 con 0x7ff720102710 2024-06-13T11:15:13.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.077+0000 7ff71effd700 1 --2- 172.21.15.77:0/290195957 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff7080a2c20 0x7ff7080a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:15:13.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.078+0000 7ff71effd700 1 --2- 172.21.15.77:0/290195957 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff7080a2c20 0x7ff7080a50e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff72006a710 tx=0x7ff714008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:15:13.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.080+0000 7ff7248b4700 1 -- 172.21.15.77:0/290195957 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff71001f020 con 0x7ff720102710 2024-06-13T11:15:13.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:13.281+0000 7ff7258b6700 1 -- 172.21.15.77:0/290195957 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff7200628d0 con 0x7ff7080a2c20 2024-06-13T11:15:13.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:15:13.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:15:13.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:13.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:13.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:13.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:13.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:13.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:13.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:13.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:13.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:15:13.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:13 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:13.926 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:15:13.926 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:15:13.926 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:13.926 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:13.926 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:13.926 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:13.926 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:13.926 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:13.926 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:13.926 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:13.927 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:15:13.927 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:13 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:13.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:15:13.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:15:13.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:13.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:13.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:13.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:13.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:13.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:13.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:13.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:13.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:15:13.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:13 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:14.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:14 smithi002 ceph-mon[32210]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:14.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:14 smithi002 ceph-mon[32210]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:15:14.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:14 smithi002 ceph-mon[32210]: Detected new or changed devices on smithi002 2024-06-13T11:15:14.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:14 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi002 to 5698M 2024-06-13T11:15:14.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:14 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:15:14.933 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:14 smithi077 ceph-mon[36410]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:14.933 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:14 smithi077 ceph-mon[36410]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:15:14.933 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:14 smithi077 ceph-mon[36410]: Detected new or changed devices on smithi002 2024-06-13T11:15:14.933 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:14 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi002 to 5698M 2024-06-13T11:15:14.933 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:14 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:15:14.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:14 smithi178 ceph-mon[36913]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:14.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:14 smithi178 ceph-mon[36913]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:15:14.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:14 smithi178 ceph-mon[36913]: Detected new or changed devices on smithi002 2024-06-13T11:15:14.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:14 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi002 to 5698M 2024-06-13T11:15:14.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:14 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:15:15.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:15 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:15.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:15 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:15:15.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:15 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:15.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:15 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:15.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:15 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:15:15.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:15 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:16.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:15 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:16.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:15 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:15:16.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:15 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:17.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:16 smithi077 ceph-mon[36410]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:17.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:16 smithi077 ceph-mon[36410]: from='client.? 172.21.15.77:0/4007002304' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "646e66f7-1ef8-428d-a842-bf28c8606df2"}]: dispatch 2024-06-13T11:15:17.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:16 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "646e66f7-1ef8-428d-a842-bf28c8606df2"}]: dispatch 2024-06-13T11:15:17.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:16 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "646e66f7-1ef8-428d-a842-bf28c8606df2"}]': finished 2024-06-13T11:15:17.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:16 smithi077 ceph-mon[36410]: osdmap e48: 8 total, 7 up, 8 in 2024-06-13T11:15:17.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:16 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:15:17.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:16 smithi077 ceph-mon[36410]: from='client.? 172.21.15.77:0/1406659599' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:15:17.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:16 smithi002 ceph-mon[32210]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:17.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:16 smithi002 ceph-mon[32210]: from='client.? 172.21.15.77:0/4007002304' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "646e66f7-1ef8-428d-a842-bf28c8606df2"}]: dispatch 2024-06-13T11:15:17.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:16 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "646e66f7-1ef8-428d-a842-bf28c8606df2"}]: dispatch 2024-06-13T11:15:17.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:16 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "646e66f7-1ef8-428d-a842-bf28c8606df2"}]': finished 2024-06-13T11:15:17.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:16 smithi002 ceph-mon[32210]: osdmap e48: 8 total, 7 up, 8 in 2024-06-13T11:15:17.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:16 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:15:17.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:16 smithi002 ceph-mon[32210]: from='client.? 172.21.15.77:0/1406659599' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:15:17.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:16 smithi178 ceph-mon[36913]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:17.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:16 smithi178 ceph-mon[36913]: from='client.? 172.21.15.77:0/4007002304' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "646e66f7-1ef8-428d-a842-bf28c8606df2"}]: dispatch 2024-06-13T11:15:17.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:16 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "646e66f7-1ef8-428d-a842-bf28c8606df2"}]: dispatch 2024-06-13T11:15:17.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:16 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "646e66f7-1ef8-428d-a842-bf28c8606df2"}]': finished 2024-06-13T11:15:17.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:16 smithi178 ceph-mon[36913]: osdmap e48: 8 total, 7 up, 8 in 2024-06-13T11:15:17.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:16 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:15:17.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:16 smithi178 ceph-mon[36913]: from='client.? 172.21.15.77:0/1406659599' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:15:19.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:18 smithi077 ceph-mon[36410]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:19.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:18 smithi002 ceph-mon[32210]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:19.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:18 smithi178 ceph-mon[36913]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:21.017 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:20 smithi077 ceph-mon[36410]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:21.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:20 smithi002 ceph-mon[32210]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:21.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:20 smithi178 ceph-mon[36913]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:23.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:22 smithi077 ceph-mon[36410]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:23.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:22 smithi002 ceph-mon[32210]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:23.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:22 smithi178 ceph-mon[36913]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:24.027 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:23 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-13T11:15:24.027 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:23 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:24.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:23 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-13T11:15:24.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:23 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:24.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:23 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-13T11:15:24.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:23 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:25.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:24 smithi077 ceph-mon[36410]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:25.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:24 smithi077 ceph-mon[36410]: Deploying daemon osd.7 on smithi077 2024-06-13T11:15:25.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:24 smithi002 ceph-mon[32210]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:25.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:24 smithi002 ceph-mon[32210]: Deploying daemon osd.7 on smithi077 2024-06-13T11:15:25.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:24 smithi178 ceph-mon[36913]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:25.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:24 smithi178 ceph-mon[36913]: Deploying daemon osd.7 on smithi077 2024-06-13T11:15:27.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:26 smithi077 ceph-mon[36410]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:27.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:26 smithi002 ceph-mon[32210]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:27.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:26 smithi178 ceph-mon[36913]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:29.019 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:28 smithi077 ceph-mon[36410]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:29.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:28 smithi002 ceph-mon[32210]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:29.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:28 smithi178 ceph-mon[36913]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:30.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:30.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:15:30.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:30.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:30 smithi077 ceph-mon[36410]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:30.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:30.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:15:30.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:30.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:30 smithi002 ceph-mon[32210]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:30.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:30.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:15:30.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:30.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:30 smithi178 ceph-mon[36913]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:32.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:32 smithi077 ceph-mon[36410]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:32.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:32 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:32.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:32 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:32.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:32 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:32.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:32 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:15:32.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:32 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:32.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:32 smithi002 ceph-mon[32210]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:32.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:32 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:32.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:32 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:32.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:32 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:32.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:32 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:15:32.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:32 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:32.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:32 smithi178 ceph-mon[36913]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:32.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:32 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:32.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:32 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:32.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:32 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:32.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:32 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:15:32.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:32 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:32.978+0000 7ff7248b4700 1 -- 172.21.15.77:0/290195957 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff7200628d0 con 0x7ff7080a2c20 2024-06-13T11:15:32.977 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 7 on host 'smithi077' 2024-06-13T11:15:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:32.980+0000 7ff7258b6700 1 -- 172.21.15.77:0/290195957 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff7080a2c20 msgr2=0x7ff7080a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:15:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:32.980+0000 7ff7258b6700 1 --2- 172.21.15.77:0/290195957 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff7080a2c20 0x7ff7080a50e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff72006a710 tx=0x7ff714008040 comp rx=0 tx=0).stop 2024-06-13T11:15:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:32.980+0000 7ff7258b6700 1 -- 172.21.15.77:0/290195957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff720102710 msgr2=0x7ff72019d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:15:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:32.980+0000 7ff7258b6700 1 --2- 172.21.15.77:0/290195957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff720102710 0x7ff72019d5a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff71000b500 tx=0x7ff71000b8c0 comp rx=0 tx=0).stop 2024-06-13T11:15:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:32.980+0000 7ff7258b6700 1 -- 172.21.15.77:0/290195957 shutdown_connections 2024-06-13T11:15:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:32.980+0000 7ff7258b6700 1 --2- 172.21.15.77:0/290195957 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff7080a2c20 0x7ff7080a50e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:32.980+0000 7ff7258b6700 1 --2- 172.21.15.77:0/290195957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7201030d0 0x7ff72019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:32.980+0000 7ff7258b6700 1 --2- 172.21.15.77:0/290195957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7201019f0 0x7ff7201010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:32.980+0000 7ff7258b6700 1 --2- 172.21.15.77:0/290195957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff720102710 0x7ff72019d5a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:32.980+0000 7ff7258b6700 1 -- 172.21.15.77:0/290195957 >> 172.21.15.77:0/290195957 conn(0x7ff7200fc1f0 msgr2=0x7ff7201059b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:15:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:32.980+0000 7ff7258b6700 1 -- 172.21.15.77:0/290195957 shutdown_connections 2024-06-13T11:15:32.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:15:32.980+0000 7ff7258b6700 1 -- 172.21.15.77:0/290195957 wait complete. 2024-06-13T11:15:33.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:33 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:15:33.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:33 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:33.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:33 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:33.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:33 smithi077 ceph-mon[36410]: from='osd.7 [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-13T11:15:33.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:33 smithi077 ceph-mon[36410]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-13T11:15:33.636 DEBUG:teuthology.orchestra.run.smithi077:osd.7> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.7.service 2024-06-13T11:15:33.638 INFO:tasks.cephadm:Deploying osd.8 on smithi178 with /dev/vg_nvme/lv_2... 2024-06-13T11:15:33.638 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-13T11:15:33.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:33 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:15:33.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:33 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:33.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:33 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:33.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:33 smithi002 ceph-mon[32210]: from='osd.7 [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-13T11:15:33.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:33 smithi002 ceph-mon[32210]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-13T11:15:33.665 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:33 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:15:33.665 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:33 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:33.665 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:33 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:33.665 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:33 smithi178 ceph-mon[36913]: from='osd.7 [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-13T11:15:33.665 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:33 smithi178 ceph-mon[36913]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-13T11:15:33.884 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:15:35.018 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:34 smithi178 ceph-mon[36913]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:35.018 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:34 smithi178 ceph-mon[36913]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-13T11:15:35.018 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:34 smithi178 ceph-mon[36913]: from='osd.7 [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:15:35.018 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:34 smithi178 ceph-mon[36913]: osdmap e49: 8 total, 7 up, 8 in 2024-06-13T11:15:35.018 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:15:35.018 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:34 smithi178 ceph-mon[36913]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:15:35.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:34 smithi077 ceph-mon[36410]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:35.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:34 smithi077 ceph-mon[36410]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-13T11:15:35.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:34 smithi077 ceph-mon[36410]: from='osd.7 [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:15:35.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:34 smithi077 ceph-mon[36410]: osdmap e49: 8 total, 7 up, 8 in 2024-06-13T11:15:35.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:34 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:15:35.139 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:34 smithi077 ceph-mon[36410]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:15:35.139 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:15:34 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:15:34.951+0000 7f15598af700 -1 osd.7 0 waiting for initial osdmap 2024-06-13T11:15:35.139 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:15:34 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:15:34.963+0000 7f15556a2700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:15:35.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:34 smithi002 ceph-mon[32210]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:35.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:34 smithi002 ceph-mon[32210]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-13T11:15:35.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:34 smithi002 ceph-mon[32210]: from='osd.7 [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:15:35.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:34 smithi002 ceph-mon[32210]: osdmap e49: 8 total, 7 up, 8 in 2024-06-13T11:15:35.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:15:35.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:34 smithi002 ceph-mon[32210]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:15:35.909 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-13T11:15:35.909 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-13T11:15:35.909 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2024-06-13T11:15:35.909 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2024-06-13T11:15:35.909 INFO:teuthology.orchestra.run.smithi178.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0084616 s, 1.2 GB/s 2024-06-13T11:15:35.909 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2024-06-13T11:15:36.241 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:35 smithi178 ceph-mon[36913]: purged_snaps scrub starts 2024-06-13T11:15:36.242 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:35 smithi178 ceph-mon[36913]: purged_snaps scrub ok 2024-06-13T11:15:36.242 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:35 smithi178 ceph-mon[36913]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-06-13T11:15:36.242 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:35 smithi178 ceph-mon[36913]: osdmap e50: 8 total, 7 up, 8 in 2024-06-13T11:15:36.242 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:35 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:15:36.242 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:35 smithi178 ceph-mon[36913]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:36.242 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:35 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:15:36.250 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:35 smithi077 ceph-mon[36410]: purged_snaps scrub starts 2024-06-13T11:15:36.251 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:35 smithi077 ceph-mon[36410]: purged_snaps scrub ok 2024-06-13T11:15:36.251 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:35 smithi077 ceph-mon[36410]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-06-13T11:15:36.251 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:35 smithi077 ceph-mon[36410]: osdmap e50: 8 total, 7 up, 8 in 2024-06-13T11:15:36.251 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:35 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:15:36.251 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:35 smithi077 ceph-mon[36410]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:36.251 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:35 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:15:36.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:35 smithi002 ceph-mon[32210]: purged_snaps scrub starts 2024-06-13T11:15:36.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:35 smithi002 ceph-mon[32210]: purged_snaps scrub ok 2024-06-13T11:15:36.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:35 smithi002 ceph-mon[32210]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-06-13T11:15:36.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:35 smithi002 ceph-mon[32210]: osdmap e50: 8 total, 7 up, 8 in 2024-06-13T11:15:36.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:35 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:15:36.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:35 smithi002 ceph-mon[32210]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 626 GiB / 626 GiB avail 2024-06-13T11:15:36.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:35 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:15:36.544 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi178:vg_nvme/lv_2 2024-06-13T11:15:36.825 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:15:37.093 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:36 smithi178 ceph-mon[36913]: osd.7 [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775] boot 2024-06-13T11:15:37.093 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:36 smithi178 ceph-mon[36913]: osdmap e51: 8 total, 8 up, 8 in 2024-06-13T11:15:37.093 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:15:37.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:36 smithi178 ceph-mon[36913]: Detected new or changed devices on smithi077 2024-06-13T11:15:37.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:37.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:37.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:37.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:37.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:37.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:36 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi077 to 5696M 2024-06-13T11:15:37.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:37.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:37.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:15:37.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:37.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:36 smithi077 ceph-mon[36410]: osd.7 [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775] boot 2024-06-13T11:15:37.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:36 smithi077 ceph-mon[36410]: osdmap e51: 8 total, 8 up, 8 in 2024-06-13T11:15:37.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:15:37.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:36 smithi077 ceph-mon[36410]: Detected new or changed devices on smithi077 2024-06-13T11:15:37.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:37.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:37.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:37.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:37.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:37.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:36 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi077 to 5696M 2024-06-13T11:15:37.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:37.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:37.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:15:37.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:37.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:36 smithi002 ceph-mon[32210]: osd.7 [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775] boot 2024-06-13T11:15:37.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:36 smithi002 ceph-mon[32210]: osdmap e51: 8 total, 8 up, 8 in 2024-06-13T11:15:37.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:15:37.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:36 smithi002 ceph-mon[32210]: Detected new or changed devices on smithi077 2024-06-13T11:15:37.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:37.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:37.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:37.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:37.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:15:37.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:36 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi077 to 5696M 2024-06-13T11:15:37.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:37.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:37.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:15:37.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:38.253 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:37 smithi178 ceph-mon[36913]: osdmap e52: 8 total, 8 up, 8 in 2024-06-13T11:15:38.254 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:37 smithi178 ceph-mon[36913]: pgmap v198: 1 pgs: 1 unknown; 577 KiB data, 247 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:38.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:37 smithi077 ceph-mon[36410]: osdmap e52: 8 total, 8 up, 8 in 2024-06-13T11:15:38.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:37 smithi077 ceph-mon[36410]: pgmap v198: 1 pgs: 1 unknown; 577 KiB data, 247 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:38.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:37 smithi002 ceph-mon[32210]: osdmap e52: 8 total, 8 up, 8 in 2024-06-13T11:15:38.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:37 smithi002 ceph-mon[32210]: pgmap v198: 1 pgs: 1 unknown; 577 KiB data, 247 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.472+0000 7f3f3142f700 1 -- 172.21.15.178:0/2544796602 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f2c102f90 msgr2=0x7f3f2c109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:15:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.472+0000 7f3f3142f700 1 --2- 172.21.15.178:0/2544796602 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f2c102f90 0x7f3f2c109840 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400b0a0 tx=0x7f3f2400b3b0 comp rx=0 tx=0).stop 2024-06-13T11:15:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.472+0000 7f3f3142f700 1 -- 172.21.15.178:0/2544796602 shutdown_connections 2024-06-13T11:15:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.472+0000 7f3f3142f700 1 --2- 172.21.15.178:0/2544796602 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f2c102f90 0x7f3f2c109840 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:38.475 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.472+0000 7f3f3142f700 1 --2- 172.21.15.178:0/2544796602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f2c1013f0 0x7f3f2c101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:38.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.472+0000 7f3f3142f700 1 --2- 172.21.15.178:0/2544796602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f2c1025f0 0x7f3f2c102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:38.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.472+0000 7f3f3142f700 1 -- 172.21.15.178:0/2544796602 >> 172.21.15.178:0/2544796602 conn(0x7f3f2c0fc9b0 msgr2=0x7f3f2c0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:15:38.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.472+0000 7f3f3142f700 1 -- 172.21.15.178:0/2544796602 shutdown_connections 2024-06-13T11:15:38.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.472+0000 7f3f3142f700 1 -- 172.21.15.178:0/2544796602 wait complete. 2024-06-13T11:15:38.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.473+0000 7f3f3142f700 1 Processor -- start 2024-06-13T11:15:38.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.473+0000 7f3f3142f700 1 -- start start 2024-06-13T11:15:38.476 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.473+0000 7f3f3142f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f2c1013f0 0x7f3f2c06b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:15:38.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.473+0000 7f3f3142f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f2c1025f0 0x7f3f2c19d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:15:38.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.473+0000 7f3f3142f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f2c102f90 0x7f3f2c19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:15:38.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.473+0000 7f3f3142f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c10d0d0 con 0x7f3f2c1025f0 2024-06-13T11:15:38.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.473+0000 7f3f3142f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c10cf50 con 0x7f3f2c1013f0 2024-06-13T11:15:38.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.473+0000 7f3f3142f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c10d250 con 0x7f3f2c102f90 2024-06-13T11:15:38.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.473+0000 7f3f2b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f2c102f90 0x7f3f2c19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:15:38.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.473+0000 7f3f2b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f2c102f90 0x7f3f2c19fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:33778/0 (socket says 172.21.15.178:33778) 2024-06-13T11:15:38.477 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.473+0000 7f3f2b7fe700 1 -- 172.21.15.178:0/2283585140 learned_addr learned my addr 172.21.15.178:0/2283585140 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-13T11:15:38.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.473+0000 7f3f2affd700 1 --2- 172.21.15.178:0/2283585140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f2c1013f0 0x7f3f2c06b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:15:38.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.474+0000 7f3f2b7fe700 1 -- 172.21.15.178:0/2283585140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f2c1013f0 msgr2=0x7f3f2c06b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:15:38.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.474+0000 7f3f2b7fe700 1 --2- 172.21.15.178:0/2283585140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f2c1013f0 0x7f3f2c06b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:38.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.474+0000 7f3f2b7fe700 1 -- 172.21.15.178:0/2283585140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f2c1025f0 msgr2=0x7f3f2c19d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:15:38.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.474+0000 7f3f2b7fe700 1 --2- 172.21.15.178:0/2283585140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f2c1025f0 0x7f3f2c19d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:38.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.474+0000 7f3f2b7fe700 1 -- 172.21.15.178:0/2283585140 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2c1a0440 con 0x7f3f2c102f90 2024-06-13T11:15:38.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.474+0000 7f3f2b7fe700 1 --2- 172.21.15.178:0/2283585140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f2c102f90 0x7f3f2c19fb70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400b070 tx=0x7f3f24007770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:15:38.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.474+0000 7f3f23fff700 1 -- 172.21.15.178:0/2283585140 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f24021020 con 0x7f3f2c102f90 2024-06-13T11:15:38.478 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.474+0000 7f3f23fff700 1 -- 172.21.15.178:0/2283585140 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f24005520 con 0x7f3f2c102f90 2024-06-13T11:15:38.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.474+0000 7f3f23fff700 1 -- 172.21.15.178:0/2283585140 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2401ba70 con 0x7f3f2c102f90 2024-06-13T11:15:38.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.474+0000 7f3f3142f700 1 -- 172.21.15.178:0/2283585140 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f2c1a06d0 con 0x7f3f2c102f90 2024-06-13T11:15:38.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.474+0000 7f3f3142f700 1 -- 172.21.15.178:0/2283585140 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f2c1a0c50 con 0x7f3f2c102f90 2024-06-13T11:15:38.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.475+0000 7f3f3142f700 1 -- 172.21.15.178:0/2283585140 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f2c069180 con 0x7f3f2c102f90 2024-06-13T11:15:38.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.476+0000 7f3f23fff700 1 -- 172.21.15.178:0/2283585140 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f3f24024020 con 0x7f3f2c102f90 2024-06-13T11:15:38.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.477+0000 7f3f23fff700 1 --2- 172.21.15.178:0/2283585140 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f3f180a2ca0 0x7f3f180a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:15:38.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.477+0000 7f3f23fff700 1 -- 172.21.15.178:0/2283585140 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5426+0+0 (secure 0 0 0) 0x7f3f2400f020 con 0x7f3f2c102f90 2024-06-13T11:15:38.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.477+0000 7f3f2affd700 1 --2- 172.21.15.178:0/2283585140 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f3f180a2ca0 0x7f3f180a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:15:38.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.478+0000 7f3f2affd700 1 --2- 172.21.15.178:0/2283585140 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f3f180a2ca0 0x7f3f180a5160 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3f14006fd0 tx=0x7f3f14008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:15:38.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.480+0000 7f3f23fff700 1 -- 172.21.15.178:0/2283585140 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3f2409db50 con 0x7f3f2c102f90 2024-06-13T11:15:38.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:38.682+0000 7f3f3142f700 1 -- 172.21.15.178:0/2283585140 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3f2c0628d0 con 0x7f3f180a2ca0 2024-06-13T11:15:39.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:38 smithi077 ceph-mon[36410]: osdmap e53: 8 total, 8 up, 8 in 2024-06-13T11:15:39.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:38 smithi077 ceph-mon[36410]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-06-13T11:15:39.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:38 smithi077 ceph-mon[36410]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:15:39.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:15:39.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:15:39.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:39.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:38 smithi077 ceph-mon[36410]: osdmap e54: 8 total, 8 up, 8 in 2024-06-13T11:15:39.323 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:38 smithi178 ceph-mon[36913]: osdmap e53: 8 total, 8 up, 8 in 2024-06-13T11:15:39.323 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:38 smithi178 ceph-mon[36913]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-06-13T11:15:39.323 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:38 smithi178 ceph-mon[36913]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:15:39.323 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:15:39.323 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:15:39.323 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:39.323 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:38 smithi178 ceph-mon[36913]: osdmap e54: 8 total, 8 up, 8 in 2024-06-13T11:15:39.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:38 smithi002 ceph-mon[32210]: osdmap e53: 8 total, 8 up, 8 in 2024-06-13T11:15:39.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:38 smithi002 ceph-mon[32210]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-06-13T11:15:39.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:38 smithi002 ceph-mon[32210]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:15:39.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:15:39.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:15:39.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:39.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:38 smithi002 ceph-mon[32210]: osdmap e54: 8 total, 8 up, 8 in 2024-06-13T11:15:40.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:40 smithi178 ceph-mon[36913]: pgmap v201: 1 pgs: 1 unknown; 577 KiB data, 247 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:40.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:40 smithi178 ceph-mon[36913]: osdmap e55: 8 total, 8 up, 8 in 2024-06-13T11:15:41.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:40 smithi077 ceph-mon[36410]: pgmap v201: 1 pgs: 1 unknown; 577 KiB data, 247 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:41.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:40 smithi077 ceph-mon[36410]: osdmap e55: 8 total, 8 up, 8 in 2024-06-13T11:15:41.079 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:40 smithi002 ceph-mon[32210]: pgmap v201: 1 pgs: 1 unknown; 577 KiB data, 247 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:41.079 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:40 smithi002 ceph-mon[32210]: osdmap e55: 8 total, 8 up, 8 in 2024-06-13T11:15:42.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:41 smithi002 ceph-mon[32210]: from='client.? 172.21.15.178:0/1987528049' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcc971fc-47d7-4289-8a9a-c76996c57370"}]: dispatch 2024-06-13T11:15:42.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:41 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcc971fc-47d7-4289-8a9a-c76996c57370"}]: dispatch 2024-06-13T11:15:42.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:41 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bcc971fc-47d7-4289-8a9a-c76996c57370"}]': finished 2024-06-13T11:15:42.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:41 smithi002 ceph-mon[32210]: osdmap e56: 9 total, 8 up, 9 in 2024-06-13T11:15:42.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T11:15:42.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:41 smithi178 ceph-mon[36913]: from='client.? 172.21.15.178:0/1987528049' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcc971fc-47d7-4289-8a9a-c76996c57370"}]: dispatch 2024-06-13T11:15:42.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:41 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcc971fc-47d7-4289-8a9a-c76996c57370"}]: dispatch 2024-06-13T11:15:42.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:41 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bcc971fc-47d7-4289-8a9a-c76996c57370"}]': finished 2024-06-13T11:15:42.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:41 smithi178 ceph-mon[36913]: osdmap e56: 9 total, 8 up, 9 in 2024-06-13T11:15:42.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T11:15:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:41 smithi077 ceph-mon[36410]: from='client.? 172.21.15.178:0/1987528049' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcc971fc-47d7-4289-8a9a-c76996c57370"}]: dispatch 2024-06-13T11:15:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:41 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcc971fc-47d7-4289-8a9a-c76996c57370"}]: dispatch 2024-06-13T11:15:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:41 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bcc971fc-47d7-4289-8a9a-c76996c57370"}]': finished 2024-06-13T11:15:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:41 smithi077 ceph-mon[36410]: osdmap e56: 9 total, 8 up, 9 in 2024-06-13T11:15:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T11:15:43.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:42 smithi002 ceph-mon[32210]: pgmap v203: 1 pgs: 1 unknown; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:43.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:42 smithi002 ceph-mon[32210]: from='client.? 172.21.15.178:0/3459022397' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:15:43.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:42 smithi178 ceph-mon[36913]: pgmap v203: 1 pgs: 1 unknown; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:42 smithi178 ceph-mon[36913]: from='client.? 172.21.15.178:0/3459022397' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:15:43.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:42 smithi077 ceph-mon[36410]: pgmap v203: 1 pgs: 1 unknown; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:42 smithi077 ceph-mon[36410]: from='client.? 172.21.15.178:0/3459022397' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:15:44.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:43 smithi002 ceph-mon[32210]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-06-13T11:15:44.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:43 smithi002 ceph-mon[32210]: Cluster is now healthy 2024-06-13T11:15:44.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:43 smithi178 ceph-mon[36913]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-06-13T11:15:44.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:43 smithi178 ceph-mon[36913]: Cluster is now healthy 2024-06-13T11:15:44.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:43 smithi077 ceph-mon[36410]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-06-13T11:15:44.380 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:43 smithi077 ceph-mon[36410]: Cluster is now healthy 2024-06-13T11:15:45.154 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:44 smithi178 ceph-mon[36913]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:45.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:44 smithi077 ceph-mon[36410]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:45.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:44 smithi002 ceph-mon[32210]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:47.185 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:46 smithi178 ceph-mon[36913]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:47.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:46 smithi077 ceph-mon[36410]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:47.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:46 smithi002 ceph-mon[32210]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:49.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:48 smithi178 ceph-mon[36913]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:49.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-13T11:15:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:49.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:48 smithi077 ceph-mon[36410]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:49.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-13T11:15:49.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:49.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:48 smithi002 ceph-mon[32210]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:49.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-13T11:15:49.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:15:50.123 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:49 smithi178 ceph-mon[36913]: Deploying daemon osd.8 on smithi178 2024-06-13T11:15:50.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:49 smithi077 ceph-mon[36410]: Deploying daemon osd.8 on smithi178 2024-06-13T11:15:50.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:49 smithi002 ceph-mon[32210]: Deploying daemon osd.8 on smithi178 2024-06-13T11:15:51.105 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:50 smithi178 ceph-mon[36913]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:51.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:50 smithi077 ceph-mon[36410]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:51.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:50 smithi002 ceph-mon[32210]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:53.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:52 smithi178 ceph-mon[36913]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:53.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:52 smithi077 ceph-mon[36410]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:53.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:52 smithi002 ceph-mon[32210]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:55.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:54 smithi178 ceph-mon[36913]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:55.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:54 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:55.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:54 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:55.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:54 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:15:55.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:54 smithi077 ceph-mon[36410]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:55.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:54 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:55.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:54 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:55.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:54 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:15:55.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:54 smithi002 ceph-mon[32210]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:55.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:54 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:55.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:54 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:55.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:54 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:15:57.126 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:56 smithi178 ceph-mon[36913]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:57.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:56 smithi077 ceph-mon[36410]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:57.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:56 smithi002 ceph-mon[32210]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:58.068 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 8 on host 'smithi178' 2024-06-13T11:15:58.068 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:58.069+0000 7f3f23fff700 1 -- 172.21.15.178:0/2283585140 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3f2c0628d0 con 0x7f3f180a2ca0 2024-06-13T11:15:58.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:58.072+0000 7f3f3142f700 1 -- 172.21.15.178:0/2283585140 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f3f180a2ca0 msgr2=0x7f3f180a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:15:58.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:58.072+0000 7f3f3142f700 1 --2- 172.21.15.178:0/2283585140 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f3f180a2ca0 0x7f3f180a5160 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3f14006fd0 tx=0x7f3f14008040 comp rx=0 tx=0).stop 2024-06-13T11:15:58.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:58.072+0000 7f3f3142f700 1 -- 172.21.15.178:0/2283585140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f2c102f90 msgr2=0x7f3f2c19fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:15:58.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:58.072+0000 7f3f3142f700 1 --2- 172.21.15.178:0/2283585140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f2c102f90 0x7f3f2c19fb70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400b070 tx=0x7f3f24007770 comp rx=0 tx=0).stop 2024-06-13T11:15:58.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:58.072+0000 7f3f3142f700 1 -- 172.21.15.178:0/2283585140 shutdown_connections 2024-06-13T11:15:58.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:58.072+0000 7f3f3142f700 1 --2- 172.21.15.178:0/2283585140 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f3f180a2ca0 0x7f3f180a5160 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:58.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:58.072+0000 7f3f3142f700 1 --2- 172.21.15.178:0/2283585140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f2c102f90 0x7f3f2c19fb70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:58.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:58.072+0000 7f3f3142f700 1 --2- 172.21.15.178:0/2283585140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f2c1013f0 0x7f3f2c06b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:58.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:58.072+0000 7f3f3142f700 1 --2- 172.21.15.178:0/2283585140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f2c1025f0 0x7f3f2c19d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:15:58.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:58.072+0000 7f3f3142f700 1 -- 172.21.15.178:0/2283585140 >> 172.21.15.178:0/2283585140 conn(0x7f3f2c0fc9b0 msgr2=0x7f3f2c105970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:15:58.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:58.072+0000 7f3f3142f700 1 -- 172.21.15.178:0/2283585140 shutdown_connections 2024-06-13T11:15:58.072 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:15:58.072+0000 7f3f3142f700 1 -- 172.21.15.178:0/2283585140 wait complete. 2024-06-13T11:15:58.785 DEBUG:teuthology.orchestra.run.smithi178:osd.8> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.8.service 2024-06-13T11:15:58.787 INFO:tasks.cephadm:Deploying osd.9 on smithi002 with /dev/vg_nvme/lv_1... 2024-06-13T11:15:58.788 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-13T11:15:59.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:58 smithi002 ceph-mon[32210]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:59.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:58 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:59.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:58 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:59.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:58 smithi002 ceph-mon[32210]: from='osd.8 [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-13T11:15:59.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:58 smithi002 ceph-mon[32210]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-13T11:15:59.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:58 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:59.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:15:58 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:59.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:58 smithi178 ceph-mon[36913]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:59.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:58 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:59.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:58 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:59.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:58 smithi178 ceph-mon[36913]: from='osd.8 [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-13T11:15:59.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:58 smithi178 ceph-mon[36913]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-13T11:15:59.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:58 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:59.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:15:58 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:15:59.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:58 smithi077 ceph-mon[36410]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:15:59.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:58 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:59.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:58 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:59.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:58 smithi077 ceph-mon[36410]: from='osd.8 [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-13T11:15:59.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:58 smithi077 ceph-mon[36410]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-13T11:15:59.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:58 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:15:59.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:15:58 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:00.197 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:16:00 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:16:00.059+0000 7f4679d9e700 -1 osd.8 0 waiting for initial osdmap 2024-06-13T11:16:00.197 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:16:00 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:16:00.069+0000 7f4675b91700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:16:00.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:00 smithi178 ceph-mon[36913]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-13T11:16:00.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:00 smithi178 ceph-mon[36913]: from='osd.8 [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:16:00.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:00 smithi178 ceph-mon[36913]: osdmap e57: 9 total, 8 up, 9 in 2024-06-13T11:16:00.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T11:16:00.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:00 smithi178 ceph-mon[36913]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:16:00.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:00 smithi178 ceph-mon[36913]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:16:00.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:00 smithi002 ceph-mon[32210]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-13T11:16:00.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:00 smithi002 ceph-mon[32210]: from='osd.8 [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:16:00.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:00 smithi002 ceph-mon[32210]: osdmap e57: 9 total, 8 up, 9 in 2024-06-13T11:16:00.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T11:16:00.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:00 smithi002 ceph-mon[32210]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:16:00.310 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:00 smithi002 ceph-mon[32210]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:16:00.470 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:00 smithi077 ceph-mon[36410]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-13T11:16:00.470 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:00 smithi077 ceph-mon[36410]: from='osd.8 [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:16:00.470 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:00 smithi077 ceph-mon[36410]: osdmap e57: 9 total, 8 up, 9 in 2024-06-13T11:16:00.470 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T11:16:00.470 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:00 smithi077 ceph-mon[36410]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:16:00.470 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:00 smithi077 ceph-mon[36410]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-06-13T11:16:01.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:01 smithi178 ceph-mon[36913]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-13T11:16:01.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:01 smithi178 ceph-mon[36913]: osdmap e58: 9 total, 8 up, 9 in 2024-06-13T11:16:01.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:01 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T11:16:01.341 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:01 smithi002 ceph-mon[32210]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-13T11:16:01.341 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:01 smithi002 ceph-mon[32210]: osdmap e58: 9 total, 8 up, 9 in 2024-06-13T11:16:01.341 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:01 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T11:16:01.388 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:01 smithi077 ceph-mon[36410]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-13T11:16:01.388 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:01 smithi077 ceph-mon[36410]: osdmap e58: 9 total, 8 up, 9 in 2024-06-13T11:16:01.389 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:01 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T11:16:02.317 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:02 smithi178 ceph-mon[36913]: purged_snaps scrub starts 2024-06-13T11:16:02.317 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:02 smithi178 ceph-mon[36913]: purged_snaps scrub ok 2024-06-13T11:16:02.317 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:02 smithi178 ceph-mon[36913]: osd.8 [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591] boot 2024-06-13T11:16:02.317 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:02 smithi178 ceph-mon[36913]: osdmap e59: 9 total, 9 up, 9 in 2024-06-13T11:16:02.317 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:02 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T11:16:02.317 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:02 smithi178 ceph-mon[36913]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:02.317 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:02 smithi178 ceph-mon[36913]: osdmap e60: 9 total, 9 up, 9 in 2024-06-13T11:16:02.377 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-13T11:16:02.377 INFO:teuthology.orchestra.run.smithi002.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-13T11:16:02.377 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 10+0 records in 2024-06-13T11:16:02.377 INFO:teuthology.orchestra.run.smithi002.stderr:10+0 records out 2024-06-13T11:16:02.377 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0382245 s, 274 MB/s 2024-06-13T11:16:02.377 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping successful for: 2024-06-13T11:16:02.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:02 smithi002 ceph-mon[32210]: purged_snaps scrub starts 2024-06-13T11:16:02.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:02 smithi002 ceph-mon[32210]: purged_snaps scrub ok 2024-06-13T11:16:02.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:02 smithi002 ceph-mon[32210]: osd.8 [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591] boot 2024-06-13T11:16:02.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:02 smithi002 ceph-mon[32210]: osdmap e59: 9 total, 9 up, 9 in 2024-06-13T11:16:02.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:02 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T11:16:02.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:02 smithi002 ceph-mon[32210]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:02.378 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:02 smithi002 ceph-mon[32210]: osdmap e60: 9 total, 9 up, 9 in 2024-06-13T11:16:02.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:02 smithi077 ceph-mon[36410]: purged_snaps scrub starts 2024-06-13T11:16:02.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:02 smithi077 ceph-mon[36410]: purged_snaps scrub ok 2024-06-13T11:16:02.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:02 smithi077 ceph-mon[36410]: osd.8 [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591] boot 2024-06-13T11:16:02.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:02 smithi077 ceph-mon[36410]: osdmap e59: 9 total, 9 up, 9 in 2024-06-13T11:16:02.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:02 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T11:16:02.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:02 smithi077 ceph-mon[36410]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:02.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:02 smithi077 ceph-mon[36410]: osdmap e60: 9 total, 9 up, 9 in 2024-06-13T11:16:03.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_1 2024-06-13T11:16:03.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:03 smithi002 ceph-mon[32210]: Detected new or changed devices on smithi178 2024-06-13T11:16:03.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:03 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:03.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:03 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:03.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:03 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:03.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:03 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:03.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:03 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:03.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:03 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi178 to 5696M 2024-06-13T11:16:03.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:03 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:03.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:03 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:03.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:03 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:16:03.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:03 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:03.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:03 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:16:03.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:03 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:03.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:03 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:16:03.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:03 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:03.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:03 smithi002 ceph-mon[32210]: osdmap e61: 9 total, 9 up, 9 in 2024-06-13T11:16:03.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:03 smithi178 ceph-mon[36913]: Detected new or changed devices on smithi178 2024-06-13T11:16:03.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:03 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:03.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:03 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:03.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:03 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:03.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:03 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:03.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:03 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:03.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:03 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi178 to 5696M 2024-06-13T11:16:03.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:03 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:03.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:03 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:03.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:03 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:16:03.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:03 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:03.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:03 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:16:03.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:03 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:03.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:03 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:16:03.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:03 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:03.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:03 smithi178 ceph-mon[36913]: osdmap e61: 9 total, 9 up, 9 in 2024-06-13T11:16:03.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:03 smithi077 ceph-mon[36410]: Detected new or changed devices on smithi178 2024-06-13T11:16:03.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:03 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:03.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:03 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:03.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:03 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:03.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:03 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:03.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:03 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:03.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:03 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi178 to 5696M 2024-06-13T11:16:03.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:03 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:03.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:03 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:03.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:03 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:16:03.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:03 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:03.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:03 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:16:03.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:03 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:03.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:03 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:16:03.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:03 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:03.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:03 smithi077 ceph-mon[36410]: osdmap e61: 9 total, 9 up, 9 in 2024-06-13T11:16:03.812 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:16:05.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:04 smithi002 ceph-mon[32210]: pgmap v220: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:05.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:04 smithi002 ceph-mon[32210]: osdmap e62: 9 total, 9 up, 9 in 2024-06-13T11:16:05.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:04 smithi178 ceph-mon[36913]: pgmap v220: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:05.199 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:04 smithi178 ceph-mon[36913]: osdmap e62: 9 total, 9 up, 9 in 2024-06-13T11:16:05.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:04 smithi077 ceph-mon[36410]: pgmap v220: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:05.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:04 smithi077 ceph-mon[36410]: osdmap e62: 9 total, 9 up, 9 in 2024-06-13T11:16:06.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.071+0000 7f62c9200700 1 -- 172.21.15.2:0/3920130397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c41081e0 msgr2=0x7f62c410a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:16:06.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.071+0000 7f62c9200700 1 --2- 172.21.15.2:0/3920130397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c41081e0 0x7f62c410a650 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00b0a0 tx=0x7f62bc00b3b0 comp rx=0 tx=0).stop 2024-06-13T11:16:06.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.071+0000 7f62c9200700 1 -- 172.21.15.2:0/3920130397 shutdown_connections 2024-06-13T11:16:06.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.071+0000 7f62c9200700 1 --2- 172.21.15.2:0/3920130397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c4102f80 0x7f62c4105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:16:06.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.071+0000 7f62c9200700 1 --2- 172.21.15.2:0/3920130397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c41081e0 0x7f62c410a650 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:16:06.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.071+0000 7f62c9200700 1 --2- 172.21.15.2:0/3920130397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62c41058b0 0x7f62c4107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:16:06.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.071+0000 7f62c9200700 1 -- 172.21.15.2:0/3920130397 >> 172.21.15.2:0/3920130397 conn(0x7f62c40fc9b0 msgr2=0x7f62c40fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:16:06.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.071+0000 7f62c9200700 1 -- 172.21.15.2:0/3920130397 shutdown_connections 2024-06-13T11:16:06.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.071+0000 7f62c9200700 1 -- 172.21.15.2:0/3920130397 wait complete. 2024-06-13T11:16:06.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.072+0000 7f62c9200700 1 Processor -- start 2024-06-13T11:16:06.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.072+0000 7f62c9200700 1 -- start start 2024-06-13T11:16:06.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.073+0000 7f62c9200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c4102f80 0x7f62c419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:16:06.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.073+0000 7f62c9200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62c41058b0 0x7f62c419ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:16:06.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.073+0000 7f62c9200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c41081e0 0x7f62c41a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:16:06.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.073+0000 7f62c9200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f62c410e0f0 con 0x7f62c4102f80 2024-06-13T11:16:06.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.073+0000 7f62c9200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f62c410df70 con 0x7f62c41058b0 2024-06-13T11:16:06.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.073+0000 7f62c9200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f62c410e270 con 0x7f62c41081e0 2024-06-13T11:16:06.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.073+0000 7f62c1e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c4102f80 0x7f62c419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:16:06.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.073+0000 7f62c1e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c4102f80 0x7f62c419a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48574/0 (socket says 172.21.15.2:48574) 2024-06-13T11:16:06.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.073+0000 7f62c1e00700 1 -- 172.21.15.2:0/1346227312 learned_addr learned my addr 172.21.15.2:0/1346227312 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:16:06.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.073+0000 7f62bbe00700 1 --2- 172.21.15.2:0/1346227312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62c41058b0 0x7f62c419ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:16:06.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.073+0000 7f62c2800700 1 --2- 172.21.15.2:0/1346227312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c41081e0 0x7f62c41a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:16:06.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.074+0000 7f62c1e00700 1 -- 172.21.15.2:0/1346227312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c41081e0 msgr2=0x7f62c41a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:16:06.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.074+0000 7f62c1e00700 1 --2- 172.21.15.2:0/1346227312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c41081e0 0x7f62c41a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:16:06.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.074+0000 7f62c1e00700 1 -- 172.21.15.2:0/1346227312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62c41058b0 msgr2=0x7f62c419ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:16:06.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.074+0000 7f62c1e00700 1 --2- 172.21.15.2:0/1346227312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62c41058b0 0x7f62c419ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:16:06.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.074+0000 7f62c1e00700 1 -- 172.21.15.2:0/1346227312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c41a2550 con 0x7f62c4102f80 2024-06-13T11:16:06.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.074+0000 7f62bbe00700 1 --2- 172.21.15.2:0/1346227312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62c41058b0 0x7f62c419ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:16:06.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.074+0000 7f62c1e00700 1 --2- 172.21.15.2:0/1346227312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c4102f80 0x7f62c419a8f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f62b400e9d0 tx=0x7f62b400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:16:06.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.074+0000 7f62baa00700 1 -- 172.21.15.2:0/1346227312 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b400cbd0 con 0x7f62c4102f80 2024-06-13T11:16:06.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.075+0000 7f62baa00700 1 -- 172.21.15.2:0/1346227312 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62b400ee70 con 0x7f62c4102f80 2024-06-13T11:16:06.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.075+0000 7f62baa00700 1 -- 172.21.15.2:0/1346227312 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b4018660 con 0x7f62c4102f80 2024-06-13T11:16:06.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.075+0000 7f62c9200700 1 -- 172.21.15.2:0/1346227312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c41a2840 con 0x7f62c4102f80 2024-06-13T11:16:06.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.075+0000 7f62c9200700 1 -- 172.21.15.2:0/1346227312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c41a2d30 con 0x7f62c4102f80 2024-06-13T11:16:06.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.076+0000 7f62c9200700 1 -- 172.21.15.2:0/1346227312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62c4069180 con 0x7f62c4102f80 2024-06-13T11:16:06.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.081+0000 7f62baa00700 1 -- 172.21.15.2:0/1346227312 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f62b4010430 con 0x7f62c4102f80 2024-06-13T11:16:06.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.083+0000 7f62baa00700 1 --2- 172.21.15.2:0/1346227312 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f62a80a2ca0 0x7f62a80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:16:06.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.083+0000 7f62baa00700 1 -- 172.21.15.2:0/1346227312 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5829+0+0 (secure 0 0 0) 0x7f62b40ce890 con 0x7f62c4102f80 2024-06-13T11:16:06.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.083+0000 7f62bbe00700 1 --2- 172.21.15.2:0/1346227312 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f62a80a2ca0 0x7f62a80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:16:06.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.084+0000 7f62bbe00700 1 --2- 172.21.15.2:0/1346227312 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f62a80a2ca0 0x7f62a80a5160 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009680 tx=0x7f62ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:16:06.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.088+0000 7f62baa00700 1 -- 172.21.15.2:0/1346227312 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f62b409c100 con 0x7f62c4102f80 2024-06-13T11:16:06.088 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:05 smithi002 ceph-mon[32210]: osdmap e63: 9 total, 9 up, 9 in 2024-06-13T11:16:06.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:05 smithi178 ceph-mon[36913]: osdmap e63: 9 total, 9 up, 9 in 2024-06-13T11:16:06.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:05 smithi077 ceph-mon[36410]: osdmap e63: 9 total, 9 up, 9 in 2024-06-13T11:16:06.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:06.330+0000 7f62c9200700 1 -- 172.21.15.2:0/1346227312 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f62c40628d0 con 0x7f62a80a2ca0 2024-06-13T11:16:07.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:06 smithi002 ceph-mon[32210]: pgmap v223: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:07.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:16:07.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:16:07.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:07.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:06 smithi178 ceph-mon[36913]: pgmap v223: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:07.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:16:07.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:16:07.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:07.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:06 smithi077 ceph-mon[36410]: pgmap v223: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:07.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:16:07.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:16:07.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:08.116 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:07 smithi178 ceph-mon[36913]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:16:08.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:07 smithi002 ceph-mon[32210]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:16:08.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:07 smithi077 ceph-mon[36410]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:16:08.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:08 smithi002 ceph-mon[32210]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-06-13T11:16:09.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:08 smithi178 ceph-mon[36913]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-06-13T11:16:09.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:08 smithi077 ceph-mon[36410]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-06-13T11:16:11.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:10 smithi002 ceph-mon[32210]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-06-13T11:16:11.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:10 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/583860895' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "899d7d4f-a24c-4508-b42c-0b363275c459"}]: dispatch 2024-06-13T11:16:11.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:10 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "899d7d4f-a24c-4508-b42c-0b363275c459"}]: dispatch 2024-06-13T11:16:11.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:10 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "899d7d4f-a24c-4508-b42c-0b363275c459"}]': finished 2024-06-13T11:16:11.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:10 smithi002 ceph-mon[32210]: osdmap e64: 10 total, 9 up, 10 in 2024-06-13T11:16:11.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:10 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:16:11.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:10 smithi178 ceph-mon[36913]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-06-13T11:16:11.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:10 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/583860895' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "899d7d4f-a24c-4508-b42c-0b363275c459"}]: dispatch 2024-06-13T11:16:11.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:10 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "899d7d4f-a24c-4508-b42c-0b363275c459"}]: dispatch 2024-06-13T11:16:11.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:10 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "899d7d4f-a24c-4508-b42c-0b363275c459"}]': finished 2024-06-13T11:16:11.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:10 smithi178 ceph-mon[36913]: osdmap e64: 10 total, 9 up, 10 in 2024-06-13T11:16:11.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:10 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:16:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:10 smithi077 ceph-mon[36410]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-06-13T11:16:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:10 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/583860895' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "899d7d4f-a24c-4508-b42c-0b363275c459"}]: dispatch 2024-06-13T11:16:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:10 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "899d7d4f-a24c-4508-b42c-0b363275c459"}]: dispatch 2024-06-13T11:16:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:10 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "899d7d4f-a24c-4508-b42c-0b363275c459"}]': finished 2024-06-13T11:16:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:10 smithi077 ceph-mon[36410]: osdmap e64: 10 total, 9 up, 10 in 2024-06-13T11:16:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:10 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:16:12.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:11 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1901123263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:16:12.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:11 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1901123263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:16:12.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:11 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1901123263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:16:13.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:12 smithi002 ceph-mon[32210]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-06-13T11:16:13.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:12 smithi178 ceph-mon[36913]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-06-13T11:16:13.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:12 smithi077 ceph-mon[36410]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-06-13T11:16:15.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:14 smithi002 ceph-mon[32210]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-06-13T11:16:15.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:14 smithi178 ceph-mon[36913]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-06-13T11:16:15.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:14 smithi077 ceph-mon[36410]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-06-13T11:16:17.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:16 smithi002 ceph-mon[32210]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-13T11:16:17.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:16 smithi178 ceph-mon[36913]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-13T11:16:17.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:16 smithi077 ceph-mon[36410]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-13T11:16:19.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:18 smithi178 ceph-mon[36913]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:19.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:18 smithi077 ceph-mon[36410]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:19.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:18 smithi002 ceph-mon[32210]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:21.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:20 smithi178 ceph-mon[36913]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:21.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-13T11:16:21.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:20 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:21.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:20 smithi077 ceph-mon[36410]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:21.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:20 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-13T11:16:21.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:20 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:21.374 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:20 smithi002 ceph-mon[32210]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:21.374 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:20 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-13T11:16:21.374 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:20 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:22.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:21 smithi002 ceph-mon[32210]: Deploying daemon osd.9 on smithi002 2024-06-13T11:16:22.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:21 smithi178 ceph-mon[36913]: Deploying daemon osd.9 on smithi002 2024-06-13T11:16:22.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:21 smithi077 ceph-mon[36410]: Deploying daemon osd.9 on smithi002 2024-06-13T11:16:23.192 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:22 smithi002 ceph-mon[32210]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:23.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:22 smithi178 ceph-mon[36913]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:23.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:22 smithi077 ceph-mon[36410]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:25.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:24 smithi178 ceph-mon[36913]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:25.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:24 smithi077 ceph-mon[36410]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:25.391 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:24 smithi002 ceph-mon[32210]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:27.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:26 smithi178 ceph-mon[36913]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:27.275 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:26 smithi002 ceph-mon[32210]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:27.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:26 smithi077 ceph-mon[36410]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:29.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:28 smithi002 ceph-mon[32210]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:29.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:28 smithi178 ceph-mon[36913]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:29.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:28 smithi077 ceph-mon[36410]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:30.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:30.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:30.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:16:30.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:30 smithi002 ceph-mon[32210]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:30.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:30.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:30.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:16:30.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:30 smithi077 ceph-mon[36410]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:30.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:30.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:30.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:16:30.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:30 smithi178 ceph-mon[36913]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:32.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:32 smithi077 ceph-mon[36410]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:32.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:32 smithi002 ceph-mon[32210]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:32.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:32 smithi178 ceph-mon[36913]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:33.981+0000 7f62baa00700 1 -- 172.21.15.2:0/1346227312 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f62c40628d0 con 0x7f62a80a2ca0 2024-06-13T11:16:33.981 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 9 on host 'smithi002' 2024-06-13T11:16:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:33.984+0000 7f62c9200700 1 -- 172.21.15.2:0/1346227312 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f62a80a2ca0 msgr2=0x7f62a80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:16:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:33.984+0000 7f62c9200700 1 --2- 172.21.15.2:0/1346227312 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f62a80a2ca0 0x7f62a80a5160 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009680 tx=0x7f62ac009260 comp rx=0 tx=0).stop 2024-06-13T11:16:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:33.984+0000 7f62c9200700 1 -- 172.21.15.2:0/1346227312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c4102f80 msgr2=0x7f62c419a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:16:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:33.984+0000 7f62c9200700 1 --2- 172.21.15.2:0/1346227312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c4102f80 0x7f62c419a8f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f62b400e9d0 tx=0x7f62b400ece0 comp rx=0 tx=0).stop 2024-06-13T11:16:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:33.984+0000 7f62c9200700 1 -- 172.21.15.2:0/1346227312 shutdown_connections 2024-06-13T11:16:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:33.984+0000 7f62c9200700 1 --2- 172.21.15.2:0/1346227312 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f62a80a2ca0 0x7f62a80a5160 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:16:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:33.984+0000 7f62c9200700 1 --2- 172.21.15.2:0/1346227312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62c4102f80 0x7f62c419a8f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:16:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:33.984+0000 7f62c9200700 1 --2- 172.21.15.2:0/1346227312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c41081e0 0x7f62c41a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:16:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:33.984+0000 7f62c9200700 1 --2- 172.21.15.2:0/1346227312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62c41058b0 0x7f62c419ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:16:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:33.984+0000 7f62c9200700 1 -- 172.21.15.2:0/1346227312 >> 172.21.15.2:0/1346227312 conn(0x7f62c40fc9b0 msgr2=0x7f62c4102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:16:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:33.984+0000 7f62c9200700 1 -- 172.21.15.2:0/1346227312 shutdown_connections 2024-06-13T11:16:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:16:33.985+0000 7f62c9200700 1 -- 172.21.15.2:0/1346227312 wait complete. 2024-06-13T11:16:34.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:33 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:34.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:33 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:34.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:33 smithi002 ceph-mon[32210]: from='osd.9 [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-13T11:16:34.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:33 smithi002 ceph-mon[32210]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-13T11:16:34.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:33 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:34.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:33 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:34.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:33 smithi178 ceph-mon[36913]: from='osd.9 [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-13T11:16:34.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:33 smithi178 ceph-mon[36913]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-13T11:16:34.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:33 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:34.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:33 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:34.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:33 smithi077 ceph-mon[36410]: from='osd.9 [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-13T11:16:34.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:33 smithi077 ceph-mon[36410]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-13T11:16:34.802 DEBUG:teuthology.orchestra.run.smithi002:osd.9> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.9.service 2024-06-13T11:16:34.807 INFO:tasks.cephadm:Deploying osd.10 on smithi077 with /dev/vg_nvme/lv_1... 2024-06-13T11:16:34.807 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-13T11:16:35.054 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T11:16:35.138 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:16:34 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:16:34.883+0000 7fa56be00700 -1 osd.9 0 waiting for initial osdmap 2024-06-13T11:16:35.139 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:16:34 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:16:34.921+0000 7fa566c00700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:16:35.139 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:34 smithi002 ceph-mon[32210]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:35.139 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:34 smithi002 ceph-mon[32210]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-13T11:16:35.139 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:34 smithi002 ceph-mon[32210]: from='osd.9 [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:16:35.140 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:34 smithi002 ceph-mon[32210]: osdmap e65: 10 total, 9 up, 10 in 2024-06-13T11:16:35.140 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:16:35.140 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:34 smithi002 ceph-mon[32210]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:16:35.140 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:35.140 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:35.175 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:34 smithi077 ceph-mon[36410]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:35.175 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:34 smithi077 ceph-mon[36410]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-13T11:16:35.175 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:34 smithi077 ceph-mon[36410]: from='osd.9 [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:16:35.175 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:34 smithi077 ceph-mon[36410]: osdmap e65: 10 total, 9 up, 10 in 2024-06-13T11:16:35.175 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:34 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:16:35.175 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:34 smithi077 ceph-mon[36410]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:16:35.175 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:34 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:35.175 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:34 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:35.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:34 smithi178 ceph-mon[36913]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:35.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:34 smithi178 ceph-mon[36913]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-13T11:16:35.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:34 smithi178 ceph-mon[36913]: from='osd.9 [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:16:35.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:34 smithi178 ceph-mon[36913]: osdmap e65: 10 total, 9 up, 10 in 2024-06-13T11:16:35.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:16:35.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:34 smithi178 ceph-mon[36913]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T11:16:35.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:35.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:36.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:35 smithi002 ceph-mon[32210]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T11:16:36.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:35 smithi002 ceph-mon[32210]: osdmap e66: 10 total, 9 up, 10 in 2024-06-13T11:16:36.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:35 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:16:36.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:35 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:16:36.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:35 smithi178 ceph-mon[36913]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T11:16:36.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:35 smithi178 ceph-mon[36913]: osdmap e66: 10 total, 9 up, 10 in 2024-06-13T11:16:36.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:35 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:16:36.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:35 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:16:36.204 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:35 smithi077 ceph-mon[36410]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T11:16:36.204 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:35 smithi077 ceph-mon[36410]: osdmap e66: 10 total, 9 up, 10 in 2024-06-13T11:16:36.204 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:35 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:16:36.204 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:35 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:16:36.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:36 smithi002 ceph-mon[32210]: purged_snaps scrub starts 2024-06-13T11:16:36.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:36 smithi002 ceph-mon[32210]: purged_snaps scrub ok 2024-06-13T11:16:36.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:36 smithi002 ceph-mon[32210]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:36.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:36 smithi002 ceph-mon[32210]: osd.9 [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478] boot 2024-06-13T11:16:36.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:36 smithi002 ceph-mon[32210]: osdmap e67: 10 total, 10 up, 10 in 2024-06-13T11:16:36.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:16:37.146 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:36 smithi077 ceph-mon[36410]: purged_snaps scrub starts 2024-06-13T11:16:37.146 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:36 smithi077 ceph-mon[36410]: purged_snaps scrub ok 2024-06-13T11:16:37.146 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:36 smithi077 ceph-mon[36410]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:37.146 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:36 smithi077 ceph-mon[36410]: osd.9 [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478] boot 2024-06-13T11:16:37.146 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:36 smithi077 ceph-mon[36410]: osdmap e67: 10 total, 10 up, 10 in 2024-06-13T11:16:37.146 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:16:37.147 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-13T11:16:37.147 INFO:teuthology.orchestra.run.smithi077.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-13T11:16:37.147 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10+0 records in 2024-06-13T11:16:37.147 INFO:teuthology.orchestra.run.smithi077.stderr:10+0 records out 2024-06-13T11:16:37.147 INFO:teuthology.orchestra.run.smithi077.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0164319 s, 638 MB/s 2024-06-13T11:16:37.147 INFO:teuthology.orchestra.run.smithi077.stderr:--> Zapping successful for: 2024-06-13T11:16:37.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:36 smithi178 ceph-mon[36913]: purged_snaps scrub starts 2024-06-13T11:16:37.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:36 smithi178 ceph-mon[36913]: purged_snaps scrub ok 2024-06-13T11:16:37.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:36 smithi178 ceph-mon[36913]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-06-13T11:16:37.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:36 smithi178 ceph-mon[36913]: osd.9 [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478] boot 2024-06-13T11:16:37.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:36 smithi178 ceph-mon[36913]: osdmap e67: 10 total, 10 up, 10 in 2024-06-13T11:16:37.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:16:37.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_1 2024-06-13T11:16:38.060 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T11:16:38.181 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:37 smithi077 ceph-mon[36410]: osdmap e68: 10 total, 10 up, 10 in 2024-06-13T11:16:38.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:37 smithi178 ceph-mon[36913]: osdmap e68: 10 total, 10 up, 10 in 2024-06-13T11:16:38.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:37 smithi002 ceph-mon[32210]: osdmap e68: 10 total, 10 up, 10 in 2024-06-13T11:16:39.192 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:38 smithi077 ceph-mon[36410]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:39.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:38 smithi178 ceph-mon[36913]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:39.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:38 smithi002 ceph-mon[32210]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:39.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.706+0000 7fb71948e700 1 -- 172.21.15.77:0/4223473842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb714104210 msgr2=0x7fb71410aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:16:39.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.706+0000 7fb71948e700 1 --2- 172.21.15.77:0/4223473842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb714104210 0x7fb71410aac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00b0d0 tx=0x7fb70c00b3e0 comp rx=0 tx=0).stop 2024-06-13T11:16:39.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.706+0000 7fb71948e700 1 -- 172.21.15.77:0/4223473842 shutdown_connections 2024-06-13T11:16:39.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.706+0000 7fb71948e700 1 --2- 172.21.15.77:0/4223473842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb714104210 0x7fb71410aac0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:16:39.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.706+0000 7fb71948e700 1 --2- 172.21.15.77:0/4223473842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7141007f0 0x7fb714100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:16:39.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.706+0000 7fb71948e700 1 --2- 172.21.15.77:0/4223473842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb714103870 0x7fb714103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:16:39.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.706+0000 7fb71948e700 1 -- 172.21.15.77:0/4223473842 >> 172.21.15.77:0/4223473842 conn(0x7fb7140fc130 msgr2=0x7fb7140fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:16:39.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.706+0000 7fb71948e700 1 -- 172.21.15.77:0/4223473842 shutdown_connections 2024-06-13T11:16:39.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.706+0000 7fb71948e700 1 -- 172.21.15.77:0/4223473842 wait complete. 2024-06-13T11:16:39.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.707+0000 7fb71948e700 1 Processor -- start 2024-06-13T11:16:39.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.707+0000 7fb71948e700 1 -- start start 2024-06-13T11:16:39.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.707+0000 7fb71948e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7141007f0 0x7fb7141031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:16:39.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.707+0000 7fb71948e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb714103870 0x7fb714101820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:16:39.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.707+0000 7fb71948e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb714104210 0x7fb714101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:16:39.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.707+0000 7fb71948e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb71410e170 con 0x7fb714103870 2024-06-13T11:16:39.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.707+0000 7fb71948e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb71410dff0 con 0x7fb7141007f0 2024-06-13T11:16:39.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.707+0000 7fb71948e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb71410e2f0 con 0x7fb714104210 2024-06-13T11:16:39.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.707+0000 7fb712ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7141007f0 0x7fb7141031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:16:39.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.707+0000 7fb712ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7141007f0 0x7fb7141031d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48048/0 (socket says 172.21.15.77:48048) 2024-06-13T11:16:39.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.707+0000 7fb712ffd700 1 -- 172.21.15.77:0/2409180911 learned_addr learned my addr 172.21.15.77:0/2409180911 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-06-13T11:16:39.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.708+0000 7fb7137fe700 1 --2- 172.21.15.77:0/2409180911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb714104210 0x7fb714101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:16:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.708+0000 7fb712ffd700 1 -- 172.21.15.77:0/2409180911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb714104210 msgr2=0x7fb714101d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:16:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.708+0000 7fb712ffd700 1 --2- 172.21.15.77:0/2409180911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb714104210 0x7fb714101d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:16:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.708+0000 7fb712ffd700 1 -- 172.21.15.77:0/2409180911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb714103870 msgr2=0x7fb714101820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:16:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.708+0000 7fb712ffd700 1 --2- 172.21.15.77:0/2409180911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb714103870 0x7fb714101820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:16:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.708+0000 7fb712ffd700 1 -- 172.21.15.77:0/2409180911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb714102610 con 0x7fb7141007f0 2024-06-13T11:16:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.708+0000 7fb7137fe700 1 --2- 172.21.15.77:0/2409180911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb714104210 0x7fb714101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:16:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.708+0000 7fb712ffd700 1 --2- 172.21.15.77:0/2409180911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7141007f0 0x7fb7141031d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb70400d980 tx=0x7fb70400dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:16:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.708+0000 7fb6fbfff700 1 -- 172.21.15.77:0/2409180911 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704017070 con 0x7fb7141007f0 2024-06-13T11:16:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.708+0000 7fb6fbfff700 1 -- 172.21.15.77:0/2409180911 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb704009b40 con 0x7fb7141007f0 2024-06-13T11:16:39.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.708+0000 7fb71948e700 1 -- 172.21.15.77:0/2409180911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7141a2850 con 0x7fb7141007f0 2024-06-13T11:16:39.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.708+0000 7fb6fbfff700 1 -- 172.21.15.77:0/2409180911 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70400f620 con 0x7fb7141007f0 2024-06-13T11:16:39.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.708+0000 7fb71948e700 1 -- 172.21.15.77:0/2409180911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7141a2d90 con 0x7fb7141007f0 2024-06-13T11:16:39.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.709+0000 7fb71948e700 1 -- 172.21.15.77:0/2409180911 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb714069180 con 0x7fb7141007f0 2024-06-13T11:16:39.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.710+0000 7fb6fbfff700 1 -- 172.21.15.77:0/2409180911 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fb704010460 con 0x7fb7141007f0 2024-06-13T11:16:39.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.711+0000 7fb6fbfff700 1 --2- 172.21.15.77:0/2409180911 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6fc0a2c20 0x7fb6fc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:16:39.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.711+0000 7fb6fbfff700 1 -- 172.21.15.77:0/2409180911 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6261+0+0 (secure 0 0 0) 0x7fb7040ce560 con 0x7fb7141007f0 2024-06-13T11:16:39.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.712+0000 7fb7127fc700 1 --2- 172.21.15.77:0/2409180911 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6fc0a2c20 0x7fb6fc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:16:39.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.713+0000 7fb7127fc700 1 --2- 172.21.15.77:0/2409180911 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6fc0a2c20 0x7fb6fc0a50e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb7080097b0 tx=0x7fb708006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:16:39.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.716+0000 7fb6fbfff700 1 -- 172.21.15.77:0/2409180911 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb70409bcc0 con 0x7fb7141007f0 2024-06-13T11:16:39.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:16:39.924+0000 7fb71948e700 1 -- 172.21.15.77:0/2409180911 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb714062990 con 0x7fb6fc0a2c20 2024-06-13T11:16:41.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:41.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:16:41.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:16:41.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:16:41.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:41.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: Detected new or changed devices on smithi002 2024-06-13T11:16:41.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:41.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:41.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:41.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:41.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:41.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:41.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:41.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:41.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:16:41.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:41.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:16:41.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:41.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:16:41.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:41.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:41.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:16:41.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:16:41.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:16:41.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:41.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: Detected new or changed devices on smithi002 2024-06-13T11:16:41.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:41.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:41.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:41.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:41.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:41.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:41.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:41.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:41.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:16:41.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:41.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:16:41.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:41.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:16:41.292 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:41.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:41.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:16:41.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:16:41.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:16:41.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:41.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: Detected new or changed devices on smithi002 2024-06-13T11:16:41.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:41.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:41.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:41.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:41.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:41.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:16:41.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:41.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:41.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:16:41.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:41.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:16:41.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:41.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:16:41.398 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:42.183 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:41 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi002 to 4273M 2024-06-13T11:16:42.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:41 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi002 to 4273M 2024-06-13T11:16:42.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:41 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi002 to 4273M 2024-06-13T11:16:43.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:42 smithi178 ceph-mon[36913]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:43.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:42 smithi178 ceph-mon[36913]: from='client.? 172.21.15.77:0/2279658727' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "112d2b8e-9673-4d7a-97e9-2089793fdd37"}]: dispatch 2024-06-13T11:16:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:42 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "112d2b8e-9673-4d7a-97e9-2089793fdd37"}]: dispatch 2024-06-13T11:16:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:42 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "112d2b8e-9673-4d7a-97e9-2089793fdd37"}]': finished 2024-06-13T11:16:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:42 smithi178 ceph-mon[36913]: osdmap e69: 11 total, 10 up, 11 in 2024-06-13T11:16:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:42 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:16:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:42 smithi077 ceph-mon[36410]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:42 smithi077 ceph-mon[36410]: from='client.? 172.21.15.77:0/2279658727' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "112d2b8e-9673-4d7a-97e9-2089793fdd37"}]: dispatch 2024-06-13T11:16:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:42 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "112d2b8e-9673-4d7a-97e9-2089793fdd37"}]: dispatch 2024-06-13T11:16:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:42 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "112d2b8e-9673-4d7a-97e9-2089793fdd37"}]': finished 2024-06-13T11:16:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:42 smithi077 ceph-mon[36410]: osdmap e69: 11 total, 10 up, 11 in 2024-06-13T11:16:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:42 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:16:43.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:42 smithi002 ceph-mon[32210]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:43.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:42 smithi002 ceph-mon[32210]: from='client.? 172.21.15.77:0/2279658727' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "112d2b8e-9673-4d7a-97e9-2089793fdd37"}]: dispatch 2024-06-13T11:16:43.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:42 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "112d2b8e-9673-4d7a-97e9-2089793fdd37"}]: dispatch 2024-06-13T11:16:43.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:42 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "112d2b8e-9673-4d7a-97e9-2089793fdd37"}]': finished 2024-06-13T11:16:43.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:42 smithi002 ceph-mon[32210]: osdmap e69: 11 total, 10 up, 11 in 2024-06-13T11:16:43.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:42 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:16:44.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:43 smithi178 ceph-mon[36913]: from='client.? 172.21.15.77:0/2948383082' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:16:44.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:43 smithi077 ceph-mon[36410]: from='client.? 172.21.15.77:0/2948383082' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:16:44.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:43 smithi002 ceph-mon[32210]: from='client.? 172.21.15.77:0/2948383082' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:16:45.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:44 smithi178 ceph-mon[36913]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:45.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:44 smithi077 ceph-mon[36410]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:45.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:44 smithi002 ceph-mon[32210]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:47.114 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:46 smithi077 ceph-mon[36410]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:47.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:46 smithi178 ceph-mon[36913]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:47.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:46 smithi002 ceph-mon[32210]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:49.063 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:48 smithi077 ceph-mon[36410]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:49.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:48 smithi178 ceph-mon[36913]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:49.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:48 smithi002 ceph-mon[32210]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:51.268 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:50 smithi077 ceph-mon[36410]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:51.268 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:50 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-13T11:16:51.268 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:50 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:51.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:50 smithi002 ceph-mon[32210]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:51.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:50 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-13T11:16:51.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:50 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:51.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:50 smithi178 ceph-mon[36913]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:51.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:50 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-13T11:16:51.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:50 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:16:52.269 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:51 smithi077 ceph-mon[36410]: Deploying daemon osd.10 on smithi077 2024-06-13T11:16:52.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:51 smithi002 ceph-mon[32210]: Deploying daemon osd.10 on smithi077 2024-06-13T11:16:52.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:51 smithi178 ceph-mon[36913]: Deploying daemon osd.10 on smithi077 2024-06-13T11:16:53.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:52 smithi077 ceph-mon[36410]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:53.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:52 smithi002 ceph-mon[32210]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:53.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:52 smithi178 ceph-mon[36913]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:54.250 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:53 smithi077 ceph-mon[36410]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:54.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:53 smithi002 ceph-mon[32210]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:54.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:53 smithi178 ceph-mon[36913]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:56.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:56 smithi077 ceph-mon[36410]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:56.542 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:56 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:56.542 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:56 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:56.542 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:56 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:16:56.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:56 smithi002 ceph-mon[32210]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:56.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:56 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:56.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:56 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:56.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:56 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:16:56.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:56 smithi178 ceph-mon[36913]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:56.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:56 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:56.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:56 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:16:56.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:56 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:16:58.539 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:16:58 smithi077 ceph-mon[36410]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:58.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:16:58 smithi002 ceph-mon[32210]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:16:58.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:16:58 smithi178 ceph-mon[36913]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:17:00.122 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 10 on host 'smithi077' 2024-06-13T11:17:00.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:17:00.123+0000 7fb6fbfff700 1 -- 172.21.15.77:0/2409180911 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fb714062990 con 0x7fb6fc0a2c20 2024-06-13T11:17:00.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:17:00.125+0000 7fb71948e700 1 -- 172.21.15.77:0/2409180911 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6fc0a2c20 msgr2=0x7fb6fc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:00.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:17:00.125+0000 7fb71948e700 1 --2- 172.21.15.77:0/2409180911 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6fc0a2c20 0x7fb6fc0a50e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb7080097b0 tx=0x7fb708006d20 comp rx=0 tx=0).stop 2024-06-13T11:17:00.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:17:00.126+0000 7fb71948e700 1 -- 172.21.15.77:0/2409180911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7141007f0 msgr2=0x7fb7141031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:00.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:17:00.126+0000 7fb71948e700 1 --2- 172.21.15.77:0/2409180911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7141007f0 0x7fb7141031d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb70400d980 tx=0x7fb70400dd40 comp rx=0 tx=0).stop 2024-06-13T11:17:00.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:17:00.126+0000 7fb71948e700 1 -- 172.21.15.77:0/2409180911 shutdown_connections 2024-06-13T11:17:00.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:17:00.126+0000 7fb71948e700 1 --2- 172.21.15.77:0/2409180911 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6fc0a2c20 0x7fb6fc0a50e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:00.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:17:00.126+0000 7fb71948e700 1 --2- 172.21.15.77:0/2409180911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb714104210 0x7fb714101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:00.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:17:00.126+0000 7fb71948e700 1 --2- 172.21.15.77:0/2409180911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7141007f0 0x7fb7141031d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:00.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:17:00.126+0000 7fb71948e700 1 --2- 172.21.15.77:0/2409180911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb714103870 0x7fb714101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:00.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:17:00.126+0000 7fb71948e700 1 -- 172.21.15.77:0/2409180911 >> 172.21.15.77:0/2409180911 conn(0x7fb7140fc130 msgr2=0x7fb714106aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:00.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:17:00.126+0000 7fb71948e700 1 -- 172.21.15.77:0/2409180911 shutdown_connections 2024-06-13T11:17:00.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-06-13T11:17:00.126+0000 7fb71948e700 1 -- 172.21.15.77:0/2409180911 wait complete. 2024-06-13T11:17:00.497 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:00 smithi077 ceph-mon[36410]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:17:00.497 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:00.497 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:00.497 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:00.497 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:17:00.497 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:00.497 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:00 smithi077 ceph-mon[36410]: from='osd.10 [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-13T11:17:00.497 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:00 smithi077 ceph-mon[36410]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-13T11:17:00.497 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:00.497 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:00.497 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:17:00.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:00 smithi002 ceph-mon[32210]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:17:00.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:00.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:00.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:00.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:17:00.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:00.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:00 smithi002 ceph-mon[32210]: from='osd.10 [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-13T11:17:00.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:00 smithi002 ceph-mon[32210]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-13T11:17:00.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:00.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:00.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:17:00.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:00 smithi178 ceph-mon[36913]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:17:00.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:00.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:00.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:00.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:17:00.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:00.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:00 smithi178 ceph-mon[36913]: from='osd.10 [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-13T11:17:00.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:00 smithi178 ceph-mon[36913]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-13T11:17:00.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:00.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:00.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:17:00.848 DEBUG:teuthology.orchestra.run.smithi077:osd.10> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.10.service 2024-06-13T11:17:00.851 INFO:tasks.cephadm:Deploying osd.11 on smithi178 with /dev/vg_nvme/lv_1... 2024-06-13T11:17:00.851 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-13T11:17:01.099 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:17:01.410 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:01 smithi077 ceph-mon[36410]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-13T11:17:01.410 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:01 smithi077 ceph-mon[36410]: from='osd.10 [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:17:01.411 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:01 smithi077 ceph-mon[36410]: osdmap e70: 11 total, 10 up, 11 in 2024-06-13T11:17:01.411 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:01 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:17:01.411 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:01 smithi077 ceph-mon[36410]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:17:01.506 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:01 smithi178 ceph-mon[36913]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-13T11:17:01.506 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:01 smithi178 ceph-mon[36913]: from='osd.10 [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:17:01.506 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:01 smithi178 ceph-mon[36913]: osdmap e70: 11 total, 10 up, 11 in 2024-06-13T11:17:01.506 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:01 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:17:01.506 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:01 smithi178 ceph-mon[36913]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:17:01.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:01 smithi002 ceph-mon[32210]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-13T11:17:01.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:01 smithi002 ceph-mon[32210]: from='osd.10 [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:17:01.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:01 smithi002 ceph-mon[32210]: osdmap e70: 11 total, 10 up, 11 in 2024-06-13T11:17:01.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:01 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:17:01.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:01 smithi002 ceph-mon[32210]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-06-13T11:17:02.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:17:01 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:17:01.758+0000 7f927a4fb700 -1 osd.10 0 waiting for initial osdmap 2024-06-13T11:17:02.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:17:01 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:17:01.771+0000 7f92722e6700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:17:02.391 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:02 smithi077 ceph-mon[36410]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:17:02.391 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:02 smithi077 ceph-mon[36410]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-06-13T11:17:02.391 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:02 smithi077 ceph-mon[36410]: osdmap e71: 11 total, 10 up, 11 in 2024-06-13T11:17:02.391 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:02 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:17:02.391 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:02 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:17:02.391 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:02 smithi077 ceph-mon[36410]: from='osd.10 ' entity='osd.10' 2024-06-13T11:17:02.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:02 smithi178 ceph-mon[36913]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:17:02.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:02 smithi178 ceph-mon[36913]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-06-13T11:17:02.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:02 smithi178 ceph-mon[36913]: osdmap e71: 11 total, 10 up, 11 in 2024-06-13T11:17:02.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:02 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:17:02.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:02 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:17:02.538 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:02 smithi178 ceph-mon[36913]: from='osd.10 ' entity='osd.10' 2024-06-13T11:17:02.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:02 smithi002 ceph-mon[32210]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-13T11:17:02.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:02 smithi002 ceph-mon[32210]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-06-13T11:17:02.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:02 smithi002 ceph-mon[32210]: osdmap e71: 11 total, 10 up, 11 in 2024-06-13T11:17:02.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:02 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:17:02.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:02 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:17:02.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:02 smithi002 ceph-mon[32210]: from='osd.10 ' entity='osd.10' 2024-06-13T11:17:03.272 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-13T11:17:03.272 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-13T11:17:03.272 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2024-06-13T11:17:03.272 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2024-06-13T11:17:03.272 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00833152 s, 1.3 GB/s 2024-06-13T11:17:03.273 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2024-06-13T11:17:03.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:03 smithi002 ceph-mon[32210]: purged_snaps scrub starts 2024-06-13T11:17:03.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:03 smithi002 ceph-mon[32210]: purged_snaps scrub ok 2024-06-13T11:17:03.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:03 smithi002 ceph-mon[32210]: osd.10 [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463] boot 2024-06-13T11:17:03.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:03 smithi002 ceph-mon[32210]: osdmap e72: 11 total, 11 up, 11 in 2024-06-13T11:17:03.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:03 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:17:03.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:03 smithi002 ceph-mon[32210]: osdmap e73: 11 total, 11 up, 11 in 2024-06-13T11:17:03.539 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:03 smithi077 ceph-mon[36410]: purged_snaps scrub starts 2024-06-13T11:17:03.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:03 smithi077 ceph-mon[36410]: purged_snaps scrub ok 2024-06-13T11:17:03.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:03 smithi077 ceph-mon[36410]: osd.10 [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463] boot 2024-06-13T11:17:03.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:03 smithi077 ceph-mon[36410]: osdmap e72: 11 total, 11 up, 11 in 2024-06-13T11:17:03.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:03 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:17:03.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:03 smithi077 ceph-mon[36410]: osdmap e73: 11 total, 11 up, 11 in 2024-06-13T11:17:03.573 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:03 smithi178 ceph-mon[36913]: purged_snaps scrub starts 2024-06-13T11:17:03.573 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:03 smithi178 ceph-mon[36913]: purged_snaps scrub ok 2024-06-13T11:17:03.573 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:03 smithi178 ceph-mon[36913]: osd.10 [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463] boot 2024-06-13T11:17:03.573 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:03 smithi178 ceph-mon[36913]: osdmap e72: 11 total, 11 up, 11 in 2024-06-13T11:17:03.573 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:03 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:17:03.573 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:03 smithi178 ceph-mon[36913]: osdmap e73: 11 total, 11 up, 11 in 2024-06-13T11:17:03.941 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi178:vg_nvme/lv_1 2024-06-13T11:17:04.183 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:17:04.546 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:04 smithi178 ceph-mon[36913]: pgmap v261: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:04.547 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:04 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:04.547 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:04 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:04.547 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:04 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:04.547 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:04 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:04.547 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:04 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:04.547 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:04 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:04.547 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:04 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:04.547 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:04 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:04.547 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:04 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:17:04.547 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:04 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:04.547 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:04 smithi178 ceph-mon[36913]: osdmap e74: 11 total, 11 up, 11 in 2024-06-13T11:17:04.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:04 smithi002 ceph-mon[32210]: pgmap v261: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:04.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:04 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:04.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:04 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:04.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:04 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:04.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:04 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:04.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:04 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:04.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:04 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:04.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:04 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:04.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:04 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:04.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:04 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:17:04.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:04 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:04.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:04 smithi002 ceph-mon[32210]: osdmap e74: 11 total, 11 up, 11 in 2024-06-13T11:17:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:04 smithi077 ceph-mon[36410]: pgmap v261: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:04 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:04 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:04 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:04 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:04 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:04 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:04 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:04.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:04 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:04.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:04 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:17:04.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:04 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:04.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:04 smithi077 ceph-mon[36410]: osdmap e74: 11 total, 11 up, 11 in 2024-06-13T11:17:05.615 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:05 smithi178 ceph-mon[36913]: Detected new or changed devices on smithi077 2024-06-13T11:17:05.616 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:05 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi077 to 4272M 2024-06-13T11:17:05.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:05 smithi002 ceph-mon[32210]: Detected new or changed devices on smithi077 2024-06-13T11:17:05.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:05 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi077 to 4272M 2024-06-13T11:17:05.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:05 smithi077 ceph-mon[36410]: Detected new or changed devices on smithi077 2024-06-13T11:17:05.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:05 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi077 to 4272M 2024-06-13T11:17:05.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.839+0000 7ff8f7df8700 1 -- 172.21.15.178:0/3128166177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f0100f20 msgr2=0x7ff8f010aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:05.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.839+0000 7ff8f7df8700 1 --2- 172.21.15.178:0/3128166177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f0100f20 0x7ff8f010aaf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800b0a0 tx=0x7ff8e800b3b0 comp rx=0 tx=0).stop 2024-06-13T11:17:05.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.839+0000 7ff8f7df8700 1 -- 172.21.15.178:0/3128166177 shutdown_connections 2024-06-13T11:17:05.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.839+0000 7ff8f7df8700 1 --2- 172.21.15.178:0/3128166177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f0100f20 0x7ff8f010aaf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:05.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.839+0000 7ff8f7df8700 1 --2- 172.21.15.178:0/3128166177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8f0103b00 0x7ff8f0103f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:05.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.839+0000 7ff8f7df8700 1 --2- 172.21.15.178:0/3128166177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8f0100580 0x7ff8f01009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:05.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.839+0000 7ff8f7df8700 1 -- 172.21.15.178:0/3128166177 >> 172.21.15.178:0/3128166177 conn(0x7ff8f00fc120 msgr2=0x7ff8f00fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:05.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.839+0000 7ff8f7df8700 1 -- 172.21.15.178:0/3128166177 shutdown_connections 2024-06-13T11:17:05.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.839+0000 7ff8f7df8700 1 -- 172.21.15.178:0/3128166177 wait complete. 2024-06-13T11:17:05.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.839+0000 7ff8f7df8700 1 Processor -- start 2024-06-13T11:17:05.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.839+0000 7ff8f7df8700 1 -- start start 2024-06-13T11:17:05.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f7df8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f0100580 0x7ff8f01986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:05.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f7df8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8f0100f20 0x7ff8f0198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:05.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f7df8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8f0103b00 0x7ff8f019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:05.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f7df8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f010e130 con 0x7ff8f0103b00 2024-06-13T11:17:05.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f7df8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f010dfb0 con 0x7ff8f0100f20 2024-06-13T11:17:05.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f7df8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f010e2b0 con 0x7ff8f0100580 2024-06-13T11:17:05.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f5b94700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f0100580 0x7ff8f01986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:05.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f5b94700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f0100580 0x7ff8f01986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:33632/0 (socket says 172.21.15.178:33632) 2024-06-13T11:17:05.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f5b94700 1 -- 172.21.15.178:0/3260005603 learned_addr learned my addr 172.21.15.178:0/3260005603 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-13T11:17:05.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f5393700 1 --2- 172.21.15.178:0/3260005603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8f0100f20 0x7ff8f0198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:05.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f5b94700 1 -- 172.21.15.178:0/3260005603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8f0100f20 msgr2=0x7ff8f0198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:05.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f5b94700 1 --2- 172.21.15.178:0/3260005603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8f0100f20 0x7ff8f0198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:05.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f5b94700 1 -- 172.21.15.178:0/3260005603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8f0103b00 msgr2=0x7ff8f019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:05.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f5b94700 1 --2- 172.21.15.178:0/3260005603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8f0103b00 0x7ff8f019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:05.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f5b94700 1 -- 172.21.15.178:0/3260005603 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f01a0320 con 0x7ff8f0100580 2024-06-13T11:17:05.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f5b94700 1 --2- 172.21.15.178:0/3260005603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f0100580 0x7ff8f01986c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00d9b0 tx=0x7ff8ec00dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:17:05.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8e6ffd700 1 -- 172.21.15.178:0/3260005603 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec017070 con 0x7ff8f0100580 2024-06-13T11:17:05.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8e6ffd700 1 -- 172.21.15.178:0/3260005603 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8ec009e10 con 0x7ff8f0100580 2024-06-13T11:17:05.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f7df8700 1 -- 172.21.15.178:0/3260005603 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f01a0610 con 0x7ff8f0100580 2024-06-13T11:17:05.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8e6ffd700 1 -- 172.21.15.178:0/3260005603 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec00f620 con 0x7ff8f0100580 2024-06-13T11:17:05.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.840+0000 7ff8f7df8700 1 -- 172.21.15.178:0/3260005603 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f01a0b00 con 0x7ff8f0100580 2024-06-13T11:17:05.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.841+0000 7ff8f7df8700 1 -- 172.21.15.178:0/3260005603 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f0069180 con 0x7ff8f0100580 2024-06-13T11:17:05.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.843+0000 7ff8e6ffd700 1 -- 172.21.15.178:0/3260005603 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff8ec009930 con 0x7ff8f0100580 2024-06-13T11:17:05.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.843+0000 7ff8e6ffd700 1 --2- 172.21.15.178:0/3260005603 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff8dc0a2c20 0x7ff8dc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:05.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.843+0000 7ff8e6ffd700 1 -- 172.21.15.178:0/3260005603 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6694+0+0 (secure 0 0 0) 0x7ff8ec0ce520 con 0x7ff8f0100580 2024-06-13T11:17:05.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.844+0000 7ff8f5393700 1 --2- 172.21.15.178:0/3260005603 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff8dc0a2c20 0x7ff8dc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:05.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.845+0000 7ff8f5393700 1 --2- 172.21.15.178:0/3260005603 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff8dc0a2c20 0x7ff8dc0a50e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0009a10 tx=0x7ff8e0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:17:05.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:05.847+0000 7ff8e6ffd700 1 -- 172.21.15.178:0/3260005603 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff8ec09bad0 con 0x7ff8f0100580 2024-06-13T11:17:06.049 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:06.051+0000 7ff8f7df8700 1 -- 172.21.15.178:0/3260005603 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff8f00628d0 con 0x7ff8dc0a2c20 2024-06-13T11:17:06.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:06 smithi002 ceph-mon[32210]: pgmap v264: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:06.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:06 smithi002 ceph-mon[32210]: osdmap e75: 11 total, 11 up, 11 in 2024-06-13T11:17:06.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:17:06.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:17:06.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:06.691 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:06 smithi178 ceph-mon[36913]: pgmap v264: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:06.691 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:06 smithi178 ceph-mon[36913]: osdmap e75: 11 total, 11 up, 11 in 2024-06-13T11:17:06.691 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:17:06.691 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:17:06.691 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:06.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:06 smithi077 ceph-mon[36410]: pgmap v264: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:06.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:06 smithi077 ceph-mon[36410]: osdmap e75: 11 total, 11 up, 11 in 2024-06-13T11:17:06.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T11:17:06.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T11:17:06.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:07.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:07 smithi002 ceph-mon[32210]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:17:07.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:07 smithi002 ceph-mon[32210]: osdmap e76: 11 total, 11 up, 11 in 2024-06-13T11:17:07.686 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:07 smithi178 ceph-mon[36913]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:17:07.686 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:07 smithi178 ceph-mon[36913]: osdmap e76: 11 total, 11 up, 11 in 2024-06-13T11:17:07.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:07 smithi077 ceph-mon[36410]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:17:07.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:07 smithi077 ceph-mon[36410]: osdmap e76: 11 total, 11 up, 11 in 2024-06-13T11:17:08.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:08 smithi002 ceph-mon[32210]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-13T11:17:08.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:08 smithi178 ceph-mon[36913]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-13T11:17:08.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:08 smithi077 ceph-mon[36410]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-13T11:17:09.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:09 smithi002 ceph-mon[32210]: from='client.? 172.21.15.178:0/373064782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b8001f5-9c74-4cc7-8c41-906cb5ac9b07"}]: dispatch 2024-06-13T11:17:09.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:09 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b8001f5-9c74-4cc7-8c41-906cb5ac9b07"}]: dispatch 2024-06-13T11:17:09.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:09 smithi002 ceph-mon[32210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b8001f5-9c74-4cc7-8c41-906cb5ac9b07"}]': finished 2024-06-13T11:17:09.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:09 smithi002 ceph-mon[32210]: osdmap e77: 12 total, 11 up, 12 in 2024-06-13T11:17:09.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:09 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:09.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:09 smithi178 ceph-mon[36913]: from='client.? 172.21.15.178:0/373064782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b8001f5-9c74-4cc7-8c41-906cb5ac9b07"}]: dispatch 2024-06-13T11:17:09.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:09 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b8001f5-9c74-4cc7-8c41-906cb5ac9b07"}]: dispatch 2024-06-13T11:17:09.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:09 smithi178 ceph-mon[36913]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b8001f5-9c74-4cc7-8c41-906cb5ac9b07"}]': finished 2024-06-13T11:17:09.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:09 smithi178 ceph-mon[36913]: osdmap e77: 12 total, 11 up, 12 in 2024-06-13T11:17:09.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:09 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:09.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:09 smithi077 ceph-mon[36410]: from='client.? 172.21.15.178:0/373064782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b8001f5-9c74-4cc7-8c41-906cb5ac9b07"}]: dispatch 2024-06-13T11:17:09.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:09 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b8001f5-9c74-4cc7-8c41-906cb5ac9b07"}]: dispatch 2024-06-13T11:17:09.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:09 smithi077 ceph-mon[36410]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b8001f5-9c74-4cc7-8c41-906cb5ac9b07"}]': finished 2024-06-13T11:17:09.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:09 smithi077 ceph-mon[36410]: osdmap e77: 12 total, 11 up, 12 in 2024-06-13T11:17:09.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:09 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:10.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:10 smithi002 ceph-mon[32210]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-06-13T11:17:10.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:10 smithi002 ceph-mon[32210]: from='client.? 172.21.15.178:0/3558948342' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:17:10.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:10 smithi178 ceph-mon[36913]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-06-13T11:17:10.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:10 smithi178 ceph-mon[36913]: from='client.? 172.21.15.178:0/3558948342' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:17:10.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:10 smithi077 ceph-mon[36410]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-06-13T11:17:10.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:10 smithi077 ceph-mon[36410]: from='client.? 172.21.15.178:0/3558948342' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T11:17:12.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:12 smithi002 ceph-mon[32210]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-13T11:17:12.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:12 smithi178 ceph-mon[36913]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-13T11:17:12.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:12 smithi077 ceph-mon[36410]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-13T11:17:14.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:14 smithi178 ceph-mon[36913]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-06-13T11:17:14.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:14 smithi002 ceph-mon[32210]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-06-13T11:17:14.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:14 smithi077 ceph-mon[36410]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-06-13T11:17:16.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:16 smithi178 ceph-mon[36913]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-06-13T11:17:16.472 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:16 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-13T11:17:16.472 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:16 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:16.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:16 smithi002 ceph-mon[32210]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-06-13T11:17:16.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:16 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-13T11:17:16.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:16 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:16.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:16 smithi077 ceph-mon[36410]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-06-13T11:17:16.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:16 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-13T11:17:16.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:16 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:17.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:17 smithi178 ceph-mon[36913]: Deploying daemon osd.11 on smithi178 2024-06-13T11:17:17.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:17 smithi002 ceph-mon[32210]: Deploying daemon osd.11 on smithi178 2024-06-13T11:17:17.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:17 smithi077 ceph-mon[36410]: Deploying daemon osd.11 on smithi178 2024-06-13T11:17:18.424 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:18 smithi178 ceph-mon[36913]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:18.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:18 smithi002 ceph-mon[32210]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:18.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:18 smithi077 ceph-mon[36410]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:20.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:20 smithi002 ceph-mon[32210]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:20.666 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:20 smithi178 ceph-mon[36913]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:20.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:20 smithi077 ceph-mon[36410]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:22.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:22 smithi002 ceph-mon[32210]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:22.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:22 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:22.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:22 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:22.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:22 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:17:22.684 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:22 smithi178 ceph-mon[36913]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:22.684 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:22 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:22.684 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:22 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:22.685 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:22 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:17:22.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:22 smithi077 ceph-mon[36410]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:22.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:22 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:22.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:22 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:22.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:22 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:17:24.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:24 smithi002 ceph-mon[32210]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:24.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:24 smithi178 ceph-mon[36913]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:24.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:24 smithi077 ceph-mon[36410]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:25.989 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:25.989+0000 7ff8e6ffd700 1 -- 172.21.15.178:0/3260005603 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7ff8f00628d0 con 0x7ff8dc0a2c20 2024-06-13T11:17:25.989 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 11 on host 'smithi178' 2024-06-13T11:17:25.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:25.992+0000 7ff8f7df8700 1 -- 172.21.15.178:0/3260005603 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff8dc0a2c20 msgr2=0x7ff8dc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:25.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:25.992+0000 7ff8f7df8700 1 --2- 172.21.15.178:0/3260005603 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff8dc0a2c20 0x7ff8dc0a50e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0009a10 tx=0x7ff8e0009190 comp rx=0 tx=0).stop 2024-06-13T11:17:25.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:25.992+0000 7ff8f7df8700 1 -- 172.21.15.178:0/3260005603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f0100580 msgr2=0x7ff8f01986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:25.991 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:25.992+0000 7ff8f7df8700 1 --2- 172.21.15.178:0/3260005603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f0100580 0x7ff8f01986c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00d9b0 tx=0x7ff8ec00dcc0 comp rx=0 tx=0).stop 2024-06-13T11:17:25.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:25.992+0000 7ff8f7df8700 1 -- 172.21.15.178:0/3260005603 shutdown_connections 2024-06-13T11:17:25.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:25.992+0000 7ff8f7df8700 1 --2- 172.21.15.178:0/3260005603 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff8dc0a2c20 0x7ff8dc0a50e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:25.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:25.992+0000 7ff8f7df8700 1 --2- 172.21.15.178:0/3260005603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8f0103b00 0x7ff8f019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:25.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:25.992+0000 7ff8f7df8700 1 --2- 172.21.15.178:0/3260005603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f0100580 0x7ff8f01986c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:25.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:25.992+0000 7ff8f7df8700 1 --2- 172.21.15.178:0/3260005603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8f0100f20 0x7ff8f0198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:25.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:25.992+0000 7ff8f7df8700 1 -- 172.21.15.178:0/3260005603 >> 172.21.15.178:0/3260005603 conn(0x7ff8f00fc120 msgr2=0x7ff8f0106ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:25.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:25.992+0000 7ff8f7df8700 1 -- 172.21.15.178:0/3260005603 shutdown_connections 2024-06-13T11:17:25.992 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:25.992+0000 7ff8f7df8700 1 -- 172.21.15.178:0/3260005603 wait complete. 2024-06-13T11:17:26.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:26.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:26.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:26.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:17:26.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:26.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:26 smithi178 ceph-mon[36913]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:26.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:26 smithi178 ceph-mon[36913]: from='osd.11 [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-13T11:17:26.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:26 smithi178 ceph-mon[36913]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-13T11:17:26.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:26.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:26.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:17:26.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:26.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:26.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:26.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:17:26.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:26.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:26 smithi002 ceph-mon[32210]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:26.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:26 smithi002 ceph-mon[32210]: from='osd.11 [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-13T11:17:26.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:26 smithi002 ceph-mon[32210]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-13T11:17:26.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:26.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:26.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:17:26.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:26 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:26.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:26 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:26.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:26 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:26.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:26 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:17:26.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:26 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:26.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:26 smithi077 ceph-mon[36410]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:26.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:26 smithi077 ceph-mon[36410]: from='osd.11 [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-13T11:17:26.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:26 smithi077 ceph-mon[36410]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-13T11:17:26.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:26 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:26.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:26 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:26.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:26 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:17:26.713 DEBUG:teuthology.orchestra.run.smithi178:osd.11> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.11.service 2024-06-13T11:17:26.715 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-06-13T11:17:26.716 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd stat -f json 2024-06-13T11:17:27.191 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:17:27.248 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:27 smithi178 ceph-mon[36913]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-13T11:17:27.248 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:27 smithi178 ceph-mon[36913]: from='osd.11 [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:17:27.249 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:27 smithi178 ceph-mon[36913]: osdmap e78: 12 total, 11 up, 12 in 2024-06-13T11:17:27.249 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:27.249 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:27 smithi178 ceph-mon[36913]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:17:27.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:27 smithi002 ceph-mon[32210]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-13T11:17:27.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:27 smithi002 ceph-mon[32210]: from='osd.11 [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:17:27.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:27 smithi002 ceph-mon[32210]: osdmap e78: 12 total, 11 up, 12 in 2024-06-13T11:17:27.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:27.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:27 smithi002 ceph-mon[32210]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:17:27.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:27 smithi077 ceph-mon[36410]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-13T11:17:27.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:27 smithi077 ceph-mon[36410]: from='osd.11 [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:17:27.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:27 smithi077 ceph-mon[36410]: osdmap e78: 12 total, 11 up, 12 in 2024-06-13T11:17:27.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:27.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:27 smithi077 ceph-mon[36410]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-13T11:17:28.145 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:17:27 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:17:27.727+0000 7fd07351e700 -1 osd.11 0 waiting for initial osdmap 2024-06-13T11:17:28.145 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:17:27 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:17:27.739+0000 7fd06b309700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T11:17:28.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:28 smithi178 ceph-mon[36913]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-13T11:17:28.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:28 smithi178 ceph-mon[36913]: osdmap e79: 12 total, 11 up, 12 in 2024-06-13T11:17:28.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:28 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:28.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:28 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:28.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:28 smithi178 ceph-mon[36913]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:28.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:28 smithi178 ceph-mon[36913]: from='osd.11 ' entity='osd.11' 2024-06-13T11:17:28.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:28 smithi077 ceph-mon[36410]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-13T11:17:28.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:28 smithi077 ceph-mon[36410]: osdmap e79: 12 total, 11 up, 12 in 2024-06-13T11:17:28.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:28 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:28.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:28 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:28.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:28 smithi077 ceph-mon[36410]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:28.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:28 smithi077 ceph-mon[36410]: from='osd.11 ' entity='osd.11' 2024-06-13T11:17:28.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:28 smithi002 ceph-mon[32210]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-13T11:17:28.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:28 smithi002 ceph-mon[32210]: osdmap e79: 12 total, 11 up, 12 in 2024-06-13T11:17:28.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:28 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:28.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:28 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:28.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:28 smithi002 ceph-mon[32210]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-13T11:17:28.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:28 smithi002 ceph-mon[32210]: from='osd.11 ' entity='osd.11' 2024-06-13T11:17:29.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:29 smithi002 ceph-mon[32210]: purged_snaps scrub starts 2024-06-13T11:17:29.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:29 smithi002 ceph-mon[32210]: purged_snaps scrub ok 2024-06-13T11:17:29.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:29 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:29.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:29 smithi002 ceph-mon[32210]: osd.11 [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767] boot 2024-06-13T11:17:29.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:29 smithi002 ceph-mon[32210]: osdmap e80: 12 total, 12 up, 12 in 2024-06-13T11:17:29.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:29 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:29.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:29 smithi178 ceph-mon[36913]: purged_snaps scrub starts 2024-06-13T11:17:29.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:29 smithi178 ceph-mon[36913]: purged_snaps scrub ok 2024-06-13T11:17:29.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:29 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:29.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:29 smithi178 ceph-mon[36913]: osd.11 [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767] boot 2024-06-13T11:17:29.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:29 smithi178 ceph-mon[36913]: osdmap e80: 12 total, 12 up, 12 in 2024-06-13T11:17:29.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:29 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:29.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:29 smithi077 ceph-mon[36410]: purged_snaps scrub starts 2024-06-13T11:17:29.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:29 smithi077 ceph-mon[36410]: purged_snaps scrub ok 2024-06-13T11:17:29.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:29.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:29 smithi077 ceph-mon[36410]: osd.11 [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767] boot 2024-06-13T11:17:29.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:29 smithi077 ceph-mon[36410]: osdmap e80: 12 total, 12 up, 12 in 2024-06-13T11:17:29.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:17:29.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.682+0000 7f167be00700 1 -- 172.21.15.2:0/3885112689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16741025c0 msgr2=0x7f1674102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:29.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.682+0000 7f167be00700 1 --2- 172.21.15.2:0/3885112689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16741025c0 0x7f1674102a20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1660009920 tx=0x7f1660009c30 comp rx=0 tx=0).stop 2024-06-13T11:17:29.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.682+0000 7f167be00700 1 -- 172.21.15.2:0/3885112689 shutdown_connections 2024-06-13T11:17:29.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.682+0000 7f167be00700 1 --2- 172.21.15.2:0/3885112689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16741013c0 0x7f16741017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:29.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.682+0000 7f167be00700 1 --2- 172.21.15.2:0/3885112689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1674102f60 0x7f1674109810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:29.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.682+0000 7f167be00700 1 --2- 172.21.15.2:0/3885112689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16741025c0 0x7f1674102a20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:29.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.682+0000 7f167be00700 1 -- 172.21.15.2:0/3885112689 >> 172.21.15.2:0/3885112689 conn(0x7f16740fc960 msgr2=0x7f16740feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:29.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.682+0000 7f167be00700 1 -- 172.21.15.2:0/3885112689 shutdown_connections 2024-06-13T11:17:29.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.682+0000 7f167be00700 1 -- 172.21.15.2:0/3885112689 wait complete. 2024-06-13T11:17:29.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.684+0000 7f167be00700 1 Processor -- start 2024-06-13T11:17:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.684+0000 7f167be00700 1 -- start start 2024-06-13T11:17:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.684+0000 7f167be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16741013c0 0x7f167419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.684+0000 7f167be00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16741025c0 0x7f167419af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.684+0000 7f167be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1674102f60 0x7f16741a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.684+0000 7f167be00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f167410cff0 con 0x7f1674102f60 2024-06-13T11:17:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.684+0000 7f167be00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f167410ce70 con 0x7f16741025c0 2024-06-13T11:17:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.684+0000 7f167be00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f167410d170 con 0x7f16741013c0 2024-06-13T11:17:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.685+0000 7f1679e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1674102f60 0x7f16741a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.685+0000 7f1679400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16741013c0 0x7f167419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.685+0000 7f1679400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16741013c0 0x7f167419aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:46640/0 (socket says 172.21.15.2:46640) 2024-06-13T11:17:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.685+0000 7f1679e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1674102f60 0x7f16741a1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51500/0 (socket says 172.21.15.2:51500) 2024-06-13T11:17:29.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.685+0000 7f1679400700 1 -- 172.21.15.2:0/3869286853 learned_addr learned my addr 172.21.15.2:0/3869286853 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:17:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.685+0000 7f1678a00700 1 --2- 172.21.15.2:0/3869286853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16741025c0 0x7f167419af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.685+0000 7f1679400700 1 -- 172.21.15.2:0/3869286853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16741025c0 msgr2=0x7f167419af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.685+0000 7f1679400700 1 --2- 172.21.15.2:0/3869286853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16741025c0 0x7f167419af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.685+0000 7f1679400700 1 -- 172.21.15.2:0/3869286853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1674102f60 msgr2=0x7f16741a1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.685+0000 7f1679400700 1 --2- 172.21.15.2:0/3869286853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1674102f60 0x7f16741a1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.685+0000 7f1679400700 1 -- 172.21.15.2:0/3869286853 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16741a2670 con 0x7f16741013c0 2024-06-13T11:17:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.685+0000 7f1678a00700 1 --2- 172.21.15.2:0/3869286853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16741025c0 0x7f167419af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:17:29.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.685+0000 7f1679400700 1 --2- 172.21.15.2:0/3869286853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16741013c0 0x7f167419aa10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f166800ea20 tx=0x7f166800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:17:29.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.686+0000 7f1672000700 1 -- 172.21.15.2:0/3869286853 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166800cbd0 con 0x7f16741013c0 2024-06-13T11:17:29.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.686+0000 7f1672000700 1 -- 172.21.15.2:0/3869286853 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1668004500 con 0x7f16741013c0 2024-06-13T11:17:29.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.686+0000 7f1672000700 1 -- 172.21.15.2:0/3869286853 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668003d80 con 0x7f16741013c0 2024-06-13T11:17:29.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.686+0000 7f167be00700 1 -- 172.21.15.2:0/3869286853 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16741a2960 con 0x7f16741013c0 2024-06-13T11:17:29.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.686+0000 7f167be00700 1 -- 172.21.15.2:0/3869286853 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16741a2e50 con 0x7f16741013c0 2024-06-13T11:17:29.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.687+0000 7f167be00700 1 -- 172.21.15.2:0/3869286853 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1674069180 con 0x7f16741013c0 2024-06-13T11:17:29.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.689+0000 7f1672000700 1 -- 172.21.15.2:0/3869286853 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f1668044b30 con 0x7f16741013c0 2024-06-13T11:17:29.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.691+0000 7f1672000700 1 --2- 172.21.15.2:0/3869286853 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f165c0a2ca0 0x7f165c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:29.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.691+0000 7f1672000700 1 -- 172.21.15.2:0/3869286853 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7f16680cedd0 con 0x7f16741013c0 2024-06-13T11:17:29.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.691+0000 7f1678a00700 1 --2- 172.21.15.2:0/3869286853 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f165c0a2ca0 0x7f165c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:29.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.692+0000 7f1678a00700 1 --2- 172.21.15.2:0/3869286853 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f165c0a2ca0 0x7f165c0a5160 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f166000a010 tx=0x7f1660019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:17:29.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.693+0000 7f1672000700 1 -- 172.21.15.2:0/3869286853 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1668044e20 con 0x7f16741013c0 2024-06-13T11:17:29.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.931+0000 7f167be00700 1 -- 172.21.15.2:0/3869286853 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f16741a32f0 con 0x7f16741013c0 2024-06-13T11:17:29.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.931+0000 7f1672000700 1 -- 172.21.15.2:0/3869286853 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7f166809c130 con 0x7f16741013c0 2024-06-13T11:17:29.931 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:17:29.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.935+0000 7f167be00700 1 -- 172.21.15.2:0/3869286853 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f165c0a2ca0 msgr2=0x7f165c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:29.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.935+0000 7f167be00700 1 --2- 172.21.15.2:0/3869286853 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f165c0a2ca0 0x7f165c0a5160 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f166000a010 tx=0x7f1660019040 comp rx=0 tx=0).stop 2024-06-13T11:17:29.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.935+0000 7f167be00700 1 -- 172.21.15.2:0/3869286853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16741013c0 msgr2=0x7f167419aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:29.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.935+0000 7f167be00700 1 --2- 172.21.15.2:0/3869286853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16741013c0 0x7f167419aa10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f166800ea20 tx=0x7f166800ed30 comp rx=0 tx=0).stop 2024-06-13T11:17:29.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.935+0000 7f167be00700 1 -- 172.21.15.2:0/3869286853 shutdown_connections 2024-06-13T11:17:29.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.935+0000 7f167be00700 1 --2- 172.21.15.2:0/3869286853 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f165c0a2ca0 0x7f165c0a5160 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:29.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.935+0000 7f167be00700 1 --2- 172.21.15.2:0/3869286853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1674102f60 0x7f16741a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:29.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.935+0000 7f167be00700 1 --2- 172.21.15.2:0/3869286853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16741013c0 0x7f167419aa10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:29.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.935+0000 7f167be00700 1 --2- 172.21.15.2:0/3869286853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16741025c0 0x7f167419af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:29.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.935+0000 7f167be00700 1 -- 172.21.15.2:0/3869286853 >> 172.21.15.2:0/3869286853 conn(0x7f16740fc960 msgr2=0x7f16740fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:29.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.936+0000 7f167be00700 1 -- 172.21.15.2:0/3869286853 shutdown_connections 2024-06-13T11:17:29.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:29.936+0000 7f167be00700 1 -- 172.21.15.2:0/3869286853 wait complete. 2024-06-13T11:17:30.774 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1718277448,"num_in_osds":12,"osd_in_since":1718277428,"num_remapped_pgs":0} 2024-06-13T11:17:30.775 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T11:17:30.978 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:30 smithi002 ceph-mon[32210]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:30.978 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:30 smithi002 ceph-mon[32210]: osdmap e81: 12 total, 12 up, 12 in 2024-06-13T11:17:30.978 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:30 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3869286853' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-13T11:17:30.978 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:30 smithi002 ceph-mon[32210]: Detected new or changed devices on smithi178 2024-06-13T11:17:30.978 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:30.978 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:30.978 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:30.978 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:30.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:30.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:30.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:30.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:30.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:17:30.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:31.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:30 smithi077 ceph-mon[36410]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:31.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:30 smithi077 ceph-mon[36410]: osdmap e81: 12 total, 12 up, 12 in 2024-06-13T11:17:31.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:30 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3869286853' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-13T11:17:31.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:30 smithi077 ceph-mon[36410]: Detected new or changed devices on smithi178 2024-06-13T11:17:31.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:31.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:31.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:31.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:31.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:31.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:31.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:31.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:31.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:17:31.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:31.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:30 smithi178 ceph-mon[36913]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:31.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:30 smithi178 ceph-mon[36913]: osdmap e81: 12 total, 12 up, 12 in 2024-06-13T11:17:31.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:30 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3869286853' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-13T11:17:31.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:30 smithi178 ceph-mon[36913]: Detected new or changed devices on smithi178 2024-06-13T11:17:31.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:31.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:31.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:31.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:31.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:31.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:17:31.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:31.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:31.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:17:31.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:31.225 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:17:32.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:31 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi178 to 4272M 2024-06-13T11:17:32.092 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:31 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi178 to 4272M 2024-06-13T11:17:32.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:31 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi178 to 4272M 2024-06-13T11:17:33.003 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:32 smithi002 ceph-mon[32210]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:33.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:32 smithi077 ceph-mon[36410]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:33.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:32 smithi178 ceph-mon[36913]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:33.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.282+0000 7fc381800700 1 -- 172.21.15.2:0/2882299658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc37c06b350 msgr2=0x7fc37c10e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:33.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.282+0000 7fc381800700 1 --2- 172.21.15.2:0/2882299658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc37c06b350 0x7fc37c10e9f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3640098f0 tx=0x7fc364009c00 comp rx=0 tx=0).stop 2024-06-13T11:17:33.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.282+0000 7fc381800700 1 -- 172.21.15.2:0/2882299658 shutdown_connections 2024-06-13T11:17:33.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.282+0000 7fc381800700 1 --2- 172.21.15.2:0/2882299658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc37c10ef30 0x7fc37c111320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:33.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.282+0000 7fc381800700 1 --2- 172.21.15.2:0/2882299658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc37c06aa30 0x7fc37c06ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:33.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.282+0000 7fc381800700 1 --2- 172.21.15.2:0/2882299658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc37c06b350 0x7fc37c10e9f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:33.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.282+0000 7fc381800700 1 -- 172.21.15.2:0/2882299658 >> 172.21.15.2:0/2882299658 conn(0x7fc37c078300 msgr2=0x7fc37c078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:33.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.282+0000 7fc381800700 1 -- 172.21.15.2:0/2882299658 shutdown_connections 2024-06-13T11:17:33.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.282+0000 7fc381800700 1 -- 172.21.15.2:0/2882299658 wait complete. 2024-06-13T11:17:33.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.283+0000 7fc381800700 1 Processor -- start 2024-06-13T11:17:33.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.283+0000 7fc381800700 1 -- start start 2024-06-13T11:17:33.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.284+0000 7fc381800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc37c06aa30 0x7fc37c19aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:33.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.284+0000 7fc381800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc37c06b350 0x7fc37c19b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:33.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.284+0000 7fc381800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc37c10ef30 0x7fc37c19f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:33.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.284+0000 7fc381800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c114a00 con 0x7fc37c10ef30 2024-06-13T11:17:33.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.284+0000 7fc381800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c114880 con 0x7fc37c06b350 2024-06-13T11:17:33.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.284+0000 7fc381800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c114b80 con 0x7fc37c06aa30 2024-06-13T11:17:33.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.284+0000 7fc372000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc37c06b350 0x7fc37c19b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:33.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.284+0000 7fc37b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc37c10ef30 0x7fc37c19f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:33.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.284+0000 7fc372000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc37c06b350 0x7fc37c19b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:38118/0 (socket says 172.21.15.2:38118) 2024-06-13T11:17:33.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.284+0000 7fc372000700 1 -- 172.21.15.2:0/3031482950 learned_addr learned my addr 172.21.15.2:0/3031482950 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:17:33.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.284+0000 7fc37aa00700 1 --2- 172.21.15.2:0/3031482950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc37c06aa30 0x7fc37c19aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:33.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.284+0000 7fc372000700 1 -- 172.21.15.2:0/3031482950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc37c06aa30 msgr2=0x7fc37c19aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:33.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.284+0000 7fc372000700 1 --2- 172.21.15.2:0/3031482950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc37c06aa30 0x7fc37c19aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:33.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.284+0000 7fc372000700 1 -- 172.21.15.2:0/3031482950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc37c10ef30 msgr2=0x7fc37c19f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:33.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.284+0000 7fc372000700 1 --2- 172.21.15.2:0/3031482950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc37c10ef30 0x7fc37c19f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:33.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.284+0000 7fc372000700 1 -- 172.21.15.2:0/3031482950 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37c19fec0 con 0x7fc37c06b350 2024-06-13T11:17:33.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.285+0000 7fc372000700 1 --2- 172.21.15.2:0/3031482950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc37c06b350 0x7fc37c19b3f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc364005950 tx=0x7fc36400fb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:17:33.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.285+0000 7fc373e00700 1 -- 172.21.15.2:0/3031482950 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc364005140 con 0x7fc37c06b350 2024-06-13T11:17:33.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.285+0000 7fc373e00700 1 -- 172.21.15.2:0/3031482950 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc36400b560 con 0x7fc37c06b350 2024-06-13T11:17:33.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.285+0000 7fc381800700 1 -- 172.21.15.2:0/3031482950 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37c1a0150 con 0x7fc37c06b350 2024-06-13T11:17:33.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.285+0000 7fc373e00700 1 -- 172.21.15.2:0/3031482950 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc364003ae0 con 0x7fc37c06b350 2024-06-13T11:17:33.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.285+0000 7fc381800700 1 -- 172.21.15.2:0/3031482950 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc37c1a7a30 con 0x7fc37c06b350 2024-06-13T11:17:33.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.286+0000 7fc381800700 1 -- 172.21.15.2:0/3031482950 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37c069180 con 0x7fc37c06b350 2024-06-13T11:17:33.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.288+0000 7fc373e00700 1 -- 172.21.15.2:0/3031482950 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc36400ba80 con 0x7fc37c06b350 2024-06-13T11:17:33.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.289+0000 7fc373e00700 1 --2- 172.21.15.2:0/3031482950 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc3600a2ca0 0x7fc3600a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:33.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.290+0000 7fc373e00700 1 -- 172.21.15.2:0/3031482950 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fc3640cfae0 con 0x7fc37c06b350 2024-06-13T11:17:33.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.290+0000 7fc37aa00700 1 --2- 172.21.15.2:0/3031482950 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc3600a2ca0 0x7fc3600a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:33.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.290+0000 7fc37aa00700 1 --2- 172.21.15.2:0/3031482950 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc3600a2ca0 0x7fc3600a5160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009c60 tx=0x7fc36c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:17:33.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.294+0000 7fc373e00700 1 -- 172.21.15.2:0/3031482950 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc364013030 con 0x7fc37c06b350 2024-06-13T11:17:33.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.528+0000 7fc381800700 1 -- 172.21.15.2:0/3031482950 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc37c02dca0 con 0x7fc37c06b350 2024-06-13T11:17:33.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.530+0000 7fc373e00700 1 -- 172.21.15.2:0/3031482950 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18386 (secure 0 0 0) 0x7fc36409ced0 con 0x7fc37c06b350 2024-06-13T11:17:33.529 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:17:33.530 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","created":"2024-06-13T11:09:07.839101+0000","modified":"2024-06-13T11:17:29.734770+0000","last_up_change":"2024-06-13T11:17:28.731479+0000","last_in_change":"2024-06-13T11:17:08.849067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:13:13.793461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f5614d91-49a7-4983-a309-0de3b3e6263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6803","nonce":4127571834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6805","nonce":4127571834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6809","nonce":4127571834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6807","nonce":4127571834}]},"public_addr":"172.21.15.2:6803/4127571834","cluster_addr":"172.21.15.2:6805/4127571834","heartbeat_back_addr":"172.21.15.2:6809/4127571834","heartbeat_front_addr":"172.21.15.2:6807/4127571834","state":["exists","up"]},{"osd":1,"uuid":"d9dbe278-309f-4726-828a-da922f486b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6801","nonce":3180360713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6803","nonce":3180360713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6807","nonce":3180360713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6805","nonce":3180360713}]},"public_addr":"172.21.15.77:6801/3180360713","cluster_addr":"172.21.15.77:6803/3180360713","heartbeat_back_addr":"172.21.15.77:6807/3180360713","heartbeat_front_addr":"172.21.15.77:6805/3180360713","state":["exists","up"]},{"osd":2,"uuid":"04c267dc-7454-418f-9965-3ff96ef280ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6801","nonce":3825510575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6803","nonce":3825510575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6807","nonce":3825510575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6805","nonce":3825510575}]},"public_addr":"172.21.15.178:6801/3825510575","cluster_addr":"172.21.15.178:6803/3825510575","heartbeat_back_addr":"172.21.15.178:6807/3825510575","heartbeat_front_addr":"172.21.15.178:6805/3825510575","state":["exists","up"]},{"osd":3,"uuid":"3847bd4f-ca04-41de-9d88-e1523dd7ff8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6811","nonce":1982693353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6813","nonce":1982693353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6817","nonce":1982693353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6815","nonce":1982693353}]},"public_addr":"172.21.15.2:6811/1982693353","cluster_addr":"172.21.15.2:6813/1982693353","heartbeat_back_addr":"172.21.15.2:6817/1982693353","heartbeat_front_addr":"172.21.15.2:6815/1982693353","state":["exists","up"]},{"osd":4,"uuid":"34d7d2e8-3dee-42b9-a6cb-d4162b122b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6809","nonce":3916694904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6811","nonce":3916694904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6815","nonce":3916694904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6813","nonce":3916694904}]},"public_addr":"172.21.15.77:6809/3916694904","cluster_addr":"172.21.15.77:6811/3916694904","heartbeat_back_addr":"172.21.15.77:6815/3916694904","heartbeat_front_addr":"172.21.15.77:6813/3916694904","state":["exists","up"]},{"osd":5,"uuid":"0468aefc-c3c8-4758-9bbf-1225b7a5ae79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6809","nonce":3572805887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6811","nonce":3572805887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6815","nonce":3572805887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6813","nonce":3572805887}]},"public_addr":"172.21.15.178:6809/3572805887","cluster_addr":"172.21.15.178:6811/3572805887","heartbeat_back_addr":"172.21.15.178:6815/3572805887","heartbeat_front_addr":"172.21.15.178:6813/3572805887","state":["exists","up"]},{"osd":6,"uuid":"0a186a4a-0e28-47bd-b5ad-9bf8079f74c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6819","nonce":1592309584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6821","nonce":1592309584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6825","nonce":1592309584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6823","nonce":1592309584}]},"public_addr":"172.21.15.2:6819/1592309584","cluster_addr":"172.21.15.2:6821/1592309584","heartbeat_back_addr":"172.21.15.2:6825/1592309584","heartbeat_front_addr":"172.21.15.2:6823/1592309584","state":["exists","up"]},{"osd":7,"uuid":"646e66f7-1ef8-428d-a842-bf28c8606df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6817","nonce":1580055775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6819","nonce":1580055775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6823","nonce":1580055775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6821","nonce":1580055775}]},"public_addr":"172.21.15.77:6817/1580055775","cluster_addr":"172.21.15.77:6819/1580055775","heartbeat_back_addr":"172.21.15.77:6823/1580055775","heartbeat_front_addr":"172.21.15.77:6821/1580055775","state":["exists","up"]},{"osd":8,"uuid":"bcc971fc-47d7-4289-8a9a-c76996c57370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6817","nonce":4285192591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6819","nonce":4285192591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6823","nonce":4285192591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6821","nonce":4285192591}]},"public_addr":"172.21.15.178:6817/4285192591","cluster_addr":"172.21.15.178:6819/4285192591","heartbeat_back_addr":"172.21.15.178:6823/4285192591","heartbeat_front_addr":"172.21.15.178:6821/4285192591","state":["exists","up"]},{"osd":9,"uuid":"899d7d4f-a24c-4508-b42c-0b363275c459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6827","nonce":4187017478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6829","nonce":4187017478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6833","nonce":4187017478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6831","nonce":4187017478}]},"public_addr":"172.21.15.2:6827/4187017478","cluster_addr":"172.21.15.2:6829/4187017478","heartbeat_back_addr":"172.21.15.2:6833/4187017478","heartbeat_front_addr":"172.21.15.2:6831/4187017478","state":["exists","up"]},{"osd":10,"uuid":"112d2b8e-9673-4d7a-97e9-2089793fdd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6825","nonce":2039538463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6827","nonce":2039538463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6831","nonce":2039538463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6829","nonce":2039538463}]},"public_addr":"172.21.15.77:6825/2039538463","cluster_addr":"172.21.15.77:6827/2039538463","heartbeat_back_addr":"172.21.15.77:6831/2039538463","heartbeat_front_addr":"172.21.15.77:6829/2039538463","state":["exists","up"]},{"osd":11,"uuid":"6b8001f5-9c74-4cc7-8c41-906cb5ac9b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6825","nonce":1915058767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6827","nonce":1915058767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6831","nonce":1915058767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6829","nonce":1915058767}]},"public_addr":"172.21.15.178:6825/1915058767","cluster_addr":"172.21.15.178:6827/1915058767","heartbeat_back_addr":"172.21.15.178:6831/1915058767","heartbeat_front_addr":"172.21.15.178:6829/1915058767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:21.707572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:46.440115+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:10.197217+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:42.853367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:08.880473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:33.605677+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:07.655377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:33.980900+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:59.397529+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:16:33.983411+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:00.932649+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:26.894098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/315567313":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/2084201061":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/3394644803":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6801/1821969949":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/2170469985":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/142516651":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6801/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/3220886565":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6800/1821969949":"2024-06-14T11:10:25.084617+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:17:33.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.533+0000 7fc381800700 1 -- 172.21.15.2:0/3031482950 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc3600a2ca0 msgr2=0x7fc3600a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:33.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.533+0000 7fc381800700 1 --2- 172.21.15.2:0/3031482950 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc3600a2ca0 0x7fc3600a5160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009c60 tx=0x7fc36c009260 comp rx=0 tx=0).stop 2024-06-13T11:17:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.533+0000 7fc381800700 1 -- 172.21.15.2:0/3031482950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc37c06b350 msgr2=0x7fc37c19b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.533+0000 7fc381800700 1 --2- 172.21.15.2:0/3031482950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc37c06b350 0x7fc37c19b3f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc364005950 tx=0x7fc36400fb20 comp rx=0 tx=0).stop 2024-06-13T11:17:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.533+0000 7fc381800700 1 -- 172.21.15.2:0/3031482950 shutdown_connections 2024-06-13T11:17:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.533+0000 7fc381800700 1 --2- 172.21.15.2:0/3031482950 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc3600a2ca0 0x7fc3600a5160 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.533+0000 7fc381800700 1 --2- 172.21.15.2:0/3031482950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc37c10ef30 0x7fc37c19f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.533+0000 7fc381800700 1 --2- 172.21.15.2:0/3031482950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc37c06aa30 0x7fc37c19aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.533+0000 7fc381800700 1 --2- 172.21.15.2:0/3031482950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc37c06b350 0x7fc37c19b3f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.533+0000 7fc381800700 1 -- 172.21.15.2:0/3031482950 >> 172.21.15.2:0/3031482950 conn(0x7fc37c078300 msgr2=0x7fc37c110380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:33.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.533+0000 7fc381800700 1 -- 172.21.15.2:0/3031482950 shutdown_connections 2024-06-13T11:17:33.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:33.534+0000 7fc381800700 1 -- 172.21.15.2:0/3031482950 wait complete. 2024-06-13T11:17:33.875 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:33 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3031482950' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:17:34.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:33 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3031482950' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:17:34.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:33 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3031482950' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:17:34.283 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-13T11:13:13.793461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-13T11:17:34.283 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-06-13T11:17:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:17:35.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:34 smithi077 ceph-mon[36410]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:35.079 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:34 smithi002 ceph-mon[32210]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:35.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:34 smithi178 ceph-mon[36913]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:36.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.892+0000 7f6900800700 1 -- 172.21.15.2:0/678196741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68f8108ac0 msgr2=0x7f68f8108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:36.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.892+0000 7f6900800700 1 --2- 172.21.15.2:0/678196741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68f8108ac0 0x7f68f8108f40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009990 tx=0x7f68e8009ca0 comp rx=0 tx=0).stop 2024-06-13T11:17:36.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.892+0000 7f6900800700 1 -- 172.21.15.2:0/678196741 shutdown_connections 2024-06-13T11:17:36.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.892+0000 7f6900800700 1 --2- 172.21.15.2:0/678196741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f8109480 0x7f68f8115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:36.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.892+0000 7f6900800700 1 --2- 172.21.15.2:0/678196741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f810eac0 0x7f68f810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:36.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.892+0000 7f6900800700 1 --2- 172.21.15.2:0/678196741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68f8108ac0 0x7f68f8108f40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:36.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.892+0000 7f6900800700 1 -- 172.21.15.2:0/678196741 >> 172.21.15.2:0/678196741 conn(0x7f68f8075c60 msgr2=0x7f68f81072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:36.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.892+0000 7f6900800700 1 -- 172.21.15.2:0/678196741 shutdown_connections 2024-06-13T11:17:36.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.892+0000 7f6900800700 1 -- 172.21.15.2:0/678196741 wait complete. 2024-06-13T11:17:36.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.893+0000 7f6900800700 1 Processor -- start 2024-06-13T11:17:36.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.893+0000 7f6900800700 1 -- start start 2024-06-13T11:17:36.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.894+0000 7f6900800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f8108ac0 0x7f68f819f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:36.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.894+0000 7f6900800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f8109480 0x7f68f819f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:36.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.894+0000 7f6900800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68f810eac0 0x7f68f81a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:36.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.894+0000 7f6900800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f68f8118e60 con 0x7f68f8109480 2024-06-13T11:17:36.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.894+0000 7f6900800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f68f8118ce0 con 0x7f68f8108ac0 2024-06-13T11:17:36.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.894+0000 7f6900800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f68f8118fe0 con 0x7f68f810eac0 2024-06-13T11:17:36.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.894+0000 7f68fd400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f8109480 0x7f68f819f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:36.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.894+0000 7f68fd400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f8109480 0x7f68f819f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41994/0 (socket says 172.21.15.2:41994) 2024-06-13T11:17:36.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.894+0000 7f68fd400700 1 -- 172.21.15.2:0/2996031273 learned_addr learned my addr 172.21.15.2:0/2996031273 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:17:36.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.894+0000 7f68fde00700 1 --2- 172.21.15.2:0/2996031273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f8108ac0 0x7f68f819f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:36.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.895+0000 7f68fe800700 1 --2- 172.21.15.2:0/2996031273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68f810eac0 0x7f68f81a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:36.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.895+0000 7f68fde00700 1 -- 172.21.15.2:0/2996031273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68f810eac0 msgr2=0x7f68f81a3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:36.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.895+0000 7f68fde00700 1 --2- 172.21.15.2:0/2996031273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68f810eac0 0x7f68f81a3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:36.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.895+0000 7f68fde00700 1 -- 172.21.15.2:0/2996031273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f8109480 msgr2=0x7f68f819f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:36.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.895+0000 7f68fde00700 1 --2- 172.21.15.2:0/2996031273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f8109480 0x7f68f819f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:36.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.895+0000 7f68fde00700 1 -- 172.21.15.2:0/2996031273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f81a4340 con 0x7f68f8108ac0 2024-06-13T11:17:36.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.895+0000 7f68fe800700 1 --2- 172.21.15.2:0/2996031273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68f810eac0 0x7f68f81a3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:17:36.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.895+0000 7f68fd400700 1 --2- 172.21.15.2:0/2996031273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f8109480 0x7f68f819f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:17:36.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.895+0000 7f68fde00700 1 --2- 172.21.15.2:0/2996031273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f8108ac0 0x7f68f819f330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00e9f0 tx=0x7f68ec00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:17:36.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.896+0000 7f68f2a00700 1 -- 172.21.15.2:0/2996031273 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec00cbd0 con 0x7f68f8108ac0 2024-06-13T11:17:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.896+0000 7f6900800700 1 -- 172.21.15.2:0/2996031273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f81a4630 con 0x7f68f8108ac0 2024-06-13T11:17:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.896+0000 7f68f2a00700 1 -- 172.21.15.2:0/2996031273 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68ec004500 con 0x7f68f8108ac0 2024-06-13T11:17:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.896+0000 7f6900800700 1 -- 172.21.15.2:0/2996031273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f81abeb0 con 0x7f68f8108ac0 2024-06-13T11:17:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.896+0000 7f68f2a00700 1 -- 172.21.15.2:0/2996031273 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec01c070 con 0x7f68f8108ac0 2024-06-13T11:17:36.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.897+0000 7f6900800700 1 -- 172.21.15.2:0/2996031273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f8069180 con 0x7f68f8108ac0 2024-06-13T11:17:36.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.899+0000 7f68f2a00700 1 -- 172.21.15.2:0/2996031273 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f68ec004750 con 0x7f68f8108ac0 2024-06-13T11:17:36.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.900+0000 7f68f2a00700 1 --2- 172.21.15.2:0/2996031273 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f68e00a2c20 0x7f68e00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:36.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.901+0000 7f68f2a00700 1 -- 172.21.15.2:0/2996031273 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f68ec0ceb70 con 0x7f68f8108ac0 2024-06-13T11:17:36.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.901+0000 7f68fd400700 1 --2- 172.21.15.2:0/2996031273 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f68e00a2c20 0x7f68e00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:36.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.902+0000 7f68fd400700 1 --2- 172.21.15.2:0/2996031273 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f68e00a2c20 0x7f68e00a50e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009750 tx=0x7f68e800b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:17:36.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:36.905+0000 7f68f2a00700 1 -- 172.21.15.2:0/2996031273 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f68ec004e20 con 0x7f68f8108ac0 2024-06-13T11:17:37.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:36 smithi077 ceph-mon[36410]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:37.136+0000 7f6900800700 1 -- 172.21.15.2:0/2996031273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f68f81a0690 con 0x7f68f8108ac0 2024-06-13T11:17:37.136 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:36 smithi002 ceph-mon[32210]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:37.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:37.137+0000 7f68f2a00700 1 -- 172.21.15.2:0/2996031273 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f68ec09bed0 con 0x7f68f8108ac0 2024-06-13T11:17:37.137 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-06-13T11:17:37.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:37.141+0000 7f6900800700 1 -- 172.21.15.2:0/2996031273 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f68e00a2c20 msgr2=0x7f68e00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:37.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:37.141+0000 7f6900800700 1 --2- 172.21.15.2:0/2996031273 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f68e00a2c20 0x7f68e00a50e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009750 tx=0x7f68e800b280 comp rx=0 tx=0).stop 2024-06-13T11:17:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:37.141+0000 7f6900800700 1 -- 172.21.15.2:0/2996031273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f8108ac0 msgr2=0x7f68f819f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:37.141+0000 7f6900800700 1 --2- 172.21.15.2:0/2996031273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f8108ac0 0x7f68f819f330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00e9f0 tx=0x7f68ec00ed00 comp rx=0 tx=0).stop 2024-06-13T11:17:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:37.141+0000 7f6900800700 1 -- 172.21.15.2:0/2996031273 shutdown_connections 2024-06-13T11:17:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:37.141+0000 7f6900800700 1 --2- 172.21.15.2:0/2996031273 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f68e00a2c20 0x7f68e00a50e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:37.141+0000 7f6900800700 1 --2- 172.21.15.2:0/2996031273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68f810eac0 0x7f68f81a3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:37.141+0000 7f6900800700 1 --2- 172.21.15.2:0/2996031273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f8108ac0 0x7f68f819f330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:37.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:37.141+0000 7f6900800700 1 --2- 172.21.15.2:0/2996031273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f8109480 0x7f68f819f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:37.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:37.141+0000 7f6900800700 1 -- 172.21.15.2:0/2996031273 >> 172.21.15.2:0/2996031273 conn(0x7f68f8075c60 msgr2=0x7f68f8076280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:37.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:37.141+0000 7f6900800700 1 -- 172.21.15.2:0/2996031273 shutdown_connections 2024-06-13T11:17:37.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:37.141+0000 7f6900800700 1 -- 172.21.15.2:0/2996031273 wait complete. 2024-06-13T11:17:37.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:36 smithi178 ceph-mon[36913]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:37.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:37 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2996031273' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-13T11:17:37.942 INFO:tasks.cephadm:Adding mds.a on smithi002 2024-06-13T11:17:37.942 INFO:tasks.cephadm:Adding mds.d on smithi002 2024-06-13T11:17:37.942 INFO:tasks.cephadm:Adding mds.g on smithi002 2024-06-13T11:17:37.943 INFO:tasks.cephadm:Adding mds.j on smithi002 2024-06-13T11:17:37.943 INFO:tasks.cephadm:Adding mds.b on smithi077 2024-06-13T11:17:37.943 INFO:tasks.cephadm:Adding mds.e on smithi077 2024-06-13T11:17:37.943 INFO:tasks.cephadm:Adding mds.h on smithi077 2024-06-13T11:17:37.943 INFO:tasks.cephadm:Adding mds.k on smithi077 2024-06-13T11:17:37.943 INFO:tasks.cephadm:Adding mds.c on smithi178 2024-06-13T11:17:37.943 INFO:tasks.cephadm:Adding mds.f on smithi178 2024-06-13T11:17:37.943 INFO:tasks.cephadm:Adding mds.i on smithi178 2024-06-13T11:17:37.943 INFO:tasks.cephadm:Adding mds.l on smithi178 2024-06-13T11:17:37.943 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph orch apply mds all '12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l' 2024-06-13T11:17:38.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:37 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2996031273' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-13T11:17:38.098 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:37 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2996031273' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-13T11:17:38.193 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:17:38.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:38 smithi178 ceph-mon[36913]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:39.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:38 smithi077 ceph-mon[36410]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:39.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:38 smithi002 ceph-mon[32210]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:39.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.858+0000 7f4bea39d700 1 -- 172.21.15.178:0/1977512279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be4102410 msgr2=0x7f4be4102830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:39.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.858+0000 7f4bea39d700 1 --2- 172.21.15.178:0/1977512279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be4102410 0x7f4be4102830 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009990 tx=0x7f4bd4009ca0 comp rx=0 tx=0).stop 2024-06-13T11:17:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.859+0000 7f4bea39d700 1 -- 172.21.15.178:0/1977512279 shutdown_connections 2024-06-13T11:17:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.859+0000 7f4bea39d700 1 --2- 172.21.15.178:0/1977512279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4be4103fb0 0x7f4be410a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.859+0000 7f4bea39d700 1 --2- 172.21.15.178:0/1977512279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be4102410 0x7f4be4102830 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.859+0000 7f4bea39d700 1 --2- 172.21.15.178:0/1977512279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4be4103610 0x7f4be4103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.859+0000 7f4bea39d700 1 -- 172.21.15.178:0/1977512279 >> 172.21.15.178:0/1977512279 conn(0x7f4be40fd9d0 msgr2=0x7f4be40ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.859+0000 7f4bea39d700 1 -- 172.21.15.178:0/1977512279 shutdown_connections 2024-06-13T11:17:39.859 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.859+0000 7f4bea39d700 1 -- 172.21.15.178:0/1977512279 wait complete. 2024-06-13T11:17:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.859+0000 7f4bea39d700 1 Processor -- start 2024-06-13T11:17:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4bea39d700 1 -- start start 2024-06-13T11:17:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4bea39d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4be4102410 0x7f4be40761e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4bea39d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4be4103610 0x7f4be4074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4bea39d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be4103fb0 0x7f4be4074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4bea39d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4be410e120 con 0x7f4be4102410 2024-06-13T11:17:39.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4bea39d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4be410dfa0 con 0x7f4be4103610 2024-06-13T11:17:39.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4bea39d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4be410e2a0 con 0x7f4be4103fb0 2024-06-13T11:17:39.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4be9b9c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be4103fb0 0x7f4be4074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:39.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4be9b9c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be4103fb0 0x7f4be4074dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:37850/0 (socket says 172.21.15.178:37850) 2024-06-13T11:17:39.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4be9b9c700 1 -- 172.21.15.178:0/921683212 learned_addr learned my addr 172.21.15.178:0/921683212 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-13T11:17:39.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4be8b9a700 1 --2- 172.21.15.178:0/921683212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4be4103610 0x7f4be4074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:39.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4be9b9c700 1 -- 172.21.15.178:0/921683212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4be4103610 msgr2=0x7f4be4074880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:39.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4be9b9c700 1 --2- 172.21.15.178:0/921683212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4be4103610 0x7f4be4074880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:39.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4be9b9c700 1 -- 172.21.15.178:0/921683212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4be4102410 msgr2=0x7f4be40761e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:39.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4be9b9c700 1 --2- 172.21.15.178:0/921683212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4be4102410 0x7f4be40761e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:39.862 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4be9b9c700 1 -- 172.21.15.178:0/921683212 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be4075690 con 0x7f4be4103fb0 2024-06-13T11:17:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4be9b9c700 1 --2- 172.21.15.178:0/921683212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be4103fb0 0x7f4be4074dc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00b970 tx=0x7f4bdc00bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:17:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.860+0000 7f4bda7fc700 1 -- 172.21.15.178:0/921683212 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc019070 con 0x7f4be4103fb0 2024-06-13T11:17:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.861+0000 7f4bda7fc700 1 -- 172.21.15.178:0/921683212 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bdc014440 con 0x7f4be4103fb0 2024-06-13T11:17:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.861+0000 7f4bda7fc700 1 -- 172.21.15.178:0/921683212 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc0075d0 con 0x7f4be4103fb0 2024-06-13T11:17:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.861+0000 7f4bea39d700 1 -- 172.21.15.178:0/921683212 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be41a2950 con 0x7f4be4103fb0 2024-06-13T11:17:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.861+0000 7f4bea39d700 1 -- 172.21.15.178:0/921683212 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be41a2e90 con 0x7f4be4103fb0 2024-06-13T11:17:39.863 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.861+0000 7f4bea39d700 1 -- 172.21.15.178:0/921683212 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be4069180 con 0x7f4be4103fb0 2024-06-13T11:17:39.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.863+0000 7f4bda7fc700 1 -- 172.21.15.178:0/921683212 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4bdc01c070 con 0x7f4be4103fb0 2024-06-13T11:17:39.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.863+0000 7f4bda7fc700 1 --2- 172.21.15.178:0/921683212 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4bd00a2c20 0x7f4bd00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:39.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.863+0000 7f4bda7fc700 1 -- 172.21.15.178:0/921683212 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f4bdc0ce560 con 0x7f4be4103fb0 2024-06-13T11:17:39.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.864+0000 7f4be939b700 1 --2- 172.21.15.178:0/921683212 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4bd00a2c20 0x7f4bd00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:39.864 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.865+0000 7f4be939b700 1 --2- 172.21.15.178:0/921683212 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4bd00a2c20 0x7f4bd00a50e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4003890 tx=0x7f4bd4005c20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:17:39.866 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:39.867+0000 7f4bda7fc700 1 -- 172.21.15.178:0/921683212 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4bdc09b960 con 0x7f4be4103fb0 2024-06-13T11:17:40.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:40.076+0000 7f4bea39d700 1 -- 172.21.15.178:0/921683212 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l", "target": ["mon-mgr", ""]}) -- 0x7f4be4062b90 con 0x7f4bd00a2c20 2024-06-13T11:17:40.092 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:40.093+0000 7f4bda7fc700 1 -- 172.21.15.178:0/921683212 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f4be4062b90 con 0x7f4bd00a2c20 2024-06-13T11:17:40.093 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled mds.all update... 2024-06-13T11:17:40.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:40.095+0000 7f4bea39d700 1 -- 172.21.15.178:0/921683212 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4bd00a2c20 msgr2=0x7f4bd00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:40.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:40.095+0000 7f4bea39d700 1 --2- 172.21.15.178:0/921683212 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4bd00a2c20 0x7f4bd00a50e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4003890 tx=0x7f4bd4005c20 comp rx=0 tx=0).stop 2024-06-13T11:17:40.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:40.095+0000 7f4bea39d700 1 -- 172.21.15.178:0/921683212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be4103fb0 msgr2=0x7f4be4074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:40.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:40.095+0000 7f4bea39d700 1 --2- 172.21.15.178:0/921683212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be4103fb0 0x7f4be4074dc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc00b970 tx=0x7f4bdc00bd30 comp rx=0 tx=0).stop 2024-06-13T11:17:40.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:40.095+0000 7f4bea39d700 1 -- 172.21.15.178:0/921683212 shutdown_connections 2024-06-13T11:17:40.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:40.095+0000 7f4bea39d700 1 --2- 172.21.15.178:0/921683212 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4bd00a2c20 0x7f4bd00a50e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:40.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:40.095+0000 7f4bea39d700 1 --2- 172.21.15.178:0/921683212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4be4102410 0x7f4be40761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:40.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:40.095+0000 7f4bea39d700 1 --2- 172.21.15.178:0/921683212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be4103fb0 0x7f4be4074dc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:40.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:40.095+0000 7f4bea39d700 1 --2- 172.21.15.178:0/921683212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4be4103610 0x7f4be4074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:40.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:40.095+0000 7f4bea39d700 1 -- 172.21.15.178:0/921683212 >> 172.21.15.178:0/921683212 conn(0x7f4be40fd9d0 msgr2=0x7f4be4106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:40.095 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:40.095+0000 7f4bea39d700 1 -- 172.21.15.178:0/921683212 shutdown_connections 2024-06-13T11:17:40.096 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-13T11:17:40.095+0000 7f4bea39d700 1 -- 172.21.15.178:0/921683212 wait complete. 2024-06-13T11:17:40.813 DEBUG:teuthology.orchestra.run.smithi002:mds.a> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.a.service 2024-06-13T11:17:40.821 DEBUG:teuthology.orchestra.run.smithi002:mds.d> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.d.service 2024-06-13T11:17:40.867 DEBUG:teuthology.orchestra.run.smithi002:mds.g> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.g.service 2024-06-13T11:17:40.912 DEBUG:teuthology.orchestra.run.smithi002:mds.j> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.j.service 2024-06-13T11:17:40.958 DEBUG:teuthology.orchestra.run.smithi077:mds.b> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.b.service 2024-06-13T11:17:40.960 DEBUG:teuthology.orchestra.run.smithi077:mds.e> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.e.service 2024-06-13T11:17:41.003 DEBUG:teuthology.orchestra.run.smithi077:mds.h> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.h.service 2024-06-13T11:17:41.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:40 smithi077 ceph-mon[36410]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:41.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:41.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:40 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:17:41.040 DEBUG:teuthology.orchestra.run.smithi077:mds.k> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.k.service 2024-06-13T11:17:41.082 DEBUG:teuthology.orchestra.run.smithi178:mds.c> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.c.service 2024-06-13T11:17:41.085 DEBUG:teuthology.orchestra.run.smithi178:mds.f> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.f.service 2024-06-13T11:17:41.096 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:40 smithi002 ceph-mon[32210]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:41.096 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:41.096 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:40 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:17:41.104 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:40 smithi178 ceph-mon[36913]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:41.104 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:41.104 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:40 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:17:41.105 DEBUG:teuthology.orchestra.run.smithi178:mds.i> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.i.service 2024-06-13T11:17:41.148 DEBUG:teuthology.orchestra.run.smithi178:mds.l> sudo journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.l.service 2024-06-13T11:17:41.190 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-06-13T11:17:41.190 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:17:41.651 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:17:42.052 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:41 smithi178 ceph-mon[36913]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:17:42.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:41 smithi178 ceph-mon[36913]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l;count:12 2024-06-13T11:17:42.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:42.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:17:42.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:42.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:17:42.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:17:42.053 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:41 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:42.119 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:41 smithi002 ceph-mon[32210]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:17:42.119 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:41 smithi002 ceph-mon[32210]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l;count:12 2024-06-13T11:17:42.119 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:42.119 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:17:42.119 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:42.119 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:17:42.119 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:17:42.119 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:41 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:41 smithi077 ceph-mon[36410]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:17:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:41 smithi077 ceph-mon[36410]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l;count:12 2024-06-13T11:17:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:17:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:17:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:17:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:41 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:42.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:42 smithi002 ceph-mon[32210]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:42.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:42 smithi002 ceph-mon[32210]: Deploying daemon mds.l on smithi178 2024-06-13T11:17:43.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:42 smithi077 ceph-mon[36410]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:43.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:42 smithi077 ceph-mon[36410]: Deploying daemon mds.l on smithi178 2024-06-13T11:17:43.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:42 smithi178 ceph-mon[36913]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:43.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:42 smithi178 ceph-mon[36913]: Deploying daemon mds.l on smithi178 2024-06-13T11:17:43.696 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 13 11:17:43 smithi178 systemd[1]: Starting Ceph mds.l for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:17:43.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.733+0000 7fba3d400700 1 -- 172.21.15.2:0/1033219407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba38074fe0 msgr2=0x7fba3810e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:43.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.733+0000 7fba3d400700 1 --2- 172.21.15.2:0/1033219407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba38074fe0 0x7fba3810e950 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba20009990 tx=0x7fba20009ca0 comp rx=0 tx=0).stop 2024-06-13T11:17:43.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.733+0000 7fba3d400700 1 -- 172.21.15.2:0/1033219407 shutdown_connections 2024-06-13T11:17:43.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.733+0000 7fba3d400700 1 --2- 172.21.15.2:0/1033219407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3810ee90 0x7fba38111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:43.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.733+0000 7fba3d400700 1 --2- 172.21.15.2:0/1033219407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba380746c0 0x7fba38074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:43.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.733+0000 7fba3d400700 1 --2- 172.21.15.2:0/1033219407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba38074fe0 0x7fba3810e950 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:43.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.734+0000 7fba3d400700 1 -- 172.21.15.2:0/1033219407 >> 172.21.15.2:0/1033219407 conn(0x7fba380795f0 msgr2=0x7fba38079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:43.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.734+0000 7fba3d400700 1 -- 172.21.15.2:0/1033219407 shutdown_connections 2024-06-13T11:17:43.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.734+0000 7fba3d400700 1 -- 172.21.15.2:0/1033219407 wait complete. 2024-06-13T11:17:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.735+0000 7fba3d400700 1 Processor -- start 2024-06-13T11:17:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.735+0000 7fba3d400700 1 -- start start 2024-06-13T11:17:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.735+0000 7fba3d400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba380746c0 0x7fba3819ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.735+0000 7fba3d400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba38074fe0 0x7fba3819b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.736+0000 7fba3d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba3810ee90 0x7fba3819f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.736+0000 7fba3d400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fba38114a10 con 0x7fba3810ee90 2024-06-13T11:17:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.736+0000 7fba3d400700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fba38114890 con 0x7fba38074fe0 2024-06-13T11:17:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.736+0000 7fba3d400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fba38114b90 con 0x7fba380746c0 2024-06-13T11:17:43.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.736+0000 7fba36800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba380746c0 0x7fba3819ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:43.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.736+0000 7fba36800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba380746c0 0x7fba3819ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:45872/0 (socket says 172.21.15.2:45872) 2024-06-13T11:17:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.736+0000 7fba36800700 1 -- 172.21.15.2:0/1267694689 learned_addr learned my addr 172.21.15.2:0/1267694689 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:17:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.736+0000 7fba2fe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba38074fe0 0x7fba3819b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.736+0000 7fba37200700 1 --2- 172.21.15.2:0/1267694689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba3810ee90 0x7fba3819f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.736+0000 7fba36800700 1 -- 172.21.15.2:0/1267694689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba38074fe0 msgr2=0x7fba3819b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.736+0000 7fba36800700 1 --2- 172.21.15.2:0/1267694689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba38074fe0 0x7fba3819b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.736+0000 7fba36800700 1 -- 172.21.15.2:0/1267694689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba3810ee90 msgr2=0x7fba3819f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.736+0000 7fba36800700 1 --2- 172.21.15.2:0/1267694689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba3810ee90 0x7fba3819f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.736+0000 7fba36800700 1 -- 172.21.15.2:0/1267694689 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3819fe40 con 0x7fba380746c0 2024-06-13T11:17:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.736+0000 7fba2fe00700 1 --2- 172.21.15.2:0/1267694689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba38074fe0 0x7fba3819b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:17:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.737+0000 7fba36800700 1 --2- 172.21.15.2:0/1267694689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba380746c0 0x7fba3819ae80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fba2800eb30 tx=0x7fba2800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:17:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.737+0000 7fba2f400700 1 -- 172.21.15.2:0/1267694689 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2800cbd0 con 0x7fba380746c0 2024-06-13T11:17:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.737+0000 7fba3d400700 1 -- 172.21.15.2:0/1267694689 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba381a0130 con 0x7fba380746c0 2024-06-13T11:17:43.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.737+0000 7fba2f400700 1 -- 172.21.15.2:0/1267694689 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba28004500 con 0x7fba380746c0 2024-06-13T11:17:43.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.737+0000 7fba2f400700 1 -- 172.21.15.2:0/1267694689 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28010430 con 0x7fba380746c0 2024-06-13T11:17:43.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.737+0000 7fba3d400700 1 -- 172.21.15.2:0/1267694689 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba381a79b0 con 0x7fba380746c0 2024-06-13T11:17:43.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.739+0000 7fba3d400700 1 -- 172.21.15.2:0/1267694689 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba38069180 con 0x7fba380746c0 2024-06-13T11:17:43.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.740+0000 7fba2f400700 1 -- 172.21.15.2:0/1267694689 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fba28003f00 con 0x7fba380746c0 2024-06-13T11:17:43.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.742+0000 7fba2f400700 1 --2- 172.21.15.2:0/1267694689 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fba1c0a2c20 0x7fba1c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:43.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.742+0000 7fba2f400700 1 -- 172.21.15.2:0/1267694689 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fba280cefa0 con 0x7fba380746c0 2024-06-13T11:17:43.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.742+0000 7fba2fe00700 1 --2- 172.21.15.2:0/1267694689 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fba1c0a2c20 0x7fba1c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:43.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.743+0000 7fba2fe00700 1 --2- 172.21.15.2:0/1267694689 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fba1c0a2c20 0x7fba1c0a50e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fba38101fd0 tx=0x7fba2000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:17:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:43.746+0000 7fba2f400700 1 -- 172.21.15.2:0/1267694689 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fba2809c300 con 0x7fba380746c0 2024-06-13T11:17:43.967 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 13 11:17:43 smithi178 podman[67601]: 2024-06-13 11:17:43.715684048 +0000 UTC m=+0.101693326 container create 6f614becb90e4408cbd2a88db4e7146e9bd2369951a36a75287533019532407b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-l, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.build-date=20240528) 2024-06-13T11:17:43.967 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 13 11:17:43 smithi178 podman[67601]: 2024-06-13 11:17:43.632066977 +0000 UTC m=+0.018076222 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:17:43.968 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 13 11:17:43 smithi178 podman[67601]: 2024-06-13 11:17:43.969301653 +0000 UTC m=+0.355310892 container init 6f614becb90e4408cbd2a88db4e7146e9bd2369951a36a75287533019532407b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-l, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528) 2024-06-13T11:17:44.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:44.028+0000 7fba3d400700 1 -- 172.21.15.2:0/1267694689 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba3819c190 con 0x7fba380746c0 2024-06-13T11:17:44.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:44.029+0000 7fba2f400700 1 -- 172.21.15.2:0/1267694689 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7fba2809bc00 con 0x7fba380746c0 2024-06-13T11:17:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:17:44.028 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-13T11:17:44.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:44.032+0000 7fba3d400700 1 -- 172.21.15.2:0/1267694689 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fba1c0a2c20 msgr2=0x7fba1c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:44.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:44.032+0000 7fba3d400700 1 --2- 172.21.15.2:0/1267694689 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fba1c0a2c20 0x7fba1c0a50e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fba38101fd0 tx=0x7fba2000b260 comp rx=0 tx=0).stop 2024-06-13T11:17:44.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:44.032+0000 7fba3d400700 1 -- 172.21.15.2:0/1267694689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba380746c0 msgr2=0x7fba3819ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:44.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:44.032+0000 7fba3d400700 1 --2- 172.21.15.2:0/1267694689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba380746c0 0x7fba3819ae80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fba2800eb30 tx=0x7fba2800ee40 comp rx=0 tx=0).stop 2024-06-13T11:17:44.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:44.032+0000 7fba3d400700 1 -- 172.21.15.2:0/1267694689 shutdown_connections 2024-06-13T11:17:44.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:44.032+0000 7fba3d400700 1 --2- 172.21.15.2:0/1267694689 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fba1c0a2c20 0x7fba1c0a50e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:44.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:44.032+0000 7fba3d400700 1 --2- 172.21.15.2:0/1267694689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba3810ee90 0x7fba3819f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:44.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:44.032+0000 7fba3d400700 1 --2- 172.21.15.2:0/1267694689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba380746c0 0x7fba3819ae80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:44.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:44.032+0000 7fba3d400700 1 --2- 172.21.15.2:0/1267694689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba38074fe0 0x7fba3819b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:44.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:44.032+0000 7fba3d400700 1 -- 172.21.15.2:0/1267694689 >> 172.21.15.2:0/1267694689 conn(0x7fba380795f0 msgr2=0x7fba380ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:44.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:44.032+0000 7fba3d400700 1 -- 172.21.15.2:0/1267694689 shutdown_connections 2024-06-13T11:17:44.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:44.033+0000 7fba3d400700 1 -- 172.21.15.2:0/1267694689 wait complete. 2024-06-13T11:17:44.033 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2024-06-13T11:17:44.446 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 13 11:17:43 smithi178 podman[67601]: 2024-06-13 11:17:43.971826014 +0000 UTC m=+0.357835261 container start 6f614becb90e4408cbd2a88db4e7146e9bd2369951a36a75287533019532407b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-06-13T11:17:44.447 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 13 11:17:43 smithi178 ceph-mds[67621]: -- 172.21.15.178:0/3687085795 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560eeb085a40 con 0x560eeb059000 2024-06-13T11:17:44.447 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 13 11:17:43 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-l[67617]: starting mds.l at 2024-06-13T11:17:44.447 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 13 11:17:44 smithi178 bash[67601]: 6f614becb90e4408cbd2a88db4e7146e9bd2369951a36a75287533019532407b 2024-06-13T11:17:44.447 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 13 11:17:44 smithi178 systemd[1]: Started Ceph mds.l for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:17:45.098 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:44 smithi077 ceph-mon[36410]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:45.098 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:44 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.178:6832/1723286863,v1:172.21.15.178:6833/1723286863] up:boot 2024-06-13T11:17:45.098 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:44 smithi077 ceph-mon[36410]: fsmap 1 up:standby 2024-06-13T11:17:45.098 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-13T11:17:45.098 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:44 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1267694689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:17:45.098 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:45.098 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:45.098 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:45.098 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:17:45.099 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:17:45.099 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:44 smithi002 ceph-mon[32210]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:44 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.178:6832/1723286863,v1:172.21.15.178:6833/1723286863] up:boot 2024-06-13T11:17:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:44 smithi002 ceph-mon[32210]: fsmap 1 up:standby 2024-06-13T11:17:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-13T11:17:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:44 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1267694689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:17:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:17:45.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:17:45.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:44 smithi178 ceph-mon[36913]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:44 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.178:6832/1723286863,v1:172.21.15.178:6833/1723286863] up:boot 2024-06-13T11:17:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:44 smithi178 ceph-mon[36913]: fsmap 1 up:standby 2024-06-13T11:17:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-13T11:17:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:44 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1267694689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:17:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:17:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:17:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:46.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:45 smithi002 ceph-mon[32210]: Deploying daemon mds.k on smithi077 2024-06-13T11:17:46.195 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:45 smithi077 ceph-mon[36410]: Deploying daemon mds.k on smithi077 2024-06-13T11:17:46.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:45 smithi178 ceph-mon[36913]: Deploying daemon mds.k on smithi077 2024-06-13T11:17:46.540 INFO:journalctl@ceph.mds.k.smithi077.stdout:Jun 13 11:17:46 smithi077 systemd[1]: Starting Ceph mds.k for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:17:46.830 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:17:46.854 INFO:journalctl@ceph.mds.k.smithi077.stdout:Jun 13 11:17:46 smithi077 podman[65667]: 2024-06-13 11:17:46.491227124 +0000 UTC m=+0.016928425 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:17:46.854 INFO:journalctl@ceph.mds.k.smithi077.stdout:Jun 13 11:17:46 smithi077 podman[65667]: 2024-06-13 11:17:46.603186845 +0000 UTC m=+0.128888132 container create 78b12aa278c91c235635a0f9f4f4806164ae5348bead1ceae1d3afaedb1b2e1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-k, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-06-13T11:17:46.854 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:46 smithi077 ceph-mon[36410]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:47.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:46 smithi002 ceph-mon[32210]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:47.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:46 smithi178 ceph-mon[36913]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:47.290 INFO:journalctl@ceph.mds.k.smithi077.stdout:Jun 13 11:17:46 smithi077 podman[65667]: 2024-06-13 11:17:46.855756976 +0000 UTC m=+0.381458277 container init 78b12aa278c91c235635a0f9f4f4806164ae5348bead1ceae1d3afaedb1b2e1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:17:47.290 INFO:journalctl@ceph.mds.k.smithi077.stdout:Jun 13 11:17:46 smithi077 podman[65667]: 2024-06-13 11:17:46.858805888 +0000 UTC m=+0.384507185 container start 78b12aa278c91c235635a0f9f4f4806164ae5348bead1ceae1d3afaedb1b2e1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-k, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-06-13T11:17:47.290 INFO:journalctl@ceph.mds.k.smithi077.stdout:Jun 13 11:17:46 smithi077 ceph-mds[65686]: -- 172.21.15.77:0/1039895226 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562a0497da40 con 0x562a04951000 2024-06-13T11:17:47.290 INFO:journalctl@ceph.mds.k.smithi077.stdout:Jun 13 11:17:46 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-k[65682]: starting mds.k at 2024-06-13T11:17:47.290 INFO:journalctl@ceph.mds.k.smithi077.stdout:Jun 13 11:17:46 smithi077 bash[65667]: 78b12aa278c91c235635a0f9f4f4806164ae5348bead1ceae1d3afaedb1b2e1b 2024-06-13T11:17:47.290 INFO:journalctl@ceph.mds.k.smithi077.stdout:Jun 13 11:17:46 smithi077 systemd[1]: Started Ceph mds.k for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:17:47.306 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:17:48.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:48.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:48.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:48.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:17:48.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:17:48.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:48.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:48 smithi002 ceph-mon[32210]: Deploying daemon mds.j on smithi002 2024-06-13T11:17:48.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:48 smithi002 ceph-mon[32210]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:48.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:48 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.77:6832/1004888584,v1:172.21.15.77:6833/1004888584] up:boot 2024-06-13T11:17:48.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:48 smithi002 ceph-mon[32210]: fsmap 2 up:standby 2024-06-13T11:17:48.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:48 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-13T11:17:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:17:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:17:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:48 smithi077 ceph-mon[36410]: Deploying daemon mds.j on smithi002 2024-06-13T11:17:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:48 smithi077 ceph-mon[36410]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:48 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.77:6832/1004888584,v1:172.21.15.77:6833/1004888584] up:boot 2024-06-13T11:17:48.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:48 smithi077 ceph-mon[36410]: fsmap 2 up:standby 2024-06-13T11:17:48.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:48 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-13T11:17:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:17:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:17:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:48 smithi178 ceph-mon[36913]: Deploying daemon mds.j on smithi002 2024-06-13T11:17:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:48 smithi178 ceph-mon[36913]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:48 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.77:6832/1004888584,v1:172.21.15.77:6833/1004888584] up:boot 2024-06-13T11:17:48.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:48 smithi178 ceph-mon[36913]: fsmap 2 up:standby 2024-06-13T11:17:48.448 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:48 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-13T11:17:50.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.247+0000 7f94d7800700 1 -- 172.21.15.2:0/3317982373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d0102740 msgr2=0x7f94d0102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:50.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.247+0000 7f94d7800700 1 --2- 172.21.15.2:0/3317982373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d0102740 0x7f94d0102b20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009920 tx=0x7f94c4009c30 comp rx=0 tx=0).stop 2024-06-13T11:17:50.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.247+0000 7f94d7800700 1 -- 172.21.15.2:0/3317982373 shutdown_connections 2024-06-13T11:17:50.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.247+0000 7f94d7800700 1 --2- 172.21.15.2:0/3317982373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d0102740 0x7f94d0102b20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:50.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.247+0000 7f94d7800700 1 --2- 172.21.15.2:0/3317982373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94d0107840 0x7f94d010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:50.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.247+0000 7f94d7800700 1 --2- 172.21.15.2:0/3317982373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d01030f0 0x7f94d0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:50.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.247+0000 7f94d7800700 1 -- 172.21.15.2:0/3317982373 >> 172.21.15.2:0/3317982373 conn(0x7f94d00795f0 msgr2=0x7f94d0079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:50.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.247+0000 7f94d7800700 1 -- 172.21.15.2:0/3317982373 shutdown_connections 2024-06-13T11:17:50.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.247+0000 7f94d7800700 1 -- 172.21.15.2:0/3317982373 wait complete. 2024-06-13T11:17:50.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.248+0000 7f94d7800700 1 Processor -- start 2024-06-13T11:17:50.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.248+0000 7f94d7800700 1 -- start start 2024-06-13T11:17:50.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.249+0000 7f94d7800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d0102740 0x7f94d019aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:50.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.249+0000 7f94d7800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94d01030f0 0x7f94d019b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:50.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.249+0000 7f94d7800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d0107840 0x7f94d019f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:50.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.249+0000 7f94d7800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f94d01127d0 con 0x7f94d0107840 2024-06-13T11:17:50.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.249+0000 7f94d7800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f94d0112650 con 0x7f94d0102740 2024-06-13T11:17:50.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.249+0000 7f94d7800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f94d0112950 con 0x7f94d01030f0 2024-06-13T11:17:50.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.249+0000 7f94cfe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94d01030f0 0x7f94d019b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:50.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.249+0000 7f94d4e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d0102740 0x7f94d019aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:50.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.249+0000 7f94cfe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94d01030f0 0x7f94d019b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:35604/0 (socket says 172.21.15.2:35604) 2024-06-13T11:17:50.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.249+0000 7f94d4e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d0102740 0x7f94d019aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:44068/0 (socket says 172.21.15.2:44068) 2024-06-13T11:17:50.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.249+0000 7f94cfe00700 1 -- 172.21.15.2:0/879676747 learned_addr learned my addr 172.21.15.2:0/879676747 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:17:50.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.249+0000 7f94d5800700 1 --2- 172.21.15.2:0/879676747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d0107840 0x7f94d019f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:50.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.250+0000 7f94d4e00700 1 -- 172.21.15.2:0/879676747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94d01030f0 msgr2=0x7f94d019b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:50.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.250+0000 7f94d4e00700 1 --2- 172.21.15.2:0/879676747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94d01030f0 0x7f94d019b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:50.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.250+0000 7f94d4e00700 1 -- 172.21.15.2:0/879676747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d0107840 msgr2=0x7f94d019f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:50.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.250+0000 7f94d4e00700 1 --2- 172.21.15.2:0/879676747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d0107840 0x7f94d019f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:50.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.250+0000 7f94d4e00700 1 -- 172.21.15.2:0/879676747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d019fe70 con 0x7f94d0102740 2024-06-13T11:17:50.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.250+0000 7f94cfe00700 1 --2- 172.21.15.2:0/879676747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94d01030f0 0x7f94d019b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:17:50.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.250+0000 7f94d4e00700 1 --2- 172.21.15.2:0/879676747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d0102740 0x7f94d019aeb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f94c400a010 tx=0x7f94c400fa70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:17:50.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.250+0000 7f94cd600700 1 -- 172.21.15.2:0/879676747 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c4005140 con 0x7f94d0102740 2024-06-13T11:17:50.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.250+0000 7f94d7800700 1 -- 172.21.15.2:0/879676747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d01a0100 con 0x7f94d0102740 2024-06-13T11:17:50.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.250+0000 7f94cd600700 1 -- 172.21.15.2:0/879676747 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94c400b560 con 0x7f94d0102740 2024-06-13T11:17:50.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.251+0000 7f94cd600700 1 -- 172.21.15.2:0/879676747 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c4003ae0 con 0x7f94d0102740 2024-06-13T11:17:50.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.251+0000 7f94d7800700 1 -- 172.21.15.2:0/879676747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d01a79e0 con 0x7f94d0102740 2024-06-13T11:17:50.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.252+0000 7f94d7800700 1 -- 172.21.15.2:0/879676747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d0103bd0 con 0x7f94d0102740 2024-06-13T11:17:50.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.254+0000 7f94cd600700 1 -- 172.21.15.2:0/879676747 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f94c4029060 con 0x7f94d0102740 2024-06-13T11:17:50.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.255+0000 7f94cd600700 1 --2- 172.21.15.2:0/879676747 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f94b80a2ca0 0x7f94b80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:50.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.255+0000 7f94cd600700 1 -- 172.21.15.2:0/879676747 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f94c40cf4b0 con 0x7f94d0102740 2024-06-13T11:17:50.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.255+0000 7f94cfe00700 1 --2- 172.21.15.2:0/879676747 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f94b80a2ca0 0x7f94b80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:50.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.256+0000 7f94cfe00700 1 --2- 172.21.15.2:0/879676747 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f94b80a2ca0 0x7f94b80a5160 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009750 tx=0x7f94bc009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:17:50.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.259+0000 7f94cd600700 1 -- 172.21.15.2:0/879676747 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f94c4013030 con 0x7f94d0102740 2024-06-13T11:17:50.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:50 smithi178 ceph-mon[36913]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:50.539 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:50 smithi077 ceph-mon[36410]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:50.562 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:50 smithi002 ceph-mon[32210]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:50.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.562+0000 7f94d7800700 1 -- 172.21.15.2:0/879676747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94d01a7bb0 con 0x7f94d0102740 2024-06-13T11:17:50.563 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:17:50.563 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-13T11:17:50.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.562+0000 7f94cd600700 1 -- 172.21.15.2:0/879676747 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7f94c409c8a0 con 0x7f94d0102740 2024-06-13T11:17:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.565+0000 7f94d7800700 1 -- 172.21.15.2:0/879676747 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f94b80a2ca0 msgr2=0x7f94b80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.565+0000 7f94d7800700 1 --2- 172.21.15.2:0/879676747 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f94b80a2ca0 0x7f94b80a5160 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009750 tx=0x7f94bc009310 comp rx=0 tx=0).stop 2024-06-13T11:17:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.566+0000 7f94d7800700 1 -- 172.21.15.2:0/879676747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d0102740 msgr2=0x7f94d019aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.566+0000 7f94d7800700 1 --2- 172.21.15.2:0/879676747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d0102740 0x7f94d019aeb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f94c400a010 tx=0x7f94c400fa70 comp rx=0 tx=0).stop 2024-06-13T11:17:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.566+0000 7f94d7800700 1 -- 172.21.15.2:0/879676747 shutdown_connections 2024-06-13T11:17:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.566+0000 7f94d7800700 1 --2- 172.21.15.2:0/879676747 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f94b80a2ca0 0x7f94b80a5160 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.566+0000 7f94d7800700 1 --2- 172.21.15.2:0/879676747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d0107840 0x7f94d019f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:50.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.566+0000 7f94d7800700 1 --2- 172.21.15.2:0/879676747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d0102740 0x7f94d019aeb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.566+0000 7f94d7800700 1 --2- 172.21.15.2:0/879676747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94d01030f0 0x7f94d019b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.566+0000 7f94d7800700 1 -- 172.21.15.2:0/879676747 >> 172.21.15.2:0/879676747 conn(0x7f94d00795f0 msgr2=0x7f94d01007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.566+0000 7f94d7800700 1 -- 172.21.15.2:0/879676747 shutdown_connections 2024-06-13T11:17:50.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:50.566+0000 7f94d7800700 1 -- 172.21.15.2:0/879676747 wait complete. 2024-06-13T11:17:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 3 2024-06-13T11:17:50.895 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 11:17:50 smithi002 systemd[1]: Starting Ceph mds.j for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:17:51.539 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:51 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/879676747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:17:51.576 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:51 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/879676747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:17:51.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:51 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/879676747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:17:51.896 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 11:17:51 smithi002 podman[72577]: 2024-06-13 11:17:51.481955037 +0000 UTC m=+0.038783785 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:17:51.896 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 11:17:51 smithi002 podman[72577]: 2024-06-13 11:17:51.601605315 +0000 UTC m=+0.158434088 container create 7ae3480c5f00ec82752c796e30057ac0a7a39660d5908d1aa9c62f1b51a28183 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-j, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-06-13T11:17:51.896 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 11:17:51 smithi002 podman[72577]: 2024-06-13 11:17:51.897495591 +0000 UTC m=+0.454324418 container init 7ae3480c5f00ec82752c796e30057ac0a7a39660d5908d1aa9c62f1b51a28183 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-j, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:17:52.286 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 11:17:51 smithi002 podman[72577]: 2024-06-13 11:17:51.908610017 +0000 UTC m=+0.465438761 container start 7ae3480c5f00ec82752c796e30057ac0a7a39660d5908d1aa9c62f1b51a28183 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-j, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc) 2024-06-13T11:17:52.286 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 11:17:51 smithi002 ceph-mds[72596]: -- 172.21.15.2:0/1532978772 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ace3c01a40 con 0x55ace3bd4800 2024-06-13T11:17:52.286 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 11:17:51 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-j[72592]: starting mds.j at 2024-06-13T11:17:52.286 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 11:17:52 smithi002 bash[72577]: 7ae3480c5f00ec82752c796e30057ac0a7a39660d5908d1aa9c62f1b51a28183 2024-06-13T11:17:52.287 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 11:17:52 smithi002 systemd[1]: Started Ceph mds.j for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:17:52.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:52 smithi077 ceph-mon[36410]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:52.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:52.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:52.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:52.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:17:52.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:17:52.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:52.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:52 smithi002 ceph-mon[32210]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:52.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:52.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:52.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:52.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:17:52.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:17:52.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:52.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:52 smithi178 ceph-mon[36913]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:52.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:52.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:52.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:52.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:17:52.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:17:52.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:53.413 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:17:53.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:53 smithi002 ceph-mon[32210]: Deploying daemon mds.d on smithi002 2024-06-13T11:17:53.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:53 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.2:6834/3486542441,v1:172.21.15.2:6835/3486542441] up:boot 2024-06-13T11:17:53.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:53 smithi002 ceph-mon[32210]: fsmap 3 up:standby 2024-06-13T11:17:53.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:53 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-13T11:17:53.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:53 smithi178 ceph-mon[36913]: Deploying daemon mds.d on smithi002 2024-06-13T11:17:53.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:53 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.2:6834/3486542441,v1:172.21.15.2:6835/3486542441] up:boot 2024-06-13T11:17:53.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:53 smithi178 ceph-mon[36913]: fsmap 3 up:standby 2024-06-13T11:17:53.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:53 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-13T11:17:53.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:53 smithi077 ceph-mon[36410]: Deploying daemon mds.d on smithi002 2024-06-13T11:17:53.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:53 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.2:6834/3486542441,v1:172.21.15.2:6835/3486542441] up:boot 2024-06-13T11:17:53.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:53 smithi077 ceph-mon[36410]: fsmap 3 up:standby 2024-06-13T11:17:53.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:53 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-13T11:17:54.374 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:54 smithi002 ceph-mon[32210]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:17:54.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:54 smithi178 ceph-mon[36913]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:54.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:54 smithi077 ceph-mon[36410]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:55.395 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 11:17:55 smithi002 systemd[1]: Starting Ceph mds.d for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:17:56.146 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 11:17:56 smithi002 podman[72971]: 2024-06-13 11:17:55.939814912 +0000 UTC m=+0.035226270 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:17:56.146 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 11:17:56 smithi002 podman[72971]: 2024-06-13 11:17:56.070572007 +0000 UTC m=+0.165983418 container create e39a0ea6b2a6f0cb72e29cdc773160ffee0d7701531baee6324c0ee83c5b5e80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T11:17:56.568 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 11:17:56 smithi002 podman[72971]: 2024-06-13 11:17:56.426493256 +0000 UTC m=+0.521905008 container init e39a0ea6b2a6f0cb72e29cdc773160ffee0d7701531baee6324c0ee83c5b5e80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-d, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc) 2024-06-13T11:17:56.569 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 11:17:56 smithi002 podman[72971]: 2024-06-13 11:17:56.438817722 +0000 UTC m=+0.534229090 container start e39a0ea6b2a6f0cb72e29cdc773160ffee0d7701531baee6324c0ee83c5b5e80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-d, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240528, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux ) 2024-06-13T11:17:56.569 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 11:17:56 smithi002 ceph-mds[73008]: -- 172.21.15.2:0/230581916 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557371ac1a40 con 0x557371a94c00 2024-06-13T11:17:56.569 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 11:17:56 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-d[73001]: starting mds.d at 2024-06-13T11:17:56.569 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:56 smithi002 ceph-mon[32210]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:56.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:56 smithi178 ceph-mon[36913]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:56.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:56 smithi077 ceph-mon[36410]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:56.869 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 11:17:56 smithi002 bash[72971]: e39a0ea6b2a6f0cb72e29cdc773160ffee0d7701531baee6324c0ee83c5b5e80 2024-06-13T11:17:56.869 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 11:17:56 smithi002 systemd[1]: Started Ceph mds.d for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:17:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.912+0000 7f1d33200700 1 -- 172.21.15.2:0/2954308909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d34102eb0 msgr2=0x7f1d34103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.912+0000 7f1d33200700 1 --2- 172.21.15.2:0/2954308909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d34102eb0 0x7f1d34103330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0099c0 tx=0x7f1d1c009cd0 comp rx=0 tx=0).stop 2024-06-13T11:17:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.912+0000 7f1d33200700 1 -- 172.21.15.2:0/2954308909 shutdown_connections 2024-06-13T11:17:56.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.912+0000 7f1d33200700 1 --2- 172.21.15.2:0/2954308909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d34103870 0x7f1d3410e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.912+0000 7f1d33200700 1 --2- 172.21.15.2:0/2954308909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d341015c0 0x7f1d341019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.912+0000 7f1d33200700 1 --2- 172.21.15.2:0/2954308909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d34102eb0 0x7f1d34103330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.912+0000 7f1d33200700 1 -- 172.21.15.2:0/2954308909 >> 172.21.15.2:0/2954308909 conn(0x7f1d340fcd70 msgr2=0x7f1d340ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.912+0000 7f1d33200700 1 -- 172.21.15.2:0/2954308909 shutdown_connections 2024-06-13T11:17:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.912+0000 7f1d33200700 1 -- 172.21.15.2:0/2954308909 wait complete. 2024-06-13T11:17:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.913+0000 7f1d33200700 1 Processor -- start 2024-06-13T11:17:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.913+0000 7f1d33200700 1 -- start start 2024-06-13T11:17:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d33200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d341015c0 0x7f1d3419ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d33200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d34102eb0 0x7f1d3419b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d33200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d34103870 0x7f1d3419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d33200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1d341116a0 con 0x7f1d34102eb0 2024-06-13T11:17:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d33200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1d34111520 con 0x7f1d341015c0 2024-06-13T11:17:56.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d33200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1d34111820 con 0x7f1d34103870 2024-06-13T11:17:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d31e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d341015c0 0x7f1d3419ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:56.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d31e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d341015c0 0x7f1d3419ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:50972/0 (socket says 172.21.15.2:50972) 2024-06-13T11:17:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d31e00700 1 -- 172.21.15.2:0/3164596122 learned_addr learned my addr 172.21.15.2:0/3164596122 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:17:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d32800700 1 --2- 172.21.15.2:0/3164596122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d34103870 0x7f1d3419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d29400700 1 --2- 172.21.15.2:0/3164596122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d34102eb0 0x7f1d3419b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d31e00700 1 -- 172.21.15.2:0/3164596122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d34103870 msgr2=0x7f1d3419f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d31e00700 1 --2- 172.21.15.2:0/3164596122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d34103870 0x7f1d3419f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d31e00700 1 -- 172.21.15.2:0/3164596122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d34102eb0 msgr2=0x7f1d3419b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d31e00700 1 --2- 172.21.15.2:0/3164596122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d34102eb0 0x7f1d3419b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d31e00700 1 -- 172.21.15.2:0/3164596122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3419fd20 con 0x7f1d341015c0 2024-06-13T11:17:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.914+0000 7f1d32800700 1 --2- 172.21.15.2:0/3164596122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d34103870 0x7f1d3419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:17:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.915+0000 7f1d31e00700 1 --2- 172.21.15.2:0/3164596122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d341015c0 0x7f1d3419ad10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400eb30 tx=0x7f1d2400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:17:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.915+0000 7f1d2b400700 1 -- 172.21.15.2:0/3164596122 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2400cd40 con 0x7f1d341015c0 2024-06-13T11:17:56.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.915+0000 7f1d33200700 1 -- 172.21.15.2:0/3164596122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d341a0010 con 0x7f1d341015c0 2024-06-13T11:17:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.915+0000 7f1d2b400700 1 -- 172.21.15.2:0/3164596122 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d24004500 con 0x7f1d341015c0 2024-06-13T11:17:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.915+0000 7f1d2b400700 1 -- 172.21.15.2:0/3164596122 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d24010690 con 0x7f1d341015c0 2024-06-13T11:17:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.915+0000 7f1d33200700 1 -- 172.21.15.2:0/3164596122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d341a7890 con 0x7f1d341015c0 2024-06-13T11:17:56.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.916+0000 7f1d33200700 1 -- 172.21.15.2:0/3164596122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d34069180 con 0x7f1d341015c0 2024-06-13T11:17:56.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.918+0000 7f1d2b400700 1 -- 172.21.15.2:0/3164596122 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f1d24043ae0 con 0x7f1d341015c0 2024-06-13T11:17:56.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.920+0000 7f1d2b400700 1 --2- 172.21.15.2:0/3164596122 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f1d180a2c20 0x7f1d180a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:17:56.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.920+0000 7f1d2b400700 1 -- 172.21.15.2:0/3164596122 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f1d240cef90 con 0x7f1d341015c0 2024-06-13T11:17:56.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.920+0000 7f1d29400700 1 --2- 172.21.15.2:0/3164596122 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f1d180a2c20 0x7f1d180a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:17:56.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.921+0000 7f1d29400700 1 --2- 172.21.15.2:0/3164596122 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f1d180a2c20 0x7f1d180a50e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1d340ff330 tx=0x7f1d1c005940 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:17:56.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:56.922+0000 7f1d2b400700 1 -- 172.21.15.2:0/3164596122 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1d2409c2f0 con 0x7f1d341015c0 2024-06-13T11:17:57.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:57.202+0000 7f1d33200700 1 -- 172.21.15.2:0/3164596122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d3419c070 con 0x7f1d341015c0 2024-06-13T11:17:57.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:57.202+0000 7f1d2b400700 1 -- 172.21.15.2:0/3164596122 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3043 (secure 0 0 0) 0x7f1d2409bbf0 con 0x7f1d341015c0 2024-06-13T11:17:57.202 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:17:57.202 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-13T11:17:57.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:57.205+0000 7f1d33200700 1 -- 172.21.15.2:0/3164596122 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f1d180a2c20 msgr2=0x7f1d180a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:57.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:57.205+0000 7f1d33200700 1 --2- 172.21.15.2:0/3164596122 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f1d180a2c20 0x7f1d180a50e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1d340ff330 tx=0x7f1d1c005940 comp rx=0 tx=0).stop 2024-06-13T11:17:57.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:57.205+0000 7f1d33200700 1 -- 172.21.15.2:0/3164596122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d341015c0 msgr2=0x7f1d3419ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:17:57.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:57.205+0000 7f1d33200700 1 --2- 172.21.15.2:0/3164596122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d341015c0 0x7f1d3419ad10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400eb30 tx=0x7f1d2400eef0 comp rx=0 tx=0).stop 2024-06-13T11:17:57.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:57.206+0000 7f1d33200700 1 -- 172.21.15.2:0/3164596122 shutdown_connections 2024-06-13T11:17:57.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:57.206+0000 7f1d33200700 1 --2- 172.21.15.2:0/3164596122 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f1d180a2c20 0x7f1d180a50e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:57.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:57.206+0000 7f1d33200700 1 --2- 172.21.15.2:0/3164596122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d34103870 0x7f1d3419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:57.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:57.206+0000 7f1d33200700 1 --2- 172.21.15.2:0/3164596122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d341015c0 0x7f1d3419ad10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:57.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:57.206+0000 7f1d33200700 1 --2- 172.21.15.2:0/3164596122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d34102eb0 0x7f1d3419b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:17:57.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:57.206+0000 7f1d33200700 1 -- 172.21.15.2:0/3164596122 >> 172.21.15.2:0/3164596122 conn(0x7f1d340fcd70 msgr2=0x7f1d3406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:17:57.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:57.206+0000 7f1d33200700 1 -- 172.21.15.2:0/3164596122 shutdown_connections 2024-06-13T11:17:57.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:17:57.206+0000 7f1d33200700 1 -- 172.21.15.2:0/3164596122 wait complete. 2024-06-13T11:17:57.207 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 4 2024-06-13T11:17:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:57 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:57 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:57 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:57 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:17:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:57 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:17:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:57 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:57 smithi002 ceph-mon[32210]: Deploying daemon mds.e on smithi077 2024-06-13T11:17:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:57 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3164596122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:17:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:57 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.2:6836/377791267,v1:172.21.15.2:6837/377791267] up:boot 2024-06-13T11:17:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:57 smithi002 ceph-mon[32210]: fsmap 4 up:standby 2024-06-13T11:17:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:57 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-13T11:17:58.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:57 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:58.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:57 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:58.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:57 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:58.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:57 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:17:58.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:57 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:17:58.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:57 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:58.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:57 smithi077 ceph-mon[36410]: Deploying daemon mds.e on smithi077 2024-06-13T11:17:58.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:57 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3164596122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:17:58.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:57 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.2:6836/377791267,v1:172.21.15.2:6837/377791267] up:boot 2024-06-13T11:17:58.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:57 smithi077 ceph-mon[36410]: fsmap 4 up:standby 2024-06-13T11:17:58.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:57 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-13T11:17:58.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:57 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:58.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:57 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:58.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:57 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:17:58.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:57 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:17:58.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:57 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:17:58.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:57 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:17:58.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:57 smithi178 ceph-mon[36913]: Deploying daemon mds.e on smithi077 2024-06-13T11:17:58.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:57 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3164596122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:17:58.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:57 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.2:6836/377791267,v1:172.21.15.2:6837/377791267] up:boot 2024-06-13T11:17:58.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:57 smithi178 ceph-mon[36913]: fsmap 4 up:standby 2024-06-13T11:17:58.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:57 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-13T11:17:59.034 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:17:58 smithi077 ceph-mon[36410]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:59.035 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:17:59 smithi077 systemd[1]: Starting Ceph mds.e for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:17:59.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:17:58 smithi002 ceph-mon[32210]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:59.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:17:58 smithi178 ceph-mon[36913]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:17:59.526 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:17:59 smithi077 podman[65981]: 2024-06-13 11:17:59.150574471 +0000 UTC m=+0.017166386 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:17:59.526 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:17:59 smithi077 podman[65981]: 2024-06-13 11:17:59.283131906 +0000 UTC m=+0.149723863 container create 283d34fc174fb77a3cf8be8a717332d1cac1fbb4c9c89f33de40119725ef49cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-e, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-13T11:17:59.526 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:17:59 smithi077 podman[65981]: 2024-06-13 11:17:59.527375464 +0000 UTC m=+0.393967379 container init 283d34fc174fb77a3cf8be8a717332d1cac1fbb4c9c89f33de40119725ef49cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc) 2024-06-13T11:17:59.790 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:17:59 smithi077 podman[65981]: 2024-06-13 11:17:59.52992069 +0000 UTC m=+0.396512605 container start 283d34fc174fb77a3cf8be8a717332d1cac1fbb4c9c89f33de40119725ef49cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:17:59.790 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:17:59 smithi077 ceph-mds[66000]: -- 172.21.15.77:0/2124454810 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a59209ba40 con 0x55a59206ec00 2024-06-13T11:17:59.790 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:17:59 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-e[65996]: starting mds.e at 2024-06-13T11:17:59.790 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:17:59 smithi077 bash[65981]: 283d34fc174fb77a3cf8be8a717332d1cac1fbb4c9c89f33de40119725ef49cf 2024-06-13T11:17:59.790 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:17:59 smithi077 systemd[1]: Started Ceph mds.e for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:17:59.984 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:18:00.475 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:18:00.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:00 smithi178 ceph-mon[36913]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:00 smithi178 ceph-mon[36913]: Deploying daemon mds.f on smithi178 2024-06-13T11:18:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:00 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.77:6834/4100836585,v1:172.21.15.77:6835/4100836585] up:boot 2024-06-13T11:18:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:00 smithi178 ceph-mon[36913]: fsmap 5 up:standby 2024-06-13T11:18:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:00 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T11:18:00.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:00 smithi002 ceph-mon[32210]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:00.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:00.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:00.979 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:00.980 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:00.980 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:00.980 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:00.980 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:00 smithi002 ceph-mon[32210]: Deploying daemon mds.f on smithi178 2024-06-13T11:18:00.980 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:00 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.77:6834/4100836585,v1:172.21.15.77:6835/4100836585] up:boot 2024-06-13T11:18:00.980 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:00 smithi002 ceph-mon[32210]: fsmap 5 up:standby 2024-06-13T11:18:00.980 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:00 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T11:18:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:00 smithi077 ceph-mon[36410]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:00 smithi077 ceph-mon[36410]: Deploying daemon mds.f on smithi178 2024-06-13T11:18:01.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:00 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.77:6834/4100836585,v1:172.21.15.77:6835/4100836585] up:boot 2024-06-13T11:18:01.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:00 smithi077 ceph-mon[36410]: fsmap 5 up:standby 2024-06-13T11:18:01.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:00 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T11:18:02.187 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:18:01 smithi178 systemd[1]: Starting Ceph mds.f for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:18:02.447 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:18:02 smithi178 podman[67904]: 2024-06-13 11:18:02.090743173 +0000 UTC m=+0.017321593 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:18:02.447 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:18:02 smithi178 podman[67904]: 2024-06-13 11:18:02.215233081 +0000 UTC m=+0.141811487 container create 12b63918acceb00128fe58d2776c8eb74ba47118b93f05e2cefdd9224a67725a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-06-13T11:18:02.447 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:18:02 smithi178 podman[67904]: 2024-06-13 11:18:02.435055182 +0000 UTC m=+0.361633603 container init 12b63918acceb00128fe58d2776c8eb74ba47118b93f05e2cefdd9224a67725a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-06-13T11:18:02.447 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:18:02 smithi178 podman[67904]: 2024-06-13 11:18:02.437837242 +0000 UTC m=+0.364415650 container start 12b63918acceb00128fe58d2776c8eb74ba47118b93f05e2cefdd9224a67725a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-06-13T11:18:02.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.761+0000 7f2516a00700 1 -- 172.21.15.2:0/2495385587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2510108ac0 msgr2=0x7f2510108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.761+0000 7f2516a00700 1 --2- 172.21.15.2:0/2495385587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2510108ac0 0x7f2510108f40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009990 tx=0x7f24f8009ca0 comp rx=0 tx=0).stop 2024-06-13T11:18:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.761+0000 7f2516a00700 1 -- 172.21.15.2:0/2495385587 shutdown_connections 2024-06-13T11:18:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.761+0000 7f2516a00700 1 --2- 172.21.15.2:0/2495385587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251010eac0 0x7f251010eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.761+0000 7f2516a00700 1 --2- 172.21.15.2:0/2495385587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2510109480 0x7f2510115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.761+0000 7f2516a00700 1 --2- 172.21.15.2:0/2495385587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2510108ac0 0x7f2510108f40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.761+0000 7f2516a00700 1 -- 172.21.15.2:0/2495385587 >> 172.21.15.2:0/2495385587 conn(0x7f2510075c60 msgr2=0x7f25101072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.761+0000 7f2516a00700 1 -- 172.21.15.2:0/2495385587 shutdown_connections 2024-06-13T11:18:02.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.761+0000 7f2516a00700 1 -- 172.21.15.2:0/2495385587 wait complete. 2024-06-13T11:18:02.761 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:02 smithi002 ceph-mon[32210]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:02.762 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:02 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:02.762 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:02 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:02.762 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:02 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:02.762 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:02 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:02.762 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:02 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:02.762 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:02 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:02.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.762+0000 7f2516a00700 1 Processor -- start 2024-06-13T11:18:02.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.763+0000 7f2516a00700 1 -- start start 2024-06-13T11:18:02.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.763+0000 7f2516a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2510108ac0 0x7f251019f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.763+0000 7f2516a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2510109480 0x7f251019f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.763+0000 7f2516a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251010eac0 0x7f25101a3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.763+0000 7f2516a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2510118e40 con 0x7f251010eac0 2024-06-13T11:18:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.763+0000 7f2516a00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2510118cc0 con 0x7f2510108ac0 2024-06-13T11:18:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.763+0000 7f2516a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2510118fc0 con 0x7f2510109480 2024-06-13T11:18:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.763+0000 7f2514a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251010eac0 0x7f25101a3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.764+0000 7f2507400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2510109480 0x7f251019f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.764+0000 7f2507400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2510109480 0x7f251019f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:41542/0 (socket says 172.21.15.2:41542) 2024-06-13T11:18:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.764+0000 7f2514a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251010eac0 0x7f25101a3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59058/0 (socket says 172.21.15.2:59058) 2024-06-13T11:18:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.764+0000 7f2507400700 1 -- 172.21.15.2:0/427695322 learned_addr learned my addr 172.21.15.2:0/427695322 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:18:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.764+0000 7f250fe00700 1 --2- 172.21.15.2:0/427695322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2510108ac0 0x7f251019f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.764+0000 7f2507400700 1 -- 172.21.15.2:0/427695322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2510108ac0 msgr2=0x7f251019f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:02.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.764+0000 7f2507400700 1 --2- 172.21.15.2:0/427695322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2510108ac0 0x7f251019f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:02.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.764+0000 7f2507400700 1 -- 172.21.15.2:0/427695322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251010eac0 msgr2=0x7f25101a3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:02.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.764+0000 7f2507400700 1 --2- 172.21.15.2:0/427695322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251010eac0 0x7f25101a3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:02.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.764+0000 7f2507400700 1 -- 172.21.15.2:0/427695322 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25101a4300 con 0x7f2510109480 2024-06-13T11:18:02.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.764+0000 7f2514a00700 1 --2- 172.21.15.2:0/427695322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251010eac0 0x7f25101a3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:18:02.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.764+0000 7f2507400700 1 --2- 172.21.15.2:0/427695322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2510109480 0x7f251019f830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f24f8005910 tx=0x7f24f800bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:02.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.765+0000 7f250d600700 1 -- 172.21.15.2:0/427695322 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8027070 con 0x7f2510109480 2024-06-13T11:18:02.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.765+0000 7f250d600700 1 -- 172.21.15.2:0/427695322 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24f8004650 con 0x7f2510109480 2024-06-13T11:18:02.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.765+0000 7f2516a00700 1 -- 172.21.15.2:0/427695322 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25101a4590 con 0x7f2510109480 2024-06-13T11:18:02.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.765+0000 7f250d600700 1 -- 172.21.15.2:0/427695322 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f800f460 con 0x7f2510109480 2024-06-13T11:18:02.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.765+0000 7f2516a00700 1 -- 172.21.15.2:0/427695322 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25101abe70 con 0x7f2510109480 2024-06-13T11:18:02.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.766+0000 7f2516a00700 1 -- 172.21.15.2:0/427695322 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2510069180 con 0x7f2510109480 2024-06-13T11:18:02.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.768+0000 7f250d600700 1 -- 172.21.15.2:0/427695322 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f24f802a070 con 0x7f2510109480 2024-06-13T11:18:02.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.770+0000 7f250d600700 1 --2- 172.21.15.2:0/427695322 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f24f40a2ca0 0x7f24f40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:02.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.770+0000 7f250d600700 1 -- 172.21.15.2:0/427695322 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f24f80cff00 con 0x7f2510109480 2024-06-13T11:18:02.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.770+0000 7f250fe00700 1 --2- 172.21.15.2:0/427695322 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f24f40a2ca0 0x7f24f40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:02.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.770+0000 7f250fe00700 1 --2- 172.21.15.2:0/427695322 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f24f40a2ca0 0x7f24f40a5160 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2500009be0 tx=0x7f2500009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:02.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:02.771+0000 7f250d600700 1 -- 172.21.15.2:0/427695322 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f24f8031070 con 0x7f2510109480 2024-06-13T11:18:02.946 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:18:02 smithi178 ceph-mds[67923]: -- 172.21.15.178:0/2560689885 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fa30d35a40 con 0x55fa30d09000 2024-06-13T11:18:02.946 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:18:02 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-f[67919]: starting mds.f at 2024-06-13T11:18:02.947 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:18:02 smithi178 bash[67904]: 12b63918acceb00128fe58d2776c8eb74ba47118b93f05e2cefdd9224a67725a 2024-06-13T11:18:02.947 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:18:02 smithi178 systemd[1]: Started Ceph mds.f for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:18:02.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:02 smithi178 ceph-mon[36913]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:02.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:02 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:02.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:02 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:02.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:02 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:02.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:02 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:02.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:02 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:02.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:02 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:03.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:02 smithi077 ceph-mon[36410]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:03.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:02 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:03.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:02 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:03.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:02 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:03.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:02 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:03.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:02 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:03.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:02 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:03.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:03.049+0000 7f2516a00700 1 -- 172.21.15.2:0/427695322 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f251002dca0 con 0x7f2510109480 2024-06-13T11:18:03.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:03.050+0000 7f250d600700 1 -- 172.21.15.2:0/427695322 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5515 (secure 0 0 0) 0x7f24f8013070 con 0x7f2510109480 2024-06-13T11:18:03.050 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:18:03.050 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-06-13T11:18:03.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:03.054+0000 7f2516a00700 1 -- 172.21.15.2:0/427695322 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f24f40a2ca0 msgr2=0x7f24f40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:03.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:03.054+0000 7f2516a00700 1 --2- 172.21.15.2:0/427695322 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f24f40a2ca0 0x7f24f40a5160 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2500009be0 tx=0x7f2500009260 comp rx=0 tx=0).stop 2024-06-13T11:18:03.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:03.054+0000 7f2516a00700 1 -- 172.21.15.2:0/427695322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2510109480 msgr2=0x7f251019f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:03.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:03.054+0000 7f2516a00700 1 --2- 172.21.15.2:0/427695322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2510109480 0x7f251019f830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f24f8005910 tx=0x7f24f800bab0 comp rx=0 tx=0).stop 2024-06-13T11:18:03.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:03.054+0000 7f2516a00700 1 -- 172.21.15.2:0/427695322 shutdown_connections 2024-06-13T11:18:03.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:03.054+0000 7f2516a00700 1 --2- 172.21.15.2:0/427695322 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f24f40a2ca0 0x7f24f40a5160 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:03.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:03.054+0000 7f2516a00700 1 --2- 172.21.15.2:0/427695322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251010eac0 0x7f25101a3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:03.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:03.054+0000 7f2516a00700 1 --2- 172.21.15.2:0/427695322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2510108ac0 0x7f251019f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:03.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:03.054+0000 7f2516a00700 1 --2- 172.21.15.2:0/427695322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2510109480 0x7f251019f830 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:03.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:03.054+0000 7f2516a00700 1 -- 172.21.15.2:0/427695322 >> 172.21.15.2:0/427695322 conn(0x7f2510075c60 msgr2=0x7f2510076240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:03.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:03.054+0000 7f2516a00700 1 -- 172.21.15.2:0/427695322 shutdown_connections 2024-06-13T11:18:03.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:03.054+0000 7f2516a00700 1 -- 172.21.15.2:0/427695322 wait complete. 2024-06-13T11:18:03.054 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 7 2024-06-13T11:18:03.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:03 smithi178 ceph-mon[36913]: Deploying daemon mds.c on smithi178 2024-06-13T11:18:03.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:03 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.178:6834/2515486418,v1:172.21.15.178:6835/2515486418] up:boot 2024-06-13T11:18:03.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:03 smithi178 ceph-mon[36913]: fsmap 6 up:standby 2024-06-13T11:18:03.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:03 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-13T11:18:03.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:03 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/427695322' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:18:04.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:03 smithi077 ceph-mon[36410]: Deploying daemon mds.c on smithi178 2024-06-13T11:18:04.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:03 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.178:6834/2515486418,v1:172.21.15.178:6835/2515486418] up:boot 2024-06-13T11:18:04.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:03 smithi077 ceph-mon[36410]: fsmap 6 up:standby 2024-06-13T11:18:04.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:03 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-13T11:18:04.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:03 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/427695322' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:18:04.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:03 smithi002 ceph-mon[32210]: Deploying daemon mds.c on smithi178 2024-06-13T11:18:04.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:03 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.178:6834/2515486418,v1:172.21.15.178:6835/2515486418] up:boot 2024-06-13T11:18:04.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:03 smithi002 ceph-mon[32210]: fsmap 6 up:standby 2024-06-13T11:18:04.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:03 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-13T11:18:04.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:03 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/427695322' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:18:04.750 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:04 smithi178 ceph-mon[36913]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:05.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:04 smithi077 ceph-mon[36410]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:05.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:04 smithi002 ceph-mon[32210]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:05.162 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:18:04 smithi178 systemd[1]: Starting Ceph mds.c for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:18:05.425 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:18:05 smithi178 podman[68205]: 2024-06-13 11:18:05.066434689 +0000 UTC m=+0.017215418 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:18:05.425 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:18:05 smithi178 podman[68205]: 2024-06-13 11:18:05.182330797 +0000 UTC m=+0.133111526 container create 12b3c48dd414d5fddbb9954165b43ed00417886751a19ae907f27e4d7457b09a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-c, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=) 2024-06-13T11:18:05.425 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:18:05 smithi178 podman[68205]: 2024-06-13 11:18:05.426702699 +0000 UTC m=+0.377483441 container init 12b3c48dd414d5fddbb9954165b43ed00417886751a19ae907f27e4d7457b09a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-c, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc) 2024-06-13T11:18:05.697 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:18:05 smithi178 podman[68205]: 2024-06-13 11:18:05.429484081 +0000 UTC m=+0.380264809 container start 12b3c48dd414d5fddbb9954165b43ed00417886751a19ae907f27e4d7457b09a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc) 2024-06-13T11:18:05.697 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:18:05 smithi178 ceph-mds[68224]: -- 172.21.15.178:0/1121607970 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5574654e9a40 con 0x5574654bd000 2024-06-13T11:18:05.697 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:18:05 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-c[68220]: starting mds.c at 2024-06-13T11:18:05.697 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:18:05 smithi178 bash[68205]: 12b3c48dd414d5fddbb9954165b43ed00417886751a19ae907f27e4d7457b09a 2024-06-13T11:18:05.697 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:18:05 smithi178 systemd[1]: Started Ceph mds.c for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:18:05.849 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:18:06.319 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:18:06.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:06 smithi002 ceph-mon[32210]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:06.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:06.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:06.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:06.804 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:06.804 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:06.804 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:06.804 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:06 smithi002 ceph-mon[32210]: Deploying daemon mds.h on smithi077 2024-06-13T11:18:06.804 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:06 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] up:boot 2024-06-13T11:18:06.804 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:06 smithi002 ceph-mon[32210]: fsmap 7 up:standby 2024-06-13T11:18:06.804 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:06 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T11:18:06.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:06 smithi178 ceph-mon[36913]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:06.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:06.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:06.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:06.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:06.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:06.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:06.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:06 smithi178 ceph-mon[36913]: Deploying daemon mds.h on smithi077 2024-06-13T11:18:06.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:06 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] up:boot 2024-06-13T11:18:06.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:06 smithi178 ceph-mon[36913]: fsmap 7 up:standby 2024-06-13T11:18:06.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:06 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T11:18:07.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:06 smithi077 ceph-mon[36410]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:07.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:07.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:07.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:07.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:07.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:07.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:07.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:06 smithi077 ceph-mon[36410]: Deploying daemon mds.h on smithi077 2024-06-13T11:18:07.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:06 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] up:boot 2024-06-13T11:18:07.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:06 smithi077 ceph-mon[36410]: fsmap 7 up:standby 2024-06-13T11:18:07.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:06 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T11:18:07.978 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:18:07 smithi077 systemd[1]: Starting Ceph mds.h for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:18:08.238 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:18:07 smithi077 podman[66294]: 2024-06-13 11:18:07.881873977 +0000 UTC m=+0.016975238 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:18:08.238 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:18:07 smithi077 podman[66294]: 2024-06-13 11:18:07.98735253 +0000 UTC m=+0.122453785 container create 509e30ce727e51dca0d7b1c3e92dd022491cec12df694a31c9244d5e4f85755f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-h, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-06-13T11:18:08.238 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:18:08 smithi077 podman[66294]: 2024-06-13 11:18:08.23990749 +0000 UTC m=+0.375008746 container init 509e30ce727e51dca0d7b1c3e92dd022491cec12df694a31c9244d5e4f85755f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-3d89acc) 2024-06-13T11:18:08.540 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:18:08 smithi077 podman[66294]: 2024-06-13 11:18:08.242546771 +0000 UTC m=+0.377648036 container start 509e30ce727e51dca0d7b1c3e92dd022491cec12df694a31c9244d5e4f85755f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-h, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:18:08.540 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:18:08 smithi077 ceph-mds[66315]: -- 172.21.15.77:0/2553430350 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563dff129a40 con 0x563dff0fc800 2024-06-13T11:18:08.540 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:18:08 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-h[66311]: starting mds.h at 2024-06-13T11:18:08.540 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:18:08 smithi077 bash[66294]: 509e30ce727e51dca0d7b1c3e92dd022491cec12df694a31c9244d5e4f85755f 2024-06-13T11:18:08.540 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:18:08 smithi077 systemd[1]: Started Ceph mds.h for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:18:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.555+0000 7f8f9cc00700 1 -- 172.21.15.2:0/11103646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f9810eef0 msgr2=0x7f8f981112e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.555+0000 7f8f9cc00700 1 --2- 172.21.15.2:0/11103646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f9810eef0 0x7f8f981112e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000b0a0 tx=0x7f8f9000b3b0 comp rx=0 tx=0).stop 2024-06-13T11:18:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.555+0000 7f8f9cc00700 1 -- 172.21.15.2:0/11103646 shutdown_connections 2024-06-13T11:18:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.555+0000 7f8f9cc00700 1 --2- 172.21.15.2:0/11103646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f9810eef0 0x7f8f981112e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.555+0000 7f8f9cc00700 1 --2- 172.21.15.2:0/11103646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f980746c0 0x7f8f98074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.555+0000 7f8f9cc00700 1 --2- 172.21.15.2:0/11103646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f98074fe0 0x7f8f9810e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.555+0000 7f8f9cc00700 1 -- 172.21.15.2:0/11103646 >> 172.21.15.2:0/11103646 conn(0x7f8f980795f0 msgr2=0x7f8f98079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.555+0000 7f8f9cc00700 1 -- 172.21.15.2:0/11103646 shutdown_connections 2024-06-13T11:18:08.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.555+0000 7f8f9cc00700 1 -- 172.21.15.2:0/11103646 wait complete. 2024-06-13T11:18:08.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.557+0000 7f8f9cc00700 1 Processor -- start 2024-06-13T11:18:08.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.558+0000 7f8f9cc00700 1 -- start start 2024-06-13T11:18:08.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.558+0000 7f8f9cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f980746c0 0x7f8f9819ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.558+0000 7f8f9cc00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f98074fe0 0x7f8f9819b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.558+0000 7f8f9cc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f9810eef0 0x7f8f9819f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.558+0000 7f8f9cc00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8f981149b0 con 0x7f8f980746c0 2024-06-13T11:18:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.558+0000 7f8f9cc00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8f98114830 con 0x7f8f98074fe0 2024-06-13T11:18:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.558+0000 7f8f9cc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8f98114b30 con 0x7f8f9810eef0 2024-06-13T11:18:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.558+0000 7f8f95e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f980746c0 0x7f8f9819ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.558+0000 7f8f95400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f98074fe0 0x7f8f9819b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.558+0000 7f8f95400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f98074fe0 0x7f8f9819b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:43788/0 (socket says 172.21.15.2:43788) 2024-06-13T11:18:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.558+0000 7f8f95e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f980746c0 0x7f8f9819ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48602/0 (socket says 172.21.15.2:48602) 2024-06-13T11:18:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.559+0000 7f8f95400700 1 -- 172.21.15.2:0/3225861779 learned_addr learned my addr 172.21.15.2:0/3225861779 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:18:08.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.559+0000 7f8f96800700 1 --2- 172.21.15.2:0/3225861779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f9810eef0 0x7f8f9819f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:08.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.559+0000 7f8f95400700 1 -- 172.21.15.2:0/3225861779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f9810eef0 msgr2=0x7f8f9819f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:08.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.559+0000 7f8f95400700 1 --2- 172.21.15.2:0/3225861779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f9810eef0 0x7f8f9819f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:08.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.559+0000 7f8f95400700 1 -- 172.21.15.2:0/3225861779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f980746c0 msgr2=0x7f8f9819ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:08.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.559+0000 7f8f95400700 1 --2- 172.21.15.2:0/3225861779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f980746c0 0x7f8f9819ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:08.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.559+0000 7f8f95400700 1 -- 172.21.15.2:0/3225861779 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9819fd50 con 0x7f8f98074fe0 2024-06-13T11:18:08.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.559+0000 7f8f96800700 1 --2- 172.21.15.2:0/3225861779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f9810eef0 0x7f8f9819f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:18:08.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.559+0000 7f8f95400700 1 --2- 172.21.15.2:0/3225861779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f98074fe0 0x7f8f9819b280 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400e9a0 tx=0x7f8f8400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:08.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.560+0000 7f8f8ea00700 1 -- 172.21.15.2:0/3225861779 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8400ca10 con 0x7f8f98074fe0 2024-06-13T11:18:08.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.560+0000 7f8f9cc00700 1 -- 172.21.15.2:0/3225861779 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f981a0040 con 0x7f8f98074fe0 2024-06-13T11:18:08.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.560+0000 7f8f8ea00700 1 -- 172.21.15.2:0/3225861779 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f8400cbb0 con 0x7f8f98074fe0 2024-06-13T11:18:08.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.560+0000 7f8f8ea00700 1 -- 172.21.15.2:0/3225861779 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84018680 con 0x7f8f98074fe0 2024-06-13T11:18:08.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.560+0000 7f8f9cc00700 1 -- 172.21.15.2:0/3225861779 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f981a78c0 con 0x7f8f98074fe0 2024-06-13T11:18:08.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.561+0000 7f8f9cc00700 1 -- 172.21.15.2:0/3225861779 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f98069180 con 0x7f8f98074fe0 2024-06-13T11:18:08.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.563+0000 7f8f8ea00700 1 -- 172.21.15.2:0/3225861779 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f8f84010430 con 0x7f8f98074fe0 2024-06-13T11:18:08.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.565+0000 7f8f8ea00700 1 --2- 172.21.15.2:0/3225861779 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8f7c0a2c20 0x7f8f7c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:08.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.565+0000 7f8f8ea00700 1 -- 172.21.15.2:0/3225861779 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f8f840cedf0 con 0x7f8f98074fe0 2024-06-13T11:18:08.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.565+0000 7f8f95e00700 1 --2- 172.21.15.2:0/3225861779 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8f7c0a2c20 0x7f8f7c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:08.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.566+0000 7f8f95e00700 1 --2- 172.21.15.2:0/3225861779 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8f7c0a2c20 0x7f8f7c0a50e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8f88007c60 tx=0x7f8f880073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:08.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.569+0000 7f8f8ea00700 1 -- 172.21.15.2:0/3225861779 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8f8409c150 con 0x7f8f98074fe0 2024-06-13T11:18:08.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:08 smithi002 ceph-mon[32210]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:08.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:08 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:08.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:08 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:08.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:08 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:08.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:08 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:08.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:08 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:08.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:08 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:08.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.849+0000 7f8f9cc00700 1 -- 172.21.15.2:0/3225861779 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f981a7ac0 con 0x7f8f98074fe0 2024-06-13T11:18:08.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.851+0000 7f8f8ea00700 1 -- 172.21.15.2:0/3225861779 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7168 (secure 0 0 0) 0x7f8f8409ba50 con 0x7f8f98074fe0 2024-06-13T11:18:08.850 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:18:08.850 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-06-13T11:18:08.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.854+0000 7f8f9cc00700 1 -- 172.21.15.2:0/3225861779 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8f7c0a2c20 msgr2=0x7f8f7c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:08.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.854+0000 7f8f9cc00700 1 --2- 172.21.15.2:0/3225861779 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8f7c0a2c20 0x7f8f7c0a50e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8f88007c60 tx=0x7f8f880073d0 comp rx=0 tx=0).stop 2024-06-13T11:18:08.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.854+0000 7f8f9cc00700 1 -- 172.21.15.2:0/3225861779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f98074fe0 msgr2=0x7f8f9819b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:08.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.854+0000 7f8f9cc00700 1 --2- 172.21.15.2:0/3225861779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f98074fe0 0x7f8f9819b280 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400e9a0 tx=0x7f8f8400ecb0 comp rx=0 tx=0).stop 2024-06-13T11:18:08.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.854+0000 7f8f9cc00700 1 -- 172.21.15.2:0/3225861779 shutdown_connections 2024-06-13T11:18:08.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.855+0000 7f8f9cc00700 1 --2- 172.21.15.2:0/3225861779 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8f7c0a2c20 0x7f8f7c0a50e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:08.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.855+0000 7f8f9cc00700 1 --2- 172.21.15.2:0/3225861779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f980746c0 0x7f8f9819ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:08.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.855+0000 7f8f9cc00700 1 --2- 172.21.15.2:0/3225861779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f9810eef0 0x7f8f9819f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:08.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.855+0000 7f8f9cc00700 1 --2- 172.21.15.2:0/3225861779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f98074fe0 0x7f8f9819b280 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:08.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.855+0000 7f8f9cc00700 1 -- 172.21.15.2:0/3225861779 >> 172.21.15.2:0/3225861779 conn(0x7f8f980795f0 msgr2=0x7f8f980ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:08.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.855+0000 7f8f9cc00700 1 -- 172.21.15.2:0/3225861779 shutdown_connections 2024-06-13T11:18:08.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:08.855+0000 7f8f9cc00700 1 -- 172.21.15.2:0/3225861779 wait complete. 2024-06-13T11:18:08.855 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 9 2024-06-13T11:18:08.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:08 smithi178 ceph-mon[36913]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:08.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:08 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:08.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:08 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:08.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:08 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:08.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:08 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:08.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:08 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:08.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:08 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:09.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:08 smithi077 ceph-mon[36410]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:09.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:08 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:09.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:08 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:09.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:08 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:09.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:08 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:09.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:08 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:09.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:08 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:09.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:09 smithi178 ceph-mon[36913]: Deploying daemon mds.i on smithi178 2024-06-13T11:18:09.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:09 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.77:6836/1628379389,v1:172.21.15.77:6837/1628379389] up:boot 2024-06-13T11:18:09.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:09 smithi178 ceph-mon[36913]: fsmap 8 up:standby 2024-06-13T11:18:09.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:09 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T11:18:09.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:09 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3225861779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:18:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:09 smithi002 ceph-mon[32210]: Deploying daemon mds.i on smithi178 2024-06-13T11:18:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:09 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.77:6836/1628379389,v1:172.21.15.77:6837/1628379389] up:boot 2024-06-13T11:18:09.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:09 smithi002 ceph-mon[32210]: fsmap 8 up:standby 2024-06-13T11:18:09.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:09 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T11:18:09.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:09 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3225861779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:18:10.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:09 smithi077 ceph-mon[36410]: Deploying daemon mds.i on smithi178 2024-06-13T11:18:10.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:09 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.77:6836/1628379389,v1:172.21.15.77:6837/1628379389] up:boot 2024-06-13T11:18:10.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:09 smithi077 ceph-mon[36410]: fsmap 8 up:standby 2024-06-13T11:18:10.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:09 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T11:18:10.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:09 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3225861779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:18:10.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:10 smithi002 ceph-mon[32210]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:10.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:10 smithi178 ceph-mon[36913]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:10.947 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:18:10 smithi178 systemd[1]: Starting Ceph mds.i for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:18:11.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:10 smithi077 ceph-mon[36410]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:11.259 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:18:10 smithi178 podman[68520]: 2024-06-13 11:18:10.871805119 +0000 UTC m=+0.016764868 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:18:11.259 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:18:11 smithi178 podman[68520]: 2024-06-13 11:18:11.000239675 +0000 UTC m=+0.145199483 container create e59a8171a075afe42bdcfc24d5b5903bfccfbc279e124fdcb749b9d5b00976bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, ceph=True) 2024-06-13T11:18:11.259 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:18:11 smithi178 podman[68520]: 2024-06-13 11:18:11.261174024 +0000 UTC m=+0.406133769 container init e59a8171a075afe42bdcfc24d5b5903bfccfbc279e124fdcb749b9d5b00976bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-i, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:18:11.681 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:18:11.696 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:18:11 smithi178 podman[68520]: 2024-06-13 11:18:11.263885944 +0000 UTC m=+0.408845688 container start e59a8171a075afe42bdcfc24d5b5903bfccfbc279e124fdcb749b9d5b00976bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-i, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.build-date=20240528) 2024-06-13T11:18:11.696 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:18:11 smithi178 ceph-mds[68539]: -- 172.21.15.178:0/3453606865 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5557a618ba40 con 0x5557a615ec00 2024-06-13T11:18:11.696 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:18:11 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-i[68535]: starting mds.i at 2024-06-13T11:18:11.697 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:18:11 smithi178 bash[68520]: e59a8171a075afe42bdcfc24d5b5903bfccfbc279e124fdcb749b9d5b00976bc 2024-06-13T11:18:11.697 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:18:11 smithi178 systemd[1]: Started Ceph mds.i for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:18:12.127 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:18:12.612 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:12 smithi002 ceph-mon[32210]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:12.612 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:12.612 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:12.612 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:12.612 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:12.612 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:12.612 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:12.612 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:12 smithi002 ceph-mon[32210]: Deploying daemon mds.g on smithi002 2024-06-13T11:18:12.612 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:12 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] up:boot 2024-06-13T11:18:12.612 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:12 smithi002 ceph-mon[32210]: fsmap 9 up:standby 2024-06-13T11:18:12.612 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:12 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T11:18:12.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:12 smithi178 ceph-mon[36913]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:12.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:12.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:12.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:12.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:12.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:12.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:12.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:12 smithi178 ceph-mon[36913]: Deploying daemon mds.g on smithi002 2024-06-13T11:18:12.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:12 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] up:boot 2024-06-13T11:18:12.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:12 smithi178 ceph-mon[36913]: fsmap 9 up:standby 2024-06-13T11:18:12.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:12 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T11:18:12.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:12 smithi077 ceph-mon[36410]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:12.896 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:12.896 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:12.896 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:12.897 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:12.897 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:12.897 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:12.897 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:12 smithi077 ceph-mon[36410]: Deploying daemon mds.g on smithi002 2024-06-13T11:18:12.897 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:12 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] up:boot 2024-06-13T11:18:12.897 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:12 smithi077 ceph-mon[36410]: fsmap 9 up:standby 2024-06-13T11:18:12.897 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:12 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T11:18:14.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:14 smithi002 ceph-mon[32210]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:14.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:14 smithi178 ceph-mon[36913]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:14.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:14 smithi077 ceph-mon[36410]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.710+0000 7ff0bae00700 1 -- 172.21.15.2:0/1143550037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b4108aa0 msgr2=0x7ff0b4108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.710+0000 7ff0bae00700 1 --2- 172.21.15.2:0/1143550037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b4108aa0 0x7ff0b4108f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff09c009990 tx=0x7ff09c009ca0 comp rx=0 tx=0).stop 2024-06-13T11:18:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.710+0000 7ff0bae00700 1 -- 172.21.15.2:0/1143550037 shutdown_connections 2024-06-13T11:18:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.710+0000 7ff0bae00700 1 --2- 172.21.15.2:0/1143550037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b4109460 0x7ff0b4115970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.710+0000 7ff0bae00700 1 --2- 172.21.15.2:0/1143550037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0b410eaa0 0x7ff0b410ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.710+0000 7ff0bae00700 1 --2- 172.21.15.2:0/1143550037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b4108aa0 0x7ff0b4108f20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.710+0000 7ff0bae00700 1 -- 172.21.15.2:0/1143550037 >> 172.21.15.2:0/1143550037 conn(0x7ff0b4075c60 msgr2=0x7ff0b41072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.710+0000 7ff0bae00700 1 -- 172.21.15.2:0/1143550037 shutdown_connections 2024-06-13T11:18:14.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.710+0000 7ff0bae00700 1 -- 172.21.15.2:0/1143550037 wait complete. 2024-06-13T11:18:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.711+0000 7ff0bae00700 1 Processor -- start 2024-06-13T11:18:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.712+0000 7ff0bae00700 1 -- start start 2024-06-13T11:18:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.712+0000 7ff0bae00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b4108aa0 0x7ff0b419f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.712+0000 7ff0bae00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0b4109460 0x7ff0b419f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.712+0000 7ff0bae00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b410eaa0 0x7ff0b41a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.712+0000 7ff0bae00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b4118e20 con 0x7ff0b410eaa0 2024-06-13T11:18:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.712+0000 7ff0bae00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b4118ca0 con 0x7ff0b4108aa0 2024-06-13T11:18:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.712+0000 7ff0bae00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b4118fa0 con 0x7ff0b4109460 2024-06-13T11:18:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.712+0000 7ff0b8e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b410eaa0 0x7ff0b41a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.712+0000 7ff0b3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b4108aa0 0x7ff0b419f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:14.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.712+0000 7ff0b8e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b410eaa0 0x7ff0b41a3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48612/0 (socket says 172.21.15.2:48612) 2024-06-13T11:18:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.712+0000 7ff0ab400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0b4109460 0x7ff0b419f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.712+0000 7ff0b8e00700 1 -- 172.21.15.2:0/4051681463 learned_addr learned my addr 172.21.15.2:0/4051681463 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:18:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.713+0000 7ff0b3e00700 1 -- 172.21.15.2:0/4051681463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0b4109460 msgr2=0x7ff0b419f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.713+0000 7ff0b3e00700 1 --2- 172.21.15.2:0/4051681463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0b4109460 0x7ff0b419f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.713+0000 7ff0b3e00700 1 -- 172.21.15.2:0/4051681463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b410eaa0 msgr2=0x7ff0b41a3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.713+0000 7ff0b3e00700 1 --2- 172.21.15.2:0/4051681463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b410eaa0 0x7ff0b41a3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.713+0000 7ff0b3e00700 1 -- 172.21.15.2:0/4051681463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b41a4280 con 0x7ff0b4108aa0 2024-06-13T11:18:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.713+0000 7ff0b8e00700 1 --2- 172.21.15.2:0/4051681463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b410eaa0 0x7ff0b41a3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:18:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.713+0000 7ff0b3e00700 1 --2- 172.21.15.2:0/4051681463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b4108aa0 0x7ff0b419f270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400e9f0 tx=0x7ff0a400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.713+0000 7ff0b1600700 1 -- 172.21.15.2:0/4051681463 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a400c9c0 con 0x7ff0b4108aa0 2024-06-13T11:18:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.713+0000 7ff0b1600700 1 -- 172.21.15.2:0/4051681463 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0a400cb60 con 0x7ff0b4108aa0 2024-06-13T11:18:14.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.713+0000 7ff0bae00700 1 -- 172.21.15.2:0/4051681463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b41a4570 con 0x7ff0b4108aa0 2024-06-13T11:18:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.714+0000 7ff0b1600700 1 -- 172.21.15.2:0/4051681463 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4018680 con 0x7ff0b4108aa0 2024-06-13T11:18:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.714+0000 7ff0bae00700 1 -- 172.21.15.2:0/4051681463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b41abdf0 con 0x7ff0b4108aa0 2024-06-13T11:18:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.715+0000 7ff0bae00700 1 -- 172.21.15.2:0/4051681463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b4069180 con 0x7ff0b4108aa0 2024-06-13T11:18:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.717+0000 7ff0b1600700 1 -- 172.21.15.2:0/4051681463 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff0a4010430 con 0x7ff0b4108aa0 2024-06-13T11:18:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.718+0000 7ff0b1600700 1 --2- 172.21.15.2:0/4051681463 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff0980a2c20 0x7ff0980a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.718+0000 7ff0b1600700 1 -- 172.21.15.2:0/4051681463 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7ff0a40ceff0 con 0x7ff0b4108aa0 2024-06-13T11:18:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.718+0000 7ff0ab400700 1 --2- 172.21.15.2:0/4051681463 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff0980a2c20 0x7ff0980a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.719+0000 7ff0ab400700 1 --2- 172.21.15.2:0/4051681463 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff0980a2c20 0x7ff0980a50e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4077ad0 tx=0x7ff09c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:14.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:14.720+0000 7ff0b1600700 1 -- 172.21.15.2:0/4051681463 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff0a409c350 con 0x7ff0b4108aa0 2024-06-13T11:18:15.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:15.002+0000 7ff0bae00700 1 -- 172.21.15.2:0/4051681463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0b402dca0 con 0x7ff0b4108aa0 2024-06-13T11:18:15.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:15.003+0000 7ff0b1600700 1 -- 172.21.15.2:0/4051681463 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+7995 (secure 0 0 0) 0x7ff0a409bc50 con 0x7ff0b4108aa0 2024-06-13T11:18:15.003 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:18:15.003 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24511,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-06-13T11:18:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:15.006+0000 7ff0bae00700 1 -- 172.21.15.2:0/4051681463 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff0980a2c20 msgr2=0x7ff0980a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:15.006+0000 7ff0bae00700 1 --2- 172.21.15.2:0/4051681463 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff0980a2c20 0x7ff0980a50e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4077ad0 tx=0x7ff09c005fd0 comp rx=0 tx=0).stop 2024-06-13T11:18:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:15.006+0000 7ff0bae00700 1 -- 172.21.15.2:0/4051681463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b4108aa0 msgr2=0x7ff0b419f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:15.006+0000 7ff0bae00700 1 --2- 172.21.15.2:0/4051681463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b4108aa0 0x7ff0b419f270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400e9f0 tx=0x7ff0a400ed00 comp rx=0 tx=0).stop 2024-06-13T11:18:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:15.006+0000 7ff0bae00700 1 -- 172.21.15.2:0/4051681463 shutdown_connections 2024-06-13T11:18:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:15.006+0000 7ff0bae00700 1 --2- 172.21.15.2:0/4051681463 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff0980a2c20 0x7ff0980a50e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:15.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:15.006+0000 7ff0bae00700 1 --2- 172.21.15.2:0/4051681463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0b410eaa0 0x7ff0b41a3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:15.006+0000 7ff0bae00700 1 --2- 172.21.15.2:0/4051681463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b4108aa0 0x7ff0b419f270 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:15.006+0000 7ff0bae00700 1 --2- 172.21.15.2:0/4051681463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0b4109460 0x7ff0b419f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:15.006+0000 7ff0bae00700 1 -- 172.21.15.2:0/4051681463 >> 172.21.15.2:0/4051681463 conn(0x7ff0b4075c60 msgr2=0x7ff0b4076180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:15.007+0000 7ff0bae00700 1 -- 172.21.15.2:0/4051681463 shutdown_connections 2024-06-13T11:18:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:15.007+0000 7ff0bae00700 1 -- 172.21.15.2:0/4051681463 wait complete. 2024-06-13T11:18:15.007 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 10 2024-06-13T11:18:15.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:15 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/4051681463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:18:15.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:15 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/4051681463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:18:15.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:15 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/4051681463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:18:16.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:16 smithi178 ceph-mon[36913]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:16.712 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:16 smithi002 ceph-mon[32210]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:16.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:16 smithi077 ceph-mon[36410]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:17.396 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 11:18:17 smithi002 systemd[1]: Starting Ceph mds.g for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:18:17.741 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 11:18:17 smithi002 podman[73810]: 2024-06-13 11:18:17.33042619 +0000 UTC m=+0.040416586 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:18:17.741 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 11:18:17 smithi002 podman[73810]: 2024-06-13 11:18:17.471078332 +0000 UTC m=+0.181068751 container create 2c388cf2f466fd41a3f2f3c78ada8a512be51ebffc12c367b255b0d04c114736 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-g, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-06-13T11:18:17.741 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 11:18:17 smithi002 podman[73810]: 2024-06-13 11:18:17.741740851 +0000 UTC m=+0.451731277 container init 2c388cf2f466fd41a3f2f3c78ada8a512be51ebffc12c367b255b0d04c114736 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-g, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-06-13T11:18:17.898 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:18:18.145 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 11:18:17 smithi002 podman[73810]: 2024-06-13 11:18:17.753041937 +0000 UTC m=+0.463032362 container start 2c388cf2f466fd41a3f2f3c78ada8a512be51ebffc12c367b255b0d04c114736 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-06-13T11:18:18.145 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 11:18:17 smithi002 ceph-mds[73829]: -- 172.21.15.2:0/1666283826 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564e60811a40 con 0x564e607e4800 2024-06-13T11:18:18.145 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 11:18:17 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-g[73825]: starting mds.g at 2024-06-13T11:18:18.146 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 11:18:17 smithi002 bash[73810]: 2c388cf2f466fd41a3f2f3c78ada8a512be51ebffc12c367b255b0d04c114736 2024-06-13T11:18:18.146 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 11:18:17 smithi002 systemd[1]: Started Ceph mds.g for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:18:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:18:18.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:18 smithi178 ceph-mon[36913]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:18.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:18 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:18.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:18 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:18.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:18 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:18.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:18 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:18.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:18 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:18.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:18 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:18.721 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:18 smithi002 ceph-mon[32210]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:18.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:18 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:18.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:18 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:18.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:18 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:18.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:18 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:18.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:18 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:18.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:18 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:18.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:18 smithi077 ceph-mon[36410]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:18.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:18 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:18.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:18 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:18.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:18 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:18.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:18 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:18.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:18 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:18.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:18 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:19.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:19 smithi002 ceph-mon[32210]: Deploying daemon mds.a on smithi002 2024-06-13T11:18:19.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:19 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.2:6838/4035170856,v1:172.21.15.2:6839/4035170856] up:boot 2024-06-13T11:18:19.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:19 smithi002 ceph-mon[32210]: fsmap 10 up:standby 2024-06-13T11:18:19.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:19 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-13T11:18:19.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:19 smithi077 ceph-mon[36410]: Deploying daemon mds.a on smithi002 2024-06-13T11:18:19.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:19 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.2:6838/4035170856,v1:172.21.15.2:6839/4035170856] up:boot 2024-06-13T11:18:19.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:19 smithi077 ceph-mon[36410]: fsmap 10 up:standby 2024-06-13T11:18:19.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:19 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-13T11:18:19.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:19 smithi178 ceph-mon[36913]: Deploying daemon mds.a on smithi002 2024-06-13T11:18:19.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:19 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.2:6838/4035170856,v1:172.21.15.2:6839/4035170856] up:boot 2024-06-13T11:18:19.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:19 smithi178 ceph-mon[36913]: fsmap 10 up:standby 2024-06-13T11:18:19.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:19 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-13T11:18:20.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:20 smithi002 ceph-mon[32210]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:20.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:20 smithi077 ceph-mon[36410]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:20.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:20 smithi178 ceph-mon[36913]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:21.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.291+0000 7fa124a00700 1 -- 172.21.15.2:0/1580839897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa120102fb0 msgr2=0x7fa120107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:21.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.291+0000 7fa124a00700 1 --2- 172.21.15.2:0/1580839897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa120102fb0 0x7fa120107000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa1080098f0 tx=0x7fa108009c00 comp rx=0 tx=0).stop 2024-06-13T11:18:21.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.291+0000 7fa124a00700 1 -- 172.21.15.2:0/1580839897 shutdown_connections 2024-06-13T11:18:21.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.291+0000 7fa124a00700 1 --2- 172.21.15.2:0/1580839897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1201076e0 0x7fa12010f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:21.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.291+0000 7fa124a00700 1 --2- 172.21.15.2:0/1580839897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa120102600 0x7fa1201029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:21.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.291+0000 7fa124a00700 1 --2- 172.21.15.2:0/1580839897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa120102fb0 0x7fa120107000 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:21.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.291+0000 7fa124a00700 1 -- 172.21.15.2:0/1580839897 >> 172.21.15.2:0/1580839897 conn(0x7fa1200fdeb0 msgr2=0x7fa1201002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:21.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.291+0000 7fa124a00700 1 -- 172.21.15.2:0/1580839897 shutdown_connections 2024-06-13T11:18:21.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.291+0000 7fa124a00700 1 -- 172.21.15.2:0/1580839897 wait complete. 2024-06-13T11:18:21.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.292+0000 7fa124a00700 1 Processor -- start 2024-06-13T11:18:21.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.293+0000 7fa124a00700 1 -- start start 2024-06-13T11:18:21.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.293+0000 7fa124a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa120102600 0x7fa12019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:21.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.293+0000 7fa124a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa120102fb0 0x7fa12019eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:21.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.293+0000 7fa124a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1201076e0 0x7fa120198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:21.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.293+0000 7fa124a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa1201126f0 con 0x7fa120102600 2024-06-13T11:18:21.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.293+0000 7fa124a00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa120112570 con 0x7fa120102fb0 2024-06-13T11:18:21.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.293+0000 7fa124a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa120112870 con 0x7fa1201076e0 2024-06-13T11:18:21.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.294+0000 7fa11e800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa120102600 0x7fa12019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:21.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.294+0000 7fa11e800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa120102600 0x7fa12019e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51902/0 (socket says 172.21.15.2:51902) 2024-06-13T11:18:21.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.294+0000 7fa11e800700 1 -- 172.21.15.2:0/810392280 learned_addr learned my addr 172.21.15.2:0/810392280 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:18:21.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.294+0000 7fa115e00700 1 --2- 172.21.15.2:0/810392280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa120102fb0 0x7fa12019eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:21.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.294+0000 7fa11f200700 1 --2- 172.21.15.2:0/810392280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1201076e0 0x7fa120198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:21.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.294+0000 7fa11e800700 1 -- 172.21.15.2:0/810392280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1201076e0 msgr2=0x7fa120198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:21.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.294+0000 7fa11e800700 1 --2- 172.21.15.2:0/810392280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1201076e0 0x7fa120198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:21.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.294+0000 7fa11e800700 1 -- 172.21.15.2:0/810392280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa120102fb0 msgr2=0x7fa12019eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:21.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.294+0000 7fa11e800700 1 --2- 172.21.15.2:0/810392280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa120102fb0 0x7fa12019eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:21.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.294+0000 7fa11e800700 1 -- 172.21.15.2:0/810392280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1201991d0 con 0x7fa120102600 2024-06-13T11:18:21.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.294+0000 7fa115e00700 1 --2- 172.21.15.2:0/810392280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa120102fb0 0x7fa12019eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:18:21.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.294+0000 7fa11e800700 1 --2- 172.21.15.2:0/810392280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa120102600 0x7fa12019e860 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa11000ef10 tx=0x7fa11000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:21.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.295+0000 7fa117e00700 1 -- 172.21.15.2:0/810392280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11000c9b0 con 0x7fa120102600 2024-06-13T11:18:21.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.295+0000 7fa117e00700 1 -- 172.21.15.2:0/810392280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa110019070 con 0x7fa120102600 2024-06-13T11:18:21.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.295+0000 7fa124a00700 1 -- 172.21.15.2:0/810392280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa120199460 con 0x7fa120102600 2024-06-13T11:18:21.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.295+0000 7fa117e00700 1 -- 172.21.15.2:0/810392280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110007e60 con 0x7fa120102600 2024-06-13T11:18:21.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.295+0000 7fa124a00700 1 -- 172.21.15.2:0/810392280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1201a5730 con 0x7fa120102600 2024-06-13T11:18:21.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.296+0000 7fa124a00700 1 -- 172.21.15.2:0/810392280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa120069180 con 0x7fa120102600 2024-06-13T11:18:21.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.298+0000 7fa117e00700 1 -- 172.21.15.2:0/810392280 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fa110012050 con 0x7fa120102600 2024-06-13T11:18:21.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.299+0000 7fa117e00700 1 --2- 172.21.15.2:0/810392280 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fa1040a2c20 0x7fa1040a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:21.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.300+0000 7fa117e00700 1 -- 172.21.15.2:0/810392280 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fa1100ceba0 con 0x7fa120102600 2024-06-13T11:18:21.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.300+0000 7fa115e00700 1 --2- 172.21.15.2:0/810392280 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fa1040a2c20 0x7fa1040a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:21.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.300+0000 7fa115e00700 1 --2- 172.21.15.2:0/810392280 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fa1040a2c20 0x7fa1040a50e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa108009fd0 tx=0x7fa10801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:21.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.305+0000 7fa117e00700 1 -- 172.21.15.2:0/810392280 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa110010040 con 0x7fa120102600 2024-06-13T11:18:21.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.586+0000 7fa124a00700 1 -- 172.21.15.2:0/810392280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa12002dca0 con 0x7fa120102600 2024-06-13T11:18:21.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.588+0000 7fa117e00700 1 -- 172.21.15.2:0/810392280 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8818 (secure 0 0 0) 0x7fa11009bf00 con 0x7fa120102600 2024-06-13T11:18:21.588 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:18:21.588 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24511,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-06-13T11:18:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.591+0000 7fa124a00700 1 -- 172.21.15.2:0/810392280 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fa1040a2c20 msgr2=0x7fa1040a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.591+0000 7fa124a00700 1 --2- 172.21.15.2:0/810392280 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fa1040a2c20 0x7fa1040a50e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa108009fd0 tx=0x7fa10801a040 comp rx=0 tx=0).stop 2024-06-13T11:18:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.591+0000 7fa124a00700 1 -- 172.21.15.2:0/810392280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa120102600 msgr2=0x7fa12019e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.591+0000 7fa124a00700 1 --2- 172.21.15.2:0/810392280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa120102600 0x7fa12019e860 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa11000ef10 tx=0x7fa11000c3a0 comp rx=0 tx=0).stop 2024-06-13T11:18:21.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.592+0000 7fa124a00700 1 -- 172.21.15.2:0/810392280 shutdown_connections 2024-06-13T11:18:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.592+0000 7fa124a00700 1 --2- 172.21.15.2:0/810392280 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fa1040a2c20 0x7fa1040a50e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.592+0000 7fa124a00700 1 --2- 172.21.15.2:0/810392280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa120102600 0x7fa12019e860 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.592+0000 7fa124a00700 1 --2- 172.21.15.2:0/810392280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1201076e0 0x7fa120198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.592+0000 7fa124a00700 1 --2- 172.21.15.2:0/810392280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa120102fb0 0x7fa12019eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.592+0000 7fa124a00700 1 -- 172.21.15.2:0/810392280 >> 172.21.15.2:0/810392280 conn(0x7fa1200fdeb0 msgr2=0x7fa1201001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.592+0000 7fa124a00700 1 -- 172.21.15.2:0/810392280 shutdown_connections 2024-06-13T11:18:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:21.592+0000 7fa124a00700 1 -- 172.21.15.2:0/810392280 wait complete. 2024-06-13T11:18:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 11 2024-06-13T11:18:22.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:22 smithi002 ceph-mon[32210]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:22.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:22 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/810392280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:18:22.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:22 smithi077 ceph-mon[36410]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:22.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:22 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/810392280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:18:22.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:22 smithi178 ceph-mon[36913]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:22.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:22 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/810392280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:18:23.124 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 11:18:22 smithi002 podman[74267]: 2024-06-13 11:18:22.844309219 +0000 UTC m=+0.175447741 container create 544f3bb3be50b431d5558d26c70491f0074de33638311c1f45c9634aa37f8651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528) 2024-06-13T11:18:23.124 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 11:18:23 smithi002 podman[74267]: 2024-06-13 11:18:23.123734352 +0000 UTC m=+0.454872880 container init 544f3bb3be50b431d5558d26c70491f0074de33638311c1f45c9634aa37f8651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-a, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-06-13T11:18:23.396 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 11:18:23 smithi002 podman[74267]: 2024-06-13 11:18:23.135438934 +0000 UTC m=+0.466577430 container start 544f3bb3be50b431d5558d26c70491f0074de33638311c1f45c9634aa37f8651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-06-13T11:18:23.396 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 11:18:23 smithi002 ceph-mds[74285]: -- 172.21.15.2:0/2407618746 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dfa983fa40 con 0x55dfa9812800 2024-06-13T11:18:23.396 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 11:18:23 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-a[74281]: starting mds.a at 2024-06-13T11:18:23.396 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 11:18:23 smithi002 bash[74267]: 544f3bb3be50b431d5558d26c70491f0074de33638311c1f45c9634aa37f8651 2024-06-13T11:18:23.396 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 11:18:23 smithi002 systemd[1]: Started Ceph mds.a for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:18:24.536 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:18:24.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:24 smithi178 ceph-mon[36913]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:24.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:24 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:24.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:24 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:24.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:24 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:24.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:24 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.2:6840/3780644818,v1:172.21.15.2:6841/3780644818] up:boot 2024-06-13T11:18:24.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:24 smithi178 ceph-mon[36913]: fsmap 11 up:standby 2024-06-13T11:18:24.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:24 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-13T11:18:24.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:24 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:24.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:24 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:24.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:24 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:24.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:24 smithi178 ceph-mon[36913]: Deploying daemon mds.b on smithi077 2024-06-13T11:18:24.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:24 smithi077 ceph-mon[36410]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:24.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:24 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:24.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:24 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:24.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:24 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:24.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:24 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.2:6840/3780644818,v1:172.21.15.2:6841/3780644818] up:boot 2024-06-13T11:18:24.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:24 smithi077 ceph-mon[36410]: fsmap 11 up:standby 2024-06-13T11:18:24.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:24 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-13T11:18:24.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:24 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:24.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:24 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:24.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:24 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:24.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:24 smithi077 ceph-mon[36410]: Deploying daemon mds.b on smithi077 2024-06-13T11:18:24.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:24 smithi002 ceph-mon[32210]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:24.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:24 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:24.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:24 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:24.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:24 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:24.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:24 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.2:6840/3780644818,v1:172.21.15.2:6841/3780644818] up:boot 2024-06-13T11:18:24.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:24 smithi002 ceph-mon[32210]: fsmap 11 up:standby 2024-06-13T11:18:24.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:24 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-13T11:18:24.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:24 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T11:18:24.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:24 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T11:18:24.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:24 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:24.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:24 smithi002 ceph-mon[32210]: Deploying daemon mds.b on smithi077 2024-06-13T11:18:25.013 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:18:25.790 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:18:25 smithi077 systemd[1]: Starting Ceph mds.b for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:18:26.151 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:18:25 smithi077 podman[66597]: 2024-06-13 11:18:25.782504614 +0000 UTC m=+0.017377848 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:18:26.152 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:18:25 smithi077 podman[66597]: 2024-06-13 11:18:25.899788402 +0000 UTC m=+0.134661627 container create cb01e210b8eb43ebf9917f1b2738dd03d594d5e28ed580cfa556aff92a50de25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-06-13T11:18:26.152 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:18:26 smithi077 podman[66597]: 2024-06-13 11:18:26.12719916 +0000 UTC m=+0.362072386 container init cb01e210b8eb43ebf9917f1b2738dd03d594d5e28ed580cfa556aff92a50de25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:18:26.152 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:18:26 smithi077 podman[66597]: 2024-06-13 11:18:26.129846808 +0000 UTC m=+0.364720034 container start cb01e210b8eb43ebf9917f1b2738dd03d594d5e28ed580cfa556aff92a50de25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-b, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:18:26.152 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:18:26 smithi077 ceph-mds[66616]: -- 172.21.15.77:0/1082994052 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5604a39cda40 con 0x5604a39a0800 2024-06-13T11:18:26.413 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:18:26 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-b[66612]: starting mds.b at 2024-06-13T11:18:26.414 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:18:26 smithi077 bash[66597]: cb01e210b8eb43ebf9917f1b2738dd03d594d5e28ed580cfa556aff92a50de25 2024-06-13T11:18:26.414 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:18:26 smithi077 systemd[1]: Started Ceph mds.b for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:18:26.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:26 smithi178 ceph-mon[36913]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:26.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:26.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:26.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:26.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:26.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:26 smithi002 ceph-mon[32210]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:26.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:26.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:26.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:26.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:26.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:26 smithi077 ceph-mon[36410]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:26.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:26 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:26.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:26 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:26.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:26 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:26.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:26 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:27.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.205+0000 7fe40bc00700 1 -- 172.21.15.2:0/1292845393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe40410eef0 msgr2=0x7fe4041112e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:27.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.205+0000 7fe40bc00700 1 --2- 172.21.15.2:0/1292845393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe40410eef0 0x7fe4041112e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc009990 tx=0x7fe3fc009ca0 comp rx=0 tx=0).stop 2024-06-13T11:18:27.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.205+0000 7fe40bc00700 1 -- 172.21.15.2:0/1292845393 shutdown_connections 2024-06-13T11:18:27.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.205+0000 7fe40bc00700 1 --2- 172.21.15.2:0/1292845393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4040746c0 0x7fe404074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:27.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.205+0000 7fe40bc00700 1 --2- 172.21.15.2:0/1292845393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe40410eef0 0x7fe4041112e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:27.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.205+0000 7fe40bc00700 1 --2- 172.21.15.2:0/1292845393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe404074fe0 0x7fe40410e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:27.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.205+0000 7fe40bc00700 1 -- 172.21.15.2:0/1292845393 >> 172.21.15.2:0/1292845393 conn(0x7fe4040795f0 msgr2=0x7fe404079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:27.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.205+0000 7fe40bc00700 1 -- 172.21.15.2:0/1292845393 shutdown_connections 2024-06-13T11:18:27.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.205+0000 7fe40bc00700 1 -- 172.21.15.2:0/1292845393 wait complete. 2024-06-13T11:18:27.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.207+0000 7fe40bc00700 1 Processor -- start 2024-06-13T11:18:27.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.207+0000 7fe40bc00700 1 -- start start 2024-06-13T11:18:27.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.207+0000 7fe40bc00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4040746c0 0x7fe40419adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:27.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.207+0000 7fe40bc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe404074fe0 0x7fe40419b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:27.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.207+0000 7fe40bc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe40410eef0 0x7fe40419f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:27.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.207+0000 7fe40bc00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe404114a40 con 0x7fe404074fe0 2024-06-13T11:18:27.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.207+0000 7fe40bc00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe4041148c0 con 0x7fe4040746c0 2024-06-13T11:18:27.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.207+0000 7fe40bc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe404114bc0 con 0x7fe40410eef0 2024-06-13T11:18:27.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.208+0000 7fe409200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4040746c0 0x7fe40419adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:27.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.208+0000 7fe409200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4040746c0 0x7fe40419adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:44828/0 (socket says 172.21.15.2:44828) 2024-06-13T11:18:27.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.208+0000 7fe409200700 1 -- 172.21.15.2:0/986368005 learned_addr learned my addr 172.21.15.2:0/986368005 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:18:27.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.208+0000 7fe409c00700 1 --2- 172.21.15.2:0/986368005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe40410eef0 0x7fe40419f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:27.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.208+0000 7fe403e00700 1 --2- 172.21.15.2:0/986368005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe404074fe0 0x7fe40419b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:27.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.208+0000 7fe409200700 1 -- 172.21.15.2:0/986368005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe40410eef0 msgr2=0x7fe40419f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:27.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.208+0000 7fe409200700 1 --2- 172.21.15.2:0/986368005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe40410eef0 0x7fe40419f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:27.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.208+0000 7fe409200700 1 -- 172.21.15.2:0/986368005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe404074fe0 msgr2=0x7fe40419b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:27.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.208+0000 7fe409200700 1 --2- 172.21.15.2:0/986368005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe404074fe0 0x7fe40419b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:27.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.208+0000 7fe409200700 1 -- 172.21.15.2:0/986368005 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40419fdc0 con 0x7fe4040746c0 2024-06-13T11:18:27.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.208+0000 7fe409c00700 1 --2- 172.21.15.2:0/986368005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe40410eef0 0x7fe40419f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:18:27.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.209+0000 7fe409200700 1 --2- 172.21.15.2:0/986368005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4040746c0 0x7fe40419adb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe3f800ef10 tx=0x7fe3f800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:27.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.209+0000 7fe401600700 1 -- 172.21.15.2:0/986368005 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f800cad0 con 0x7fe4040746c0 2024-06-13T11:18:27.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.209+0000 7fe401600700 1 -- 172.21.15.2:0/986368005 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3f8019070 con 0x7fe4040746c0 2024-06-13T11:18:27.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.209+0000 7fe401600700 1 -- 172.21.15.2:0/986368005 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f80146e0 con 0x7fe4040746c0 2024-06-13T11:18:27.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.209+0000 7fe40bc00700 1 -- 172.21.15.2:0/986368005 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4041a0050 con 0x7fe4040746c0 2024-06-13T11:18:27.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.209+0000 7fe40bc00700 1 -- 172.21.15.2:0/986368005 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4041a7930 con 0x7fe4040746c0 2024-06-13T11:18:27.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.210+0000 7fe40bc00700 1 -- 172.21.15.2:0/986368005 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe404069180 con 0x7fe4040746c0 2024-06-13T11:18:27.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.212+0000 7fe401600700 1 -- 172.21.15.2:0/986368005 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fe3f8012050 con 0x7fe4040746c0 2024-06-13T11:18:27.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.214+0000 7fe401600700 1 --2- 172.21.15.2:0/986368005 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe3ec0a2ca0 0x7fe3ec0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:27.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.214+0000 7fe401600700 1 -- 172.21.15.2:0/986368005 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe3f80cf320 con 0x7fe4040746c0 2024-06-13T11:18:27.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.214+0000 7fe403e00700 1 --2- 172.21.15.2:0/986368005 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe3ec0a2ca0 0x7fe3ec0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:27.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.215+0000 7fe403e00700 1 --2- 172.21.15.2:0/986368005 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe3ec0a2ca0 0x7fe3ec0a5160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe404110b20 tx=0x7fe3f0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.216+0000 7fe401600700 1 -- 172.21.15.2:0/986368005 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe3f8010040 con 0x7fe4040746c0 2024-06-13T11:18:27.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.510+0000 7fe40bc00700 1 -- 172.21.15.2:0/986368005 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe40419c110 con 0x7fe4040746c0 2024-06-13T11:18:27.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.511+0000 7fe401600700 1 -- 172.21.15.2:0/986368005 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10461 (secure 0 0 0) 0x7fe40419c110 con 0x7fe4040746c0 2024-06-13T11:18:27.510 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:18:27.510 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24509,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24511,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-06-13T11:18:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.515+0000 7fe40bc00700 1 -- 172.21.15.2:0/986368005 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe3ec0a2ca0 msgr2=0x7fe3ec0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.515+0000 7fe40bc00700 1 --2- 172.21.15.2:0/986368005 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe3ec0a2ca0 0x7fe3ec0a5160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe404110b20 tx=0x7fe3f0009260 comp rx=0 tx=0).stop 2024-06-13T11:18:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.515+0000 7fe40bc00700 1 -- 172.21.15.2:0/986368005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4040746c0 msgr2=0x7fe40419adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.515+0000 7fe40bc00700 1 --2- 172.21.15.2:0/986368005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4040746c0 0x7fe40419adb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe3f800ef10 tx=0x7fe3f800c3a0 comp rx=0 tx=0).stop 2024-06-13T11:18:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.515+0000 7fe40bc00700 1 -- 172.21.15.2:0/986368005 shutdown_connections 2024-06-13T11:18:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.515+0000 7fe40bc00700 1 --2- 172.21.15.2:0/986368005 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe3ec0a2ca0 0x7fe3ec0a5160 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.515+0000 7fe40bc00700 1 --2- 172.21.15.2:0/986368005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe40410eef0 0x7fe40419f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.515+0000 7fe40bc00700 1 --2- 172.21.15.2:0/986368005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4040746c0 0x7fe40419adb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.515+0000 7fe40bc00700 1 --2- 172.21.15.2:0/986368005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe404074fe0 0x7fe40419b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.515+0000 7fe40bc00700 1 -- 172.21.15.2:0/986368005 >> 172.21.15.2:0/986368005 conn(0x7fe4040795f0 msgr2=0x7fe4040ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.515+0000 7fe40bc00700 1 -- 172.21.15.2:0/986368005 shutdown_connections 2024-06-13T11:18:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:27.515+0000 7fe40bc00700 1 -- 172.21.15.2:0/986368005 wait complete. 2024-06-13T11:18:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 13 2024-06-13T11:18:27.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:27.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:27 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] up:boot 2024-06-13T11:18:27.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:27 smithi178 ceph-mon[36913]: fsmap 12 up:standby 2024-06-13T11:18:27.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T11:18:27.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:18:27.726 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:27.726 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:27 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] up:boot 2024-06-13T11:18:27.726 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:27 smithi077 ceph-mon[36410]: fsmap 12 up:standby 2024-06-13T11:18:27.726 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T11:18:27.727 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:18:27.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:27.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:27 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] up:boot 2024-06-13T11:18:27.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:27 smithi002 ceph-mon[32210]: fsmap 12 up:standby 2024-06-13T11:18:27.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T11:18:27.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:18:28.421 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-06-13T11:18:28.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:28 smithi002 ceph-mon[32210]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:28.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:28 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/986368005' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:18:28.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:28 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:28.609 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:28 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:28.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:28 smithi178 ceph-mon[36913]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:28.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:28 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/986368005' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:18:28.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:28 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:28.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:28 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:28.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:28 smithi077 ceph-mon[36410]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:28.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:28 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/986368005' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:18:28.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:28 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:28.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:28 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:29.222 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:18:29.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:29 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:29.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:29 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:29.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:29 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:29.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:29 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:29.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:29.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:29 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:30.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:30 smithi002 ceph-mon[32210]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:30.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:30 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:30.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:30 smithi077 ceph-mon[36410]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:30.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:30 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:30.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:30 smithi178 ceph-mon[36913]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:30.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:30 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:31.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.511+0000 7f4fdbe00700 1 -- 172.21.15.2:0/4241604689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fdc103ea0 msgr2=0x7f4fdc10c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:31.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.511+0000 7f4fdbe00700 1 --2- 172.21.15.2:0/4241604689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fdc103ea0 0x7f4fdc10c390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009990 tx=0x7f4fc8009ca0 comp rx=0 tx=0).stop 2024-06-13T11:18:31.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.512+0000 7f4fdbe00700 1 -- 172.21.15.2:0/4241604689 shutdown_connections 2024-06-13T11:18:31.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.512+0000 7f4fdbe00700 1 --2- 172.21.15.2:0/4241604689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fdc10c9b0 0x7f4fdc10ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:31.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.512+0000 7f4fdbe00700 1 --2- 172.21.15.2:0/4241604689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fdc103580 0x7f4fdc103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:31.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.512+0000 7f4fdbe00700 1 --2- 172.21.15.2:0/4241604689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fdc103ea0 0x7f4fdc10c390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:31.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.512+0000 7f4fdbe00700 1 -- 172.21.15.2:0/4241604689 >> 172.21.15.2:0/4241604689 conn(0x7f4fdc0fcdb0 msgr2=0x7f4fdc0ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:31.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.512+0000 7f4fdbe00700 1 -- 172.21.15.2:0/4241604689 shutdown_connections 2024-06-13T11:18:31.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.512+0000 7f4fdbe00700 1 -- 172.21.15.2:0/4241604689 wait complete. 2024-06-13T11:18:31.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.513+0000 7f4fdbe00700 1 Processor -- start 2024-06-13T11:18:31.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.513+0000 7f4fdbe00700 1 -- start start 2024-06-13T11:18:31.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.514+0000 7f4fdbe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fdc103580 0x7f4fdc19e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:31.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.514+0000 7f4fdbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fdc103ea0 0x7f4fdc19ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:31.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.514+0000 7f4fdbe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fdc10c9b0 0x7f4fdc198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:31.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.514+0000 7f4fdbe00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc112720 con 0x7f4fdc10c9b0 2024-06-13T11:18:31.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.514+0000 7f4fdbe00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc1125a0 con 0x7f4fdc103580 2024-06-13T11:18:31.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.514+0000 7f4fdbe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc1128a0 con 0x7f4fdc103ea0 2024-06-13T11:18:31.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.515+0000 7f4fda000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fdc103ea0 0x7f4fdc19ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:31.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.515+0000 7f4fda000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fdc103ea0 0x7f4fdc19ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55720/0 (socket says 172.21.15.2:55720) 2024-06-13T11:18:31.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.515+0000 7f4fda000700 1 -- 172.21.15.2:0/3411374080 learned_addr learned my addr 172.21.15.2:0/3411374080 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:18:31.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.515+0000 7f4fdb400700 1 --2- 172.21.15.2:0/3411374080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fdc10c9b0 0x7f4fdc198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:31.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.515+0000 7f4fdaa00700 1 --2- 172.21.15.2:0/3411374080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fdc103580 0x7f4fdc19e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:31.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.515+0000 7f4fda000700 1 -- 172.21.15.2:0/3411374080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fdc103580 msgr2=0x7f4fdc19e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.515+0000 7f4fda000700 1 --2- 172.21.15.2:0/3411374080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fdc103580 0x7f4fdc19e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.515+0000 7f4fda000700 1 -- 172.21.15.2:0/3411374080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fdc10c9b0 msgr2=0x7f4fdc198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.515+0000 7f4fda000700 1 --2- 172.21.15.2:0/3411374080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fdc10c9b0 0x7f4fdc198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.515+0000 7f4fda000700 1 -- 172.21.15.2:0/3411374080 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc199160 con 0x7f4fdc103ea0 2024-06-13T11:18:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.516+0000 7f4fda000700 1 --2- 172.21.15.2:0/3411374080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fdc103ea0 0x7f4fdc19ed80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8000c00 tx=0x7f4fc800bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.516+0000 7f4fd3400700 1 -- 172.21.15.2:0/3411374080 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8003890 con 0x7f4fdc103ea0 2024-06-13T11:18:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.516+0000 7f4fdbe00700 1 -- 172.21.15.2:0/3411374080 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fdc1993f0 con 0x7f4fdc103ea0 2024-06-13T11:18:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.516+0000 7f4fdbe00700 1 -- 172.21.15.2:0/3411374080 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fdc1a5710 con 0x7f4fdc103ea0 2024-06-13T11:18:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.516+0000 7f4fd3400700 1 -- 172.21.15.2:0/3411374080 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fc8005030 con 0x7f4fdc103ea0 2024-06-13T11:18:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.516+0000 7f4fd3400700 1 -- 172.21.15.2:0/3411374080 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8004bc0 con 0x7f4fdc103ea0 2024-06-13T11:18:31.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.518+0000 7f4fdbe00700 1 -- 172.21.15.2:0/3411374080 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fbc005330 con 0x7f4fdc103ea0 2024-06-13T11:18:31.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.519+0000 7f4fd3400700 1 -- 172.21.15.2:0/3411374080 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4fc8009d10 con 0x7f4fdc103ea0 2024-06-13T11:18:31.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.521+0000 7f4fd3400700 1 --2- 172.21.15.2:0/3411374080 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4fc00a2ca0 0x7f4fc00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:31.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.521+0000 7f4fd3400700 1 -- 172.21.15.2:0/3411374080 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f4fc80cf710 con 0x7f4fdc103ea0 2024-06-13T11:18:31.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.521+0000 7f4fdaa00700 1 --2- 172.21.15.2:0/3411374080 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4fc00a2ca0 0x7f4fc00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:31.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.522+0000 7f4fdaa00700 1 --2- 172.21.15.2:0/3411374080 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4fc00a2ca0 0x7f4fc00a5160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc199b40 tx=0x7f4fcc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:31.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.525+0000 7f4fd3400700 1 -- 172.21.15.2:0/3411374080 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4fc8013070 con 0x7f4fdc103ea0 2024-06-13T11:18:31.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.773+0000 7f4fdbe00700 1 -- 172.21.15.2:0/3411374080 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4fbc005620 con 0x7f4fdc103ea0 2024-06-13T11:18:31.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.773+0000 7f4fd3400700 1 -- 172.21.15.2:0/3411374080 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f4fc809cb00 con 0x7f4fdc103ea0 2024-06-13T11:18:31.773 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:18:31.773 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-06-13T11:18:31.773 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:18:31.773 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2024-06-13T11:18:31.773 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2024-06-13T11:18:31.773 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:18:31.773 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-06-13T11:18:31.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.777+0000 7f4fdbe00700 1 -- 172.21.15.2:0/3411374080 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4fc00a2ca0 msgr2=0x7f4fc00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:31.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.777+0000 7f4fdbe00700 1 --2- 172.21.15.2:0/3411374080 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4fc00a2ca0 0x7f4fc00a5160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc199b40 tx=0x7f4fcc009260 comp rx=0 tx=0).stop 2024-06-13T11:18:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.777+0000 7f4fdbe00700 1 -- 172.21.15.2:0/3411374080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fdc103ea0 msgr2=0x7f4fdc19ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.777+0000 7f4fdbe00700 1 --2- 172.21.15.2:0/3411374080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fdc103ea0 0x7f4fdc19ed80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8000c00 tx=0x7f4fc800bab0 comp rx=0 tx=0).stop 2024-06-13T11:18:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.777+0000 7f4fdbe00700 1 -- 172.21.15.2:0/3411374080 shutdown_connections 2024-06-13T11:18:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.777+0000 7f4fdbe00700 1 --2- 172.21.15.2:0/3411374080 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4fc00a2ca0 0x7f4fc00a5160 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.777+0000 7f4fdbe00700 1 --2- 172.21.15.2:0/3411374080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fdc10c9b0 0x7f4fdc198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.777+0000 7f4fdbe00700 1 --2- 172.21.15.2:0/3411374080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fdc103580 0x7f4fdc19e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.777+0000 7f4fdbe00700 1 --2- 172.21.15.2:0/3411374080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fdc103ea0 0x7f4fdc19ed80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.777+0000 7f4fdbe00700 1 -- 172.21.15.2:0/3411374080 >> 172.21.15.2:0/3411374080 conn(0x7f4fdc0fcdb0 msgr2=0x7f4fdc0fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.777+0000 7f4fdbe00700 1 -- 172.21.15.2:0/3411374080 shutdown_connections 2024-06-13T11:18:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:31.777+0000 7f4fdbe00700 1 -- 172.21.15.2:0/3411374080 wait complete. 2024-06-13T11:18:32.642 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-13T11:18:32.642 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-13T11:18:32.696 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:32 smithi002 ceph-mon[32210]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:32.696 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:32 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:32.696 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:32 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:32.697 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:32 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:32.697 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:32 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:18:32.697 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:32 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:32.697 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:32 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3411374080' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-13T11:18:32.697 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:32 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:18:32.932 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:32 smithi178 ceph-mon[36913]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:32.932 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:32 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:32.933 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:32 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:32.933 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:32 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:32.933 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:32 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:18:32.933 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:32 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:32.933 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:32 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3411374080' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-13T11:18:32.933 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:32 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:18:33.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:32 smithi077 ceph-mon[36410]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:33.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:32 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:33.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:32 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:33.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:32 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:33.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:32 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:18:33.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:32 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:33.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:32 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3411374080' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-13T11:18:33.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:32 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:18:33.731 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:18:34.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:34 smithi002 ceph-mon[32210]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:34.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:34.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:34.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:34.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:34 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:34.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:34 smithi077 ceph-mon[36410]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:34.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:34 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:34.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:34 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:34.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:34 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:34.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:34 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:34.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:34 smithi178 ceph-mon[36913]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:34.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:34.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:34.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:34.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:34 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:35.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.956+0000 7f16f8c00700 1 -- 172.21.15.2:0/1422890396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16f410a660 msgr2=0x7f16f410aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:35.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.956+0000 7f16f8c00700 1 --2- 172.21.15.2:0/1422890396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16f410a660 0x7f16f410aa40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009990 tx=0x7f16e4009ca0 comp rx=0 tx=0).stop 2024-06-13T11:18:35.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.956+0000 7f16f8c00700 1 -- 172.21.15.2:0/1422890396 shutdown_connections 2024-06-13T11:18:35.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.956+0000 7f16f8c00700 1 --2- 172.21.15.2:0/1422890396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16f4105020 0x7f16f4111530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:35.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.956+0000 7f16f8c00700 1 --2- 172.21.15.2:0/1422890396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16f410a660 0x7f16f410aa40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:35.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.956+0000 7f16f8c00700 1 --2- 172.21.15.2:0/1422890396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16f4104660 0x7f16f4104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:35.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.956+0000 7f16f8c00700 1 -- 172.21.15.2:0/1422890396 >> 172.21.15.2:0/1422890396 conn(0x7f16f4100130 msgr2=0x7f16f4102550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:35.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.956+0000 7f16f8c00700 1 -- 172.21.15.2:0/1422890396 shutdown_connections 2024-06-13T11:18:35.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.956+0000 7f16f8c00700 1 -- 172.21.15.2:0/1422890396 wait complete. 2024-06-13T11:18:35.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.958+0000 7f16f8c00700 1 Processor -- start 2024-06-13T11:18:35.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.958+0000 7f16f8c00700 1 -- start start 2024-06-13T11:18:35.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.959+0000 7f16f8c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16f4104660 0x7f16f419ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:35.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.959+0000 7f16f8c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16f4105020 0x7f16f419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:35.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.959+0000 7f16f8c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16f410a660 0x7f16f419f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:35.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.959+0000 7f16f8c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f16f41149e0 con 0x7f16f4105020 2024-06-13T11:18:35.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.959+0000 7f16f8c00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f16f4114860 con 0x7f16f410a660 2024-06-13T11:18:35.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.959+0000 7f16f8c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f16f4114b60 con 0x7f16f4104660 2024-06-13T11:18:35.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.959+0000 7f16f1400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16f4105020 0x7f16f419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:35.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.959+0000 7f16f1e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16f4104660 0x7f16f419ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:35.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.959+0000 7f16f1e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16f4104660 0x7f16f419ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55738/0 (socket says 172.21.15.2:55738) 2024-06-13T11:18:35.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.959+0000 7f16f1e00700 1 -- 172.21.15.2:0/3305672934 learned_addr learned my addr 172.21.15.2:0/3305672934 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:18:35.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.959+0000 7f16f2800700 1 --2- 172.21.15.2:0/3305672934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16f410a660 0x7f16f419f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:35.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.960+0000 7f16f1e00700 1 -- 172.21.15.2:0/3305672934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16f410a660 msgr2=0x7f16f419f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:35.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.960+0000 7f16f1e00700 1 --2- 172.21.15.2:0/3305672934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16f410a660 0x7f16f419f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:35.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.960+0000 7f16f1e00700 1 -- 172.21.15.2:0/3305672934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16f4105020 msgr2=0x7f16f419b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:35.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.960+0000 7f16f1e00700 1 --2- 172.21.15.2:0/3305672934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16f4105020 0x7f16f419b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:35.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.960+0000 7f16f1e00700 1 -- 172.21.15.2:0/3305672934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f419fe10 con 0x7f16f4104660 2024-06-13T11:18:35.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.960+0000 7f16f1400700 1 --2- 172.21.15.2:0/3305672934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16f4105020 0x7f16f419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:18:35.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.960+0000 7f16f1e00700 1 --2- 172.21.15.2:0/3305672934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16f4104660 0x7f16f419ae50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f16e4000c00 tx=0x7f16e400bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:35.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.961+0000 7f16eaa00700 1 -- 172.21.15.2:0/3305672934 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4027070 con 0x7f16f4104660 2024-06-13T11:18:35.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.961+0000 7f16f8c00700 1 -- 172.21.15.2:0/3305672934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f41a00a0 con 0x7f16f4104660 2024-06-13T11:18:35.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.961+0000 7f16eaa00700 1 -- 172.21.15.2:0/3305672934 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16e40056d0 con 0x7f16f4104660 2024-06-13T11:18:35.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.961+0000 7f16eaa00700 1 -- 172.21.15.2:0/3305672934 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4022e10 con 0x7f16f4104660 2024-06-13T11:18:35.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.961+0000 7f16f8c00700 1 -- 172.21.15.2:0/3305672934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f41a7980 con 0x7f16f4104660 2024-06-13T11:18:35.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.962+0000 7f16f8c00700 1 -- 172.21.15.2:0/3305672934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f4105da0 con 0x7f16f4104660 2024-06-13T11:18:35.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.964+0000 7f16eaa00700 1 -- 172.21.15.2:0/3305672934 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f16e402a070 con 0x7f16f4104660 2024-06-13T11:18:35.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.965+0000 7f16eaa00700 1 --2- 172.21.15.2:0/3305672934 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f16d80a2c20 0x7f16d80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:35.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.965+0000 7f16eaa00700 1 -- 172.21.15.2:0/3305672934 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f16e40cf850 con 0x7f16f4104660 2024-06-13T11:18:35.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.966+0000 7f16f1400700 1 --2- 172.21.15.2:0/3305672934 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f16d80a2c20 0x7f16d80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:35.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.966+0000 7f16f1400700 1 --2- 172.21.15.2:0/3305672934 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f16d80a2c20 0x7f16d80a50e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009680 tx=0x7f16e0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:35.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:35.969+0000 7f16eaa00700 1 -- 172.21.15.2:0/3305672934 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f16e4013070 con 0x7f16f4104660 2024-06-13T11:18:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:36.230+0000 7f16f8c00700 1 -- 172.21.15.2:0/3305672934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f16f402dca0 con 0x7f16f4104660 2024-06-13T11:18:37.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:36 smithi077 ceph-mon[36410]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:37.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:37.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:37.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:37.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:18:37.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:36 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:37.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:36 smithi002 ceph-mon[32210]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:37.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:37.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:37.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:37.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:18:37.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:36 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:37.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:37.148+0000 7f16eaa00700 1 -- 172.21.15.2:0/3305672934 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7f16e409cc40 con 0x7f16f4104660 2024-06-13T11:18:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:37.156+0000 7f16f8c00700 1 -- 172.21.15.2:0/3305672934 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f16d80a2c20 msgr2=0x7f16d80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:37.157+0000 7f16f8c00700 1 --2- 172.21.15.2:0/3305672934 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f16d80a2c20 0x7f16d80a50e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009680 tx=0x7f16e0009260 comp rx=0 tx=0).stop 2024-06-13T11:18:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:37.157+0000 7f16f8c00700 1 -- 172.21.15.2:0/3305672934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16f4104660 msgr2=0x7f16f419ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:37.157+0000 7f16f8c00700 1 --2- 172.21.15.2:0/3305672934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16f4104660 0x7f16f419ae50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f16e4000c00 tx=0x7f16e400bab0 comp rx=0 tx=0).stop 2024-06-13T11:18:37.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:37.158+0000 7f16f8c00700 1 -- 172.21.15.2:0/3305672934 shutdown_connections 2024-06-13T11:18:37.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:37.158+0000 7f16f8c00700 1 --2- 172.21.15.2:0/3305672934 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f16d80a2c20 0x7f16d80a50e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:37.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:37.158+0000 7f16f8c00700 1 --2- 172.21.15.2:0/3305672934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16f410a660 0x7f16f419f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:37.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:37.158+0000 7f16f8c00700 1 --2- 172.21.15.2:0/3305672934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16f4104660 0x7f16f419ae50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:37.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:37.158+0000 7f16f8c00700 1 --2- 172.21.15.2:0/3305672934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16f4105020 0x7f16f419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:37.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:37.158+0000 7f16f8c00700 1 -- 172.21.15.2:0/3305672934 >> 172.21.15.2:0/3305672934 conn(0x7f16f4100130 msgr2=0x7f16f4100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:37.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:37.160+0000 7f16f8c00700 1 -- 172.21.15.2:0/3305672934 shutdown_connections 2024-06-13T11:18:37.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:37.160+0000 7f16f8c00700 1 -- 172.21.15.2:0/3305672934 wait complete. 2024-06-13T11:18:37.163 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2024-06-13T11:18:37.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:36 smithi178 ceph-mon[36913]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:37.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:37.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:37.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:18:37.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:18:37.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:36 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:18:37.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:37 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3305672934' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-13T11:18:37.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:37 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-13T11:18:37.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:37 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-13T11:18:37.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:37 smithi002 ceph-mon[32210]: osdmap e82: 12 total, 12 up, 12 in 2024-06-13T11:18:38.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:37 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3305672934' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-13T11:18:38.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:37 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-13T11:18:38.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:37 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-13T11:18:38.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:37 smithi077 ceph-mon[36410]: osdmap e82: 12 total, 12 up, 12 in 2024-06-13T11:18:38.098 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:37 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3305672934' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-13T11:18:38.098 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:37 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-13T11:18:38.098 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:37 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-13T11:18:38.098 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:37 smithi178 ceph-mon[36913]: osdmap e82: 12 total, 12 up, 12 in 2024-06-13T11:18:38.117 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-06-13T11:18:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:18:39.092 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:38 smithi002 ceph-mon[32210]: pgmap v318: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:39.092 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:38 smithi002 ceph-mon[32210]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T11:18:39.092 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:38 smithi002 ceph-mon[32210]: osdmap e83: 12 total, 12 up, 12 in 2024-06-13T11:18:39.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:38 smithi178 ceph-mon[36913]: pgmap v318: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:39.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:38 smithi178 ceph-mon[36913]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T11:18:39.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:38 smithi178 ceph-mon[36913]: osdmap e83: 12 total, 12 up, 12 in 2024-06-13T11:18:39.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:38 smithi077 ceph-mon[36410]: pgmap v318: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:39.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:38 smithi077 ceph-mon[36410]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T11:18:39.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:38 smithi077 ceph-mon[36410]: osdmap e83: 12 total, 12 up, 12 in 2024-06-13T11:18:40.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:40 smithi002 ceph-mon[32210]: osdmap e84: 12 total, 12 up, 12 in 2024-06-13T11:18:40.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:40 smithi002 ceph-mon[32210]: pgmap v321: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:40.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:40 smithi178 ceph-mon[36913]: osdmap e84: 12 total, 12 up, 12 in 2024-06-13T11:18:40.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:40 smithi178 ceph-mon[36913]: pgmap v321: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:40.539 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:40 smithi077 ceph-mon[36410]: osdmap e84: 12 total, 12 up, 12 in 2024-06-13T11:18:40.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:40 smithi077 ceph-mon[36410]: pgmap v321: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:41.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.020+0000 7f7f2cc00700 1 -- 172.21.15.2:0/837398430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f28102f00 msgr2=0x7f7f2810f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:41.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.020+0000 7f7f2cc00700 1 --2- 172.21.15.2:0/837398430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f28102f00 0x7f7f2810f390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f200098f0 tx=0x7f7f20009c00 comp rx=0 tx=0).stop 2024-06-13T11:18:41.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.020+0000 7f7f2cc00700 1 -- 172.21.15.2:0/837398430 shutdown_connections 2024-06-13T11:18:41.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.020+0000 7f7f2cc00700 1 --2- 172.21.15.2:0/837398430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f281085c0 0x7f7f281089a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:41.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.020+0000 7f7f2cc00700 1 --2- 172.21.15.2:0/837398430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f28102f00 0x7f7f2810f390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.020+0000 7f7f2cc00700 1 --2- 172.21.15.2:0/837398430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f28102540 0x7f7f281029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.020+0000 7f7f2cc00700 1 -- 172.21.15.2:0/837398430 >> 172.21.15.2:0/837398430 conn(0x7f7f280795e0 msgr2=0x7f7f280799f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.020+0000 7f7f2cc00700 1 -- 172.21.15.2:0/837398430 shutdown_connections 2024-06-13T11:18:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.020+0000 7f7f2cc00700 1 -- 172.21.15.2:0/837398430 wait complete. 2024-06-13T11:18:41.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.021+0000 7f7f2cc00700 1 Processor -- start 2024-06-13T11:18:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.022+0000 7f7f2cc00700 1 -- start start 2024-06-13T11:18:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.022+0000 7f7f2cc00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f28102540 0x7f7f2819e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.022+0000 7f7f2cc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f28102f00 0x7f7f2819edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.022+0000 7f7f2cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f281085c0 0x7f7f28198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.022+0000 7f7f2cc00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7f28112850 con 0x7f7f281085c0 2024-06-13T11:18:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.022+0000 7f7f2cc00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f281126d0 con 0x7f7f28102540 2024-06-13T11:18:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.022+0000 7f7f2cc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7f281129d0 con 0x7f7f28102f00 2024-06-13T11:18:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.022+0000 7f7f25e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f28102540 0x7f7f2819e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.022+0000 7f7f26800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f281085c0 0x7f7f28198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.022+0000 7f7f25e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f28102540 0x7f7f2819e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:45242/0 (socket says 172.21.15.2:45242) 2024-06-13T11:18:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.022+0000 7f7f25e00700 1 -- 172.21.15.2:0/2612473401 learned_addr learned my addr 172.21.15.2:0/2612473401 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:18:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.022+0000 7f7f25400700 1 --2- 172.21.15.2:0/2612473401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f28102f00 0x7f7f2819edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.023+0000 7f7f25400700 1 -- 172.21.15.2:0/2612473401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f28102540 msgr2=0x7f7f2819e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.023+0000 7f7f25400700 1 --2- 172.21.15.2:0/2612473401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f28102540 0x7f7f2819e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.023+0000 7f7f25400700 1 -- 172.21.15.2:0/2612473401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f281085c0 msgr2=0x7f7f28198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.023+0000 7f7f25400700 1 --2- 172.21.15.2:0/2612473401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f281085c0 0x7f7f28198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.023+0000 7f7f25400700 1 -- 172.21.15.2:0/2612473401 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f281991b0 con 0x7f7f28102f00 2024-06-13T11:18:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.023+0000 7f7f25e00700 1 --2- 172.21.15.2:0/2612473401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f28102540 0x7f7f2819e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:18:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.023+0000 7f7f25400700 1 --2- 172.21.15.2:0/2612473401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f28102f00 0x7f7f2819edd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400e9f0 tx=0x7f7f1400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.023+0000 7f7f1ea00700 1 -- 172.21.15.2:0/2612473401 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f14004220 con 0x7f7f28102f00 2024-06-13T11:18:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.024+0000 7f7f1ea00700 1 -- 172.21.15.2:0/2612473401 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f14004d10 con 0x7f7f28102f00 2024-06-13T11:18:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.024+0000 7f7f2cc00700 1 -- 172.21.15.2:0/2612473401 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f281994a0 con 0x7f7f28102f00 2024-06-13T11:18:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.024+0000 7f7f1ea00700 1 -- 172.21.15.2:0/2612473401 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f14005020 con 0x7f7f28102f00 2024-06-13T11:18:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.024+0000 7f7f2cc00700 1 -- 172.21.15.2:0/2612473401 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f281a5760 con 0x7f7f28102f00 2024-06-13T11:18:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.025+0000 7f7f2cc00700 1 -- 172.21.15.2:0/2612473401 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f28103c30 con 0x7f7f28102f00 2024-06-13T11:18:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.028+0000 7f7f1ea00700 1 -- 172.21.15.2:0/2612473401 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f7f14042ae0 con 0x7f7f28102f00 2024-06-13T11:18:41.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.029+0000 7f7f1ea00700 1 --2- 172.21.15.2:0/2612473401 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7f0c0a2ca0 0x7f7f0c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:41.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.029+0000 7f7f1ea00700 1 -- 172.21.15.2:0/2612473401 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7497+0+0 (secure 0 0 0) 0x7f7f140cebb0 con 0x7f7f28102f00 2024-06-13T11:18:41.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.029+0000 7f7f25e00700 1 --2- 172.21.15.2:0/2612473401 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7f0c0a2ca0 0x7f7f0c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.030+0000 7f7f25e00700 1 --2- 172.21.15.2:0/2612473401 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7f0c0a2ca0 0x7f7f0c0a5160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009fd0 tx=0x7f7f1800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.031+0000 7f7f1ea00700 1 -- 172.21.15.2:0/2612473401 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7f1400f3c0 con 0x7f7f28102f00 2024-06-13T11:18:41.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.264+0000 7f7f2cc00700 1 -- 172.21.15.2:0/2612473401 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f7f28199f80 con 0x7f7f28102f00 2024-06-13T11:18:41.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.884+0000 7f7f1ea00700 1 -- 172.21.15.2:0/2612473401 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v85) ==== 171+0+0 (secure 0 0 0) 0x7f7f140043c0 con 0x7f7f28102f00 2024-06-13T11:18:41.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.890+0000 7f7f2cc00700 1 -- 172.21.15.2:0/2612473401 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7f0c0a2ca0 msgr2=0x7f7f0c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:41.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.890+0000 7f7f2cc00700 1 --2- 172.21.15.2:0/2612473401 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7f0c0a2ca0 0x7f7f0c0a5160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009fd0 tx=0x7f7f1800b040 comp rx=0 tx=0).stop 2024-06-13T11:18:41.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.890+0000 7f7f2cc00700 1 -- 172.21.15.2:0/2612473401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f28102f00 msgr2=0x7f7f2819edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:41.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.890+0000 7f7f2cc00700 1 --2- 172.21.15.2:0/2612473401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f28102f00 0x7f7f2819edd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400e9f0 tx=0x7f7f1400ed00 comp rx=0 tx=0).stop 2024-06-13T11:18:41.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.891+0000 7f7f2cc00700 1 -- 172.21.15.2:0/2612473401 shutdown_connections 2024-06-13T11:18:41.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.891+0000 7f7f2cc00700 1 --2- 172.21.15.2:0/2612473401 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7f0c0a2ca0 0x7f7f0c0a5160 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:41.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.891+0000 7f7f2cc00700 1 --2- 172.21.15.2:0/2612473401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f281085c0 0x7f7f28198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:41.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.891+0000 7f7f2cc00700 1 --2- 172.21.15.2:0/2612473401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f28102540 0x7f7f2819e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:41.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.891+0000 7f7f2cc00700 1 --2- 172.21.15.2:0/2612473401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f28102f00 0x7f7f2819edd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:41.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.891+0000 7f7f2cc00700 1 -- 172.21.15.2:0/2612473401 >> 172.21.15.2:0/2612473401 conn(0x7f7f280795e0 msgr2=0x7f7f28100ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:41.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.893+0000 7f7f2cc00700 1 -- 172.21.15.2:0/2612473401 shutdown_connections 2024-06-13T11:18:41.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:41.893+0000 7f7f2cc00700 1 -- 172.21.15.2:0/2612473401 wait complete. 2024-06-13T11:18:41.897 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2024-06-13T11:18:42.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:41 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2612473401' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-13T11:18:42.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:41 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-13T11:18:42.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:41 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2612473401' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-13T11:18:42.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:41 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-13T11:18:42.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:41 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2612473401' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-13T11:18:42.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:41 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-13T11:18:42.804 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-13T11:18:43.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:42 smithi002 ceph-mon[32210]: pgmap v322: 33 pgs: 6 creating+peering, 18 active+clean, 9 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:43.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:42 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-06-13T11:18:43.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:42 smithi002 ceph-mon[32210]: osdmap e85: 12 total, 12 up, 12 in 2024-06-13T11:18:43.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:42 smithi002 ceph-mon[32210]: osdmap e86: 12 total, 12 up, 12 in 2024-06-13T11:18:43.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:42 smithi178 ceph-mon[36913]: pgmap v322: 33 pgs: 6 creating+peering, 18 active+clean, 9 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:43.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:42 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-06-13T11:18:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:42 smithi178 ceph-mon[36913]: osdmap e85: 12 total, 12 up, 12 in 2024-06-13T11:18:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:42 smithi178 ceph-mon[36913]: osdmap e86: 12 total, 12 up, 12 in 2024-06-13T11:18:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:42 smithi077 ceph-mon[36410]: pgmap v322: 33 pgs: 6 creating+peering, 18 active+clean, 9 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:42 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-06-13T11:18:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:42 smithi077 ceph-mon[36410]: osdmap e85: 12 total, 12 up, 12 in 2024-06-13T11:18:43.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:42 smithi077 ceph-mon[36410]: osdmap e86: 12 total, 12 up, 12 in 2024-06-13T11:18:43.292 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:18:45.126 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:44 smithi002 ceph-mon[32210]: pgmap v325: 97 pgs: 14 creating+peering, 37 active+clean, 46 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:45.127 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:44 smithi002 ceph-mon[32210]: osdmap e87: 12 total, 12 up, 12 in 2024-06-13T11:18:45.127 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:44 smithi002 ceph-mon[32210]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T11:18:45.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:44 smithi178 ceph-mon[36913]: pgmap v325: 97 pgs: 14 creating+peering, 37 active+clean, 46 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:44 smithi178 ceph-mon[36913]: osdmap e87: 12 total, 12 up, 12 in 2024-06-13T11:18:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:44 smithi178 ceph-mon[36913]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T11:18:45.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:44 smithi077 ceph-mon[36410]: pgmap v325: 97 pgs: 14 creating+peering, 37 active+clean, 46 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:45.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:44 smithi077 ceph-mon[36410]: osdmap e87: 12 total, 12 up, 12 in 2024-06-13T11:18:45.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:44 smithi077 ceph-mon[36410]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T11:18:45.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.647+0000 7fb025200700 1 -- 172.21.15.2:0/2620832061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb020108ac0 msgr2=0x7fb020108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:45.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.647+0000 7fb025200700 1 --2- 172.21.15.2:0/2620832061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb020108ac0 0x7fb020108f40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0098f0 tx=0x7fb00c009c00 comp rx=0 tx=0).stop 2024-06-13T11:18:45.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.647+0000 7fb025200700 1 -- 172.21.15.2:0/2620832061 shutdown_connections 2024-06-13T11:18:45.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.647+0000 7fb025200700 1 --2- 172.21.15.2:0/2620832061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb020109480 0x7fb020115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:45.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.647+0000 7fb025200700 1 --2- 172.21.15.2:0/2620832061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb02010eac0 0x7fb02010eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:45.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.647+0000 7fb025200700 1 --2- 172.21.15.2:0/2620832061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb020108ac0 0x7fb020108f40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:45.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.647+0000 7fb025200700 1 -- 172.21.15.2:0/2620832061 >> 172.21.15.2:0/2620832061 conn(0x7fb020075c60 msgr2=0x7fb0201072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:45.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.647+0000 7fb025200700 1 -- 172.21.15.2:0/2620832061 shutdown_connections 2024-06-13T11:18:45.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.647+0000 7fb025200700 1 -- 172.21.15.2:0/2620832061 wait complete. 2024-06-13T11:18:45.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.649+0000 7fb025200700 1 Processor -- start 2024-06-13T11:18:45.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.649+0000 7fb025200700 1 -- start start 2024-06-13T11:18:45.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.649+0000 7fb025200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb020108ac0 0x7fb02019f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:45.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.649+0000 7fb025200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb020109480 0x7fb02019f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:45.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.649+0000 7fb025200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb02010eac0 0x7fb0201a3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:45.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.649+0000 7fb025200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb020118ea0 con 0x7fb02010eac0 2024-06-13T11:18:45.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.649+0000 7fb025200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb020118d20 con 0x7fb020109480 2024-06-13T11:18:45.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.649+0000 7fb025200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb020119020 con 0x7fb020108ac0 2024-06-13T11:18:45.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.650+0000 7fb01de00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb020108ac0 0x7fb02019f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:45.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.650+0000 7fb01de00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb020108ac0 0x7fb02019f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:51098/0 (socket says 172.21.15.2:51098) 2024-06-13T11:18:45.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.650+0000 7fb01de00700 1 -- 172.21.15.2:0/2709931209 learned_addr learned my addr 172.21.15.2:0/2709931209 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:18:45.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.650+0000 7fb01d400700 1 --2- 172.21.15.2:0/2709931209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb020109480 0x7fb02019f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:45.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.650+0000 7fb01e800700 1 --2- 172.21.15.2:0/2709931209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb02010eac0 0x7fb0201a3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:45.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.650+0000 7fb01de00700 1 -- 172.21.15.2:0/2709931209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb020109480 msgr2=0x7fb02019f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:45.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.650+0000 7fb01de00700 1 --2- 172.21.15.2:0/2709931209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb020109480 0x7fb02019f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:45.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.650+0000 7fb01de00700 1 -- 172.21.15.2:0/2709931209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb02010eac0 msgr2=0x7fb0201a3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:45.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.650+0000 7fb01de00700 1 --2- 172.21.15.2:0/2709931209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb02010eac0 0x7fb0201a3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:45.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.650+0000 7fb01de00700 1 -- 172.21.15.2:0/2709931209 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0201a4320 con 0x7fb020108ac0 2024-06-13T11:18:45.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.650+0000 7fb01d400700 1 --2- 172.21.15.2:0/2709931209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb020109480 0x7fb02019f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:18:45.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.650+0000 7fb01de00700 1 --2- 172.21.15.2:0/2709931209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb020108ac0 0x7fb02019f310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb01000e9c0 tx=0x7fb01000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:45.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.651+0000 7fb016a00700 1 -- 172.21.15.2:0/2709931209 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01000cbd0 con 0x7fb020108ac0 2024-06-13T11:18:45.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.651+0000 7fb025200700 1 -- 172.21.15.2:0/2709931209 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0201a4610 con 0x7fb020108ac0 2024-06-13T11:18:45.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.651+0000 7fb016a00700 1 -- 172.21.15.2:0/2709931209 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb01000ee60 con 0x7fb020108ac0 2024-06-13T11:18:45.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.651+0000 7fb016a00700 1 -- 172.21.15.2:0/2709931209 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010005630 con 0x7fb020108ac0 2024-06-13T11:18:45.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.651+0000 7fb025200700 1 -- 172.21.15.2:0/2709931209 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0201abe90 con 0x7fb020108ac0 2024-06-13T11:18:45.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.652+0000 7fb025200700 1 -- 172.21.15.2:0/2709931209 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb020069180 con 0x7fb020108ac0 2024-06-13T11:18:45.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.654+0000 7fb016a00700 1 -- 172.21.15.2:0/2709931209 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fb010004750 con 0x7fb020108ac0 2024-06-13T11:18:45.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.655+0000 7fb016a00700 1 --2- 172.21.15.2:0/2709931209 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb0040a2ca0 0x7fb0040a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:45.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.656+0000 7fb016a00700 1 -- 172.21.15.2:0/2709931209 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 7879+0+0 (secure 0 0 0) 0x7fb0100cf0b0 con 0x7fb020108ac0 2024-06-13T11:18:45.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.656+0000 7fb01d400700 1 --2- 172.21.15.2:0/2709931209 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb0040a2ca0 0x7fb0040a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:45.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.657+0000 7fb01d400700 1 --2- 172.21.15.2:0/2709931209 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb0040a2ca0 0x7fb0040a5160 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009810 tx=0x7fb00c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:45.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.660+0000 7fb016a00700 1 -- 172.21.15.2:0/2709931209 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb01009c120 con 0x7fb020108ac0 2024-06-13T11:18:45.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:45.940+0000 7fb025200700 1 -- 172.21.15.2:0/2709931209 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb02002dca0 con 0x7fb020108ac0 2024-06-13T11:18:46.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:46.899+0000 7fb016a00700 1 -- 172.21.15.2:0/2709931209 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fb01009ba20 con 0x7fb020108ac0 2024-06-13T11:18:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:46.906+0000 7fb025200700 1 -- 172.21.15.2:0/2709931209 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb0040a2ca0 msgr2=0x7fb0040a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:46.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:46.906+0000 7fb025200700 1 --2- 172.21.15.2:0/2709931209 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb0040a2ca0 0x7fb0040a5160 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009810 tx=0x7fb00c019040 comp rx=0 tx=0).stop 2024-06-13T11:18:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:46.906+0000 7fb025200700 1 -- 172.21.15.2:0/2709931209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb020108ac0 msgr2=0x7fb02019f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:46.906+0000 7fb025200700 1 --2- 172.21.15.2:0/2709931209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb020108ac0 0x7fb02019f310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb01000e9c0 tx=0x7fb01000ecd0 comp rx=0 tx=0).stop 2024-06-13T11:18:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:46.906+0000 7fb025200700 1 -- 172.21.15.2:0/2709931209 shutdown_connections 2024-06-13T11:18:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:46.906+0000 7fb025200700 1 --2- 172.21.15.2:0/2709931209 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb0040a2ca0 0x7fb0040a5160 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:46.906+0000 7fb025200700 1 --2- 172.21.15.2:0/2709931209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb02010eac0 0x7fb0201a3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:46.906+0000 7fb025200700 1 --2- 172.21.15.2:0/2709931209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb020108ac0 0x7fb02019f310 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb01000e9c0 tx=0x7fb01000ecd0 comp rx=0 tx=0).stop 2024-06-13T11:18:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:46.906+0000 7fb025200700 1 --2- 172.21.15.2:0/2709931209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb020109480 0x7fb02019f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:46.906+0000 7fb025200700 1 -- 172.21.15.2:0/2709931209 >> 172.21.15.2:0/2709931209 conn(0x7fb020075c60 msgr2=0x7fb020076280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:46.907+0000 7fb025200700 1 -- 172.21.15.2:0/2709931209 shutdown_connections 2024-06-13T11:18:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:46.909+0000 7fb025200700 1 -- 172.21.15.2:0/2709931209 wait complete. 2024-06-13T11:18:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 2 and data pool 3 2024-06-13T11:18:47.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:46 smithi178 ceph-mon[36913]: pgmap v327: 97 pgs: 14 creating+peering, 66 active+clean, 17 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:47.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:46 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2709931209' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-13T11:18:47.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:46 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-13T11:18:47.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:46 smithi178 ceph-mon[36913]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-06-13T11:18:47.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:46 smithi077 ceph-mon[36410]: pgmap v327: 97 pgs: 14 creating+peering, 66 active+clean, 17 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:47.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:46 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2709931209' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-13T11:18:47.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:46 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-13T11:18:47.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:46 smithi077 ceph-mon[36410]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-06-13T11:18:47.300 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:46 smithi002 ceph-mon[32210]: pgmap v327: 97 pgs: 14 creating+peering, 66 active+clean, 17 unknown; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:47.300 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:46 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2709931209' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-13T11:18:47.300 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:46 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-13T11:18:47.300 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:46 smithi002 ceph-mon[32210]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-06-13T11:18:47.812 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-06-13T11:18:47.813 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-06-13T11:18:48.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:47 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-13T11:18:48.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:47 smithi002 ceph-mon[32210]: osdmap e88: 12 total, 12 up, 12 in 2024-06-13T11:18:48.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:47 smithi002 ceph-mon[32210]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-06-13T11:18:48.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:47 smithi002 ceph-mon[32210]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-06-13T11:18:48.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:47 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-13T11:18:48.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:47 smithi178 ceph-mon[36913]: osdmap e88: 12 total, 12 up, 12 in 2024-06-13T11:18:48.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:47 smithi178 ceph-mon[36913]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-06-13T11:18:48.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:47 smithi178 ceph-mon[36913]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-06-13T11:18:48.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:47 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-13T11:18:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:47 smithi077 ceph-mon[36410]: osdmap e88: 12 total, 12 up, 12 in 2024-06-13T11:18:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:47 smithi077 ceph-mon[36410]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-06-13T11:18:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:47 smithi077 ceph-mon[36410]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-06-13T11:18:48.304 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:18:49.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:48 smithi002 ceph-mon[32210]: pgmap v329: 97 pgs: 4 creating+peering, 93 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:48 smithi002 ceph-mon[32210]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-13T11:18:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:48 smithi002 ceph-mon[32210]: Cluster is now healthy 2024-06-13T11:18:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:48 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] up:active 2024-06-13T11:18:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:48 smithi002 ceph-mon[32210]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-13T11:18:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:48 smithi002 ceph-mon[32210]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-13T11:18:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:48 smithi178 ceph-mon[36913]: pgmap v329: 97 pgs: 4 creating+peering, 93 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:48 smithi178 ceph-mon[36913]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-13T11:18:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:48 smithi178 ceph-mon[36913]: Cluster is now healthy 2024-06-13T11:18:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:48 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] up:active 2024-06-13T11:18:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:48 smithi178 ceph-mon[36913]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-13T11:18:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:48 smithi178 ceph-mon[36913]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-13T11:18:49.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:48 smithi077 ceph-mon[36410]: pgmap v329: 97 pgs: 4 creating+peering, 93 active+clean; 577 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:18:49.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:48 smithi077 ceph-mon[36410]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-13T11:18:49.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:48 smithi077 ceph-mon[36410]: Cluster is now healthy 2024-06-13T11:18:49.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:48 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] up:active 2024-06-13T11:18:49.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:48 smithi077 ceph-mon[36410]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-13T11:18:49.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:48 smithi077 ceph-mon[36410]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-13T11:18:50.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.551+0000 7f9dc8400700 1 -- 172.21.15.2:0/341372959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc0107400 msgr2=0x7f9dc01077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:50.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.551+0000 7f9dc8400700 1 --2- 172.21.15.2:0/341372959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc0107400 0x7f9dc01077e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9db4009990 tx=0x7f9db4009ca0 comp rx=0 tx=0).stop 2024-06-13T11:18:50.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.551+0000 7f9dc8400700 1 -- 172.21.15.2:0/341372959 shutdown_connections 2024-06-13T11:18:50.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.551+0000 7f9dc8400700 1 --2- 172.21.15.2:0/341372959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dc0101d50 0x7f9dc010e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:50.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.551+0000 7f9dc8400700 1 --2- 172.21.15.2:0/341372959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc0107400 0x7f9dc01077e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:50.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.551+0000 7f9dc8400700 1 --2- 172.21.15.2:0/341372959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9dc0101390 0x7f9dc0101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:50.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.551+0000 7f9dc8400700 1 -- 172.21.15.2:0/341372959 >> 172.21.15.2:0/341372959 conn(0x7f9dc0078340 msgr2=0x7f9dc0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:50.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.552+0000 7f9dc8400700 1 -- 172.21.15.2:0/341372959 shutdown_connections 2024-06-13T11:18:50.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.552+0000 7f9dc8400700 1 -- 172.21.15.2:0/341372959 wait complete. 2024-06-13T11:18:50.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.553+0000 7f9dc8400700 1 Processor -- start 2024-06-13T11:18:50.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.553+0000 7f9dc8400700 1 -- start start 2024-06-13T11:18:50.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc8400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc0101390 0x7f9dc01a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:50.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc8400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dc0101d50 0x7f9dc01a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:50.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc8400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9dc0107400 0x7f9dc019af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:50.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc8400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc0111670 con 0x7f9dc0101d50 2024-06-13T11:18:50.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc8400700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc01114f0 con 0x7f9dc0101390 2024-06-13T11:18:50.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc8400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc01117f0 con 0x7f9dc0107400 2024-06-13T11:18:50.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc5a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc0101390 0x7f9dc01a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:50.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc5a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc0101390 0x7f9dc01a0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:32788/0 (socket says 172.21.15.2:32788) 2024-06-13T11:18:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc5a00700 1 -- 172.21.15.2:0/777836454 learned_addr learned my addr 172.21.15.2:0/777836454 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:18:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc5000700 1 --2- 172.21.15.2:0/777836454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dc0101d50 0x7f9dc01a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc6400700 1 --2- 172.21.15.2:0/777836454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9dc0107400 0x7f9dc019af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc5a00700 1 -- 172.21.15.2:0/777836454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9dc0107400 msgr2=0x7f9dc019af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc5a00700 1 --2- 172.21.15.2:0/777836454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9dc0107400 0x7f9dc019af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc5a00700 1 -- 172.21.15.2:0/777836454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dc0101d50 msgr2=0x7f9dc01a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc5a00700 1 --2- 172.21.15.2:0/777836454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dc0101d50 0x7f9dc01a1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc5a00700 1 -- 172.21.15.2:0/777836454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc019b7c0 con 0x7f9dc0101390 2024-06-13T11:18:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.554+0000 7f9dc5000700 1 --2- 172.21.15.2:0/777836454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dc0101d50 0x7f9dc01a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:18:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.555+0000 7f9dc5a00700 1 --2- 172.21.15.2:0/777836454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc0101390 0x7f9dc01a0ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9db400bae0 tx=0x7f9db400bb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.555+0000 7f9dbe000700 1 -- 172.21.15.2:0/777836454 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db4026070 con 0x7f9dc0101390 2024-06-13T11:18:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.555+0000 7f9dbe000700 1 -- 172.21.15.2:0/777836454 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9db4003d70 con 0x7f9dc0101390 2024-06-13T11:18:50.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.555+0000 7f9dbe000700 1 -- 172.21.15.2:0/777836454 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db4021410 con 0x7f9dc0101390 2024-06-13T11:18:50.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.555+0000 7f9dc8400700 1 -- 172.21.15.2:0/777836454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc019ba50 con 0x7f9dc0101390 2024-06-13T11:18:50.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.555+0000 7f9dc8400700 1 -- 172.21.15.2:0/777836454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc01a78d0 con 0x7f9dc0101390 2024-06-13T11:18:50.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.556+0000 7f9dc8400700 1 -- 172.21.15.2:0/777836454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc0069180 con 0x7f9dc0101390 2024-06-13T11:18:50.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.558+0000 7f9dbe000700 1 -- 172.21.15.2:0/777836454 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f9db4029070 con 0x7f9dc0101390 2024-06-13T11:18:50.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.560+0000 7f9dbe000700 1 --2- 172.21.15.2:0/777836454 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9da80a2ca0 0x7f9da80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:50.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.560+0000 7f9dbe000700 1 -- 172.21.15.2:0/777836454 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f9db40d0280 con 0x7f9dc0101390 2024-06-13T11:18:50.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.560+0000 7f9dc5000700 1 --2- 172.21.15.2:0/777836454 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9da80a2ca0 0x7f9da80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:50.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.561+0000 7f9dc5000700 1 --2- 172.21.15.2:0/777836454 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9da80a2ca0 0x7f9da80a5160 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9dc019c380 tx=0x7f9dac00b5f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.562+0000 7f9dbe000700 1 -- 172.21.15.2:0/777836454 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9db4030080 con 0x7f9dc0101390 2024-06-13T11:18:50.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.804+0000 7f9dc8400700 1 -- 172.21.15.2:0/777836454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f9dc01a7b00 con 0x7f9dc0101390 2024-06-13T11:18:50.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.937+0000 7f9dbe000700 1 -- 172.21.15.2:0/777836454 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v89) ==== 157+0+0 (secure 0 0 0) 0x7f9db4013070 con 0x7f9dc0101390 2024-06-13T11:18:50.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.941+0000 7f9dc8400700 1 -- 172.21.15.2:0/777836454 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9da80a2ca0 msgr2=0x7f9da80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:50.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.941+0000 7f9dc8400700 1 --2- 172.21.15.2:0/777836454 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9da80a2ca0 0x7f9da80a5160 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9dc019c380 tx=0x7f9dac00b5f0 comp rx=0 tx=0).stop 2024-06-13T11:18:50.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.941+0000 7f9dc8400700 1 -- 172.21.15.2:0/777836454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc0101390 msgr2=0x7f9dc01a0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:50.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.941+0000 7f9dc8400700 1 --2- 172.21.15.2:0/777836454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc0101390 0x7f9dc01a0ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9db400bae0 tx=0x7f9db400bb10 comp rx=0 tx=0).stop 2024-06-13T11:18:50.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.941+0000 7f9dc8400700 1 -- 172.21.15.2:0/777836454 shutdown_connections 2024-06-13T11:18:50.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.941+0000 7f9dc8400700 1 --2- 172.21.15.2:0/777836454 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9da80a2ca0 0x7f9da80a5160 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:50.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.941+0000 7f9dc8400700 1 --2- 172.21.15.2:0/777836454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9dc0107400 0x7f9dc019af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:50.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.941+0000 7f9dc8400700 1 --2- 172.21.15.2:0/777836454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc0101390 0x7f9dc01a0ae0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:50.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.941+0000 7f9dc8400700 1 --2- 172.21.15.2:0/777836454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dc0101d50 0x7f9dc01a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:50.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.941+0000 7f9dc8400700 1 -- 172.21.15.2:0/777836454 >> 172.21.15.2:0/777836454 conn(0x7f9dc0078340 msgr2=0x7f9dc00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:50.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.942+0000 7f9dc8400700 1 -- 172.21.15.2:0/777836454 shutdown_connections 2024-06-13T11:18:50.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:50.942+0000 7f9dc8400700 1 -- 172.21.15.2:0/777836454 wait complete. 2024-06-13T11:18:51.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:50 smithi002 ceph-mon[32210]: pgmap v330: 97 pgs: 97 active+clean; 578 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 1 op/s 2024-06-13T11:18:51.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:50 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/777836454' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-13T11:18:51.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:50 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-13T11:18:51.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:50 smithi178 ceph-mon[36913]: pgmap v330: 97 pgs: 97 active+clean; 578 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 1 op/s 2024-06-13T11:18:51.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:50 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/777836454' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-13T11:18:51.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:50 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-13T11:18:51.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:50 smithi077 ceph-mon[36410]: pgmap v330: 97 pgs: 97 active+clean; 578 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 1 op/s 2024-06-13T11:18:51.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:50 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/777836454' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-13T11:18:51.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:50 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-13T11:18:51.763 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-06-13T11:18:52.242 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:18:52.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:51 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-06-13T11:18:52.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:51 smithi077 ceph-mon[36410]: osdmap e89: 12 total, 12 up, 12 in 2024-06-13T11:18:52.392 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:51 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-06-13T11:18:52.392 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:51 smithi002 ceph-mon[32210]: osdmap e89: 12 total, 12 up, 12 in 2024-06-13T11:18:52.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:51 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-06-13T11:18:52.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:51 smithi178 ceph-mon[36913]: osdmap e89: 12 total, 12 up, 12 in 2024-06-13T11:18:52.946 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:18:52 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-i[68535]: 2024-06-13T11:18:52.625+0000 7f8000686700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-13T11:18:53.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:52 smithi002 ceph-mon[32210]: pgmap v332: 97 pgs: 97 active+clean; 578 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-06-13T11:18:53.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:52 smithi077 ceph-mon[36410]: pgmap v332: 97 pgs: 97 active+clean; 578 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-06-13T11:18:53.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:52 smithi178 ceph-mon[36913]: pgmap v332: 97 pgs: 97 active+clean; 578 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-06-13T11:18:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.494+0000 7fc4d2a00700 1 -- 172.21.15.2:0/1766844956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4cc0746c0 msgr2=0x7fc4cc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.494+0000 7fc4d2a00700 1 --2- 172.21.15.2:0/1766844956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4cc0746c0 0x7fc4cc074aa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc009990 tx=0x7fc4bc009ca0 comp rx=0 tx=0).stop 2024-06-13T11:18:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.494+0000 7fc4d2a00700 1 -- 172.21.15.2:0/1766844956 shutdown_connections 2024-06-13T11:18:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.494+0000 7fc4d2a00700 1 --2- 172.21.15.2:0/1766844956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4cc10eef0 0x7fc4cc1112e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.494+0000 7fc4d2a00700 1 --2- 172.21.15.2:0/1766844956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4cc0746c0 0x7fc4cc074aa0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:54.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.494+0000 7fc4d2a00700 1 --2- 172.21.15.2:0/1766844956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4cc074fe0 0x7fc4cc10e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:54.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.494+0000 7fc4d2a00700 1 -- 172.21.15.2:0/1766844956 >> 172.21.15.2:0/1766844956 conn(0x7fc4cc079560 msgr2=0x7fc4cc079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:54.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.494+0000 7fc4d2a00700 1 -- 172.21.15.2:0/1766844956 shutdown_connections 2024-06-13T11:18:54.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.494+0000 7fc4d2a00700 1 -- 172.21.15.2:0/1766844956 wait complete. 2024-06-13T11:18:54.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.495+0000 7fc4d2a00700 1 Processor -- start 2024-06-13T11:18:54.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.496+0000 7fc4d2a00700 1 -- start start 2024-06-13T11:18:54.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.496+0000 7fc4d2a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4cc0746c0 0x7fc4cc19adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:54.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.496+0000 7fc4d2a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4cc074fe0 0x7fc4cc19b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:54.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.496+0000 7fc4d2a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4cc10eef0 0x7fc4cc19f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:54.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.496+0000 7fc4d2a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc114a00 con 0x7fc4cc074fe0 2024-06-13T11:18:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.496+0000 7fc4d2a00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc114880 con 0x7fc4cc10eef0 2024-06-13T11:18:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.496+0000 7fc4d2a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc114b80 con 0x7fc4cc0746c0 2024-06-13T11:18:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.496+0000 7fc4c3400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4cc074fe0 0x7fc4cc19b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.496+0000 7fc4cbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4cc0746c0 0x7fc4cc19adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.496+0000 7fc4c3400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4cc074fe0 0x7fc4cc19b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38292/0 (socket says 172.21.15.2:38292) 2024-06-13T11:18:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.496+0000 7fc4cbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4cc0746c0 0x7fc4cc19adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:59894/0 (socket says 172.21.15.2:59894) 2024-06-13T11:18:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.496+0000 7fc4c3400700 1 -- 172.21.15.2:0/3679535795 learned_addr learned my addr 172.21.15.2:0/3679535795 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:18:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.496+0000 7fc4d0a00700 1 --2- 172.21.15.2:0/3679535795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4cc10eef0 0x7fc4cc19f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.497+0000 7fc4c3400700 1 -- 172.21.15.2:0/3679535795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4cc0746c0 msgr2=0x7fc4cc19adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.497+0000 7fc4c3400700 1 --2- 172.21.15.2:0/3679535795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4cc0746c0 0x7fc4cc19adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.497+0000 7fc4c3400700 1 -- 172.21.15.2:0/3679535795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4cc10eef0 msgr2=0x7fc4cc19f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.497+0000 7fc4c3400700 1 --2- 172.21.15.2:0/3679535795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4cc10eef0 0x7fc4cc19f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.497+0000 7fc4c3400700 1 -- 172.21.15.2:0/3679535795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4cc19fd70 con 0x7fc4cc074fe0 2024-06-13T11:18:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.497+0000 7fc4c3400700 1 --2- 172.21.15.2:0/3679535795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4cc074fe0 0x7fc4cc19b2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400e9a0 tx=0x7fc4b400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.497+0000 7fc4c9600700 1 -- 172.21.15.2:0/3679535795 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400ca10 con 0x7fc4cc074fe0 2024-06-13T11:18:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.498+0000 7fc4d2a00700 1 -- 172.21.15.2:0/3679535795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4cc1a0060 con 0x7fc4cc074fe0 2024-06-13T11:18:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.498+0000 7fc4c9600700 1 -- 172.21.15.2:0/3679535795 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4b400cbb0 con 0x7fc4cc074fe0 2024-06-13T11:18:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.498+0000 7fc4c9600700 1 -- 172.21.15.2:0/3679535795 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4018680 con 0x7fc4cc074fe0 2024-06-13T11:18:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.498+0000 7fc4d2a00700 1 -- 172.21.15.2:0/3679535795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4cc1a78e0 con 0x7fc4cc074fe0 2024-06-13T11:18:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.499+0000 7fc4d2a00700 1 -- 172.21.15.2:0/3679535795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4cc050a00 con 0x7fc4cc074fe0 2024-06-13T11:18:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.501+0000 7fc4c9600700 1 -- 172.21.15.2:0/3679535795 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc4b4010430 con 0x7fc4cc074fe0 2024-06-13T11:18:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.502+0000 7fc4c9600700 1 --2- 172.21.15.2:0/3679535795 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc4b00a2cc0 0x7fc4b00a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.503+0000 7fc4c9600700 1 -- 172.21.15.2:0/3679535795 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8277+0+0 (secure 0 0 0) 0x7fc4b40cf7c0 con 0x7fc4cc074fe0 2024-06-13T11:18:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.503+0000 7fc4cbe00700 1 --2- 172.21.15.2:0/3679535795 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc4b00a2cc0 0x7fc4b00a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.504+0000 7fc4cbe00700 1 --2- 172.21.15.2:0/3679535795 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc4b00a2cc0 0x7fc4b00a5180 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00b2e0 tx=0x7fc4bc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:54.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.506+0000 7fc4c9600700 1 -- 172.21.15.2:0/3679535795 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc4b409c690 con 0x7fc4cc074fe0 2024-06-13T11:18:54.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:54.737+0000 7fc4d2a00700 1 -- 172.21.15.2:0/3679535795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc4cc19c0c0 con 0x7fc4cc074fe0 2024-06-13T11:18:55.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:54 smithi002 ceph-mon[32210]: pgmap v333: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-13T11:18:55.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:54 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3679535795' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-13T11:18:55.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:54 smithi077 ceph-mon[36410]: pgmap v333: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-13T11:18:55.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:54 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3679535795' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-13T11:18:55.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:54 smithi178 ceph-mon[36913]: pgmap v333: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-13T11:18:55.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:54 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3679535795' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-13T11:18:55.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:55.986+0000 7fc4c9600700 1 -- 172.21.15.2:0/3679535795 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v91) ==== 228+0+0 (secure 0 0 0) 0x7fc4cc19c0c0 con 0x7fc4cc074fe0 2024-06-13T11:18:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:55.993+0000 7fc4d2a00700 1 -- 172.21.15.2:0/3679535795 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc4b00a2cc0 msgr2=0x7fc4b00a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:55.993+0000 7fc4d2a00700 1 --2- 172.21.15.2:0/3679535795 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc4b00a2cc0 0x7fc4b00a5180 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00b2e0 tx=0x7fc4bc005fd0 comp rx=0 tx=0).stop 2024-06-13T11:18:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:55.993+0000 7fc4d2a00700 1 -- 172.21.15.2:0/3679535795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4cc074fe0 msgr2=0x7fc4cc19b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:55.993+0000 7fc4d2a00700 1 --2- 172.21.15.2:0/3679535795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4cc074fe0 0x7fc4cc19b2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400e9a0 tx=0x7fc4b400ecb0 comp rx=0 tx=0).stop 2024-06-13T11:18:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:55.994+0000 7fc4d2a00700 1 -- 172.21.15.2:0/3679535795 shutdown_connections 2024-06-13T11:18:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:55.994+0000 7fc4d2a00700 1 --2- 172.21.15.2:0/3679535795 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc4b00a2cc0 0x7fc4b00a5180 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:55.994+0000 7fc4d2a00700 1 --2- 172.21.15.2:0/3679535795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4cc10eef0 0x7fc4cc19f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:55.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:55.994+0000 7fc4d2a00700 1 --2- 172.21.15.2:0/3679535795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4cc0746c0 0x7fc4cc19adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:55.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:55.994+0000 7fc4d2a00700 1 --2- 172.21.15.2:0/3679535795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4cc074fe0 0x7fc4cc19b2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:55.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:55.994+0000 7fc4d2a00700 1 -- 172.21.15.2:0/3679535795 >> 172.21.15.2:0/3679535795 conn(0x7fc4cc079560 msgr2=0x7fc4cc0ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:55.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:55.998+0000 7fc4d2a00700 1 -- 172.21.15.2:0/3679535795 shutdown_connections 2024-06-13T11:18:55.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:55.998+0000 7fc4d2a00700 1 -- 172.21.15.2:0/3679535795 wait complete. 2024-06-13T11:18:56.001 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data_ec' created 2024-06-13T11:18:56.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:55 smithi077 ceph-mon[36410]: osdmap e90: 12 total, 12 up, 12 in 2024-06-13T11:18:56.393 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:55 smithi002 ceph-mon[32210]: osdmap e90: 12 total, 12 up, 12 in 2024-06-13T11:18:56.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:55 smithi178 ceph-mon[36913]: osdmap e90: 12 total, 12 up, 12 in 2024-06-13T11:18:56.828 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-06-13T11:18:57.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:57 smithi002 ceph-mon[32210]: pgmap v335: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-13T11:18:57.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:57 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3679535795' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-13T11:18:57.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:57 smithi002 ceph-mon[32210]: osdmap e91: 12 total, 12 up, 12 in 2024-06-13T11:18:57.287 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:18:57.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:57 smithi077 ceph-mon[36410]: pgmap v335: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-13T11:18:57.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:57 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3679535795' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-13T11:18:57.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:57 smithi077 ceph-mon[36410]: osdmap e91: 12 total, 12 up, 12 in 2024-06-13T11:18:57.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:57 smithi178 ceph-mon[36913]: pgmap v335: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-13T11:18:57.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:57 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3679535795' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-13T11:18:57.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:57 smithi178 ceph-mon[36913]: osdmap e91: 12 total, 12 up, 12 in 2024-06-13T11:18:58.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:58 smithi002 ceph-mon[32210]: osdmap e92: 12 total, 12 up, 12 in 2024-06-13T11:18:58.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:58 smithi002 ceph-mon[32210]: pgmap v338: 129 pgs: 13 creating+peering, 19 unknown, 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-06-13T11:18:58.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:58 smithi077 ceph-mon[36410]: osdmap e92: 12 total, 12 up, 12 in 2024-06-13T11:18:58.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:58 smithi077 ceph-mon[36410]: pgmap v338: 129 pgs: 13 creating+peering, 19 unknown, 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-06-13T11:18:58.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:58 smithi178 ceph-mon[36913]: osdmap e92: 12 total, 12 up, 12 in 2024-06-13T11:18:58.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:58 smithi178 ceph-mon[36913]: pgmap v338: 129 pgs: 13 creating+peering, 19 unknown, 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-06-13T11:18:59.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:59 smithi077 ceph-mon[36410]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T11:18:59.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:18:59 smithi077 ceph-mon[36410]: osdmap e93: 12 total, 12 up, 12 in 2024-06-13T11:18:59.386 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:59 smithi002 ceph-mon[32210]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T11:18:59.386 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:18:59 smithi002 ceph-mon[32210]: osdmap e93: 12 total, 12 up, 12 in 2024-06-13T11:18:59.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:59 smithi178 ceph-mon[36913]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T11:18:59.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:18:59 smithi178 ceph-mon[36913]: osdmap e93: 12 total, 12 up, 12 in 2024-06-13T11:18:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.567+0000 7f4cfb400700 1 -- 172.21.15.2:0/2477260577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cf41084f0 msgr2=0x7f4cf41088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.567+0000 7f4cfb400700 1 --2- 172.21.15.2:0/2477260577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cf41084f0 0x7f4cf41088d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8009990 tx=0x7f4ce8009ca0 comp rx=0 tx=0).stop 2024-06-13T11:18:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.567+0000 7f4cfb400700 1 -- 172.21.15.2:0/2477260577 shutdown_connections 2024-06-13T11:18:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.567+0000 7f4cfb400700 1 --2- 172.21.15.2:0/2477260577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf4102e80 0x7f4cf410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.567+0000 7f4cfb400700 1 --2- 172.21.15.2:0/2477260577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cf41084f0 0x7f4cf41088d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.567+0000 7f4cfb400700 1 --2- 172.21.15.2:0/2477260577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf41024e0 0x7f4cf4102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.567+0000 7f4cfb400700 1 -- 172.21.15.2:0/2477260577 >> 172.21.15.2:0/2477260577 conn(0x7f4cf4079530 msgr2=0x7f4cf4079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:18:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.567+0000 7f4cfb400700 1 -- 172.21.15.2:0/2477260577 shutdown_connections 2024-06-13T11:18:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.567+0000 7f4cfb400700 1 -- 172.21.15.2:0/2477260577 wait complete. 2024-06-13T11:18:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.568+0000 7f4cfb400700 1 Processor -- start 2024-06-13T11:18:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.569+0000 7f4cfb400700 1 -- start start 2024-06-13T11:18:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.569+0000 7f4cfb400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf41024e0 0x7f4cf4074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.569+0000 7f4cfb400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf4102e80 0x7f4cf4074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.569+0000 7f4cfb400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cf41084f0 0x7f4cf4075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.569+0000 7f4cfb400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf41127a0 con 0x7f4cf41024e0 2024-06-13T11:18:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.569+0000 7f4cfb400700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf4112620 con 0x7f4cf4102e80 2024-06-13T11:18:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.569+0000 7f4cfb400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf4112920 con 0x7f4cf41084f0 2024-06-13T11:18:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.569+0000 7f4cf8a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf41024e0 0x7f4cf4074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.569+0000 7f4cf8a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf41024e0 0x7f4cf4074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60570/0 (socket says 172.21.15.2:60570) 2024-06-13T11:18:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.569+0000 7f4cf8a00700 1 -- 172.21.15.2:0/1957446353 learned_addr learned my addr 172.21.15.2:0/1957446353 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:18:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.569+0000 7f4cf3e00700 1 --2- 172.21.15.2:0/1957446353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf4102e80 0x7f4cf4074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.569+0000 7f4cf9400700 1 --2- 172.21.15.2:0/1957446353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cf41084f0 0x7f4cf4075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.570+0000 7f4cf8a00700 1 -- 172.21.15.2:0/1957446353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cf41084f0 msgr2=0x7f4cf4075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.570+0000 7f4cf8a00700 1 --2- 172.21.15.2:0/1957446353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cf41084f0 0x7f4cf4075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.570+0000 7f4cf8a00700 1 -- 172.21.15.2:0/1957446353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf4102e80 msgr2=0x7f4cf4074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:18:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.570+0000 7f4cf8a00700 1 --2- 172.21.15.2:0/1957446353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf4102e80 0x7f4cf4074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:18:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.570+0000 7f4cf8a00700 1 -- 172.21.15.2:0/1957446353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf41a7160 con 0x7f4cf41024e0 2024-06-13T11:18:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.570+0000 7f4cf8a00700 1 --2- 172.21.15.2:0/1957446353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf41024e0 0x7f4cf4074790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8000c00 tx=0x7f4ce800bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.571+0000 7f4cf1600700 1 -- 172.21.15.2:0/1957446353 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8027070 con 0x7f4cf41024e0 2024-06-13T11:18:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.571+0000 7f4cf1600700 1 -- 172.21.15.2:0/1957446353 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ce80056d0 con 0x7f4cf41024e0 2024-06-13T11:18:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.571+0000 7f4cf1600700 1 -- 172.21.15.2:0/1957446353 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8022e10 con 0x7f4cf41024e0 2024-06-13T11:18:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.571+0000 7f4cfb400700 1 -- 172.21.15.2:0/1957446353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf41a73f0 con 0x7f4cf41024e0 2024-06-13T11:18:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.571+0000 7f4cfb400700 1 -- 172.21.15.2:0/1957446353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf41a7840 con 0x7f4cf41024e0 2024-06-13T11:18:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.572+0000 7f4cfb400700 1 -- 172.21.15.2:0/1957446353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf4069180 con 0x7f4cf41024e0 2024-06-13T11:18:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.574+0000 7f4cf1600700 1 -- 172.21.15.2:0/1957446353 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4ce802a070 con 0x7f4cf41024e0 2024-06-13T11:18:59.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.575+0000 7f4cf1600700 1 --2- 172.21.15.2:0/1957446353 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4cdc0a2c20 0x7f4cdc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:18:59.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.576+0000 7f4cf1600700 1 -- 172.21.15.2:0/1957446353 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8770+0+0 (secure 0 0 0) 0x7f4ce80d05b0 con 0x7f4cf41024e0 2024-06-13T11:18:59.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.576+0000 7f4cf3e00700 1 --2- 172.21.15.2:0/1957446353 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4cdc0a2c20 0x7f4cdc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:18:59.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.576+0000 7f4cf3e00700 1 --2- 172.21.15.2:0/1957446353 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4cdc0a2c20 0x7f4cdc0a50e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009680 tx=0x7f4ce0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:18:59.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.579+0000 7f4cf1600700 1 -- 172.21.15.2:0/1957446353 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4ce8013070 con 0x7f4cf41024e0 2024-06-13T11:18:59.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:18:59.816+0000 7f4cfb400700 1 -- 172.21.15.2:0/1957446353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f4cf402de60 con 0x7f4cf41024e0 2024-06-13T11:19:00.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:00.037+0000 7f4cf1600700 1 -- 172.21.15.2:0/1957446353 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v94) ==== 169+0+0 (secure 0 0 0) 0x7f4ce80870c0 con 0x7f4cf41024e0 2024-06-13T11:19:00.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:00.043+0000 7f4cfb400700 1 -- 172.21.15.2:0/1957446353 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4cdc0a2c20 msgr2=0x7f4cdc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:00.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:00.043+0000 7f4cfb400700 1 --2- 172.21.15.2:0/1957446353 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4cdc0a2c20 0x7f4cdc0a50e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009680 tx=0x7f4ce0009260 comp rx=0 tx=0).stop 2024-06-13T11:19:00.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:00.044+0000 7f4cfb400700 1 -- 172.21.15.2:0/1957446353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf41024e0 msgr2=0x7f4cf4074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:00.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:00.044+0000 7f4cfb400700 1 --2- 172.21.15.2:0/1957446353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf41024e0 0x7f4cf4074790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8000c00 tx=0x7f4ce800bab0 comp rx=0 tx=0).stop 2024-06-13T11:19:00.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:00.044+0000 7f4cfb400700 1 -- 172.21.15.2:0/1957446353 shutdown_connections 2024-06-13T11:19:00.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:00.044+0000 7f4cfb400700 1 --2- 172.21.15.2:0/1957446353 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4cdc0a2c20 0x7f4cdc0a50e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:00.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:00.044+0000 7f4cfb400700 1 --2- 172.21.15.2:0/1957446353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf41024e0 0x7f4cf4074790 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8000c00 tx=0x7f4ce800bab0 comp rx=0 tx=0).stop 2024-06-13T11:19:00.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:00.044+0000 7f4cfb400700 1 --2- 172.21.15.2:0/1957446353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cf41084f0 0x7f4cf4075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:00.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:00.044+0000 7f4cfb400700 1 --2- 172.21.15.2:0/1957446353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf4102e80 0x7f4cf4074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:00.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:00.044+0000 7f4cfb400700 1 -- 172.21.15.2:0/1957446353 >> 172.21.15.2:0/1957446353 conn(0x7f4cf4079530 msgr2=0x7f4cf4100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:00.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:00.045+0000 7f4cfb400700 1 -- 172.21.15.2:0/1957446353 shutdown_connections 2024-06-13T11:19:00.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:00.045+0000 7f4cfb400700 1 -- 172.21.15.2:0/1957446353 wait complete. 2024-06-13T11:19:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:set pool 4 allow_ec_overwrites to true 2024-06-13T11:19:00.124 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:00 smithi002 ceph-mon[32210]: pgmap v340: 129 pgs: 13 creating+peering, 10 unknown, 106 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:00.124 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:00 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1957446353' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-13T11:19:00.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:00 smithi077 ceph-mon[36410]: pgmap v340: 129 pgs: 13 creating+peering, 10 unknown, 106 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:00.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:00 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1957446353' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-13T11:19:00.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:00 smithi178 ceph-mon[36913]: pgmap v340: 129 pgs: 13 creating+peering, 10 unknown, 106 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:00.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:00 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1957446353' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-13T11:19:00.891 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-06-13T11:19:01.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:01 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1957446353' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-06-13T11:19:01.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:01 smithi002 ceph-mon[32210]: osdmap e94: 12 total, 12 up, 12 in 2024-06-13T11:19:01.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:01 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1957446353' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-06-13T11:19:01.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:01 smithi077 ceph-mon[36410]: osdmap e94: 12 total, 12 up, 12 in 2024-06-13T11:19:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:19:01.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:01 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1957446353' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-06-13T11:19:01.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:01 smithi178 ceph-mon[36913]: osdmap e94: 12 total, 12 up, 12 in 2024-06-13T11:19:02.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:02 smithi002 ceph-mon[32210]: pgmap v342: 129 pgs: 12 creating+peering, 117 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:02.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:02 smithi178 ceph-mon[36913]: pgmap v342: 129 pgs: 12 creating+peering, 117 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:02.539 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:02 smithi077 ceph-mon[36410]: pgmap v342: 129 pgs: 12 creating+peering, 117 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.677+0000 7f90afe00700 1 -- 172.21.15.2:0/4291760181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90a8104ed0 msgr2=0x7f90a8105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.677+0000 7f90afe00700 1 --2- 172.21.15.2:0/4291760181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90a8104ed0 0x7f90a8105360 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f90a000b0a0 tx=0x7f90a000b3b0 comp rx=0 tx=0).stop 2024-06-13T11:19:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.677+0000 7f90afe00700 1 -- 172.21.15.2:0/4291760181 shutdown_connections 2024-06-13T11:19:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.677+0000 7f90afe00700 1 --2- 172.21.15.2:0/4291760181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90a8104ed0 0x7f90a8105360 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.677+0000 7f90afe00700 1 --2- 172.21.15.2:0/4291760181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a81073c0 0x7f90a806a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.677+0000 7f90afe00700 1 --2- 172.21.15.2:0/4291760181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90a806a6e0 0x7f90a806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.677+0000 7f90afe00700 1 -- 172.21.15.2:0/4291760181 >> 172.21.15.2:0/4291760181 conn(0x7f90a8078340 msgr2=0x7f90a8078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.677+0000 7f90afe00700 1 -- 172.21.15.2:0/4291760181 shutdown_connections 2024-06-13T11:19:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.677+0000 7f90afe00700 1 -- 172.21.15.2:0/4291760181 wait complete. 2024-06-13T11:19:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.678+0000 7f90afe00700 1 Processor -- start 2024-06-13T11:19:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.678+0000 7f90afe00700 1 -- start start 2024-06-13T11:19:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.678+0000 7f90afe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a806a6e0 0x7f90a819f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.679+0000 7f90afe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90a8104ed0 0x7f90a819f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.679+0000 7f90afe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90a81073c0 0x7f90a81a3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.679+0000 7f90afe00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f90a8118dc0 con 0x7f90a8104ed0 2024-06-13T11:19:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.679+0000 7f90afe00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f90a8118c40 con 0x7f90a806a6e0 2024-06-13T11:19:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.679+0000 7f90afe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f90a8118f40 con 0x7f90a81073c0 2024-06-13T11:19:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.679+0000 7f90ad400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a806a6e0 0x7f90a819f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.679+0000 7f90ad400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a806a6e0 0x7f90a819f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:42072/0 (socket says 172.21.15.2:42072) 2024-06-13T11:19:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.679+0000 7f90ad400700 1 -- 172.21.15.2:0/2799194567 learned_addr learned my addr 172.21.15.2:0/2799194567 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:19:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.679+0000 7f90aca00700 1 --2- 172.21.15.2:0/2799194567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90a8104ed0 0x7f90a819f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.679+0000 7f90ade00700 1 --2- 172.21.15.2:0/2799194567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90a81073c0 0x7f90a81a3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.679+0000 7f90ad400700 1 -- 172.21.15.2:0/2799194567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90a81073c0 msgr2=0x7f90a81a3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.679+0000 7f90ad400700 1 --2- 172.21.15.2:0/2799194567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90a81073c0 0x7f90a81a3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.679+0000 7f90ad400700 1 -- 172.21.15.2:0/2799194567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90a8104ed0 msgr2=0x7f90a819f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.679+0000 7f90ad400700 1 --2- 172.21.15.2:0/2799194567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90a8104ed0 0x7f90a819f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.679+0000 7f90ad400700 1 -- 172.21.15.2:0/2799194567 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a81a4220 con 0x7f90a806a6e0 2024-06-13T11:19:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.680+0000 7f90ade00700 1 --2- 172.21.15.2:0/2799194567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90a81073c0 0x7f90a81a3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:19:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.680+0000 7f90ad400700 1 --2- 172.21.15.2:0/2799194567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a806a6e0 0x7f90a819f210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f909c00e9a0 tx=0x7f909c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.680+0000 7f90a6000700 1 -- 172.21.15.2:0/2799194567 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c00cbd0 con 0x7f90a806a6e0 2024-06-13T11:19:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.680+0000 7f90a6000700 1 -- 172.21.15.2:0/2799194567 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f909c00cd70 con 0x7f90a806a6e0 2024-06-13T11:19:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.680+0000 7f90a6000700 1 -- 172.21.15.2:0/2799194567 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c018750 con 0x7f90a806a6e0 2024-06-13T11:19:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.680+0000 7f90afe00700 1 -- 172.21.15.2:0/2799194567 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a81a4510 con 0x7f90a806a6e0 2024-06-13T11:19:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.680+0000 7f90afe00700 1 -- 172.21.15.2:0/2799194567 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a81abd90 con 0x7f90a806a6e0 2024-06-13T11:19:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.681+0000 7f90afe00700 1 -- 172.21.15.2:0/2799194567 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90a8069180 con 0x7f90a806a6e0 2024-06-13T11:19:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.684+0000 7f90a6000700 1 -- 172.21.15.2:0/2799194567 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f909c010430 con 0x7f90a806a6e0 2024-06-13T11:19:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.685+0000 7f90a6000700 1 --2- 172.21.15.2:0/2799194567 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f90900a2ca0 0x7f90900a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.685+0000 7f90a6000700 1 -- 172.21.15.2:0/2799194567 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8770+0+0 (secure 0 0 0) 0x7f909c0cf910 con 0x7f90a806a6e0 2024-06-13T11:19:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.685+0000 7f90aca00700 1 --2- 172.21.15.2:0/2799194567 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f90900a2ca0 0x7f90900a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.686+0000 7f90aca00700 1 --2- 172.21.15.2:0/2799194567 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f90900a2ca0 0x7f90900a5160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f90a806a300 tx=0x7f9094009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.687+0000 7f90a6000700 1 -- 172.21.15.2:0/2799194567 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f909c09c5f0 con 0x7f90a806a6e0 2024-06-13T11:19:03.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:03.967+0000 7f90afe00700 1 -- 172.21.15.2:0/2799194567 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f90a81ac020 con 0x7f90a806a6e0 2024-06-13T11:19:04.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:04.304+0000 7f90a6000700 1 -- 172.21.15.2:0/2799194567 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f909c09bef0 con 0x7f90a806a6e0 2024-06-13T11:19:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:04.309+0000 7f90afe00700 1 -- 172.21.15.2:0/2799194567 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f90900a2ca0 msgr2=0x7f90900a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:04.309+0000 7f90afe00700 1 --2- 172.21.15.2:0/2799194567 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f90900a2ca0 0x7f90900a5160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f90a806a300 tx=0x7f9094009260 comp rx=0 tx=0).stop 2024-06-13T11:19:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:04.309+0000 7f90afe00700 1 -- 172.21.15.2:0/2799194567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a806a6e0 msgr2=0x7f90a819f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:04.309+0000 7f90afe00700 1 --2- 172.21.15.2:0/2799194567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a806a6e0 0x7f90a819f210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f909c00e9a0 tx=0x7f909c00ecb0 comp rx=0 tx=0).stop 2024-06-13T11:19:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:04.309+0000 7f90afe00700 1 -- 172.21.15.2:0/2799194567 shutdown_connections 2024-06-13T11:19:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:04.309+0000 7f90afe00700 1 --2- 172.21.15.2:0/2799194567 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f90900a2ca0 0x7f90900a5160 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:04.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:04.309+0000 7f90afe00700 1 --2- 172.21.15.2:0/2799194567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90a81073c0 0x7f90a81a3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:04.309+0000 7f90afe00700 1 --2- 172.21.15.2:0/2799194567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a806a6e0 0x7f90a819f210 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:04.309+0000 7f90afe00700 1 --2- 172.21.15.2:0/2799194567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90a8104ed0 0x7f90a819f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:04.309+0000 7f90afe00700 1 -- 172.21.15.2:0/2799194567 >> 172.21.15.2:0/2799194567 conn(0x7f90a8078340 msgr2=0x7f90a8103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:04.310+0000 7f90afe00700 1 -- 172.21.15.2:0/2799194567 shutdown_connections 2024-06-13T11:19:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:04.310+0000 7f90afe00700 1 -- 172.21.15.2:0/2799194567 wait complete. 2024-06-13T11:19:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:added data pool 4 to fsmap 2024-06-13T11:19:04.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:04 smithi002 ceph-mon[32210]: pgmap v343: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:04.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:04 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2799194567' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-13T11:19:04.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:04 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-13T11:19:04.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:04 smithi178 ceph-mon[36913]: pgmap v343: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:04.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:04 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2799194567' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-13T11:19:04.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:04 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-13T11:19:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:04 smithi077 ceph-mon[36410]: pgmap v343: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:04 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2799194567' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-13T11:19:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:04 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-13T11:19:05.107 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:19:05.566 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:19:05.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:05 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-06-13T11:19:05.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:05 smithi002 ceph-mon[32210]: osdmap e95: 12 total, 12 up, 12 in 2024-06-13T11:19:05.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:05 smithi002 ceph-mon[32210]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-13T11:19:05.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:05 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-06-13T11:19:05.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:05 smithi178 ceph-mon[36913]: osdmap e95: 12 total, 12 up, 12 in 2024-06-13T11:19:05.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:05 smithi178 ceph-mon[36913]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-13T11:19:05.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:05 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-06-13T11:19:05.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:05 smithi077 ceph-mon[36410]: osdmap e95: 12 total, 12 up, 12 in 2024-06-13T11:19:05.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:05 smithi077 ceph-mon[36410]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-13T11:19:06.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:06 smithi002 ceph-mon[32210]: pgmap v345: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:06.635 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:06 smithi002 ceph-mon[32210]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-13T11:19:06.635 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:06 smithi002 ceph-mon[32210]: Cluster is now healthy 2024-06-13T11:19:06.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:06 smithi178 ceph-mon[36913]: pgmap v345: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:06.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:06 smithi178 ceph-mon[36913]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-13T11:19:06.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:06 smithi178 ceph-mon[36913]: Cluster is now healthy 2024-06-13T11:19:06.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:06 smithi077 ceph-mon[36410]: pgmap v345: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:06.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:06 smithi077 ceph-mon[36410]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-13T11:19:06.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:06 smithi077 ceph-mon[36410]: Cluster is now healthy 2024-06-13T11:19:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.791+0000 7fdd63c00700 1 -- 172.21.15.2:0/1336664020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd5c102740 msgr2=0x7fdd5c102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.791+0000 7fdd63c00700 1 --2- 172.21.15.2:0/1336664020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd5c102740 0x7fdd5c102b20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0098f0 tx=0x7fdd4c009c00 comp rx=0 tx=0).stop 2024-06-13T11:19:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.791+0000 7fdd63c00700 1 -- 172.21.15.2:0/1336664020 shutdown_connections 2024-06-13T11:19:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.791+0000 7fdd63c00700 1 --2- 172.21.15.2:0/1336664020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd5c107840 0x7fdd5c10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.791+0000 7fdd63c00700 1 --2- 172.21.15.2:0/1336664020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd5c102740 0x7fdd5c102b20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:07.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.791+0000 7fdd63c00700 1 --2- 172.21.15.2:0/1336664020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd5c1030f0 0x7fdd5c107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:07.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.791+0000 7fdd63c00700 1 -- 172.21.15.2:0/1336664020 >> 172.21.15.2:0/1336664020 conn(0x7fdd5c0795f0 msgr2=0x7fdd5c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:07.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.792+0000 7fdd63c00700 1 -- 172.21.15.2:0/1336664020 shutdown_connections 2024-06-13T11:19:07.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.792+0000 7fdd63c00700 1 -- 172.21.15.2:0/1336664020 wait complete. 2024-06-13T11:19:07.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.793+0000 7fdd63c00700 1 Processor -- start 2024-06-13T11:19:07.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.793+0000 7fdd63c00700 1 -- start start 2024-06-13T11:19:07.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.793+0000 7fdd63c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd5c102740 0x7fdd5c19ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:07.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.793+0000 7fdd63c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd5c1030f0 0x7fdd5c19b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:07.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.793+0000 7fdd63c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd5c107840 0x7fdd5c19f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:07.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.793+0000 7fdd63c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5c1127b0 con 0x7fdd5c1030f0 2024-06-13T11:19:07.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.793+0000 7fdd63c00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5c112630 con 0x7fdd5c107840 2024-06-13T11:19:07.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.793+0000 7fdd63c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5c112930 con 0x7fdd5c102740 2024-06-13T11:19:07.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.794+0000 7fdd61200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd5c102740 0x7fdd5c19ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:07.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.794+0000 7fdd53e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd5c1030f0 0x7fdd5c19b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:07.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.794+0000 7fdd61200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd5c102740 0x7fdd5c19ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:54124/0 (socket says 172.21.15.2:54124) 2024-06-13T11:19:07.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.794+0000 7fdd61200700 1 -- 172.21.15.2:0/2615871383 learned_addr learned my addr 172.21.15.2:0/2615871383 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:19:07.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.794+0000 7fdd53e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd5c1030f0 0x7fdd5c19b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35216/0 (socket says 172.21.15.2:35216) 2024-06-13T11:19:07.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.794+0000 7fdd61c00700 1 --2- 172.21.15.2:0/2615871383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd5c107840 0x7fdd5c19f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:07.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.794+0000 7fdd61200700 1 -- 172.21.15.2:0/2615871383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd5c107840 msgr2=0x7fdd5c19f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:07.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.794+0000 7fdd61200700 1 --2- 172.21.15.2:0/2615871383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd5c107840 0x7fdd5c19f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:07.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.794+0000 7fdd61200700 1 -- 172.21.15.2:0/2615871383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd5c1030f0 msgr2=0x7fdd5c19b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:07.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.794+0000 7fdd61200700 1 --2- 172.21.15.2:0/2615871383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd5c1030f0 0x7fdd5c19b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:07.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.794+0000 7fdd61200700 1 -- 172.21.15.2:0/2615871383 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5c19fe80 con 0x7fdd5c102740 2024-06-13T11:19:07.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.794+0000 7fdd61200700 1 --2- 172.21.15.2:0/2615871383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd5c102740 0x7fdd5c19ae70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009fd0 tx=0x7fdd4c0094b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:07.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.795+0000 7fdd5a000700 1 -- 172.21.15.2:0/2615871383 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c025070 con 0x7fdd5c102740 2024-06-13T11:19:07.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.795+0000 7fdd5a000700 1 -- 172.21.15.2:0/2615871383 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd4c00b560 con 0x7fdd5c102740 2024-06-13T11:19:07.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.795+0000 7fdd5a000700 1 -- 172.21.15.2:0/2615871383 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c004c30 con 0x7fdd5c102740 2024-06-13T11:19:07.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.795+0000 7fdd63c00700 1 -- 172.21.15.2:0/2615871383 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd5c1a0110 con 0x7fdd5c102740 2024-06-13T11:19:07.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.795+0000 7fdd63c00700 1 -- 172.21.15.2:0/2615871383 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd5c1a79f0 con 0x7fdd5c102740 2024-06-13T11:19:07.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.796+0000 7fdd63c00700 1 -- 172.21.15.2:0/2615871383 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd5c069180 con 0x7fdd5c102740 2024-06-13T11:19:07.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.798+0000 7fdd5a000700 1 -- 172.21.15.2:0/2615871383 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fdd4c028070 con 0x7fdd5c102740 2024-06-13T11:19:07.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.799+0000 7fdd5a000700 1 --2- 172.21.15.2:0/2615871383 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdd400a2c20 0x7fdd400a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:07.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.800+0000 7fdd5a000700 1 -- 172.21.15.2:0/2615871383 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7fdd4c0cfe10 con 0x7fdd5c102740 2024-06-13T11:19:07.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.800+0000 7fdd53e00700 1 --2- 172.21.15.2:0/2615871383 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdd400a2c20 0x7fdd400a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:07.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.800+0000 7fdd53e00700 1 --2- 172.21.15.2:0/2615871383 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdd400a2c20 0x7fdd400a50e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009750 tx=0x7fdd44009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:07.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:07.802+0000 7fdd5a000700 1 -- 172.21.15.2:0/2615871383 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdd4c02f080 con 0x7fdd5c102740 2024-06-13T11:19:08.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:08.079+0000 7fdd63c00700 1 -- 172.21.15.2:0/2615871383 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd5c1a7bc0 con 0x7fdd5c102740 2024-06-13T11:19:08.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:08.080+0000 7fdd5a000700 1 -- 172.21.15.2:0/2615871383 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11780 (secure 0 0 0) 0x7fdd4c013030 con 0x7fdd5c102740 2024-06-13T11:19:08.080 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:19:08.080 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24509,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:19:03.970662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24511},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24511,"qdb_cluster":[24511]},"id":1}]} 2024-06-13T11:19:08.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:08.083+0000 7fdd63c00700 1 -- 172.21.15.2:0/2615871383 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdd400a2c20 msgr2=0x7fdd400a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:08.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:08.083+0000 7fdd63c00700 1 --2- 172.21.15.2:0/2615871383 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdd400a2c20 0x7fdd400a50e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009750 tx=0x7fdd44009310 comp rx=0 tx=0).stop 2024-06-13T11:19:08.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:08.083+0000 7fdd63c00700 1 -- 172.21.15.2:0/2615871383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd5c102740 msgr2=0x7fdd5c19ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:08.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:08.083+0000 7fdd63c00700 1 --2- 172.21.15.2:0/2615871383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd5c102740 0x7fdd5c19ae70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009fd0 tx=0x7fdd4c0094b0 comp rx=0 tx=0).stop 2024-06-13T11:19:08.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:08.083+0000 7fdd63c00700 1 -- 172.21.15.2:0/2615871383 shutdown_connections 2024-06-13T11:19:08.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:08.083+0000 7fdd63c00700 1 --2- 172.21.15.2:0/2615871383 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdd400a2c20 0x7fdd400a50e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:08.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:08.083+0000 7fdd63c00700 1 --2- 172.21.15.2:0/2615871383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd5c107840 0x7fdd5c19f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:08.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:08.083+0000 7fdd63c00700 1 --2- 172.21.15.2:0/2615871383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd5c102740 0x7fdd5c19ae70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:08.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:08.083+0000 7fdd63c00700 1 --2- 172.21.15.2:0/2615871383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd5c1030f0 0x7fdd5c19b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:08.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:08.083+0000 7fdd63c00700 1 -- 172.21.15.2:0/2615871383 >> 172.21.15.2:0/2615871383 conn(0x7fdd5c0795f0 msgr2=0x7fdd5c1004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:08.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:08.084+0000 7fdd63c00700 1 -- 172.21.15.2:0/2615871383 shutdown_connections 2024-06-13T11:19:08.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:08.084+0000 7fdd63c00700 1 -- 172.21.15.2:0/2615871383 wait complete. 2024-06-13T11:19:08.084 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-06-13T11:19:08.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:08 smithi002 ceph-mon[32210]: pgmap v346: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:08.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:08 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2615871383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:19:08.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:08 smithi178 ceph-mon[36913]: pgmap v346: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:08.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:08 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2615871383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:19:08.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:08 smithi077 ceph-mon[36410]: pgmap v346: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:08.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:08 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2615871383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:19:08.859 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T11:19:09.337 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:19:10.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:10 smithi002 ceph-mon[32210]: pgmap v347: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:10.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:10 smithi178 ceph-mon[36913]: pgmap v347: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:10.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:10 smithi077 ceph-mon[36410]: pgmap v347: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.667+0000 7fdb99000700 1 -- 172.21.15.2:0/3643168706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb941084e0 msgr2=0x7fdb941088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.667+0000 7fdb99000700 1 --2- 172.21.15.2:0/3643168706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb941084e0 0x7fdb941088c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdb840099c0 tx=0x7fdb84009cd0 comp rx=0 tx=0).stop 2024-06-13T11:19:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.667+0000 7fdb99000700 1 -- 172.21.15.2:0/3643168706 shutdown_connections 2024-06-13T11:19:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.667+0000 7fdb99000700 1 --2- 172.21.15.2:0/3643168706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb941084e0 0x7fdb941088c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.667+0000 7fdb99000700 1 --2- 172.21.15.2:0/3643168706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb9406ab10 0x7fdb9410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.667+0000 7fdb99000700 1 --2- 172.21.15.2:0/3643168706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb9406a170 0x7fdb9406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.667+0000 7fdb99000700 1 -- 172.21.15.2:0/3643168706 >> 172.21.15.2:0/3643168706 conn(0x7fdb940782c0 msgr2=0x7fdb940786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:11.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.667+0000 7fdb99000700 1 -- 172.21.15.2:0/3643168706 shutdown_connections 2024-06-13T11:19:11.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.667+0000 7fdb99000700 1 -- 172.21.15.2:0/3643168706 wait complete. 2024-06-13T11:19:11.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.668+0000 7fdb99000700 1 Processor -- start 2024-06-13T11:19:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.669+0000 7fdb99000700 1 -- start start 2024-06-13T11:19:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.669+0000 7fdb99000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb9406a170 0x7fdb94101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.669+0000 7fdb99000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9406ab10 0x7fdb941019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.669+0000 7fdb99000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb941084e0 0x7fdb94101ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.669+0000 7fdb99000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94112790 con 0x7fdb9406ab10 2024-06-13T11:19:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.669+0000 7fdb99000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94112610 con 0x7fdb9406a170 2024-06-13T11:19:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.669+0000 7fdb99000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94112910 con 0x7fdb941084e0 2024-06-13T11:19:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.669+0000 7fdb91400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9406ab10 0x7fdb941019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.669+0000 7fdb91400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9406ab10 0x7fdb941019a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35228/0 (socket says 172.21.15.2:35228) 2024-06-13T11:19:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.669+0000 7fdb91400700 1 -- 172.21.15.2:0/3428100600 learned_addr learned my addr 172.21.15.2:0/3428100600 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:19:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.670+0000 7fdb92800700 1 --2- 172.21.15.2:0/3428100600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb941084e0 0x7fdb94101ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:11.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.670+0000 7fdb91e00700 1 --2- 172.21.15.2:0/3428100600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb9406a170 0x7fdb94101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.670+0000 7fdb91400700 1 -- 172.21.15.2:0/3428100600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb941084e0 msgr2=0x7fdb94101ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.670+0000 7fdb91400700 1 --2- 172.21.15.2:0/3428100600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb941084e0 0x7fdb94101ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:11.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.670+0000 7fdb91400700 1 -- 172.21.15.2:0/3428100600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb9406a170 msgr2=0x7fdb94101460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.670+0000 7fdb91400700 1 --2- 172.21.15.2:0/3428100600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb9406a170 0x7fdb94101460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.670+0000 7fdb91400700 1 -- 172.21.15.2:0/3428100600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb941a7180 con 0x7fdb9406ab10 2024-06-13T11:19:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.670+0000 7fdb91400700 1 --2- 172.21.15.2:0/3428100600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9406ab10 0x7fdb941019a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdb8000e9c0 tx=0x7fdb8000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.670+0000 7fdb8aa00700 1 -- 172.21.15.2:0/3428100600 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8000cbd0 con 0x7fdb9406ab10 2024-06-13T11:19:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.671+0000 7fdb8aa00700 1 -- 172.21.15.2:0/3428100600 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb8000ee60 con 0x7fdb9406ab10 2024-06-13T11:19:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.671+0000 7fdb99000700 1 -- 172.21.15.2:0/3428100600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb941a7470 con 0x7fdb9406ab10 2024-06-13T11:19:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.671+0000 7fdb8aa00700 1 -- 172.21.15.2:0/3428100600 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb80005630 con 0x7fdb9406ab10 2024-06-13T11:19:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.671+0000 7fdb99000700 1 -- 172.21.15.2:0/3428100600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb941a7960 con 0x7fdb9406ab10 2024-06-13T11:19:11.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.672+0000 7fdb99000700 1 -- 172.21.15.2:0/3428100600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb94069180 con 0x7fdb9406ab10 2024-06-13T11:19:11.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.675+0000 7fdb8aa00700 1 -- 172.21.15.2:0/3428100600 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fdb80004750 con 0x7fdb9406ab10 2024-06-13T11:19:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.676+0000 7fdb8aa00700 1 --2- 172.21.15.2:0/3428100600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdb780a2c20 0x7fdb780a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.676+0000 7fdb8aa00700 1 -- 172.21.15.2:0/3428100600 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7fdb800cf4f0 con 0x7fdb9406ab10 2024-06-13T11:19:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.676+0000 7fdb91e00700 1 --2- 172.21.15.2:0/3428100600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdb780a2c20 0x7fdb780a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:11.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.677+0000 7fdb91e00700 1 --2- 172.21.15.2:0/3428100600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdb780a2c20 0x7fdb780a50e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb84000c00 tx=0x7fdb84005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:11.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.681+0000 7fdb8aa00700 1 -- 172.21.15.2:0/3428100600 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdb8009c210 con 0x7fdb9406ab10 2024-06-13T11:19:11.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.913+0000 7fdb99000700 1 -- 172.21.15.2:0/3428100600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb94102940 con 0x7fdb9406ab10 2024-06-13T11:19:11.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.918+0000 7fdb8aa00700 1 -- 172.21.15.2:0/3428100600 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24058 (secure 0 0 0) 0x7fdb8009bb10 con 0x7fdb9406ab10 2024-06-13T11:19:11.918 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:19:11.918 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":95,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","created":"2024-06-13T11:09:07.839101+0000","modified":"2024-06-13T11:19:03.970443+0000","last_up_change":"2024-06-13T11:17:28.731479+0000","last_in_change":"2024-06-13T11:17:08.849067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:13:13.793461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:18:36.784824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:18:41.824835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:18:55.545870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f5614d91-49a7-4983-a309-0de3b3e6263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6803","nonce":4127571834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6805","nonce":4127571834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6809","nonce":4127571834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6807","nonce":4127571834}]},"public_addr":"172.21.15.2:6803/4127571834","cluster_addr":"172.21.15.2:6805/4127571834","heartbeat_back_addr":"172.21.15.2:6809/4127571834","heartbeat_front_addr":"172.21.15.2:6807/4127571834","state":["exists","up"]},{"osd":1,"uuid":"d9dbe278-309f-4726-828a-da922f486b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6801","nonce":3180360713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6803","nonce":3180360713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6807","nonce":3180360713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6805","nonce":3180360713}]},"public_addr":"172.21.15.77:6801/3180360713","cluster_addr":"172.21.15.77:6803/3180360713","heartbeat_back_addr":"172.21.15.77:6807/3180360713","heartbeat_front_addr":"172.21.15.77:6805/3180360713","state":["exists","up"]},{"osd":2,"uuid":"04c267dc-7454-418f-9965-3ff96ef280ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6801","nonce":3825510575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6803","nonce":3825510575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6807","nonce":3825510575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6805","nonce":3825510575}]},"public_addr":"172.21.15.178:6801/3825510575","cluster_addr":"172.21.15.178:6803/3825510575","heartbeat_back_addr":"172.21.15.178:6807/3825510575","heartbeat_front_addr":"172.21.15.178:6805/3825510575","state":["exists","up"]},{"osd":3,"uuid":"3847bd4f-ca04-41de-9d88-e1523dd7ff8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6811","nonce":1982693353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6813","nonce":1982693353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6817","nonce":1982693353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6815","nonce":1982693353}]},"public_addr":"172.21.15.2:6811/1982693353","cluster_addr":"172.21.15.2:6813/1982693353","heartbeat_back_addr":"172.21.15.2:6817/1982693353","heartbeat_front_addr":"172.21.15.2:6815/1982693353","state":["exists","up"]},{"osd":4,"uuid":"34d7d2e8-3dee-42b9-a6cb-d4162b122b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6809","nonce":3916694904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6811","nonce":3916694904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6815","nonce":3916694904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6813","nonce":3916694904}]},"public_addr":"172.21.15.77:6809/3916694904","cluster_addr":"172.21.15.77:6811/3916694904","heartbeat_back_addr":"172.21.15.77:6815/3916694904","heartbeat_front_addr":"172.21.15.77:6813/3916694904","state":["exists","up"]},{"osd":5,"uuid":"0468aefc-c3c8-4758-9bbf-1225b7a5ae79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6809","nonce":3572805887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6811","nonce":3572805887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6815","nonce":3572805887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6813","nonce":3572805887}]},"public_addr":"172.21.15.178:6809/3572805887","cluster_addr":"172.21.15.178:6811/3572805887","heartbeat_back_addr":"172.21.15.178:6815/3572805887","heartbeat_front_addr":"172.21.15.178:6813/3572805887","state":["exists","up"]},{"osd":6,"uuid":"0a186a4a-0e28-47bd-b5ad-9bf8079f74c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6819","nonce":1592309584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6821","nonce":1592309584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6825","nonce":1592309584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6823","nonce":1592309584}]},"public_addr":"172.21.15.2:6819/1592309584","cluster_addr":"172.21.15.2:6821/1592309584","heartbeat_back_addr":"172.21.15.2:6825/1592309584","heartbeat_front_addr":"172.21.15.2:6823/1592309584","state":["exists","up"]},{"osd":7,"uuid":"646e66f7-1ef8-428d-a842-bf28c8606df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6817","nonce":1580055775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6819","nonce":1580055775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6823","nonce":1580055775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6821","nonce":1580055775}]},"public_addr":"172.21.15.77:6817/1580055775","cluster_addr":"172.21.15.77:6819/1580055775","heartbeat_back_addr":"172.21.15.77:6823/1580055775","heartbeat_front_addr":"172.21.15.77:6821/1580055775","state":["exists","up"]},{"osd":8,"uuid":"bcc971fc-47d7-4289-8a9a-c76996c57370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6817","nonce":4285192591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6819","nonce":4285192591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6823","nonce":4285192591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6821","nonce":4285192591}]},"public_addr":"172.21.15.178:6817/4285192591","cluster_addr":"172.21.15.178:6819/4285192591","heartbeat_back_addr":"172.21.15.178:6823/4285192591","heartbeat_front_addr":"172.21.15.178:6821/4285192591","state":["exists","up"]},{"osd":9,"uuid":"899d7d4f-a24c-4508-b42c-0b363275c459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6827","nonce":4187017478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6829","nonce":4187017478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6833","nonce":4187017478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6831","nonce":4187017478}]},"public_addr":"172.21.15.2:6827/4187017478","cluster_addr":"172.21.15.2:6829/4187017478","heartbeat_back_addr":"172.21.15.2:6833/4187017478","heartbeat_front_addr":"172.21.15.2:6831/4187017478","state":["exists","up"]},{"osd":10,"uuid":"112d2b8e-9673-4d7a-97e9-2089793fdd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6825","nonce":2039538463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6827","nonce":2039538463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6831","nonce":2039538463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6829","nonce":2039538463}]},"public_addr":"172.21.15.77:6825/2039538463","cluster_addr":"172.21.15.77:6827/2039538463","heartbeat_back_addr":"172.21.15.77:6831/2039538463","heartbeat_front_addr":"172.21.15.77:6829/2039538463","state":["exists","up"]},{"osd":11,"uuid":"6b8001f5-9c74-4cc7-8c41-906cb5ac9b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6825","nonce":1915058767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6827","nonce":1915058767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6831","nonce":1915058767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6829","nonce":1915058767}]},"public_addr":"172.21.15.178:6825/1915058767","cluster_addr":"172.21.15.178:6827/1915058767","heartbeat_back_addr":"172.21.15.178:6831/1915058767","heartbeat_front_addr":"172.21.15.178:6829/1915058767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:21.707572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:46.440115+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:10.197217+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:42.853367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:08.880473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:33.605677+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:07.655377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:33.980900+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:59.397529+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:16:33.983411+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:00.932649+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:26.894098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/315567313":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/2084201061":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/3394644803":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6801/1821969949":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/2170469985":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/142516651":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6801/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/3220886565":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6800/1821969949":"2024-06-14T11:10:25.084617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:19:11.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.921+0000 7fdb99000700 1 -- 172.21.15.2:0/3428100600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdb780a2c20 msgr2=0x7fdb780a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:11.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.921+0000 7fdb99000700 1 --2- 172.21.15.2:0/3428100600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdb780a2c20 0x7fdb780a50e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb84000c00 tx=0x7fdb84005fb0 comp rx=0 tx=0).stop 2024-06-13T11:19:11.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.921+0000 7fdb99000700 1 -- 172.21.15.2:0/3428100600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9406ab10 msgr2=0x7fdb941019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:11.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.921+0000 7fdb99000700 1 --2- 172.21.15.2:0/3428100600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9406ab10 0x7fdb941019a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdb8000e9c0 tx=0x7fdb8000ecd0 comp rx=0 tx=0).stop 2024-06-13T11:19:11.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.921+0000 7fdb99000700 1 -- 172.21.15.2:0/3428100600 shutdown_connections 2024-06-13T11:19:11.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.921+0000 7fdb99000700 1 --2- 172.21.15.2:0/3428100600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdb780a2c20 0x7fdb780a50e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:11.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.921+0000 7fdb99000700 1 --2- 172.21.15.2:0/3428100600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb941084e0 0x7fdb94101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:11.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.921+0000 7fdb99000700 1 --2- 172.21.15.2:0/3428100600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb9406a170 0x7fdb94101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:11.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.921+0000 7fdb99000700 1 --2- 172.21.15.2:0/3428100600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9406ab10 0x7fdb941019a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:11.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.921+0000 7fdb99000700 1 -- 172.21.15.2:0/3428100600 >> 172.21.15.2:0/3428100600 conn(0x7fdb940782c0 msgr2=0x7fdb940ff480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:11.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.921+0000 7fdb99000700 1 -- 172.21.15.2:0/3428100600 shutdown_connections 2024-06-13T11:19:11.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:11.921+0000 7fdb99000700 1 -- 172.21.15.2:0/3428100600 wait complete. 2024-06-13T11:19:12.588 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:12 smithi002 ceph-mon[32210]: pgmap v348: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:12.588 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:12 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3428100600' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:19:12.671 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T11:19:12.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:12 smithi178 ceph-mon[36913]: pgmap v348: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:12.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:12 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3428100600' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:19:12.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:12 smithi077 ceph-mon[36410]: pgmap v348: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:12.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:12 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3428100600' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:19:13.147 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:19:15.092 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:14 smithi002 ceph-mon[32210]: pgmap v349: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:15.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:14 smithi178 ceph-mon[36913]: pgmap v349: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:15.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:14 smithi077 ceph-mon[36410]: pgmap v349: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:15.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.401+0000 7fbdf0a00700 1 -- 172.21.15.2:0/1468832117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdec0746c0 msgr2=0x7fbdec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:15.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.401+0000 7fbdf0a00700 1 --2- 172.21.15.2:0/1468832117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdec0746c0 0x7fbdec074aa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009990 tx=0x7fbddc009ca0 comp rx=0 tx=0).stop 2024-06-13T11:19:15.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.402+0000 7fbdf0a00700 1 -- 172.21.15.2:0/1468832117 shutdown_connections 2024-06-13T11:19:15.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.402+0000 7fbdf0a00700 1 --2- 172.21.15.2:0/1468832117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdec10ee90 0x7fbdec111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:15.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.402+0000 7fbdf0a00700 1 --2- 172.21.15.2:0/1468832117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdec0746c0 0x7fbdec074aa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:15.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.402+0000 7fbdf0a00700 1 --2- 172.21.15.2:0/1468832117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdec074fe0 0x7fbdec10e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:15.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.402+0000 7fbdf0a00700 1 -- 172.21.15.2:0/1468832117 >> 172.21.15.2:0/1468832117 conn(0x7fbdec0795f0 msgr2=0x7fbdec079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:15.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.402+0000 7fbdf0a00700 1 -- 172.21.15.2:0/1468832117 shutdown_connections 2024-06-13T11:19:15.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.402+0000 7fbdf0a00700 1 -- 172.21.15.2:0/1468832117 wait complete. 2024-06-13T11:19:15.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.404+0000 7fbdf0a00700 1 Processor -- start 2024-06-13T11:19:15.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.404+0000 7fbdf0a00700 1 -- start start 2024-06-13T11:19:15.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.405+0000 7fbdf0a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdec0746c0 0x7fbdec19af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:15.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.405+0000 7fbdf0a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdec074fe0 0x7fbdec19b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:15.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.405+0000 7fbdf0a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdec10ee90 0x7fbdec19f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:15.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.405+0000 7fbdf0a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec1149d0 con 0x7fbdec0746c0 2024-06-13T11:19:15.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.405+0000 7fbdf0a00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec114850 con 0x7fbdec10ee90 2024-06-13T11:19:15.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.405+0000 7fbdf0a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec114b50 con 0x7fbdec074fe0 2024-06-13T11:19:15.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.405+0000 7fbde9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdec0746c0 0x7fbdec19af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:15.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.405+0000 7fbde9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdec0746c0 0x7fbdec19af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35244/0 (socket says 172.21.15.2:35244) 2024-06-13T11:19:15.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.405+0000 7fbde9e00700 1 -- 172.21.15.2:0/2658952266 learned_addr learned my addr 172.21.15.2:0/2658952266 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:19:15.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.405+0000 7fbde9400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdec074fe0 0x7fbdec19b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:15.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.405+0000 7fbdea800700 1 --2- 172.21.15.2:0/2658952266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdec10ee90 0x7fbdec19f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:15.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.406+0000 7fbdea800700 1 -- 172.21.15.2:0/2658952266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdec074fe0 msgr2=0x7fbdec19b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:15.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.406+0000 7fbdea800700 1 --2- 172.21.15.2:0/2658952266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdec074fe0 0x7fbdec19b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:15.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.406+0000 7fbdea800700 1 -- 172.21.15.2:0/2658952266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdec0746c0 msgr2=0x7fbdec19af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:15.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.406+0000 7fbdea800700 1 --2- 172.21.15.2:0/2658952266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdec0746c0 0x7fbdec19af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:15.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.406+0000 7fbdea800700 1 -- 172.21.15.2:0/2658952266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdec19ff30 con 0x7fbdec10ee90 2024-06-13T11:19:15.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.406+0000 7fbde9e00700 1 --2- 172.21.15.2:0/2658952266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdec0746c0 0x7fbdec19af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:19:15.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.406+0000 7fbde9400700 1 --2- 172.21.15.2:0/2658952266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdec074fe0 0x7fbdec19b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:19:15.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.406+0000 7fbdea800700 1 --2- 172.21.15.2:0/2658952266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdec10ee90 0x7fbdec19f7f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbde400efc0 tx=0x7fbde400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:15.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.406+0000 7fbde2a00700 1 -- 172.21.15.2:0/2658952266 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde40092e0 con 0x7fbdec10ee90 2024-06-13T11:19:15.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.406+0000 7fbde2a00700 1 -- 172.21.15.2:0/2658952266 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbde4004bb0 con 0x7fbdec10ee90 2024-06-13T11:19:15.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.406+0000 7fbdf0a00700 1 -- 172.21.15.2:0/2658952266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdec1a01c0 con 0x7fbdec10ee90 2024-06-13T11:19:15.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.406+0000 7fbde2a00700 1 -- 172.21.15.2:0/2658952266 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde4004280 con 0x7fbdec10ee90 2024-06-13T11:19:15.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.406+0000 7fbdf0a00700 1 -- 172.21.15.2:0/2658952266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdec1a7aa0 con 0x7fbdec10ee90 2024-06-13T11:19:15.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.408+0000 7fbdf0a00700 1 -- 172.21.15.2:0/2658952266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdec069180 con 0x7fbdec10ee90 2024-06-13T11:19:15.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.410+0000 7fbde2a00700 1 -- 172.21.15.2:0/2658952266 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fbde401b030 con 0x7fbdec10ee90 2024-06-13T11:19:15.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.411+0000 7fbde2a00700 1 --2- 172.21.15.2:0/2658952266 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fbdd00a2ca0 0x7fbdd00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:15.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.411+0000 7fbde2a00700 1 -- 172.21.15.2:0/2658952266 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7fbde40ced20 con 0x7fbdec10ee90 2024-06-13T11:19:15.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.411+0000 7fbde9e00700 1 --2- 172.21.15.2:0/2658952266 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fbdd00a2ca0 0x7fbdd00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:15.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.412+0000 7fbde9e00700 1 --2- 172.21.15.2:0/2658952266 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fbdd00a2ca0 0x7fbdd00a5160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009750 tx=0x7fbddc00b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:15.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.416+0000 7fbde2a00700 1 -- 172.21.15.2:0/2658952266 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbde4022020 con 0x7fbdec10ee90 2024-06-13T11:19:15.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.646+0000 7fbdf0a00700 1 -- 172.21.15.2:0/2658952266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbdec02dca0 con 0x7fbdec10ee90 2024-06-13T11:19:15.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.648+0000 7fbde2a00700 1 -- 172.21.15.2:0/2658952266 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24058 (secure 0 0 0) 0x7fbde4010040 con 0x7fbdec10ee90 2024-06-13T11:19:15.647 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:19:15.648 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":95,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","created":"2024-06-13T11:09:07.839101+0000","modified":"2024-06-13T11:19:03.970443+0000","last_up_change":"2024-06-13T11:17:28.731479+0000","last_in_change":"2024-06-13T11:17:08.849067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:13:13.793461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:18:36.784824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:18:41.824835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:18:55.545870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f5614d91-49a7-4983-a309-0de3b3e6263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6803","nonce":4127571834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6805","nonce":4127571834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6809","nonce":4127571834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6807","nonce":4127571834}]},"public_addr":"172.21.15.2:6803/4127571834","cluster_addr":"172.21.15.2:6805/4127571834","heartbeat_back_addr":"172.21.15.2:6809/4127571834","heartbeat_front_addr":"172.21.15.2:6807/4127571834","state":["exists","up"]},{"osd":1,"uuid":"d9dbe278-309f-4726-828a-da922f486b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6801","nonce":3180360713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6803","nonce":3180360713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6807","nonce":3180360713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6805","nonce":3180360713}]},"public_addr":"172.21.15.77:6801/3180360713","cluster_addr":"172.21.15.77:6803/3180360713","heartbeat_back_addr":"172.21.15.77:6807/3180360713","heartbeat_front_addr":"172.21.15.77:6805/3180360713","state":["exists","up"]},{"osd":2,"uuid":"04c267dc-7454-418f-9965-3ff96ef280ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6801","nonce":3825510575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6803","nonce":3825510575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6807","nonce":3825510575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6805","nonce":3825510575}]},"public_addr":"172.21.15.178:6801/3825510575","cluster_addr":"172.21.15.178:6803/3825510575","heartbeat_back_addr":"172.21.15.178:6807/3825510575","heartbeat_front_addr":"172.21.15.178:6805/3825510575","state":["exists","up"]},{"osd":3,"uuid":"3847bd4f-ca04-41de-9d88-e1523dd7ff8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6811","nonce":1982693353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6813","nonce":1982693353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6817","nonce":1982693353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6815","nonce":1982693353}]},"public_addr":"172.21.15.2:6811/1982693353","cluster_addr":"172.21.15.2:6813/1982693353","heartbeat_back_addr":"172.21.15.2:6817/1982693353","heartbeat_front_addr":"172.21.15.2:6815/1982693353","state":["exists","up"]},{"osd":4,"uuid":"34d7d2e8-3dee-42b9-a6cb-d4162b122b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6809","nonce":3916694904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6811","nonce":3916694904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6815","nonce":3916694904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6813","nonce":3916694904}]},"public_addr":"172.21.15.77:6809/3916694904","cluster_addr":"172.21.15.77:6811/3916694904","heartbeat_back_addr":"172.21.15.77:6815/3916694904","heartbeat_front_addr":"172.21.15.77:6813/3916694904","state":["exists","up"]},{"osd":5,"uuid":"0468aefc-c3c8-4758-9bbf-1225b7a5ae79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6809","nonce":3572805887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6811","nonce":3572805887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6815","nonce":3572805887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6813","nonce":3572805887}]},"public_addr":"172.21.15.178:6809/3572805887","cluster_addr":"172.21.15.178:6811/3572805887","heartbeat_back_addr":"172.21.15.178:6815/3572805887","heartbeat_front_addr":"172.21.15.178:6813/3572805887","state":["exists","up"]},{"osd":6,"uuid":"0a186a4a-0e28-47bd-b5ad-9bf8079f74c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6819","nonce":1592309584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6821","nonce":1592309584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6825","nonce":1592309584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6823","nonce":1592309584}]},"public_addr":"172.21.15.2:6819/1592309584","cluster_addr":"172.21.15.2:6821/1592309584","heartbeat_back_addr":"172.21.15.2:6825/1592309584","heartbeat_front_addr":"172.21.15.2:6823/1592309584","state":["exists","up"]},{"osd":7,"uuid":"646e66f7-1ef8-428d-a842-bf28c8606df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6817","nonce":1580055775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6819","nonce":1580055775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6823","nonce":1580055775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6821","nonce":1580055775}]},"public_addr":"172.21.15.77:6817/1580055775","cluster_addr":"172.21.15.77:6819/1580055775","heartbeat_back_addr":"172.21.15.77:6823/1580055775","heartbeat_front_addr":"172.21.15.77:6821/1580055775","state":["exists","up"]},{"osd":8,"uuid":"bcc971fc-47d7-4289-8a9a-c76996c57370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6817","nonce":4285192591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6819","nonce":4285192591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6823","nonce":4285192591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6821","nonce":4285192591}]},"public_addr":"172.21.15.178:6817/4285192591","cluster_addr":"172.21.15.178:6819/4285192591","heartbeat_back_addr":"172.21.15.178:6823/4285192591","heartbeat_front_addr":"172.21.15.178:6821/4285192591","state":["exists","up"]},{"osd":9,"uuid":"899d7d4f-a24c-4508-b42c-0b363275c459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6827","nonce":4187017478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6829","nonce":4187017478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6833","nonce":4187017478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6831","nonce":4187017478}]},"public_addr":"172.21.15.2:6827/4187017478","cluster_addr":"172.21.15.2:6829/4187017478","heartbeat_back_addr":"172.21.15.2:6833/4187017478","heartbeat_front_addr":"172.21.15.2:6831/4187017478","state":["exists","up"]},{"osd":10,"uuid":"112d2b8e-9673-4d7a-97e9-2089793fdd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6825","nonce":2039538463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6827","nonce":2039538463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6831","nonce":2039538463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6829","nonce":2039538463}]},"public_addr":"172.21.15.77:6825/2039538463","cluster_addr":"172.21.15.77:6827/2039538463","heartbeat_back_addr":"172.21.15.77:6831/2039538463","heartbeat_front_addr":"172.21.15.77:6829/2039538463","state":["exists","up"]},{"osd":11,"uuid":"6b8001f5-9c74-4cc7-8c41-906cb5ac9b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6825","nonce":1915058767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6827","nonce":1915058767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6831","nonce":1915058767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6829","nonce":1915058767}]},"public_addr":"172.21.15.178:6825/1915058767","cluster_addr":"172.21.15.178:6827/1915058767","heartbeat_back_addr":"172.21.15.178:6831/1915058767","heartbeat_front_addr":"172.21.15.178:6829/1915058767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:21.707572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:46.440115+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:10.197217+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:42.853367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:08.880473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:33.605677+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:07.655377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:33.980900+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:59.397529+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:16:33.983411+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:00.932649+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:26.894098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/315567313":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/2084201061":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/3394644803":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6801/1821969949":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/2170469985":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/142516651":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6801/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/3220886565":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6800/1821969949":"2024-06-14T11:10:25.084617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:19:15.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.651+0000 7fbdf0a00700 1 -- 172.21.15.2:0/2658952266 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fbdd00a2ca0 msgr2=0x7fbdd00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:15.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.651+0000 7fbdf0a00700 1 --2- 172.21.15.2:0/2658952266 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fbdd00a2ca0 0x7fbdd00a5160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009750 tx=0x7fbddc00b280 comp rx=0 tx=0).stop 2024-06-13T11:19:15.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.651+0000 7fbdf0a00700 1 -- 172.21.15.2:0/2658952266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdec10ee90 msgr2=0x7fbdec19f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:15.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.651+0000 7fbdf0a00700 1 --2- 172.21.15.2:0/2658952266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdec10ee90 0x7fbdec19f7f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbde400efc0 tx=0x7fbde400c3a0 comp rx=0 tx=0).stop 2024-06-13T11:19:15.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.651+0000 7fbdf0a00700 1 -- 172.21.15.2:0/2658952266 shutdown_connections 2024-06-13T11:19:15.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.651+0000 7fbdf0a00700 1 --2- 172.21.15.2:0/2658952266 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fbdd00a2ca0 0x7fbdd00a5160 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:15.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.651+0000 7fbdf0a00700 1 --2- 172.21.15.2:0/2658952266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdec0746c0 0x7fbdec19af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:15.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.651+0000 7fbdf0a00700 1 --2- 172.21.15.2:0/2658952266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdec10ee90 0x7fbdec19f7f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:15.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.651+0000 7fbdf0a00700 1 --2- 172.21.15.2:0/2658952266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdec074fe0 0x7fbdec19b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:15.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.651+0000 7fbdf0a00700 1 -- 172.21.15.2:0/2658952266 >> 172.21.15.2:0/2658952266 conn(0x7fbdec0795f0 msgr2=0x7fbdec100ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:15.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.651+0000 7fbdf0a00700 1 -- 172.21.15.2:0/2658952266 shutdown_connections 2024-06-13T11:19:15.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:15.652+0000 7fbdf0a00700 1 -- 172.21.15.2:0/2658952266 wait complete. 2024-06-13T11:19:16.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:15 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2658952266' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:19:16.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:15 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2658952266' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:19:16.379 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:15 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2658952266' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:19:16.476 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:19:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:19:17.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:16 smithi178 ceph-mon[36913]: pgmap v350: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:17.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:16 smithi077 ceph-mon[36410]: pgmap v350: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:17.300 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:16 smithi002 ceph-mon[32210]: pgmap v350: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:19.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.053+0000 7f70ad400700 1 -- 172.21.15.2:0/739393916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a810a670 msgr2=0x7f70a810aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.053+0000 7f70ad400700 1 --2- 172.21.15.2:0/739393916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a810a670 0x7f70a810aa50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7098009990 tx=0x7f7098009ca0 comp rx=0 tx=0).stop 2024-06-13T11:19:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.053+0000 7f70ad400700 1 -- 172.21.15.2:0/739393916 shutdown_connections 2024-06-13T11:19:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.053+0000 7f70ad400700 1 --2- 172.21.15.2:0/739393916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a8104f80 0x7f70a8111440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.053+0000 7f70ad400700 1 --2- 172.21.15.2:0/739393916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a810a670 0x7f70a810aa50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.053+0000 7f70ad400700 1 --2- 172.21.15.2:0/739393916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70a81045c0 0x7f70a8104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.053+0000 7f70ad400700 1 -- 172.21.15.2:0/739393916 >> 172.21.15.2:0/739393916 conn(0x7f70a8100070 msgr2=0x7f70a8102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.053+0000 7f70ad400700 1 -- 172.21.15.2:0/739393916 shutdown_connections 2024-06-13T11:19:19.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.053+0000 7f70ad400700 1 -- 172.21.15.2:0/739393916 wait complete. 2024-06-13T11:19:19.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.054+0000 7f70ad400700 1 Processor -- start 2024-06-13T11:19:19.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.054+0000 7f70ad400700 1 -- start start 2024-06-13T11:19:19.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.055+0000 7f70ad400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a81045c0 0x7f70a81a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:19.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.055+0000 7f70ad400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70a8104f80 0x7f70a81a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:19.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.055+0000 7f70ad400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a810a670 0x7f70a819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:19.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.055+0000 7f70ad400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81148c0 con 0x7f70a8104f80 2024-06-13T11:19:19.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.055+0000 7f70ad400700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8114740 con 0x7f70a810a670 2024-06-13T11:19:19.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.055+0000 7f70ad400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8114a40 con 0x7f70a81045c0 2024-06-13T11:19:19.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.055+0000 7f70a7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a81045c0 0x7f70a81a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:19.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.055+0000 7f70a7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a81045c0 0x7f70a81a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55474/0 (socket says 172.21.15.2:55474) 2024-06-13T11:19:19.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.055+0000 7f70a7e00700 1 -- 172.21.15.2:0/1325033256 learned_addr learned my addr 172.21.15.2:0/1325033256 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:19:19.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.055+0000 7f70aca00700 1 --2- 172.21.15.2:0/1325033256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a810a670 0x7f70a819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:19.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.055+0000 7f70a7400700 1 --2- 172.21.15.2:0/1325033256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70a8104f80 0x7f70a81a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:19.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.056+0000 7f70a7e00700 1 -- 172.21.15.2:0/1325033256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a810a670 msgr2=0x7f70a819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:19.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.056+0000 7f70a7e00700 1 --2- 172.21.15.2:0/1325033256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a810a670 0x7f70a819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:19.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.056+0000 7f70a7e00700 1 -- 172.21.15.2:0/1325033256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70a8104f80 msgr2=0x7f70a81a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:19.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.056+0000 7f70a7e00700 1 --2- 172.21.15.2:0/1325033256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70a8104f80 0x7f70a81a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:19.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.056+0000 7f70a7e00700 1 -- 172.21.15.2:0/1325033256 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a819b200 con 0x7f70a81045c0 2024-06-13T11:19:19.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.056+0000 7f70a7400700 1 --2- 172.21.15.2:0/1325033256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70a8104f80 0x7f70a81a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:19:19.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.056+0000 7f70a7e00700 1 --2- 172.21.15.2:0/1325033256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a81045c0 0x7f70a81a08e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f70980095b0 tx=0x7f7098005590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.056+0000 7f70a4c00700 1 -- 172.21.15.2:0/1325033256 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098026070 con 0x7f70a81045c0 2024-06-13T11:19:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.056+0000 7f70a4c00700 1 -- 172.21.15.2:0/1325033256 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70980056b0 con 0x7f70a81045c0 2024-06-13T11:19:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.056+0000 7f70a4c00700 1 -- 172.21.15.2:0/1325033256 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70980173f0 con 0x7f70a81045c0 2024-06-13T11:19:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.056+0000 7f70ad400700 1 -- 172.21.15.2:0/1325033256 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a819b490 con 0x7f70a81045c0 2024-06-13T11:19:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.057+0000 7f70ad400700 1 -- 172.21.15.2:0/1325033256 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a81a77b0 con 0x7f70a81045c0 2024-06-13T11:19:19.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.058+0000 7f70ad400700 1 -- 172.21.15.2:0/1325033256 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70a8069180 con 0x7f70a81045c0 2024-06-13T11:19:19.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.060+0000 7f70a4c00700 1 -- 172.21.15.2:0/1325033256 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f7098029070 con 0x7f70a81045c0 2024-06-13T11:19:19.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.061+0000 7f70a4c00700 1 --2- 172.21.15.2:0/1325033256 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f708c0a2ca0 0x7f708c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:19.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.061+0000 7f70a4c00700 1 -- 172.21.15.2:0/1325033256 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7f70980cfeb0 con 0x7f70a81045c0 2024-06-13T11:19:19.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.061+0000 7f70a7400700 1 --2- 172.21.15.2:0/1325033256 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f708c0a2ca0 0x7f708c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:19.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.062+0000 7f70a7400700 1 --2- 172.21.15.2:0/1325033256 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f708c0a2ca0 0x7f708c0a5160 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f70a8109c30 tx=0x7f7094009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:19.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.066+0000 7f70a4c00700 1 -- 172.21.15.2:0/1325033256 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7098013070 con 0x7f70a81045c0 2024-06-13T11:19:19.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:18 smithi002 ceph-mon[32210]: pgmap v351: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:19.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:18 smithi178 ceph-mon[36913]: pgmap v351: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:19.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:18 smithi077 ceph-mon[36410]: pgmap v351: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:19.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.347+0000 7f70ad400700 1 -- 172.21.15.2:0/1325033256 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70a81a79d0 con 0x7f70a81045c0 2024-06-13T11:19:19.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.348+0000 7f70a4c00700 1 -- 172.21.15.2:0/1325033256 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11780 (secure 0 0 0) 0x7f709809cc00 con 0x7f70a81045c0 2024-06-13T11:19:19.348 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:19:19.348 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24509,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:19:03.970662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24511},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24511,"qdb_cluster":[24511]},"id":1}]} 2024-06-13T11:19:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.351+0000 7f70ad400700 1 -- 172.21.15.2:0/1325033256 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f708c0a2ca0 msgr2=0x7f708c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.351+0000 7f70ad400700 1 --2- 172.21.15.2:0/1325033256 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f708c0a2ca0 0x7f708c0a5160 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f70a8109c30 tx=0x7f7094009260 comp rx=0 tx=0).stop 2024-06-13T11:19:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.351+0000 7f70ad400700 1 -- 172.21.15.2:0/1325033256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a81045c0 msgr2=0x7f70a81a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.351+0000 7f70ad400700 1 --2- 172.21.15.2:0/1325033256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a81045c0 0x7f70a81a08e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f70980095b0 tx=0x7f7098005590 comp rx=0 tx=0).stop 2024-06-13T11:19:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.351+0000 7f70ad400700 1 -- 172.21.15.2:0/1325033256 shutdown_connections 2024-06-13T11:19:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.351+0000 7f70ad400700 1 --2- 172.21.15.2:0/1325033256 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f708c0a2ca0 0x7f708c0a5160 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.351+0000 7f70ad400700 1 --2- 172.21.15.2:0/1325033256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70a810a670 0x7f70a819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:19.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.351+0000 7f70ad400700 1 --2- 172.21.15.2:0/1325033256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a81045c0 0x7f70a81a08e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.351+0000 7f70ad400700 1 --2- 172.21.15.2:0/1325033256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70a8104f80 0x7f70a81a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.351+0000 7f70ad400700 1 -- 172.21.15.2:0/1325033256 >> 172.21.15.2:0/1325033256 conn(0x7f70a8100070 msgr2=0x7f70a8101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.352+0000 7f70ad400700 1 -- 172.21.15.2:0/1325033256 shutdown_connections 2024-06-13T11:19:19.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:19.352+0000 7f70ad400700 1 -- 172.21.15.2:0/1325033256 wait complete. 2024-06-13T11:19:19.353 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-06-13T11:19:20.179 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T11:19:20.260 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:19 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1325033256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:19:20.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:19 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1325033256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:19:20.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:19 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1325033256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:19:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:19:21.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:20 smithi002 ceph-mon[32210]: pgmap v352: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:21.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:20 smithi077 ceph-mon[36410]: pgmap v352: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:21.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:20 smithi178 ceph-mon[36913]: pgmap v352: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:22.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.910+0000 7fa037000700 1 -- 172.21.15.2:0/931651577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0301006b0 msgr2=0x7fa030100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:22.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.910+0000 7fa037000700 1 --2- 172.21.15.2:0/931651577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0301006b0 0x7fa030100b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009990 tx=0x7fa01c009ca0 comp rx=0 tx=0).stop 2024-06-13T11:19:22.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.910+0000 7fa037000700 1 -- 172.21.15.2:0/931651577 shutdown_connections 2024-06-13T11:19:22.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.910+0000 7fa037000700 1 --2- 172.21.15.2:0/931651577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0301066b0 0x7fa030106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:22.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.910+0000 7fa037000700 1 --2- 172.21.15.2:0/931651577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa030101070 0x7fa03010d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:22.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.910+0000 7fa037000700 1 --2- 172.21.15.2:0/931651577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0301006b0 0x7fa030100b30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:22.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.910+0000 7fa037000700 1 -- 172.21.15.2:0/931651577 >> 172.21.15.2:0/931651577 conn(0x7fa030077590 msgr2=0x7fa0300fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:22.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.910+0000 7fa037000700 1 -- 172.21.15.2:0/931651577 shutdown_connections 2024-06-13T11:19:22.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.910+0000 7fa037000700 1 -- 172.21.15.2:0/931651577 wait complete. 2024-06-13T11:19:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.911+0000 7fa037000700 1 Processor -- start 2024-06-13T11:19:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.912+0000 7fa037000700 1 -- start start 2024-06-13T11:19:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.912+0000 7fa037000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0301006b0 0x7fa03019ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.912+0000 7fa037000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa030101070 0x7fa03019b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.912+0000 7fa037000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0301066b0 0x7fa03019f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.912+0000 7fa037000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa030111700 con 0x7fa0301006b0 2024-06-13T11:19:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.912+0000 7fa037000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa030111580 con 0x7fa0301066b0 2024-06-13T11:19:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.912+0000 7fa037000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa030111880 con 0x7fa030101070 2024-06-13T11:19:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.912+0000 7fa02f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa030101070 0x7fa03019b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.912+0000 7fa02f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa030101070 0x7fa03019b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55482/0 (socket says 172.21.15.2:55482) 2024-06-13T11:19:22.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.912+0000 7fa02f400700 1 -- 172.21.15.2:0/3127901394 learned_addr learned my addr 172.21.15.2:0/3127901394 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:19:22.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.912+0000 7fa02fe00700 1 --2- 172.21.15.2:0/3127901394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0301006b0 0x7fa03019ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:22.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.913+0000 7fa035000700 1 --2- 172.21.15.2:0/3127901394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0301066b0 0x7fa03019f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:22.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.913+0000 7fa02f400700 1 -- 172.21.15.2:0/3127901394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0301066b0 msgr2=0x7fa03019f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:22.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.913+0000 7fa02f400700 1 --2- 172.21.15.2:0/3127901394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0301066b0 0x7fa03019f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:22.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.913+0000 7fa02f400700 1 -- 172.21.15.2:0/3127901394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0301006b0 msgr2=0x7fa03019ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:22.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.913+0000 7fa02f400700 1 --2- 172.21.15.2:0/3127901394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0301006b0 0x7fa03019ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:22.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.913+0000 7fa02f400700 1 -- 172.21.15.2:0/3127901394 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa03019fe60 con 0x7fa030101070 2024-06-13T11:19:22.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.913+0000 7fa035000700 1 --2- 172.21.15.2:0/3127901394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0301066b0 0x7fa03019f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:19:22.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.913+0000 7fa02f400700 1 --2- 172.21.15.2:0/3127901394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa030101070 0x7fa03019b390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa01c000c00 tx=0x7fa01c00bb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:22.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.914+0000 7fa02cc00700 1 -- 172.21.15.2:0/3127901394 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c027070 con 0x7fa030101070 2024-06-13T11:19:22.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.914+0000 7fa037000700 1 -- 172.21.15.2:0/3127901394 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0301a00f0 con 0x7fa030101070 2024-06-13T11:19:22.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.914+0000 7fa02cc00700 1 -- 172.21.15.2:0/3127901394 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa01c003d70 con 0x7fa030101070 2024-06-13T11:19:22.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.914+0000 7fa037000700 1 -- 172.21.15.2:0/3127901394 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0301a79d0 con 0x7fa030101070 2024-06-13T11:19:22.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.914+0000 7fa02cc00700 1 -- 172.21.15.2:0/3127901394 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c00f460 con 0x7fa030101070 2024-06-13T11:19:22.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.915+0000 7fa037000700 1 -- 172.21.15.2:0/3127901394 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa030101df0 con 0x7fa030101070 2024-06-13T11:19:22.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.919+0000 7fa02cc00700 1 -- 172.21.15.2:0/3127901394 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fa01c009d10 con 0x7fa030101070 2024-06-13T11:19:22.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.920+0000 7fa02cc00700 1 --2- 172.21.15.2:0/3127901394 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fa0140a2c20 0x7fa0140a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:22.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.920+0000 7fa02cc00700 1 -- 172.21.15.2:0/3127901394 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7fa01c0d05b0 con 0x7fa030101070 2024-06-13T11:19:22.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.920+0000 7fa02fe00700 1 --2- 172.21.15.2:0/3127901394 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fa0140a2c20 0x7fa0140a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:22.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.921+0000 7fa02fe00700 1 --2- 172.21.15.2:0/3127901394 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fa0140a2c20 0x7fa0140a50e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa020009bd0 tx=0x7fa020009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:22.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:22.921+0000 7fa02cc00700 1 -- 172.21.15.2:0/3127901394 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa01c013070 con 0x7fa030101070 2024-06-13T11:19:23.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:22 smithi002 ceph-mon[32210]: pgmap v353: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:23.158+0000 7fa037000700 1 -- 172.21.15.2:0/3127901394 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa03019c1e0 con 0x7fa030101070 2024-06-13T11:19:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:23.160+0000 7fa02cc00700 1 -- 172.21.15.2:0/3127901394 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24058 (secure 0 0 0) 0x7fa03019c1e0 con 0x7fa030101070 2024-06-13T11:19:23.160 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:19:23.160 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":95,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","created":"2024-06-13T11:09:07.839101+0000","modified":"2024-06-13T11:19:03.970443+0000","last_up_change":"2024-06-13T11:17:28.731479+0000","last_in_change":"2024-06-13T11:17:08.849067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:13:13.793461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:18:36.784824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:18:41.824835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:18:55.545870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f5614d91-49a7-4983-a309-0de3b3e6263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6803","nonce":4127571834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6805","nonce":4127571834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6809","nonce":4127571834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6807","nonce":4127571834}]},"public_addr":"172.21.15.2:6803/4127571834","cluster_addr":"172.21.15.2:6805/4127571834","heartbeat_back_addr":"172.21.15.2:6809/4127571834","heartbeat_front_addr":"172.21.15.2:6807/4127571834","state":["exists","up"]},{"osd":1,"uuid":"d9dbe278-309f-4726-828a-da922f486b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6801","nonce":3180360713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6803","nonce":3180360713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6807","nonce":3180360713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6805","nonce":3180360713}]},"public_addr":"172.21.15.77:6801/3180360713","cluster_addr":"172.21.15.77:6803/3180360713","heartbeat_back_addr":"172.21.15.77:6807/3180360713","heartbeat_front_addr":"172.21.15.77:6805/3180360713","state":["exists","up"]},{"osd":2,"uuid":"04c267dc-7454-418f-9965-3ff96ef280ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6801","nonce":3825510575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6803","nonce":3825510575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6807","nonce":3825510575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6805","nonce":3825510575}]},"public_addr":"172.21.15.178:6801/3825510575","cluster_addr":"172.21.15.178:6803/3825510575","heartbeat_back_addr":"172.21.15.178:6807/3825510575","heartbeat_front_addr":"172.21.15.178:6805/3825510575","state":["exists","up"]},{"osd":3,"uuid":"3847bd4f-ca04-41de-9d88-e1523dd7ff8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6811","nonce":1982693353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6813","nonce":1982693353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6817","nonce":1982693353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6815","nonce":1982693353}]},"public_addr":"172.21.15.2:6811/1982693353","cluster_addr":"172.21.15.2:6813/1982693353","heartbeat_back_addr":"172.21.15.2:6817/1982693353","heartbeat_front_addr":"172.21.15.2:6815/1982693353","state":["exists","up"]},{"osd":4,"uuid":"34d7d2e8-3dee-42b9-a6cb-d4162b122b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6809","nonce":3916694904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6811","nonce":3916694904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6815","nonce":3916694904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6813","nonce":3916694904}]},"public_addr":"172.21.15.77:6809/3916694904","cluster_addr":"172.21.15.77:6811/3916694904","heartbeat_back_addr":"172.21.15.77:6815/3916694904","heartbeat_front_addr":"172.21.15.77:6813/3916694904","state":["exists","up"]},{"osd":5,"uuid":"0468aefc-c3c8-4758-9bbf-1225b7a5ae79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6809","nonce":3572805887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6811","nonce":3572805887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6815","nonce":3572805887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6813","nonce":3572805887}]},"public_addr":"172.21.15.178:6809/3572805887","cluster_addr":"172.21.15.178:6811/3572805887","heartbeat_back_addr":"172.21.15.178:6815/3572805887","heartbeat_front_addr":"172.21.15.178:6813/3572805887","state":["exists","up"]},{"osd":6,"uuid":"0a186a4a-0e28-47bd-b5ad-9bf8079f74c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6819","nonce":1592309584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6821","nonce":1592309584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6825","nonce":1592309584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6823","nonce":1592309584}]},"public_addr":"172.21.15.2:6819/1592309584","cluster_addr":"172.21.15.2:6821/1592309584","heartbeat_back_addr":"172.21.15.2:6825/1592309584","heartbeat_front_addr":"172.21.15.2:6823/1592309584","state":["exists","up"]},{"osd":7,"uuid":"646e66f7-1ef8-428d-a842-bf28c8606df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6817","nonce":1580055775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6819","nonce":1580055775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6823","nonce":1580055775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6821","nonce":1580055775}]},"public_addr":"172.21.15.77:6817/1580055775","cluster_addr":"172.21.15.77:6819/1580055775","heartbeat_back_addr":"172.21.15.77:6823/1580055775","heartbeat_front_addr":"172.21.15.77:6821/1580055775","state":["exists","up"]},{"osd":8,"uuid":"bcc971fc-47d7-4289-8a9a-c76996c57370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6817","nonce":4285192591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6819","nonce":4285192591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6823","nonce":4285192591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6821","nonce":4285192591}]},"public_addr":"172.21.15.178:6817/4285192591","cluster_addr":"172.21.15.178:6819/4285192591","heartbeat_back_addr":"172.21.15.178:6823/4285192591","heartbeat_front_addr":"172.21.15.178:6821/4285192591","state":["exists","up"]},{"osd":9,"uuid":"899d7d4f-a24c-4508-b42c-0b363275c459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6827","nonce":4187017478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6829","nonce":4187017478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6833","nonce":4187017478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6831","nonce":4187017478}]},"public_addr":"172.21.15.2:6827/4187017478","cluster_addr":"172.21.15.2:6829/4187017478","heartbeat_back_addr":"172.21.15.2:6833/4187017478","heartbeat_front_addr":"172.21.15.2:6831/4187017478","state":["exists","up"]},{"osd":10,"uuid":"112d2b8e-9673-4d7a-97e9-2089793fdd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6825","nonce":2039538463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6827","nonce":2039538463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6831","nonce":2039538463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6829","nonce":2039538463}]},"public_addr":"172.21.15.77:6825/2039538463","cluster_addr":"172.21.15.77:6827/2039538463","heartbeat_back_addr":"172.21.15.77:6831/2039538463","heartbeat_front_addr":"172.21.15.77:6829/2039538463","state":["exists","up"]},{"osd":11,"uuid":"6b8001f5-9c74-4cc7-8c41-906cb5ac9b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6825","nonce":1915058767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6827","nonce":1915058767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6831","nonce":1915058767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6829","nonce":1915058767}]},"public_addr":"172.21.15.178:6825/1915058767","cluster_addr":"172.21.15.178:6827/1915058767","heartbeat_back_addr":"172.21.15.178:6831/1915058767","heartbeat_front_addr":"172.21.15.178:6829/1915058767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:21.707572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:46.440115+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:10.197217+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:42.853367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:08.880473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:33.605677+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:07.655377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:33.980900+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:59.397529+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:16:33.983411+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:00.932649+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:26.894098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/315567313":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/2084201061":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/3394644803":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6801/1821969949":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/2170469985":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/142516651":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6801/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/3220886565":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6800/1821969949":"2024-06-14T11:10:25.084617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:19:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:23.164+0000 7fa037000700 1 -- 172.21.15.2:0/3127901394 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fa0140a2c20 msgr2=0x7fa0140a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:23.164+0000 7fa037000700 1 --2- 172.21.15.2:0/3127901394 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fa0140a2c20 0x7fa0140a50e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa020009bd0 tx=0x7fa020009260 comp rx=0 tx=0).stop 2024-06-13T11:19:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:23.164+0000 7fa037000700 1 -- 172.21.15.2:0/3127901394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa030101070 msgr2=0x7fa03019b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:23.164+0000 7fa037000700 1 --2- 172.21.15.2:0/3127901394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa030101070 0x7fa03019b390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa01c000c00 tx=0x7fa01c00bb60 comp rx=0 tx=0).stop 2024-06-13T11:19:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:23.164+0000 7fa037000700 1 -- 172.21.15.2:0/3127901394 shutdown_connections 2024-06-13T11:19:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:23.164+0000 7fa037000700 1 --2- 172.21.15.2:0/3127901394 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fa0140a2c20 0x7fa0140a50e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:23.164+0000 7fa037000700 1 --2- 172.21.15.2:0/3127901394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0301006b0 0x7fa03019ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:23.164+0000 7fa037000700 1 --2- 172.21.15.2:0/3127901394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0301066b0 0x7fa03019f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:23.164+0000 7fa037000700 1 --2- 172.21.15.2:0/3127901394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa030101070 0x7fa03019b390 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:23.164+0000 7fa037000700 1 -- 172.21.15.2:0/3127901394 >> 172.21.15.2:0/3127901394 conn(0x7fa030077590 msgr2=0x7fa03010e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:23.164+0000 7fa037000700 1 -- 172.21.15.2:0/3127901394 shutdown_connections 2024-06-13T11:19:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:23.164+0000 7fa037000700 1 -- 172.21.15.2:0/3127901394 wait complete. 2024-06-13T11:19:23.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:22 smithi077 ceph-mon[36410]: pgmap v353: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:23.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:22 smithi178 ceph-mon[36913]: pgmap v353: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:23.984 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-13T11:18:45.943965+0000', 'modified': '2024-06-13T11:19:03.970662+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24511}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24511': {'gid': 24511, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.178:6839/970862278', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6838', 'nonce': 970862278}, {'type': 'v1', 'addr': '172.21.15.178:6839', 'nonce': 970862278}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24511, 'qdb_cluster': [24511]} 2024-06-13T11:19:23.984 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-13T11:19:23.984 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.i status 2024-06-13T11:19:24.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:23 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3127901394' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:19:24.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:23 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3127901394' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:19:24.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:23 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3127901394' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:19:24.455 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:19:25.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:24 smithi002 ceph-mon[32210]: pgmap v354: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:25.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:24 smithi077 ceph-mon[36410]: pgmap v354: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:25.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:24 smithi178 ceph-mon[36913]: pgmap v354: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:26.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-06-13T11:19:26.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]: dispatch 2024-06-13T11:19:26.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-06-13T11:19:26.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-06-13T11:19:26.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-06-13T11:19:26.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-06-13T11:19:26.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9, 5, 7]}]: dispatch 2024-06-13T11:19:26.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:25 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-06-13T11:19:26.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:25 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-06-13T11:19:26.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:25 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]: dispatch 2024-06-13T11:19:26.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:25 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-06-13T11:19:26.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:25 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-06-13T11:19:26.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:25 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-06-13T11:19:26.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:25 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-06-13T11:19:26.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:25 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9, 5, 7]}]: dispatch 2024-06-13T11:19:26.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:25 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-06-13T11:19:26.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-06-13T11:19:26.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]: dispatch 2024-06-13T11:19:26.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-06-13T11:19:26.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-06-13T11:19:26.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-06-13T11:19:26.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-06-13T11:19:26.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9, 5, 7]}]: dispatch 2024-06-13T11:19:26.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:25 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-06-13T11:19:26.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.661+0000 7f2934c00700 1 -- 172.21.15.2:0/1063668769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29300748c0 msgr2=0x7f2930074ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:26.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.661+0000 7f2934c00700 1 --2- 172.21.15.2:0/1063668769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29300748c0 0x7f2930074ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2920009f90 tx=0x7f292000b330 comp rx=0 tx=0).stop 2024-06-13T11:19:26.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.662+0000 7f2934c00700 1 -- 172.21.15.2:0/1063668769 shutdown_connections 2024-06-13T11:19:26.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.662+0000 7f2934c00700 1 --2- 172.21.15.2:0/1063668769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f293010ec00 0x7f2930111070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.662+0000 7f2934c00700 1 --2- 172.21.15.2:0/1063668769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29300748c0 0x7f2930074ca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.662+0000 7f2934c00700 1 --2- 172.21.15.2:0/1063668769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29300751e0 0x7f293010e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.662+0000 7f2934c00700 1 -- 172.21.15.2:0/1063668769 >> 172.21.15.2:0/1063668769 conn(0x7f29300fdf10 msgr2=0x7f2930100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:26.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.662+0000 7f2934c00700 1 -- 172.21.15.2:0/1063668769 shutdown_connections 2024-06-13T11:19:26.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.662+0000 7f2934c00700 1 -- 172.21.15.2:0/1063668769 wait complete. 2024-06-13T11:19:26.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.663+0000 7f2934c00700 1 Processor -- start 2024-06-13T11:19:26.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.663+0000 7f2934c00700 1 -- start start 2024-06-13T11:19:26.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f2934c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29300748c0 0x7f293019adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f2934c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29300751e0 0x7f293019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f2934c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f293010ec00 0x7f293019f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f2934c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2930114920 con 0x7f29300751e0 2024-06-13T11:19:26.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f2934c00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f29301147a0 con 0x7f29300748c0 2024-06-13T11:19:26.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f2934c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2930114aa0 con 0x7f293010ec00 2024-06-13T11:19:26.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f292f400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29300748c0 0x7f293019adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f292f400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29300748c0 0x7f293019adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:35532/0 (socket says 172.21.15.2:35532) 2024-06-13T11:19:26.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f292f400700 1 -- 172.21.15.2:0/806181343 learned_addr learned my addr 172.21.15.2:0/806181343 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:19:26.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f2926a00700 1 --2- 172.21.15.2:0/806181343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29300751e0 0x7f293019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f292fe00700 1 --2- 172.21.15.2:0/806181343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f293010ec00 0x7f293019f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f292f400700 1 -- 172.21.15.2:0/806181343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f293010ec00 msgr2=0x7f293019f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:26.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f292f400700 1 --2- 172.21.15.2:0/806181343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f293010ec00 0x7f293019f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f292f400700 1 -- 172.21.15.2:0/806181343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29300751e0 msgr2=0x7f293019b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:26.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f292f400700 1 --2- 172.21.15.2:0/806181343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29300751e0 0x7f293019b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f292f400700 1 -- 172.21.15.2:0/806181343 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293019fe00 con 0x7f29300748c0 2024-06-13T11:19:26.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.664+0000 7f292fe00700 1 --2- 172.21.15.2:0/806181343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f293010ec00 0x7f293019f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:19:26.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.665+0000 7f292f400700 1 --2- 172.21.15.2:0/806181343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29300748c0 0x7f293019adf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2920004f20 tx=0x7f2920004f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:26.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.665+0000 7f292cc00700 1 -- 172.21.15.2:0/806181343 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920021070 con 0x7f29300748c0 2024-06-13T11:19:26.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.665+0000 7f292cc00700 1 -- 172.21.15.2:0/806181343 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2920007ac0 con 0x7f29300748c0 2024-06-13T11:19:26.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.665+0000 7f2934c00700 1 -- 172.21.15.2:0/806181343 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29301a0090 con 0x7f29300748c0 2024-06-13T11:19:26.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.665+0000 7f292cc00700 1 -- 172.21.15.2:0/806181343 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29200052a0 con 0x7f29300748c0 2024-06-13T11:19:26.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.665+0000 7f2934c00700 1 -- 172.21.15.2:0/806181343 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29301a7970 con 0x7f29300748c0 2024-06-13T11:19:26.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.669+0000 7f292cc00700 1 -- 172.21.15.2:0/806181343 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f2920024070 con 0x7f29300748c0 2024-06-13T11:19:26.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.670+0000 7f2940b0db80 1 Processor -- start 2024-06-13T11:19:26.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.670+0000 7f2940b0db80 1 -- start start 2024-06-13T11:19:26.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.671+0000 7f2940b0db80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225604df0 0x55922568a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.671+0000 7f2940b0db80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55922568a910 0x55922568ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.671+0000 7f2940b0db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225693520 0x559225695910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.671+0000 7f2940b0db80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5592255979c0 con 0x559225604df0 2024-06-13T11:19:26.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.671+0000 7f2940b0db80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5592255daab0 con 0x55922568a910 2024-06-13T11:19:26.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.671+0000 7f2940b0db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5592255958a0 con 0x559225693520 2024-06-13T11:19:26.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.671+0000 7f292fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225604df0 0x55922568a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.671+0000 7f292cc00700 1 --2- 172.21.15.2:0/806181343 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29140a2c20 0x7f29140a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.671+0000 7f292fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225604df0 0x55922568a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38438/0 (socket says 172.21.15.2:38438) 2024-06-13T11:19:26.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.671+0000 7f2926a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225693520 0x559225695910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.671+0000 7f292fe00700 1 -- 172.21.15.2:0/1035694446 learned_addr learned my addr 172.21.15.2:0/1035694446 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:19:26.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.671+0000 7f292f400700 1 --2- 172.21.15.2:0/1035694446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55922568a910 0x55922568ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.672+0000 7f292cc00700 1 -- 172.21.15.2:0/806181343 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9050+0+0 (secure 0 0 0) 0x7f292000f020 con 0x7f29300748c0 2024-06-13T11:19:26.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.672+0000 7f2926a00700 1 -- 172.21.15.2:0/1035694446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55922568a910 msgr2=0x55922568ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:19:26.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.672+0000 7f2926a00700 1 --2- 172.21.15.2:0/1035694446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55922568a910 0x55922568ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.672+0000 7f2926a00700 1 -- 172.21.15.2:0/1035694446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225604df0 msgr2=0x55922568a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:19:26.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.672+0000 7f2926a00700 1 --2- 172.21.15.2:0/1035694446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225604df0 0x55922568a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.672+0000 7f2926a00700 1 -- 172.21.15.2:0/1035694446 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559225582f40 con 0x559225693520 2024-06-13T11:19:26.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.672+0000 7f292fe00700 1 --2- 172.21.15.2:0/806181343 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29140a2c20 0x7f29140a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.672+0000 7f2926a00700 1 --2- 172.21.15.2:0/1035694446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225693520 0x559225695910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2918005fd0 tx=0x7f2918011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4ead9fbd971ad4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:26.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.672+0000 7f2924c00700 1 -- 172.21.15.2:0/1035694446 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918004250 con 0x559225693520 2024-06-13T11:19:26.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.673+0000 7f2924c00700 1 -- 172.21.15.2:0/1035694446 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29180043f0 con 0x559225693520 2024-06-13T11:19:26.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.673+0000 7f2924c00700 1 -- 172.21.15.2:0/1035694446 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918019910 con 0x559225693520 2024-06-13T11:19:26.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.673+0000 7f2940b0db80 1 -- 172.21.15.2:0/1035694446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225693520 msgr2=0x559225695910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:26.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.673+0000 7f2940b0db80 1 --2- 172.21.15.2:0/1035694446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225693520 0x559225695910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2918005fd0 tx=0x7f2918011720 comp rx=0 tx=0).stop 2024-06-13T11:19:26.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.673+0000 7f292fe00700 1 --2- 172.21.15.2:0/806181343 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29140a2c20 0x7f29140a50e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f29280126b0 tx=0x7f29280047c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:26.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.673+0000 7f2940b0db80 1 -- 172.21.15.2:0/1035694446 shutdown_connections 2024-06-13T11:19:26.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.673+0000 7f2940b0db80 1 --2- 172.21.15.2:0/1035694446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225604df0 0x55922568a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.673+0000 7f2940b0db80 1 --2- 172.21.15.2:0/1035694446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225693520 0x559225695910 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.673+0000 7f2940b0db80 1 --2- 172.21.15.2:0/1035694446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55922568a910 0x55922568ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.673+0000 7f2940b0db80 1 -- 172.21.15.2:0/1035694446 >> 172.21.15.2:0/1035694446 conn(0x5592255b5120 msgr2=0x5592256847d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:26.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.674+0000 7f2940b0db80 1 -- 172.21.15.2:0/1035694446 shutdown_connections 2024-06-13T11:19:26.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.674+0000 7f2940b0db80 1 -- 172.21.15.2:0/1035694446 wait complete. 2024-06-13T11:19:26.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.674+0000 7f2940b0db80 1 -- start start 2024-06-13T11:19:26.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.674+0000 7f2940b0db80 1 Processor -- start 2024-06-13T11:19:26.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.675+0000 7f2940b0db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225604df0 0x559225692be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.675+0000 7f2940b0db80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55922568a910 0x55922568fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.675+0000 7f2940b0db80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225693520 0x559225690420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.675+0000 7f2940b0db80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559225576f10 con 0x559225693520 2024-06-13T11:19:26.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.675+0000 7f2940b0db80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5592255d6a70 con 0x55922568a910 2024-06-13T11:19:26.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.675+0000 7f2940b0db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559225696130 con 0x559225604df0 2024-06-13T11:19:26.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.675+0000 7f2940b0db80 10 client.0 _ll_register_callbacks cb 0x5592255746d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:19:26.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.675+0000 7f292f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225604df0 0x559225692be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.675+0000 7f292f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225604df0 0x559225692be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:59668/0 (socket says 172.21.15.2:59668) 2024-06-13T11:19:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.675+0000 7f2926a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55922568a910 0x55922568fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.675+0000 7f292f400700 1 -- 172.21.15.2:0/2014570443 learned_addr learned my addr 172.21.15.2:0/2014570443 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:19:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.675+0000 7f292fe00700 1 --2- 172.21.15.2:0/2014570443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225693520 0x559225690420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.675+0000 7f292f400700 1 -- 172.21.15.2:0/2014570443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55922568a910 msgr2=0x55922568fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:19:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.676+0000 7f292f400700 1 --2- 172.21.15.2:0/2014570443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55922568a910 0x55922568fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.676+0000 7f292f400700 1 -- 172.21.15.2:0/2014570443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225693520 msgr2=0x559225690420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:19:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.676+0000 7f292f400700 1 --2- 172.21.15.2:0/2014570443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225693520 0x559225690420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.676+0000 7f292f400700 1 -- 172.21.15.2:0/2014570443 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559225529880 con 0x559225604df0 2024-06-13T11:19:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.676+0000 7f292fe00700 1 --2- 172.21.15.2:0/2014570443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225693520 0x559225690420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:19:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.676+0000 7f292f400700 1 --2- 172.21.15.2:0/2014570443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225604df0 0x559225692be0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2920099730 tx=0x7f292006bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5feafd80f9a7b346 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:26.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.676+0000 7f291d600700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:19:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.676+0000 7f291d600700 1 -- 172.21.15.2:0/2014570443 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920067e40 con 0x559225604df0 2024-06-13T11:19:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.676+0000 7f291d600700 1 -- 172.21.15.2:0/2014570443 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9050+0+0 (secure 0 0 0) 0x7f2920007c70 con 0x559225604df0 2024-06-13T11:19:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.676+0000 7f2940b0db80 1 -- 172.21.15.2:0/2014570443 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29180043f0 con 0x559225604df0 2024-06-13T11:19:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.676+0000 7f291d600700 1 -- 172.21.15.2:0/2014570443 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f292009d460 con 0x559225604df0 2024-06-13T11:19:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.676+0000 7f2940b0db80 10 client.24628 fetch_fsmap learned FSMap version 17 2024-06-13T11:19:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.676+0000 7f2940b0db80 1 -- 172.21.15.2:0/2014570443 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5592256a0810 con 0x559225604df0 2024-06-13T11:19:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.677+0000 7f291d600700 1 -- 172.21.15.2:0/2014570443 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29180043f0 con 0x559225604df0 2024-06-13T11:19:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.677+0000 7f291d600700 1 -- 172.21.15.2:0/2014570443 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7f2920087040 con 0x559225604df0 2024-06-13T11:19:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.677+0000 7f2940b0db80 10 client.24628 fetch_fsmap finished waiting for FSMap version 17 2024-06-13T11:19:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.677+0000 7f2940b0db80 10 client.24628 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-13T11:19:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.677+0000 7f2940b0db80 20 client.24628 populate_metadata read hostname 'smithi002' 2024-06-13T11:19:26.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.677+0000 7f2940b0db80 1 --2- 172.21.15.2:0/2014570443 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5592256a2e60 0x5592256a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.677+0000 7f2940b0db80 4 client.24628 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:19:26.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.677+0000 7f2940b0db80 1 -- 172.21.15.2:0/2014570443 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592255e7fb0 con 0x5592256a2e60 2024-06-13T11:19:26.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.678+0000 7f2926a00700 1 --2- 172.21.15.2:0/2014570443 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5592256a2e60 0x5592256a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.678+0000 7f2926a00700 1 --2- 172.21.15.2:0/2014570443 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5592256a2e60 0x5592256a42d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbabb8b49f2ad104 server_cookie=98d797af00f2cde8 in_seq=0 out_seq=0 2024-06-13T11:19:26.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.678+0000 7f291d600700 10 client.24628 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:19:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.679+0000 7f291d600700 1 -- 172.21.15.2:0/2014570443 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5592255e7fb0 con 0x5592256a2e60 2024-06-13T11:19:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.679+0000 7f291d600700 10 client.24628 handle_command_reply: tid=0 2024-06-13T11:19:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.679+0000 7f2940b0db80 1 client.24628 shutdown 2024-06-13T11:19:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.679+0000 7f2940b0db80 1 -- 172.21.15.2:0/2014570443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225604df0 msgr2=0x559225692be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.679+0000 7f2940b0db80 1 --2- 172.21.15.2:0/2014570443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225604df0 0x559225692be0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2920099730 tx=0x7f292006bce0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.679+0000 7f2940b0db80 1 -- 172.21.15.2:0/2014570443 shutdown_connections 2024-06-13T11:19:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.679+0000 7f2940b0db80 1 --2- 172.21.15.2:0/2014570443 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5592256a2e60 0x5592256a42d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.679+0000 7f2940b0db80 1 --2- 172.21.15.2:0/2014570443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225693520 0x559225690420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.679+0000 7f2940b0db80 1 --2- 172.21.15.2:0/2014570443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225604df0 0x559225692be0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.679+0000 7f291d600700 0 client.24628 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:19:26.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.679+0000 7f2940b0db80 1 --2- 172.21.15.2:0/2014570443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55922568a910 0x55922568fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.680+0000 7f2940b0db80 1 -- 172.21.15.2:0/2014570443 >> 172.21.15.2:0/2014570443 conn(0x5592255b5120 msgr2=0x5592256843c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:26.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.680+0000 7f2940b0db80 1 -- 172.21.15.2:0/2014570443 shutdown_connections 2024-06-13T11:19:26.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.680+0000 7f2940b0db80 1 -- 172.21.15.2:0/2014570443 wait complete. 2024-06-13T11:19:26.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.680+0000 7f2940b0db80 20 client.24628 trim_cache size 0 max 16384 2024-06-13T11:19:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.705+0000 7f2940b0db80 1 Processor -- start 2024-06-13T11:19:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.705+0000 7f2940b0db80 1 -- start start 2024-06-13T11:19:26.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.705+0000 7f2940b0db80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559225604df0 0x559225690470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.705+0000 7f2940b0db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55922568a910 0x559225691710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.705+0000 7f2940b0db80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225693520 0x559225691c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.705+0000 7f2940b0db80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5592256a2610 con 0x559225693520 2024-06-13T11:19:26.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.705+0000 7f2940b0db80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5592256a2ce0 con 0x559225604df0 2024-06-13T11:19:26.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.705+0000 7f2940b0db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5592256a33b0 con 0x55922568a910 2024-06-13T11:19:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.706+0000 7f292fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225693520 0x559225691c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.706+0000 7f292f400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559225604df0 0x559225690470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.706+0000 7f292fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225693520 0x559225691c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38470/0 (socket says 172.21.15.2:38470) 2024-06-13T11:19:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.706+0000 7f292fe00700 1 -- 172.21.15.2:0/2960023961 learned_addr learned my addr 172.21.15.2:0/2960023961 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:19:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.706+0000 7f2926a00700 1 --2- 172.21.15.2:0/2960023961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55922568a910 0x559225691710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.706+0000 7f292f400700 1 -- 172.21.15.2:0/2960023961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55922568a910 msgr2=0x559225691710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:19:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.706+0000 7f292f400700 1 --2- 172.21.15.2:0/2960023961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55922568a910 0x559225691710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.706+0000 7f292f400700 1 -- 172.21.15.2:0/2960023961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225693520 msgr2=0x559225691c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:19:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.706+0000 7f292f400700 1 --2- 172.21.15.2:0/2960023961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225693520 0x559225691c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.706+0000 7f292f400700 1 -- 172.21.15.2:0/2960023961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55922568e470 con 0x559225604df0 2024-06-13T11:19:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.706+0000 7f292f400700 1 --2- 172.21.15.2:0/2960023961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559225604df0 0x559225690470 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f292006fdf0 tx=0x7f292000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=775da7316da26b7e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.707+0000 7f291fe00700 1 -- 172.21.15.2:0/2960023961 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292006a020 con 0x559225604df0 2024-06-13T11:19:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.707+0000 7f291fe00700 1 -- 172.21.15.2:0/2960023961 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f292009cd60 con 0x559225604df0 2024-06-13T11:19:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.707+0000 7f291fe00700 1 -- 172.21.15.2:0/2960023961 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292009c3a0 con 0x559225604df0 2024-06-13T11:19:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.707+0000 7f2940b0db80 1 -- 172.21.15.2:0/2960023961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559225604df0 msgr2=0x559225690470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.707+0000 7f2940b0db80 1 --2- 172.21.15.2:0/2960023961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559225604df0 0x559225690470 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f292006fdf0 tx=0x7f292000b330 comp rx=0 tx=0).stop 2024-06-13T11:19:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.707+0000 7f2940b0db80 1 -- 172.21.15.2:0/2960023961 shutdown_connections 2024-06-13T11:19:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.707+0000 7f2940b0db80 1 --2- 172.21.15.2:0/2960023961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559225693520 0x559225691c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.707+0000 7f2940b0db80 1 --2- 172.21.15.2:0/2960023961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559225604df0 0x559225690470 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.707+0000 7f2940b0db80 1 --2- 172.21.15.2:0/2960023961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55922568a910 0x559225691710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.707+0000 7f2940b0db80 1 -- 172.21.15.2:0/2960023961 >> 172.21.15.2:0/2960023961 conn(0x5592255b5120 msgr2=0x55922568e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.708+0000 7f2940b0db80 1 -- 172.21.15.2:0/2960023961 shutdown_connections 2024-06-13T11:19:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.708+0000 7f2940b0db80 1 -- 172.21.15.2:0/2960023961 wait complete. 2024-06-13T11:19:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.708+0000 7f2940b0db80 1 -- start start 2024-06-13T11:19:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.708+0000 7f2940b0db80 1 Processor -- start 2024-06-13T11:19:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f2940b0db80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559225604df0 0x5592256ae030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f2940b0db80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922568a910 0x55922568cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f2940b0db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225693520 0x55922568d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f2940b0db80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5592256a4150 con 0x55922568a910 2024-06-13T11:19:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f2940b0db80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5592256a3a80 con 0x559225604df0 2024-06-13T11:19:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f2940b0db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5592256a4820 con 0x559225693520 2024-06-13T11:19:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f2940b0db80 10 client.0 _ll_register_callbacks cb 0x5592255746d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:19:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f2926a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922568a910 0x55922568cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f292f400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559225604df0 0x5592256ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f292f400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559225604df0 0x5592256ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:35572/0 (socket says 172.21.15.2:35572) 2024-06-13T11:19:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f2926a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922568a910 0x55922568cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38480/0 (socket says 172.21.15.2:38480) 2024-06-13T11:19:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f292f400700 1 -- 172.21.15.2:0/3150758404 learned_addr learned my addr 172.21.15.2:0/3150758404 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:19:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f292fe00700 1 --2- 172.21.15.2:0/3150758404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225693520 0x55922568d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f292f400700 1 -- 172.21.15.2:0/3150758404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225693520 msgr2=0x55922568d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:19:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f292f400700 1 --2- 172.21.15.2:0/3150758404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225693520 0x55922568d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f292f400700 1 -- 172.21.15.2:0/3150758404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922568a910 msgr2=0x55922568cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:19:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f292f400700 1 --2- 172.21.15.2:0/3150758404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922568a910 0x55922568cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.709+0000 7f292f400700 1 -- 172.21.15.2:0/3150758404 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592256abb20 con 0x559225604df0 2024-06-13T11:19:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.710+0000 7f2926a00700 1 --2- 172.21.15.2:0/3150758404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922568a910 0x55922568cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:19:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.710+0000 7f292f400700 1 --2- 172.21.15.2:0/3150758404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559225604df0 0x5592256ae030 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2920009f60 tx=0x7f2920097780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6e7c997fb2bd6be server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.710+0000 7f291d600700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:19:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.710+0000 7f291d600700 1 -- 172.21.15.2:0/3150758404 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292006a070 con 0x559225604df0 2024-06-13T11:19:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.710+0000 7f2940b0db80 1 -- 172.21.15.2:0/3150758404 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f292009cd60 con 0x559225604df0 2024-06-13T11:19:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.710+0000 7f291d600700 1 -- 172.21.15.2:0/3150758404 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9050+0+0 (secure 0 0 0) 0x7f29200a3310 con 0x559225604df0 2024-06-13T11:19:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.710+0000 7f291d600700 1 -- 172.21.15.2:0/3150758404 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f29200a5940 con 0x559225604df0 2024-06-13T11:19:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.710+0000 7f2940b0db80 10 client.24608 fetch_fsmap learned FSMap version 17 2024-06-13T11:19:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.710+0000 7f2940b0db80 1 -- 172.21.15.2:0/3150758404 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5592256abb20 con 0x559225604df0 2024-06-13T11:19:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.711+0000 7f291d600700 1 -- 172.21.15.2:0/3150758404 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f292009cd60 con 0x559225604df0 2024-06-13T11:19:26.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.711+0000 7f291d600700 1 -- 172.21.15.2:0/3150758404 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7f2920087040 con 0x559225604df0 2024-06-13T11:19:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.711+0000 7f2940b0db80 10 client.24608 fetch_fsmap finished waiting for FSMap version 17 2024-06-13T11:19:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.711+0000 7f2940b0db80 10 client.24608 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-13T11:19:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.711+0000 7f2940b0db80 20 client.24608 populate_metadata read hostname 'smithi002' 2024-06-13T11:19:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.711+0000 7f2940b0db80 1 --2- 172.21.15.2:0/3150758404 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x559225712c70 0x559225711980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.711+0000 7f2940b0db80 4 client.24608 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T11:19:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.711+0000 7f2940b0db80 1 -- 172.21.15.2:0/3150758404 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "status"}) -- 0x5592255e2530 con 0x559225712c70 2024-06-13T11:19:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.711+0000 7f2926a00700 1 --2- 172.21.15.2:0/3150758404 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x559225712c70 0x559225711980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.712+0000 7f2926a00700 1 --2- 172.21.15.2:0/3150758404 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x559225712c70 0x559225711980 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2e377bc5c097acc server_cookie=3cc208b35a8b2002 in_seq=0 out_seq=0 2024-06-13T11:19:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.712+0000 7f291d600700 10 client.24608 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:19:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.712+0000 7f291d600700 1 -- 172.21.15.2:0/3150758404 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5592255e2530 con 0x559225712c70 2024-06-13T11:19:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.712+0000 7f291d600700 10 client.24608 handle_command_reply: tid=0 2024-06-13T11:19:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.712+0000 7f2940b0db80 1 client.24608 shutdown 2024-06-13T11:19:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.712+0000 7f2940b0db80 1 -- 172.21.15.2:0/3150758404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559225604df0 msgr2=0x5592256ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.712+0000 7f2940b0db80 1 --2- 172.21.15.2:0/3150758404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559225604df0 0x5592256ae030 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2920009f60 tx=0x7f2920097780 comp rx=0 tx=0).stop 2024-06-13T11:19:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.712+0000 7f2940b0db80 1 -- 172.21.15.2:0/3150758404 shutdown_connections 2024-06-13T11:19:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.712+0000 7f2940b0db80 1 --2- 172.21.15.2:0/3150758404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559225693520 0x55922568d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.712+0000 7f2940b0db80 1 --2- 172.21.15.2:0/3150758404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559225604df0 0x5592256ae030 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.712+0000 7f2940b0db80 1 --2- 172.21.15.2:0/3150758404 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x559225712c70 0x559225711980 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.712+0000 7f2940b0db80 1 --2- 172.21.15.2:0/3150758404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55922568a910 0x55922568cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.712+0000 7f2940b0db80 1 -- 172.21.15.2:0/3150758404 >> 172.21.15.2:0/3150758404 conn(0x5592255b5120 msgr2=0x55922568acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.712+0000 7f291d600700 0 client.24608 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:19:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.713+0000 7f2940b0db80 1 -- 172.21.15.2:0/3150758404 shutdown_connections 2024-06-13T11:19:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.713+0000 7f2940b0db80 1 -- 172.21.15.2:0/3150758404 wait complete. 2024-06-13T11:19:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.713+0000 7f2940b0db80 20 client.24608 trim_cache size 0 max 16384 2024-06-13T11:19:26.717 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:19:26.717 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "3611563c-2975-11ef-bc9c-c7b262605968", 2024-06-13T11:19:26.717 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-06-13T11:19:26.717 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24511, 2024-06-13T11:19:26.717 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-06-13T11:19:26.717 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-06-13T11:19:26.717 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-06-13T11:19:26.717 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 39.816461719000003, 2024-06-13T11:19:26.717 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 17, 2024-06-13T11:19:26.717 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 96, 2024-06-13T11:19:26.717 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 94, 2024-06-13T11:19:26.717 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 75.423907385999996 2024-06-13T11:19:26.717 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:19:26.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.713+0000 7f2934c00700 1 -- 172.21.15.2:0/806181343 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29140a2c20 msgr2=0x7f29140a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:26.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.713+0000 7f2934c00700 1 --2- 172.21.15.2:0/806181343 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29140a2c20 0x7f29140a50e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f29280126b0 tx=0x7f29280047c0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.713+0000 7f2934c00700 1 -- 172.21.15.2:0/806181343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29300748c0 msgr2=0x7f293019adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:26.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.713+0000 7f2934c00700 1 --2- 172.21.15.2:0/806181343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29300748c0 0x7f293019adf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2920004f20 tx=0x7f2920004f50 comp rx=0 tx=0).stop 2024-06-13T11:19:26.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.714+0000 7f2934c00700 1 -- 172.21.15.2:0/806181343 shutdown_connections 2024-06-13T11:19:26.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.714+0000 7f2934c00700 1 --2- 172.21.15.2:0/806181343 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29140a2c20 0x7f29140a50e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.714+0000 7f2934c00700 1 --2- 172.21.15.2:0/806181343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f293010ec00 0x7f293019f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.714+0000 7f2934c00700 1 --2- 172.21.15.2:0/806181343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29300748c0 0x7f293019adf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.714+0000 7f2934c00700 1 --2- 172.21.15.2:0/806181343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29300751e0 0x7f293019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.714+0000 7f2934c00700 1 -- 172.21.15.2:0/806181343 >> 172.21.15.2:0/806181343 conn(0x7f29300fdf10 msgr2=0x7f29300fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.714+0000 7f2934c00700 1 -- 172.21.15.2:0/806181343 shutdown_connections 2024-06-13T11:19:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:26.714+0000 7f2934c00700 1 -- 172.21.15.2:0/806181343 wait complete. 2024-06-13T11:19:27.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:27 smithi077 ceph-mon[36410]: pgmap v355: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:27.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-06-13T11:19:27.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]': finished 2024-06-13T11:19:27.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-06-13T11:19:27.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-06-13T11:19:27.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-06-13T11:19:27.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-06-13T11:19:27.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9, 5, 7]}]': finished 2024-06-13T11:19:27.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-06-13T11:19:27.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:27 smithi077 ceph-mon[36410]: osdmap e96: 12 total, 12 up, 12 in 2024-06-13T11:19:27.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:27 smithi002 ceph-mon[32210]: pgmap v355: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:27.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-06-13T11:19:27.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]': finished 2024-06-13T11:19:27.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-06-13T11:19:27.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-06-13T11:19:27.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-06-13T11:19:27.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-06-13T11:19:27.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9, 5, 7]}]': finished 2024-06-13T11:19:27.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-06-13T11:19:27.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:27 smithi002 ceph-mon[32210]: osdmap e96: 12 total, 12 up, 12 in 2024-06-13T11:19:27.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:27 smithi178 ceph-mon[36913]: pgmap v355: 129 pgs: 129 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:27.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-06-13T11:19:27.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]': finished 2024-06-13T11:19:27.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-06-13T11:19:27.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-06-13T11:19:27.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-06-13T11:19:27.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-06-13T11:19:27.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9, 5, 7]}]': finished 2024-06-13T11:19:27.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-06-13T11:19:27.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:27 smithi178 ceph-mon[36913]: osdmap e96: 12 total, 12 up, 12 in 2024-06-13T11:19:27.572 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-13T11:19:27.572 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-13T11:19:27.573 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs ls 2024-06-13T11:19:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:19:28.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:28 smithi077 ceph-mon[36410]: osdmap e97: 12 total, 12 up, 12 in 2024-06-13T11:19:28.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:28 smithi077 ceph-mon[36410]: pgmap v358: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:28.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:28 smithi002 ceph-mon[32210]: osdmap e97: 12 total, 12 up, 12 in 2024-06-13T11:19:28.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:28 smithi002 ceph-mon[32210]: pgmap v358: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:28.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:28 smithi178 ceph-mon[36913]: osdmap e97: 12 total, 12 up, 12 in 2024-06-13T11:19:28.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:28 smithi178 ceph-mon[36913]: pgmap v358: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:30.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.226+0000 7fc0ba000700 1 -- 172.21.15.2:0/941730138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0b410a690 msgr2=0x7fc0b410aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:30.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.226+0000 7fc0ba000700 1 --2- 172.21.15.2:0/941730138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0b410a690 0x7fc0b410aa70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400b0a0 tx=0x7fc0a400b3b0 comp rx=0 tx=0).stop 2024-06-13T11:19:30.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.227+0000 7fc0ba000700 1 -- 172.21.15.2:0/941730138 shutdown_connections 2024-06-13T11:19:30.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.227+0000 7fc0ba000700 1 --2- 172.21.15.2:0/941730138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0b410a690 0x7fc0b410aa70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:30.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.227+0000 7fc0ba000700 1 --2- 172.21.15.2:0/941730138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0b4105050 0x7fc0b4111560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:30.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.227+0000 7fc0ba000700 1 --2- 172.21.15.2:0/941730138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0b4104690 0x7fc0b4104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:30.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.227+0000 7fc0ba000700 1 -- 172.21.15.2:0/941730138 >> 172.21.15.2:0/941730138 conn(0x7fc0b41001a0 msgr2=0x7fc0b41025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:30.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.227+0000 7fc0ba000700 1 -- 172.21.15.2:0/941730138 shutdown_connections 2024-06-13T11:19:30.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.227+0000 7fc0ba000700 1 -- 172.21.15.2:0/941730138 wait complete. 2024-06-13T11:19:30.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.228+0000 7fc0ba000700 1 Processor -- start 2024-06-13T11:19:30.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.228+0000 7fc0ba000700 1 -- start start 2024-06-13T11:19:30.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.228+0000 7fc0ba000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0b4104690 0x7fc0b419adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:30.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.228+0000 7fc0ba000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0b4105050 0x7fc0b419b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:30.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.229+0000 7fc0ba000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0b410a690 0x7fc0b419f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:30.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.229+0000 7fc0ba000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b41149e0 con 0x7fc0b4105050 2024-06-13T11:19:30.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.229+0000 7fc0ba000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b4114860 con 0x7fc0b4104690 2024-06-13T11:19:30.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.229+0000 7fc0ba000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b4114b60 con 0x7fc0b410a690 2024-06-13T11:19:30.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.229+0000 7fc0b3400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0b4104690 0x7fc0b419adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:30.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.229+0000 7fc0aaa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0b4105050 0x7fc0b419b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:30.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.229+0000 7fc0b3400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0b4104690 0x7fc0b419adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:35582/0 (socket says 172.21.15.2:35582) 2024-06-13T11:19:30.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.229+0000 7fc0b3400700 1 -- 172.21.15.2:0/1465375217 learned_addr learned my addr 172.21.15.2:0/1465375217 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:19:30.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.229+0000 7fc0b3e00700 1 --2- 172.21.15.2:0/1465375217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0b410a690 0x7fc0b419f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:30.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.229+0000 7fc0b3400700 1 -- 172.21.15.2:0/1465375217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0b410a690 msgr2=0x7fc0b419f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:30.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.229+0000 7fc0b3400700 1 --2- 172.21.15.2:0/1465375217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0b410a690 0x7fc0b419f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:30.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.229+0000 7fc0b3400700 1 -- 172.21.15.2:0/1465375217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0b4105050 msgr2=0x7fc0b419b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:30.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.229+0000 7fc0b3400700 1 --2- 172.21.15.2:0/1465375217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0b4105050 0x7fc0b419b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:30.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.229+0000 7fc0b3400700 1 -- 172.21.15.2:0/1465375217 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b419fe00 con 0x7fc0b4104690 2024-06-13T11:19:30.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.230+0000 7fc0b3400700 1 --2- 172.21.15.2:0/1465375217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0b4104690 0x7fc0b419adf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40062a0 tx=0x7fc0a4004ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:30.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.230+0000 7fc0b0c00700 1 -- 172.21.15.2:0/1465375217 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4021070 con 0x7fc0b4104690 2024-06-13T11:19:30.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.230+0000 7fc0ba000700 1 -- 172.21.15.2:0/1465375217 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b41a0090 con 0x7fc0b4104690 2024-06-13T11:19:30.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.230+0000 7fc0b0c00700 1 -- 172.21.15.2:0/1465375217 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0a4007b80 con 0x7fc0b4104690 2024-06-13T11:19:30.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.230+0000 7fc0b0c00700 1 -- 172.21.15.2:0/1465375217 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a40052c0 con 0x7fc0b4104690 2024-06-13T11:19:30.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.230+0000 7fc0ba000700 1 -- 172.21.15.2:0/1465375217 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b41a7970 con 0x7fc0b4104690 2024-06-13T11:19:30.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.231+0000 7fc0ba000700 1 -- 172.21.15.2:0/1465375217 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b410cc20 con 0x7fc0b4104690 2024-06-13T11:19:30.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.233+0000 7fc0b0c00700 1 -- 172.21.15.2:0/1465375217 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc0a4024070 con 0x7fc0b4104690 2024-06-13T11:19:30.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.235+0000 7fc0b0c00700 1 --2- 172.21.15.2:0/1465375217 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc0980a2c20 0x7fc0980a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:30.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.235+0000 7fc0b0c00700 1 -- 172.21.15.2:0/1465375217 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9050+0+0 (secure 0 0 0) 0x7fc0a400f020 con 0x7fc0b4104690 2024-06-13T11:19:30.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.235+0000 7fc0aaa00700 1 --2- 172.21.15.2:0/1465375217 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc0980a2c20 0x7fc0980a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:30.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.236+0000 7fc0aaa00700 1 --2- 172.21.15.2:0/1465375217 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc0980a2c20 0x7fc0980a50e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4102730 tx=0x7fc09c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:30.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.238+0000 7fc0b0c00700 1 -- 172.21.15.2:0/1465375217 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc0a402b020 con 0x7fc0b4104690 2024-06-13T11:19:30.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.521+0000 7fc0ba000700 1 -- 172.21.15.2:0/1465375217 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc0b419c150 con 0x7fc0b4104690 2024-06-13T11:19:30.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.522+0000 7fc0b0c00700 1 -- 172.21.15.2:0/1465375217 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fc0a409d610 con 0x7fc0b4104690 2024-06-13T11:19:30.521 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-13T11:19:30.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.525+0000 7fc0ba000700 1 -- 172.21.15.2:0/1465375217 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc0980a2c20 msgr2=0x7fc0980a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:30.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.525+0000 7fc0ba000700 1 --2- 172.21.15.2:0/1465375217 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc0980a2c20 0x7fc0980a50e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4102730 tx=0x7fc09c009260 comp rx=0 tx=0).stop 2024-06-13T11:19:30.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.525+0000 7fc0ba000700 1 -- 172.21.15.2:0/1465375217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0b4104690 msgr2=0x7fc0b419adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:30.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.525+0000 7fc0ba000700 1 --2- 172.21.15.2:0/1465375217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0b4104690 0x7fc0b419adf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40062a0 tx=0x7fc0a4004ce0 comp rx=0 tx=0).stop 2024-06-13T11:19:30.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.525+0000 7fc0ba000700 1 -- 172.21.15.2:0/1465375217 shutdown_connections 2024-06-13T11:19:30.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.525+0000 7fc0ba000700 1 --2- 172.21.15.2:0/1465375217 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc0980a2c20 0x7fc0980a50e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:30.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.525+0000 7fc0ba000700 1 --2- 172.21.15.2:0/1465375217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0b410a690 0x7fc0b419f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:30.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.525+0000 7fc0ba000700 1 --2- 172.21.15.2:0/1465375217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0b4104690 0x7fc0b419adf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:30.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.525+0000 7fc0ba000700 1 --2- 172.21.15.2:0/1465375217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0b4105050 0x7fc0b419b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:30.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.525+0000 7fc0ba000700 1 -- 172.21.15.2:0/1465375217 >> 172.21.15.2:0/1465375217 conn(0x7fc0b41001a0 msgr2=0x7fc0b41007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:30.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.526+0000 7fc0ba000700 1 -- 172.21.15.2:0/1465375217 shutdown_connections 2024-06-13T11:19:30.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:30.526+0000 7fc0ba000700 1 -- 172.21.15.2:0/1465375217 wait complete. 2024-06-13T11:19:30.583 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:30 smithi002 ceph-mon[32210]: pgmap v359: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:30.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:30 smithi178 ceph-mon[36913]: pgmap v359: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:30.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:30 smithi077 ceph-mon[36410]: pgmap v359: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:31.326 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-06-13T11:19:31.326 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-13T11:19:31.326 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-06-13T11:19:31.326 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-06-13T11:19:31.326 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-13T11:19:31.326 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-06-13T11:19:31.327 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-13T11:19:31.327 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-13T11:19:31.327 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-06-13T11:19:31.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:19:31.327 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-06-13T11:19:31.379 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-13T11:19:31.379 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-13T11:19:31.379 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-06-13T11:19:31.379 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:19:31.379 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-06-13T11:19:31.379 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:19:31.379 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:19:31.379 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:19:31.380 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-06-13T11:19:31.380 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:19:31.380 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:19:31.380 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-06-13T11:19:31.380 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-13T11:19:31.380 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:19:31.380 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-06-13T11:19:31.380 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-06-13T11:19:31.380 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 41970sec preferred_lft 41970sec 2024-06-13T11:19:31.380 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2024-06-13T11:19:31.380 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:19:31.380 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:19:31.380 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:19:31.380 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-06-13T11:19:31.382 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-13T11:19:31.382 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:19:31.382 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T11:19:31.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-06-13T11:19:31.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-06-13T11:19:31.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-06-13T11:19:31.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-13T11:19:31.382 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T11:19:31.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:19:31.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:31 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1465375217' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-13T11:19:31.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:31 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1465375217' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-13T11:19:31.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:31 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1465375217' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-13T11:19:31.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:19:31.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:19:31.839 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-13T11:19:31.906 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-06-13T11:19:31.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:19:31.909 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-06-13T11:19:31.959 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-06-13T11:19:31.960 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-13T11:19:31.960 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-13T11:19:31.960 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-13T11:19:31.960 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-13T11:19:31.960 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:19:31.960 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T11:19:31.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-13T11:19:31.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-13T11:19:31.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-13T11:19:31.961 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T11:19:32.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:19:32.333 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:32 smithi002 ceph-mon[32210]: pgmap v360: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:32.691 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:32 smithi077 ceph-mon[36410]: pgmap v360: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:32.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:32 smithi178 ceph-mon[36913]: pgmap v360: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:32.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:19:32.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:19:32.748 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-06-13T11:19:32.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:19:32.805 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-06-13T11:19:32.860 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:19:32.860 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T11:19:32.860 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T11:19:32.860 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-06-13T11:19:32.860 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T11:19:32.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:19:33.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:19:33.056 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-06-13T11:19:33.056 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:19:33.056 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T11:19:33.056 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-06-13T11:19:33.056 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-13T11:19:33.056 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-06-13T11:19:33.056 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-06-13T11:19:33.056 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-06-13T11:19:33.056 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T11:19:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:19:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:19:33.382 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:19:33.382 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T11:19:33.383 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-06-13T11:19:33.383 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-06-13T11:19:33.383 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T11:19:33.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:19:33.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:19:33.596 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-06-13T11:19:33.596 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T11:19:33.596 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-06-13T11:19:33.643 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-06-13T11:19:33.643 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T11:19:33.643 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-06-13T11:19:33.735 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-06-13T11:19:33.821 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-06-13T11:19:33.879 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-06-13T11:19:33.879 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-06-13T11:19:33.879 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-06-13T11:19:33.879 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-06-13T11:19:33.879 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-06-13T11:19:33.879 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-06-13T11:19:33.879 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-06-13T11:19:33.879 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-06-13T11:19:33.879 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-06-13T11:19:33.880 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-06-13T11:19:33.880 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-06-13T11:19:33.880 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-06-13T11:19:33.880 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-06-13T11:19:33.880 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-06-13T11:19:33.880 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-06-13T11:19:33.880 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-06-13T11:19:33.880 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-06-13T11:19:33.880 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-06-13T11:19:33.880 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-06-13T11:19:33.880 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-06-13T11:19:33.880 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-13T11:19:33.880 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-13T11:19:33.880 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-06-13T11:19:33.881 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-06-13T11:19:33.881 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-06-13T11:19:33.881 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-06-13T11:19:33.881 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/a476c5a4e2112a48e0d2ec0a5ec5188780c8159b155665ba93fead71f612eac8/merged 2024-06-13T11:19:33.881 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/b85a51906fb8644d58cdcd54c94a6b6a77c168dac26c5563628b79429dd87240/merged 2024-06-13T11:19:33.881 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-06-13T11:19:33.881 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-06-13T11:19:33.881 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/a50b5c980f4694cae3269319051caa662b4edb0d058905eb22340174ac94af2f/merged 2024-06-13T11:19:33.881 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/54c47657b8734d38d61d7674b7a09855a8b3cc9e9a694f2682c4d0ccfbe8609b/merged 2024-06-13T11:19:33.881 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/fd84442dcd0d13324b2e333c4dfc11d3782e2c425bc25f0f25971577c6c58616/merged 2024-06-13T11:19:33.881 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/d958bf0c044d7ed7e7d770522e6f26394580960c4633bc60d969731dee408e85/merged 2024-06-13T11:19:33.881 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/45e7fe75debd3b63c429a0beaab707ba736d52742c87e609feffa895b8691471/merged 2024-06-13T11:19:33.881 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/e454ffa096d20c7964ab6429fefcfa26cfc40972dec79378f3f24f20bd6725d9/merged 2024-06-13T11:19:33.881 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/dcf1ddffa0f8e0463b0a07d0270760651110b914b999c2860087eeb3ab836891/merged 2024-06-13T11:19:33.882 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/f67409068bf3b8e308ac36d6ec7cd0ac5c14985bf8693a8dc8ed47bef5566c99/merged 2024-06-13T11:19:33.882 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-06-13T11:19:33.882 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T11:19:33.882 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T11:19:33.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:19:33.883 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-06-13T11:19:33.932 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-13T11:19:33.933 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-06-13T11:19:33.938 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-06-13T11:19:34.009 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-06-13T11:19:34.055 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-06-13T11:19:34.055 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-06-13T11:19:34.055 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-06-13T11:19:34.055 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-06-13T11:19:34.055 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-06-13T11:19:34.055 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-06-13T11:19:34.055 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-06-13T11:19:34.055 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-06-13T11:19:34.055 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-06-13T11:19:34.055 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-06-13T11:19:34.055 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-06-13T11:19:34.056 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-06-13T11:19:34.056 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-06-13T11:19:34.056 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-06-13T11:19:34.056 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-06-13T11:19:34.056 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-06-13T11:19:34.056 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-06-13T11:19:34.056 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-06-13T11:19:34.056 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-06-13T11:19:34.056 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-06-13T11:19:34.056 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-13T11:19:34.056 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-13T11:19:34.056 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-06-13T11:19:34.057 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-06-13T11:19:34.057 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-06-13T11:19:34.057 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-06-13T11:19:34.057 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/a476c5a4e2112a48e0d2ec0a5ec5188780c8159b155665ba93fead71f612eac8/merged 2024-06-13T11:19:34.057 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/b85a51906fb8644d58cdcd54c94a6b6a77c168dac26c5563628b79429dd87240/merged 2024-06-13T11:19:34.057 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-06-13T11:19:34.057 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-06-13T11:19:34.057 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/a50b5c980f4694cae3269319051caa662b4edb0d058905eb22340174ac94af2f/merged 2024-06-13T11:19:34.057 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/54c47657b8734d38d61d7674b7a09855a8b3cc9e9a694f2682c4d0ccfbe8609b/merged 2024-06-13T11:19:34.057 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/fd84442dcd0d13324b2e333c4dfc11d3782e2c425bc25f0f25971577c6c58616/merged 2024-06-13T11:19:34.057 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/d958bf0c044d7ed7e7d770522e6f26394580960c4633bc60d969731dee408e85/merged 2024-06-13T11:19:34.057 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/45e7fe75debd3b63c429a0beaab707ba736d52742c87e609feffa895b8691471/merged 2024-06-13T11:19:34.057 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/e454ffa096d20c7964ab6429fefcfa26cfc40972dec79378f3f24f20bd6725d9/merged 2024-06-13T11:19:34.057 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/dcf1ddffa0f8e0463b0a07d0270760651110b914b999c2860087eeb3ab836891/merged 2024-06-13T11:19:34.058 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/f67409068bf3b8e308ac36d6ec7cd0ac5c14985bf8693a8dc8ed47bef5566c99/merged 2024-06-13T11:19:34.058 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-06-13T11:19:34.058 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T11:19:34.058 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T11:19:34.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:19:34.059 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-06-13T11:19:34.148 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:2024-06-13T11:19:34.149+0000 7f6ec4121480 -1 init, newargv = 0x562e81f8dc40 newargc=15 2024-06-13T11:19:34.148 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:ceph-fuse[78040]: starting ceph client 2024-06-13T11:19:34.158 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:ceph-fuse[78040]: starting fuse 2024-06-13T11:19:34.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:34 smithi002 ceph-mon[32210]: pgmap v361: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:34.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:34 smithi178 ceph-mon[36913]: pgmap v361: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:34.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:34 smithi077 ceph-mon[36410]: pgmap v361: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:35.203 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-06-13T11:19:35.294 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-06-13T11:19:35.352 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-06-13T11:19:35.352 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-06-13T11:19:35.352 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-06-13T11:19:35.352 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-06-13T11:19:35.352 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-06-13T11:19:35.352 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-06-13T11:19:35.352 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-06-13T11:19:35.352 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-06-13T11:19:35.352 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-06-13T11:19:35.353 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-06-13T11:19:35.353 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-06-13T11:19:35.353 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-06-13T11:19:35.353 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-06-13T11:19:35.353 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-06-13T11:19:35.353 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-06-13T11:19:35.353 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-06-13T11:19:35.353 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-06-13T11:19:35.353 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-06-13T11:19:35.353 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-06-13T11:19:35.353 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-06-13T11:19:35.353 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-13T11:19:35.353 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-13T11:19:35.354 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-06-13T11:19:35.354 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-06-13T11:19:35.354 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-06-13T11:19:35.354 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-06-13T11:19:35.354 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/a476c5a4e2112a48e0d2ec0a5ec5188780c8159b155665ba93fead71f612eac8/merged 2024-06-13T11:19:35.354 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/b85a51906fb8644d58cdcd54c94a6b6a77c168dac26c5563628b79429dd87240/merged 2024-06-13T11:19:35.354 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-06-13T11:19:35.354 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-06-13T11:19:35.354 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/a50b5c980f4694cae3269319051caa662b4edb0d058905eb22340174ac94af2f/merged 2024-06-13T11:19:35.354 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/54c47657b8734d38d61d7674b7a09855a8b3cc9e9a694f2682c4d0ccfbe8609b/merged 2024-06-13T11:19:35.354 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/fd84442dcd0d13324b2e333c4dfc11d3782e2c425bc25f0f25971577c6c58616/merged 2024-06-13T11:19:35.354 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/d958bf0c044d7ed7e7d770522e6f26394580960c4633bc60d969731dee408e85/merged 2024-06-13T11:19:35.355 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/45e7fe75debd3b63c429a0beaab707ba736d52742c87e609feffa895b8691471/merged 2024-06-13T11:19:35.355 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/e454ffa096d20c7964ab6429fefcfa26cfc40972dec79378f3f24f20bd6725d9/merged 2024-06-13T11:19:35.355 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/dcf1ddffa0f8e0463b0a07d0270760651110b914b999c2860087eeb3ab836891/merged 2024-06-13T11:19:35.355 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/f67409068bf3b8e308ac36d6ec7cd0ac5c14985bf8693a8dc8ed47bef5566c99/merged 2024-06-13T11:19:35.355 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-06-13T11:19:35.355 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T11:19:35.355 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T11:19:35.355 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.admin 2024-06-13T11:19:35.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:19:35.356 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-06-13T11:19:35.412 INFO:teuthology.orchestra.run.smithi002.stdout:119 2024-06-13T11:19:35.412 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-06-13T11:19:35.413 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2024-06-13T11:19:35.413 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2024-06-13T11:19:35.413 DEBUG:teuthology.orchestra.run.smithi002:> import re 2024-06-13T11:19:35.413 DEBUG:teuthology.orchestra.run.smithi002:> import os 2024-06-13T11:19:35.413 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2024-06-13T11:19:35.413 DEBUG:teuthology.orchestra.run.smithi002:> 2024-06-13T11:19:35.413 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2024-06-13T11:19:35.413 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-06-13T11:19:35.413 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2024-06-13T11:19:35.413 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-06-13T11:19:35.413 DEBUG:teuthology.orchestra.run.smithi002:> 2024-06-13T11:19:35.413 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2024-06-13T11:19:35.413 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2024-06-13T11:19:35.413 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2024-06-13T11:19:35.414 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2024-06-13T11:19:35.414 DEBUG:teuthology.orchestra.run.smithi002:> 2024-06-13T11:19:35.414 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2024-06-13T11:19:35.414 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-13T11:19:35.414 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-13T11:19:35.414 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-13T11:19:35.414 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2024-06-13T11:19:35.414 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2024-06-13T11:19:35.414 DEBUG:teuthology.orchestra.run.smithi002:> return f 2024-06-13T11:19:35.414 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-13T11:19:35.414 DEBUG:teuthology.orchestra.run.smithi002:> 2024-06-13T11:19:35.414 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.admin")) 2024-06-13T11:19:35.414 DEBUG:teuthology.orchestra.run.smithi002:> ' 2024-06-13T11:19:35.592 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.admin.78040.asok 2024-06-13T11:19:35.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:19:35.610 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.78040.asok 2024-06-13T11:19:35.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:19:35.610 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.78040.asok status 2024-06-13T11:19:35.846 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:19:35.847 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2024-06-13T11:19:35.847 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-13T11:19:35.847 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-13T11:19:35.847 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "admin", 2024-06-13T11:19:35.847 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2024-06-13T11:19:35.847 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-06-13T11:19:35.847 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "78040", 2024-06-13T11:19:35.847 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2024-06-13T11:19:35.847 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:19:35.847 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2024-06-13T11:19:35.847 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2024-06-13T11:19:35.847 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 14526, 2024-06-13T11:19:35.848 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2024-06-13T11:19:35.848 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2024-06-13T11:19:35.848 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2024-06-13T11:19:35.848 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 14526 2024-06-13T11:19:35.848 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:19:35.848 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-06-13T11:19:35.848 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-06-13T11:19:35.848 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-06-13T11:19:35.848 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2474083696 2024-06-13T11:19:35.848 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:19:35.848 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:19:35.848 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-06-13T11:19:35.848 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-06-13T11:19:35.848 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-06-13T11:19:35.849 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2474083696 2024-06-13T11:19:35.849 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:19:35.849 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.14526 192.168.0.1:0/2474083696", 2024-06-13T11:19:35.849 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/2474083696", 2024-06-13T11:19:35.849 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2024-06-13T11:19:35.849 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 17, 2024-06-13T11:19:35.849 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 97, 2024-06-13T11:19:35.849 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2024-06-13T11:19:35.849 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2024-06-13T11:19:35.849 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2024-06-13T11:19:35.849 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:19:35.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:19:35.863 DEBUG:teuthology.orchestra.run.smithi002:> stat --file-system '--printf=%T 2024-06-13T11:19:35.863 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-06-13T11:19:35.915 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2024-06-13T11:19:35.915 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-06-13T11:19:35.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:19:35.916 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-06-13T11:19:36.001 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-06-13T11:19:36.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:19:36.172 INFO:teuthology.orchestra.run.smithi002.stdout:# file: . 2024-06-13T11:19:36.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-06-13T11:19:36.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:19:36.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:19:36.184 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:19:36.184 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:19:36.240 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd blocklist ls 2024-06-13T11:19:36.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:36 smithi002 ceph-mon[32210]: pgmap v362: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:36.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:36 smithi178 ceph-mon[36913]: pgmap v362: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:36.698 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:19:36.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:36 smithi077 ceph-mon[36410]: pgmap v362: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:37.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:37 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:19:37.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:37 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:19:37.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:37 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:19:38.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:38 smithi002 ceph-mon[32210]: pgmap v363: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:38.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:38.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:38.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:38.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:38 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:38.597 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:38 smithi178 ceph-mon[36913]: pgmap v363: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:38.597 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:38.597 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:38.598 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:38.598 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:38 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:38.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:38 smithi077 ceph-mon[36410]: pgmap v363: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:19:38.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:38.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:38.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:38.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:38 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:39.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.155+0000 7f7c6e800700 1 -- 172.21.15.2:0/1778231395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c68075020 msgr2=0x7f7c68113120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:39.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.155+0000 7f7c6e800700 1 --2- 172.21.15.2:0/1778231395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c68075020 0x7f7c68113120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009990 tx=0x7f7c54009ca0 comp rx=0 tx=0).stop 2024-06-13T11:19:39.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.155+0000 7f7c6e800700 1 -- 172.21.15.2:0/1778231395 shutdown_connections 2024-06-13T11:19:39.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.155+0000 7f7c6e800700 1 --2- 172.21.15.2:0/1778231395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c68074700 0x7f7c68074ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:39.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.155+0000 7f7c6e800700 1 --2- 172.21.15.2:0/1778231395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c68113660 0x7f7c68115a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:39.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.155+0000 7f7c6e800700 1 --2- 172.21.15.2:0/1778231395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c68075020 0x7f7c68113120 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:39.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.155+0000 7f7c6e800700 1 -- 172.21.15.2:0/1778231395 >> 172.21.15.2:0/1778231395 conn(0x7f7c68079680 msgr2=0x7f7c68079a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:39.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.155+0000 7f7c6e800700 1 -- 172.21.15.2:0/1778231395 shutdown_connections 2024-06-13T11:19:39.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.155+0000 7f7c6e800700 1 -- 172.21.15.2:0/1778231395 wait complete. 2024-06-13T11:19:39.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.156+0000 7f7c6e800700 1 Processor -- start 2024-06-13T11:19:39.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.156+0000 7f7c6e800700 1 -- start start 2024-06-13T11:19:39.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.157+0000 7f7c6e800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c68074700 0x7f7c6819f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:39.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.157+0000 7f7c6e800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c68075020 0x7f7c6819f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:39.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.157+0000 7f7c6e800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c68113660 0x7f7c681a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:39.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.157+0000 7f7c6e800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7c68118ea0 con 0x7f7c68075020 2024-06-13T11:19:39.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.157+0000 7f7c6e800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c68118d20 con 0x7f7c68113660 2024-06-13T11:19:39.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.157+0000 7f7c6e800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7c68119020 con 0x7f7c68074700 2024-06-13T11:19:39.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.157+0000 7f7c66a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c68075020 0x7f7c6819f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:39.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.157+0000 7f7c67400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c68074700 0x7f7c6819f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:39.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.157+0000 7f7c66a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c68075020 0x7f7c6819f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48426/0 (socket says 172.21.15.2:48426) 2024-06-13T11:19:39.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.157+0000 7f7c66a00700 1 -- 172.21.15.2:0/1765700937 learned_addr learned my addr 172.21.15.2:0/1765700937 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:19:39.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.157+0000 7f7c67e00700 1 --2- 172.21.15.2:0/1765700937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c68113660 0x7f7c681a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:39.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.157+0000 7f7c67400700 1 -- 172.21.15.2:0/1765700937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c68113660 msgr2=0x7f7c681a3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:39.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.158+0000 7f7c67400700 1 --2- 172.21.15.2:0/1765700937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c68113660 0x7f7c681a3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:39.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.158+0000 7f7c67400700 1 -- 172.21.15.2:0/1765700937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c68075020 msgr2=0x7f7c6819f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:39.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.158+0000 7f7c67400700 1 --2- 172.21.15.2:0/1765700937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c68075020 0x7f7c6819f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:39.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.158+0000 7f7c67400700 1 -- 172.21.15.2:0/1765700937 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c681a4360 con 0x7f7c68074700 2024-06-13T11:19:39.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.158+0000 7f7c66a00700 1 --2- 172.21.15.2:0/1765700937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c68075020 0x7f7c6819f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:19:39.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.158+0000 7f7c67e00700 1 --2- 172.21.15.2:0/1765700937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c68113660 0x7f7c681a3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:19:39.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.158+0000 7f7c67400700 1 --2- 172.21.15.2:0/1765700937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c68074700 0x7f7c6819f350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800e9f0 tx=0x7f7c5800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:39.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.158+0000 7f7c5fe00700 1 -- 172.21.15.2:0/1765700937 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5800c9c0 con 0x7f7c68074700 2024-06-13T11:19:39.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.158+0000 7f7c6e800700 1 -- 172.21.15.2:0/1765700937 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c681a4650 con 0x7f7c68074700 2024-06-13T11:19:39.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.158+0000 7f7c5fe00700 1 -- 172.21.15.2:0/1765700937 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c5800cb60 con 0x7f7c68074700 2024-06-13T11:19:39.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.158+0000 7f7c5fe00700 1 -- 172.21.15.2:0/1765700937 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c58018680 con 0x7f7c68074700 2024-06-13T11:19:39.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.158+0000 7f7c6e800700 1 -- 172.21.15.2:0/1765700937 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c681abed0 con 0x7f7c68074700 2024-06-13T11:19:39.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.160+0000 7f7c6e800700 1 -- 172.21.15.2:0/1765700937 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c68069180 con 0x7f7c68074700 2024-06-13T11:19:39.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.162+0000 7f7c5fe00700 1 -- 172.21.15.2:0/1765700937 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f7c58010430 con 0x7f7c68074700 2024-06-13T11:19:39.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.163+0000 7f7c5fe00700 1 --2- 172.21.15.2:0/1765700937 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7c4c0a2c20 0x7f7c4c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:39.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.163+0000 7f7c5fe00700 1 -- 172.21.15.2:0/1765700937 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9050+0+0 (secure 0 0 0) 0x7f7c580cf4b0 con 0x7f7c68074700 2024-06-13T11:19:39.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.164+0000 7f7c66a00700 1 --2- 172.21.15.2:0/1765700937 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7c4c0a2c20 0x7f7c4c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:39.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.164+0000 7f7c66a00700 1 --2- 172.21.15.2:0/1765700937 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7c4c0a2c20 0x7f7c4c0a50e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009750 tx=0x7f7c5400b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:39.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.167+0000 7f7c5fe00700 1 -- 172.21.15.2:0/1765700937 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7c5809c080 con 0x7f7c68074700 2024-06-13T11:19:39.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.422+0000 7f7c6e800700 1 -- 172.21.15.2:0/1765700937 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7c681ac0a0 con 0x7f7c68074700 2024-06-13T11:19:39.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.423+0000 7f7c5fe00700 1 -- 172.21.15.2:0/1765700937 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v97) ==== 81+0+580 (secure 0 0 0) 0x7f7c5809b980 con 0x7f7c68074700 2024-06-13T11:19:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/315567313 2024-06-14T11:10:25.084617+0000 2024-06-13T11:19:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2084201061 2024-06-14T11:10:25.084617+0000 2024-06-13T11:19:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3394644803 2024-06-14T11:09:49.418694+0000 2024-06-13T11:19:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/1821969949 2024-06-14T11:10:25.084617+0000 2024-06-13T11:19:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2666864285 2024-06-14T11:09:49.418694+0000 2024-06-13T11:19:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2170469985 2024-06-14T11:09:49.418694+0000 2024-06-13T11:19:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/142516651 2024-06-14T11:10:25.084617+0000 2024-06-13T11:19:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2666864285 2024-06-14T11:09:49.418694+0000 2024-06-13T11:19:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3220886565 2024-06-14T11:09:49.418694+0000 2024-06-13T11:19:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/1821969949 2024-06-14T11:10:25.084617+0000 2024-06-13T11:19:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.426+0000 7f7c6e800700 1 -- 172.21.15.2:0/1765700937 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7c4c0a2c20 msgr2=0x7f7c4c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.426+0000 7f7c6e800700 1 --2- 172.21.15.2:0/1765700937 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7c4c0a2c20 0x7f7c4c0a50e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009750 tx=0x7f7c5400b280 comp rx=0 tx=0).stop 2024-06-13T11:19:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.426+0000 7f7c6e800700 1 -- 172.21.15.2:0/1765700937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c68074700 msgr2=0x7f7c6819f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.426+0000 7f7c6e800700 1 --2- 172.21.15.2:0/1765700937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c68074700 0x7f7c6819f350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800e9f0 tx=0x7f7c5800ed00 comp rx=0 tx=0).stop 2024-06-13T11:19:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.426+0000 7f7c6e800700 1 -- 172.21.15.2:0/1765700937 shutdown_connections 2024-06-13T11:19:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.426+0000 7f7c6e800700 1 --2- 172.21.15.2:0/1765700937 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7c4c0a2c20 0x7f7c4c0a50e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.426+0000 7f7c6e800700 1 --2- 172.21.15.2:0/1765700937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c68113660 0x7f7c681a3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.426+0000 7f7c6e800700 1 --2- 172.21.15.2:0/1765700937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c68074700 0x7f7c6819f350 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.426+0000 7f7c6e800700 1 --2- 172.21.15.2:0/1765700937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c68075020 0x7f7c6819f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.426+0000 7f7c6e800700 1 -- 172.21.15.2:0/1765700937 >> 172.21.15.2:0/1765700937 conn(0x7f7c68079680 msgr2=0x7f7c6810f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.426+0000 7f7c6e800700 1 -- 172.21.15.2:0/1765700937 shutdown_connections 2024-06-13T11:19:39.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:39.427+0000 7f7c6e800700 1 -- 172.21.15.2:0/1765700937 wait complete. 2024-06-13T11:19:39.427 INFO:teuthology.orchestra.run.smithi002.stderr:listed 10 entries 2024-06-13T11:19:40.469 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:19:40.469 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:19:40.526 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd blocklist ls 2024-06-13T11:19:40.596 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:40 smithi002 ceph-mon[32210]: pgmap v364: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T11:19:40.596 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:40 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1765700937' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T11:19:40.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:40 smithi178 ceph-mon[36913]: pgmap v364: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T11:19:40.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:40 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1765700937' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T11:19:40.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:40 smithi077 ceph-mon[36410]: pgmap v364: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T11:19:40.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:40 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1765700937' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T11:19:40.989 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:19:43.121 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:42 smithi002 ceph-mon[32210]: pgmap v365: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T11:19:43.121 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:42 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:43.121 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:42 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:43.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.290+0000 7fc3ea200700 1 -- 172.21.15.2:0/450518522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3e4108500 msgr2=0x7fc3e41088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.290+0000 7fc3ea200700 1 --2- 172.21.15.2:0/450518522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3e4108500 0x7fc3e41088e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009990 tx=0x7fc3d4009ca0 comp rx=0 tx=0).stop 2024-06-13T11:19:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.290+0000 7fc3ea200700 1 -- 172.21.15.2:0/450518522 shutdown_connections 2024-06-13T11:19:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.290+0000 7fc3ea200700 1 --2- 172.21.15.2:0/450518522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e406ab30 0x7fc3e410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.290+0000 7fc3ea200700 1 --2- 172.21.15.2:0/450518522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3e4108500 0x7fc3e41088e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.290+0000 7fc3ea200700 1 --2- 172.21.15.2:0/450518522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3e406a170 0x7fc3e406a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.290+0000 7fc3ea200700 1 -- 172.21.15.2:0/450518522 >> 172.21.15.2:0/450518522 conn(0x7fc3e4078340 msgr2=0x7fc3e4078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.290+0000 7fc3ea200700 1 -- 172.21.15.2:0/450518522 shutdown_connections 2024-06-13T11:19:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.290+0000 7fc3ea200700 1 -- 172.21.15.2:0/450518522 wait complete. 2024-06-13T11:19:43.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:42 smithi077 ceph-mon[36410]: pgmap v365: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T11:19:43.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:42 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:43.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:42 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:43.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.291+0000 7fc3ea200700 1 Processor -- start 2024-06-13T11:19:43.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.291+0000 7fc3ea200700 1 -- start start 2024-06-13T11:19:43.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.292+0000 7fc3ea200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3e406a170 0x7fc3e419ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:43.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.292+0000 7fc3ea200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3e406ab30 0x7fc3e419b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:43.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.292+0000 7fc3ea200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e4108500 0x7fc3e419f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:43.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.292+0000 7fc3ea200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e41127b0 con 0x7fc3e406a170 2024-06-13T11:19:43.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.292+0000 7fc3ea200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e4112630 con 0x7fc3e4108500 2024-06-13T11:19:43.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.292+0000 7fc3ea200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e4112930 con 0x7fc3e406ab30 2024-06-13T11:19:43.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.292+0000 7fc3e2a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3e406ab30 0x7fc3e419b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:43.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.292+0000 7fc3e3400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3e406a170 0x7fc3e419ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:43.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.292+0000 7fc3e2a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3e406ab30 0x7fc3e419b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:48030/0 (socket says 172.21.15.2:48030) 2024-06-13T11:19:43.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.292+0000 7fc3e2a00700 1 -- 172.21.15.2:0/986617393 learned_addr learned my addr 172.21.15.2:0/986617393 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:19:43.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.292+0000 7fc3e3e00700 1 --2- 172.21.15.2:0/986617393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e4108500 0x7fc3e419f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:43.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.293+0000 7fc3e2a00700 1 -- 172.21.15.2:0/986617393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e4108500 msgr2=0x7fc3e419f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:43.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.293+0000 7fc3e2a00700 1 --2- 172.21.15.2:0/986617393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e4108500 0x7fc3e419f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:43.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.293+0000 7fc3e2a00700 1 -- 172.21.15.2:0/986617393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3e406a170 msgr2=0x7fc3e419ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:43.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.293+0000 7fc3e2a00700 1 --2- 172.21.15.2:0/986617393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3e406a170 0x7fc3e419ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:43.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.293+0000 7fc3e2a00700 1 -- 172.21.15.2:0/986617393 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e419fe80 con 0x7fc3e406ab30 2024-06-13T11:19:43.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.293+0000 7fc3e3e00700 1 --2- 172.21.15.2:0/986617393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e4108500 0x7fc3e419f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:19:43.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.293+0000 7fc3e2a00700 1 --2- 172.21.15.2:0/986617393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3e406ab30 0x7fc3e419b3b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000e9a0 tx=0x7fc3d000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:43.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.293+0000 7fc3dbe00700 1 -- 172.21.15.2:0/986617393 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d000cbd0 con 0x7fc3e406ab30 2024-06-13T11:19:43.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.293+0000 7fc3dbe00700 1 -- 172.21.15.2:0/986617393 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3d000cd70 con 0x7fc3e406ab30 2024-06-13T11:19:43.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.293+0000 7fc3ea200700 1 -- 172.21.15.2:0/986617393 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e41a0170 con 0x7fc3e406ab30 2024-06-13T11:19:43.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.293+0000 7fc3dbe00700 1 -- 172.21.15.2:0/986617393 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0018750 con 0x7fc3e406ab30 2024-06-13T11:19:43.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.293+0000 7fc3ea200700 1 -- 172.21.15.2:0/986617393 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e41a79f0 con 0x7fc3e406ab30 2024-06-13T11:19:43.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.295+0000 7fc3ea200700 1 -- 172.21.15.2:0/986617393 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e4069180 con 0x7fc3e406ab30 2024-06-13T11:19:43.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.297+0000 7fc3dbe00700 1 -- 172.21.15.2:0/986617393 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc3d0010430 con 0x7fc3e406ab30 2024-06-13T11:19:43.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.299+0000 7fc3dbe00700 1 --2- 172.21.15.2:0/986617393 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc3c80a2ca0 0x7fc3c80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:43.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.299+0000 7fc3dbe00700 1 -- 172.21.15.2:0/986617393 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9050+0+0 (secure 0 0 0) 0x7fc3d00cf630 con 0x7fc3e406ab30 2024-06-13T11:19:43.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.299+0000 7fc3e3400700 1 --2- 172.21.15.2:0/986617393 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc3c80a2ca0 0x7fc3c80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:43.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.300+0000 7fc3e3400700 1 --2- 172.21.15.2:0/986617393 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc3c80a2ca0 0x7fc3c80a5160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400b2e0 tx=0x7fc3d4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:43.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.303+0000 7fc3dbe00700 1 -- 172.21.15.2:0/986617393 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc3d009c200 con 0x7fc3e406ab30 2024-06-13T11:19:43.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:42 smithi178 ceph-mon[36913]: pgmap v365: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T11:19:43.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:42 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:43.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:42 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:43.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.554+0000 7fc3ea200700 1 -- 172.21.15.2:0/986617393 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc3e419c1d0 con 0x7fc3e406ab30 2024-06-13T11:19:43.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.555+0000 7fc3dbe00700 1 -- 172.21.15.2:0/986617393 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v97) ==== 81+0+580 (secure 0 0 0) 0x7fc3d009bb00 con 0x7fc3e406ab30 2024-06-13T11:19:43.554 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/315567313 2024-06-14T11:10:25.084617+0000 2024-06-13T11:19:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2084201061 2024-06-14T11:10:25.084617+0000 2024-06-13T11:19:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3394644803 2024-06-14T11:09:49.418694+0000 2024-06-13T11:19:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/1821969949 2024-06-14T11:10:25.084617+0000 2024-06-13T11:19:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2666864285 2024-06-14T11:09:49.418694+0000 2024-06-13T11:19:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2170469985 2024-06-14T11:09:49.418694+0000 2024-06-13T11:19:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/142516651 2024-06-14T11:10:25.084617+0000 2024-06-13T11:19:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2666864285 2024-06-14T11:09:49.418694+0000 2024-06-13T11:19:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3220886565 2024-06-14T11:09:49.418694+0000 2024-06-13T11:19:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/1821969949 2024-06-14T11:10:25.084617+0000 2024-06-13T11:19:43.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.559+0000 7fc3ea200700 1 -- 172.21.15.2:0/986617393 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc3c80a2ca0 msgr2=0x7fc3c80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:43.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.559+0000 7fc3ea200700 1 --2- 172.21.15.2:0/986617393 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc3c80a2ca0 0x7fc3c80a5160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400b2e0 tx=0x7fc3d4005fd0 comp rx=0 tx=0).stop 2024-06-13T11:19:43.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.559+0000 7fc3ea200700 1 -- 172.21.15.2:0/986617393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3e406ab30 msgr2=0x7fc3e419b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:43.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.559+0000 7fc3ea200700 1 --2- 172.21.15.2:0/986617393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3e406ab30 0x7fc3e419b3b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000e9a0 tx=0x7fc3d000ecb0 comp rx=0 tx=0).stop 2024-06-13T11:19:43.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.559+0000 7fc3ea200700 1 -- 172.21.15.2:0/986617393 shutdown_connections 2024-06-13T11:19:43.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.559+0000 7fc3ea200700 1 --2- 172.21.15.2:0/986617393 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fc3c80a2ca0 0x7fc3c80a5160 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:43.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.559+0000 7fc3ea200700 1 --2- 172.21.15.2:0/986617393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3e406a170 0x7fc3e419ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:43.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.559+0000 7fc3ea200700 1 --2- 172.21.15.2:0/986617393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e4108500 0x7fc3e419f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:43.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.559+0000 7fc3ea200700 1 --2- 172.21.15.2:0/986617393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3e406ab30 0x7fc3e419b3b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:43.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.559+0000 7fc3ea200700 1 -- 172.21.15.2:0/986617393 >> 172.21.15.2:0/986617393 conn(0x7fc3e4078340 msgr2=0x7fc3e410d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:43.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.559+0000 7fc3ea200700 1 -- 172.21.15.2:0/986617393 shutdown_connections 2024-06-13T11:19:43.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:43.559+0000 7fc3ea200700 1 -- 172.21.15.2:0/986617393 wait complete. 2024-06-13T11:19:43.559 INFO:teuthology.orchestra.run.smithi002.stderr:listed 10 entries 2024-06-13T11:19:44.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:43 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:19:44.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:43 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:19:44.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:43 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:44.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:43 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/986617393' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T11:19:44.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:43 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:19:44.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:43 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:19:44.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:43 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:44.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:43 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/986617393' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T11:19:44.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:43 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:19:44.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:43 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:19:44.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:43 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:19:44.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:43 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/986617393' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T11:19:44.456 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2024-06-13T11:19:44.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:19:44.457 DEBUG:teuthology.orchestra.run.smithi002:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-06-13T11:19:44.545 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:ceph-fuse[78040]: fuse finished with error 0 and tester_r 0 2024-06-13T11:19:44.552 INFO:teuthology.orchestra.run:waiting for 300 2024-06-13T11:19:45.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:44 smithi002 ceph-mon[32210]: pgmap v366: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T11:19:45.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:44 smithi077 ceph-mon[36410]: pgmap v366: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T11:19:45.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:44 smithi178 ceph-mon[36913]: pgmap v366: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T11:19:47.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:46 smithi077 ceph-mon[36410]: pgmap v367: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T11:19:47.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:46 smithi002 ceph-mon[32210]: pgmap v367: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T11:19:47.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:46 smithi178 ceph-mon[36913]: pgmap v367: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T11:19:49.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:48 smithi077 ceph-mon[36410]: pgmap v368: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T11:19:49.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:48 smithi002 ceph-mon[32210]: pgmap v368: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T11:19:49.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:48 smithi178 ceph-mon[36913]: pgmap v368: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T11:19:50.653 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T11:19:50.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:19:50.654 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-06-13T11:19:50.723 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T11:19:51.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:50 smithi002 ceph-mon[32210]: pgmap v369: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-06-13T11:19:51.196 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:19:51.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:50 smithi077 ceph-mon[36410]: pgmap v369: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-06-13T11:19:51.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:50 smithi178 ceph-mon[36913]: pgmap v369: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-06-13T11:19:53.286 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:52 smithi002 ceph-mon[32210]: pgmap v370: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T11:19:53.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:53 smithi077 ceph-mon[36410]: pgmap v370: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T11:19:53.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:53 smithi178 ceph-mon[36913]: pgmap v370: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T11:19:53.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.614+0000 7f040a800700 1 -- 172.21.15.2:0/3084784057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0404102fb0 msgr2=0x7f0404107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:53.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.614+0000 7f040a800700 1 --2- 172.21.15.2:0/3084784057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0404102fb0 0x7f0404107000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009990 tx=0x7f03f0009ca0 comp rx=0 tx=0).stop 2024-06-13T11:19:53.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.615+0000 7f040a800700 1 -- 172.21.15.2:0/3084784057 shutdown_connections 2024-06-13T11:19:53.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.615+0000 7f040a800700 1 --2- 172.21.15.2:0/3084784057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0404102600 0x7f04041029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:53.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.615+0000 7f040a800700 1 --2- 172.21.15.2:0/3084784057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04041076e0 0x7f040410f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:53.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.615+0000 7f040a800700 1 --2- 172.21.15.2:0/3084784057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0404102fb0 0x7f0404107000 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:53.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.615+0000 7f040a800700 1 -- 172.21.15.2:0/3084784057 >> 172.21.15.2:0/3084784057 conn(0x7f04040fdeb0 msgr2=0x7f04041002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:53.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.615+0000 7f040a800700 1 -- 172.21.15.2:0/3084784057 shutdown_connections 2024-06-13T11:19:53.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.615+0000 7f040a800700 1 -- 172.21.15.2:0/3084784057 wait complete. 2024-06-13T11:19:53.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.617+0000 7f040a800700 1 Processor -- start 2024-06-13T11:19:53.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.617+0000 7f040a800700 1 -- start start 2024-06-13T11:19:53.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.618+0000 7f040a800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0404102600 0x7f0404074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:53.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.618+0000 7f040a800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0404102fb0 0x7f0404074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:53.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.618+0000 7f040a800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04041076e0 0x7f0404075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:53.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.618+0000 7f040a800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04041126c0 con 0x7f0404102fb0 2024-06-13T11:19:53.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.618+0000 7f040a800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0404112540 con 0x7f0404102600 2024-06-13T11:19:53.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.618+0000 7f040a800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0404112840 con 0x7f04041076e0 2024-06-13T11:19:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.618+0000 7f0408a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0404102fb0 0x7f0404074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.618+0000 7f0408a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0404102fb0 0x7f0404074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46376/0 (socket says 172.21.15.2:46376) 2024-06-13T11:19:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.618+0000 7f0408a00700 1 -- 172.21.15.2:0/1531396870 learned_addr learned my addr 172.21.15.2:0/1531396870 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:19:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.618+0000 7f0409400700 1 --2- 172.21.15.2:0/1531396870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0404102600 0x7f0404074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.618+0000 7f0409e00700 1 --2- 172.21.15.2:0/1531396870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04041076e0 0x7f0404075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.619+0000 7f0408a00700 1 -- 172.21.15.2:0/1531396870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04041076e0 msgr2=0x7f0404075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:53.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.619+0000 7f0408a00700 1 --2- 172.21.15.2:0/1531396870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04041076e0 0x7f0404075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:53.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.619+0000 7f0408a00700 1 -- 172.21.15.2:0/1531396870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0404102600 msgr2=0x7f0404074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:53.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.619+0000 7f0408a00700 1 --2- 172.21.15.2:0/1531396870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0404102600 0x7f0404074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:53.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.619+0000 7f0408a00700 1 -- 172.21.15.2:0/1531396870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04041a70b0 con 0x7f0404102fb0 2024-06-13T11:19:53.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.619+0000 7f0408a00700 1 --2- 172.21.15.2:0/1531396870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0404102fb0 0x7f0404074cd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f03f0000c00 tx=0x7f03f000b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:53.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.619+0000 7f0402000700 1 -- 172.21.15.2:0/1531396870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f0027070 con 0x7f0404102fb0 2024-06-13T11:19:53.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.619+0000 7f0402000700 1 -- 172.21.15.2:0/1531396870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03f0022470 con 0x7f0404102fb0 2024-06-13T11:19:53.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.620+0000 7f040a800700 1 -- 172.21.15.2:0/1531396870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04041a7340 con 0x7f0404102fb0 2024-06-13T11:19:53.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.620+0000 7f0402000700 1 -- 172.21.15.2:0/1531396870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f0017650 con 0x7f0404102fb0 2024-06-13T11:19:53.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.620+0000 7f040a800700 1 -- 172.21.15.2:0/1531396870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04041a77f0 con 0x7f0404102fb0 2024-06-13T11:19:53.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.621+0000 7f040a800700 1 -- 172.21.15.2:0/1531396870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0404069180 con 0x7f0404102fb0 2024-06-13T11:19:53.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.623+0000 7f0402000700 1 -- 172.21.15.2:0/1531396870 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f03f002a070 con 0x7f0404102fb0 2024-06-13T11:19:53.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.624+0000 7f0402000700 1 --2- 172.21.15.2:0/1531396870 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f03ec0a2ca0 0x7f03ec0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:53.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.625+0000 7f0402000700 1 -- 172.21.15.2:0/1531396870 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9050+0+0 (secure 0 0 0) 0x7f03f00d0270 con 0x7f0404102fb0 2024-06-13T11:19:53.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.625+0000 7f0409400700 1 --2- 172.21.15.2:0/1531396870 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f03ec0a2ca0 0x7f03ec0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:53.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.625+0000 7f0409400700 1 --2- 172.21.15.2:0/1531396870 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f03ec0a2ca0 0x7f03ec0a5160 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009c60 tx=0x7f03f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:53.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.629+0000 7f0402000700 1 -- 172.21.15.2:0/1531396870 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f03f0013070 con 0x7f0404102fb0 2024-06-13T11:19:53.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.856+0000 7f040a800700 1 -- 172.21.15.2:0/1531396870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f040402dca0 con 0x7f0404102fb0 2024-06-13T11:19:53.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.859+0000 7f0402000700 1 -- 172.21.15.2:0/1531396870 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+24470 (secure 0 0 0) 0x7f03f009ced0 con 0x7f0404102fb0 2024-06-13T11:19:53.858 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:19:53.859 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":97,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","created":"2024-06-13T11:09:07.839101+0000","modified":"2024-06-13T11:19:26.977801+0000","last_up_change":"2024-06-13T11:17:28.731479+0000","last_in_change":"2024-06-13T11:17:08.849067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:13:13.793461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:18:36.784824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:18:41.824835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:18:55.545870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f5614d91-49a7-4983-a309-0de3b3e6263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6803","nonce":4127571834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6805","nonce":4127571834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6809","nonce":4127571834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6807","nonce":4127571834}]},"public_addr":"172.21.15.2:6803/4127571834","cluster_addr":"172.21.15.2:6805/4127571834","heartbeat_back_addr":"172.21.15.2:6809/4127571834","heartbeat_front_addr":"172.21.15.2:6807/4127571834","state":["exists","up"]},{"osd":1,"uuid":"d9dbe278-309f-4726-828a-da922f486b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6801","nonce":3180360713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6803","nonce":3180360713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6807","nonce":3180360713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6805","nonce":3180360713}]},"public_addr":"172.21.15.77:6801/3180360713","cluster_addr":"172.21.15.77:6803/3180360713","heartbeat_back_addr":"172.21.15.77:6807/3180360713","heartbeat_front_addr":"172.21.15.77:6805/3180360713","state":["exists","up"]},{"osd":2,"uuid":"04c267dc-7454-418f-9965-3ff96ef280ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6801","nonce":3825510575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6803","nonce":3825510575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6807","nonce":3825510575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6805","nonce":3825510575}]},"public_addr":"172.21.15.178:6801/3825510575","cluster_addr":"172.21.15.178:6803/3825510575","heartbeat_back_addr":"172.21.15.178:6807/3825510575","heartbeat_front_addr":"172.21.15.178:6805/3825510575","state":["exists","up"]},{"osd":3,"uuid":"3847bd4f-ca04-41de-9d88-e1523dd7ff8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6811","nonce":1982693353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6813","nonce":1982693353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6817","nonce":1982693353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6815","nonce":1982693353}]},"public_addr":"172.21.15.2:6811/1982693353","cluster_addr":"172.21.15.2:6813/1982693353","heartbeat_back_addr":"172.21.15.2:6817/1982693353","heartbeat_front_addr":"172.21.15.2:6815/1982693353","state":["exists","up"]},{"osd":4,"uuid":"34d7d2e8-3dee-42b9-a6cb-d4162b122b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6809","nonce":3916694904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6811","nonce":3916694904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6815","nonce":3916694904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6813","nonce":3916694904}]},"public_addr":"172.21.15.77:6809/3916694904","cluster_addr":"172.21.15.77:6811/3916694904","heartbeat_back_addr":"172.21.15.77:6815/3916694904","heartbeat_front_addr":"172.21.15.77:6813/3916694904","state":["exists","up"]},{"osd":5,"uuid":"0468aefc-c3c8-4758-9bbf-1225b7a5ae79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6809","nonce":3572805887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6811","nonce":3572805887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6815","nonce":3572805887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6813","nonce":3572805887}]},"public_addr":"172.21.15.178:6809/3572805887","cluster_addr":"172.21.15.178:6811/3572805887","heartbeat_back_addr":"172.21.15.178:6815/3572805887","heartbeat_front_addr":"172.21.15.178:6813/3572805887","state":["exists","up"]},{"osd":6,"uuid":"0a186a4a-0e28-47bd-b5ad-9bf8079f74c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6819","nonce":1592309584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6821","nonce":1592309584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6825","nonce":1592309584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6823","nonce":1592309584}]},"public_addr":"172.21.15.2:6819/1592309584","cluster_addr":"172.21.15.2:6821/1592309584","heartbeat_back_addr":"172.21.15.2:6825/1592309584","heartbeat_front_addr":"172.21.15.2:6823/1592309584","state":["exists","up"]},{"osd":7,"uuid":"646e66f7-1ef8-428d-a842-bf28c8606df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6817","nonce":1580055775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6819","nonce":1580055775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6823","nonce":1580055775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6821","nonce":1580055775}]},"public_addr":"172.21.15.77:6817/1580055775","cluster_addr":"172.21.15.77:6819/1580055775","heartbeat_back_addr":"172.21.15.77:6823/1580055775","heartbeat_front_addr":"172.21.15.77:6821/1580055775","state":["exists","up"]},{"osd":8,"uuid":"bcc971fc-47d7-4289-8a9a-c76996c57370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6817","nonce":4285192591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6819","nonce":4285192591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6823","nonce":4285192591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6821","nonce":4285192591}]},"public_addr":"172.21.15.178:6817/4285192591","cluster_addr":"172.21.15.178:6819/4285192591","heartbeat_back_addr":"172.21.15.178:6823/4285192591","heartbeat_front_addr":"172.21.15.178:6821/4285192591","state":["exists","up"]},{"osd":9,"uuid":"899d7d4f-a24c-4508-b42c-0b363275c459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6827","nonce":4187017478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6829","nonce":4187017478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6833","nonce":4187017478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6831","nonce":4187017478}]},"public_addr":"172.21.15.2:6827/4187017478","cluster_addr":"172.21.15.2:6829/4187017478","heartbeat_back_addr":"172.21.15.2:6833/4187017478","heartbeat_front_addr":"172.21.15.2:6831/4187017478","state":["exists","up"]},{"osd":10,"uuid":"112d2b8e-9673-4d7a-97e9-2089793fdd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6825","nonce":2039538463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6827","nonce":2039538463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6831","nonce":2039538463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6829","nonce":2039538463}]},"public_addr":"172.21.15.77:6825/2039538463","cluster_addr":"172.21.15.77:6827/2039538463","heartbeat_back_addr":"172.21.15.77:6831/2039538463","heartbeat_front_addr":"172.21.15.77:6829/2039538463","state":["exists","up"]},{"osd":11,"uuid":"6b8001f5-9c74-4cc7-8c41-906cb5ac9b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6825","nonce":1915058767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6827","nonce":1915058767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6831","nonce":1915058767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6829","nonce":1915058767}]},"public_addr":"172.21.15.178:6825/1915058767","cluster_addr":"172.21.15.178:6827/1915058767","heartbeat_back_addr":"172.21.15.178:6831/1915058767","heartbeat_front_addr":"172.21.15.178:6829/1915058767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:21.707572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:46.440115+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:10.197217+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:42.853367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:08.880473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:33.605677+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:07.655377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:33.980900+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:59.397529+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:16:33.983411+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:00.932649+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:26.894098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9},{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/315567313":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/2084201061":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/3394644803":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6801/1821969949":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/2170469985":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/142516651":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6801/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/3220886565":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6800/1821969949":"2024-06-14T11:10:25.084617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:19:53.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.862+0000 7f040a800700 1 -- 172.21.15.2:0/1531396870 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f03ec0a2ca0 msgr2=0x7f03ec0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:53.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.862+0000 7f040a800700 1 --2- 172.21.15.2:0/1531396870 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f03ec0a2ca0 0x7f03ec0a5160 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009c60 tx=0x7f03f8009260 comp rx=0 tx=0).stop 2024-06-13T11:19:53.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.862+0000 7f040a800700 1 -- 172.21.15.2:0/1531396870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0404102fb0 msgr2=0x7f0404074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:53.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.862+0000 7f040a800700 1 --2- 172.21.15.2:0/1531396870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0404102fb0 0x7f0404074cd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f03f0000c00 tx=0x7f03f000b610 comp rx=0 tx=0).stop 2024-06-13T11:19:53.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.862+0000 7f040a800700 1 -- 172.21.15.2:0/1531396870 shutdown_connections 2024-06-13T11:19:53.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.862+0000 7f040a800700 1 --2- 172.21.15.2:0/1531396870 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f03ec0a2ca0 0x7f03ec0a5160 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:53.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.862+0000 7f040a800700 1 --2- 172.21.15.2:0/1531396870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04041076e0 0x7f0404075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:53.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.862+0000 7f040a800700 1 --2- 172.21.15.2:0/1531396870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0404102600 0x7f0404074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:53.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.862+0000 7f040a800700 1 --2- 172.21.15.2:0/1531396870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0404102fb0 0x7f0404074cd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:53.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.862+0000 7f040a800700 1 -- 172.21.15.2:0/1531396870 >> 172.21.15.2:0/1531396870 conn(0x7f04040fdeb0 msgr2=0x7f04041001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:53.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.863+0000 7f040a800700 1 -- 172.21.15.2:0/1531396870 shutdown_connections 2024-06-13T11:19:53.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:53.863+0000 7f040a800700 1 -- 172.21.15.2:0/1531396870 wait complete. 2024-06-13T11:19:54.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:54 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1531396870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:19:54.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:54 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1531396870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:19:54.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:54 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1531396870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:19:54.814 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T11:19:55.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:55 smithi077 ceph-mon[36410]: pgmap v371: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T11:19:55.294 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:19:55.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:55 smithi002 ceph-mon[32210]: pgmap v371: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T11:19:55.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:55 smithi178 ceph-mon[36913]: pgmap v371: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T11:19:56.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:56 smithi002 ceph-mon[32210]: pgmap v372: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T11:19:56.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:56 smithi077 ceph-mon[36410]: pgmap v372: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T11:19:56.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:56 smithi178 ceph-mon[36913]: pgmap v372: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T11:19:57.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.596+0000 7f8acde00700 1 -- 172.21.15.2:0/3008126813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ac8101ed0 msgr2=0x7f8ac8105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:57.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.596+0000 7f8acde00700 1 --2- 172.21.15.2:0/3008126813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ac8101ed0 0x7f8ac8105f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009920 tx=0x7f8ab4009c30 comp rx=0 tx=0).stop 2024-06-13T11:19:57.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.596+0000 7f8acde00700 1 -- 172.21.15.2:0/3008126813 shutdown_connections 2024-06-13T11:19:57.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.596+0000 7f8acde00700 1 --2- 172.21.15.2:0/3008126813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac8101520 0x7f8ac8101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:57.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.596+0000 7f8acde00700 1 --2- 172.21.15.2:0/3008126813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac8106600 0x7f8ac810e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:57.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.596+0000 7f8acde00700 1 --2- 172.21.15.2:0/3008126813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ac8101ed0 0x7f8ac8105f20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:57.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.596+0000 7f8acde00700 1 -- 172.21.15.2:0/3008126813 >> 172.21.15.2:0/3008126813 conn(0x7f8ac80fcdb0 msgr2=0x7f8ac80ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:57.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.597+0000 7f8acde00700 1 -- 172.21.15.2:0/3008126813 shutdown_connections 2024-06-13T11:19:57.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.597+0000 7f8acde00700 1 -- 172.21.15.2:0/3008126813 wait complete. 2024-06-13T11:19:57.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.598+0000 7f8acde00700 1 Processor -- start 2024-06-13T11:19:57.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.598+0000 7f8acde00700 1 -- start start 2024-06-13T11:19:57.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.598+0000 7f8acde00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac8101520 0x7f8ac8102fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:57.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.598+0000 7f8acde00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac8101ed0 0x7f8ac8103500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:57.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.598+0000 7f8acde00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ac8106600 0x7f8ac8103a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:57.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.599+0000 7f8acde00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac8111610 con 0x7f8ac8101ed0 2024-06-13T11:19:57.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.599+0000 7f8acde00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac8111490 con 0x7f8ac8101520 2024-06-13T11:19:57.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.599+0000 7f8acde00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac8111790 con 0x7f8ac8106600 2024-06-13T11:19:57.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.599+0000 7f8acca00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac8101520 0x7f8ac8102fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.599+0000 7f8acca00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac8101520 0x7f8ac8102fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:57048/0 (socket says 172.21.15.2:57048) 2024-06-13T11:19:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.599+0000 7f8acca00700 1 -- 172.21.15.2:0/1397363991 learned_addr learned my addr 172.21.15.2:0/1397363991 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:19:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.599+0000 7f8ac7e00700 1 --2- 172.21.15.2:0/1397363991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac8101ed0 0x7f8ac8103500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.599+0000 7f8acd400700 1 --2- 172.21.15.2:0/1397363991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ac8106600 0x7f8ac8103a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:57.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.599+0000 7f8acca00700 1 -- 172.21.15.2:0/1397363991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ac8106600 msgr2=0x7f8ac8103a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:57.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.599+0000 7f8acca00700 1 --2- 172.21.15.2:0/1397363991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ac8106600 0x7f8ac8103a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:57.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.599+0000 7f8acca00700 1 -- 172.21.15.2:0/1397363991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac8101ed0 msgr2=0x7f8ac8103500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:57.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.599+0000 7f8acca00700 1 --2- 172.21.15.2:0/1397363991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac8101ed0 0x7f8ac8103500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:57.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.599+0000 7f8acca00700 1 -- 172.21.15.2:0/1397363991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac81a7180 con 0x7f8ac8101520 2024-06-13T11:19:57.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.600+0000 7f8acca00700 1 --2- 172.21.15.2:0/1397363991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac8101520 0x7f8ac8102fc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00e9c0 tx=0x7f8abc00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:57.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.600+0000 7f8ac5600700 1 -- 172.21.15.2:0/1397363991 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc004a30 con 0x7f8ac8101520 2024-06-13T11:19:57.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.600+0000 7f8ac5600700 1 -- 172.21.15.2:0/1397363991 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8abc00cca0 con 0x7f8ac8101520 2024-06-13T11:19:57.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.600+0000 7f8ac5600700 1 -- 172.21.15.2:0/1397363991 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc005610 con 0x7f8ac8101520 2024-06-13T11:19:57.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.600+0000 7f8acde00700 1 -- 172.21.15.2:0/1397363991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac81a7470 con 0x7f8ac8101520 2024-06-13T11:19:57.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.600+0000 7f8acde00700 1 -- 172.21.15.2:0/1397363991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac81a7930 con 0x7f8ac8101520 2024-06-13T11:19:57.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.601+0000 7f8acde00700 1 -- 172.21.15.2:0/1397363991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac8069180 con 0x7f8ac8101520 2024-06-13T11:19:57.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.603+0000 7f8ac5600700 1 -- 172.21.15.2:0/1397363991 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f8abc004cf0 con 0x7f8ac8101520 2024-06-13T11:19:57.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.604+0000 7f8ac5600700 1 --2- 172.21.15.2:0/1397363991 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8ab00a2c20 0x7f8ab00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:19:57.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.605+0000 7f8ac5600700 1 -- 172.21.15.2:0/1397363991 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9050+0+0 (secure 0 0 0) 0x7f8abc0cf4c0 con 0x7f8ac8101520 2024-06-13T11:19:57.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.605+0000 7f8ac7e00700 1 --2- 172.21.15.2:0/1397363991 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8ab00a2c20 0x7f8ab00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:19:57.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.606+0000 7f8ac7e00700 1 --2- 172.21.15.2:0/1397363991 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8ab00a2c20 0x7f8ab00a50e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c010 tx=0x7f8ab4019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:19:57.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.609+0000 7f8ac5600700 1 -- 172.21.15.2:0/1397363991 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8abc09c090 con 0x7f8ac8101520 2024-06-13T11:19:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.842+0000 7f8acde00700 1 -- 172.21.15.2:0/1397363991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ac81044f0 con 0x7f8ac8101520 2024-06-13T11:19:57.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.844+0000 7f8ac5600700 1 -- 172.21.15.2:0/1397363991 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+24470 (secure 0 0 0) 0x7f8abc09b990 con 0x7f8ac8101520 2024-06-13T11:19:57.846 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:19:57.846 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":97,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","created":"2024-06-13T11:09:07.839101+0000","modified":"2024-06-13T11:19:26.977801+0000","last_up_change":"2024-06-13T11:17:28.731479+0000","last_in_change":"2024-06-13T11:17:08.849067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:13:13.793461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:18:36.784824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:18:41.824835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:18:55.545870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f5614d91-49a7-4983-a309-0de3b3e6263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6803","nonce":4127571834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6805","nonce":4127571834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6809","nonce":4127571834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6807","nonce":4127571834}]},"public_addr":"172.21.15.2:6803/4127571834","cluster_addr":"172.21.15.2:6805/4127571834","heartbeat_back_addr":"172.21.15.2:6809/4127571834","heartbeat_front_addr":"172.21.15.2:6807/4127571834","state":["exists","up"]},{"osd":1,"uuid":"d9dbe278-309f-4726-828a-da922f486b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6801","nonce":3180360713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6803","nonce":3180360713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6807","nonce":3180360713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6805","nonce":3180360713}]},"public_addr":"172.21.15.77:6801/3180360713","cluster_addr":"172.21.15.77:6803/3180360713","heartbeat_back_addr":"172.21.15.77:6807/3180360713","heartbeat_front_addr":"172.21.15.77:6805/3180360713","state":["exists","up"]},{"osd":2,"uuid":"04c267dc-7454-418f-9965-3ff96ef280ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6801","nonce":3825510575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6803","nonce":3825510575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6807","nonce":3825510575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6805","nonce":3825510575}]},"public_addr":"172.21.15.178:6801/3825510575","cluster_addr":"172.21.15.178:6803/3825510575","heartbeat_back_addr":"172.21.15.178:6807/3825510575","heartbeat_front_addr":"172.21.15.178:6805/3825510575","state":["exists","up"]},{"osd":3,"uuid":"3847bd4f-ca04-41de-9d88-e1523dd7ff8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6811","nonce":1982693353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6813","nonce":1982693353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6817","nonce":1982693353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6815","nonce":1982693353}]},"public_addr":"172.21.15.2:6811/1982693353","cluster_addr":"172.21.15.2:6813/1982693353","heartbeat_back_addr":"172.21.15.2:6817/1982693353","heartbeat_front_addr":"172.21.15.2:6815/1982693353","state":["exists","up"]},{"osd":4,"uuid":"34d7d2e8-3dee-42b9-a6cb-d4162b122b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6809","nonce":3916694904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6811","nonce":3916694904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6815","nonce":3916694904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6813","nonce":3916694904}]},"public_addr":"172.21.15.77:6809/3916694904","cluster_addr":"172.21.15.77:6811/3916694904","heartbeat_back_addr":"172.21.15.77:6815/3916694904","heartbeat_front_addr":"172.21.15.77:6813/3916694904","state":["exists","up"]},{"osd":5,"uuid":"0468aefc-c3c8-4758-9bbf-1225b7a5ae79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6809","nonce":3572805887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6811","nonce":3572805887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6815","nonce":3572805887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6813","nonce":3572805887}]},"public_addr":"172.21.15.178:6809/3572805887","cluster_addr":"172.21.15.178:6811/3572805887","heartbeat_back_addr":"172.21.15.178:6815/3572805887","heartbeat_front_addr":"172.21.15.178:6813/3572805887","state":["exists","up"]},{"osd":6,"uuid":"0a186a4a-0e28-47bd-b5ad-9bf8079f74c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6819","nonce":1592309584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6821","nonce":1592309584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6825","nonce":1592309584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6823","nonce":1592309584}]},"public_addr":"172.21.15.2:6819/1592309584","cluster_addr":"172.21.15.2:6821/1592309584","heartbeat_back_addr":"172.21.15.2:6825/1592309584","heartbeat_front_addr":"172.21.15.2:6823/1592309584","state":["exists","up"]},{"osd":7,"uuid":"646e66f7-1ef8-428d-a842-bf28c8606df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6817","nonce":1580055775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6819","nonce":1580055775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6823","nonce":1580055775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6821","nonce":1580055775}]},"public_addr":"172.21.15.77:6817/1580055775","cluster_addr":"172.21.15.77:6819/1580055775","heartbeat_back_addr":"172.21.15.77:6823/1580055775","heartbeat_front_addr":"172.21.15.77:6821/1580055775","state":["exists","up"]},{"osd":8,"uuid":"bcc971fc-47d7-4289-8a9a-c76996c57370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6817","nonce":4285192591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6819","nonce":4285192591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6823","nonce":4285192591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6821","nonce":4285192591}]},"public_addr":"172.21.15.178:6817/4285192591","cluster_addr":"172.21.15.178:6819/4285192591","heartbeat_back_addr":"172.21.15.178:6823/4285192591","heartbeat_front_addr":"172.21.15.178:6821/4285192591","state":["exists","up"]},{"osd":9,"uuid":"899d7d4f-a24c-4508-b42c-0b363275c459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6827","nonce":4187017478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6829","nonce":4187017478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6833","nonce":4187017478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6831","nonce":4187017478}]},"public_addr":"172.21.15.2:6827/4187017478","cluster_addr":"172.21.15.2:6829/4187017478","heartbeat_back_addr":"172.21.15.2:6833/4187017478","heartbeat_front_addr":"172.21.15.2:6831/4187017478","state":["exists","up"]},{"osd":10,"uuid":"112d2b8e-9673-4d7a-97e9-2089793fdd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6825","nonce":2039538463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6827","nonce":2039538463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6831","nonce":2039538463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6829","nonce":2039538463}]},"public_addr":"172.21.15.77:6825/2039538463","cluster_addr":"172.21.15.77:6827/2039538463","heartbeat_back_addr":"172.21.15.77:6831/2039538463","heartbeat_front_addr":"172.21.15.77:6829/2039538463","state":["exists","up"]},{"osd":11,"uuid":"6b8001f5-9c74-4cc7-8c41-906cb5ac9b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6825","nonce":1915058767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6827","nonce":1915058767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6831","nonce":1915058767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6829","nonce":1915058767}]},"public_addr":"172.21.15.178:6825/1915058767","cluster_addr":"172.21.15.178:6827/1915058767","heartbeat_back_addr":"172.21.15.178:6831/1915058767","heartbeat_front_addr":"172.21.15.178:6829/1915058767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:21.707572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:46.440115+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:10.197217+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:42.853367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:08.880473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:33.605677+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:07.655377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:33.980900+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:59.397529+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:16:33.983411+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:00.932649+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:26.894098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9},{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/315567313":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/2084201061":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/3394644803":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6801/1821969949":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/2170469985":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/142516651":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6801/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/3220886565":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6800/1821969949":"2024-06-14T11:10:25.084617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:19:57.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.847+0000 7f8acde00700 1 -- 172.21.15.2:0/1397363991 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8ab00a2c20 msgr2=0x7f8ab00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:57.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.847+0000 7f8acde00700 1 --2- 172.21.15.2:0/1397363991 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8ab00a2c20 0x7f8ab00a50e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c010 tx=0x7f8ab4019040 comp rx=0 tx=0).stop 2024-06-13T11:19:57.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.847+0000 7f8acde00700 1 -- 172.21.15.2:0/1397363991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac8101520 msgr2=0x7f8ac8102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:19:57.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.847+0000 7f8acde00700 1 --2- 172.21.15.2:0/1397363991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac8101520 0x7f8ac8102fc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00e9c0 tx=0x7f8abc00ecd0 comp rx=0 tx=0).stop 2024-06-13T11:19:57.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.847+0000 7f8acde00700 1 -- 172.21.15.2:0/1397363991 shutdown_connections 2024-06-13T11:19:57.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.847+0000 7f8acde00700 1 --2- 172.21.15.2:0/1397363991 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8ab00a2c20 0x7f8ab00a50e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:57.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.847+0000 7f8acde00700 1 --2- 172.21.15.2:0/1397363991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ac8106600 0x7f8ac8103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:57.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.847+0000 7f8acde00700 1 --2- 172.21.15.2:0/1397363991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ac8101520 0x7f8ac8102fc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:57.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.847+0000 7f8acde00700 1 --2- 172.21.15.2:0/1397363991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ac8101ed0 0x7f8ac8103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:19:57.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.847+0000 7f8acde00700 1 -- 172.21.15.2:0/1397363991 >> 172.21.15.2:0/1397363991 conn(0x7f8ac80fcdb0 msgr2=0x7f8ac806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:19:57.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.848+0000 7f8acde00700 1 -- 172.21.15.2:0/1397363991 shutdown_connections 2024-06-13T11:19:57.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:19:57.848+0000 7f8acde00700 1 -- 172.21.15.2:0/1397363991 wait complete. 2024-06-13T11:19:58.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:58 smithi002 ceph-mon[32210]: pgmap v373: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T11:19:58.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:19:58 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1397363991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:19:58.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:58 smithi178 ceph-mon[36913]: pgmap v373: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T11:19:58.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:19:58 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1397363991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:19:58.761 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-06-13T11:19:58.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:58 smithi077 ceph-mon[36410]: pgmap v373: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T11:19:58.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:19:58 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1397363991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:19:59.220 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:20:00.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:00 smithi002 ceph-mon[32210]: pgmap v374: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T11:20:00.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:00 smithi002 ceph-mon[32210]: overall HEALTH_OK 2024-06-13T11:20:00.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:00 smithi178 ceph-mon[36913]: pgmap v374: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T11:20:00.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:00 smithi178 ceph-mon[36913]: overall HEALTH_OK 2024-06-13T11:20:00.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:00 smithi077 ceph-mon[36410]: pgmap v374: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T11:20:00.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:00 smithi077 ceph-mon[36410]: overall HEALTH_OK 2024-06-13T11:20:01.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.511+0000 7f7bf5200700 1 -- 172.21.15.2:0/2868096875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf0102740 msgr2=0x7f7bf0102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:01.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.511+0000 7f7bf5200700 1 --2- 172.21.15.2:0/2868096875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf0102740 0x7f7bf0102b20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7be0009920 tx=0x7f7be0009c30 comp rx=0 tx=0).stop 2024-06-13T11:20:01.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.511+0000 7f7bf5200700 1 -- 172.21.15.2:0/2868096875 shutdown_connections 2024-06-13T11:20:01.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.511+0000 7f7bf5200700 1 --2- 172.21.15.2:0/2868096875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf0102740 0x7f7bf0102b20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:01.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.511+0000 7f7bf5200700 1 --2- 172.21.15.2:0/2868096875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bf0107840 0x7f7bf010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:01.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.511+0000 7f7bf5200700 1 --2- 172.21.15.2:0/2868096875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bf01030f0 0x7f7bf0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:01.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.511+0000 7f7bf5200700 1 -- 172.21.15.2:0/2868096875 >> 172.21.15.2:0/2868096875 conn(0x7f7bf00795f0 msgr2=0x7f7bf0079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:01.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.511+0000 7f7bf5200700 1 -- 172.21.15.2:0/2868096875 shutdown_connections 2024-06-13T11:20:01.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.511+0000 7f7bf5200700 1 -- 172.21.15.2:0/2868096875 wait complete. 2024-06-13T11:20:01.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.512+0000 7f7bf5200700 1 Processor -- start 2024-06-13T11:20:01.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.512+0000 7f7bf5200700 1 -- start start 2024-06-13T11:20:01.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.513+0000 7f7bf5200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bf0102740 0x7f7bf019ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:01.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.513+0000 7f7bf5200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf01030f0 0x7f7bf019b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:01.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.513+0000 7f7bf5200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bf0107840 0x7f7bf019f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:01.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.513+0000 7f7bf5200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01127b0 con 0x7f7bf01030f0 2024-06-13T11:20:01.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.513+0000 7f7bf5200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf0112630 con 0x7f7bf0107840 2024-06-13T11:20:01.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.513+0000 7f7bf5200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf0112930 con 0x7f7bf0102740 2024-06-13T11:20:01.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.513+0000 7f7bede00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bf0102740 0x7f7bf019ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:01.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.513+0000 7f7bede00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bf0102740 0x7f7bf019ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:43398/0 (socket says 172.21.15.2:43398) 2024-06-13T11:20:01.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.513+0000 7f7bede00700 1 -- 172.21.15.2:0/4266756046 learned_addr learned my addr 172.21.15.2:0/4266756046 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:20:01.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.513+0000 7f7bed400700 1 --2- 172.21.15.2:0/4266756046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf01030f0 0x7f7bf019b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:01.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.514+0000 7f7bee800700 1 --2- 172.21.15.2:0/4266756046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bf0107840 0x7f7bf019f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:01.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.514+0000 7f7bede00700 1 -- 172.21.15.2:0/4266756046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bf0107840 msgr2=0x7f7bf019f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:01.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.514+0000 7f7bede00700 1 --2- 172.21.15.2:0/4266756046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bf0107840 0x7f7bf019f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:01.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.514+0000 7f7bede00700 1 -- 172.21.15.2:0/4266756046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf01030f0 msgr2=0x7f7bf019b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:01.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.514+0000 7f7bede00700 1 --2- 172.21.15.2:0/4266756046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf01030f0 0x7f7bf019b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:01.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.514+0000 7f7bede00700 1 -- 172.21.15.2:0/4266756046 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf019fe90 con 0x7f7bf0102740 2024-06-13T11:20:01.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.514+0000 7f7bede00700 1 --2- 172.21.15.2:0/4266756046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bf0102740 0x7f7bf019ae80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7be0000c00 tx=0x7f7be000fa70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:01.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.515+0000 7f7be6a00700 1 -- 172.21.15.2:0/4266756046 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be0027070 con 0x7f7bf0102740 2024-06-13T11:20:01.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.515+0000 7f7bf5200700 1 -- 172.21.15.2:0/4266756046 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf01a0120 con 0x7f7bf0102740 2024-06-13T11:20:01.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.515+0000 7f7be6a00700 1 -- 172.21.15.2:0/4266756046 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7be0005660 con 0x7f7bf0102740 2024-06-13T11:20:01.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.515+0000 7f7be6a00700 1 -- 172.21.15.2:0/4266756046 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be0004930 con 0x7f7bf0102740 2024-06-13T11:20:01.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.515+0000 7f7bf5200700 1 -- 172.21.15.2:0/4266756046 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf01a7a00 con 0x7f7bf0102740 2024-06-13T11:20:01.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.516+0000 7f7bf5200700 1 -- 172.21.15.2:0/4266756046 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf0069180 con 0x7f7bf0102740 2024-06-13T11:20:01.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.519+0000 7f7be6a00700 1 -- 172.21.15.2:0/4266756046 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f7be002a070 con 0x7f7bf0102740 2024-06-13T11:20:01.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.521+0000 7f7be6a00700 1 --2- 172.21.15.2:0/4266756046 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7bd40a2c20 0x7f7bd40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:01.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.521+0000 7f7be6a00700 1 -- 172.21.15.2:0/4266756046 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9050+0+0 (secure 0 0 0) 0x7f7be00cfdc0 con 0x7f7bf0102740 2024-06-13T11:20:01.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.521+0000 7f7bed400700 1 --2- 172.21.15.2:0/4266756046 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7bd40a2c20 0x7f7bd40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:01.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.522+0000 7f7bed400700 1 --2- 172.21.15.2:0/4266756046 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7bd40a2c20 0x7f7bd40a50e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7bf010f800 tx=0x7f7bdc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:01.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.525+0000 7f7be6a00700 1 -- 172.21.15.2:0/4266756046 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7be005e850 con 0x7f7bf0102740 2024-06-13T11:20:01.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:01.807+0000 7f7bf5200700 1 -- 172.21.15.2:0/4266756046 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7bf01a7bd0 con 0x7f7bf0102740 2024-06-13T11:20:02.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:02.345+0000 7f7be6a00700 1 -- 172.21.15.2:0/4266756046 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f7be0013030 con 0x7f7bf0102740 2024-06-13T11:20:02.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:02.350+0000 7f7bf5200700 1 -- 172.21.15.2:0/4266756046 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7bd40a2c20 msgr2=0x7f7bd40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:02.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:02.350+0000 7f7bf5200700 1 --2- 172.21.15.2:0/4266756046 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7bd40a2c20 0x7f7bd40a50e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7bf010f800 tx=0x7f7bdc009260 comp rx=0 tx=0).stop 2024-06-13T11:20:02.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:02.350+0000 7f7bf5200700 1 -- 172.21.15.2:0/4266756046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bf0102740 msgr2=0x7f7bf019ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:02.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:02.350+0000 7f7bf5200700 1 --2- 172.21.15.2:0/4266756046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bf0102740 0x7f7bf019ae80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7be0000c00 tx=0x7f7be000fa70 comp rx=0 tx=0).stop 2024-06-13T11:20:02.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:02.350+0000 7f7bf5200700 1 -- 172.21.15.2:0/4266756046 shutdown_connections 2024-06-13T11:20:02.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:02.350+0000 7f7bf5200700 1 --2- 172.21.15.2:0/4266756046 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7bd40a2c20 0x7f7bd40a50e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:02.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:02.350+0000 7f7bf5200700 1 --2- 172.21.15.2:0/4266756046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bf0107840 0x7f7bf019f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:02.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:02.350+0000 7f7bf5200700 1 --2- 172.21.15.2:0/4266756046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bf0102740 0x7f7bf019ae80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:02.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:02.350+0000 7f7bf5200700 1 --2- 172.21.15.2:0/4266756046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf01030f0 0x7f7bf019b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:02.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:02.350+0000 7f7bf5200700 1 -- 172.21.15.2:0/4266756046 >> 172.21.15.2:0/4266756046 conn(0x7f7bf00795f0 msgr2=0x7f7bf0100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:02.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:02.350+0000 7f7bf5200700 1 -- 172.21.15.2:0/4266756046 shutdown_connections 2024-06-13T11:20:02.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:02.351+0000 7f7bf5200700 1 -- 172.21.15.2:0/4266756046 wait complete. 2024-06-13T11:20:02.592 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:02 smithi077 ceph-mon[36410]: pgmap v375: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:20:02.592 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:02 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/4266756046' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-13T11:20:02.592 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:02 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-13T11:20:02.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:02 smithi002 ceph-mon[32210]: pgmap v375: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:20:02.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:02 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/4266756046' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-13T11:20:02.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:02 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-13T11:20:02.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:02 smithi178 ceph-mon[36913]: pgmap v375: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:20:02.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:02 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/4266756046' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-13T11:20:02.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:02 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-13T11:20:03.183 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-06-13T11:20:03.184 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-06-13T11:20:03.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:03 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-13T11:20:03.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:03 smithi002 ceph-mon[32210]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-13T11:20:03.664 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:20:03.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:03 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-13T11:20:03.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:03 smithi178 ceph-mon[36913]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-13T11:20:03.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:03 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-13T11:20:03.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:03 smithi077 ceph-mon[36410]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-13T11:20:04.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:04 smithi002 ceph-mon[32210]: pgmap v376: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:20:04.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:04 smithi178 ceph-mon[36913]: pgmap v376: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:20:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:04 smithi077 ceph-mon[36410]: pgmap v376: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:20:05.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.987+0000 7f6adf200700 1 -- 172.21.15.2:0/1052817132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0101160 msgr2=0x7f6ae0101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:05.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.987+0000 7f6adf200700 1 --2- 172.21.15.2:0/1052817132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0101160 0x7f6ae0101540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009990 tx=0x7f6ad0009ca0 comp rx=0 tx=0).stop 2024-06-13T11:20:05.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.987+0000 7f6adf200700 1 -- 172.21.15.2:0/1052817132 shutdown_connections 2024-06-13T11:20:05.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.987+0000 7f6adf200700 1 --2- 172.21.15.2:0/1052817132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0101160 0x7f6ae0101540 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:05.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.987+0000 7f6adf200700 1 --2- 172.21.15.2:0/1052817132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ae010ed10 0x7f6ae0111100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:05.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.987+0000 7f6adf200700 1 --2- 172.21.15.2:0/1052817132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ae0101b10 0x7f6ae010e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:05.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.987+0000 7f6adf200700 1 -- 172.21.15.2:0/1052817132 >> 172.21.15.2:0/1052817132 conn(0x7f6ae00fce20 msgr2=0x7f6ae00ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:05.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.987+0000 7f6adf200700 1 -- 172.21.15.2:0/1052817132 shutdown_connections 2024-06-13T11:20:05.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.987+0000 7f6adf200700 1 -- 172.21.15.2:0/1052817132 wait complete. 2024-06-13T11:20:05.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.988+0000 7f6adf200700 1 Processor -- start 2024-06-13T11:20:05.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.989+0000 7f6adf200700 1 -- start start 2024-06-13T11:20:05.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.989+0000 7f6adf200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ae0101160 0x7f6ae019ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:05.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.989+0000 7f6adf200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0101b10 0x7f6ae019b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:05.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.989+0000 7f6adf200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ae010ed10 0x7f6ae019f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:05.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.989+0000 7f6adf200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0114970 con 0x7f6ae0101b10 2024-06-13T11:20:05.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.989+0000 7f6adf200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01147f0 con 0x7f6ae0101160 2024-06-13T11:20:05.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.989+0000 7f6adf200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0114af0 con 0x7f6ae010ed10 2024-06-13T11:20:05.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.989+0000 7f6adde00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ae0101160 0x7f6ae019ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:05.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.990+0000 7f6add400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0101b10 0x7f6ae019b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:05.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.990+0000 7f6adde00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ae0101160 0x7f6ae019ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:58234/0 (socket says 172.21.15.2:58234) 2024-06-13T11:20:05.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.990+0000 7f6adde00700 1 -- 172.21.15.2:0/890006643 learned_addr learned my addr 172.21.15.2:0/890006643 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:20:05.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.990+0000 7f6ade800700 1 --2- 172.21.15.2:0/890006643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ae010ed10 0x7f6ae019f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:05.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.990+0000 7f6adde00700 1 -- 172.21.15.2:0/890006643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ae010ed10 msgr2=0x7f6ae019f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:05.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.990+0000 7f6adde00700 1 --2- 172.21.15.2:0/890006643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ae010ed10 0x7f6ae019f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:05.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.990+0000 7f6adde00700 1 -- 172.21.15.2:0/890006643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0101b10 msgr2=0x7f6ae019b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:05.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.990+0000 7f6adde00700 1 --2- 172.21.15.2:0/890006643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0101b10 0x7f6ae019b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:05.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.990+0000 7f6adde00700 1 -- 172.21.15.2:0/890006643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae019fdf0 con 0x7f6ae0101160 2024-06-13T11:20:05.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.990+0000 7f6adde00700 1 --2- 172.21.15.2:0/890006643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ae0101160 0x7f6ae019ade0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000bae0 tx=0x7f6ad000bb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:05.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.991+0000 7f6ad6a00700 1 -- 172.21.15.2:0/890006643 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0026070 con 0x7f6ae0101160 2024-06-13T11:20:05.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.991+0000 7f6ad6a00700 1 -- 172.21.15.2:0/890006643 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad0003d70 con 0x7f6ae0101160 2024-06-13T11:20:05.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.991+0000 7f6ad6a00700 1 -- 172.21.15.2:0/890006643 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0021410 con 0x7f6ae0101160 2024-06-13T11:20:05.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.991+0000 7f6adf200700 1 -- 172.21.15.2:0/890006643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae01a0080 con 0x7f6ae0101160 2024-06-13T11:20:05.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.991+0000 7f6adf200700 1 -- 172.21.15.2:0/890006643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae01a7960 con 0x7f6ae0101160 2024-06-13T11:20:05.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.992+0000 7f6adf200700 1 -- 172.21.15.2:0/890006643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae006b2e0 con 0x7f6ae0101160 2024-06-13T11:20:05.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.994+0000 7f6ad6a00700 1 -- 172.21.15.2:0/890006643 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f6ad0029070 con 0x7f6ae0101160 2024-06-13T11:20:05.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.995+0000 7f6ad6a00700 1 --2- 172.21.15.2:0/890006643 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f6ac40a2ca0 0x7f6ac40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:05.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.995+0000 7f6ad6a00700 1 -- 172.21.15.2:0/890006643 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9050+0+0 (secure 0 0 0) 0x7f6ad00cffe0 con 0x7f6ae0101160 2024-06-13T11:20:05.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.996+0000 7f6add400700 1 --2- 172.21.15.2:0/890006643 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f6ac40a2ca0 0x7f6ac40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:05.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:05.996+0000 7f6add400700 1 --2- 172.21.15.2:0/890006643 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f6ac40a2ca0 0x7f6ac40a5160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00ff260 tx=0x7f6acc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:05.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:06.000+0000 7f6ad6a00700 1 -- 172.21.15.2:0/890006643 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6ad005d850 con 0x7f6ae0101160 2024-06-13T11:20:06.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:06.283+0000 7f6adf200700 1 -- 172.21.15.2:0/890006643 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f6ae019c140 con 0x7f6ae0101160 2024-06-13T11:20:06.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:06.365+0000 7f6ad6a00700 1 -- 172.21.15.2:0/890006643 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f6ad0013070 con 0x7f6ae0101160 2024-06-13T11:20:06.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:06.369+0000 7f6adf200700 1 -- 172.21.15.2:0/890006643 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f6ac40a2ca0 msgr2=0x7f6ac40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:06.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:06.369+0000 7f6adf200700 1 --2- 172.21.15.2:0/890006643 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f6ac40a2ca0 0x7f6ac40a5160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00ff260 tx=0x7f6acc009260 comp rx=0 tx=0).stop 2024-06-13T11:20:06.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:06.369+0000 7f6adf200700 1 -- 172.21.15.2:0/890006643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ae0101160 msgr2=0x7f6ae019ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:06.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:06.369+0000 7f6adf200700 1 --2- 172.21.15.2:0/890006643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ae0101160 0x7f6ae019ade0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000bae0 tx=0x7f6ad000bb10 comp rx=0 tx=0).stop 2024-06-13T11:20:06.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:06.369+0000 7f6adf200700 1 -- 172.21.15.2:0/890006643 shutdown_connections 2024-06-13T11:20:06.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:06.369+0000 7f6adf200700 1 --2- 172.21.15.2:0/890006643 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f6ac40a2ca0 0x7f6ac40a5160 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:06.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:06.369+0000 7f6adf200700 1 --2- 172.21.15.2:0/890006643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ae010ed10 0x7f6ae019f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:06.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:06.369+0000 7f6adf200700 1 --2- 172.21.15.2:0/890006643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ae0101160 0x7f6ae019ade0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:06.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:06.369+0000 7f6adf200700 1 --2- 172.21.15.2:0/890006643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0101b10 0x7f6ae019b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:06.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:06.369+0000 7f6adf200700 1 -- 172.21.15.2:0/890006643 >> 172.21.15.2:0/890006643 conn(0x7f6ae00fce20 msgr2=0x7f6ae010ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:06.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:06.369+0000 7f6adf200700 1 -- 172.21.15.2:0/890006643 shutdown_connections 2024-06-13T11:20:06.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:06.370+0000 7f6adf200700 1 -- 172.21.15.2:0/890006643 wait complete. 2024-06-13T11:20:06.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:06 smithi002 ceph-mon[32210]: pgmap v377: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:20:06.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:06 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/890006643' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-13T11:20:06.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:06 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-13T11:20:06.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:06 smithi178 ceph-mon[36913]: pgmap v377: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:20:06.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:06 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/890006643' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-13T11:20:06.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:06 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-13T11:20:06.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:06 smithi077 ceph-mon[36410]: pgmap v377: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:20:06.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:06 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/890006643' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-13T11:20:06.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:06 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-13T11:20:07.237 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-06-13T11:20:07.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:07 smithi002 ceph-mon[32210]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-13T11:20:07.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:07 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-06-13T11:20:07.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:07 smithi002 ceph-mon[32210]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-13T11:20:07.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:07 smithi002 ceph-mon[32210]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-13T11:20:07.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:07 smithi002 ceph-mon[32210]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-06-13T11:20:07.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:07 smithi002 ceph-mon[32210]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-06-13T11:20:07.696 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:20:07 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-i[68535]: 2024-06-13T11:20:07.630+0000 7f8000686700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-06-13T11:20:07.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:07 smithi178 ceph-mon[36913]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-13T11:20:07.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:07 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-06-13T11:20:07.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:07 smithi178 ceph-mon[36913]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-13T11:20:07.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:07 smithi178 ceph-mon[36913]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-13T11:20:07.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:07 smithi178 ceph-mon[36913]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-06-13T11:20:07.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:07 smithi178 ceph-mon[36913]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-06-13T11:20:07.710 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:20:07.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:07 smithi077 ceph-mon[36410]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-13T11:20:07.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:07 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-06-13T11:20:07.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:07 smithi077 ceph-mon[36410]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-13T11:20:07.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:07 smithi077 ceph-mon[36410]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-06-13T11:20:07.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:07 smithi077 ceph-mon[36410]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-06-13T11:20:07.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:07 smithi077 ceph-mon[36410]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-06-13T11:20:08.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:08 smithi002 ceph-mon[32210]: pgmap v378: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-06-13T11:20:08.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:08 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] up:active 2024-06-13T11:20:08.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:08 smithi002 ceph-mon[32210]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-13T11:20:08.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:08 smithi002 ceph-mon[32210]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-13T11:20:08.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:08 smithi002 ceph-mon[32210]: Cluster is now healthy 2024-06-13T11:20:08.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:08 smithi002 ceph-mon[32210]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-06-13T11:20:08.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:08 smithi002 ceph-mon[32210]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-06-13T11:20:08.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:08 smithi002 ceph-mon[32210]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-06-13T11:20:08.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:08 smithi178 ceph-mon[36913]: pgmap v378: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-06-13T11:20:08.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:08 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] up:active 2024-06-13T11:20:08.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:08 smithi178 ceph-mon[36913]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-13T11:20:08.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:08 smithi178 ceph-mon[36913]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-13T11:20:08.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:08 smithi178 ceph-mon[36913]: Cluster is now healthy 2024-06-13T11:20:08.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:08 smithi178 ceph-mon[36913]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-06-13T11:20:08.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:08 smithi178 ceph-mon[36913]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-06-13T11:20:08.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:08 smithi178 ceph-mon[36913]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-06-13T11:20:08.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:08 smithi077 ceph-mon[36410]: pgmap v378: 129 pgs: 129 active+clean; 581 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-06-13T11:20:08.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:08 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] up:active 2024-06-13T11:20:08.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:08 smithi077 ceph-mon[36410]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-13T11:20:08.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:08 smithi077 ceph-mon[36410]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-13T11:20:08.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:08 smithi077 ceph-mon[36410]: Cluster is now healthy 2024-06-13T11:20:08.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:08 smithi077 ceph-mon[36410]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-06-13T11:20:08.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:08 smithi077 ceph-mon[36410]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-06-13T11:20:08.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:08 smithi077 ceph-mon[36410]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-06-13T11:20:09.689 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:09 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] up:active 2024-06-13T11:20:09.689 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:09 smithi002 ceph-mon[32210]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-06-13T11:20:09.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:09 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] up:active 2024-06-13T11:20:09.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:09 smithi178 ceph-mon[36913]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-06-13T11:20:09.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:09 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] up:active 2024-06-13T11:20:09.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:09 smithi077 ceph-mon[36410]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-06-13T11:20:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.005+0000 7fec35800700 1 -- 172.21.15.2:0/4196523881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec30113660 msgr2=0x7fec30115a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.005+0000 7fec35800700 1 --2- 172.21.15.2:0/4196523881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec30113660 0x7fec30115a50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fec28009f90 tx=0x7fec2800b330 comp rx=0 tx=0).stop 2024-06-13T11:20:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.005+0000 7fec35800700 1 -- 172.21.15.2:0/4196523881 shutdown_connections 2024-06-13T11:20:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.005+0000 7fec35800700 1 --2- 172.21.15.2:0/4196523881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec300746c0 0x7fec30074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:10.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.005+0000 7fec35800700 1 --2- 172.21.15.2:0/4196523881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec30113660 0x7fec30115a50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:10.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.005+0000 7fec35800700 1 --2- 172.21.15.2:0/4196523881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec30074fe0 0x7fec30113120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:10.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.005+0000 7fec35800700 1 -- 172.21.15.2:0/4196523881 >> 172.21.15.2:0/4196523881 conn(0x7fec300795f0 msgr2=0x7fec30079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:10.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.005+0000 7fec35800700 1 -- 172.21.15.2:0/4196523881 shutdown_connections 2024-06-13T11:20:10.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.005+0000 7fec35800700 1 -- 172.21.15.2:0/4196523881 wait complete. 2024-06-13T11:20:10.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.006+0000 7fec35800700 1 Processor -- start 2024-06-13T11:20:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.007+0000 7fec35800700 1 -- start start 2024-06-13T11:20:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.007+0000 7fec35800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec300746c0 0x7fec3019f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.007+0000 7fec35800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec30074fe0 0x7fec3019f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.007+0000 7fec35800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec30113660 0x7fec301a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.007+0000 7fec35800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec30118d80 con 0x7fec30113660 2024-06-13T11:20:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.008+0000 7fec35800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fec30118c00 con 0x7fec30074fe0 2024-06-13T11:20:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.008+0000 7fec35800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fec30118f00 con 0x7fec300746c0 2024-06-13T11:20:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.008+0000 7fec2ea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec300746c0 0x7fec3019f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.008+0000 7fec2ea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec300746c0 0x7fec3019f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:52182/0 (socket says 172.21.15.2:52182) 2024-06-13T11:20:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.008+0000 7fec2ea00700 1 -- 172.21.15.2:0/4107962326 learned_addr learned my addr 172.21.15.2:0/4107962326 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:20:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.008+0000 7fec2e000700 1 --2- 172.21.15.2:0/4107962326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec30074fe0 0x7fec3019f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.008+0000 7fec2f400700 1 --2- 172.21.15.2:0/4107962326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec30113660 0x7fec301a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.008+0000 7fec2e000700 1 -- 172.21.15.2:0/4107962326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec300746c0 msgr2=0x7fec3019f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.008+0000 7fec2e000700 1 --2- 172.21.15.2:0/4107962326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec300746c0 0x7fec3019f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.008+0000 7fec2e000700 1 -- 172.21.15.2:0/4107962326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec30113660 msgr2=0x7fec301a3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:10.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.008+0000 7fec2e000700 1 --2- 172.21.15.2:0/4107962326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec30113660 0x7fec301a3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:10.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.008+0000 7fec2e000700 1 -- 172.21.15.2:0/4107962326 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec301a4190 con 0x7fec30074fe0 2024-06-13T11:20:10.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.009+0000 7fec2e000700 1 --2- 172.21.15.2:0/4107962326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec30074fe0 0x7fec3019f710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00e9f0 tx=0x7fec1c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:10.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.009+0000 7fec27400700 1 -- 172.21.15.2:0/4107962326 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00cb70 con 0x7fec30074fe0 2024-06-13T11:20:10.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.009+0000 7fec35800700 1 -- 172.21.15.2:0/4107962326 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec301a4480 con 0x7fec30074fe0 2024-06-13T11:20:10.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.009+0000 7fec27400700 1 -- 172.21.15.2:0/4107962326 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec1c00ee90 con 0x7fec30074fe0 2024-06-13T11:20:10.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.009+0000 7fec27400700 1 -- 172.21.15.2:0/4107962326 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c003dc0 con 0x7fec30074fe0 2024-06-13T11:20:10.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.009+0000 7fec35800700 1 -- 172.21.15.2:0/4107962326 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec301abd00 con 0x7fec30074fe0 2024-06-13T11:20:10.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.010+0000 7fec35800700 1 -- 172.21.15.2:0/4107962326 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec30069180 con 0x7fec30074fe0 2024-06-13T11:20:10.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.013+0000 7fec27400700 1 -- 172.21.15.2:0/4107962326 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fec1c043ae0 con 0x7fec30074fe0 2024-06-13T11:20:10.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.015+0000 7fec27400700 1 --2- 172.21.15.2:0/4107962326 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fec140a2c20 0x7fec140a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:10.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.015+0000 7fec27400700 1 -- 172.21.15.2:0/4107962326 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9050+0+0 (secure 0 0 0) 0x7fec1c0cf3d0 con 0x7fec30074fe0 2024-06-13T11:20:10.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.015+0000 7fec2ea00700 1 --2- 172.21.15.2:0/4107962326 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fec140a2c20 0x7fec140a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.016+0000 7fec2ea00700 1 --2- 172.21.15.2:0/4107962326 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fec140a2c20 0x7fec140a50e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fec20005950 tx=0x7fec20009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.016+0000 7fec27400700 1 -- 172.21.15.2:0/4107962326 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fec1c00f3c0 con 0x7fec30074fe0 2024-06-13T11:20:10.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.298+0000 7fec35800700 1 -- 172.21.15.2:0/4107962326 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fec301a04e0 con 0x7fec30074fe0 2024-06-13T11:20:10.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.419+0000 7fec27400700 1 -- 172.21.15.2:0/4107962326 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7fec301a04e0 con 0x7fec30074fe0 2024-06-13T11:20:10.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.422+0000 7fec35800700 1 -- 172.21.15.2:0/4107962326 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fec140a2c20 msgr2=0x7fec140a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:10.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.422+0000 7fec35800700 1 --2- 172.21.15.2:0/4107962326 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fec140a2c20 0x7fec140a50e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fec20005950 tx=0x7fec20009310 comp rx=0 tx=0).stop 2024-06-13T11:20:10.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.422+0000 7fec35800700 1 -- 172.21.15.2:0/4107962326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec30074fe0 msgr2=0x7fec3019f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:10.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.422+0000 7fec35800700 1 --2- 172.21.15.2:0/4107962326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec30074fe0 0x7fec3019f710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00e9f0 tx=0x7fec1c00ed00 comp rx=0 tx=0).stop 2024-06-13T11:20:10.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.423+0000 7fec35800700 1 -- 172.21.15.2:0/4107962326 shutdown_connections 2024-06-13T11:20:10.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.423+0000 7fec35800700 1 --2- 172.21.15.2:0/4107962326 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fec140a2c20 0x7fec140a50e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:10.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.423+0000 7fec35800700 1 --2- 172.21.15.2:0/4107962326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec30113660 0x7fec301a3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:10.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.423+0000 7fec35800700 1 --2- 172.21.15.2:0/4107962326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec300746c0 0x7fec3019f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:10.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.423+0000 7fec35800700 1 --2- 172.21.15.2:0/4107962326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec30074fe0 0x7fec3019f710 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:10.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.423+0000 7fec35800700 1 -- 172.21.15.2:0/4107962326 >> 172.21.15.2:0/4107962326 conn(0x7fec300795f0 msgr2=0x7fec301123b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:10.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.423+0000 7fec35800700 1 -- 172.21.15.2:0/4107962326 shutdown_connections 2024-06-13T11:20:10.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:10.423+0000 7fec35800700 1 -- 172.21.15.2:0/4107962326 wait complete. 2024-06-13T11:20:10.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:10 smithi002 ceph-mon[32210]: pgmap v379: 129 pgs: 129 active+clean; 582 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 2 op/s 2024-06-13T11:20:10.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:10 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/4107962326' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-13T11:20:10.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:10 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-13T11:20:10.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:10 smithi178 ceph-mon[36913]: pgmap v379: 129 pgs: 129 active+clean; 582 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 2 op/s 2024-06-13T11:20:10.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:10 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/4107962326' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-13T11:20:10.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:10 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-13T11:20:10.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:10 smithi077 ceph-mon[36410]: pgmap v379: 129 pgs: 129 active+clean; 582 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 2 op/s 2024-06-13T11:20:10.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:10 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/4107962326' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-13T11:20:10.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:10 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-13T11:20:11.233 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-06-13T11:20:11.694 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:20:11.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:11 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-13T11:20:11.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:11 smithi178 ceph-mon[36913]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-06-13T11:20:11.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:11 smithi178 ceph-mon[36913]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:20:11.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:11 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-13T11:20:11.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:11 smithi077 ceph-mon[36410]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-06-13T11:20:11.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:11 smithi077 ceph-mon[36410]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:20:11.845 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:11 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-13T11:20:11.845 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:11 smithi002 ceph-mon[32210]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-06-13T11:20:11.845 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:11 smithi002 ceph-mon[32210]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:20:12.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:12 smithi002 ceph-mon[32210]: pgmap v380: 129 pgs: 129 active+clean; 583 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1.8 KiB/s wr, 6 op/s 2024-06-13T11:20:12.696 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:20:12 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-i[68535]: 2024-06-13T11:20:12.630+0000 7f8000686700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-06-13T11:20:12.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:12 smithi178 ceph-mon[36913]: pgmap v380: 129 pgs: 129 active+clean; 583 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1.8 KiB/s wr, 6 op/s 2024-06-13T11:20:12.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:12 smithi077 ceph-mon[36410]: pgmap v380: 129 pgs: 129 active+clean; 583 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1.8 KiB/s wr, 6 op/s 2024-06-13T11:20:14.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.092+0000 7f32fd800700 1 -- 172.21.15.2:0/2797280682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32f8102fd0 msgr2=0x7f32f8107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.092+0000 7f32fd800700 1 --2- 172.21.15.2:0/2797280682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32f8102fd0 0x7f32f8107020 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009990 tx=0x7f32e0009ca0 comp rx=0 tx=0).stop 2024-06-13T11:20:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.092+0000 7f32fd800700 1 -- 172.21.15.2:0/2797280682 shutdown_connections 2024-06-13T11:20:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.092+0000 7f32fd800700 1 --2- 172.21.15.2:0/2797280682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32f8102620 0x7f32f8102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.092+0000 7f32fd800700 1 --2- 172.21.15.2:0/2797280682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32f8107700 0x7f32f810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.092+0000 7f32fd800700 1 --2- 172.21.15.2:0/2797280682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32f8102fd0 0x7f32f8107020 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.092+0000 7f32fd800700 1 -- 172.21.15.2:0/2797280682 >> 172.21.15.2:0/2797280682 conn(0x7f32f80fdf10 msgr2=0x7f32f8100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.092+0000 7f32fd800700 1 -- 172.21.15.2:0/2797280682 shutdown_connections 2024-06-13T11:20:14.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.093+0000 7f32fd800700 1 -- 172.21.15.2:0/2797280682 wait complete. 2024-06-13T11:20:14.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.094+0000 7f32fd800700 1 Processor -- start 2024-06-13T11:20:14.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.094+0000 7f32fd800700 1 -- start start 2024-06-13T11:20:14.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.094+0000 7f32fd800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32f8102620 0x7f32f8074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:14.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.094+0000 7f32fd800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32f8102fd0 0x7f32f8074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.094+0000 7f32fd800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32f8107700 0x7f32f8075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.094+0000 7f32fd800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f32f8112710 con 0x7f32f8107700 2024-06-13T11:20:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.094+0000 7f32fd800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f32f8112590 con 0x7f32f8102fd0 2024-06-13T11:20:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.094+0000 7f32fd800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f32f8112890 con 0x7f32f8102620 2024-06-13T11:20:14.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.095+0000 7f32efe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32f8102fd0 0x7f32f8074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:14.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.095+0000 7f32f7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32f8102620 0x7f32f8074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:14.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.095+0000 7f32efe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32f8102fd0 0x7f32f8074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:58272/0 (socket says 172.21.15.2:58272) 2024-06-13T11:20:14.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.095+0000 7f32efe00700 1 -- 172.21.15.2:0/1558506873 learned_addr learned my addr 172.21.15.2:0/1558506873 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:20:14.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.095+0000 7f32fce00700 1 --2- 172.21.15.2:0/1558506873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32f8107700 0x7f32f8075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.095+0000 7f32f7e00700 1 -- 172.21.15.2:0/1558506873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32f8102fd0 msgr2=0x7f32f8074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.095+0000 7f32f7e00700 1 --2- 172.21.15.2:0/1558506873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32f8102fd0 0x7f32f8074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.095+0000 7f32f7e00700 1 -- 172.21.15.2:0/1558506873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32f8107700 msgr2=0x7f32f8075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.095+0000 7f32f7e00700 1 --2- 172.21.15.2:0/1558506873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32f8107700 0x7f32f8075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.095+0000 7f32f7e00700 1 -- 172.21.15.2:0/1558506873 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f81a7130 con 0x7f32f8102620 2024-06-13T11:20:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.096+0000 7f32f7e00700 1 --2- 172.21.15.2:0/1558506873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32f8102620 0x7f32f8074790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f32e800e9f0 tx=0x7f32e800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.096+0000 7f32f5600700 1 -- 172.21.15.2:0/1558506873 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e800c9c0 con 0x7f32f8102620 2024-06-13T11:20:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.096+0000 7f32f5600700 1 -- 172.21.15.2:0/1558506873 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32e800cb60 con 0x7f32f8102620 2024-06-13T11:20:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.096+0000 7f32fd800700 1 -- 172.21.15.2:0/1558506873 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f81a7420 con 0x7f32f8102620 2024-06-13T11:20:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.096+0000 7f32f5600700 1 -- 172.21.15.2:0/1558506873 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e8018680 con 0x7f32f8102620 2024-06-13T11:20:14.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.096+0000 7f32fd800700 1 -- 172.21.15.2:0/1558506873 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f81a79b0 con 0x7f32f8102620 2024-06-13T11:20:14.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.097+0000 7f32fd800700 1 -- 172.21.15.2:0/1558506873 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f8069180 con 0x7f32f8102620 2024-06-13T11:20:14.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.100+0000 7f32f5600700 1 -- 172.21.15.2:0/1558506873 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f32e8010430 con 0x7f32f8102620 2024-06-13T11:20:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.101+0000 7f32f5600700 1 --2- 172.21.15.2:0/1558506873 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f32dc0a2ca0 0x7f32dc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.101+0000 7f32f5600700 1 -- 172.21.15.2:0/1558506873 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9050+0+0 (secure 0 0 0) 0x7f32e80cf760 con 0x7f32f8102620 2024-06-13T11:20:14.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.101+0000 7f32efe00700 1 --2- 172.21.15.2:0/1558506873 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f32dc0a2ca0 0x7f32dc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:14.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.102+0000 7f32efe00700 1 --2- 172.21.15.2:0/1558506873 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f32dc0a2ca0 0x7f32dc0a5160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009750 tx=0x7f32e000b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:14.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.104+0000 7f32f5600700 1 -- 172.21.15.2:0/1558506873 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f32e809c330 con 0x7f32f8102620 2024-06-13T11:20:14.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.393+0000 7f32fd800700 1 -- 172.21.15.2:0/1558506873 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f32f802dca0 con 0x7f32f8102620 2024-06-13T11:20:14.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.439+0000 7f32f5600700 1 -- 172.21.15.2:0/1558506873 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f32e809bc30 con 0x7f32f8102620 2024-06-13T11:20:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.444+0000 7f32fd800700 1 -- 172.21.15.2:0/1558506873 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f32dc0a2ca0 msgr2=0x7f32dc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.444+0000 7f32fd800700 1 --2- 172.21.15.2:0/1558506873 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f32dc0a2ca0 0x7f32dc0a5160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009750 tx=0x7f32e000b280 comp rx=0 tx=0).stop 2024-06-13T11:20:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.444+0000 7f32fd800700 1 -- 172.21.15.2:0/1558506873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32f8102620 msgr2=0x7f32f8074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.444+0000 7f32fd800700 1 --2- 172.21.15.2:0/1558506873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32f8102620 0x7f32f8074790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f32e800e9f0 tx=0x7f32e800ed00 comp rx=0 tx=0).stop 2024-06-13T11:20:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.444+0000 7f32fd800700 1 -- 172.21.15.2:0/1558506873 shutdown_connections 2024-06-13T11:20:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.444+0000 7f32fd800700 1 --2- 172.21.15.2:0/1558506873 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f32dc0a2ca0 0x7f32dc0a5160 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.444+0000 7f32fd800700 1 --2- 172.21.15.2:0/1558506873 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32f8107700 0x7f32f8075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.444+0000 7f32fd800700 1 --2- 172.21.15.2:0/1558506873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32f8102620 0x7f32f8074790 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.444+0000 7f32fd800700 1 --2- 172.21.15.2:0/1558506873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32f8102fd0 0x7f32f8074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.444+0000 7f32fd800700 1 -- 172.21.15.2:0/1558506873 >> 172.21.15.2:0/1558506873 conn(0x7f32f80fdf10 msgr2=0x7f32f81001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.445+0000 7f32fd800700 1 -- 172.21.15.2:0/1558506873 shutdown_connections 2024-06-13T11:20:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:14.445+0000 7f32fd800700 1 -- 172.21.15.2:0/1558506873 wait complete. 2024-06-13T11:20:14.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:14 smithi002 ceph-mon[32210]: pgmap v381: 129 pgs: 129 active+clean; 584 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-06-13T11:20:14.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:14 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1558506873' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-13T11:20:14.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:14 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-13T11:20:14.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:14 smithi178 ceph-mon[36913]: pgmap v381: 129 pgs: 129 active+clean; 584 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-06-13T11:20:14.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:14 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1558506873' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-13T11:20:14.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:14 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-13T11:20:14.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:14 smithi077 ceph-mon[36410]: pgmap v381: 129 pgs: 129 active+clean; 584 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-06-13T11:20:14.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:14 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1558506873' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-13T11:20:14.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:14 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-13T11:20:15.294 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-06-13T11:20:15.294 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-06-13T11:20:15.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:15 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-13T11:20:15.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:15 smithi002 ceph-mon[32210]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:20:15.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:15 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-13T11:20:15.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:15 smithi178 ceph-mon[36913]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:20:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:20:15.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:15 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-13T11:20:15.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:15 smithi077 ceph-mon[36410]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:20:16.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:16 smithi077 ceph-mon[36410]: pgmap v382: 129 pgs: 129 active+clean; 584 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-06-13T11:20:16.831 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:16 smithi002 ceph-mon[32210]: pgmap v382: 129 pgs: 129 active+clean; 584 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-06-13T11:20:16.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:16 smithi178 ceph-mon[36913]: pgmap v382: 129 pgs: 129 active+clean; 584 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-06-13T11:20:18.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.126+0000 7fb6db000700 1 -- 172.21.15.2:0/3975804234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6d4074fe0 msgr2=0x7fb6d410e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:18.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.126+0000 7fb6db000700 1 --2- 172.21.15.2:0/3975804234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6d4074fe0 0x7fb6d410e950 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009990 tx=0x7fb6c0009ca0 comp rx=0 tx=0).stop 2024-06-13T11:20:18.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.126+0000 7fb6db000700 1 -- 172.21.15.2:0/3975804234 shutdown_connections 2024-06-13T11:20:18.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.126+0000 7fb6db000700 1 --2- 172.21.15.2:0/3975804234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6d410ee90 0x7fb6d4111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:18.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.126+0000 7fb6db000700 1 --2- 172.21.15.2:0/3975804234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d40746c0 0x7fb6d4074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:18.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.126+0000 7fb6db000700 1 --2- 172.21.15.2:0/3975804234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6d4074fe0 0x7fb6d410e950 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:18.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.126+0000 7fb6db000700 1 -- 172.21.15.2:0/3975804234 >> 172.21.15.2:0/3975804234 conn(0x7fb6d40795f0 msgr2=0x7fb6d4079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:18.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.127+0000 7fb6db000700 1 -- 172.21.15.2:0/3975804234 shutdown_connections 2024-06-13T11:20:18.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.127+0000 7fb6db000700 1 -- 172.21.15.2:0/3975804234 wait complete. 2024-06-13T11:20:18.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.128+0000 7fb6db000700 1 Processor -- start 2024-06-13T11:20:18.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.129+0000 7fb6db000700 1 -- start start 2024-06-13T11:20:18.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.130+0000 7fb6db000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d40746c0 0x7fb6d419ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:18.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.130+0000 7fb6db000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6d4074fe0 0x7fb6d419b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:18.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.130+0000 7fb6db000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6d410ee90 0x7fb6d419f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:18.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.130+0000 7fb6db000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d4114a40 con 0x7fb6d410ee90 2024-06-13T11:20:18.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.130+0000 7fb6db000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d41148c0 con 0x7fb6d40746c0 2024-06-13T11:20:18.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.130+0000 7fb6db000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d4114bc0 con 0x7fb6d4074fe0 2024-06-13T11:20:18.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.130+0000 7fb6d3400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6d4074fe0 0x7fb6d419b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:18.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.130+0000 7fb6d3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d40746c0 0x7fb6d419ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:18.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.130+0000 7fb6d9000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6d410ee90 0x7fb6d419f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:18.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.130+0000 7fb6d3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d40746c0 0x7fb6d419ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:52050/0 (socket says 172.21.15.2:52050) 2024-06-13T11:20:18.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.130+0000 7fb6d3400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6d4074fe0 0x7fb6d419b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49960/0 (socket says 172.21.15.2:49960) 2024-06-13T11:20:18.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.130+0000 7fb6d3e00700 1 -- 172.21.15.2:0/2418629499 learned_addr learned my addr 172.21.15.2:0/2418629499 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:20:18.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.131+0000 7fb6d3400700 1 -- 172.21.15.2:0/2418629499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d40746c0 msgr2=0x7fb6d419ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:18.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.131+0000 7fb6d3400700 1 --2- 172.21.15.2:0/2418629499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d40746c0 0x7fb6d419ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:18.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.131+0000 7fb6d3400700 1 -- 172.21.15.2:0/2418629499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6d410ee90 msgr2=0x7fb6d419f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:18.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.131+0000 7fb6d3400700 1 --2- 172.21.15.2:0/2418629499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6d410ee90 0x7fb6d419f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:18.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.131+0000 7fb6d3400700 1 -- 172.21.15.2:0/2418629499 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d419fea0 con 0x7fb6d4074fe0 2024-06-13T11:20:18.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.131+0000 7fb6d9000700 1 --2- 172.21.15.2:0/2418629499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6d410ee90 0x7fb6d419f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:20:18.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.131+0000 7fb6d3400700 1 --2- 172.21.15.2:0/2418629499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6d4074fe0 0x7fb6d419b3d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb6c00059d0 tx=0x7fb6c000bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:18.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.131+0000 7fb6d0c00700 1 -- 172.21.15.2:0/2418629499 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0027070 con 0x7fb6d4074fe0 2024-06-13T11:20:18.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.132+0000 7fb6d0c00700 1 -- 172.21.15.2:0/2418629499 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6c0003d70 con 0x7fb6d4074fe0 2024-06-13T11:20:18.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.132+0000 7fb6db000700 1 -- 172.21.15.2:0/2418629499 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d41a0130 con 0x7fb6d4074fe0 2024-06-13T11:20:18.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.132+0000 7fb6d0c00700 1 -- 172.21.15.2:0/2418629499 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0022e30 con 0x7fb6d4074fe0 2024-06-13T11:20:18.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.132+0000 7fb6db000700 1 -- 172.21.15.2:0/2418629499 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d41a7a10 con 0x7fb6d4074fe0 2024-06-13T11:20:18.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.133+0000 7fb6db000700 1 -- 172.21.15.2:0/2418629499 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6d4069180 con 0x7fb6d4074fe0 2024-06-13T11:20:18.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.136+0000 7fb6d0c00700 1 -- 172.21.15.2:0/2418629499 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fb6c002a070 con 0x7fb6d4074fe0 2024-06-13T11:20:18.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.137+0000 7fb6d0c00700 1 --2- 172.21.15.2:0/2418629499 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6b80a2c20 0x7fb6b80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:18.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.137+0000 7fb6d0c00700 1 -- 172.21.15.2:0/2418629499 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9050+0+0 (secure 0 0 0) 0x7fb6c00d0460 con 0x7fb6d4074fe0 2024-06-13T11:20:18.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.137+0000 7fb6d3e00700 1 --2- 172.21.15.2:0/2418629499 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6b80a2c20 0x7fb6b80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:18.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.138+0000 7fb6d3e00700 1 --2- 172.21.15.2:0/2418629499 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6b80a2c20 0x7fb6b80a50e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4009d20 tx=0x7fb6c4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:18.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.139+0000 7fb6d0c00700 1 -- 172.21.15.2:0/2418629499 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb6c0013070 con 0x7fb6d4074fe0 2024-06-13T11:20:18.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.401+0000 7fb6db000700 1 -- 172.21.15.2:0/2418629499 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb6d419c1f0 con 0x7fb6b80a2c20 2024-06-13T11:20:18.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.441+0000 7fb6d0c00700 1 -- 172.21.15.2:0/2418629499 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb6d419c1f0 con 0x7fb6b80a2c20 2024-06-13T11:20:18.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.445+0000 7fb6db000700 1 -- 172.21.15.2:0/2418629499 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6b80a2c20 msgr2=0x7fb6b80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.445+0000 7fb6db000700 1 --2- 172.21.15.2:0/2418629499 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6b80a2c20 0x7fb6b80a50e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4009d20 tx=0x7fb6c4009260 comp rx=0 tx=0).stop 2024-06-13T11:20:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.445+0000 7fb6db000700 1 -- 172.21.15.2:0/2418629499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6d4074fe0 msgr2=0x7fb6d419b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.445+0000 7fb6db000700 1 --2- 172.21.15.2:0/2418629499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6d4074fe0 0x7fb6d419b3d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb6c00059d0 tx=0x7fb6c000bab0 comp rx=0 tx=0).stop 2024-06-13T11:20:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.445+0000 7fb6db000700 1 -- 172.21.15.2:0/2418629499 shutdown_connections 2024-06-13T11:20:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.445+0000 7fb6db000700 1 --2- 172.21.15.2:0/2418629499 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6b80a2c20 0x7fb6b80a50e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.445+0000 7fb6db000700 1 --2- 172.21.15.2:0/2418629499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6d410ee90 0x7fb6d419f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.445+0000 7fb6db000700 1 --2- 172.21.15.2:0/2418629499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6d40746c0 0x7fb6d419ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.445+0000 7fb6db000700 1 --2- 172.21.15.2:0/2418629499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6d4074fe0 0x7fb6d419b3d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.445+0000 7fb6db000700 1 -- 172.21.15.2:0/2418629499 >> 172.21.15.2:0/2418629499 conn(0x7fb6d40795f0 msgr2=0x7fb6d40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.445+0000 7fb6db000700 1 -- 172.21.15.2:0/2418629499 shutdown_connections 2024-06-13T11:20:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:18.445+0000 7fb6db000700 1 -- 172.21.15.2:0/2418629499 wait complete. 2024-06-13T11:20:18.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:18 smithi077 ceph-mon[36410]: pgmap v383: 129 pgs: 129 active+clean; 584 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-13T11:20:18.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:18 smithi002 ceph-mon[32210]: pgmap v383: 129 pgs: 129 active+clean; 584 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-13T11:20:18.836 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:20:18 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:20:18.409+0000 7f55d2800700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:20:18.837 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:20:18 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:20:18.410+0000 7f55d2800700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:20:18.837 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:20:18 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:20:18.410+0000 7f55d2800700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:20:18.837 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:20:18 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:20:18.410+0000 7f55d2800700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:20:18.837 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:20:18 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:20:18.410+0000 7f55d2800700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:20:18.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:18 smithi178 ceph-mon[36913]: pgmap v383: 129 pgs: 129 active+clean; 584 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-13T11:20:19.251 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-06-13T11:20:19.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:19 smithi178 ceph-mon[36913]: from='client.24700 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:20:19.730 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:20:19.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:19 smithi077 ceph-mon[36410]: from='client.24700 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:20:19.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:19 smithi002 ceph-mon[32210]: from='client.24700 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:20:20.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:20 smithi077 ceph-mon[36410]: pgmap v384: 129 pgs: 129 active+clean; 584 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-06-13T11:20:20.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:20 smithi077 ceph-mon[36410]: mgrmap e17: x(active, since 9m), standbys: z, y 2024-06-13T11:20:20.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:20 smithi002 ceph-mon[32210]: pgmap v384: 129 pgs: 129 active+clean; 584 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-06-13T11:20:20.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:20 smithi002 ceph-mon[32210]: mgrmap e17: x(active, since 9m), standbys: z, y 2024-06-13T11:20:20.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:20 smithi178 ceph-mon[36913]: pgmap v384: 129 pgs: 129 active+clean; 584 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-06-13T11:20:20.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:20 smithi178 ceph-mon[36913]: mgrmap e17: x(active, since 9m), standbys: z, y 2024-06-13T11:20:22.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.049+0000 7fd218e00700 1 -- 172.21.15.2:0/740669399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd214100a30 msgr2=0x7fd214100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:22.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.049+0000 7fd218e00700 1 --2- 172.21.15.2:0/740669399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd214100a30 0x7fd214100e10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd2040098f0 tx=0x7fd204009c00 comp rx=0 tx=0).stop 2024-06-13T11:20:22.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.049+0000 7fd218e00700 1 -- 172.21.15.2:0/740669399 shutdown_connections 2024-06-13T11:20:22.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.049+0000 7fd218e00700 1 --2- 172.21.15.2:0/740669399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2141059b0 0x7fd21410d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:22.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.049+0000 7fd218e00700 1 --2- 172.21.15.2:0/740669399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd214100a30 0x7fd214100e10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:22.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.049+0000 7fd218e00700 1 --2- 172.21.15.2:0/740669399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2141013e0 0x7fd214105280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:22.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.049+0000 7fd218e00700 1 -- 172.21.15.2:0/740669399 >> 172.21.15.2:0/740669399 conn(0x7fd214076180 msgr2=0x7fd214076590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:22.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.050+0000 7fd218e00700 1 -- 172.21.15.2:0/740669399 shutdown_connections 2024-06-13T11:20:22.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.050+0000 7fd218e00700 1 -- 172.21.15.2:0/740669399 wait complete. 2024-06-13T11:20:22.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.051+0000 7fd218e00700 1 Processor -- start 2024-06-13T11:20:22.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.051+0000 7fd218e00700 1 -- start start 2024-06-13T11:20:22.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.052+0000 7fd218e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd214100a30 0x7fd21419ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:22.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.052+0000 7fd218e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2141013e0 0x7fd21419b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:22.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.052+0000 7fd218e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2141059b0 0x7fd21419f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:22.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.052+0000 7fd218e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd214111670 con 0x7fd214100a30 2024-06-13T11:20:22.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.052+0000 7fd218e00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2141114f0 con 0x7fd2141059b0 2024-06-13T11:20:22.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.052+0000 7fd218e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd2141117f0 con 0x7fd2141013e0 2024-06-13T11:20:22.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.052+0000 7fd213400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd214100a30 0x7fd21419ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:22.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.052+0000 7fd213e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2141059b0 0x7fd21419f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:22.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.052+0000 7fd212a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2141013e0 0x7fd21419b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:22.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.052+0000 7fd213400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd214100a30 0x7fd21419ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38100/0 (socket says 172.21.15.2:38100) 2024-06-13T11:20:22.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.052+0000 7fd213400700 1 -- 172.21.15.2:0/1250177721 learned_addr learned my addr 172.21.15.2:0/1250177721 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:20:22.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.053+0000 7fd213400700 1 -- 172.21.15.2:0/1250177721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2141013e0 msgr2=0x7fd21419b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:22.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.053+0000 7fd213400700 1 --2- 172.21.15.2:0/1250177721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2141013e0 0x7fd21419b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:22.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.053+0000 7fd213400700 1 -- 172.21.15.2:0/1250177721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2141059b0 msgr2=0x7fd21419f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:22.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.053+0000 7fd213400700 1 --2- 172.21.15.2:0/1250177721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2141059b0 0x7fd21419f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:22.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.053+0000 7fd213400700 1 -- 172.21.15.2:0/1250177721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21419fdb0 con 0x7fd214100a30 2024-06-13T11:20:22.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.053+0000 7fd213e00700 1 --2- 172.21.15.2:0/1250177721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2141059b0 0x7fd21419f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:20:22.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.053+0000 7fd213400700 1 --2- 172.21.15.2:0/1250177721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd214100a30 0x7fd21419ada0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd2040094f0 tx=0x7fd20400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:22.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.053+0000 7fd20be00700 1 -- 172.21.15.2:0/1250177721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204027070 con 0x7fd214100a30 2024-06-13T11:20:22.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.053+0000 7fd20be00700 1 -- 172.21.15.2:0/1250177721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2040055a0 con 0x7fd214100a30 2024-06-13T11:20:22.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.053+0000 7fd218e00700 1 -- 172.21.15.2:0/1250177721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2141a0040 con 0x7fd214100a30 2024-06-13T11:20:22.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.053+0000 7fd20be00700 1 -- 172.21.15.2:0/1250177721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204004930 con 0x7fd214100a30 2024-06-13T11:20:22.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.053+0000 7fd218e00700 1 -- 172.21.15.2:0/1250177721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2141a7920 con 0x7fd214100a30 2024-06-13T11:20:22.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.055+0000 7fd209600700 1 -- 172.21.15.2:0/1250177721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1ec005330 con 0x7fd214100a30 2024-06-13T11:20:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.057+0000 7fd20be00700 1 -- 172.21.15.2:0/1250177721 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fd20402a070 con 0x7fd214100a30 2024-06-13T11:20:22.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.059+0000 7fd20be00700 1 --2- 172.21.15.2:0/1250177721 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd1f80a2cb0 0x7fd1f80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:22.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.059+0000 7fd20be00700 1 -- 172.21.15.2:0/1250177721 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9050+0+0 (secure 0 0 0) 0x7fd2040cfe70 con 0x7fd214100a30 2024-06-13T11:20:22.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.059+0000 7fd212a00700 1 --2- 172.21.15.2:0/1250177721 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd1f80a2cb0 0x7fd1f80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:22.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.060+0000 7fd212a00700 1 --2- 172.21.15.2:0/1250177721 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd1f80a2cb0 0x7fd1f80a5170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd214076bf0 tx=0x7fd200009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:22.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.064+0000 7fd20be00700 1 -- 172.21.15.2:0/1250177721 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd20405e850 con 0x7fd214100a30 2024-06-13T11:20:22.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.331+0000 7fd209600700 1 -- 172.21.15.2:0/1250177721 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd1ec000bc0 con 0x7fd1f80a2cb0 2024-06-13T11:20:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.368+0000 7fd20be00700 1 -- 172.21.15.2:0/1250177721 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd1ec000bc0 con 0x7fd1f80a2cb0 2024-06-13T11:20:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.371+0000 7fd209600700 1 -- 172.21.15.2:0/1250177721 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd1f80a2cb0 msgr2=0x7fd1f80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.371+0000 7fd209600700 1 --2- 172.21.15.2:0/1250177721 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd1f80a2cb0 0x7fd1f80a5170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd214076bf0 tx=0x7fd200009260 comp rx=0 tx=0).stop 2024-06-13T11:20:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.371+0000 7fd209600700 1 -- 172.21.15.2:0/1250177721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd214100a30 msgr2=0x7fd21419ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.371+0000 7fd209600700 1 --2- 172.21.15.2:0/1250177721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd214100a30 0x7fd21419ada0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd2040094f0 tx=0x7fd20400fa00 comp rx=0 tx=0).stop 2024-06-13T11:20:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.371+0000 7fd209600700 1 -- 172.21.15.2:0/1250177721 shutdown_connections 2024-06-13T11:20:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.371+0000 7fd209600700 1 --2- 172.21.15.2:0/1250177721 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd1f80a2cb0 0x7fd1f80a5170 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.371+0000 7fd209600700 1 --2- 172.21.15.2:0/1250177721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd214100a30 0x7fd21419ada0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.371+0000 7fd209600700 1 --2- 172.21.15.2:0/1250177721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2141059b0 0x7fd21419f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.371+0000 7fd209600700 1 --2- 172.21.15.2:0/1250177721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2141013e0 0x7fd21419b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.371+0000 7fd209600700 1 -- 172.21.15.2:0/1250177721 >> 172.21.15.2:0/1250177721 conn(0x7fd214076180 msgr2=0x7fd2140fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.372+0000 7fd209600700 1 -- 172.21.15.2:0/1250177721 shutdown_connections 2024-06-13T11:20:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:22.372+0000 7fd209600700 1 -- 172.21.15.2:0/1250177721 wait complete. 2024-06-13T11:20:22.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:22 smithi002 ceph-mon[32210]: pgmap v385: 129 pgs: 129 active+clean; 584 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-06-13T11:20:22.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:22 smithi077 ceph-mon[36410]: pgmap v385: 129 pgs: 129 active+clean; 584 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-06-13T11:20:22.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:22 smithi178 ceph-mon[36913]: pgmap v385: 129 pgs: 129 active+clean; 584 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-06-13T11:20:23.159 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-06-13T11:20:23.630 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:20:23.782 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:23 smithi002 ceph-mon[32210]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:20:23.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:23 smithi077 ceph-mon[36410]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:20:23.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:23 smithi178 ceph-mon[36913]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:20:24.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:24 smithi077 ceph-mon[36410]: pgmap v386: 129 pgs: 129 active+clean; 591 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-06-13T11:20:24.805 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:24 smithi002 ceph-mon[32210]: pgmap v386: 129 pgs: 129 active+clean; 591 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-06-13T11:20:24.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:24 smithi178 ceph-mon[36913]: pgmap v386: 129 pgs: 129 active+clean; 591 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-06-13T11:20:25.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.820+0000 7feefb200700 1 -- 172.21.15.2:0/3413947154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feef41073d0 msgr2=0x7feef41077b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:25.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.820+0000 7feefb200700 1 --2- 172.21.15.2:0/3413947154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feef41073d0 0x7feef41077b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feee4009990 tx=0x7feee4009ca0 comp rx=0 tx=0).stop 2024-06-13T11:20:25.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.820+0000 7feefb200700 1 -- 172.21.15.2:0/3413947154 shutdown_connections 2024-06-13T11:20:25.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.820+0000 7feefb200700 1 --2- 172.21.15.2:0/3413947154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feef41073d0 0x7feef41077b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:25.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.820+0000 7feefb200700 1 --2- 172.21.15.2:0/3413947154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef4101d30 0x7feef410e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:25.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.820+0000 7feefb200700 1 --2- 172.21.15.2:0/3413947154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feef4101390 0x7feef41017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:25.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.820+0000 7feefb200700 1 -- 172.21.15.2:0/3413947154 >> 172.21.15.2:0/3413947154 conn(0x7feef40782c0 msgr2=0x7feef40786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:25.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.820+0000 7feefb200700 1 -- 172.21.15.2:0/3413947154 shutdown_connections 2024-06-13T11:20:25.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.821+0000 7feefb200700 1 -- 172.21.15.2:0/3413947154 wait complete. 2024-06-13T11:20:25.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.822+0000 7feefb200700 1 Processor -- start 2024-06-13T11:20:25.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.822+0000 7feefb200700 1 -- start start 2024-06-13T11:20:25.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.822+0000 7feefb200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feef4101390 0x7feef419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:25.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.822+0000 7feefb200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feef4101d30 0x7feef419eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:25.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.822+0000 7feefb200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef41073d0 0x7feef4198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:25.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.822+0000 7feefb200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feef4111630 con 0x7feef4101390 2024-06-13T11:20:25.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.822+0000 7feefb200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7feef41114b0 con 0x7feef4101d30 2024-06-13T11:20:25.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.822+0000 7feefb200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7feef41117b0 con 0x7feef41073d0 2024-06-13T11:20:25.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.823+0000 7feef3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feef4101390 0x7feef419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:25.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.823+0000 7feef9200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef41073d0 0x7feef4198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:25.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.823+0000 7feef3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feef4101390 0x7feef419e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38124/0 (socket says 172.21.15.2:38124) 2024-06-13T11:20:25.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.823+0000 7feef3e00700 1 -- 172.21.15.2:0/1527173344 learned_addr learned my addr 172.21.15.2:0/1527173344 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:20:25.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.823+0000 7feef3400700 1 --2- 172.21.15.2:0/1527173344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feef4101d30 0x7feef419eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:25.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.823+0000 7feef9200700 1 -- 172.21.15.2:0/1527173344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feef4101d30 msgr2=0x7feef419eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:25.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.823+0000 7feef9200700 1 --2- 172.21.15.2:0/1527173344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feef4101d30 0x7feef419eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:25.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.823+0000 7feef9200700 1 -- 172.21.15.2:0/1527173344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feef4101390 msgr2=0x7feef419e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:25.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.823+0000 7feef9200700 1 --2- 172.21.15.2:0/1527173344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feef4101390 0x7feef419e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:25.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.823+0000 7feef9200700 1 -- 172.21.15.2:0/1527173344 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef41991d0 con 0x7feef41073d0 2024-06-13T11:20:25.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.824+0000 7feef9200700 1 --2- 172.21.15.2:0/1527173344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef41073d0 0x7feef4198a70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feeec00efc0 tx=0x7feeec00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:25.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.824+0000 7feef0c00700 1 -- 172.21.15.2:0/1527173344 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec0092e0 con 0x7feef41073d0 2024-06-13T11:20:25.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.824+0000 7feef0c00700 1 -- 172.21.15.2:0/1527173344 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feeec004bb0 con 0x7feef41073d0 2024-06-13T11:20:25.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.824+0000 7feef0c00700 1 -- 172.21.15.2:0/1527173344 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec004280 con 0x7feef41073d0 2024-06-13T11:20:25.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.824+0000 7feefb200700 1 -- 172.21.15.2:0/1527173344 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef4199460 con 0x7feef41073d0 2024-06-13T11:20:25.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.824+0000 7feefb200700 1 -- 172.21.15.2:0/1527173344 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef41a5730 con 0x7feef41073d0 2024-06-13T11:20:25.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.825+0000 7feefb200700 1 -- 172.21.15.2:0/1527173344 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feef4069180 con 0x7feef41073d0 2024-06-13T11:20:25.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.827+0000 7feef0c00700 1 -- 172.21.15.2:0/1527173344 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7feeec01b030 con 0x7feef41073d0 2024-06-13T11:20:25.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.828+0000 7feef0c00700 1 --2- 172.21.15.2:0/1527173344 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7feed80a2cb0 0x7feed80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:25.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.829+0000 7feef0c00700 1 -- 172.21.15.2:0/1527173344 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9050+0+0 (secure 0 0 0) 0x7feeec0cefd0 con 0x7feef41073d0 2024-06-13T11:20:25.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.829+0000 7feef3e00700 1 --2- 172.21.15.2:0/1527173344 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7feed80a2cb0 0x7feed80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:25.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.829+0000 7feef3e00700 1 --2- 172.21.15.2:0/1527173344 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7feed80a2cb0 0x7feed80a5170 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7feee4006010 tx=0x7feee4009590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:25.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:25.833+0000 7feef0c00700 1 -- 172.21.15.2:0/1527173344 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7feeec022020 con 0x7feef41073d0 2024-06-13T11:20:26.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:26.100+0000 7feefb200700 1 -- 172.21.15.2:0/1527173344 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7feef4105180 con 0x7feed80a2cb0 2024-06-13T11:20:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:26.114+0000 7feef0c00700 1 -- 172.21.15.2:0/1527173344 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7feef4105180 con 0x7feed80a2cb0 2024-06-13T11:20:26.114 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/qa/sv_0/a84471cc-c930-4d1f-ab55-cbaf0c5c9d75 2024-06-13T11:20:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:26.117+0000 7feefb200700 1 -- 172.21.15.2:0/1527173344 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7feed80a2cb0 msgr2=0x7feed80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:26.117+0000 7feefb200700 1 --2- 172.21.15.2:0/1527173344 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7feed80a2cb0 0x7feed80a5170 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7feee4006010 tx=0x7feee4009590 comp rx=0 tx=0).stop 2024-06-13T11:20:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:26.117+0000 7feefb200700 1 -- 172.21.15.2:0/1527173344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef41073d0 msgr2=0x7feef4198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:26.117+0000 7feefb200700 1 --2- 172.21.15.2:0/1527173344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef41073d0 0x7feef4198a70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feeec00efc0 tx=0x7feeec00c3a0 comp rx=0 tx=0).stop 2024-06-13T11:20:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:26.117+0000 7feefb200700 1 -- 172.21.15.2:0/1527173344 shutdown_connections 2024-06-13T11:20:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:26.117+0000 7feefb200700 1 --2- 172.21.15.2:0/1527173344 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7feed80a2cb0 0x7feed80a5170 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:26.117+0000 7feefb200700 1 --2- 172.21.15.2:0/1527173344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feef4101390 0x7feef419e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:26.117+0000 7feefb200700 1 --2- 172.21.15.2:0/1527173344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef41073d0 0x7feef4198a70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:26.117+0000 7feefb200700 1 --2- 172.21.15.2:0/1527173344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feef4101d30 0x7feef419eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:26.117+0000 7feefb200700 1 -- 172.21.15.2:0/1527173344 >> 172.21.15.2:0/1527173344 conn(0x7feef40782c0 msgr2=0x7feef4100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:26.118+0000 7feefb200700 1 -- 172.21.15.2:0/1527173344 shutdown_connections 2024-06-13T11:20:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:26.118+0000 7feefb200700 1 -- 172.21.15.2:0/1527173344 wait complete. 2024-06-13T11:20:26.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:26 smithi077 ceph-mon[36410]: pgmap v387: 129 pgs: 129 active+clean; 591 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-06-13T11:20:26.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:26 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 10]}]: dispatch 2024-06-13T11:20:26.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:26 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]: dispatch 2024-06-13T11:20:26.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:26 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-06-13T11:20:26.876 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:26 smithi002 ceph-mon[32210]: pgmap v387: 129 pgs: 129 active+clean; 591 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-06-13T11:20:26.876 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 10]}]: dispatch 2024-06-13T11:20:26.876 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]: dispatch 2024-06-13T11:20:26.876 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:26 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-06-13T11:20:26.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:26 smithi178 ceph-mon[36913]: pgmap v387: 129 pgs: 129 active+clean; 591 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-06-13T11:20:26.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 10]}]: dispatch 2024-06-13T11:20:26.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]: dispatch 2024-06-13T11:20:26.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:26 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-06-13T11:20:26.950 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-06-13T11:20:27.405 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:20:27.778 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:27 smithi002 ceph-mon[32210]: from='client.24715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:20:27.778 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 10]}]': finished 2024-06-13T11:20:27.778 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2024-06-13T11:20:27.778 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:27 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-06-13T11:20:27.779 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:27 smithi002 ceph-mon[32210]: osdmap e98: 12 total, 12 up, 12 in 2024-06-13T11:20:27.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:27 smithi077 ceph-mon[36410]: from='client.24715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:20:27.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 10]}]': finished 2024-06-13T11:20:27.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2024-06-13T11:20:27.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:27 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-06-13T11:20:27.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:27 smithi077 ceph-mon[36410]: osdmap e98: 12 total, 12 up, 12 in 2024-06-13T11:20:27.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:27 smithi178 ceph-mon[36913]: from='client.24715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:20:27.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 10]}]': finished 2024-06-13T11:20:27.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2024-06-13T11:20:27.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:27 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-06-13T11:20:27.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:27 smithi178 ceph-mon[36913]: osdmap e98: 12 total, 12 up, 12 in 2024-06-13T11:20:28.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:28 smithi077 ceph-mon[36410]: pgmap v389: 129 pgs: 2 peering, 127 active+clean; 591 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-06-13T11:20:28.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:28 smithi077 ceph-mon[36410]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-06-13T11:20:28.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:28 smithi077 ceph-mon[36410]: osdmap e99: 12 total, 12 up, 12 in 2024-06-13T11:20:28.799 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:28 smithi002 ceph-mon[32210]: pgmap v389: 129 pgs: 2 peering, 127 active+clean; 591 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-06-13T11:20:28.799 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:28 smithi002 ceph-mon[32210]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-06-13T11:20:28.799 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:28 smithi002 ceph-mon[32210]: osdmap e99: 12 total, 12 up, 12 in 2024-06-13T11:20:28.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:28 smithi178 ceph-mon[36913]: pgmap v389: 129 pgs: 2 peering, 127 active+clean; 591 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-06-13T11:20:28.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:28 smithi178 ceph-mon[36913]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-06-13T11:20:28.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:28 smithi178 ceph-mon[36913]: osdmap e99: 12 total, 12 up, 12 in 2024-06-13T11:20:29.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.695+0000 7fced2400700 1 -- 172.21.15.2:0/2410971262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcecc108520 msgr2=0x7fcecc108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:29.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.695+0000 7fced2400700 1 --2- 172.21.15.2:0/2410971262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcecc108520 0x7fcecc108900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009990 tx=0x7fcebc009ca0 comp rx=0 tx=0).stop 2024-06-13T11:20:29.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.695+0000 7fced2400700 1 -- 172.21.15.2:0/2410971262 shutdown_connections 2024-06-13T11:20:29.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.695+0000 7fced2400700 1 --2- 172.21.15.2:0/2410971262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcecc102ed0 0x7fcecc10f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:29.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.695+0000 7fced2400700 1 --2- 172.21.15.2:0/2410971262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcecc108520 0x7fcecc108900 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:29.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.695+0000 7fced2400700 1 --2- 172.21.15.2:0/2410971262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcecc102510 0x7fcecc102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:29.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.695+0000 7fced2400700 1 -- 172.21.15.2:0/2410971262 >> 172.21.15.2:0/2410971262 conn(0x7fcecc079560 msgr2=0x7fcecc079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:29.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.695+0000 7fced2400700 1 -- 172.21.15.2:0/2410971262 shutdown_connections 2024-06-13T11:20:29.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.695+0000 7fced2400700 1 -- 172.21.15.2:0/2410971262 wait complete. 2024-06-13T11:20:29.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.697+0000 7fced2400700 1 Processor -- start 2024-06-13T11:20:29.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.697+0000 7fced2400700 1 -- start start 2024-06-13T11:20:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.697+0000 7fced2400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcecc102510 0x7fcecc1a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.697+0000 7fced2400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcecc102ed0 0x7fcecc1a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.697+0000 7fced2400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcecc108520 0x7fcecc19aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.697+0000 7fced2400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc075110 con 0x7fcecc102510 2024-06-13T11:20:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.697+0000 7fced2400700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc074f90 con 0x7fcecc108520 2024-06-13T11:20:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.697+0000 7fced2400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc075290 con 0x7fcecc102ed0 2024-06-13T11:20:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.698+0000 7fcecb400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcecc102510 0x7fcecc1a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.698+0000 7fcecb400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcecc102510 0x7fcecc1a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49442/0 (socket says 172.21.15.2:49442) 2024-06-13T11:20:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.698+0000 7fcecb400700 1 -- 172.21.15.2:0/1391572332 learned_addr learned my addr 172.21.15.2:0/1391572332 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:20:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.698+0000 7fcecbe00700 1 --2- 172.21.15.2:0/1391572332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcecc108520 0x7fcecc19aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.698+0000 7fcec2a00700 1 --2- 172.21.15.2:0/1391572332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcecc102ed0 0x7fcecc1a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.698+0000 7fcecb400700 1 -- 172.21.15.2:0/1391572332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcecc102ed0 msgr2=0x7fcecc1a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.698+0000 7fcecb400700 1 --2- 172.21.15.2:0/1391572332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcecc102ed0 0x7fcecc1a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.698+0000 7fcecb400700 1 -- 172.21.15.2:0/1391572332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcecc108520 msgr2=0x7fcecc19aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.698+0000 7fcecb400700 1 --2- 172.21.15.2:0/1391572332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcecc108520 0x7fcecc19aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.698+0000 7fcecb400700 1 -- 172.21.15.2:0/1391572332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcecc19b7d0 con 0x7fcecc102510 2024-06-13T11:20:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.698+0000 7fcecbe00700 1 --2- 172.21.15.2:0/1391572332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcecc108520 0x7fcecc19aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:20:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.699+0000 7fcecb400700 1 --2- 172.21.15.2:0/1391572332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcecc102510 0x7fcecc1a0ab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcebc000c00 tx=0x7fcebc00bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.699+0000 7fcec8c00700 1 -- 172.21.15.2:0/1391572332 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc027070 con 0x7fcecc102510 2024-06-13T11:20:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.699+0000 7fcec8c00700 1 -- 172.21.15.2:0/1391572332 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcebc0056d0 con 0x7fcecc102510 2024-06-13T11:20:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.699+0000 7fced2400700 1 -- 172.21.15.2:0/1391572332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcecc19ba00 con 0x7fcecc102510 2024-06-13T11:20:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.699+0000 7fcec8c00700 1 -- 172.21.15.2:0/1391572332 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc022e10 con 0x7fcecc102510 2024-06-13T11:20:29.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.699+0000 7fced2400700 1 -- 172.21.15.2:0/1391572332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcecc1a7a70 con 0x7fcecc102510 2024-06-13T11:20:29.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.700+0000 7fced2400700 1 -- 172.21.15.2:0/1391572332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcecc103c00 con 0x7fcecc102510 2024-06-13T11:20:29.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.702+0000 7fcec8c00700 1 -- 172.21.15.2:0/1391572332 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fcebc02a070 con 0x7fcecc102510 2024-06-13T11:20:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.704+0000 7fcec8c00700 1 --2- 172.21.15.2:0/1391572332 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fceb00a2d30 0x7fceb00a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.704+0000 7fcec8c00700 1 -- 172.21.15.2:0/1391572332 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fcebc0d0180 con 0x7fcecc102510 2024-06-13T11:20:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.704+0000 7fcec2a00700 1 --2- 172.21.15.2:0/1391572332 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fceb00a2d30 0x7fceb00a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:29.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.705+0000 7fcec2a00700 1 --2- 172.21.15.2:0/1391572332 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fceb00a2d30 0x7fceb00a51f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcecc19c350 tx=0x7fceb4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:29.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.708+0000 7fcec8c00700 1 -- 172.21.15.2:0/1391572332 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcebc013070 con 0x7fcecc102510 2024-06-13T11:20:29.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:29.980+0000 7fced2400700 1 -- 172.21.15.2:0/1391572332 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fcecc1070a0 con 0x7fceb00a2d30 2024-06-13T11:20:30.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:30.014+0000 7fcec8c00700 1 -- 172.21.15.2:0/1391572332 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcecc1070a0 con 0x7fceb00a2d30 2024-06-13T11:20:30.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:30.018+0000 7fced2400700 1 -- 172.21.15.2:0/1391572332 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fceb00a2d30 msgr2=0x7fceb00a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:30.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:30.018+0000 7fced2400700 1 --2- 172.21.15.2:0/1391572332 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fceb00a2d30 0x7fceb00a51f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcecc19c350 tx=0x7fceb4009260 comp rx=0 tx=0).stop 2024-06-13T11:20:30.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:30.018+0000 7fced2400700 1 -- 172.21.15.2:0/1391572332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcecc102510 msgr2=0x7fcecc1a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:30.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:30.018+0000 7fced2400700 1 --2- 172.21.15.2:0/1391572332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcecc102510 0x7fcecc1a0ab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcebc000c00 tx=0x7fcebc00bab0 comp rx=0 tx=0).stop 2024-06-13T11:20:30.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:30.018+0000 7fced2400700 1 -- 172.21.15.2:0/1391572332 shutdown_connections 2024-06-13T11:20:30.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:30.018+0000 7fced2400700 1 --2- 172.21.15.2:0/1391572332 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fceb00a2d30 0x7fceb00a51f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:30.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:30.018+0000 7fced2400700 1 --2- 172.21.15.2:0/1391572332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcecc102510 0x7fcecc1a0ab0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:30.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:30.018+0000 7fced2400700 1 --2- 172.21.15.2:0/1391572332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcecc108520 0x7fcecc19aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:30.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:30.018+0000 7fced2400700 1 --2- 172.21.15.2:0/1391572332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcecc102ed0 0x7fcecc1a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:30.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:30.018+0000 7fced2400700 1 -- 172.21.15.2:0/1391572332 >> 172.21.15.2:0/1391572332 conn(0x7fcecc079560 msgr2=0x7fcecc1005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:30.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:30.018+0000 7fced2400700 1 -- 172.21.15.2:0/1391572332 shutdown_connections 2024-06-13T11:20:30.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:30.019+0000 7fced2400700 1 -- 172.21.15.2:0/1391572332 wait complete. 2024-06-13T11:20:30.774 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:30 smithi002 ceph-mon[32210]: pgmap v391: 129 pgs: 2 peering, 127 active+clean; 611 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.5 KiB/s wr, 8 op/s 2024-06-13T11:20:30.775 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:30 smithi002 ceph-mon[32210]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:20:30.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:30 smithi077 ceph-mon[36410]: pgmap v391: 129 pgs: 2 peering, 127 active+clean; 611 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.5 KiB/s wr, 8 op/s 2024-06-13T11:20:30.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:30 smithi077 ceph-mon[36410]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:20:30.857 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-06-13T11:20:30.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:30 smithi178 ceph-mon[36913]: pgmap v391: 129 pgs: 2 peering, 127 active+clean; 611 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.5 KiB/s wr, 8 op/s 2024-06-13T11:20:30.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:30 smithi178 ceph-mon[36913]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:20:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:20:32.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:32 smithi002 ceph-mon[32210]: pgmap v392: 129 pgs: 2 peering, 127 active+clean; 611 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.1 KiB/s wr, 6 op/s 2024-06-13T11:20:32.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:32 smithi077 ceph-mon[36410]: pgmap v392: 129 pgs: 2 peering, 127 active+clean; 611 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.1 KiB/s wr, 6 op/s 2024-06-13T11:20:32.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:32 smithi178 ceph-mon[36913]: pgmap v392: 129 pgs: 2 peering, 127 active+clean; 611 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.1 KiB/s wr, 6 op/s 2024-06-13T11:20:33.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.554+0000 7f557a600700 1 -- 172.21.15.2:0/3424175140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5574108650 msgr2=0x7f5574108a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:33.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.554+0000 7f557a600700 1 --2- 172.21.15.2:0/3424175140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5574108650 0x7f5574108a30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5564009990 tx=0x7f5564009ca0 comp rx=0 tx=0).stop 2024-06-13T11:20:33.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.554+0000 7f557a600700 1 -- 172.21.15.2:0/3424175140 shutdown_connections 2024-06-13T11:20:33.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.554+0000 7f557a600700 1 --2- 172.21.15.2:0/3424175140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5574102e80 0x7f557410f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:33.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.554+0000 7f557a600700 1 --2- 172.21.15.2:0/3424175140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5574108650 0x7f5574108a30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:33.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.554+0000 7f557a600700 1 --2- 172.21.15.2:0/3424175140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55741024e0 0x7f5574102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:33.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.554+0000 7f557a600700 1 -- 172.21.15.2:0/3424175140 >> 172.21.15.2:0/3424175140 conn(0x7f55740795f0 msgr2=0x7f5574079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.554+0000 7f557a600700 1 -- 172.21.15.2:0/3424175140 shutdown_connections 2024-06-13T11:20:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.555+0000 7f557a600700 1 -- 172.21.15.2:0/3424175140 wait complete. 2024-06-13T11:20:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.556+0000 7f557a600700 1 Processor -- start 2024-06-13T11:20:33.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.556+0000 7f557a600700 1 -- start start 2024-06-13T11:20:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.557+0000 7f557a600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55741024e0 0x7f5574074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.557+0000 7f557a600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5574102e80 0x7f5574074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.557+0000 7f557a600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5574108650 0x7f5574075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.557+0000 7f557a600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5574112810 con 0x7f5574102e80 2024-06-13T11:20:33.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.557+0000 7f557a600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5574112690 con 0x7f5574108650 2024-06-13T11:20:33.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.557+0000 7f557a600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5574112990 con 0x7f55741024e0 2024-06-13T11:20:33.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.557+0000 7f5573400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55741024e0 0x7f5574074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:33.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.557+0000 7f5573400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55741024e0 0x7f5574074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:54200/0 (socket says 172.21.15.2:54200) 2024-06-13T11:20:33.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.557+0000 7f5573400700 1 -- 172.21.15.2:0/2515455952 learned_addr learned my addr 172.21.15.2:0/2515455952 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:20:33.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.558+0000 7f5572a00700 1 --2- 172.21.15.2:0/2515455952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5574102e80 0x7f5574074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:33.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.558+0000 7f5573e00700 1 --2- 172.21.15.2:0/2515455952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5574108650 0x7f5574075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:33.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.558+0000 7f5573400700 1 -- 172.21.15.2:0/2515455952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5574108650 msgr2=0x7f5574075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:33.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.558+0000 7f5573400700 1 --2- 172.21.15.2:0/2515455952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5574108650 0x7f5574075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:33.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.558+0000 7f5573400700 1 -- 172.21.15.2:0/2515455952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5574102e80 msgr2=0x7f5574074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:33.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.558+0000 7f5573400700 1 --2- 172.21.15.2:0/2515455952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5574102e80 0x7f5574074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:33.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.558+0000 7f5573400700 1 -- 172.21.15.2:0/2515455952 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55741a71b0 con 0x7f55741024e0 2024-06-13T11:20:33.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.558+0000 7f5573400700 1 --2- 172.21.15.2:0/2515455952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55741024e0 0x7f5574074790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5564000c00 tx=0x7f556400ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:33.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.559+0000 7f556be00700 1 -- 172.21.15.2:0/2515455952 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5564027070 con 0x7f55741024e0 2024-06-13T11:20:33.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.559+0000 7f557a600700 1 -- 172.21.15.2:0/2515455952 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55741a7440 con 0x7f55741024e0 2024-06-13T11:20:33.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.559+0000 7f556be00700 1 -- 172.21.15.2:0/2515455952 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5564003d70 con 0x7f55741024e0 2024-06-13T11:20:33.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.559+0000 7f556be00700 1 -- 172.21.15.2:0/2515455952 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556400f460 con 0x7f55741024e0 2024-06-13T11:20:33.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.559+0000 7f557a600700 1 -- 172.21.15.2:0/2515455952 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55741a78f0 con 0x7f55741024e0 2024-06-13T11:20:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.561+0000 7f557a600700 1 -- 172.21.15.2:0/2515455952 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5574069180 con 0x7f55741024e0 2024-06-13T11:20:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.562+0000 7f556be00700 1 -- 172.21.15.2:0/2515455952 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f556402a070 con 0x7f55741024e0 2024-06-13T11:20:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.563+0000 7f556be00700 1 --2- 172.21.15.2:0/2515455952 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f55580a2cb0 0x7f55580a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:33.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.564+0000 7f556be00700 1 -- 172.21.15.2:0/2515455952 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f55640d04b0 con 0x7f55741024e0 2024-06-13T11:20:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.564+0000 7f5572a00700 1 --2- 172.21.15.2:0/2515455952 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f55580a2cb0 0x7f55580a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:33.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.565+0000 7f5572a00700 1 --2- 172.21.15.2:0/2515455952 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f55580a2cb0 0x7f55580a5170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5574079bf0 tx=0x7f5560009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:33.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.568+0000 7f556be00700 1 -- 172.21.15.2:0/2515455952 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f556405e850 con 0x7f55741024e0 2024-06-13T11:20:33.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:33 smithi002 ceph-mon[32210]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-06-13T11:20:33.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:33 smithi002 ceph-mon[32210]: Cluster is now healthy 2024-06-13T11:20:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.842+0000 7f557a600700 1 -- 172.21.15.2:0/2515455952 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f55740628d0 con 0x7f55580a2cb0 2024-06-13T11:20:33.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.850+0000 7f556be00700 1 -- 172.21.15.2:0/2515455952 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f55740628d0 con 0x7f55580a2cb0 2024-06-13T11:20:33.850 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/qa/sv_1/9e273771-c2ec-44e8-bad9-d56daaf6a806 2024-06-13T11:20:33.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.854+0000 7f557a600700 1 -- 172.21.15.2:0/2515455952 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f55580a2cb0 msgr2=0x7f55580a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:33.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.854+0000 7f557a600700 1 --2- 172.21.15.2:0/2515455952 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f55580a2cb0 0x7f55580a5170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5574079bf0 tx=0x7f5560009260 comp rx=0 tx=0).stop 2024-06-13T11:20:33.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.854+0000 7f557a600700 1 -- 172.21.15.2:0/2515455952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55741024e0 msgr2=0x7f5574074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:33.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.854+0000 7f557a600700 1 --2- 172.21.15.2:0/2515455952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55741024e0 0x7f5574074790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5564000c00 tx=0x7f556400ba90 comp rx=0 tx=0).stop 2024-06-13T11:20:33.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.854+0000 7f557a600700 1 -- 172.21.15.2:0/2515455952 shutdown_connections 2024-06-13T11:20:33.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.854+0000 7f557a600700 1 --2- 172.21.15.2:0/2515455952 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f55580a2cb0 0x7f55580a5170 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:33.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.854+0000 7f557a600700 1 --2- 172.21.15.2:0/2515455952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5574108650 0x7f5574075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:33.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.854+0000 7f557a600700 1 --2- 172.21.15.2:0/2515455952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55741024e0 0x7f5574074790 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:33.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.854+0000 7f557a600700 1 --2- 172.21.15.2:0/2515455952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5574102e80 0x7f5574074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:33.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.854+0000 7f557a600700 1 -- 172.21.15.2:0/2515455952 >> 172.21.15.2:0/2515455952 conn(0x7f55740795f0 msgr2=0x7f55741010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:33.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.854+0000 7f557a600700 1 -- 172.21.15.2:0/2515455952 shutdown_connections 2024-06-13T11:20:33.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:33.854+0000 7f557a600700 1 -- 172.21.15.2:0/2515455952 wait complete. 2024-06-13T11:20:33.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:33 smithi178 ceph-mon[36913]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-06-13T11:20:33.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:33 smithi178 ceph-mon[36913]: Cluster is now healthy 2024-06-13T11:20:34.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:33 smithi077 ceph-mon[36410]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-06-13T11:20:34.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:33 smithi077 ceph-mon[36410]: Cluster is now healthy 2024-06-13T11:20:34.689 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:20:34.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:34 smithi002 ceph-mon[32210]: pgmap v393: 129 pgs: 129 active+clean; 632 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2024-06-13T11:20:34.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:34 smithi002 ceph-mon[32210]: from='client.24727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:20:34.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:34 smithi178 ceph-mon[36913]: pgmap v393: 129 pgs: 129 active+clean; 632 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2024-06-13T11:20:34.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:34 smithi178 ceph-mon[36913]: from='client.24727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:20:35.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:34 smithi077 ceph-mon[36410]: pgmap v393: 129 pgs: 129 active+clean; 632 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2024-06-13T11:20:35.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:34 smithi077 ceph-mon[36410]: from='client.24727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:20:35.154 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:20:36.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:36 smithi002 ceph-mon[32210]: pgmap v394: 129 pgs: 129 active+clean; 632 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.9 KiB/s wr, 9 op/s 2024-06-13T11:20:36.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:36 smithi178 ceph-mon[36913]: pgmap v394: 129 pgs: 129 active+clean; 632 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.9 KiB/s wr, 9 op/s 2024-06-13T11:20:37.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:36 smithi077 ceph-mon[36410]: pgmap v394: 129 pgs: 129 active+clean; 632 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.9 KiB/s wr, 9 op/s 2024-06-13T11:20:37.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.448+0000 7ff24fe00700 1 -- 172.21.15.2:0/902170976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff24810eab0 msgr2=0x7ff24810ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:37.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.448+0000 7ff24fe00700 1 --2- 172.21.15.2:0/902170976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff24810eab0 0x7ff24810ee90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff23c009990 tx=0x7ff23c009ca0 comp rx=0 tx=0).stop 2024-06-13T11:20:37.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.448+0000 7ff24fe00700 1 -- 172.21.15.2:0/902170976 shutdown_connections 2024-06-13T11:20:37.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.448+0000 7ff24fe00700 1 --2- 172.21.15.2:0/902170976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff24810eab0 0x7ff24810ee90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:37.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.448+0000 7ff24fe00700 1 --2- 172.21.15.2:0/902170976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2481094c0 0x7ff248115980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:37.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.448+0000 7ff24fe00700 1 --2- 172.21.15.2:0/902170976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff248108b00 0x7ff248108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:37.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.448+0000 7ff24fe00700 1 -- 172.21.15.2:0/902170976 >> 172.21.15.2:0/902170976 conn(0x7ff248075c60 msgr2=0x7ff248078080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:37.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.448+0000 7ff24fe00700 1 -- 172.21.15.2:0/902170976 shutdown_connections 2024-06-13T11:20:37.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.448+0000 7ff24fe00700 1 -- 172.21.15.2:0/902170976 wait complete. 2024-06-13T11:20:37.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.450+0000 7ff24fe00700 1 Processor -- start 2024-06-13T11:20:37.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.450+0000 7ff24fe00700 1 -- start start 2024-06-13T11:20:37.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.451+0000 7ff24fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff248108b00 0x7ff24819f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:37.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.451+0000 7ff24fe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2481094c0 0x7ff24819f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.451+0000 7ff24fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff24810eab0 0x7ff2481a3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.451+0000 7ff24fe00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff248118e00 con 0x7ff24810eab0 2024-06-13T11:20:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.451+0000 7ff24fe00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff248118c80 con 0x7ff2481094c0 2024-06-13T11:20:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.451+0000 7ff24fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff248118f80 con 0x7ff248108b00 2024-06-13T11:20:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.451+0000 7ff24de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff24810eab0 0x7ff2481a3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:37.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.451+0000 7ff24d400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff248108b00 0x7ff24819f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:37.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.451+0000 7ff24ca00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2481094c0 0x7ff24819f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:37.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.451+0000 7ff24d400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff248108b00 0x7ff24819f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:46752/0 (socket says 172.21.15.2:46752) 2024-06-13T11:20:37.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.451+0000 7ff24de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff24810eab0 0x7ff2481a3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36782/0 (socket says 172.21.15.2:36782) 2024-06-13T11:20:37.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.451+0000 7ff24d400700 1 -- 172.21.15.2:0/2566328201 learned_addr learned my addr 172.21.15.2:0/2566328201 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:20:37.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.451+0000 7ff24ca00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2481094c0 0x7ff24819f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:54128/0 (socket says 172.21.15.2:54128) 2024-06-13T11:20:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.452+0000 7ff24d400700 1 -- 172.21.15.2:0/2566328201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2481094c0 msgr2=0x7ff24819f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.452+0000 7ff24d400700 1 --2- 172.21.15.2:0/2566328201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2481094c0 0x7ff24819f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.452+0000 7ff24d400700 1 -- 172.21.15.2:0/2566328201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff24810eab0 msgr2=0x7ff2481a3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.452+0000 7ff24d400700 1 --2- 172.21.15.2:0/2566328201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff24810eab0 0x7ff2481a3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.452+0000 7ff24d400700 1 -- 172.21.15.2:0/2566328201 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2481a4230 con 0x7ff248108b00 2024-06-13T11:20:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.452+0000 7ff24de00700 1 --2- 172.21.15.2:0/2566328201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff24810eab0 0x7ff2481a3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:20:37.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.452+0000 7ff24ca00700 1 --2- 172.21.15.2:0/2566328201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2481094c0 0x7ff24819f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:20:37.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.452+0000 7ff24d400700 1 --2- 172.21.15.2:0/2566328201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff248108b00 0x7ff24819f270 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00bae0 tx=0x7ff23c00bb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:37.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.452+0000 7ff246000700 1 -- 172.21.15.2:0/2566328201 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c026070 con 0x7ff248108b00 2024-06-13T11:20:37.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.452+0000 7ff246000700 1 -- 172.21.15.2:0/2566328201 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff23c003d70 con 0x7ff248108b00 2024-06-13T11:20:37.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.452+0000 7ff246000700 1 -- 172.21.15.2:0/2566328201 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c021410 con 0x7ff248108b00 2024-06-13T11:20:37.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.453+0000 7ff24fe00700 1 -- 172.21.15.2:0/2566328201 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2481a44c0 con 0x7ff248108b00 2024-06-13T11:20:37.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.453+0000 7ff24fe00700 1 -- 172.21.15.2:0/2566328201 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2481abda0 con 0x7ff248108b00 2024-06-13T11:20:37.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.454+0000 7ff24fe00700 1 -- 172.21.15.2:0/2566328201 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff24810a1f0 con 0x7ff248108b00 2024-06-13T11:20:37.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.456+0000 7ff246000700 1 -- 172.21.15.2:0/2566328201 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7ff23c029070 con 0x7ff248108b00 2024-06-13T11:20:37.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.457+0000 7ff246000700 1 --2- 172.21.15.2:0/2566328201 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff2300a2d30 0x7ff2300a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:37.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.457+0000 7ff246000700 1 -- 172.21.15.2:0/2566328201 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7ff23c0d0790 con 0x7ff248108b00 2024-06-13T11:20:37.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.458+0000 7ff24ca00700 1 --2- 172.21.15.2:0/2566328201 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff2300a2d30 0x7ff2300a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:37.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.458+0000 7ff24ca00700 1 --2- 172.21.15.2:0/2566328201 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff2300a2d30 0x7ff2300a51f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff24810dfe0 tx=0x7ff234009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:37.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.460+0000 7ff246000700 1 -- 172.21.15.2:0/2566328201 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff23c030080 con 0x7ff248108b00 2024-06-13T11:20:37.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.742+0000 7ff24fe00700 1 -- 172.21.15.2:0/2566328201 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2481a0580 con 0x7ff248108b00 2024-06-13T11:20:37.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.743+0000 7ff246000700 1 -- 172.21.15.2:0/2566328201 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11853 (secure 0 0 0) 0x7ff23c013070 con 0x7ff248108b00 2024-06-13T11:20:37.743 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:20:37.743 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:20:14.396526+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24509,24511,24493]},"id":1}]} 2024-06-13T11:20:37.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.747+0000 7ff24fe00700 1 -- 172.21.15.2:0/2566328201 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff2300a2d30 msgr2=0x7ff2300a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:37.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.747+0000 7ff24fe00700 1 --2- 172.21.15.2:0/2566328201 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff2300a2d30 0x7ff2300a51f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff24810dfe0 tx=0x7ff234009260 comp rx=0 tx=0).stop 2024-06-13T11:20:37.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.747+0000 7ff24fe00700 1 -- 172.21.15.2:0/2566328201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff248108b00 msgr2=0x7ff24819f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:37.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.747+0000 7ff24fe00700 1 --2- 172.21.15.2:0/2566328201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff248108b00 0x7ff24819f270 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00bae0 tx=0x7ff23c00bb10 comp rx=0 tx=0).stop 2024-06-13T11:20:37.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.747+0000 7ff24fe00700 1 -- 172.21.15.2:0/2566328201 shutdown_connections 2024-06-13T11:20:37.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.747+0000 7ff24fe00700 1 --2- 172.21.15.2:0/2566328201 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff2300a2d30 0x7ff2300a51f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:37.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.747+0000 7ff24fe00700 1 --2- 172.21.15.2:0/2566328201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff24810eab0 0x7ff2481a3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:37.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.747+0000 7ff24fe00700 1 --2- 172.21.15.2:0/2566328201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff248108b00 0x7ff24819f270 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:37.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.747+0000 7ff24fe00700 1 --2- 172.21.15.2:0/2566328201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2481094c0 0x7ff24819f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:37.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.747+0000 7ff24fe00700 1 -- 172.21.15.2:0/2566328201 >> 172.21.15.2:0/2566328201 conn(0x7ff248075c60 msgr2=0x7ff248076220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:37.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.747+0000 7ff24fe00700 1 -- 172.21.15.2:0/2566328201 shutdown_connections 2024-06-13T11:20:37.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:37.747+0000 7ff24fe00700 1 -- 172.21.15.2:0/2566328201 wait complete. 2024-06-13T11:20:37.748 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-06-13T11:20:38.632 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T11:20:38.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:38 smithi002 ceph-mon[32210]: pgmap v395: 129 pgs: 129 active+clean; 632 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-06-13T11:20:38.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:38 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2566328201' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:20:38.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:38 smithi178 ceph-mon[36913]: pgmap v395: 129 pgs: 129 active+clean; 632 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-06-13T11:20:38.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:38 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2566328201' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:20:39.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:38 smithi077 ceph-mon[36410]: pgmap v395: 129 pgs: 129 active+clean; 632 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-06-13T11:20:39.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:38 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2566328201' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:20:39.110 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:20:40.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:40 smithi002 ceph-mon[32210]: pgmap v396: 129 pgs: 129 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-06-13T11:20:40.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:40 smithi178 ceph-mon[36913]: pgmap v396: 129 pgs: 129 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-06-13T11:20:41.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:40 smithi077 ceph-mon[36410]: pgmap v396: 129 pgs: 129 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-06-13T11:20:41.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.349+0000 7f7db4800700 1 -- 172.21.15.2:0/1864596641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dac1046d0 msgr2=0x7f7dac104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:41.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.349+0000 7f7db4800700 1 --2- 172.21.15.2:0/1864596641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dac1046d0 0x7f7dac104b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0098f0 tx=0x7f7d9c009c00 comp rx=0 tx=0).stop 2024-06-13T11:20:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.349+0000 7f7db4800700 1 -- 172.21.15.2:0/1864596641 shutdown_connections 2024-06-13T11:20:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.349+0000 7f7db4800700 1 --2- 172.21.15.2:0/1864596641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dac10a6d0 0x7f7dac10aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.349+0000 7f7db4800700 1 --2- 172.21.15.2:0/1864596641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7dac105090 0x7f7dac1115a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.349+0000 7f7db4800700 1 --2- 172.21.15.2:0/1864596641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dac1046d0 0x7f7dac104b50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.349+0000 7f7db4800700 1 -- 172.21.15.2:0/1864596641 >> 172.21.15.2:0/1864596641 conn(0x7f7dac1001c0 msgr2=0x7f7dac1025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.349+0000 7f7db4800700 1 -- 172.21.15.2:0/1864596641 shutdown_connections 2024-06-13T11:20:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.349+0000 7f7db4800700 1 -- 172.21.15.2:0/1864596641 wait complete. 2024-06-13T11:20:41.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.350+0000 7f7db4800700 1 Processor -- start 2024-06-13T11:20:41.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.350+0000 7f7db4800700 1 -- start start 2024-06-13T11:20:41.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.351+0000 7f7db4800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7dac1046d0 0x7f7dac19aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:41.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.351+0000 7f7db4800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dac105090 0x7f7dac19b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:41.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.351+0000 7f7db4800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dac10a6d0 0x7f7dac19f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:41.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.351+0000 7f7db4800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac114a20 con 0x7f7dac10a6d0 2024-06-13T11:20:41.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.351+0000 7f7db4800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac1148a0 con 0x7f7dac105090 2024-06-13T11:20:41.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.351+0000 7f7db4800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac114ba0 con 0x7f7dac1046d0 2024-06-13T11:20:41.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.351+0000 7f7db2800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dac10a6d0 0x7f7dac19f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:41.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.351+0000 7f7db1400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dac105090 0x7f7dac19b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:41.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.351+0000 7f7db2800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dac10a6d0 0x7f7dac19f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36792/0 (socket says 172.21.15.2:36792) 2024-06-13T11:20:41.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.351+0000 7f7db1e00700 1 --2- 172.21.15.2:0/853290716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7dac1046d0 0x7f7dac19aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:41.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.351+0000 7f7db2800700 1 -- 172.21.15.2:0/853290716 learned_addr learned my addr 172.21.15.2:0/853290716 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:20:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.352+0000 7f7db1e00700 1 -- 172.21.15.2:0/853290716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dac105090 msgr2=0x7f7dac19b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.352+0000 7f7db1e00700 1 --2- 172.21.15.2:0/853290716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dac105090 0x7f7dac19b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.352+0000 7f7db1e00700 1 -- 172.21.15.2:0/853290716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dac10a6d0 msgr2=0x7f7dac19f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.352+0000 7f7db1e00700 1 --2- 172.21.15.2:0/853290716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dac10a6d0 0x7f7dac19f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.352+0000 7f7db1e00700 1 -- 172.21.15.2:0/853290716 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dac19fe70 con 0x7f7dac1046d0 2024-06-13T11:20:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.352+0000 7f7db1400700 1 --2- 172.21.15.2:0/853290716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dac105090 0x7f7dac19b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:20:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.352+0000 7f7db1e00700 1 --2- 172.21.15.2:0/853290716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7dac1046d0 0x7f7dac19aeb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7da000e9c0 tx=0x7f7da000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.353+0000 7f7da6a00700 1 -- 172.21.15.2:0/853290716 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da000c9c0 con 0x7f7dac1046d0 2024-06-13T11:20:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.353+0000 7f7db4800700 1 -- 172.21.15.2:0/853290716 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dac1a0160 con 0x7f7dac1046d0 2024-06-13T11:20:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.353+0000 7f7da6a00700 1 -- 172.21.15.2:0/853290716 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7da000cb60 con 0x7f7dac1046d0 2024-06-13T11:20:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.353+0000 7f7da6a00700 1 -- 172.21.15.2:0/853290716 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da0018680 con 0x7f7dac1046d0 2024-06-13T11:20:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.353+0000 7f7db4800700 1 -- 172.21.15.2:0/853290716 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dac1a79e0 con 0x7f7dac1046d0 2024-06-13T11:20:41.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.354+0000 7f7db4800700 1 -- 172.21.15.2:0/853290716 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dac069180 con 0x7f7dac1046d0 2024-06-13T11:20:41.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.356+0000 7f7da6a00700 1 -- 172.21.15.2:0/853290716 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f7da000cd10 con 0x7f7dac1046d0 2024-06-13T11:20:41.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.357+0000 7f7da6a00700 1 --2- 172.21.15.2:0/853290716 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7d940a2cb0 0x7f7d940a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:41.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.358+0000 7f7da6a00700 1 -- 172.21.15.2:0/853290716 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f7da00cf9b0 con 0x7f7dac1046d0 2024-06-13T11:20:41.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.358+0000 7f7db1400700 1 --2- 172.21.15.2:0/853290716 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7d940a2cb0 0x7f7d940a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:41.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.359+0000 7f7db1400700 1 --2- 172.21.15.2:0/853290716 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7d940a2cb0 0x7f7d940a5170 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009fd0 tx=0x7f7d9c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:41.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.360+0000 7f7da6a00700 1 -- 172.21.15.2:0/853290716 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7da009c3c0 con 0x7f7dac1046d0 2024-06-13T11:20:41.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.590+0000 7f7db4800700 1 -- 172.21.15.2:0/853290716 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7dac02dca0 con 0x7f7dac1046d0 2024-06-13T11:20:41.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.592+0000 7f7da6a00700 1 -- 172.21.15.2:0/853290716 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24612 (secure 0 0 0) 0x7f7da009bcc0 con 0x7f7dac1046d0 2024-06-13T11:20:41.592 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:20:41.592 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":99,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","created":"2024-06-13T11:09:07.839101+0000","modified":"2024-06-13T11:20:27.512678+0000","last_up_change":"2024-06-13T11:17:28.731479+0000","last_in_change":"2024-06-13T11:17:08.849067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:13:13.793461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:18:36.784824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:18:41.824835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:18:55.545870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f5614d91-49a7-4983-a309-0de3b3e6263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6803","nonce":4127571834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6805","nonce":4127571834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6809","nonce":4127571834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6807","nonce":4127571834}]},"public_addr":"172.21.15.2:6803/4127571834","cluster_addr":"172.21.15.2:6805/4127571834","heartbeat_back_addr":"172.21.15.2:6809/4127571834","heartbeat_front_addr":"172.21.15.2:6807/4127571834","state":["exists","up"]},{"osd":1,"uuid":"d9dbe278-309f-4726-828a-da922f486b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6801","nonce":3180360713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6803","nonce":3180360713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6807","nonce":3180360713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6805","nonce":3180360713}]},"public_addr":"172.21.15.77:6801/3180360713","cluster_addr":"172.21.15.77:6803/3180360713","heartbeat_back_addr":"172.21.15.77:6807/3180360713","heartbeat_front_addr":"172.21.15.77:6805/3180360713","state":["exists","up"]},{"osd":2,"uuid":"04c267dc-7454-418f-9965-3ff96ef280ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6801","nonce":3825510575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6803","nonce":3825510575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6807","nonce":3825510575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6805","nonce":3825510575}]},"public_addr":"172.21.15.178:6801/3825510575","cluster_addr":"172.21.15.178:6803/3825510575","heartbeat_back_addr":"172.21.15.178:6807/3825510575","heartbeat_front_addr":"172.21.15.178:6805/3825510575","state":["exists","up"]},{"osd":3,"uuid":"3847bd4f-ca04-41de-9d88-e1523dd7ff8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6811","nonce":1982693353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6813","nonce":1982693353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6817","nonce":1982693353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6815","nonce":1982693353}]},"public_addr":"172.21.15.2:6811/1982693353","cluster_addr":"172.21.15.2:6813/1982693353","heartbeat_back_addr":"172.21.15.2:6817/1982693353","heartbeat_front_addr":"172.21.15.2:6815/1982693353","state":["exists","up"]},{"osd":4,"uuid":"34d7d2e8-3dee-42b9-a6cb-d4162b122b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6809","nonce":3916694904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6811","nonce":3916694904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6815","nonce":3916694904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6813","nonce":3916694904}]},"public_addr":"172.21.15.77:6809/3916694904","cluster_addr":"172.21.15.77:6811/3916694904","heartbeat_back_addr":"172.21.15.77:6815/3916694904","heartbeat_front_addr":"172.21.15.77:6813/3916694904","state":["exists","up"]},{"osd":5,"uuid":"0468aefc-c3c8-4758-9bbf-1225b7a5ae79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6809","nonce":3572805887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6811","nonce":3572805887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6815","nonce":3572805887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6813","nonce":3572805887}]},"public_addr":"172.21.15.178:6809/3572805887","cluster_addr":"172.21.15.178:6811/3572805887","heartbeat_back_addr":"172.21.15.178:6815/3572805887","heartbeat_front_addr":"172.21.15.178:6813/3572805887","state":["exists","up"]},{"osd":6,"uuid":"0a186a4a-0e28-47bd-b5ad-9bf8079f74c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6819","nonce":1592309584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6821","nonce":1592309584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6825","nonce":1592309584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6823","nonce":1592309584}]},"public_addr":"172.21.15.2:6819/1592309584","cluster_addr":"172.21.15.2:6821/1592309584","heartbeat_back_addr":"172.21.15.2:6825/1592309584","heartbeat_front_addr":"172.21.15.2:6823/1592309584","state":["exists","up"]},{"osd":7,"uuid":"646e66f7-1ef8-428d-a842-bf28c8606df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6817","nonce":1580055775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6819","nonce":1580055775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6823","nonce":1580055775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6821","nonce":1580055775}]},"public_addr":"172.21.15.77:6817/1580055775","cluster_addr":"172.21.15.77:6819/1580055775","heartbeat_back_addr":"172.21.15.77:6823/1580055775","heartbeat_front_addr":"172.21.15.77:6821/1580055775","state":["exists","up"]},{"osd":8,"uuid":"bcc971fc-47d7-4289-8a9a-c76996c57370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6817","nonce":4285192591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6819","nonce":4285192591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6823","nonce":4285192591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6821","nonce":4285192591}]},"public_addr":"172.21.15.178:6817/4285192591","cluster_addr":"172.21.15.178:6819/4285192591","heartbeat_back_addr":"172.21.15.178:6823/4285192591","heartbeat_front_addr":"172.21.15.178:6821/4285192591","state":["exists","up"]},{"osd":9,"uuid":"899d7d4f-a24c-4508-b42c-0b363275c459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6827","nonce":4187017478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6829","nonce":4187017478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6833","nonce":4187017478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6831","nonce":4187017478}]},"public_addr":"172.21.15.2:6827/4187017478","cluster_addr":"172.21.15.2:6829/4187017478","heartbeat_back_addr":"172.21.15.2:6833/4187017478","heartbeat_front_addr":"172.21.15.2:6831/4187017478","state":["exists","up"]},{"osd":10,"uuid":"112d2b8e-9673-4d7a-97e9-2089793fdd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6825","nonce":2039538463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6827","nonce":2039538463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6831","nonce":2039538463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6829","nonce":2039538463}]},"public_addr":"172.21.15.77:6825/2039538463","cluster_addr":"172.21.15.77:6827/2039538463","heartbeat_back_addr":"172.21.15.77:6831/2039538463","heartbeat_front_addr":"172.21.15.77:6829/2039538463","state":["exists","up"]},{"osd":11,"uuid":"6b8001f5-9c74-4cc7-8c41-906cb5ac9b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6825","nonce":1915058767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6827","nonce":1915058767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6831","nonce":1915058767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6829","nonce":1915058767}]},"public_addr":"172.21.15.178:6825/1915058767","cluster_addr":"172.21.15.178:6827/1915058767","heartbeat_back_addr":"172.21.15.178:6831/1915058767","heartbeat_front_addr":"172.21.15.178:6829/1915058767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:21.707572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:46.440115+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:10.197217+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:42.853367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:08.880473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:33.605677+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:07.655377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:33.980900+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:59.397529+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:16:33.983411+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:00.932649+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:26.894098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9},{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/315567313":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/2084201061":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/3394644803":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6801/1821969949":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/2170469985":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/142516651":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6801/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/3220886565":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6800/1821969949":"2024-06-14T11:10:25.084617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:20:41.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.596+0000 7f7db4800700 1 -- 172.21.15.2:0/853290716 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7d940a2cb0 msgr2=0x7f7d940a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:41.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.596+0000 7f7db4800700 1 --2- 172.21.15.2:0/853290716 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7d940a2cb0 0x7f7d940a5170 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009fd0 tx=0x7f7d9c019040 comp rx=0 tx=0).stop 2024-06-13T11:20:41.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.596+0000 7f7db4800700 1 -- 172.21.15.2:0/853290716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7dac1046d0 msgr2=0x7f7dac19aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:41.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.596+0000 7f7db4800700 1 --2- 172.21.15.2:0/853290716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7dac1046d0 0x7f7dac19aeb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7da000e9c0 tx=0x7f7da000ecd0 comp rx=0 tx=0).stop 2024-06-13T11:20:41.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.596+0000 7f7db4800700 1 -- 172.21.15.2:0/853290716 shutdown_connections 2024-06-13T11:20:41.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.596+0000 7f7db4800700 1 --2- 172.21.15.2:0/853290716 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f7d940a2cb0 0x7f7d940a5170 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:41.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.596+0000 7f7db4800700 1 --2- 172.21.15.2:0/853290716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dac10a6d0 0x7f7dac19f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:41.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.596+0000 7f7db4800700 1 --2- 172.21.15.2:0/853290716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7dac1046d0 0x7f7dac19aeb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:41.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.596+0000 7f7db4800700 1 --2- 172.21.15.2:0/853290716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dac105090 0x7f7dac19b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:41.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.596+0000 7f7db4800700 1 -- 172.21.15.2:0/853290716 >> 172.21.15.2:0/853290716 conn(0x7f7dac1001c0 msgr2=0x7f7dac1007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.597+0000 7f7db4800700 1 -- 172.21.15.2:0/853290716 shutdown_connections 2024-06-13T11:20:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:41.597+0000 7f7db4800700 1 -- 172.21.15.2:0/853290716 wait complete. 2024-06-13T11:20:41.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:41 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/853290716' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:20:41.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:41 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/853290716' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:20:42.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:41 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/853290716' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:20:42.417 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-13T11:20:42.417 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph pg dump --format=json 2024-06-13T11:20:42.885 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:20:42.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:42 smithi002 ceph-mon[32210]: pgmap v397: 129 pgs: 129 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-06-13T11:20:42.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:42 smithi178 ceph-mon[36913]: pgmap v397: 129 pgs: 129 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-06-13T11:20:43.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:42 smithi077 ceph-mon[36410]: pgmap v397: 129 pgs: 129 active+clean; 637 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-06-13T11:20:44.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:44 smithi002 ceph-mon[32210]: pgmap v398: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-06-13T11:20:44.822 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:44 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:20:44.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:44 smithi178 ceph-mon[36913]: pgmap v398: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-06-13T11:20:44.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:44 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:20:44.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.989+0000 7f4aff600700 1 -- 172.21.15.2:0/2865298534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af8108500 msgr2=0x7f4af81088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:44.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.989+0000 7f4aff600700 1 --2- 172.21.15.2:0/2865298534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af8108500 0x7f4af81088e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0098f0 tx=0x7f4aec009c00 comp rx=0 tx=0).stop 2024-06-13T11:20:44.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.990+0000 7f4aff600700 1 -- 172.21.15.2:0/2865298534 shutdown_connections 2024-06-13T11:20:44.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.990+0000 7f4aff600700 1 --2- 172.21.15.2:0/2865298534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4af806ab30 0x7f4af810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:44.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.990+0000 7f4aff600700 1 --2- 172.21.15.2:0/2865298534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af8108500 0x7f4af81088e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:44.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.990+0000 7f4aff600700 1 --2- 172.21.15.2:0/2865298534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af806a170 0x7f4af806a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:44.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.990+0000 7f4aff600700 1 -- 172.21.15.2:0/2865298534 >> 172.21.15.2:0/2865298534 conn(0x7f4af8078340 msgr2=0x7f4af8078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:44.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.990+0000 7f4aff600700 1 -- 172.21.15.2:0/2865298534 shutdown_connections 2024-06-13T11:20:44.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.990+0000 7f4aff600700 1 -- 172.21.15.2:0/2865298534 wait complete. 2024-06-13T11:20:44.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.991+0000 7f4aff600700 1 Processor -- start 2024-06-13T11:20:44.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.991+0000 7f4aff600700 1 -- start start 2024-06-13T11:20:44.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.992+0000 7f4aff600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4af806a170 0x7f4af819af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:44.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.992+0000 7f4aff600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af806ab30 0x7f4af819b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:44.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.992+0000 7f4aff600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8108500 0x7f4af819f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:44.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.992+0000 7f4aff600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4af81127b0 con 0x7f4af8108500 2024-06-13T11:20:44.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.992+0000 7f4aff600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4af8112630 con 0x7f4af806ab30 2024-06-13T11:20:44.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.992+0000 7f4aff600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4af8112930 con 0x7f4af806a170 2024-06-13T11:20:44.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.992+0000 7f4afcc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4af806a170 0x7f4af819af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:44.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.992+0000 7f4af7e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af806ab30 0x7f4af819b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:44.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.992+0000 7f4afcc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4af806a170 0x7f4af819af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:46784/0 (socket says 172.21.15.2:46784) 2024-06-13T11:20:44.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.992+0000 7f4afcc00700 1 -- 172.21.15.2:0/1982522098 learned_addr learned my addr 172.21.15.2:0/1982522098 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:20:44.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.992+0000 7f4afd600700 1 --2- 172.21.15.2:0/1982522098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8108500 0x7f4af819f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:44.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.992+0000 7f4afcc00700 1 -- 172.21.15.2:0/1982522098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af806ab30 msgr2=0x7f4af819b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:44.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.992+0000 7f4afcc00700 1 --2- 172.21.15.2:0/1982522098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af806ab30 0x7f4af819b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:44.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.992+0000 7f4afcc00700 1 -- 172.21.15.2:0/1982522098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8108500 msgr2=0x7f4af819f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:44.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.992+0000 7f4afcc00700 1 --2- 172.21.15.2:0/1982522098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8108500 0x7f4af819f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:44.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.992+0000 7f4afcc00700 1 -- 172.21.15.2:0/1982522098 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af819ff10 con 0x7f4af806a170 2024-06-13T11:20:44.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.993+0000 7f4afcc00700 1 --2- 172.21.15.2:0/1982522098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4af806a170 0x7f4af819af00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4aec005950 tx=0x7f4aec00fb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:44.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.993+0000 7f4af5600700 1 -- 172.21.15.2:0/1982522098 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0051f0 con 0x7f4af806a170 2024-06-13T11:20:44.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.993+0000 7f4af5600700 1 -- 172.21.15.2:0/1982522098 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4aec00b560 con 0x7f4af806a170 2024-06-13T11:20:44.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.993+0000 7f4aff600700 1 -- 172.21.15.2:0/1982522098 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af81a01a0 con 0x7f4af806a170 2024-06-13T11:20:44.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.993+0000 7f4af5600700 1 -- 172.21.15.2:0/1982522098 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec003a40 con 0x7f4af806a170 2024-06-13T11:20:44.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.994+0000 7f4aff600700 1 -- 172.21.15.2:0/1982522098 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af81a7a80 con 0x7f4af806a170 2024-06-13T11:20:44.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.995+0000 7f4aff600700 1 -- 172.21.15.2:0/1982522098 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af8103bc0 con 0x7f4af806a170 2024-06-13T11:20:44.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.996+0000 7f4af5600700 1 -- 172.21.15.2:0/1982522098 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f4aec00ba80 con 0x7f4af806a170 2024-06-13T11:20:44.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.998+0000 7f4af5600700 1 --2- 172.21.15.2:0/1982522098 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4ae00a2cb0 0x7f4ae00a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:44.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.998+0000 7f4af5600700 1 -- 172.21.15.2:0/1982522098 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f4aec0d0560 con 0x7f4af806a170 2024-06-13T11:20:44.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.998+0000 7f4af7e00700 1 --2- 172.21.15.2:0/1982522098 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4ae00a2cb0 0x7f4ae00a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:44.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:44.999+0000 7f4af7e00700 1 --2- 172.21.15.2:0/1982522098 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4ae00a2cb0 0x7f4ae00a5170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4af810f810 tx=0x7f4ae4009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:45.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:45.002+0000 7f4af5600700 1 -- 172.21.15.2:0/1982522098 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4aec013030 con 0x7f4af806a170 2024-06-13T11:20:45.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:44 smithi077 ceph-mon[36410]: pgmap v398: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-06-13T11:20:45.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:44 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:20:45.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:45.228+0000 7f4aff600700 1 -- 172.21.15.2:0/1982522098 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4af8100580 con 0x7f4ae00a2cb0 2024-06-13T11:20:45.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:45.248+0000 7f4af5600700 1 -- 172.21.15.2:0/1982522098 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340662 (secure 0 0 0) 0x7f4af8100580 con 0x7f4ae00a2cb0 2024-06-13T11:20:45.248 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:20:45.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:45.255+0000 7f4aff600700 1 -- 172.21.15.2:0/1982522098 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4ae00a2cb0 msgr2=0x7f4ae00a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:45.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:45.255+0000 7f4aff600700 1 --2- 172.21.15.2:0/1982522098 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4ae00a2cb0 0x7f4ae00a5170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4af810f810 tx=0x7f4ae4009310 comp rx=0 tx=0).stop 2024-06-13T11:20:45.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:45.255+0000 7f4aff600700 1 -- 172.21.15.2:0/1982522098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4af806a170 msgr2=0x7f4af819af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:45.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:45.255+0000 7f4aff600700 1 --2- 172.21.15.2:0/1982522098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4af806a170 0x7f4af819af00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4aec005950 tx=0x7f4aec00fb20 comp rx=0 tx=0).stop 2024-06-13T11:20:45.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:45.256+0000 7f4aff600700 1 -- 172.21.15.2:0/1982522098 shutdown_connections 2024-06-13T11:20:45.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:45.256+0000 7f4aff600700 1 --2- 172.21.15.2:0/1982522098 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4ae00a2cb0 0x7f4ae00a5170 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:45.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:45.256+0000 7f4aff600700 1 --2- 172.21.15.2:0/1982522098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8108500 0x7f4af819f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:45.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:45.256+0000 7f4aff600700 1 --2- 172.21.15.2:0/1982522098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4af806a170 0x7f4af819af00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:45.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:45.256+0000 7f4aff600700 1 --2- 172.21.15.2:0/1982522098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af806ab30 0x7f4af819b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:45.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:45.256+0000 7f4aff600700 1 -- 172.21.15.2:0/1982522098 >> 172.21.15.2:0/1982522098 conn(0x7f4af8078340 msgr2=0x7f4af80ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:45.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:45.256+0000 7f4aff600700 1 -- 172.21.15.2:0/1982522098 shutdown_connections 2024-06-13T11:20:45.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:45.257+0000 7f4aff600700 1 -- 172.21.15.2:0/1982522098 wait complete. 2024-06-13T11:20:45.258 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-06-13T11:20:45.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:45 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:45.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:45 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:45.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:45 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:45.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:45 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:45.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:45 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:45.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:45 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:46.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:45 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:46.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:45 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:46.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:45 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:46.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:45 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:46.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:45 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:46.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:45 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:46.125 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":398,"stamp":"2024-06-13T11:20:43.288247+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658541,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":355,"num_read_kb":300,"num_write":353,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":284,"ondisk_log_size":284,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387448,"kb_used_data":13308,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554376,"statfs":{"total":1151940427776,"available":1151543681024,"internally_reserved":0,"allocated":13627392,"data_stored":8781004,"data_compressed":498924,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":33323,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":74,"num_write":24,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005800"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899698+0000","last_change":"2024-06-13T11:18:42.925351+0000","last_active":"2024-06-13T11:20:27.899698+0000","last_peered":"2024-06-13T11:20:27.899698+0000","last_clean":"2024-06-13T11:20:27.899698+0000","last_became_active":"2024-06-13T11:18:42.924971+0000","last_became_peered":"2024-06-13T11:18:42.924971+0000","last_unstale":"2024-06-13T11:20:27.899698+0000","last_undegraded":"2024-06-13T11:20:27.899698+0000","last_fullsized":"2024-06-13T11:20:27.899698+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:33:49.563311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.114426+0000","last_change":"2024-06-13T11:18:42.923771+0000","last_active":"2024-06-13T11:20:28.114426+0000","last_peered":"2024-06-13T11:20:28.114426+0000","last_clean":"2024-06-13T11:20:28.114426+0000","last_became_active":"2024-06-13T11:18:42.918410+0000","last_became_peered":"2024-06-13T11:18:42.918410+0000","last_unstale":"2024-06-13T11:20:28.114426+0000","last_undegraded":"2024-06-13T11:20:28.114426+0000","last_fullsized":"2024-06-13T11:20:28.114426+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:11:28.256622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.113753+0000","last_change":"2024-06-13T11:18:42.919502+0000","last_active":"2024-06-13T11:20:28.113753+0000","last_peered":"2024-06-13T11:20:28.113753+0000","last_clean":"2024-06-13T11:20:28.113753+0000","last_became_active":"2024-06-13T11:18:42.915747+0000","last_became_peered":"2024-06-13T11:18:42.915747+0000","last_unstale":"2024-06-13T11:20:28.113753+0000","last_undegraded":"2024-06-13T11:20:28.113753+0000","last_fullsized":"2024-06-13T11:20:28.113753+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:39:23.555604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529345+0000","last_change":"2024-06-13T11:18:42.905944+0000","last_active":"2024-06-13T11:20:27.529345+0000","last_peered":"2024-06-13T11:20:27.529345+0000","last_clean":"2024-06-13T11:20:27.529345+0000","last_became_active":"2024-06-13T11:18:42.905494+0000","last_became_peered":"2024-06-13T11:18:42.905494+0000","last_unstale":"2024-06-13T11:20:27.529345+0000","last_undegraded":"2024-06-13T11:20:27.529345+0000","last_fullsized":"2024-06-13T11:20:27.529345+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:26:44.396593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525766+0000","last_change":"2024-06-13T11:18:42.924212+0000","last_active":"2024-06-13T11:20:27.525766+0000","last_peered":"2024-06-13T11:20:27.525766+0000","last_clean":"2024-06-13T11:20:27.525766+0000","last_became_active":"2024-06-13T11:18:42.923848+0000","last_became_peered":"2024-06-13T11:18:42.923848+0000","last_unstale":"2024-06-13T11:20:27.525766+0000","last_undegraded":"2024-06-13T11:20:27.525766+0000","last_fullsized":"2024-06-13T11:20:27.525766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:01.754609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.799751+0000","last_change":"2024-06-13T11:18:42.915283+0000","last_active":"2024-06-13T11:20:27.799751+0000","last_peered":"2024-06-13T11:20:27.799751+0000","last_clean":"2024-06-13T11:20:27.799751+0000","last_became_active":"2024-06-13T11:18:42.914921+0000","last_became_peered":"2024-06-13T11:18:42.914921+0000","last_unstale":"2024-06-13T11:20:27.799751+0000","last_undegraded":"2024-06-13T11:20:27.799751+0000","last_fullsized":"2024-06-13T11:20:27.799751+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:48:42.116314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525478+0000","last_change":"2024-06-13T11:18:42.911614+0000","last_active":"2024-06-13T11:20:27.525478+0000","last_peered":"2024-06-13T11:20:27.525478+0000","last_clean":"2024-06-13T11:20:27.525478+0000","last_became_active":"2024-06-13T11:18:42.911360+0000","last_became_peered":"2024-06-13T11:18:42.911360+0000","last_unstale":"2024-06-13T11:20:27.525478+0000","last_undegraded":"2024-06-13T11:20:27.525478+0000","last_fullsized":"2024-06-13T11:20:27.525478+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:23:55.161725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.766180+0000","last_change":"2024-06-13T11:19:27.074801+0000","last_active":"2024-06-13T11:20:27.766180+0000","last_peered":"2024-06-13T11:20:27.766180+0000","last_clean":"2024-06-13T11:20:27.766180+0000","last_became_active":"2024-06-13T11:19:27.072783+0000","last_became_peered":"2024-06-13T11:19:27.072783+0000","last_unstale":"2024-06-13T11:20:27.766180+0000","last_undegraded":"2024-06-13T11:20:27.766180+0000","last_fullsized":"2024-06-13T11:20:27.766180+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:34.658008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899378+0000","last_change":"2024-06-13T11:18:42.913482+0000","last_active":"2024-06-13T11:20:27.899378+0000","last_peered":"2024-06-13T11:20:27.899378+0000","last_clean":"2024-06-13T11:20:27.899378+0000","last_became_active":"2024-06-13T11:18:42.912700+0000","last_became_peered":"2024-06-13T11:18:42.912700+0000","last_unstale":"2024-06-13T11:20:27.899378+0000","last_undegraded":"2024-06-13T11:20:27.899378+0000","last_fullsized":"2024-06-13T11:20:27.899378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:38:42.053801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.800198+0000","last_change":"2024-06-13T11:18:42.905824+0000","last_active":"2024-06-13T11:20:27.800198+0000","last_peered":"2024-06-13T11:20:27.800198+0000","last_clean":"2024-06-13T11:20:27.800198+0000","last_became_active":"2024-06-13T11:18:42.905443+0000","last_became_peered":"2024-06-13T11:18:42.905443+0000","last_unstale":"2024-06-13T11:20:27.800198+0000","last_undegraded":"2024-06-13T11:20:27.800198+0000","last_fullsized":"2024-06-13T11:20:27.800198+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:51:46.957656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525844+0000","last_change":"2024-06-13T11:18:42.901987+0000","last_active":"2024-06-13T11:20:27.525844+0000","last_peered":"2024-06-13T11:20:27.525844+0000","last_clean":"2024-06-13T11:20:27.525844+0000","last_became_active":"2024-06-13T11:18:42.901641+0000","last_became_peered":"2024-06-13T11:18:42.901641+0000","last_unstale":"2024-06-13T11:20:27.525844+0000","last_undegraded":"2024-06-13T11:20:27.525844+0000","last_fullsized":"2024-06-13T11:20:27.525844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:52:29.036172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529071+0000","last_change":"2024-06-13T11:18:42.899161+0000","last_active":"2024-06-13T11:20:27.529071+0000","last_peered":"2024-06-13T11:20:27.529071+0000","last_clean":"2024-06-13T11:20:27.529071+0000","last_became_active":"2024-06-13T11:18:42.898823+0000","last_became_peered":"2024-06-13T11:18:42.898823+0000","last_unstale":"2024-06-13T11:20:27.529071+0000","last_undegraded":"2024-06-13T11:20:27.529071+0000","last_fullsized":"2024-06-13T11:20:27.529071+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:21:20.968759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528238+0000","last_change":"2024-06-13T11:18:42.908954+0000","last_active":"2024-06-13T11:20:27.528238+0000","last_peered":"2024-06-13T11:20:27.528238+0000","last_clean":"2024-06-13T11:20:27.528238+0000","last_became_active":"2024-06-13T11:18:42.908604+0000","last_became_peered":"2024-06-13T11:18:42.908604+0000","last_unstale":"2024-06-13T11:20:27.528238+0000","last_undegraded":"2024-06-13T11:20:27.528238+0000","last_fullsized":"2024-06-13T11:20:27.528238+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:00:30.662233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.112806+0000","last_change":"2024-06-13T11:18:42.925374+0000","last_active":"2024-06-13T11:20:28.112806+0000","last_peered":"2024-06-13T11:20:28.112806+0000","last_clean":"2024-06-13T11:20:28.112806+0000","last_became_active":"2024-06-13T11:18:42.924624+0000","last_became_peered":"2024-06-13T11:18:42.924624+0000","last_unstale":"2024-06-13T11:20:28.112806+0000","last_undegraded":"2024-06-13T11:20:28.112806+0000","last_fullsized":"2024-06-13T11:20:28.112806+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:07.989887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.113136+0000","last_change":"2024-06-13T11:18:42.924457+0000","last_active":"2024-06-13T11:20:28.113136+0000","last_peered":"2024-06-13T11:20:28.113136+0000","last_clean":"2024-06-13T11:20:28.113136+0000","last_became_active":"2024-06-13T11:18:42.922641+0000","last_became_peered":"2024-06-13T11:18:42.922641+0000","last_unstale":"2024-06-13T11:20:28.113136+0000","last_undegraded":"2024-06-13T11:20:28.113136+0000","last_fullsized":"2024-06-13T11:20:28.113136+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:52:56.769565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.898696+0000","last_change":"2024-06-13T11:18:42.925333+0000","last_active":"2024-06-13T11:20:27.898696+0000","last_peered":"2024-06-13T11:20:27.898696+0000","last_clean":"2024-06-13T11:20:27.898696+0000","last_became_active":"2024-06-13T11:18:42.924854+0000","last_became_peered":"2024-06-13T11:18:42.924854+0000","last_unstale":"2024-06-13T11:20:27.898696+0000","last_undegraded":"2024-06-13T11:20:27.898696+0000","last_fullsized":"2024-06-13T11:20:27.898696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:30:38.554616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899571+0000","last_change":"2024-06-13T11:18:42.926652+0000","last_active":"2024-06-13T11:20:27.899571+0000","last_peered":"2024-06-13T11:20:27.899571+0000","last_clean":"2024-06-13T11:20:27.899571+0000","last_became_active":"2024-06-13T11:18:42.926281+0000","last_became_peered":"2024-06-13T11:18:42.926281+0000","last_unstale":"2024-06-13T11:20:27.899571+0000","last_undegraded":"2024-06-13T11:20:27.899571+0000","last_fullsized":"2024-06-13T11:20:27.899571+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:50:50.483047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767431+0000","last_change":"2024-06-13T11:18:42.917743+0000","last_active":"2024-06-13T11:20:27.767431+0000","last_peered":"2024-06-13T11:20:27.767431+0000","last_clean":"2024-06-13T11:20:27.767431+0000","last_became_active":"2024-06-13T11:18:42.916473+0000","last_became_peered":"2024-06-13T11:18:42.916473+0000","last_unstale":"2024-06-13T11:20:27.767431+0000","last_undegraded":"2024-06-13T11:20:27.767431+0000","last_fullsized":"2024-06-13T11:20:27.767431+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:20:12.909524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.531117+0000","last_change":"2024-06-13T11:18:42.930712+0000","last_active":"2024-06-13T11:20:27.531117+0000","last_peered":"2024-06-13T11:20:27.531117+0000","last_clean":"2024-06-13T11:20:27.531117+0000","last_became_active":"2024-06-13T11:18:42.930446+0000","last_became_peered":"2024-06-13T11:18:42.930446+0000","last_unstale":"2024-06-13T11:20:27.531117+0000","last_undegraded":"2024-06-13T11:20:27.531117+0000","last_fullsized":"2024-06-13T11:20:27.531117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:08:28.729916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.531307+0000","last_change":"2024-06-13T11:18:57.027006+0000","last_active":"2024-06-13T11:20:27.531307+0000","last_peered":"2024-06-13T11:20:27.531307+0000","last_clean":"2024-06-13T11:20:27.531307+0000","last_became_active":"2024-06-13T11:18:57.026562+0000","last_became_peered":"2024-06-13T11:18:57.026562+0000","last_unstale":"2024-06-13T11:20:27.531307+0000","last_undegraded":"2024-06-13T11:20:27.531307+0000","last_fullsized":"2024-06-13T11:20:27.531307+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:17:32.180729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"97'9","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767587+0000","last_change":"2024-06-13T11:18:38.172704+0000","last_active":"2024-06-13T11:20:27.767587+0000","last_peered":"2024-06-13T11:20:27.767587+0000","last_clean":"2024-06-13T11:20:27.767587+0000","last_became_active":"2024-06-13T11:18:38.172125+0000","last_became_peered":"2024-06-13T11:18:38.172125+0000","last_unstale":"2024-06-13T11:20:27.767587+0000","last_undegraded":"2024-06-13T11:20:27.767587+0000","last_fullsized":"2024-06-13T11:20:27.767587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:40:52.578805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.903067+0000","last_change":"2024-06-13T11:18:42.922864+0000","last_active":"2024-06-13T11:20:27.903067+0000","last_peered":"2024-06-13T11:20:27.903067+0000","last_clean":"2024-06-13T11:20:27.903067+0000","last_became_active":"2024-06-13T11:18:42.921283+0000","last_became_peered":"2024-06-13T11:18:42.921283+0000","last_unstale":"2024-06-13T11:20:27.903067+0000","last_undegraded":"2024-06-13T11:20:27.903067+0000","last_fullsized":"2024-06-13T11:20:27.903067+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:44.421502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.904814+0000","last_change":"2024-06-13T11:20:27.904814+0000","last_active":"2024-06-13T11:20:27.904814+0000","last_peered":"2024-06-13T11:20:27.904814+0000","last_clean":"2024-06-13T11:20:27.904814+0000","last_became_active":"2024-06-13T11:20:27.904342+0000","last_became_peered":"2024-06-13T11:20:27.904342+0000","last_unstale":"2024-06-13T11:20:27.904814+0000","last_undegraded":"2024-06-13T11:20:27.904814+0000","last_fullsized":"2024-06-13T11:20:27.904814+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:45:59.215429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,10,3],"acting":[4,6,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.903753+0000","last_change":"2024-06-13T11:18:38.483021+0000","last_active":"2024-06-13T11:20:27.903753+0000","last_peered":"2024-06-13T11:20:27.903753+0000","last_clean":"2024-06-13T11:20:27.903753+0000","last_became_active":"2024-06-13T11:18:38.482594+0000","last_became_peered":"2024-06-13T11:18:38.482594+0000","last_unstale":"2024-06-13T11:20:27.903753+0000","last_undegraded":"2024-06-13T11:20:27.903753+0000","last_fullsized":"2024-06-13T11:20:27.903753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:27:07.660961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.114333+0000","last_change":"2024-06-13T11:18:42.926272+0000","last_active":"2024-06-13T11:20:28.114333+0000","last_peered":"2024-06-13T11:20:28.114333+0000","last_clean":"2024-06-13T11:20:28.114333+0000","last_became_active":"2024-06-13T11:18:42.925864+0000","last_became_peered":"2024-06-13T11:18:42.925864+0000","last_unstale":"2024-06-13T11:20:28.114333+0000","last_undegraded":"2024-06-13T11:20:28.114333+0000","last_fullsized":"2024-06-13T11:20:28.114333+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:51:59.562266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528907+0000","last_change":"2024-06-13T11:18:57.033152+0000","last_active":"2024-06-13T11:20:27.528907+0000","last_peered":"2024-06-13T11:20:27.528907+0000","last_clean":"2024-06-13T11:20:27.528907+0000","last_became_active":"2024-06-13T11:18:57.032696+0000","last_became_peered":"2024-06-13T11:18:57.032696+0000","last_unstale":"2024-06-13T11:20:27.528907+0000","last_undegraded":"2024-06-13T11:20:27.528907+0000","last_fullsized":"2024-06-13T11:20:27.528907+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:59:20.584476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'4","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526162+0000","last_change":"2024-06-13T11:18:38.168246+0000","last_active":"2024-06-13T11:20:27.526162+0000","last_peered":"2024-06-13T11:20:27.526162+0000","last_clean":"2024-06-13T11:20:27.526162+0000","last_became_active":"2024-06-13T11:18:38.167918+0000","last_became_peered":"2024-06-13T11:18:38.167918+0000","last_unstale":"2024-06-13T11:20:27.526162+0000","last_undegraded":"2024-06-13T11:20:27.526162+0000","last_fullsized":"2024-06-13T11:20:27.526162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:23:39.079356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.898934+0000","last_change":"2024-06-13T11:18:42.901291+0000","last_active":"2024-06-13T11:20:27.898934+0000","last_peered":"2024-06-13T11:20:27.898934+0000","last_clean":"2024-06-13T11:20:27.898934+0000","last_became_active":"2024-06-13T11:18:42.900990+0000","last_became_peered":"2024-06-13T11:18:42.900990+0000","last_unstale":"2024-06-13T11:20:27.898934+0000","last_undegraded":"2024-06-13T11:20:27.898934+0000","last_fullsized":"2024-06-13T11:20:27.898934+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:59:03.521767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.905640+0000","last_change":"2024-06-13T11:20:27.905640+0000","last_active":"2024-06-13T11:20:27.905640+0000","last_peered":"2024-06-13T11:20:27.905640+0000","last_clean":"2024-06-13T11:20:27.905640+0000","last_became_active":"2024-06-13T11:20:27.905149+0000","last_became_peered":"2024-06-13T11:20:27.905149+0000","last_unstale":"2024-06-13T11:20:27.905640+0000","last_undegraded":"2024-06-13T11:20:27.905640+0000","last_fullsized":"2024-06-13T11:20:27.905640+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:24:14.702582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526051+0000","last_change":"2024-06-13T11:18:38.170301+0000","last_active":"2024-06-13T11:20:27.526051+0000","last_peered":"2024-06-13T11:20:27.526051+0000","last_clean":"2024-06-13T11:20:27.526051+0000","last_became_active":"2024-06-13T11:18:38.169926+0000","last_became_peered":"2024-06-13T11:18:38.169926+0000","last_unstale":"2024-06-13T11:20:27.526051+0000","last_undegraded":"2024-06-13T11:20:27.526051+0000","last_fullsized":"2024-06-13T11:20:27.526051+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:02:02.877638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602732+0000","last_change":"2024-06-13T11:18:42.907869+0000","last_active":"2024-06-13T11:20:27.602732+0000","last_peered":"2024-06-13T11:20:27.602732+0000","last_clean":"2024-06-13T11:20:27.602732+0000","last_became_active":"2024-06-13T11:18:42.907349+0000","last_became_peered":"2024-06-13T11:18:42.907349+0000","last_unstale":"2024-06-13T11:20:27.602732+0000","last_undegraded":"2024-06-13T11:20:27.602732+0000","last_fullsized":"2024-06-13T11:20:27.602732+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:54:33.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.530909+0000","last_change":"2024-06-13T11:18:57.009598+0000","last_active":"2024-06-13T11:20:27.530909+0000","last_peered":"2024-06-13T11:20:27.530909+0000","last_clean":"2024-06-13T11:20:27.530909+0000","last_became_active":"2024-06-13T11:18:57.009186+0000","last_became_peered":"2024-06-13T11:18:57.009186+0000","last_unstale":"2024-06-13T11:20:27.530909+0000","last_undegraded":"2024-06-13T11:20:27.530909+0000","last_fullsized":"2024-06-13T11:20:27.530909+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:41:46.784749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"97'6","reported_seq":84,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:39.476102+0000","last_change":"2024-06-13T11:18:38.167060+0000","last_active":"2024-06-13T11:20:39.476102+0000","last_peered":"2024-06-13T11:20:39.476102+0000","last_clean":"2024-06-13T11:20:39.476102+0000","last_became_active":"2024-06-13T11:18:38.166704+0000","last_became_peered":"2024-06-13T11:18:38.166704+0000","last_unstale":"2024-06-13T11:20:39.476102+0000","last_undegraded":"2024-06-13T11:20:39.476102+0000","last_fullsized":"2024-06-13T11:20:39.476102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:30:51.754276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525627+0000","last_change":"2024-06-13T11:18:42.915361+0000","last_active":"2024-06-13T11:20:27.525627+0000","last_peered":"2024-06-13T11:20:27.525627+0000","last_clean":"2024-06-13T11:20:27.525627+0000","last_became_active":"2024-06-13T11:18:42.914977+0000","last_became_peered":"2024-06-13T11:18:42.914977+0000","last_unstale":"2024-06-13T11:20:27.525627+0000","last_undegraded":"2024-06-13T11:20:27.525627+0000","last_fullsized":"2024-06-13T11:20:27.525627+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:04:30.677548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.603953+0000","last_change":"2024-06-13T11:20:27.603953+0000","last_active":"2024-06-13T11:20:27.603953+0000","last_peered":"2024-06-13T11:20:27.603953+0000","last_clean":"2024-06-13T11:20:27.603953+0000","last_became_active":"2024-06-13T11:20:27.603306+0000","last_became_peered":"2024-06-13T11:20:27.603306+0000","last_unstale":"2024-06-13T11:20:27.603953+0000","last_undegraded":"2024-06-13T11:20:27.603953+0000","last_fullsized":"2024-06-13T11:20:27.603953+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:02:01.228984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'3","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.799597+0000","last_change":"2024-06-13T11:18:38.170126+0000","last_active":"2024-06-13T11:20:27.799597+0000","last_peered":"2024-06-13T11:20:27.799597+0000","last_clean":"2024-06-13T11:20:27.799597+0000","last_became_active":"2024-06-13T11:18:38.169736+0000","last_became_peered":"2024-06-13T11:18:38.169736+0000","last_unstale":"2024-06-13T11:20:27.799597+0000","last_undegraded":"2024-06-13T11:20:27.799597+0000","last_fullsized":"2024-06-13T11:20:27.799597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:07:22.778093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602550+0000","last_change":"2024-06-13T11:18:42.929004+0000","last_active":"2024-06-13T11:20:27.602550+0000","last_peered":"2024-06-13T11:20:27.602550+0000","last_clean":"2024-06-13T11:20:27.602550+0000","last_became_active":"2024-06-13T11:18:42.928579+0000","last_became_peered":"2024-06-13T11:18:42.928579+0000","last_unstale":"2024-06-13T11:20:27.602550+0000","last_undegraded":"2024-06-13T11:20:27.602550+0000","last_fullsized":"2024-06-13T11:20:27.602550+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:31:15.703033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899556+0000","last_change":"2024-06-13T11:18:57.031059+0000","last_active":"2024-06-13T11:20:27.899556+0000","last_peered":"2024-06-13T11:20:27.899556+0000","last_clean":"2024-06-13T11:20:27.899556+0000","last_became_active":"2024-06-13T11:18:57.030723+0000","last_became_peered":"2024-06-13T11:18:57.030723+0000","last_unstale":"2024-06-13T11:20:27.899556+0000","last_undegraded":"2024-06-13T11:20:27.899556+0000","last_fullsized":"2024-06-13T11:20:27.899556+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:19:36.883790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.527530+0000","last_change":"2024-06-13T11:18:38.175189+0000","last_active":"2024-06-13T11:20:27.527530+0000","last_peered":"2024-06-13T11:20:27.527530+0000","last_clean":"2024-06-13T11:20:27.527530+0000","last_became_active":"2024-06-13T11:18:38.173817+0000","last_became_peered":"2024-06-13T11:18:38.173817+0000","last_unstale":"2024-06-13T11:20:27.527530+0000","last_undegraded":"2024-06-13T11:20:27.527530+0000","last_fullsized":"2024-06-13T11:20:27.527530+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:02:18.422449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.903095+0000","last_change":"2024-06-13T11:18:42.920665+0000","last_active":"2024-06-13T11:20:27.903095+0000","last_peered":"2024-06-13T11:20:27.903095+0000","last_clean":"2024-06-13T11:20:27.903095+0000","last_became_active":"2024-06-13T11:18:42.919461+0000","last_became_peered":"2024-06-13T11:18:42.919461+0000","last_unstale":"2024-06-13T11:20:27.903095+0000","last_undegraded":"2024-06-13T11:20:27.903095+0000","last_fullsized":"2024-06-13T11:20:27.903095+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:56:23.042481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.113898+0000","last_change":"2024-06-13T11:18:57.025822+0000","last_active":"2024-06-13T11:20:28.113898+0000","last_peered":"2024-06-13T11:20:28.113898+0000","last_clean":"2024-06-13T11:20:28.113898+0000","last_became_active":"2024-06-13T11:18:57.025408+0000","last_became_peered":"2024-06-13T11:18:57.025408+0000","last_unstale":"2024-06-13T11:20:28.113898+0000","last_undegraded":"2024-06-13T11:20:28.113898+0000","last_fullsized":"2024-06-13T11:20:28.113898+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:39:28.295433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'1","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.601935+0000","last_change":"2024-06-13T11:18:38.168097+0000","last_active":"2024-06-13T11:20:27.601935+0000","last_peered":"2024-06-13T11:20:27.601935+0000","last_clean":"2024-06-13T11:20:27.601935+0000","last_became_active":"2024-06-13T11:18:38.167812+0000","last_became_peered":"2024-06-13T11:18:38.167812+0000","last_unstale":"2024-06-13T11:20:27.601935+0000","last_undegraded":"2024-06-13T11:20:27.601935+0000","last_fullsized":"2024-06-13T11:20:27.601935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:24:20.247579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.766698+0000","last_change":"2024-06-13T11:18:42.932941+0000","last_active":"2024-06-13T11:20:27.766698+0000","last_peered":"2024-06-13T11:20:27.766698+0000","last_clean":"2024-06-13T11:20:27.766698+0000","last_became_active":"2024-06-13T11:18:42.931942+0000","last_became_peered":"2024-06-13T11:18:42.931942+0000","last_unstale":"2024-06-13T11:20:27.766698+0000","last_undegraded":"2024-06-13T11:20:27.766698+0000","last_fullsized":"2024-06-13T11:20:27.766698+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:12:38.625753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.902278+0000","last_change":"2024-06-13T11:18:57.026834+0000","last_active":"2024-06-13T11:20:27.902278+0000","last_peered":"2024-06-13T11:20:27.902278+0000","last_clean":"2024-06-13T11:20:27.902278+0000","last_became_active":"2024-06-13T11:18:57.026401+0000","last_became_peered":"2024-06-13T11:18:57.026401+0000","last_unstale":"2024-06-13T11:20:27.902278+0000","last_undegraded":"2024-06-13T11:20:27.902278+0000","last_fullsized":"2024-06-13T11:20:27.902278+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:11:19.993946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"97'3","reported_seq":79,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:40.476755+0000","last_change":"2024-06-13T11:18:38.172648+0000","last_active":"2024-06-13T11:20:40.476755+0000","last_peered":"2024-06-13T11:20:40.476755+0000","last_clean":"2024-06-13T11:20:40.476755+0000","last_became_active":"2024-06-13T11:18:38.172311+0000","last_became_peered":"2024-06-13T11:18:38.172311+0000","last_unstale":"2024-06-13T11:20:40.476755+0000","last_undegraded":"2024-06-13T11:20:40.476755+0000","last_fullsized":"2024-06-13T11:20:40.476755+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:59:10.620378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899331+0000","last_change":"2024-06-13T11:18:42.920352+0000","last_active":"2024-06-13T11:20:27.899331+0000","last_peered":"2024-06-13T11:20:27.899331+0000","last_clean":"2024-06-13T11:20:27.899331+0000","last_became_active":"2024-06-13T11:18:42.919969+0000","last_became_peered":"2024-06-13T11:18:42.919969+0000","last_unstale":"2024-06-13T11:20:27.899331+0000","last_undegraded":"2024-06-13T11:20:27.899331+0000","last_fullsized":"2024-06-13T11:20:27.899331+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:10:59.832735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.766418+0000","last_change":"2024-06-13T11:18:57.034774+0000","last_active":"2024-06-13T11:20:27.766418+0000","last_peered":"2024-06-13T11:20:27.766418+0000","last_clean":"2024-06-13T11:20:27.766418+0000","last_became_active":"2024-06-13T11:18:57.031812+0000","last_became_peered":"2024-06-13T11:18:57.031812+0000","last_unstale":"2024-06-13T11:20:27.766418+0000","last_undegraded":"2024-06-13T11:20:27.766418+0000","last_fullsized":"2024-06-13T11:20:27.766418+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:26.195958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525940+0000","last_change":"2024-06-13T11:18:38.168169+0000","last_active":"2024-06-13T11:20:27.525940+0000","last_peered":"2024-06-13T11:20:27.525940+0000","last_clean":"2024-06-13T11:20:27.525940+0000","last_became_active":"2024-06-13T11:18:38.167791+0000","last_became_peered":"2024-06-13T11:18:38.167791+0000","last_unstale":"2024-06-13T11:20:27.525940+0000","last_undegraded":"2024-06-13T11:20:27.525940+0000","last_fullsized":"2024-06-13T11:20:27.525940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:04.879468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.114053+0000","last_change":"2024-06-13T11:19:27.077888+0000","last_active":"2024-06-13T11:20:28.114053+0000","last_peered":"2024-06-13T11:20:28.114053+0000","last_clean":"2024-06-13T11:20:28.114053+0000","last_became_active":"2024-06-13T11:19:27.075904+0000","last_became_peered":"2024-06-13T11:19:27.075904+0000","last_unstale":"2024-06-13T11:20:28.114053+0000","last_undegraded":"2024-06-13T11:20:28.114053+0000","last_fullsized":"2024-06-13T11:20:28.114053+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:59.920163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529053+0000","last_change":"2024-06-13T11:19:27.073568+0000","last_active":"2024-06-13T11:20:27.529053+0000","last_peered":"2024-06-13T11:20:27.529053+0000","last_clean":"2024-06-13T11:20:27.529053+0000","last_became_active":"2024-06-13T11:19:27.072954+0000","last_became_peered":"2024-06-13T11:19:27.072954+0000","last_unstale":"2024-06-13T11:20:27.529053+0000","last_undegraded":"2024-06-13T11:20:27.529053+0000","last_fullsized":"2024-06-13T11:20:27.529053+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:10:25.492093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602717+0000","last_change":"2024-06-13T11:18:38.482021+0000","last_active":"2024-06-13T11:20:27.602717+0000","last_peered":"2024-06-13T11:20:27.602717+0000","last_clean":"2024-06-13T11:20:27.602717+0000","last_became_active":"2024-06-13T11:18:38.481574+0000","last_became_peered":"2024-06-13T11:18:38.481574+0000","last_unstale":"2024-06-13T11:20:27.602717+0000","last_undegraded":"2024-06-13T11:20:27.602717+0000","last_fullsized":"2024-06-13T11:20:27.602717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:50:54.297559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899093+0000","last_change":"2024-06-13T11:19:27.072380+0000","last_active":"2024-06-13T11:20:27.899093+0000","last_peered":"2024-06-13T11:20:27.899093+0000","last_clean":"2024-06-13T11:20:27.899093+0000","last_became_active":"2024-06-13T11:19:27.072027+0000","last_became_peered":"2024-06-13T11:19:27.072027+0000","last_unstale":"2024-06-13T11:20:27.899093+0000","last_undegraded":"2024-06-13T11:20:27.899093+0000","last_fullsized":"2024-06-13T11:20:27.899093+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:37:10.455890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.766792+0000","last_change":"2024-06-13T11:18:57.028370+0000","last_active":"2024-06-13T11:20:27.766792+0000","last_peered":"2024-06-13T11:20:27.766792+0000","last_clean":"2024-06-13T11:20:27.766792+0000","last_became_active":"2024-06-13T11:18:57.023478+0000","last_became_peered":"2024-06-13T11:18:57.023478+0000","last_unstale":"2024-06-13T11:20:27.766792+0000","last_undegraded":"2024-06-13T11:20:27.766792+0000","last_fullsized":"2024-06-13T11:20:27.766792+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:25:01.237698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"99'34","reported_seq":151,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:41.478942+0000","last_change":"2024-06-13T11:18:38.169179+0000","last_active":"2024-06-13T11:20:41.478942+0000","last_peered":"2024-06-13T11:20:41.478942+0000","last_clean":"2024-06-13T11:20:41.478942+0000","last_became_active":"2024-06-13T11:18:38.168775+0000","last_became_peered":"2024-06-13T11:18:38.168775+0000","last_unstale":"2024-06-13T11:20:41.478942+0000","last_undegraded":"2024-06-13T11:20:41.478942+0000","last_fullsized":"2024-06-13T11:20:41.478942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:53:39.290755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63549,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":73,"num_read_kb":98,"num_write":35,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525918+0000","last_change":"2024-06-13T11:18:42.903744+0000","last_active":"2024-06-13T11:20:27.525918+0000","last_peered":"2024-06-13T11:20:27.525918+0000","last_clean":"2024-06-13T11:20:27.525918+0000","last_became_active":"2024-06-13T11:18:42.903410+0000","last_became_peered":"2024-06-13T11:18:42.903410+0000","last_unstale":"2024-06-13T11:20:27.525918+0000","last_undegraded":"2024-06-13T11:20:27.525918+0000","last_fullsized":"2024-06-13T11:20:27.525918+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:17:55.975517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.603245+0000","last_change":"2024-06-13T11:18:57.026052+0000","last_active":"2024-06-13T11:20:27.603245+0000","last_peered":"2024-06-13T11:20:27.603245+0000","last_clean":"2024-06-13T11:20:27.603245+0000","last_became_active":"2024-06-13T11:18:57.025677+0000","last_became_peered":"2024-06-13T11:18:57.025677+0000","last_unstale":"2024-06-13T11:20:27.603245+0000","last_undegraded":"2024-06-13T11:20:27.603245+0000","last_fullsized":"2024-06-13T11:20:27.603245+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:41.061675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'6","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.530944+0000","last_change":"2024-06-13T11:18:38.166672+0000","last_active":"2024-06-13T11:20:27.530944+0000","last_peered":"2024-06-13T11:20:27.530944+0000","last_clean":"2024-06-13T11:20:27.530944+0000","last_became_active":"2024-06-13T11:18:38.165923+0000","last_became_peered":"2024-06-13T11:18:38.165923+0000","last_unstale":"2024-06-13T11:20:27.530944+0000","last_undegraded":"2024-06-13T11:20:27.530944+0000","last_fullsized":"2024-06-13T11:20:27.530944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:54:00.989462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.527446+0000","last_change":"2024-06-13T11:18:42.919280+0000","last_active":"2024-06-13T11:20:27.527446+0000","last_peered":"2024-06-13T11:20:27.527446+0000","last_clean":"2024-06-13T11:20:27.527446+0000","last_became_active":"2024-06-13T11:18:42.917421+0000","last_became_peered":"2024-06-13T11:18:42.917421+0000","last_unstale":"2024-06-13T11:20:27.527446+0000","last_undegraded":"2024-06-13T11:20:27.527446+0000","last_fullsized":"2024-06-13T11:20:27.527446+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:52:23.765290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899244+0000","last_change":"2024-06-13T11:18:57.031244+0000","last_active":"2024-06-13T11:20:27.899244+0000","last_peered":"2024-06-13T11:20:27.899244+0000","last_clean":"2024-06-13T11:20:27.899244+0000","last_became_active":"2024-06-13T11:18:57.030781+0000","last_became_peered":"2024-06-13T11:18:57.030781+0000","last_unstale":"2024-06-13T11:20:27.899244+0000","last_undegraded":"2024-06-13T11:20:27.899244+0000","last_fullsized":"2024-06-13T11:20:27.899244+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:19:51.722256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'3","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602509+0000","last_change":"2024-06-13T11:18:38.171060+0000","last_active":"2024-06-13T11:20:27.602509+0000","last_peered":"2024-06-13T11:20:27.602509+0000","last_clean":"2024-06-13T11:20:27.602509+0000","last_became_active":"2024-06-13T11:18:38.170682+0000","last_became_peered":"2024-06-13T11:18:38.170682+0000","last_unstale":"2024-06-13T11:20:27.602509+0000","last_undegraded":"2024-06-13T11:20:27.602509+0000","last_fullsized":"2024-06-13T11:20:27.602509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:05:53.157074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525716+0000","last_change":"2024-06-13T11:18:42.902700+0000","last_active":"2024-06-13T11:20:27.525716+0000","last_peered":"2024-06-13T11:20:27.525716+0000","last_clean":"2024-06-13T11:20:27.525716+0000","last_became_active":"2024-06-13T11:18:42.902351+0000","last_became_peered":"2024-06-13T11:18:42.902351+0000","last_unstale":"2024-06-13T11:20:27.525716+0000","last_undegraded":"2024-06-13T11:20:27.525716+0000","last_fullsized":"2024-06-13T11:20:27.525716+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:55:16.769324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767243+0000","last_change":"2024-06-13T11:18:57.034840+0000","last_active":"2024-06-13T11:20:27.767243+0000","last_peered":"2024-06-13T11:20:27.767243+0000","last_clean":"2024-06-13T11:20:27.767243+0000","last_became_active":"2024-06-13T11:18:57.033552+0000","last_became_peered":"2024-06-13T11:18:57.033552+0000","last_unstale":"2024-06-13T11:20:27.767243+0000","last_undegraded":"2024-06-13T11:20:27.767243+0000","last_fullsized":"2024-06-13T11:20:27.767243+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:44:25.463043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"97'4","reported_seq":83,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:40.499514+0000","last_change":"2024-06-13T11:18:38.170644+0000","last_active":"2024-06-13T11:20:40.499514+0000","last_peered":"2024-06-13T11:20:40.499514+0000","last_clean":"2024-06-13T11:20:40.499514+0000","last_became_active":"2024-06-13T11:18:38.169986+0000","last_became_peered":"2024-06-13T11:18:38.169986+0000","last_unstale":"2024-06-13T11:20:40.499514+0000","last_undegraded":"2024-06-13T11:20:40.499514+0000","last_fullsized":"2024-06-13T11:20:40.499514+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:45:48.817898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525848+0000","last_change":"2024-06-13T11:18:42.903465+0000","last_active":"2024-06-13T11:20:27.525848+0000","last_peered":"2024-06-13T11:20:27.525848+0000","last_clean":"2024-06-13T11:20:27.525848+0000","last_became_active":"2024-06-13T11:18:42.903001+0000","last_became_peered":"2024-06-13T11:18:42.903001+0000","last_unstale":"2024-06-13T11:20:27.525848+0000","last_undegraded":"2024-06-13T11:20:27.525848+0000","last_fullsized":"2024-06-13T11:20:27.525848+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:25:24.331890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529269+0000","last_change":"2024-06-13T11:18:57.033966+0000","last_active":"2024-06-13T11:20:27.529269+0000","last_peered":"2024-06-13T11:20:27.529269+0000","last_clean":"2024-06-13T11:20:27.529269+0000","last_became_active":"2024-06-13T11:18:57.032448+0000","last_became_peered":"2024-06-13T11:18:57.032448+0000","last_unstale":"2024-06-13T11:20:27.529269+0000","last_undegraded":"2024-06-13T11:20:27.529269+0000","last_fullsized":"2024-06-13T11:20:27.529269+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:51:40.473020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'15","reported_seq":60,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525540+0000","last_change":"2024-06-13T11:18:38.483204+0000","last_active":"2024-06-13T11:20:27.525540+0000","last_peered":"2024-06-13T11:20:27.525540+0000","last_clean":"2024-06-13T11:20:27.525540+0000","last_became_active":"2024-06-13T11:18:38.482800+0000","last_became_peered":"2024-06-13T11:18:38.482800+0000","last_unstale":"2024-06-13T11:20:27.525540+0000","last_undegraded":"2024-06-13T11:20:27.525540+0000","last_fullsized":"2024-06-13T11:20:27.525540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:28:44.636201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602182+0000","last_change":"2024-06-13T11:18:42.899944+0000","last_active":"2024-06-13T11:20:27.602182+0000","last_peered":"2024-06-13T11:20:27.602182+0000","last_clean":"2024-06-13T11:20:27.602182+0000","last_became_active":"2024-06-13T11:18:42.899551+0000","last_became_peered":"2024-06-13T11:18:42.899551+0000","last_unstale":"2024-06-13T11:20:27.602182+0000","last_undegraded":"2024-06-13T11:20:27.602182+0000","last_fullsized":"2024-06-13T11:20:27.602182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:18:21.109043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602118+0000","last_change":"2024-06-13T11:18:57.028817+0000","last_active":"2024-06-13T11:20:27.602118+0000","last_peered":"2024-06-13T11:20:27.602118+0000","last_clean":"2024-06-13T11:20:27.602118+0000","last_became_active":"2024-06-13T11:18:57.028433+0000","last_became_peered":"2024-06-13T11:18:57.028433+0000","last_unstale":"2024-06-13T11:20:27.602118+0000","last_undegraded":"2024-06-13T11:20:27.602118+0000","last_fullsized":"2024-06-13T11:20:27.602118+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:56:24.180096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526169+0000","last_change":"2024-06-13T11:18:38.165907+0000","last_active":"2024-06-13T11:20:27.526169+0000","last_peered":"2024-06-13T11:20:27.526169+0000","last_clean":"2024-06-13T11:20:27.526169+0000","last_became_active":"2024-06-13T11:18:38.165516+0000","last_became_peered":"2024-06-13T11:18:38.165516+0000","last_unstale":"2024-06-13T11:20:27.526169+0000","last_undegraded":"2024-06-13T11:20:27.526169+0000","last_fullsized":"2024-06-13T11:20:27.526169+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:51:15.774967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899515+0000","last_change":"2024-06-13T11:19:27.004377+0000","last_active":"2024-06-13T11:20:27.899515+0000","last_peered":"2024-06-13T11:20:27.899515+0000","last_clean":"2024-06-13T11:20:27.899515+0000","last_became_active":"2024-06-13T11:19:27.003954+0000","last_became_peered":"2024-06-13T11:19:27.003954+0000","last_unstale":"2024-06-13T11:20:27.899515+0000","last_undegraded":"2024-06-13T11:20:27.899515+0000","last_fullsized":"2024-06-13T11:20:27.899515+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:53:25.967036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525596+0000","last_change":"2024-06-13T11:18:57.184912+0000","last_active":"2024-06-13T11:20:27.525596+0000","last_peered":"2024-06-13T11:20:27.525596+0000","last_clean":"2024-06-13T11:20:27.525596+0000","last_became_active":"2024-06-13T11:18:57.184442+0000","last_became_peered":"2024-06-13T11:18:57.184442+0000","last_unstale":"2024-06-13T11:20:27.525596+0000","last_undegraded":"2024-06-13T11:20:27.525596+0000","last_fullsized":"2024-06-13T11:20:27.525596+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:47:17.961086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767219+0000","last_change":"2024-06-13T11:18:38.484487+0000","last_active":"2024-06-13T11:20:27.767219+0000","last_peered":"2024-06-13T11:20:27.767219+0000","last_clean":"2024-06-13T11:20:27.767219+0000","last_became_active":"2024-06-13T11:18:38.483587+0000","last_became_peered":"2024-06-13T11:18:38.483587+0000","last_unstale":"2024-06-13T11:20:27.767219+0000","last_undegraded":"2024-06-13T11:20:27.767219+0000","last_fullsized":"2024-06-13T11:20:27.767219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:50:19.773340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.799883+0000","last_change":"2024-06-13T11:18:42.913275+0000","last_active":"2024-06-13T11:20:27.799883+0000","last_peered":"2024-06-13T11:20:27.799883+0000","last_clean":"2024-06-13T11:20:27.799883+0000","last_became_active":"2024-06-13T11:18:42.912880+0000","last_became_peered":"2024-06-13T11:18:42.912880+0000","last_unstale":"2024-06-13T11:20:27.799883+0000","last_undegraded":"2024-06-13T11:20:27.799883+0000","last_fullsized":"2024-06-13T11:20:27.799883+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:01:55.261976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528761+0000","last_change":"2024-06-13T11:18:57.027893+0000","last_active":"2024-06-13T11:20:27.528761+0000","last_peered":"2024-06-13T11:20:27.528761+0000","last_clean":"2024-06-13T11:20:27.528761+0000","last_became_active":"2024-06-13T11:18:57.025683+0000","last_became_peered":"2024-06-13T11:18:57.025683+0000","last_unstale":"2024-06-13T11:20:27.528761+0000","last_undegraded":"2024-06-13T11:20:27.528761+0000","last_fullsized":"2024-06-13T11:20:27.528761+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:25:59.348570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"97'1","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525936+0000","last_change":"2024-06-13T11:18:38.167932+0000","last_active":"2024-06-13T11:20:27.525936+0000","last_peered":"2024-06-13T11:20:27.525936+0000","last_clean":"2024-06-13T11:20:27.525936+0000","last_became_active":"2024-06-13T11:18:38.167520+0000","last_became_peered":"2024-06-13T11:18:38.167520+0000","last_unstale":"2024-06-13T11:20:27.525936+0000","last_undegraded":"2024-06-13T11:20:27.525936+0000","last_fullsized":"2024-06-13T11:20:27.525936+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:00:04.537091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.799575+0000","last_change":"2024-06-13T11:18:42.923211+0000","last_active":"2024-06-13T11:20:27.799575+0000","last_peered":"2024-06-13T11:20:27.799575+0000","last_clean":"2024-06-13T11:20:27.799575+0000","last_became_active":"2024-06-13T11:18:42.922858+0000","last_became_peered":"2024-06-13T11:18:42.922858+0000","last_unstale":"2024-06-13T11:20:27.799575+0000","last_undegraded":"2024-06-13T11:20:27.799575+0000","last_fullsized":"2024-06-13T11:20:27.799575+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:56:18.163502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528719+0000","last_change":"2024-06-13T11:18:57.185071+0000","last_active":"2024-06-13T11:20:27.528719+0000","last_peered":"2024-06-13T11:20:27.528719+0000","last_clean":"2024-06-13T11:20:27.528719+0000","last_became_active":"2024-06-13T11:18:57.184526+0000","last_became_peered":"2024-06-13T11:18:57.184526+0000","last_unstale":"2024-06-13T11:20:27.528719+0000","last_undegraded":"2024-06-13T11:20:27.528719+0000","last_fullsized":"2024-06-13T11:20:27.528719+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:51:37.715832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602260+0000","last_change":"2024-06-13T11:18:42.912483+0000","last_active":"2024-06-13T11:20:27.602260+0000","last_peered":"2024-06-13T11:20:27.602260+0000","last_clean":"2024-06-13T11:20:27.602260+0000","last_became_active":"2024-06-13T11:18:42.912117+0000","last_became_peered":"2024-06-13T11:18:42.912117+0000","last_unstale":"2024-06-13T11:20:27.602260+0000","last_undegraded":"2024-06-13T11:20:27.602260+0000","last_fullsized":"2024-06-13T11:20:27.602260+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:23.769097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"97'4","reported_seq":79,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:39.496871+0000","last_change":"2024-06-13T11:18:38.483334+0000","last_active":"2024-06-13T11:20:39.496871+0000","last_peered":"2024-06-13T11:20:39.496871+0000","last_clean":"2024-06-13T11:20:39.496871+0000","last_became_active":"2024-06-13T11:18:38.482885+0000","last_became_peered":"2024-06-13T11:18:38.482885+0000","last_unstale":"2024-06-13T11:20:39.496871+0000","last_undegraded":"2024-06-13T11:20:39.496871+0000","last_fullsized":"2024-06-13T11:20:39.496871+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:55:19.986526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"97'1","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525681+0000","last_change":"2024-06-13T11:18:57.016960+0000","last_active":"2024-06-13T11:20:27.525681+0000","last_peered":"2024-06-13T11:20:27.525681+0000","last_clean":"2024-06-13T11:20:27.525681+0000","last_became_active":"2024-06-13T11:18:57.016490+0000","last_became_peered":"2024-06-13T11:18:57.016490+0000","last_unstale":"2024-06-13T11:20:27.525681+0000","last_undegraded":"2024-06-13T11:20:27.525681+0000","last_fullsized":"2024-06-13T11:20:27.525681+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:40:19.796594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.903398+0000","last_change":"2024-06-13T11:18:42.921581+0000","last_active":"2024-06-13T11:20:27.903398+0000","last_peered":"2024-06-13T11:20:27.903398+0000","last_clean":"2024-06-13T11:20:27.903398+0000","last_became_active":"2024-06-13T11:18:42.917820+0000","last_became_peered":"2024-06-13T11:18:42.917820+0000","last_unstale":"2024-06-13T11:20:27.903398+0000","last_undegraded":"2024-06-13T11:20:27.903398+0000","last_fullsized":"2024-06-13T11:20:27.903398+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:59:28.460363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'3","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528872+0000","last_change":"2024-06-13T11:18:38.168111+0000","last_active":"2024-06-13T11:20:27.528872+0000","last_peered":"2024-06-13T11:20:27.528872+0000","last_clean":"2024-06-13T11:20:27.528872+0000","last_became_active":"2024-06-13T11:18:38.167732+0000","last_became_peered":"2024-06-13T11:18:38.167732+0000","last_unstale":"2024-06-13T11:20:27.528872+0000","last_undegraded":"2024-06-13T11:20:27.528872+0000","last_fullsized":"2024-06-13T11:20:27.528872+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:36:55.993553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":377,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525428+0000","last_change":"2024-06-13T11:17:06.317849+0000","last_active":"2024-06-13T11:20:27.525428+0000","last_peered":"2024-06-13T11:20:27.525428+0000","last_clean":"2024-06-13T11:20:27.525428+0000","last_became_active":"2024-06-13T11:17:06.317293+0000","last_became_peered":"2024-06-13T11:17:06.317293+0000","last_unstale":"2024-06-13T11:20:27.525428+0000","last_undegraded":"2024-06-13T11:20:27.525428+0000","last_fullsized":"2024-06-13T11:20:27.525428+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:13:14.002581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:13:14.002581+0000","last_clean_scrub_stamp":"2024-06-13T11:13:14.002581+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:54:32.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602807+0000","last_change":"2024-06-13T11:18:57.185880+0000","last_active":"2024-06-13T11:20:27.602807+0000","last_peered":"2024-06-13T11:20:27.602807+0000","last_clean":"2024-06-13T11:20:27.602807+0000","last_became_active":"2024-06-13T11:18:57.185140+0000","last_became_peered":"2024-06-13T11:18:57.185140+0000","last_unstale":"2024-06-13T11:20:27.602807+0000","last_undegraded":"2024-06-13T11:20:27.602807+0000","last_fullsized":"2024-06-13T11:20:27.602807+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:43:40.195809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.527128+0000","last_change":"2024-06-13T11:19:27.006408+0000","last_active":"2024-06-13T11:20:27.527128+0000","last_peered":"2024-06-13T11:20:27.527128+0000","last_clean":"2024-06-13T11:20:27.527128+0000","last_became_active":"2024-06-13T11:19:27.005525+0000","last_became_peered":"2024-06-13T11:19:27.005525+0000","last_unstale":"2024-06-13T11:20:27.527128+0000","last_undegraded":"2024-06-13T11:20:27.527128+0000","last_fullsized":"2024-06-13T11:20:27.527128+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:09:39.891543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525753+0000","last_change":"2024-06-13T11:18:38.171089+0000","last_active":"2024-06-13T11:20:27.525753+0000","last_peered":"2024-06-13T11:20:27.525753+0000","last_clean":"2024-06-13T11:20:27.525753+0000","last_became_active":"2024-06-13T11:18:38.170769+0000","last_became_peered":"2024-06-13T11:18:38.170769+0000","last_unstale":"2024-06-13T11:20:27.525753+0000","last_undegraded":"2024-06-13T11:20:27.525753+0000","last_fullsized":"2024-06-13T11:20:27.525753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:07:46.355159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899192+0000","last_change":"2024-06-13T11:18:57.015609+0000","last_active":"2024-06-13T11:20:27.899192+0000","last_peered":"2024-06-13T11:20:27.899192+0000","last_clean":"2024-06-13T11:20:27.899192+0000","last_became_active":"2024-06-13T11:18:57.015164+0000","last_became_peered":"2024-06-13T11:18:57.015164+0000","last_unstale":"2024-06-13T11:20:27.899192+0000","last_undegraded":"2024-06-13T11:20:27.899192+0000","last_fullsized":"2024-06-13T11:20:27.899192+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:32:15.725778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526001+0000","last_change":"2024-06-13T11:18:38.483215+0000","last_active":"2024-06-13T11:20:27.526001+0000","last_peered":"2024-06-13T11:20:27.526001+0000","last_clean":"2024-06-13T11:20:27.526001+0000","last_became_active":"2024-06-13T11:18:38.482789+0000","last_became_peered":"2024-06-13T11:18:38.482789+0000","last_unstale":"2024-06-13T11:20:27.526001+0000","last_undegraded":"2024-06-13T11:20:27.526001+0000","last_fullsized":"2024-06-13T11:20:27.526001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:01:58.020310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528232+0000","last_change":"2024-06-13T11:18:42.914846+0000","last_active":"2024-06-13T11:20:27.528232+0000","last_peered":"2024-06-13T11:20:27.528232+0000","last_clean":"2024-06-13T11:20:27.528232+0000","last_became_active":"2024-06-13T11:18:42.912614+0000","last_became_peered":"2024-06-13T11:18:42.912614+0000","last_unstale":"2024-06-13T11:20:27.528232+0000","last_undegraded":"2024-06-13T11:20:27.528232+0000","last_fullsized":"2024-06-13T11:20:27.528232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:00:13.066079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.902666+0000","last_change":"2024-06-13T11:18:57.185117+0000","last_active":"2024-06-13T11:20:27.902666+0000","last_peered":"2024-06-13T11:20:27.902666+0000","last_clean":"2024-06-13T11:20:27.902666+0000","last_became_active":"2024-06-13T11:18:57.184498+0000","last_became_peered":"2024-06-13T11:18:57.184498+0000","last_unstale":"2024-06-13T11:20:27.902666+0000","last_undegraded":"2024-06-13T11:20:27.902666+0000","last_fullsized":"2024-06-13T11:20:27.902666+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:04:28.800984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"99'11","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:35.919769+0000","last_change":"2024-06-13T11:18:38.176918+0000","last_active":"2024-06-13T11:20:35.919769+0000","last_peered":"2024-06-13T11:20:35.919769+0000","last_clean":"2024-06-13T11:20:35.919769+0000","last_became_active":"2024-06-13T11:18:38.176236+0000","last_became_peered":"2024-06-13T11:18:38.176236+0000","last_unstale":"2024-06-13T11:20:35.919769+0000","last_undegraded":"2024-06-13T11:20:35.919769+0000","last_fullsized":"2024-06-13T11:20:35.919769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:10:20.684891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.904351+0000","last_change":"2024-06-13T11:18:42.920930+0000","last_active":"2024-06-13T11:20:27.904351+0000","last_peered":"2024-06-13T11:20:27.904351+0000","last_clean":"2024-06-13T11:20:27.904351+0000","last_became_active":"2024-06-13T11:18:42.915838+0000","last_became_peered":"2024-06-13T11:18:42.915838+0000","last_unstale":"2024-06-13T11:20:27.904351+0000","last_undegraded":"2024-06-13T11:20:27.904351+0000","last_fullsized":"2024-06-13T11:20:27.904351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:07:43.483317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.530672+0000","last_change":"2024-06-13T11:18:57.009043+0000","last_active":"2024-06-13T11:20:27.530672+0000","last_peered":"2024-06-13T11:20:27.530672+0000","last_clean":"2024-06-13T11:20:27.530672+0000","last_became_active":"2024-06-13T11:18:57.008533+0000","last_became_peered":"2024-06-13T11:18:57.008533+0000","last_unstale":"2024-06-13T11:20:27.530672+0000","last_undegraded":"2024-06-13T11:20:27.530672+0000","last_fullsized":"2024-06-13T11:20:27.530672+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:30:29.614810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'4","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529178+0000","last_change":"2024-06-13T11:18:38.523042+0000","last_active":"2024-06-13T11:20:27.529178+0000","last_peered":"2024-06-13T11:20:27.529178+0000","last_clean":"2024-06-13T11:20:27.529178+0000","last_became_active":"2024-06-13T11:18:38.522673+0000","last_became_peered":"2024-06-13T11:18:38.522673+0000","last_unstale":"2024-06-13T11:20:27.529178+0000","last_undegraded":"2024-06-13T11:20:27.529178+0000","last_fullsized":"2024-06-13T11:20:27.529178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:25:50.725281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.114522+0000","last_change":"2024-06-13T11:18:42.934090+0000","last_active":"2024-06-13T11:20:28.114522+0000","last_peered":"2024-06-13T11:20:28.114522+0000","last_clean":"2024-06-13T11:20:28.114522+0000","last_became_active":"2024-06-13T11:18:42.933680+0000","last_became_peered":"2024-06-13T11:18:42.933680+0000","last_unstale":"2024-06-13T11:20:28.114522+0000","last_undegraded":"2024-06-13T11:20:28.114522+0000","last_fullsized":"2024-06-13T11:20:28.114522+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:39:30.214272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528962+0000","last_change":"2024-06-13T11:18:57.185186+0000","last_active":"2024-06-13T11:20:27.528962+0000","last_peered":"2024-06-13T11:20:27.528962+0000","last_clean":"2024-06-13T11:20:27.528962+0000","last_became_active":"2024-06-13T11:18:57.184448+0000","last_became_peered":"2024-06-13T11:18:57.184448+0000","last_unstale":"2024-06-13T11:20:27.528962+0000","last_undegraded":"2024-06-13T11:20:27.528962+0000","last_fullsized":"2024-06-13T11:20:27.528962+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:18:32.514993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.898789+0000","last_change":"2024-06-13T11:19:26.999451+0000","last_active":"2024-06-13T11:20:27.898789+0000","last_peered":"2024-06-13T11:20:27.898789+0000","last_clean":"2024-06-13T11:20:27.898789+0000","last_became_active":"2024-06-13T11:19:26.999153+0000","last_became_peered":"2024-06-13T11:19:26.999153+0000","last_unstale":"2024-06-13T11:20:27.898789+0000","last_undegraded":"2024-06-13T11:20:27.898789+0000","last_fullsized":"2024-06-13T11:20:27.898789+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:42:34.755569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525540+0000","last_change":"2024-06-13T11:18:42.903741+0000","last_active":"2024-06-13T11:20:27.525540+0000","last_peered":"2024-06-13T11:20:27.525540+0000","last_clean":"2024-06-13T11:20:27.525540+0000","last_became_active":"2024-06-13T11:18:42.903351+0000","last_became_peered":"2024-06-13T11:18:42.903351+0000","last_unstale":"2024-06-13T11:20:27.525540+0000","last_undegraded":"2024-06-13T11:20:27.525540+0000","last_fullsized":"2024-06-13T11:20:27.525540+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:47:21.206540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767417+0000","last_change":"2024-06-13T11:18:57.035149+0000","last_active":"2024-06-13T11:20:27.767417+0000","last_peered":"2024-06-13T11:20:27.767417+0000","last_clean":"2024-06-13T11:20:27.767417+0000","last_became_active":"2024-06-13T11:18:57.033208+0000","last_became_peered":"2024-06-13T11:18:57.033208+0000","last_unstale":"2024-06-13T11:20:27.767417+0000","last_undegraded":"2024-06-13T11:20:27.767417+0000","last_fullsized":"2024-06-13T11:20:27.767417+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:19:01.353814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'3","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.902373+0000","last_change":"2024-06-13T11:18:38.170464+0000","last_active":"2024-06-13T11:20:27.902373+0000","last_peered":"2024-06-13T11:20:27.902373+0000","last_clean":"2024-06-13T11:20:27.902373+0000","last_became_active":"2024-06-13T11:18:38.169945+0000","last_became_peered":"2024-06-13T11:18:38.169945+0000","last_unstale":"2024-06-13T11:20:27.902373+0000","last_undegraded":"2024-06-13T11:20:27.902373+0000","last_fullsized":"2024-06-13T11:20:27.902373+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:53:20.112176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899166+0000","last_change":"2024-06-13T11:18:42.925391+0000","last_active":"2024-06-13T11:20:27.899166+0000","last_peered":"2024-06-13T11:20:27.899166+0000","last_clean":"2024-06-13T11:20:27.899166+0000","last_became_active":"2024-06-13T11:18:42.924900+0000","last_became_peered":"2024-06-13T11:18:42.924900+0000","last_unstale":"2024-06-13T11:20:27.899166+0000","last_undegraded":"2024-06-13T11:20:27.899166+0000","last_fullsized":"2024-06-13T11:20:27.899166+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:10.954502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"99'1","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528909+0000","last_change":"2024-06-13T11:18:57.029448+0000","last_active":"2024-06-13T11:20:27.528909+0000","last_peered":"2024-06-13T11:20:27.528909+0000","last_clean":"2024-06-13T11:20:27.528909+0000","last_became_active":"2024-06-13T11:18:57.028918+0000","last_became_peered":"2024-06-13T11:18:57.028918+0000","last_unstale":"2024-06-13T11:20:27.528909+0000","last_undegraded":"2024-06-13T11:20:27.528909+0000","last_fullsized":"2024-06-13T11:20:27.528909+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:53:06.206458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"97'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899139+0000","last_change":"2024-06-13T11:19:27.078724+0000","last_active":"2024-06-13T11:20:27.899139+0000","last_peered":"2024-06-13T11:20:27.899139+0000","last_clean":"2024-06-13T11:20:27.899139+0000","last_became_active":"2024-06-13T11:19:27.078329+0000","last_became_peered":"2024-06-13T11:19:27.078329+0000","last_unstale":"2024-06-13T11:20:27.899139+0000","last_undegraded":"2024-06-13T11:20:27.899139+0000","last_fullsized":"2024-06-13T11:20:27.899139+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:25:38.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.902861+0000","last_change":"2024-06-13T11:18:42.930769+0000","last_active":"2024-06-13T11:20:27.902861+0000","last_peered":"2024-06-13T11:20:27.902861+0000","last_clean":"2024-06-13T11:20:27.902861+0000","last_became_active":"2024-06-13T11:18:42.928727+0000","last_became_peered":"2024-06-13T11:18:42.928727+0000","last_unstale":"2024-06-13T11:20:27.902861+0000","last_undegraded":"2024-06-13T11:20:27.902861+0000","last_fullsized":"2024-06-13T11:20:27.902861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:14:55.202237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529315+0000","last_change":"2024-06-13T11:18:57.185071+0000","last_active":"2024-06-13T11:20:27.529315+0000","last_peered":"2024-06-13T11:20:27.529315+0000","last_clean":"2024-06-13T11:20:27.529315+0000","last_became_active":"2024-06-13T11:18:57.184534+0000","last_became_peered":"2024-06-13T11:18:57.184534+0000","last_unstale":"2024-06-13T11:20:27.529315+0000","last_undegraded":"2024-06-13T11:20:27.529315+0000","last_fullsized":"2024-06-13T11:20:27.529315+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:55:11.146525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525668+0000","last_change":"2024-06-13T11:18:38.167734+0000","last_active":"2024-06-13T11:20:27.525668+0000","last_peered":"2024-06-13T11:20:27.525668+0000","last_clean":"2024-06-13T11:20:27.525668+0000","last_became_active":"2024-06-13T11:18:38.167345+0000","last_became_peered":"2024-06-13T11:18:38.167345+0000","last_unstale":"2024-06-13T11:20:27.525668+0000","last_undegraded":"2024-06-13T11:20:27.525668+0000","last_fullsized":"2024-06-13T11:20:27.525668+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:55:43.155928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525784+0000","last_change":"2024-06-13T11:18:42.900884+0000","last_active":"2024-06-13T11:20:27.525784+0000","last_peered":"2024-06-13T11:20:27.525784+0000","last_clean":"2024-06-13T11:20:27.525784+0000","last_became_active":"2024-06-13T11:18:42.900562+0000","last_became_peered":"2024-06-13T11:18:42.900562+0000","last_unstale":"2024-06-13T11:20:27.525784+0000","last_undegraded":"2024-06-13T11:20:27.525784+0000","last_fullsized":"2024-06-13T11:20:27.525784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:38:59.480693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.898766+0000","last_change":"2024-06-13T11:18:57.015496+0000","last_active":"2024-06-13T11:20:27.898766+0000","last_peered":"2024-06-13T11:20:27.898766+0000","last_clean":"2024-06-13T11:20:27.898766+0000","last_became_active":"2024-06-13T11:18:57.015079+0000","last_became_peered":"2024-06-13T11:18:57.015079+0000","last_unstale":"2024-06-13T11:20:27.898766+0000","last_undegraded":"2024-06-13T11:20:27.898766+0000","last_fullsized":"2024-06-13T11:20:27.898766+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:31:40.130018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.531531+0000","last_change":"2024-06-13T11:18:38.523097+0000","last_active":"2024-06-13T11:20:27.531531+0000","last_peered":"2024-06-13T11:20:27.531531+0000","last_clean":"2024-06-13T11:20:27.531531+0000","last_became_active":"2024-06-13T11:18:38.522638+0000","last_became_peered":"2024-06-13T11:18:38.522638+0000","last_unstale":"2024-06-13T11:20:27.531531+0000","last_undegraded":"2024-06-13T11:20:27.531531+0000","last_fullsized":"2024-06-13T11:20:27.531531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:35:36.843246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526040+0000","last_change":"2024-06-13T11:18:42.899281+0000","last_active":"2024-06-13T11:20:27.526040+0000","last_peered":"2024-06-13T11:20:27.526040+0000","last_clean":"2024-06-13T11:20:27.526040+0000","last_became_active":"2024-06-13T11:18:42.898924+0000","last_became_peered":"2024-06-13T11:18:42.898924+0000","last_unstale":"2024-06-13T11:20:27.526040+0000","last_undegraded":"2024-06-13T11:20:27.526040+0000","last_fullsized":"2024-06-13T11:20:27.526040+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:18:10.324425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.112660+0000","last_change":"2024-06-13T11:18:57.037070+0000","last_active":"2024-06-13T11:20:28.112660+0000","last_peered":"2024-06-13T11:20:28.112660+0000","last_clean":"2024-06-13T11:20:28.112660+0000","last_became_active":"2024-06-13T11:18:57.036632+0000","last_became_peered":"2024-06-13T11:18:57.036632+0000","last_unstale":"2024-06-13T11:20:28.112660+0000","last_undegraded":"2024-06-13T11:20:28.112660+0000","last_fullsized":"2024-06-13T11:20:28.112660+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:19:35.433902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.603128+0000","last_change":"2024-06-13T11:18:38.170790+0000","last_active":"2024-06-13T11:20:27.603128+0000","last_peered":"2024-06-13T11:20:27.603128+0000","last_clean":"2024-06-13T11:20:27.603128+0000","last_became_active":"2024-06-13T11:18:38.170260+0000","last_became_peered":"2024-06-13T11:18:38.170260+0000","last_unstale":"2024-06-13T11:20:27.603128+0000","last_undegraded":"2024-06-13T11:20:27.603128+0000","last_fullsized":"2024-06-13T11:20:27.603128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:11:44.070550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525873+0000","last_change":"2024-06-13T11:18:42.906969+0000","last_active":"2024-06-13T11:20:27.525873+0000","last_peered":"2024-06-13T11:20:27.525873+0000","last_clean":"2024-06-13T11:20:27.525873+0000","last_became_active":"2024-06-13T11:18:42.906657+0000","last_became_peered":"2024-06-13T11:18:42.906657+0000","last_unstale":"2024-06-13T11:20:27.525873+0000","last_undegraded":"2024-06-13T11:20:27.525873+0000","last_fullsized":"2024-06-13T11:20:27.525873+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:30:36.414377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.601926+0000","last_change":"2024-06-13T11:18:57.007226+0000","last_active":"2024-06-13T11:20:27.601926+0000","last_peered":"2024-06-13T11:20:27.601926+0000","last_clean":"2024-06-13T11:20:27.601926+0000","last_became_active":"2024-06-13T11:18:57.006803+0000","last_became_peered":"2024-06-13T11:18:57.006803+0000","last_unstale":"2024-06-13T11:20:27.601926+0000","last_undegraded":"2024-06-13T11:20:27.601926+0000","last_fullsized":"2024-06-13T11:20:27.601926+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:08:28.913145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529479+0000","last_change":"2024-06-13T11:18:38.173327+0000","last_active":"2024-06-13T11:20:27.529479+0000","last_peered":"2024-06-13T11:20:27.529479+0000","last_clean":"2024-06-13T11:20:27.529479+0000","last_became_active":"2024-06-13T11:18:38.172786+0000","last_became_peered":"2024-06-13T11:18:38.172786+0000","last_unstale":"2024-06-13T11:20:27.529479+0000","last_undegraded":"2024-06-13T11:20:27.529479+0000","last_fullsized":"2024-06-13T11:20:27.529479+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:40:30.330272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526173+0000","last_change":"2024-06-13T11:18:42.899816+0000","last_active":"2024-06-13T11:20:27.526173+0000","last_peered":"2024-06-13T11:20:27.526173+0000","last_clean":"2024-06-13T11:20:27.526173+0000","last_became_active":"2024-06-13T11:18:42.899495+0000","last_became_peered":"2024-06-13T11:18:42.899495+0000","last_unstale":"2024-06-13T11:20:27.526173+0000","last_undegraded":"2024-06-13T11:20:27.526173+0000","last_fullsized":"2024-06-13T11:20:27.526173+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:16:08.303616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899292+0000","last_change":"2024-06-13T11:18:42.909944+0000","last_active":"2024-06-13T11:20:27.899292+0000","last_peered":"2024-06-13T11:20:27.899292+0000","last_clean":"2024-06-13T11:20:27.899292+0000","last_became_active":"2024-06-13T11:18:42.909557+0000","last_became_peered":"2024-06-13T11:18:42.909557+0000","last_unstale":"2024-06-13T11:20:27.899292+0000","last_undegraded":"2024-06-13T11:20:27.899292+0000","last_fullsized":"2024-06-13T11:20:27.899292+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:22:07.093462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.531456+0000","last_change":"2024-06-13T11:18:42.912462+0000","last_active":"2024-06-13T11:20:27.531456+0000","last_peered":"2024-06-13T11:20:27.531456+0000","last_clean":"2024-06-13T11:20:27.531456+0000","last_became_active":"2024-06-13T11:18:42.912110+0000","last_became_peered":"2024-06-13T11:18:42.912110+0000","last_unstale":"2024-06-13T11:20:27.531456+0000","last_undegraded":"2024-06-13T11:20:27.531456+0000","last_fullsized":"2024-06-13T11:20:27.531456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:11:33.123305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.530794+0000","last_change":"2024-06-13T11:18:42.924224+0000","last_active":"2024-06-13T11:20:27.530794+0000","last_peered":"2024-06-13T11:20:27.530794+0000","last_clean":"2024-06-13T11:20:27.530794+0000","last_became_active":"2024-06-13T11:18:42.923858+0000","last_became_peered":"2024-06-13T11:18:42.923858+0000","last_unstale":"2024-06-13T11:20:27.530794+0000","last_undegraded":"2024-06-13T11:20:27.530794+0000","last_fullsized":"2024-06-13T11:20:27.530794+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:36:11.602930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.113283+0000","last_change":"2024-06-13T11:18:42.921160+0000","last_active":"2024-06-13T11:20:28.113283+0000","last_peered":"2024-06-13T11:20:28.113283+0000","last_clean":"2024-06-13T11:20:28.113283+0000","last_became_active":"2024-06-13T11:18:42.920704+0000","last_became_peered":"2024-06-13T11:18:42.920704+0000","last_unstale":"2024-06-13T11:20:28.113283+0000","last_undegraded":"2024-06-13T11:20:28.113283+0000","last_fullsized":"2024-06-13T11:20:28.113283+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:07:17.023390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528452+0000","last_change":"2024-06-13T11:18:42.923637+0000","last_active":"2024-06-13T11:20:27.528452+0000","last_peered":"2024-06-13T11:20:27.528452+0000","last_clean":"2024-06-13T11:20:27.528452+0000","last_became_active":"2024-06-13T11:18:42.923234+0000","last_became_peered":"2024-06-13T11:18:42.923234+0000","last_unstale":"2024-06-13T11:20:27.528452+0000","last_undegraded":"2024-06-13T11:20:27.528452+0000","last_fullsized":"2024-06-13T11:20:27.528452+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:51:19.676747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899457+0000","last_change":"2024-06-13T11:18:42.910300+0000","last_active":"2024-06-13T11:20:27.899457+0000","last_peered":"2024-06-13T11:20:27.899457+0000","last_clean":"2024-06-13T11:20:27.899457+0000","last_became_active":"2024-06-13T11:18:42.909937+0000","last_became_peered":"2024-06-13T11:18:42.909937+0000","last_unstale":"2024-06-13T11:20:27.899457+0000","last_undegraded":"2024-06-13T11:20:27.899457+0000","last_fullsized":"2024-06-13T11:20:27.899457+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:24:51.407238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.531164+0000","last_change":"2024-06-13T11:18:42.907066+0000","last_active":"2024-06-13T11:20:27.531164+0000","last_peered":"2024-06-13T11:20:27.531164+0000","last_clean":"2024-06-13T11:20:27.531164+0000","last_became_active":"2024-06-13T11:18:42.906582+0000","last_became_peered":"2024-06-13T11:18:42.906582+0000","last_unstale":"2024-06-13T11:20:27.531164+0000","last_undegraded":"2024-06-13T11:20:27.531164+0000","last_fullsized":"2024-06-13T11:20:27.531164+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:40:02.549931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.904685+0000","last_change":"2024-06-13T11:18:42.910290+0000","last_active":"2024-06-13T11:20:27.904685+0000","last_peered":"2024-06-13T11:20:27.904685+0000","last_clean":"2024-06-13T11:20:27.904685+0000","last_became_active":"2024-06-13T11:18:42.909772+0000","last_became_peered":"2024-06-13T11:18:42.909772+0000","last_unstale":"2024-06-13T11:20:27.904685+0000","last_undegraded":"2024-06-13T11:20:27.904685+0000","last_fullsized":"2024-06-13T11:20:27.904685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:05:56.008087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602110+0000","last_change":"2024-06-13T11:18:42.928792+0000","last_active":"2024-06-13T11:20:27.602110+0000","last_peered":"2024-06-13T11:20:27.602110+0000","last_clean":"2024-06-13T11:20:27.602110+0000","last_became_active":"2024-06-13T11:18:42.928464+0000","last_became_peered":"2024-06-13T11:18:42.928464+0000","last_unstale":"2024-06-13T11:20:27.602110+0000","last_undegraded":"2024-06-13T11:20:27.602110+0000","last_fullsized":"2024-06-13T11:20:27.602110+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:01:58.686124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.903312+0000","last_change":"2024-06-13T11:18:42.920719+0000","last_active":"2024-06-13T11:20:27.903312+0000","last_peered":"2024-06-13T11:20:27.903312+0000","last_clean":"2024-06-13T11:20:27.903312+0000","last_became_active":"2024-06-13T11:18:42.913355+0000","last_became_peered":"2024-06-13T11:18:42.913355+0000","last_unstale":"2024-06-13T11:20:27.903312+0000","last_undegraded":"2024-06-13T11:20:27.903312+0000","last_fullsized":"2024-06-13T11:20:27.903312+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:25:00.020936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899092+0000","last_change":"2024-06-13T11:18:42.906709+0000","last_active":"2024-06-13T11:20:27.899092+0000","last_peered":"2024-06-13T11:20:27.899092+0000","last_clean":"2024-06-13T11:20:27.899092+0000","last_became_active":"2024-06-13T11:18:42.906309+0000","last_became_peered":"2024-06-13T11:18:42.906309+0000","last_unstale":"2024-06-13T11:20:27.899092+0000","last_undegraded":"2024-06-13T11:20:27.899092+0000","last_fullsized":"2024-06-13T11:20:27.899092+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:09.255670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528277+0000","last_change":"2024-06-13T11:18:42.926939+0000","last_active":"2024-06-13T11:20:27.528277+0000","last_peered":"2024-06-13T11:20:27.528277+0000","last_clean":"2024-06-13T11:20:27.528277+0000","last_became_active":"2024-06-13T11:18:42.926616+0000","last_became_peered":"2024-06-13T11:18:42.926616+0000","last_unstale":"2024-06-13T11:20:27.528277+0000","last_undegraded":"2024-06-13T11:20:27.528277+0000","last_fullsized":"2024-06-13T11:20:27.528277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:52:46.468479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899422+0000","last_change":"2024-06-13T11:18:42.901103+0000","last_active":"2024-06-13T11:20:27.899422+0000","last_peered":"2024-06-13T11:20:27.899422+0000","last_clean":"2024-06-13T11:20:27.899422+0000","last_became_active":"2024-06-13T11:18:42.900726+0000","last_became_peered":"2024-06-13T11:18:42.900726+0000","last_unstale":"2024-06-13T11:20:27.899422+0000","last_undegraded":"2024-06-13T11:20:27.899422+0000","last_fullsized":"2024-06-13T11:20:27.899422+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:55.895451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285250,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67939,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":219,"num_read_kb":181,"num_write":170,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":197564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383721,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1093632,"data_stored":569642,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645357,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32388,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712764,"statfs":{"total":95995035648,"available":95961870336,"internally_reserved":0,"allocated":1241088,"data_stored":1220849,"data_compressed":68781,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808883,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1114112,"data_stored":573974,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070521,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":569798,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332159,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1159168,"data_stored":1166096,"data_compressed":68781,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495685,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712904,"statfs":{"total":95995035648,"available":95962013696,"internally_reserved":0,"allocated":1089536,"data_stored":565054,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32300,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712852,"statfs":{"total":95995035648,"available":95961960448,"internally_reserved":0,"allocated":1150976,"data_stored":622260,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738470,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1114112,"data_stored":566442,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411419,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36492,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708660,"statfs":{"total":95995035648,"available":95957667840,"internally_reserved":0,"allocated":1183744,"data_stored":630253,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182484,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":565248,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920848,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1101824,"data_stored":570094,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757323,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36480,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708672,"statfs":{"total":95995035648,"available":95957680128,"internally_reserved":0,"allocated":1167360,"data_stored":1161294,"data_compressed":68781,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34630,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34630,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34630,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":57296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T11:20:46.132 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph pg dump --format=json 2024-06-13T11:20:46.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:45 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:46.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:45 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:46.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:45 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:46.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:45 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:46.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:45 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:46.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:45 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:46.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:46 smithi002 ceph-mon[32210]: from='client.24745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:20:46.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:46 smithi002 ceph-mon[32210]: pgmap v399: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-06-13T11:20:47.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:46 smithi077 ceph-mon[36410]: from='client.24745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:20:47.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:46 smithi077 ceph-mon[36410]: pgmap v399: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-06-13T11:20:47.190 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:20:47.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:46 smithi178 ceph-mon[36913]: from='client.24745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:20:47.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:46 smithi178 ceph-mon[36913]: pgmap v399: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-06-13T11:20:48.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:48 smithi002 ceph-mon[32210]: pgmap v400: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-13T11:20:49.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:48 smithi077 ceph-mon[36410]: pgmap v400: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-13T11:20:49.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:48 smithi178 ceph-mon[36913]: pgmap v400: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-13T11:20:49.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.473+0000 7f7265800700 1 -- 172.21.15.2:0/667199612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72601085f0 msgr2=0x7f72601089d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:49.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.473+0000 7f7265800700 1 --2- 172.21.15.2:0/667199612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72601085f0 0x7f72601089d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7250009990 tx=0x7f7250009ca0 comp rx=0 tx=0).stop 2024-06-13T11:20:49.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.473+0000 7f7265800700 1 -- 172.21.15.2:0/667199612 shutdown_connections 2024-06-13T11:20:49.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.473+0000 7f7265800700 1 --2- 172.21.15.2:0/667199612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72601085f0 0x7f72601089d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:49.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.473+0000 7f7265800700 1 --2- 172.21.15.2:0/667199612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7260102ea0 0x7f726010f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:49.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.473+0000 7f7265800700 1 --2- 172.21.15.2:0/667199612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72601024e0 0x7f7260102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:49.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.473+0000 7f7265800700 1 -- 172.21.15.2:0/667199612 >> 172.21.15.2:0/667199612 conn(0x7f7260079640 msgr2=0x7f7260079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:49.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.473+0000 7f7265800700 1 -- 172.21.15.2:0/667199612 shutdown_connections 2024-06-13T11:20:49.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.473+0000 7f7265800700 1 -- 172.21.15.2:0/667199612 wait complete. 2024-06-13T11:20:49.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.474+0000 7f7265800700 1 Processor -- start 2024-06-13T11:20:49.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.475+0000 7f7265800700 1 -- start start 2024-06-13T11:20:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.475+0000 7f7265800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72601024e0 0x7f7260074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.475+0000 7f7265800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7260102ea0 0x7f7260074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.475+0000 7f7265800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72601085f0 0x7f7260075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.475+0000 7f7265800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7260112800 con 0x7f72601024e0 2024-06-13T11:20:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.475+0000 7f7265800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7260112680 con 0x7f7260102ea0 2024-06-13T11:20:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.475+0000 7f7265800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7260112980 con 0x7f72601085f0 2024-06-13T11:20:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.475+0000 7f725ea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72601024e0 0x7f7260074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.475+0000 7f725ea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72601024e0 0x7f7260074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38348/0 (socket says 172.21.15.2:38348) 2024-06-13T11:20:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.475+0000 7f725ea00700 1 -- 172.21.15.2:0/2084759893 learned_addr learned my addr 172.21.15.2:0/2084759893 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:20:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.475+0000 7f725f400700 1 --2- 172.21.15.2:0/2084759893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72601085f0 0x7f7260075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.476+0000 7f7256000700 1 --2- 172.21.15.2:0/2084759893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7260102ea0 0x7f7260074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.476+0000 7f725ea00700 1 -- 172.21.15.2:0/2084759893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72601085f0 msgr2=0x7f7260075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.476+0000 7f725ea00700 1 --2- 172.21.15.2:0/2084759893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72601085f0 0x7f7260075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:49.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.476+0000 7f725ea00700 1 -- 172.21.15.2:0/2084759893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7260102ea0 msgr2=0x7f7260074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:49.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.476+0000 7f725ea00700 1 --2- 172.21.15.2:0/2084759893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7260102ea0 0x7f7260074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:49.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.476+0000 7f725ea00700 1 -- 172.21.15.2:0/2084759893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72601a7230 con 0x7f72601024e0 2024-06-13T11:20:49.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.476+0000 7f725f400700 1 --2- 172.21.15.2:0/2084759893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72601085f0 0x7f7260075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:20:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.476+0000 7f7256000700 1 --2- 172.21.15.2:0/2084759893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7260102ea0 0x7f7260074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:20:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.476+0000 7f725ea00700 1 --2- 172.21.15.2:0/2084759893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72601024e0 0x7f7260074790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7250000c00 tx=0x7f725000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.477+0000 7f7257e00700 1 -- 172.21.15.2:0/2084759893 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250027070 con 0x7f72601024e0 2024-06-13T11:20:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.477+0000 7f7265800700 1 -- 172.21.15.2:0/2084759893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72601a74c0 con 0x7f72601024e0 2024-06-13T11:20:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.477+0000 7f7257e00700 1 -- 172.21.15.2:0/2084759893 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72500056d0 con 0x7f72601024e0 2024-06-13T11:20:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.477+0000 7f7257e00700 1 -- 172.21.15.2:0/2084759893 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250022e10 con 0x7f72601024e0 2024-06-13T11:20:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.477+0000 7f7265800700 1 -- 172.21.15.2:0/2084759893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72601a7970 con 0x7f72601024e0 2024-06-13T11:20:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.478+0000 7f7265800700 1 -- 172.21.15.2:0/2084759893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7260069180 con 0x7f72601024e0 2024-06-13T11:20:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.480+0000 7f7257e00700 1 -- 172.21.15.2:0/2084759893 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f725002a070 con 0x7f72601024e0 2024-06-13T11:20:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.482+0000 7f7257e00700 1 --2- 172.21.15.2:0/2084759893 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f72440a2cb0 0x7f72440a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.482+0000 7f7257e00700 1 -- 172.21.15.2:0/2084759893 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f72500d0200 con 0x7f72601024e0 2024-06-13T11:20:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.482+0000 7f7256000700 1 --2- 172.21.15.2:0/2084759893 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f72440a2cb0 0x7f72440a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.483+0000 7f7256000700 1 --2- 172.21.15.2:0/2084759893 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f72440a2cb0 0x7f72440a5170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7260079c60 tx=0x7f7248009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:49.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.487+0000 7f7257e00700 1 -- 172.21.15.2:0/2084759893 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7250013070 con 0x7f72601024e0 2024-06-13T11:20:49.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.729+0000 7f7265800700 1 -- 172.21.15.2:0/2084759893 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7260075c70 con 0x7f72440a2cb0 2024-06-13T11:20:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.741+0000 7f7257e00700 1 -- 172.21.15.2:0/2084759893 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340662 (secure 0 0 0) 0x7f7260075c70 con 0x7f72440a2cb0 2024-06-13T11:20:49.745 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:20:49.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.746+0000 7f7265800700 1 -- 172.21.15.2:0/2084759893 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f72440a2cb0 msgr2=0x7f72440a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:49.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.746+0000 7f7265800700 1 --2- 172.21.15.2:0/2084759893 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f72440a2cb0 0x7f72440a5170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7260079c60 tx=0x7f7248009260 comp rx=0 tx=0).stop 2024-06-13T11:20:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.746+0000 7f7265800700 1 -- 172.21.15.2:0/2084759893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72601024e0 msgr2=0x7f7260074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.746+0000 7f7265800700 1 --2- 172.21.15.2:0/2084759893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72601024e0 0x7f7260074790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7250000c00 tx=0x7f725000bab0 comp rx=0 tx=0).stop 2024-06-13T11:20:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.747+0000 7f7265800700 1 -- 172.21.15.2:0/2084759893 shutdown_connections 2024-06-13T11:20:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.747+0000 7f7265800700 1 --2- 172.21.15.2:0/2084759893 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f72440a2cb0 0x7f72440a5170 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.747+0000 7f7265800700 1 --2- 172.21.15.2:0/2084759893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72601024e0 0x7f7260074790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.747+0000 7f7265800700 1 --2- 172.21.15.2:0/2084759893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72601085f0 0x7f7260075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.747+0000 7f7265800700 1 --2- 172.21.15.2:0/2084759893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7260102ea0 0x7f7260074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.747+0000 7f7265800700 1 -- 172.21.15.2:0/2084759893 >> 172.21.15.2:0/2084759893 conn(0x7f7260079640 msgr2=0x7f7260101050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.747+0000 7f7265800700 1 -- 172.21.15.2:0/2084759893 shutdown_connections 2024-06-13T11:20:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:49.747+0000 7f7265800700 1 -- 172.21.15.2:0/2084759893 wait complete. 2024-06-13T11:20:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-06-13T11:20:50.529 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":401,"stamp":"2024-06-13T11:20:49.291147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658541,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":385,"num_read_kb":315,"num_write":353,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":284,"ondisk_log_size":284,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387456,"kb_used_data":13316,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124554368,"statfs":{"total":1151940427776,"available":1151543672832,"internally_reserved":0,"allocated":13635584,"data_stored":8787257,"data_compressed":498924,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11071,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":52,"num_write":7,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006034"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899729+0000","last_change":"2024-06-13T11:18:42.925351+0000","last_active":"2024-06-13T11:20:27.899729+0000","last_peered":"2024-06-13T11:20:27.899729+0000","last_clean":"2024-06-13T11:20:27.899729+0000","last_became_active":"2024-06-13T11:18:42.924971+0000","last_became_peered":"2024-06-13T11:18:42.924971+0000","last_unstale":"2024-06-13T11:20:27.899729+0000","last_undegraded":"2024-06-13T11:20:27.899729+0000","last_fullsized":"2024-06-13T11:20:27.899729+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:33:49.563311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.114559+0000","last_change":"2024-06-13T11:18:42.923771+0000","last_active":"2024-06-13T11:20:28.114559+0000","last_peered":"2024-06-13T11:20:28.114559+0000","last_clean":"2024-06-13T11:20:28.114559+0000","last_became_active":"2024-06-13T11:18:42.918410+0000","last_became_peered":"2024-06-13T11:18:42.918410+0000","last_unstale":"2024-06-13T11:20:28.114559+0000","last_undegraded":"2024-06-13T11:20:28.114559+0000","last_fullsized":"2024-06-13T11:20:28.114559+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:11:28.256622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.113910+0000","last_change":"2024-06-13T11:18:42.919502+0000","last_active":"2024-06-13T11:20:28.113910+0000","last_peered":"2024-06-13T11:20:28.113910+0000","last_clean":"2024-06-13T11:20:28.113910+0000","last_became_active":"2024-06-13T11:18:42.915747+0000","last_became_peered":"2024-06-13T11:18:42.915747+0000","last_unstale":"2024-06-13T11:20:28.113910+0000","last_undegraded":"2024-06-13T11:20:28.113910+0000","last_fullsized":"2024-06-13T11:20:28.113910+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:39:23.555604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529407+0000","last_change":"2024-06-13T11:18:42.905944+0000","last_active":"2024-06-13T11:20:27.529407+0000","last_peered":"2024-06-13T11:20:27.529407+0000","last_clean":"2024-06-13T11:20:27.529407+0000","last_became_active":"2024-06-13T11:18:42.905494+0000","last_became_peered":"2024-06-13T11:18:42.905494+0000","last_unstale":"2024-06-13T11:20:27.529407+0000","last_undegraded":"2024-06-13T11:20:27.529407+0000","last_fullsized":"2024-06-13T11:20:27.529407+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:26:44.396593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525766+0000","last_change":"2024-06-13T11:18:42.924212+0000","last_active":"2024-06-13T11:20:27.525766+0000","last_peered":"2024-06-13T11:20:27.525766+0000","last_clean":"2024-06-13T11:20:27.525766+0000","last_became_active":"2024-06-13T11:18:42.923848+0000","last_became_peered":"2024-06-13T11:18:42.923848+0000","last_unstale":"2024-06-13T11:20:27.525766+0000","last_undegraded":"2024-06-13T11:20:27.525766+0000","last_fullsized":"2024-06-13T11:20:27.525766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:01.754609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.799751+0000","last_change":"2024-06-13T11:18:42.915283+0000","last_active":"2024-06-13T11:20:27.799751+0000","last_peered":"2024-06-13T11:20:27.799751+0000","last_clean":"2024-06-13T11:20:27.799751+0000","last_became_active":"2024-06-13T11:18:42.914921+0000","last_became_peered":"2024-06-13T11:18:42.914921+0000","last_unstale":"2024-06-13T11:20:27.799751+0000","last_undegraded":"2024-06-13T11:20:27.799751+0000","last_fullsized":"2024-06-13T11:20:27.799751+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:48:42.116314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525478+0000","last_change":"2024-06-13T11:18:42.911614+0000","last_active":"2024-06-13T11:20:27.525478+0000","last_peered":"2024-06-13T11:20:27.525478+0000","last_clean":"2024-06-13T11:20:27.525478+0000","last_became_active":"2024-06-13T11:18:42.911360+0000","last_became_peered":"2024-06-13T11:18:42.911360+0000","last_unstale":"2024-06-13T11:20:27.525478+0000","last_undegraded":"2024-06-13T11:20:27.525478+0000","last_fullsized":"2024-06-13T11:20:27.525478+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:23:55.161725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.766180+0000","last_change":"2024-06-13T11:19:27.074801+0000","last_active":"2024-06-13T11:20:27.766180+0000","last_peered":"2024-06-13T11:20:27.766180+0000","last_clean":"2024-06-13T11:20:27.766180+0000","last_became_active":"2024-06-13T11:19:27.072783+0000","last_became_peered":"2024-06-13T11:19:27.072783+0000","last_unstale":"2024-06-13T11:20:27.766180+0000","last_undegraded":"2024-06-13T11:20:27.766180+0000","last_fullsized":"2024-06-13T11:20:27.766180+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:34.658008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899378+0000","last_change":"2024-06-13T11:18:42.913482+0000","last_active":"2024-06-13T11:20:27.899378+0000","last_peered":"2024-06-13T11:20:27.899378+0000","last_clean":"2024-06-13T11:20:27.899378+0000","last_became_active":"2024-06-13T11:18:42.912700+0000","last_became_peered":"2024-06-13T11:18:42.912700+0000","last_unstale":"2024-06-13T11:20:27.899378+0000","last_undegraded":"2024-06-13T11:20:27.899378+0000","last_fullsized":"2024-06-13T11:20:27.899378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:38:42.053801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.800198+0000","last_change":"2024-06-13T11:18:42.905824+0000","last_active":"2024-06-13T11:20:27.800198+0000","last_peered":"2024-06-13T11:20:27.800198+0000","last_clean":"2024-06-13T11:20:27.800198+0000","last_became_active":"2024-06-13T11:18:42.905443+0000","last_became_peered":"2024-06-13T11:18:42.905443+0000","last_unstale":"2024-06-13T11:20:27.800198+0000","last_undegraded":"2024-06-13T11:20:27.800198+0000","last_fullsized":"2024-06-13T11:20:27.800198+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:51:46.957656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525844+0000","last_change":"2024-06-13T11:18:42.901987+0000","last_active":"2024-06-13T11:20:27.525844+0000","last_peered":"2024-06-13T11:20:27.525844+0000","last_clean":"2024-06-13T11:20:27.525844+0000","last_became_active":"2024-06-13T11:18:42.901641+0000","last_became_peered":"2024-06-13T11:18:42.901641+0000","last_unstale":"2024-06-13T11:20:27.525844+0000","last_undegraded":"2024-06-13T11:20:27.525844+0000","last_fullsized":"2024-06-13T11:20:27.525844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:52:29.036172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529071+0000","last_change":"2024-06-13T11:18:42.899161+0000","last_active":"2024-06-13T11:20:27.529071+0000","last_peered":"2024-06-13T11:20:27.529071+0000","last_clean":"2024-06-13T11:20:27.529071+0000","last_became_active":"2024-06-13T11:18:42.898823+0000","last_became_peered":"2024-06-13T11:18:42.898823+0000","last_unstale":"2024-06-13T11:20:27.529071+0000","last_undegraded":"2024-06-13T11:20:27.529071+0000","last_fullsized":"2024-06-13T11:20:27.529071+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:21:20.968759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528238+0000","last_change":"2024-06-13T11:18:42.908954+0000","last_active":"2024-06-13T11:20:27.528238+0000","last_peered":"2024-06-13T11:20:27.528238+0000","last_clean":"2024-06-13T11:20:27.528238+0000","last_became_active":"2024-06-13T11:18:42.908604+0000","last_became_peered":"2024-06-13T11:18:42.908604+0000","last_unstale":"2024-06-13T11:20:27.528238+0000","last_undegraded":"2024-06-13T11:20:27.528238+0000","last_fullsized":"2024-06-13T11:20:27.528238+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:00:30.662233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.112806+0000","last_change":"2024-06-13T11:18:42.925374+0000","last_active":"2024-06-13T11:20:28.112806+0000","last_peered":"2024-06-13T11:20:28.112806+0000","last_clean":"2024-06-13T11:20:28.112806+0000","last_became_active":"2024-06-13T11:18:42.924624+0000","last_became_peered":"2024-06-13T11:18:42.924624+0000","last_unstale":"2024-06-13T11:20:28.112806+0000","last_undegraded":"2024-06-13T11:20:28.112806+0000","last_fullsized":"2024-06-13T11:20:28.112806+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:07.989887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.113136+0000","last_change":"2024-06-13T11:18:42.924457+0000","last_active":"2024-06-13T11:20:28.113136+0000","last_peered":"2024-06-13T11:20:28.113136+0000","last_clean":"2024-06-13T11:20:28.113136+0000","last_became_active":"2024-06-13T11:18:42.922641+0000","last_became_peered":"2024-06-13T11:18:42.922641+0000","last_unstale":"2024-06-13T11:20:28.113136+0000","last_undegraded":"2024-06-13T11:20:28.113136+0000","last_fullsized":"2024-06-13T11:20:28.113136+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:52:56.769565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.898696+0000","last_change":"2024-06-13T11:18:42.925333+0000","last_active":"2024-06-13T11:20:27.898696+0000","last_peered":"2024-06-13T11:20:27.898696+0000","last_clean":"2024-06-13T11:20:27.898696+0000","last_became_active":"2024-06-13T11:18:42.924854+0000","last_became_peered":"2024-06-13T11:18:42.924854+0000","last_unstale":"2024-06-13T11:20:27.898696+0000","last_undegraded":"2024-06-13T11:20:27.898696+0000","last_fullsized":"2024-06-13T11:20:27.898696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:30:38.554616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899571+0000","last_change":"2024-06-13T11:18:42.926652+0000","last_active":"2024-06-13T11:20:27.899571+0000","last_peered":"2024-06-13T11:20:27.899571+0000","last_clean":"2024-06-13T11:20:27.899571+0000","last_became_active":"2024-06-13T11:18:42.926281+0000","last_became_peered":"2024-06-13T11:18:42.926281+0000","last_unstale":"2024-06-13T11:20:27.899571+0000","last_undegraded":"2024-06-13T11:20:27.899571+0000","last_fullsized":"2024-06-13T11:20:27.899571+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:50:50.483047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767431+0000","last_change":"2024-06-13T11:18:42.917743+0000","last_active":"2024-06-13T11:20:27.767431+0000","last_peered":"2024-06-13T11:20:27.767431+0000","last_clean":"2024-06-13T11:20:27.767431+0000","last_became_active":"2024-06-13T11:18:42.916473+0000","last_became_peered":"2024-06-13T11:18:42.916473+0000","last_unstale":"2024-06-13T11:20:27.767431+0000","last_undegraded":"2024-06-13T11:20:27.767431+0000","last_fullsized":"2024-06-13T11:20:27.767431+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:20:12.909524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.531117+0000","last_change":"2024-06-13T11:18:42.930712+0000","last_active":"2024-06-13T11:20:27.531117+0000","last_peered":"2024-06-13T11:20:27.531117+0000","last_clean":"2024-06-13T11:20:27.531117+0000","last_became_active":"2024-06-13T11:18:42.930446+0000","last_became_peered":"2024-06-13T11:18:42.930446+0000","last_unstale":"2024-06-13T11:20:27.531117+0000","last_undegraded":"2024-06-13T11:20:27.531117+0000","last_fullsized":"2024-06-13T11:20:27.531117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:08:28.729916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.531307+0000","last_change":"2024-06-13T11:18:57.027006+0000","last_active":"2024-06-13T11:20:27.531307+0000","last_peered":"2024-06-13T11:20:27.531307+0000","last_clean":"2024-06-13T11:20:27.531307+0000","last_became_active":"2024-06-13T11:18:57.026562+0000","last_became_peered":"2024-06-13T11:18:57.026562+0000","last_unstale":"2024-06-13T11:20:27.531307+0000","last_undegraded":"2024-06-13T11:20:27.531307+0000","last_fullsized":"2024-06-13T11:20:27.531307+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:17:32.180729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"97'9","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767734+0000","last_change":"2024-06-13T11:18:38.172704+0000","last_active":"2024-06-13T11:20:27.767734+0000","last_peered":"2024-06-13T11:20:27.767734+0000","last_clean":"2024-06-13T11:20:27.767734+0000","last_became_active":"2024-06-13T11:18:38.172125+0000","last_became_peered":"2024-06-13T11:18:38.172125+0000","last_unstale":"2024-06-13T11:20:27.767734+0000","last_undegraded":"2024-06-13T11:20:27.767734+0000","last_fullsized":"2024-06-13T11:20:27.767734+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:40:52.578805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.903214+0000","last_change":"2024-06-13T11:18:42.922864+0000","last_active":"2024-06-13T11:20:27.903214+0000","last_peered":"2024-06-13T11:20:27.903214+0000","last_clean":"2024-06-13T11:20:27.903214+0000","last_became_active":"2024-06-13T11:18:42.921283+0000","last_became_peered":"2024-06-13T11:18:42.921283+0000","last_unstale":"2024-06-13T11:20:27.903214+0000","last_undegraded":"2024-06-13T11:20:27.903214+0000","last_fullsized":"2024-06-13T11:20:27.903214+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:44.421502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.904814+0000","last_change":"2024-06-13T11:20:27.904814+0000","last_active":"2024-06-13T11:20:27.904814+0000","last_peered":"2024-06-13T11:20:27.904814+0000","last_clean":"2024-06-13T11:20:27.904814+0000","last_became_active":"2024-06-13T11:20:27.904342+0000","last_became_peered":"2024-06-13T11:20:27.904342+0000","last_unstale":"2024-06-13T11:20:27.904814+0000","last_undegraded":"2024-06-13T11:20:27.904814+0000","last_fullsized":"2024-06-13T11:20:27.904814+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:45:59.215429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,10,3],"acting":[4,6,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.903753+0000","last_change":"2024-06-13T11:18:38.483021+0000","last_active":"2024-06-13T11:20:27.903753+0000","last_peered":"2024-06-13T11:20:27.903753+0000","last_clean":"2024-06-13T11:20:27.903753+0000","last_became_active":"2024-06-13T11:18:38.482594+0000","last_became_peered":"2024-06-13T11:18:38.482594+0000","last_unstale":"2024-06-13T11:20:27.903753+0000","last_undegraded":"2024-06-13T11:20:27.903753+0000","last_fullsized":"2024-06-13T11:20:27.903753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:27:07.660961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.114460+0000","last_change":"2024-06-13T11:18:42.926272+0000","last_active":"2024-06-13T11:20:28.114460+0000","last_peered":"2024-06-13T11:20:28.114460+0000","last_clean":"2024-06-13T11:20:28.114460+0000","last_became_active":"2024-06-13T11:18:42.925864+0000","last_became_peered":"2024-06-13T11:18:42.925864+0000","last_unstale":"2024-06-13T11:20:28.114460+0000","last_undegraded":"2024-06-13T11:20:28.114460+0000","last_fullsized":"2024-06-13T11:20:28.114460+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:51:59.562266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528907+0000","last_change":"2024-06-13T11:18:57.033152+0000","last_active":"2024-06-13T11:20:27.528907+0000","last_peered":"2024-06-13T11:20:27.528907+0000","last_clean":"2024-06-13T11:20:27.528907+0000","last_became_active":"2024-06-13T11:18:57.032696+0000","last_became_peered":"2024-06-13T11:18:57.032696+0000","last_unstale":"2024-06-13T11:20:27.528907+0000","last_undegraded":"2024-06-13T11:20:27.528907+0000","last_fullsized":"2024-06-13T11:20:27.528907+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:59:20.584476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'4","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526162+0000","last_change":"2024-06-13T11:18:38.168246+0000","last_active":"2024-06-13T11:20:27.526162+0000","last_peered":"2024-06-13T11:20:27.526162+0000","last_clean":"2024-06-13T11:20:27.526162+0000","last_became_active":"2024-06-13T11:18:38.167918+0000","last_became_peered":"2024-06-13T11:18:38.167918+0000","last_unstale":"2024-06-13T11:20:27.526162+0000","last_undegraded":"2024-06-13T11:20:27.526162+0000","last_fullsized":"2024-06-13T11:20:27.526162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:23:39.079356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.898934+0000","last_change":"2024-06-13T11:18:42.901291+0000","last_active":"2024-06-13T11:20:27.898934+0000","last_peered":"2024-06-13T11:20:27.898934+0000","last_clean":"2024-06-13T11:20:27.898934+0000","last_became_active":"2024-06-13T11:18:42.900990+0000","last_became_peered":"2024-06-13T11:18:42.900990+0000","last_unstale":"2024-06-13T11:20:27.898934+0000","last_undegraded":"2024-06-13T11:20:27.898934+0000","last_fullsized":"2024-06-13T11:20:27.898934+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:59:03.521767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.905640+0000","last_change":"2024-06-13T11:20:27.905640+0000","last_active":"2024-06-13T11:20:27.905640+0000","last_peered":"2024-06-13T11:20:27.905640+0000","last_clean":"2024-06-13T11:20:27.905640+0000","last_became_active":"2024-06-13T11:20:27.905149+0000","last_became_peered":"2024-06-13T11:20:27.905149+0000","last_unstale":"2024-06-13T11:20:27.905640+0000","last_undegraded":"2024-06-13T11:20:27.905640+0000","last_fullsized":"2024-06-13T11:20:27.905640+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:24:14.702582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526051+0000","last_change":"2024-06-13T11:18:38.170301+0000","last_active":"2024-06-13T11:20:27.526051+0000","last_peered":"2024-06-13T11:20:27.526051+0000","last_clean":"2024-06-13T11:20:27.526051+0000","last_became_active":"2024-06-13T11:18:38.169926+0000","last_became_peered":"2024-06-13T11:18:38.169926+0000","last_unstale":"2024-06-13T11:20:27.526051+0000","last_undegraded":"2024-06-13T11:20:27.526051+0000","last_fullsized":"2024-06-13T11:20:27.526051+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:02:02.877638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602732+0000","last_change":"2024-06-13T11:18:42.907869+0000","last_active":"2024-06-13T11:20:27.602732+0000","last_peered":"2024-06-13T11:20:27.602732+0000","last_clean":"2024-06-13T11:20:27.602732+0000","last_became_active":"2024-06-13T11:18:42.907349+0000","last_became_peered":"2024-06-13T11:18:42.907349+0000","last_unstale":"2024-06-13T11:20:27.602732+0000","last_undegraded":"2024-06-13T11:20:27.602732+0000","last_fullsized":"2024-06-13T11:20:27.602732+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:54:33.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.530909+0000","last_change":"2024-06-13T11:18:57.009598+0000","last_active":"2024-06-13T11:20:27.530909+0000","last_peered":"2024-06-13T11:20:27.530909+0000","last_clean":"2024-06-13T11:20:27.530909+0000","last_became_active":"2024-06-13T11:18:57.009186+0000","last_became_peered":"2024-06-13T11:18:57.009186+0000","last_unstale":"2024-06-13T11:20:27.530909+0000","last_undegraded":"2024-06-13T11:20:27.530909+0000","last_fullsized":"2024-06-13T11:20:27.530909+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:41:46.784749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"97'6","reported_seq":89,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:44.483042+0000","last_change":"2024-06-13T11:18:38.167060+0000","last_active":"2024-06-13T11:20:44.483042+0000","last_peered":"2024-06-13T11:20:44.483042+0000","last_clean":"2024-06-13T11:20:44.483042+0000","last_became_active":"2024-06-13T11:18:38.166704+0000","last_became_peered":"2024-06-13T11:18:38.166704+0000","last_unstale":"2024-06-13T11:20:44.483042+0000","last_undegraded":"2024-06-13T11:20:44.483042+0000","last_fullsized":"2024-06-13T11:20:44.483042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:30:51.754276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525627+0000","last_change":"2024-06-13T11:18:42.915361+0000","last_active":"2024-06-13T11:20:27.525627+0000","last_peered":"2024-06-13T11:20:27.525627+0000","last_clean":"2024-06-13T11:20:27.525627+0000","last_became_active":"2024-06-13T11:18:42.914977+0000","last_became_peered":"2024-06-13T11:18:42.914977+0000","last_unstale":"2024-06-13T11:20:27.525627+0000","last_undegraded":"2024-06-13T11:20:27.525627+0000","last_fullsized":"2024-06-13T11:20:27.525627+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:04:30.677548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.603953+0000","last_change":"2024-06-13T11:20:27.603953+0000","last_active":"2024-06-13T11:20:27.603953+0000","last_peered":"2024-06-13T11:20:27.603953+0000","last_clean":"2024-06-13T11:20:27.603953+0000","last_became_active":"2024-06-13T11:20:27.603306+0000","last_became_peered":"2024-06-13T11:20:27.603306+0000","last_unstale":"2024-06-13T11:20:27.603953+0000","last_undegraded":"2024-06-13T11:20:27.603953+0000","last_fullsized":"2024-06-13T11:20:27.603953+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:02:01.228984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'3","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.799597+0000","last_change":"2024-06-13T11:18:38.170126+0000","last_active":"2024-06-13T11:20:27.799597+0000","last_peered":"2024-06-13T11:20:27.799597+0000","last_clean":"2024-06-13T11:20:27.799597+0000","last_became_active":"2024-06-13T11:18:38.169736+0000","last_became_peered":"2024-06-13T11:18:38.169736+0000","last_unstale":"2024-06-13T11:20:27.799597+0000","last_undegraded":"2024-06-13T11:20:27.799597+0000","last_fullsized":"2024-06-13T11:20:27.799597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:07:22.778093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602550+0000","last_change":"2024-06-13T11:18:42.929004+0000","last_active":"2024-06-13T11:20:27.602550+0000","last_peered":"2024-06-13T11:20:27.602550+0000","last_clean":"2024-06-13T11:20:27.602550+0000","last_became_active":"2024-06-13T11:18:42.928579+0000","last_became_peered":"2024-06-13T11:18:42.928579+0000","last_unstale":"2024-06-13T11:20:27.602550+0000","last_undegraded":"2024-06-13T11:20:27.602550+0000","last_fullsized":"2024-06-13T11:20:27.602550+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:31:15.703033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899556+0000","last_change":"2024-06-13T11:18:57.031059+0000","last_active":"2024-06-13T11:20:27.899556+0000","last_peered":"2024-06-13T11:20:27.899556+0000","last_clean":"2024-06-13T11:20:27.899556+0000","last_became_active":"2024-06-13T11:18:57.030723+0000","last_became_peered":"2024-06-13T11:18:57.030723+0000","last_unstale":"2024-06-13T11:20:27.899556+0000","last_undegraded":"2024-06-13T11:20:27.899556+0000","last_fullsized":"2024-06-13T11:20:27.899556+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:19:36.883790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.527530+0000","last_change":"2024-06-13T11:18:38.175189+0000","last_active":"2024-06-13T11:20:27.527530+0000","last_peered":"2024-06-13T11:20:27.527530+0000","last_clean":"2024-06-13T11:20:27.527530+0000","last_became_active":"2024-06-13T11:18:38.173817+0000","last_became_peered":"2024-06-13T11:18:38.173817+0000","last_unstale":"2024-06-13T11:20:27.527530+0000","last_undegraded":"2024-06-13T11:20:27.527530+0000","last_fullsized":"2024-06-13T11:20:27.527530+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:02:18.422449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.903095+0000","last_change":"2024-06-13T11:18:42.920665+0000","last_active":"2024-06-13T11:20:27.903095+0000","last_peered":"2024-06-13T11:20:27.903095+0000","last_clean":"2024-06-13T11:20:27.903095+0000","last_became_active":"2024-06-13T11:18:42.919461+0000","last_became_peered":"2024-06-13T11:18:42.919461+0000","last_unstale":"2024-06-13T11:20:27.903095+0000","last_undegraded":"2024-06-13T11:20:27.903095+0000","last_fullsized":"2024-06-13T11:20:27.903095+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:56:23.042481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.113898+0000","last_change":"2024-06-13T11:18:57.025822+0000","last_active":"2024-06-13T11:20:28.113898+0000","last_peered":"2024-06-13T11:20:28.113898+0000","last_clean":"2024-06-13T11:20:28.113898+0000","last_became_active":"2024-06-13T11:18:57.025408+0000","last_became_peered":"2024-06-13T11:18:57.025408+0000","last_unstale":"2024-06-13T11:20:28.113898+0000","last_undegraded":"2024-06-13T11:20:28.113898+0000","last_fullsized":"2024-06-13T11:20:28.113898+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:39:28.295433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'1","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.601935+0000","last_change":"2024-06-13T11:18:38.168097+0000","last_active":"2024-06-13T11:20:27.601935+0000","last_peered":"2024-06-13T11:20:27.601935+0000","last_clean":"2024-06-13T11:20:27.601935+0000","last_became_active":"2024-06-13T11:18:38.167812+0000","last_became_peered":"2024-06-13T11:18:38.167812+0000","last_unstale":"2024-06-13T11:20:27.601935+0000","last_undegraded":"2024-06-13T11:20:27.601935+0000","last_fullsized":"2024-06-13T11:20:27.601935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:24:20.247579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.766698+0000","last_change":"2024-06-13T11:18:42.932941+0000","last_active":"2024-06-13T11:20:27.766698+0000","last_peered":"2024-06-13T11:20:27.766698+0000","last_clean":"2024-06-13T11:20:27.766698+0000","last_became_active":"2024-06-13T11:18:42.931942+0000","last_became_peered":"2024-06-13T11:18:42.931942+0000","last_unstale":"2024-06-13T11:20:27.766698+0000","last_undegraded":"2024-06-13T11:20:27.766698+0000","last_fullsized":"2024-06-13T11:20:27.766698+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:12:38.625753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.902278+0000","last_change":"2024-06-13T11:18:57.026834+0000","last_active":"2024-06-13T11:20:27.902278+0000","last_peered":"2024-06-13T11:20:27.902278+0000","last_clean":"2024-06-13T11:20:27.902278+0000","last_became_active":"2024-06-13T11:18:57.026401+0000","last_became_peered":"2024-06-13T11:18:57.026401+0000","last_unstale":"2024-06-13T11:20:27.902278+0000","last_undegraded":"2024-06-13T11:20:27.902278+0000","last_fullsized":"2024-06-13T11:20:27.902278+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:11:19.993946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"97'3","reported_seq":84,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:45.483587+0000","last_change":"2024-06-13T11:18:38.172648+0000","last_active":"2024-06-13T11:20:45.483587+0000","last_peered":"2024-06-13T11:20:45.483587+0000","last_clean":"2024-06-13T11:20:45.483587+0000","last_became_active":"2024-06-13T11:18:38.172311+0000","last_became_peered":"2024-06-13T11:18:38.172311+0000","last_unstale":"2024-06-13T11:20:45.483587+0000","last_undegraded":"2024-06-13T11:20:45.483587+0000","last_fullsized":"2024-06-13T11:20:45.483587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:59:10.620378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899331+0000","last_change":"2024-06-13T11:18:42.920352+0000","last_active":"2024-06-13T11:20:27.899331+0000","last_peered":"2024-06-13T11:20:27.899331+0000","last_clean":"2024-06-13T11:20:27.899331+0000","last_became_active":"2024-06-13T11:18:42.919969+0000","last_became_peered":"2024-06-13T11:18:42.919969+0000","last_unstale":"2024-06-13T11:20:27.899331+0000","last_undegraded":"2024-06-13T11:20:27.899331+0000","last_fullsized":"2024-06-13T11:20:27.899331+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:10:59.832735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.766418+0000","last_change":"2024-06-13T11:18:57.034774+0000","last_active":"2024-06-13T11:20:27.766418+0000","last_peered":"2024-06-13T11:20:27.766418+0000","last_clean":"2024-06-13T11:20:27.766418+0000","last_became_active":"2024-06-13T11:18:57.031812+0000","last_became_peered":"2024-06-13T11:18:57.031812+0000","last_unstale":"2024-06-13T11:20:27.766418+0000","last_undegraded":"2024-06-13T11:20:27.766418+0000","last_fullsized":"2024-06-13T11:20:27.766418+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:26.195958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525940+0000","last_change":"2024-06-13T11:18:38.168169+0000","last_active":"2024-06-13T11:20:27.525940+0000","last_peered":"2024-06-13T11:20:27.525940+0000","last_clean":"2024-06-13T11:20:27.525940+0000","last_became_active":"2024-06-13T11:18:38.167791+0000","last_became_peered":"2024-06-13T11:18:38.167791+0000","last_unstale":"2024-06-13T11:20:27.525940+0000","last_undegraded":"2024-06-13T11:20:27.525940+0000","last_fullsized":"2024-06-13T11:20:27.525940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:04.879468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.114053+0000","last_change":"2024-06-13T11:19:27.077888+0000","last_active":"2024-06-13T11:20:28.114053+0000","last_peered":"2024-06-13T11:20:28.114053+0000","last_clean":"2024-06-13T11:20:28.114053+0000","last_became_active":"2024-06-13T11:19:27.075904+0000","last_became_peered":"2024-06-13T11:19:27.075904+0000","last_unstale":"2024-06-13T11:20:28.114053+0000","last_undegraded":"2024-06-13T11:20:28.114053+0000","last_fullsized":"2024-06-13T11:20:28.114053+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:59.920163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529053+0000","last_change":"2024-06-13T11:19:27.073568+0000","last_active":"2024-06-13T11:20:27.529053+0000","last_peered":"2024-06-13T11:20:27.529053+0000","last_clean":"2024-06-13T11:20:27.529053+0000","last_became_active":"2024-06-13T11:19:27.072954+0000","last_became_peered":"2024-06-13T11:19:27.072954+0000","last_unstale":"2024-06-13T11:20:27.529053+0000","last_undegraded":"2024-06-13T11:20:27.529053+0000","last_fullsized":"2024-06-13T11:20:27.529053+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:10:25.492093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602717+0000","last_change":"2024-06-13T11:18:38.482021+0000","last_active":"2024-06-13T11:20:27.602717+0000","last_peered":"2024-06-13T11:20:27.602717+0000","last_clean":"2024-06-13T11:20:27.602717+0000","last_became_active":"2024-06-13T11:18:38.481574+0000","last_became_peered":"2024-06-13T11:18:38.481574+0000","last_unstale":"2024-06-13T11:20:27.602717+0000","last_undegraded":"2024-06-13T11:20:27.602717+0000","last_fullsized":"2024-06-13T11:20:27.602717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:50:54.297559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899093+0000","last_change":"2024-06-13T11:19:27.072380+0000","last_active":"2024-06-13T11:20:27.899093+0000","last_peered":"2024-06-13T11:20:27.899093+0000","last_clean":"2024-06-13T11:20:27.899093+0000","last_became_active":"2024-06-13T11:19:27.072027+0000","last_became_peered":"2024-06-13T11:19:27.072027+0000","last_unstale":"2024-06-13T11:20:27.899093+0000","last_undegraded":"2024-06-13T11:20:27.899093+0000","last_fullsized":"2024-06-13T11:20:27.899093+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:37:10.455890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.766792+0000","last_change":"2024-06-13T11:18:57.028370+0000","last_active":"2024-06-13T11:20:27.766792+0000","last_peered":"2024-06-13T11:20:27.766792+0000","last_clean":"2024-06-13T11:20:27.766792+0000","last_became_active":"2024-06-13T11:18:57.023478+0000","last_became_peered":"2024-06-13T11:18:57.023478+0000","last_unstale":"2024-06-13T11:20:27.766792+0000","last_undegraded":"2024-06-13T11:20:27.766792+0000","last_fullsized":"2024-06-13T11:20:27.766792+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:25:01.237698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"99'34","reported_seq":161,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:46.484970+0000","last_change":"2024-06-13T11:18:38.169179+0000","last_active":"2024-06-13T11:20:46.484970+0000","last_peered":"2024-06-13T11:20:46.484970+0000","last_clean":"2024-06-13T11:20:46.484970+0000","last_became_active":"2024-06-13T11:18:38.168775+0000","last_became_peered":"2024-06-13T11:18:38.168775+0000","last_unstale":"2024-06-13T11:20:46.484970+0000","last_undegraded":"2024-06-13T11:20:46.484970+0000","last_fullsized":"2024-06-13T11:20:46.484970+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:53:39.290755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63549,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":83,"num_read_kb":103,"num_write":35,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525918+0000","last_change":"2024-06-13T11:18:42.903744+0000","last_active":"2024-06-13T11:20:27.525918+0000","last_peered":"2024-06-13T11:20:27.525918+0000","last_clean":"2024-06-13T11:20:27.525918+0000","last_became_active":"2024-06-13T11:18:42.903410+0000","last_became_peered":"2024-06-13T11:18:42.903410+0000","last_unstale":"2024-06-13T11:20:27.525918+0000","last_undegraded":"2024-06-13T11:20:27.525918+0000","last_fullsized":"2024-06-13T11:20:27.525918+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:17:55.975517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.603245+0000","last_change":"2024-06-13T11:18:57.026052+0000","last_active":"2024-06-13T11:20:27.603245+0000","last_peered":"2024-06-13T11:20:27.603245+0000","last_clean":"2024-06-13T11:20:27.603245+0000","last_became_active":"2024-06-13T11:18:57.025677+0000","last_became_peered":"2024-06-13T11:18:57.025677+0000","last_unstale":"2024-06-13T11:20:27.603245+0000","last_undegraded":"2024-06-13T11:20:27.603245+0000","last_fullsized":"2024-06-13T11:20:27.603245+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:41.061675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'6","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.530944+0000","last_change":"2024-06-13T11:18:38.166672+0000","last_active":"2024-06-13T11:20:27.530944+0000","last_peered":"2024-06-13T11:20:27.530944+0000","last_clean":"2024-06-13T11:20:27.530944+0000","last_became_active":"2024-06-13T11:18:38.165923+0000","last_became_peered":"2024-06-13T11:18:38.165923+0000","last_unstale":"2024-06-13T11:20:27.530944+0000","last_undegraded":"2024-06-13T11:20:27.530944+0000","last_fullsized":"2024-06-13T11:20:27.530944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:54:00.989462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.527446+0000","last_change":"2024-06-13T11:18:42.919280+0000","last_active":"2024-06-13T11:20:27.527446+0000","last_peered":"2024-06-13T11:20:27.527446+0000","last_clean":"2024-06-13T11:20:27.527446+0000","last_became_active":"2024-06-13T11:18:42.917421+0000","last_became_peered":"2024-06-13T11:18:42.917421+0000","last_unstale":"2024-06-13T11:20:27.527446+0000","last_undegraded":"2024-06-13T11:20:27.527446+0000","last_fullsized":"2024-06-13T11:20:27.527446+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:52:23.765290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899244+0000","last_change":"2024-06-13T11:18:57.031244+0000","last_active":"2024-06-13T11:20:27.899244+0000","last_peered":"2024-06-13T11:20:27.899244+0000","last_clean":"2024-06-13T11:20:27.899244+0000","last_became_active":"2024-06-13T11:18:57.030781+0000","last_became_peered":"2024-06-13T11:18:57.030781+0000","last_unstale":"2024-06-13T11:20:27.899244+0000","last_undegraded":"2024-06-13T11:20:27.899244+0000","last_fullsized":"2024-06-13T11:20:27.899244+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:19:51.722256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'3","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602509+0000","last_change":"2024-06-13T11:18:38.171060+0000","last_active":"2024-06-13T11:20:27.602509+0000","last_peered":"2024-06-13T11:20:27.602509+0000","last_clean":"2024-06-13T11:20:27.602509+0000","last_became_active":"2024-06-13T11:18:38.170682+0000","last_became_peered":"2024-06-13T11:18:38.170682+0000","last_unstale":"2024-06-13T11:20:27.602509+0000","last_undegraded":"2024-06-13T11:20:27.602509+0000","last_fullsized":"2024-06-13T11:20:27.602509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:05:53.157074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525716+0000","last_change":"2024-06-13T11:18:42.902700+0000","last_active":"2024-06-13T11:20:27.525716+0000","last_peered":"2024-06-13T11:20:27.525716+0000","last_clean":"2024-06-13T11:20:27.525716+0000","last_became_active":"2024-06-13T11:18:42.902351+0000","last_became_peered":"2024-06-13T11:18:42.902351+0000","last_unstale":"2024-06-13T11:20:27.525716+0000","last_undegraded":"2024-06-13T11:20:27.525716+0000","last_fullsized":"2024-06-13T11:20:27.525716+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:55:16.769324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767243+0000","last_change":"2024-06-13T11:18:57.034840+0000","last_active":"2024-06-13T11:20:27.767243+0000","last_peered":"2024-06-13T11:20:27.767243+0000","last_clean":"2024-06-13T11:20:27.767243+0000","last_became_active":"2024-06-13T11:18:57.033552+0000","last_became_peered":"2024-06-13T11:18:57.033552+0000","last_unstale":"2024-06-13T11:20:27.767243+0000","last_undegraded":"2024-06-13T11:20:27.767243+0000","last_fullsized":"2024-06-13T11:20:27.767243+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:44:25.463043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"97'4","reported_seq":88,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:45.508695+0000","last_change":"2024-06-13T11:18:38.170644+0000","last_active":"2024-06-13T11:20:45.508695+0000","last_peered":"2024-06-13T11:20:45.508695+0000","last_clean":"2024-06-13T11:20:45.508695+0000","last_became_active":"2024-06-13T11:18:38.169986+0000","last_became_peered":"2024-06-13T11:18:38.169986+0000","last_unstale":"2024-06-13T11:20:45.508695+0000","last_undegraded":"2024-06-13T11:20:45.508695+0000","last_fullsized":"2024-06-13T11:20:45.508695+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:45:48.817898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525848+0000","last_change":"2024-06-13T11:18:42.903465+0000","last_active":"2024-06-13T11:20:27.525848+0000","last_peered":"2024-06-13T11:20:27.525848+0000","last_clean":"2024-06-13T11:20:27.525848+0000","last_became_active":"2024-06-13T11:18:42.903001+0000","last_became_peered":"2024-06-13T11:18:42.903001+0000","last_unstale":"2024-06-13T11:20:27.525848+0000","last_undegraded":"2024-06-13T11:20:27.525848+0000","last_fullsized":"2024-06-13T11:20:27.525848+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:25:24.331890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529269+0000","last_change":"2024-06-13T11:18:57.033966+0000","last_active":"2024-06-13T11:20:27.529269+0000","last_peered":"2024-06-13T11:20:27.529269+0000","last_clean":"2024-06-13T11:20:27.529269+0000","last_became_active":"2024-06-13T11:18:57.032448+0000","last_became_peered":"2024-06-13T11:18:57.032448+0000","last_unstale":"2024-06-13T11:20:27.529269+0000","last_undegraded":"2024-06-13T11:20:27.529269+0000","last_fullsized":"2024-06-13T11:20:27.529269+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:51:40.473020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'15","reported_seq":60,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525540+0000","last_change":"2024-06-13T11:18:38.483204+0000","last_active":"2024-06-13T11:20:27.525540+0000","last_peered":"2024-06-13T11:20:27.525540+0000","last_clean":"2024-06-13T11:20:27.525540+0000","last_became_active":"2024-06-13T11:18:38.482800+0000","last_became_peered":"2024-06-13T11:18:38.482800+0000","last_unstale":"2024-06-13T11:20:27.525540+0000","last_undegraded":"2024-06-13T11:20:27.525540+0000","last_fullsized":"2024-06-13T11:20:27.525540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:28:44.636201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602182+0000","last_change":"2024-06-13T11:18:42.899944+0000","last_active":"2024-06-13T11:20:27.602182+0000","last_peered":"2024-06-13T11:20:27.602182+0000","last_clean":"2024-06-13T11:20:27.602182+0000","last_became_active":"2024-06-13T11:18:42.899551+0000","last_became_peered":"2024-06-13T11:18:42.899551+0000","last_unstale":"2024-06-13T11:20:27.602182+0000","last_undegraded":"2024-06-13T11:20:27.602182+0000","last_fullsized":"2024-06-13T11:20:27.602182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:18:21.109043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602118+0000","last_change":"2024-06-13T11:18:57.028817+0000","last_active":"2024-06-13T11:20:27.602118+0000","last_peered":"2024-06-13T11:20:27.602118+0000","last_clean":"2024-06-13T11:20:27.602118+0000","last_became_active":"2024-06-13T11:18:57.028433+0000","last_became_peered":"2024-06-13T11:18:57.028433+0000","last_unstale":"2024-06-13T11:20:27.602118+0000","last_undegraded":"2024-06-13T11:20:27.602118+0000","last_fullsized":"2024-06-13T11:20:27.602118+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:56:24.180096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526169+0000","last_change":"2024-06-13T11:18:38.165907+0000","last_active":"2024-06-13T11:20:27.526169+0000","last_peered":"2024-06-13T11:20:27.526169+0000","last_clean":"2024-06-13T11:20:27.526169+0000","last_became_active":"2024-06-13T11:18:38.165516+0000","last_became_peered":"2024-06-13T11:18:38.165516+0000","last_unstale":"2024-06-13T11:20:27.526169+0000","last_undegraded":"2024-06-13T11:20:27.526169+0000","last_fullsized":"2024-06-13T11:20:27.526169+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:51:15.774967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899515+0000","last_change":"2024-06-13T11:19:27.004377+0000","last_active":"2024-06-13T11:20:27.899515+0000","last_peered":"2024-06-13T11:20:27.899515+0000","last_clean":"2024-06-13T11:20:27.899515+0000","last_became_active":"2024-06-13T11:19:27.003954+0000","last_became_peered":"2024-06-13T11:19:27.003954+0000","last_unstale":"2024-06-13T11:20:27.899515+0000","last_undegraded":"2024-06-13T11:20:27.899515+0000","last_fullsized":"2024-06-13T11:20:27.899515+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:53:25.967036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525596+0000","last_change":"2024-06-13T11:18:57.184912+0000","last_active":"2024-06-13T11:20:27.525596+0000","last_peered":"2024-06-13T11:20:27.525596+0000","last_clean":"2024-06-13T11:20:27.525596+0000","last_became_active":"2024-06-13T11:18:57.184442+0000","last_became_peered":"2024-06-13T11:18:57.184442+0000","last_unstale":"2024-06-13T11:20:27.525596+0000","last_undegraded":"2024-06-13T11:20:27.525596+0000","last_fullsized":"2024-06-13T11:20:27.525596+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:47:17.961086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767283+0000","last_change":"2024-06-13T11:18:38.484487+0000","last_active":"2024-06-13T11:20:27.767283+0000","last_peered":"2024-06-13T11:20:27.767283+0000","last_clean":"2024-06-13T11:20:27.767283+0000","last_became_active":"2024-06-13T11:18:38.483587+0000","last_became_peered":"2024-06-13T11:18:38.483587+0000","last_unstale":"2024-06-13T11:20:27.767283+0000","last_undegraded":"2024-06-13T11:20:27.767283+0000","last_fullsized":"2024-06-13T11:20:27.767283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:50:19.773340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.800002+0000","last_change":"2024-06-13T11:18:42.913275+0000","last_active":"2024-06-13T11:20:27.800002+0000","last_peered":"2024-06-13T11:20:27.800002+0000","last_clean":"2024-06-13T11:20:27.800002+0000","last_became_active":"2024-06-13T11:18:42.912880+0000","last_became_peered":"2024-06-13T11:18:42.912880+0000","last_unstale":"2024-06-13T11:20:27.800002+0000","last_undegraded":"2024-06-13T11:20:27.800002+0000","last_fullsized":"2024-06-13T11:20:27.800002+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:01:55.261976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528761+0000","last_change":"2024-06-13T11:18:57.027893+0000","last_active":"2024-06-13T11:20:27.528761+0000","last_peered":"2024-06-13T11:20:27.528761+0000","last_clean":"2024-06-13T11:20:27.528761+0000","last_became_active":"2024-06-13T11:18:57.025683+0000","last_became_peered":"2024-06-13T11:18:57.025683+0000","last_unstale":"2024-06-13T11:20:27.528761+0000","last_undegraded":"2024-06-13T11:20:27.528761+0000","last_fullsized":"2024-06-13T11:20:27.528761+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:25:59.348570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526081+0000","last_change":"2024-06-13T11:18:38.167932+0000","last_active":"2024-06-13T11:20:27.526081+0000","last_peered":"2024-06-13T11:20:27.526081+0000","last_clean":"2024-06-13T11:20:27.526081+0000","last_became_active":"2024-06-13T11:18:38.167520+0000","last_became_peered":"2024-06-13T11:18:38.167520+0000","last_unstale":"2024-06-13T11:20:27.526081+0000","last_undegraded":"2024-06-13T11:20:27.526081+0000","last_fullsized":"2024-06-13T11:20:27.526081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:00:04.537091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.799637+0000","last_change":"2024-06-13T11:18:42.923211+0000","last_active":"2024-06-13T11:20:27.799637+0000","last_peered":"2024-06-13T11:20:27.799637+0000","last_clean":"2024-06-13T11:20:27.799637+0000","last_became_active":"2024-06-13T11:18:42.922858+0000","last_became_peered":"2024-06-13T11:18:42.922858+0000","last_unstale":"2024-06-13T11:20:27.799637+0000","last_undegraded":"2024-06-13T11:20:27.799637+0000","last_fullsized":"2024-06-13T11:20:27.799637+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:56:18.163502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528719+0000","last_change":"2024-06-13T11:18:57.185071+0000","last_active":"2024-06-13T11:20:27.528719+0000","last_peered":"2024-06-13T11:20:27.528719+0000","last_clean":"2024-06-13T11:20:27.528719+0000","last_became_active":"2024-06-13T11:18:57.184526+0000","last_became_peered":"2024-06-13T11:18:57.184526+0000","last_unstale":"2024-06-13T11:20:27.528719+0000","last_undegraded":"2024-06-13T11:20:27.528719+0000","last_fullsized":"2024-06-13T11:20:27.528719+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:51:37.715832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602309+0000","last_change":"2024-06-13T11:18:42.912483+0000","last_active":"2024-06-13T11:20:27.602309+0000","last_peered":"2024-06-13T11:20:27.602309+0000","last_clean":"2024-06-13T11:20:27.602309+0000","last_became_active":"2024-06-13T11:18:42.912117+0000","last_became_peered":"2024-06-13T11:18:42.912117+0000","last_unstale":"2024-06-13T11:20:27.602309+0000","last_undegraded":"2024-06-13T11:20:27.602309+0000","last_fullsized":"2024-06-13T11:20:27.602309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:23.769097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"97'4","reported_seq":85,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:45.508211+0000","last_change":"2024-06-13T11:18:38.483334+0000","last_active":"2024-06-13T11:20:45.508211+0000","last_peered":"2024-06-13T11:20:45.508211+0000","last_clean":"2024-06-13T11:20:45.508211+0000","last_became_active":"2024-06-13T11:18:38.482885+0000","last_became_peered":"2024-06-13T11:18:38.482885+0000","last_unstale":"2024-06-13T11:20:45.508211+0000","last_undegraded":"2024-06-13T11:20:45.508211+0000","last_fullsized":"2024-06-13T11:20:45.508211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:55:19.986526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"97'1","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525681+0000","last_change":"2024-06-13T11:18:57.016960+0000","last_active":"2024-06-13T11:20:27.525681+0000","last_peered":"2024-06-13T11:20:27.525681+0000","last_clean":"2024-06-13T11:20:27.525681+0000","last_became_active":"2024-06-13T11:18:57.016490+0000","last_became_peered":"2024-06-13T11:18:57.016490+0000","last_unstale":"2024-06-13T11:20:27.525681+0000","last_undegraded":"2024-06-13T11:20:27.525681+0000","last_fullsized":"2024-06-13T11:20:27.525681+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:40:19.796594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.903398+0000","last_change":"2024-06-13T11:18:42.921581+0000","last_active":"2024-06-13T11:20:27.903398+0000","last_peered":"2024-06-13T11:20:27.903398+0000","last_clean":"2024-06-13T11:20:27.903398+0000","last_became_active":"2024-06-13T11:18:42.917820+0000","last_became_peered":"2024-06-13T11:18:42.917820+0000","last_unstale":"2024-06-13T11:20:27.903398+0000","last_undegraded":"2024-06-13T11:20:27.903398+0000","last_fullsized":"2024-06-13T11:20:27.903398+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:59:28.460363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'3","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528941+0000","last_change":"2024-06-13T11:18:38.168111+0000","last_active":"2024-06-13T11:20:27.528941+0000","last_peered":"2024-06-13T11:20:27.528941+0000","last_clean":"2024-06-13T11:20:27.528941+0000","last_became_active":"2024-06-13T11:18:38.167732+0000","last_became_peered":"2024-06-13T11:18:38.167732+0000","last_unstale":"2024-06-13T11:20:27.528941+0000","last_undegraded":"2024-06-13T11:20:27.528941+0000","last_fullsized":"2024-06-13T11:20:27.528941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:36:55.993553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":377,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525428+0000","last_change":"2024-06-13T11:17:06.317849+0000","last_active":"2024-06-13T11:20:27.525428+0000","last_peered":"2024-06-13T11:20:27.525428+0000","last_clean":"2024-06-13T11:20:27.525428+0000","last_became_active":"2024-06-13T11:17:06.317293+0000","last_became_peered":"2024-06-13T11:17:06.317293+0000","last_unstale":"2024-06-13T11:20:27.525428+0000","last_undegraded":"2024-06-13T11:20:27.525428+0000","last_fullsized":"2024-06-13T11:20:27.525428+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:13:14.002581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:13:14.002581+0000","last_clean_scrub_stamp":"2024-06-13T11:13:14.002581+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:54:32.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602807+0000","last_change":"2024-06-13T11:18:57.185880+0000","last_active":"2024-06-13T11:20:27.602807+0000","last_peered":"2024-06-13T11:20:27.602807+0000","last_clean":"2024-06-13T11:20:27.602807+0000","last_became_active":"2024-06-13T11:18:57.185140+0000","last_became_peered":"2024-06-13T11:18:57.185140+0000","last_unstale":"2024-06-13T11:20:27.602807+0000","last_undegraded":"2024-06-13T11:20:27.602807+0000","last_fullsized":"2024-06-13T11:20:27.602807+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:43:40.195809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.527128+0000","last_change":"2024-06-13T11:19:27.006408+0000","last_active":"2024-06-13T11:20:27.527128+0000","last_peered":"2024-06-13T11:20:27.527128+0000","last_clean":"2024-06-13T11:20:27.527128+0000","last_became_active":"2024-06-13T11:19:27.005525+0000","last_became_peered":"2024-06-13T11:19:27.005525+0000","last_unstale":"2024-06-13T11:20:27.527128+0000","last_undegraded":"2024-06-13T11:20:27.527128+0000","last_fullsized":"2024-06-13T11:20:27.527128+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:09:39.891543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525753+0000","last_change":"2024-06-13T11:18:38.171089+0000","last_active":"2024-06-13T11:20:27.525753+0000","last_peered":"2024-06-13T11:20:27.525753+0000","last_clean":"2024-06-13T11:20:27.525753+0000","last_became_active":"2024-06-13T11:18:38.170769+0000","last_became_peered":"2024-06-13T11:18:38.170769+0000","last_unstale":"2024-06-13T11:20:27.525753+0000","last_undegraded":"2024-06-13T11:20:27.525753+0000","last_fullsized":"2024-06-13T11:20:27.525753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:07:46.355159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899192+0000","last_change":"2024-06-13T11:18:57.015609+0000","last_active":"2024-06-13T11:20:27.899192+0000","last_peered":"2024-06-13T11:20:27.899192+0000","last_clean":"2024-06-13T11:20:27.899192+0000","last_became_active":"2024-06-13T11:18:57.015164+0000","last_became_peered":"2024-06-13T11:18:57.015164+0000","last_unstale":"2024-06-13T11:20:27.899192+0000","last_undegraded":"2024-06-13T11:20:27.899192+0000","last_fullsized":"2024-06-13T11:20:27.899192+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:32:15.725778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'1","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526065+0000","last_change":"2024-06-13T11:18:38.483215+0000","last_active":"2024-06-13T11:20:27.526065+0000","last_peered":"2024-06-13T11:20:27.526065+0000","last_clean":"2024-06-13T11:20:27.526065+0000","last_became_active":"2024-06-13T11:18:38.482789+0000","last_became_peered":"2024-06-13T11:18:38.482789+0000","last_unstale":"2024-06-13T11:20:27.526065+0000","last_undegraded":"2024-06-13T11:20:27.526065+0000","last_fullsized":"2024-06-13T11:20:27.526065+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:01:58.020310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528232+0000","last_change":"2024-06-13T11:18:42.914846+0000","last_active":"2024-06-13T11:20:27.528232+0000","last_peered":"2024-06-13T11:20:27.528232+0000","last_clean":"2024-06-13T11:20:27.528232+0000","last_became_active":"2024-06-13T11:18:42.912614+0000","last_became_peered":"2024-06-13T11:18:42.912614+0000","last_unstale":"2024-06-13T11:20:27.528232+0000","last_undegraded":"2024-06-13T11:20:27.528232+0000","last_fullsized":"2024-06-13T11:20:27.528232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:00:13.066079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.902666+0000","last_change":"2024-06-13T11:18:57.185117+0000","last_active":"2024-06-13T11:20:27.902666+0000","last_peered":"2024-06-13T11:20:27.902666+0000","last_clean":"2024-06-13T11:20:27.902666+0000","last_became_active":"2024-06-13T11:18:57.184498+0000","last_became_peered":"2024-06-13T11:18:57.184498+0000","last_unstale":"2024-06-13T11:20:27.902666+0000","last_undegraded":"2024-06-13T11:20:27.902666+0000","last_fullsized":"2024-06-13T11:20:27.902666+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:04:28.800984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"99'11","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:35.919769+0000","last_change":"2024-06-13T11:18:38.176918+0000","last_active":"2024-06-13T11:20:35.919769+0000","last_peered":"2024-06-13T11:20:35.919769+0000","last_clean":"2024-06-13T11:20:35.919769+0000","last_became_active":"2024-06-13T11:18:38.176236+0000","last_became_peered":"2024-06-13T11:18:38.176236+0000","last_unstale":"2024-06-13T11:20:35.919769+0000","last_undegraded":"2024-06-13T11:20:35.919769+0000","last_fullsized":"2024-06-13T11:20:35.919769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:10:20.684891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.904351+0000","last_change":"2024-06-13T11:18:42.920930+0000","last_active":"2024-06-13T11:20:27.904351+0000","last_peered":"2024-06-13T11:20:27.904351+0000","last_clean":"2024-06-13T11:20:27.904351+0000","last_became_active":"2024-06-13T11:18:42.915838+0000","last_became_peered":"2024-06-13T11:18:42.915838+0000","last_unstale":"2024-06-13T11:20:27.904351+0000","last_undegraded":"2024-06-13T11:20:27.904351+0000","last_fullsized":"2024-06-13T11:20:27.904351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:07:43.483317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.530672+0000","last_change":"2024-06-13T11:18:57.009043+0000","last_active":"2024-06-13T11:20:27.530672+0000","last_peered":"2024-06-13T11:20:27.530672+0000","last_clean":"2024-06-13T11:20:27.530672+0000","last_became_active":"2024-06-13T11:18:57.008533+0000","last_became_peered":"2024-06-13T11:18:57.008533+0000","last_unstale":"2024-06-13T11:20:27.530672+0000","last_undegraded":"2024-06-13T11:20:27.530672+0000","last_fullsized":"2024-06-13T11:20:27.530672+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:30:29.614810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'4","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529178+0000","last_change":"2024-06-13T11:18:38.523042+0000","last_active":"2024-06-13T11:20:27.529178+0000","last_peered":"2024-06-13T11:20:27.529178+0000","last_clean":"2024-06-13T11:20:27.529178+0000","last_became_active":"2024-06-13T11:18:38.522673+0000","last_became_peered":"2024-06-13T11:18:38.522673+0000","last_unstale":"2024-06-13T11:20:27.529178+0000","last_undegraded":"2024-06-13T11:20:27.529178+0000","last_fullsized":"2024-06-13T11:20:27.529178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:25:50.725281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.114522+0000","last_change":"2024-06-13T11:18:42.934090+0000","last_active":"2024-06-13T11:20:28.114522+0000","last_peered":"2024-06-13T11:20:28.114522+0000","last_clean":"2024-06-13T11:20:28.114522+0000","last_became_active":"2024-06-13T11:18:42.933680+0000","last_became_peered":"2024-06-13T11:18:42.933680+0000","last_unstale":"2024-06-13T11:20:28.114522+0000","last_undegraded":"2024-06-13T11:20:28.114522+0000","last_fullsized":"2024-06-13T11:20:28.114522+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:39:30.214272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528962+0000","last_change":"2024-06-13T11:18:57.185186+0000","last_active":"2024-06-13T11:20:27.528962+0000","last_peered":"2024-06-13T11:20:27.528962+0000","last_clean":"2024-06-13T11:20:27.528962+0000","last_became_active":"2024-06-13T11:18:57.184448+0000","last_became_peered":"2024-06-13T11:18:57.184448+0000","last_unstale":"2024-06-13T11:20:27.528962+0000","last_undegraded":"2024-06-13T11:20:27.528962+0000","last_fullsized":"2024-06-13T11:20:27.528962+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:18:32.514993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.898789+0000","last_change":"2024-06-13T11:19:26.999451+0000","last_active":"2024-06-13T11:20:27.898789+0000","last_peered":"2024-06-13T11:20:27.898789+0000","last_clean":"2024-06-13T11:20:27.898789+0000","last_became_active":"2024-06-13T11:19:26.999153+0000","last_became_peered":"2024-06-13T11:19:26.999153+0000","last_unstale":"2024-06-13T11:20:27.898789+0000","last_undegraded":"2024-06-13T11:20:27.898789+0000","last_fullsized":"2024-06-13T11:20:27.898789+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:42:34.755569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525540+0000","last_change":"2024-06-13T11:18:42.903741+0000","last_active":"2024-06-13T11:20:27.525540+0000","last_peered":"2024-06-13T11:20:27.525540+0000","last_clean":"2024-06-13T11:20:27.525540+0000","last_became_active":"2024-06-13T11:18:42.903351+0000","last_became_peered":"2024-06-13T11:18:42.903351+0000","last_unstale":"2024-06-13T11:20:27.525540+0000","last_undegraded":"2024-06-13T11:20:27.525540+0000","last_fullsized":"2024-06-13T11:20:27.525540+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:47:21.206540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767417+0000","last_change":"2024-06-13T11:18:57.035149+0000","last_active":"2024-06-13T11:20:27.767417+0000","last_peered":"2024-06-13T11:20:27.767417+0000","last_clean":"2024-06-13T11:20:27.767417+0000","last_became_active":"2024-06-13T11:18:57.033208+0000","last_became_peered":"2024-06-13T11:18:57.033208+0000","last_unstale":"2024-06-13T11:20:27.767417+0000","last_undegraded":"2024-06-13T11:20:27.767417+0000","last_fullsized":"2024-06-13T11:20:27.767417+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:19:01.353814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'3","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.902373+0000","last_change":"2024-06-13T11:18:38.170464+0000","last_active":"2024-06-13T11:20:27.902373+0000","last_peered":"2024-06-13T11:20:27.902373+0000","last_clean":"2024-06-13T11:20:27.902373+0000","last_became_active":"2024-06-13T11:18:38.169945+0000","last_became_peered":"2024-06-13T11:18:38.169945+0000","last_unstale":"2024-06-13T11:20:27.902373+0000","last_undegraded":"2024-06-13T11:20:27.902373+0000","last_fullsized":"2024-06-13T11:20:27.902373+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:53:20.112176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899166+0000","last_change":"2024-06-13T11:18:42.925391+0000","last_active":"2024-06-13T11:20:27.899166+0000","last_peered":"2024-06-13T11:20:27.899166+0000","last_clean":"2024-06-13T11:20:27.899166+0000","last_became_active":"2024-06-13T11:18:42.924900+0000","last_became_peered":"2024-06-13T11:18:42.924900+0000","last_unstale":"2024-06-13T11:20:27.899166+0000","last_undegraded":"2024-06-13T11:20:27.899166+0000","last_fullsized":"2024-06-13T11:20:27.899166+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:10.954502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"99'1","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528909+0000","last_change":"2024-06-13T11:18:57.029448+0000","last_active":"2024-06-13T11:20:27.528909+0000","last_peered":"2024-06-13T11:20:27.528909+0000","last_clean":"2024-06-13T11:20:27.528909+0000","last_became_active":"2024-06-13T11:18:57.028918+0000","last_became_peered":"2024-06-13T11:18:57.028918+0000","last_unstale":"2024-06-13T11:20:27.528909+0000","last_undegraded":"2024-06-13T11:20:27.528909+0000","last_fullsized":"2024-06-13T11:20:27.528909+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:53:06.206458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"97'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899139+0000","last_change":"2024-06-13T11:19:27.078724+0000","last_active":"2024-06-13T11:20:27.899139+0000","last_peered":"2024-06-13T11:20:27.899139+0000","last_clean":"2024-06-13T11:20:27.899139+0000","last_became_active":"2024-06-13T11:19:27.078329+0000","last_became_peered":"2024-06-13T11:19:27.078329+0000","last_unstale":"2024-06-13T11:20:27.899139+0000","last_undegraded":"2024-06-13T11:20:27.899139+0000","last_fullsized":"2024-06-13T11:20:27.899139+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:25:38.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.902861+0000","last_change":"2024-06-13T11:18:42.930769+0000","last_active":"2024-06-13T11:20:27.902861+0000","last_peered":"2024-06-13T11:20:27.902861+0000","last_clean":"2024-06-13T11:20:27.902861+0000","last_became_active":"2024-06-13T11:18:42.928727+0000","last_became_peered":"2024-06-13T11:18:42.928727+0000","last_unstale":"2024-06-13T11:20:27.902861+0000","last_undegraded":"2024-06-13T11:20:27.902861+0000","last_fullsized":"2024-06-13T11:20:27.902861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:14:55.202237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529315+0000","last_change":"2024-06-13T11:18:57.185071+0000","last_active":"2024-06-13T11:20:27.529315+0000","last_peered":"2024-06-13T11:20:27.529315+0000","last_clean":"2024-06-13T11:20:27.529315+0000","last_became_active":"2024-06-13T11:18:57.184534+0000","last_became_peered":"2024-06-13T11:18:57.184534+0000","last_unstale":"2024-06-13T11:20:27.529315+0000","last_undegraded":"2024-06-13T11:20:27.529315+0000","last_fullsized":"2024-06-13T11:20:27.529315+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:55:11.146525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525668+0000","last_change":"2024-06-13T11:18:38.167734+0000","last_active":"2024-06-13T11:20:27.525668+0000","last_peered":"2024-06-13T11:20:27.525668+0000","last_clean":"2024-06-13T11:20:27.525668+0000","last_became_active":"2024-06-13T11:18:38.167345+0000","last_became_peered":"2024-06-13T11:18:38.167345+0000","last_unstale":"2024-06-13T11:20:27.525668+0000","last_undegraded":"2024-06-13T11:20:27.525668+0000","last_fullsized":"2024-06-13T11:20:27.525668+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:55:43.155928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525784+0000","last_change":"2024-06-13T11:18:42.900884+0000","last_active":"2024-06-13T11:20:27.525784+0000","last_peered":"2024-06-13T11:20:27.525784+0000","last_clean":"2024-06-13T11:20:27.525784+0000","last_became_active":"2024-06-13T11:18:42.900562+0000","last_became_peered":"2024-06-13T11:18:42.900562+0000","last_unstale":"2024-06-13T11:20:27.525784+0000","last_undegraded":"2024-06-13T11:20:27.525784+0000","last_fullsized":"2024-06-13T11:20:27.525784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:38:59.480693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.898766+0000","last_change":"2024-06-13T11:18:57.015496+0000","last_active":"2024-06-13T11:20:27.898766+0000","last_peered":"2024-06-13T11:20:27.898766+0000","last_clean":"2024-06-13T11:20:27.898766+0000","last_became_active":"2024-06-13T11:18:57.015079+0000","last_became_peered":"2024-06-13T11:18:57.015079+0000","last_unstale":"2024-06-13T11:20:27.898766+0000","last_undegraded":"2024-06-13T11:20:27.898766+0000","last_fullsized":"2024-06-13T11:20:27.898766+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:31:40.130018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.531531+0000","last_change":"2024-06-13T11:18:38.523097+0000","last_active":"2024-06-13T11:20:27.531531+0000","last_peered":"2024-06-13T11:20:27.531531+0000","last_clean":"2024-06-13T11:20:27.531531+0000","last_became_active":"2024-06-13T11:18:38.522638+0000","last_became_peered":"2024-06-13T11:18:38.522638+0000","last_unstale":"2024-06-13T11:20:27.531531+0000","last_undegraded":"2024-06-13T11:20:27.531531+0000","last_fullsized":"2024-06-13T11:20:27.531531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:35:36.843246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526040+0000","last_change":"2024-06-13T11:18:42.899281+0000","last_active":"2024-06-13T11:20:27.526040+0000","last_peered":"2024-06-13T11:20:27.526040+0000","last_clean":"2024-06-13T11:20:27.526040+0000","last_became_active":"2024-06-13T11:18:42.898924+0000","last_became_peered":"2024-06-13T11:18:42.898924+0000","last_unstale":"2024-06-13T11:20:27.526040+0000","last_undegraded":"2024-06-13T11:20:27.526040+0000","last_fullsized":"2024-06-13T11:20:27.526040+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:18:10.324425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.112660+0000","last_change":"2024-06-13T11:18:57.037070+0000","last_active":"2024-06-13T11:20:28.112660+0000","last_peered":"2024-06-13T11:20:28.112660+0000","last_clean":"2024-06-13T11:20:28.112660+0000","last_became_active":"2024-06-13T11:18:57.036632+0000","last_became_peered":"2024-06-13T11:18:57.036632+0000","last_unstale":"2024-06-13T11:20:28.112660+0000","last_undegraded":"2024-06-13T11:20:28.112660+0000","last_fullsized":"2024-06-13T11:20:28.112660+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:19:35.433902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.603128+0000","last_change":"2024-06-13T11:18:38.170790+0000","last_active":"2024-06-13T11:20:27.603128+0000","last_peered":"2024-06-13T11:20:27.603128+0000","last_clean":"2024-06-13T11:20:27.603128+0000","last_became_active":"2024-06-13T11:18:38.170260+0000","last_became_peered":"2024-06-13T11:18:38.170260+0000","last_unstale":"2024-06-13T11:20:27.603128+0000","last_undegraded":"2024-06-13T11:20:27.603128+0000","last_fullsized":"2024-06-13T11:20:27.603128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:11:44.070550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525873+0000","last_change":"2024-06-13T11:18:42.906969+0000","last_active":"2024-06-13T11:20:27.525873+0000","last_peered":"2024-06-13T11:20:27.525873+0000","last_clean":"2024-06-13T11:20:27.525873+0000","last_became_active":"2024-06-13T11:18:42.906657+0000","last_became_peered":"2024-06-13T11:18:42.906657+0000","last_unstale":"2024-06-13T11:20:27.525873+0000","last_undegraded":"2024-06-13T11:20:27.525873+0000","last_fullsized":"2024-06-13T11:20:27.525873+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:30:36.414377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.601926+0000","last_change":"2024-06-13T11:18:57.007226+0000","last_active":"2024-06-13T11:20:27.601926+0000","last_peered":"2024-06-13T11:20:27.601926+0000","last_clean":"2024-06-13T11:20:27.601926+0000","last_became_active":"2024-06-13T11:18:57.006803+0000","last_became_peered":"2024-06-13T11:18:57.006803+0000","last_unstale":"2024-06-13T11:20:27.601926+0000","last_undegraded":"2024-06-13T11:20:27.601926+0000","last_fullsized":"2024-06-13T11:20:27.601926+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:08:28.913145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529479+0000","last_change":"2024-06-13T11:18:38.173327+0000","last_active":"2024-06-13T11:20:27.529479+0000","last_peered":"2024-06-13T11:20:27.529479+0000","last_clean":"2024-06-13T11:20:27.529479+0000","last_became_active":"2024-06-13T11:18:38.172786+0000","last_became_peered":"2024-06-13T11:18:38.172786+0000","last_unstale":"2024-06-13T11:20:27.529479+0000","last_undegraded":"2024-06-13T11:20:27.529479+0000","last_fullsized":"2024-06-13T11:20:27.529479+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:40:30.330272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526173+0000","last_change":"2024-06-13T11:18:42.899816+0000","last_active":"2024-06-13T11:20:27.526173+0000","last_peered":"2024-06-13T11:20:27.526173+0000","last_clean":"2024-06-13T11:20:27.526173+0000","last_became_active":"2024-06-13T11:18:42.899495+0000","last_became_peered":"2024-06-13T11:18:42.899495+0000","last_unstale":"2024-06-13T11:20:27.526173+0000","last_undegraded":"2024-06-13T11:20:27.526173+0000","last_fullsized":"2024-06-13T11:20:27.526173+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:16:08.303616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899338+0000","last_change":"2024-06-13T11:18:42.909944+0000","last_active":"2024-06-13T11:20:27.899338+0000","last_peered":"2024-06-13T11:20:27.899338+0000","last_clean":"2024-06-13T11:20:27.899338+0000","last_became_active":"2024-06-13T11:18:42.909557+0000","last_became_peered":"2024-06-13T11:18:42.909557+0000","last_unstale":"2024-06-13T11:20:27.899338+0000","last_undegraded":"2024-06-13T11:20:27.899338+0000","last_fullsized":"2024-06-13T11:20:27.899338+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:22:07.093462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.531508+0000","last_change":"2024-06-13T11:18:42.912462+0000","last_active":"2024-06-13T11:20:27.531508+0000","last_peered":"2024-06-13T11:20:27.531508+0000","last_clean":"2024-06-13T11:20:27.531508+0000","last_became_active":"2024-06-13T11:18:42.912110+0000","last_became_peered":"2024-06-13T11:18:42.912110+0000","last_unstale":"2024-06-13T11:20:27.531508+0000","last_undegraded":"2024-06-13T11:20:27.531508+0000","last_fullsized":"2024-06-13T11:20:27.531508+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:11:33.123305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.530903+0000","last_change":"2024-06-13T11:18:42.924224+0000","last_active":"2024-06-13T11:20:27.530903+0000","last_peered":"2024-06-13T11:20:27.530903+0000","last_clean":"2024-06-13T11:20:27.530903+0000","last_became_active":"2024-06-13T11:18:42.923858+0000","last_became_peered":"2024-06-13T11:18:42.923858+0000","last_unstale":"2024-06-13T11:20:27.530903+0000","last_undegraded":"2024-06-13T11:20:27.530903+0000","last_fullsized":"2024-06-13T11:20:27.530903+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:36:11.602930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.113461+0000","last_change":"2024-06-13T11:18:42.921160+0000","last_active":"2024-06-13T11:20:28.113461+0000","last_peered":"2024-06-13T11:20:28.113461+0000","last_clean":"2024-06-13T11:20:28.113461+0000","last_became_active":"2024-06-13T11:18:42.920704+0000","last_became_peered":"2024-06-13T11:18:42.920704+0000","last_unstale":"2024-06-13T11:20:28.113461+0000","last_undegraded":"2024-06-13T11:20:28.113461+0000","last_fullsized":"2024-06-13T11:20:28.113461+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:07:17.023390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528452+0000","last_change":"2024-06-13T11:18:42.923637+0000","last_active":"2024-06-13T11:20:27.528452+0000","last_peered":"2024-06-13T11:20:27.528452+0000","last_clean":"2024-06-13T11:20:27.528452+0000","last_became_active":"2024-06-13T11:18:42.923234+0000","last_became_peered":"2024-06-13T11:18:42.923234+0000","last_unstale":"2024-06-13T11:20:27.528452+0000","last_undegraded":"2024-06-13T11:20:27.528452+0000","last_fullsized":"2024-06-13T11:20:27.528452+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:51:19.676747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899457+0000","last_change":"2024-06-13T11:18:42.910300+0000","last_active":"2024-06-13T11:20:27.899457+0000","last_peered":"2024-06-13T11:20:27.899457+0000","last_clean":"2024-06-13T11:20:27.899457+0000","last_became_active":"2024-06-13T11:18:42.909937+0000","last_became_peered":"2024-06-13T11:18:42.909937+0000","last_unstale":"2024-06-13T11:20:27.899457+0000","last_undegraded":"2024-06-13T11:20:27.899457+0000","last_fullsized":"2024-06-13T11:20:27.899457+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:24:51.407238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.531164+0000","last_change":"2024-06-13T11:18:42.907066+0000","last_active":"2024-06-13T11:20:27.531164+0000","last_peered":"2024-06-13T11:20:27.531164+0000","last_clean":"2024-06-13T11:20:27.531164+0000","last_became_active":"2024-06-13T11:18:42.906582+0000","last_became_peered":"2024-06-13T11:18:42.906582+0000","last_unstale":"2024-06-13T11:20:27.531164+0000","last_undegraded":"2024-06-13T11:20:27.531164+0000","last_fullsized":"2024-06-13T11:20:27.531164+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:40:02.549931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.904685+0000","last_change":"2024-06-13T11:18:42.910290+0000","last_active":"2024-06-13T11:20:27.904685+0000","last_peered":"2024-06-13T11:20:27.904685+0000","last_clean":"2024-06-13T11:20:27.904685+0000","last_became_active":"2024-06-13T11:18:42.909772+0000","last_became_peered":"2024-06-13T11:18:42.909772+0000","last_unstale":"2024-06-13T11:20:27.904685+0000","last_undegraded":"2024-06-13T11:20:27.904685+0000","last_fullsized":"2024-06-13T11:20:27.904685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:05:56.008087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602110+0000","last_change":"2024-06-13T11:18:42.928792+0000","last_active":"2024-06-13T11:20:27.602110+0000","last_peered":"2024-06-13T11:20:27.602110+0000","last_clean":"2024-06-13T11:20:27.602110+0000","last_became_active":"2024-06-13T11:18:42.928464+0000","last_became_peered":"2024-06-13T11:18:42.928464+0000","last_unstale":"2024-06-13T11:20:27.602110+0000","last_undegraded":"2024-06-13T11:20:27.602110+0000","last_fullsized":"2024-06-13T11:20:27.602110+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:01:58.686124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.903312+0000","last_change":"2024-06-13T11:18:42.920719+0000","last_active":"2024-06-13T11:20:27.903312+0000","last_peered":"2024-06-13T11:20:27.903312+0000","last_clean":"2024-06-13T11:20:27.903312+0000","last_became_active":"2024-06-13T11:18:42.913355+0000","last_became_peered":"2024-06-13T11:18:42.913355+0000","last_unstale":"2024-06-13T11:20:27.903312+0000","last_undegraded":"2024-06-13T11:20:27.903312+0000","last_fullsized":"2024-06-13T11:20:27.903312+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:25:00.020936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899092+0000","last_change":"2024-06-13T11:18:42.906709+0000","last_active":"2024-06-13T11:20:27.899092+0000","last_peered":"2024-06-13T11:20:27.899092+0000","last_clean":"2024-06-13T11:20:27.899092+0000","last_became_active":"2024-06-13T11:18:42.906309+0000","last_became_peered":"2024-06-13T11:18:42.906309+0000","last_unstale":"2024-06-13T11:20:27.899092+0000","last_undegraded":"2024-06-13T11:20:27.899092+0000","last_fullsized":"2024-06-13T11:20:27.899092+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:09.255670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528277+0000","last_change":"2024-06-13T11:18:42.926939+0000","last_active":"2024-06-13T11:20:27.528277+0000","last_peered":"2024-06-13T11:20:27.528277+0000","last_clean":"2024-06-13T11:20:27.528277+0000","last_became_active":"2024-06-13T11:18:42.926616+0000","last_became_peered":"2024-06-13T11:18:42.926616+0000","last_unstale":"2024-06-13T11:20:27.528277+0000","last_undegraded":"2024-06-13T11:20:27.528277+0000","last_fullsized":"2024-06-13T11:20:27.528277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:52:46.468479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899422+0000","last_change":"2024-06-13T11:18:42.901103+0000","last_active":"2024-06-13T11:20:27.899422+0000","last_peered":"2024-06-13T11:20:27.899422+0000","last_clean":"2024-06-13T11:20:27.899422+0000","last_became_active":"2024-06-13T11:18:42.900726+0000","last_became_peered":"2024-06-13T11:18:42.900726+0000","last_unstale":"2024-06-13T11:20:27.899422+0000","last_undegraded":"2024-06-13T11:20:27.899422+0000","last_fullsized":"2024-06-13T11:20:27.899422+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:55.895451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285250,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67939,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":249,"num_read_kb":196,"num_write":170,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":203817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383723,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1093632,"data_stored":569642,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645358,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32388,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712764,"statfs":{"total":95995035648,"available":95961870336,"internally_reserved":0,"allocated":1241088,"data_stored":1220849,"data_compressed":68781,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808884,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1114112,"data_stored":573974,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070522,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":569798,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332160,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1159168,"data_stored":1166096,"data_compressed":68781,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495686,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712904,"statfs":{"total":95995035648,"available":95962013696,"internally_reserved":0,"allocated":1089536,"data_stored":565054,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32308,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712844,"statfs":{"total":95995035648,"available":95961952256,"internally_reserved":0,"allocated":1159168,"data_stored":628513,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738472,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1114112,"data_stored":566442,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411420,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36492,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708660,"statfs":{"total":95995035648,"available":95957667840,"internally_reserved":0,"allocated":1183744,"data_stored":630253,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182485,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":565248,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920849,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1101824,"data_stored":570094,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757324,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36480,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708672,"statfs":{"total":95995035648,"available":95957680128,"internally_reserved":0,"allocated":1167360,"data_stored":1161294,"data_compressed":68781,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34630,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34630,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34630,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T11:20:50.535 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-13T11:20:50.535 INFO:tasks.cephadm:Setting up client nodes... 2024-06-13T11:20:50.535 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-06-13T11:20:50.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:50 smithi002 ceph-mon[32210]: pgmap v401: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-06-13T11:20:50.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:50 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:50.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:50 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:50.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:50 smithi002 ceph-mon[32210]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:20:50.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:50 smithi178 ceph-mon[36913]: pgmap v401: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-06-13T11:20:50.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:50 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:50.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:50 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:50.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:50 smithi178 ceph-mon[36913]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:20:51.008 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:20:51.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:50 smithi077 ceph-mon[36410]: pgmap v401: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-06-13T11:20:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:50 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:50 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:50 smithi077 ceph-mon[36410]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:20:51.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:51 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:20:51.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:51 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:20:51.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:51 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:51.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:51 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:20:51.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:51 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:20:51.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:51 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:51 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:20:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:51 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:20:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:51 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:20:53.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.205+0000 7fb651800700 1 -- 172.21.15.2:0/1482897643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb64c0764c0 msgr2=0x7fb64c074920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:53.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.205+0000 7fb651800700 1 --2- 172.21.15.2:0/1482897643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb64c0764c0 0x7fb64c074920 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0098f0 tx=0x7fb63c009c00 comp rx=0 tx=0).stop 2024-06-13T11:20:53.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.205+0000 7fb651800700 1 -- 172.21.15.2:0/1482897643 shutdown_connections 2024-06-13T11:20:53.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.205+0000 7fb651800700 1 --2- 172.21.15.2:0/1482897643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb64c10eb00 0x7fb64c110ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:53.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.205+0000 7fb651800700 1 --2- 172.21.15.2:0/1482897643 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb64c0764c0 0x7fb64c074920 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:53.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.205+0000 7fb651800700 1 --2- 172.21.15.2:0/1482897643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb64c074ef0 0x7fb64c075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:53.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.205+0000 7fb651800700 1 -- 172.21.15.2:0/1482897643 >> 172.21.15.2:0/1482897643 conn(0x7fb64c0fdae0 msgr2=0x7fb64c0fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:53.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.205+0000 7fb651800700 1 -- 172.21.15.2:0/1482897643 shutdown_connections 2024-06-13T11:20:53.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.205+0000 7fb651800700 1 -- 172.21.15.2:0/1482897643 wait complete. 2024-06-13T11:20:53.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.207+0000 7fb651800700 1 Processor -- start 2024-06-13T11:20:53.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.207+0000 7fb651800700 1 -- start start 2024-06-13T11:20:53.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.208+0000 7fb651800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb64c074ef0 0x7fb64c19ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:53.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.208+0000 7fb651800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb64c0764c0 0x7fb64c19f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:53.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.208+0000 7fb651800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb64c10eb00 0x7fb64c1a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:53.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.208+0000 7fb651800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c114700 con 0x7fb64c0764c0 2024-06-13T11:20:53.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.208+0000 7fb651800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c114580 con 0x7fb64c10eb00 2024-06-13T11:20:53.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.208+0000 7fb651800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c114880 con 0x7fb64c074ef0 2024-06-13T11:20:53.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.208+0000 7fb64aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb64c074ef0 0x7fb64c19ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:53.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.208+0000 7fb643e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb64c0764c0 0x7fb64c19f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:53.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.208+0000 7fb64aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb64c074ef0 0x7fb64c19ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:53938/0 (socket says 172.21.15.2:53938) 2024-06-13T11:20:53.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.208+0000 7fb64aa00700 1 -- 172.21.15.2:0/1739589991 learned_addr learned my addr 172.21.15.2:0/1739589991 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:20:53.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.208+0000 7fb64b400700 1 --2- 172.21.15.2:0/1739589991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb64c10eb00 0x7fb64c1a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:53.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.208+0000 7fb64aa00700 1 -- 172.21.15.2:0/1739589991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb64c10eb00 msgr2=0x7fb64c1a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:53.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.208+0000 7fb64aa00700 1 --2- 172.21.15.2:0/1739589991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb64c10eb00 0x7fb64c1a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:53.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.208+0000 7fb64aa00700 1 -- 172.21.15.2:0/1739589991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb64c0764c0 msgr2=0x7fb64c19f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:53.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.208+0000 7fb64aa00700 1 --2- 172.21.15.2:0/1739589991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb64c0764c0 0x7fb64c19f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:53.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.208+0000 7fb64aa00700 1 -- 172.21.15.2:0/1739589991 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64c1a6930 con 0x7fb64c074ef0 2024-06-13T11:20:53.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.209+0000 7fb64aa00700 1 --2- 172.21.15.2:0/1739589991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb64c074ef0 0x7fb64c19ecb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00fca0 tx=0x7fb63c005250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:53.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.209+0000 7fb643400700 1 -- 172.21.15.2:0/1739589991 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c00f950 con 0x7fb64c074ef0 2024-06-13T11:20:53.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.209+0000 7fb643400700 1 -- 172.21.15.2:0/1739589991 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb63c00ba40 con 0x7fb64c074ef0 2024-06-13T11:20:53.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.209+0000 7fb651800700 1 -- 172.21.15.2:0/1739589991 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb64c1a6bc0 con 0x7fb64c074ef0 2024-06-13T11:20:53.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.209+0000 7fb643400700 1 -- 172.21.15.2:0/1739589991 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c003c80 con 0x7fb64c074ef0 2024-06-13T11:20:53.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.209+0000 7fb651800700 1 -- 172.21.15.2:0/1739589991 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb64c1a7070 con 0x7fb64c074ef0 2024-06-13T11:20:53.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.210+0000 7fb651800700 1 -- 172.21.15.2:0/1739589991 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb64c050a00 con 0x7fb64c074ef0 2024-06-13T11:20:53.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.212+0000 7fb643400700 1 -- 172.21.15.2:0/1739589991 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fb63c005540 con 0x7fb64c074ef0 2024-06-13T11:20:53.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.214+0000 7fb643400700 1 --2- 172.21.15.2:0/1739589991 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6300a2f80 0x7fb6300a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:53.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.214+0000 7fb643400700 1 -- 172.21.15.2:0/1739589991 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fb63c0d06b0 con 0x7fb64c074ef0 2024-06-13T11:20:53.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.214+0000 7fb643e00700 1 --2- 172.21.15.2:0/1739589991 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6300a2f80 0x7fb6300a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:53.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.215+0000 7fb643e00700 1 --2- 172.21.15.2:0/1739589991 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6300a2f80 0x7fb6300a5440 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb634009750 tx=0x7fb634009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.218+0000 7fb643400700 1 -- 172.21.15.2:0/1739589991 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb63c013030 con 0x7fb64c074ef0 2024-06-13T11:20:53.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:52 smithi077 ceph-mon[36410]: pgmap v402: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-06-13T11:20:53.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:52 smithi002 ceph-mon[32210]: pgmap v402: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-06-13T11:20:53.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:52 smithi178 ceph-mon[36913]: pgmap v402: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-06-13T11:20:53.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.535+0000 7fb651800700 1 -- 172.21.15.2:0/1739589991 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fb64c0630a0 con 0x7fb64c074ef0 2024-06-13T11:20:53.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.544+0000 7fb643400700 1 -- 172.21.15.2:0/1739589991 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fb63c09d150 con 0x7fb64c074ef0 2024-06-13T11:20:53.543 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-06-13T11:20:53.543 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQAV1mpmqgoZIBAA68S5nQp3zkE26ZScnWCfSA== 2024-06-13T11:20:53.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.547+0000 7fb651800700 1 -- 172.21.15.2:0/1739589991 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6300a2f80 msgr2=0x7fb6300a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:53.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.547+0000 7fb651800700 1 --2- 172.21.15.2:0/1739589991 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6300a2f80 0x7fb6300a5440 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb634009750 tx=0x7fb634009310 comp rx=0 tx=0).stop 2024-06-13T11:20:53.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.547+0000 7fb651800700 1 -- 172.21.15.2:0/1739589991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb64c074ef0 msgr2=0x7fb64c19ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:53.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.547+0000 7fb651800700 1 --2- 172.21.15.2:0/1739589991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb64c074ef0 0x7fb64c19ecb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00fca0 tx=0x7fb63c005250 comp rx=0 tx=0).stop 2024-06-13T11:20:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.547+0000 7fb651800700 1 -- 172.21.15.2:0/1739589991 shutdown_connections 2024-06-13T11:20:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.547+0000 7fb651800700 1 --2- 172.21.15.2:0/1739589991 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb6300a2f80 0x7fb6300a5440 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.547+0000 7fb651800700 1 --2- 172.21.15.2:0/1739589991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb64c10eb00 0x7fb64c1a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.547+0000 7fb651800700 1 --2- 172.21.15.2:0/1739589991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb64c074ef0 0x7fb64c19ecb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.547+0000 7fb651800700 1 --2- 172.21.15.2:0/1739589991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb64c0764c0 0x7fb64c19f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.547+0000 7fb651800700 1 -- 172.21.15.2:0/1739589991 >> 172.21.15.2:0/1739589991 conn(0x7fb64c0fdae0 msgr2=0x7fb64c101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.547+0000 7fb651800700 1 -- 172.21.15.2:0/1739589991 shutdown_connections 2024-06-13T11:20:53.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:53.548+0000 7fb651800700 1 -- 172.21.15.2:0/1739589991 wait complete. 2024-06-13T11:20:54.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:53 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1739589991' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-13T11:20:54.285 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:53 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-13T11:20:54.285 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:53 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-13T11:20:54.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:53 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1739589991' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-13T11:20:54.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:53 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-13T11:20:54.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:53 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-13T11:20:54.375 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:20:54.376 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-06-13T11:20:54.376 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-13T11:20:54.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:53 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1739589991' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-13T11:20:54.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:53 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-13T11:20:54.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:53 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-13T11:20:54.522 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-13T11:20:54.522 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-06-13T11:20:54.522 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph mgr dump --format=json 2024-06-13T11:20:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:20:55.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:54 smithi077 ceph-mon[36410]: pgmap v403: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 6 op/s 2024-06-13T11:20:55.339 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:54 smithi002 ceph-mon[32210]: pgmap v403: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 6 op/s 2024-06-13T11:20:55.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:54 smithi178 ceph-mon[36913]: pgmap v403: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 6 op/s 2024-06-13T11:20:57.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.247+0000 7fd62c600700 1 -- 172.21.15.2:0/1212497047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6241030f0 msgr2=0x7fd624107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:57.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.247+0000 7fd62c600700 1 --2- 172.21.15.2:0/1212497047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6241030f0 0x7fd624107110 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd6100099c0 tx=0x7fd610009cd0 comp rx=0 tx=0).stop 2024-06-13T11:20:57.248 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:56 smithi002 ceph-mon[32210]: pgmap v404: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:20:57.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.247+0000 7fd62c600700 1 -- 172.21.15.2:0/1212497047 shutdown_connections 2024-06-13T11:20:57.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.247+0000 7fd62c600700 1 --2- 172.21.15.2:0/1212497047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd624107840 0x7fd62410f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:57.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.247+0000 7fd62c600700 1 --2- 172.21.15.2:0/1212497047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd624102740 0x7fd624102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:57.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.247+0000 7fd62c600700 1 --2- 172.21.15.2:0/1212497047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6241030f0 0x7fd624107110 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:57.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.248+0000 7fd62c600700 1 -- 172.21.15.2:0/1212497047 >> 172.21.15.2:0/1212497047 conn(0x7fd6240795f0 msgr2=0x7fd624079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:57.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.248+0000 7fd62c600700 1 -- 172.21.15.2:0/1212497047 shutdown_connections 2024-06-13T11:20:57.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.248+0000 7fd62c600700 1 -- 172.21.15.2:0/1212497047 wait complete. 2024-06-13T11:20:57.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.249+0000 7fd62c600700 1 Processor -- start 2024-06-13T11:20:57.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.250+0000 7fd62c600700 1 -- start start 2024-06-13T11:20:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.250+0000 7fd62c600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd624102740 0x7fd62419ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.250+0000 7fd62c600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6241030f0 0x7fd62419b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.250+0000 7fd62c600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd624107840 0x7fd62419f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.250+0000 7fd62c600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd624112770 con 0x7fd624107840 2024-06-13T11:20:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.250+0000 7fd62c600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd6241125f0 con 0x7fd624102740 2024-06-13T11:20:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.250+0000 7fd62c600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd6241128f0 con 0x7fd6241030f0 2024-06-13T11:20:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.250+0000 7fd62a600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd624107840 0x7fd62419f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.250+0000 7fd629200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6241030f0 0x7fd62419b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.250+0000 7fd62a600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd624107840 0x7fd62419f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46474/0 (socket says 172.21.15.2:46474) 2024-06-13T11:20:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.250+0000 7fd629c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd624102740 0x7fd62419ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.250+0000 7fd62a600700 1 -- 172.21.15.2:0/698639600 learned_addr learned my addr 172.21.15.2:0/698639600 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:20:57.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.251+0000 7fd629200700 1 -- 172.21.15.2:0/698639600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd624102740 msgr2=0x7fd62419ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:57.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.251+0000 7fd629200700 1 --2- 172.21.15.2:0/698639600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd624102740 0x7fd62419ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:57.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.251+0000 7fd629200700 1 -- 172.21.15.2:0/698639600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd624107840 msgr2=0x7fd62419f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:57.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.251+0000 7fd629200700 1 --2- 172.21.15.2:0/698639600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd624107840 0x7fd62419f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:57.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.251+0000 7fd629200700 1 -- 172.21.15.2:0/698639600 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62419fdb0 con 0x7fd6241030f0 2024-06-13T11:20:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.251+0000 7fd629c00700 1 --2- 172.21.15.2:0/698639600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd624102740 0x7fd62419ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:20:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.251+0000 7fd629200700 1 --2- 172.21.15.2:0/698639600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6241030f0 0x7fd62419b2e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd61000b580 tx=0x7fd610003a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.252+0000 7fd622000700 1 -- 172.21.15.2:0/698639600 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd610003680 con 0x7fd6241030f0 2024-06-13T11:20:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.252+0000 7fd622000700 1 -- 172.21.15.2:0/698639600 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6100055a0 con 0x7fd6241030f0 2024-06-13T11:20:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.252+0000 7fd62c600700 1 -- 172.21.15.2:0/698639600 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6241a0040 con 0x7fd6241030f0 2024-06-13T11:20:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.252+0000 7fd622000700 1 -- 172.21.15.2:0/698639600 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61000fc90 con 0x7fd6241030f0 2024-06-13T11:20:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.252+0000 7fd62c600700 1 -- 172.21.15.2:0/698639600 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6241a7920 con 0x7fd6241030f0 2024-06-13T11:20:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.253+0000 7fd62c600700 1 -- 172.21.15.2:0/698639600 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd624103bd0 con 0x7fd6241030f0 2024-06-13T11:20:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.256+0000 7fd622000700 1 -- 172.21.15.2:0/698639600 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fd61000f460 con 0x7fd6241030f0 2024-06-13T11:20:57.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.257+0000 7fd622000700 1 --2- 172.21.15.2:0/698639600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd60c0a2ed0 0x7fd60c0a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:20:57.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.257+0000 7fd622000700 1 -- 172.21.15.2:0/698639600 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fd6100d0560 con 0x7fd6241030f0 2024-06-13T11:20:57.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.257+0000 7fd629c00700 1 --2- 172.21.15.2:0/698639600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd60c0a2ed0 0x7fd60c0a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:20:57.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.258+0000 7fd629c00700 1 --2- 172.21.15.2:0/698639600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd60c0a2ed0 0x7fd60c0a5390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd618011490 tx=0x7fd618009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:20:57.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.259+0000 7fd622000700 1 -- 172.21.15.2:0/698639600 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd610013070 con 0x7fd6241030f0 2024-06-13T11:20:57.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:56 smithi077 ceph-mon[36410]: pgmap v404: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:20:57.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:56 smithi178 ceph-mon[36913]: pgmap v404: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:20:57.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.554+0000 7fd62c600700 1 -- 172.21.15.2:0/698639600 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fd6241a7af0 con 0x7fd6241030f0 2024-06-13T11:20:57.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.560+0000 7fd622000700 1 -- 172.21.15.2:0/698639600 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263188 (secure 0 0 0) 0x7fd61009d000 con 0x7fd6241030f0 2024-06-13T11:20:57.564 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:20:57.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.567+0000 7fd62c600700 1 -- 172.21.15.2:0/698639600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd60c0a2ed0 msgr2=0x7fd60c0a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:57.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.567+0000 7fd62c600700 1 --2- 172.21.15.2:0/698639600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd60c0a2ed0 0x7fd60c0a5390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd618011490 tx=0x7fd618009260 comp rx=0 tx=0).stop 2024-06-13T11:20:57.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.567+0000 7fd62c600700 1 -- 172.21.15.2:0/698639600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6241030f0 msgr2=0x7fd62419b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:20:57.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.567+0000 7fd62c600700 1 --2- 172.21.15.2:0/698639600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6241030f0 0x7fd62419b2e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd61000b580 tx=0x7fd610003a90 comp rx=0 tx=0).stop 2024-06-13T11:20:57.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.567+0000 7fd62c600700 1 -- 172.21.15.2:0/698639600 shutdown_connections 2024-06-13T11:20:57.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.567+0000 7fd62c600700 1 --2- 172.21.15.2:0/698639600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd60c0a2ed0 0x7fd60c0a5390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:57.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.567+0000 7fd62c600700 1 --2- 172.21.15.2:0/698639600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd624107840 0x7fd62419f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:57.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.567+0000 7fd62c600700 1 --2- 172.21.15.2:0/698639600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd624102740 0x7fd62419ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:57.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.567+0000 7fd62c600700 1 --2- 172.21.15.2:0/698639600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6241030f0 0x7fd62419b2e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:20:57.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.567+0000 7fd62c600700 1 -- 172.21.15.2:0/698639600 >> 172.21.15.2:0/698639600 conn(0x7fd6240795f0 msgr2=0x7fd624108990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:20:57.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.567+0000 7fd62c600700 1 -- 172.21.15.2:0/698639600 shutdown_connections 2024-06-13T11:20:57.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:20:57.567+0000 7fd62c600700 1 -- 172.21.15.2:0/698639600 wait complete. 2024-06-13T11:20:58.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:58 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/698639600' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-13T11:20:58.385 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:58 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/698639600' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-13T11:20:58.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:58 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/698639600' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-13T11:20:58.466 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3387272091},{"type":"v1","addr":"172.21.15.2:6801","nonce":3387272091}]},"active_addr":"172.21.15.2:6801/3387272091","active_change":"2024-06-13T11:10:25.084835+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.2:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":1640275700}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":88846693}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":778891449}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":682201811}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":4119694426}]}]} 2024-06-13T11:20:58.475 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-06-13T11:20:58.475 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-06-13T11:20:58.476 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T11:20:58.994 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:20:59.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:20:59 smithi077 ceph-mon[36410]: pgmap v405: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T11:20:59.330 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:20:59 smithi002 ceph-mon[32210]: pgmap v405: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T11:20:59.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:20:59 smithi178 ceph-mon[36913]: pgmap v405: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T11:21:01.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.242+0000 7f4c78a00700 1 -- 172.21.15.2:0/125327937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c7406b3a0 msgr2=0x7f4c7410f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:01.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.242+0000 7f4c78a00700 1 --2- 172.21.15.2:0/125327937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c7406b3a0 0x7f4c7410f310 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00b0a0 tx=0x7f4c6c00b3b0 comp rx=0 tx=0).stop 2024-06-13T11:21:01.242 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:01 smithi002 ceph-mon[32210]: pgmap v406: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:01.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.242+0000 7f4c78a00700 1 -- 172.21.15.2:0/125327937 shutdown_connections 2024-06-13T11:21:01.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.242+0000 7f4c78a00700 1 --2- 172.21.15.2:0/125327937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c7406b3a0 0x7f4c7410f310 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:01.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.242+0000 7f4c78a00700 1 --2- 172.21.15.2:0/125327937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c741084d0 0x7f4c741088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:01.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.242+0000 7f4c78a00700 1 --2- 172.21.15.2:0/125327937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c7406aa00 0x7f4c7406ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:01.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.242+0000 7f4c78a00700 1 -- 172.21.15.2:0/125327937 >> 172.21.15.2:0/125327937 conn(0x7f4c74078330 msgr2=0x7f4c74078740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:01.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.242+0000 7f4c78a00700 1 -- 172.21.15.2:0/125327937 shutdown_connections 2024-06-13T11:21:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.242+0000 7f4c78a00700 1 -- 172.21.15.2:0/125327937 wait complete. 2024-06-13T11:21:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.243+0000 7f4c78a00700 1 Processor -- start 2024-06-13T11:21:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.244+0000 7f4c78a00700 1 -- start start 2024-06-13T11:21:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.244+0000 7f4c78a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c7406aa00 0x7f4c7419e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.244+0000 7f4c78a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c7406b3a0 0x7f4c7419ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.244+0000 7f4c78a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c741084d0 0x7f4c741989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.244+0000 7f4c78a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4c74112770 con 0x7f4c7406aa00 2024-06-13T11:21:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.244+0000 7f4c78a00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4c741125f0 con 0x7f4c7406b3a0 2024-06-13T11:21:01.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.244+0000 7f4c78a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4c741128f0 con 0x7f4c741084d0 2024-06-13T11:21:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.244+0000 7f4c71e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c7406aa00 0x7f4c7419e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.244+0000 7f4c69400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c7406b3a0 0x7f4c7419ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.244+0000 7f4c71e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c7406aa00 0x7f4c7419e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46494/0 (socket says 172.21.15.2:46494) 2024-06-13T11:21:01.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.244+0000 7f4c69400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c7406b3a0 0x7f4c7419ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:37886/0 (socket says 172.21.15.2:37886) 2024-06-13T11:21:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.244+0000 7f4c71e00700 1 -- 172.21.15.2:0/846225903 learned_addr learned my addr 172.21.15.2:0/846225903 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.245+0000 7f4c72800700 1 --2- 172.21.15.2:0/846225903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c741084d0 0x7f4c741989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.245+0000 7f4c71e00700 1 -- 172.21.15.2:0/846225903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c741084d0 msgr2=0x7f4c741989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.245+0000 7f4c71e00700 1 --2- 172.21.15.2:0/846225903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c741084d0 0x7f4c741989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.245+0000 7f4c71e00700 1 -- 172.21.15.2:0/846225903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c7406b3a0 msgr2=0x7f4c7419ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.245+0000 7f4c71e00700 1 --2- 172.21.15.2:0/846225903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c7406b3a0 0x7f4c7419ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.245+0000 7f4c71e00700 1 -- 172.21.15.2:0/846225903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c74199150 con 0x7f4c7406aa00 2024-06-13T11:21:01.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.245+0000 7f4c69400700 1 --2- 172.21.15.2:0/846225903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c7406b3a0 0x7f4c7419ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:21:01.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.245+0000 7f4c71e00700 1 --2- 172.21.15.2:0/846225903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c7406aa00 0x7f4c7419e830 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400e9a0 tx=0x7f4c6400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:01.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.246+0000 7f4c6b400700 1 -- 172.21.15.2:0/846225903 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6400ca10 con 0x7f4c7406aa00 2024-06-13T11:21:01.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.246+0000 7f4c6b400700 1 -- 172.21.15.2:0/846225903 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c6400cbb0 con 0x7f4c7406aa00 2024-06-13T11:21:01.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.246+0000 7f4c78a00700 1 -- 172.21.15.2:0/846225903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c74199440 con 0x7f4c7406aa00 2024-06-13T11:21:01.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.246+0000 7f4c6b400700 1 -- 172.21.15.2:0/846225903 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64018680 con 0x7f4c7406aa00 2024-06-13T11:21:01.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.246+0000 7f4c78a00700 1 -- 172.21.15.2:0/846225903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c74101380 con 0x7f4c7406aa00 2024-06-13T11:21:01.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.247+0000 7f4c78a00700 1 -- 172.21.15.2:0/846225903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c74103b80 con 0x7f4c7406aa00 2024-06-13T11:21:01.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.249+0000 7f4c6b400700 1 -- 172.21.15.2:0/846225903 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f4c64010430 con 0x7f4c7406aa00 2024-06-13T11:21:01.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.252+0000 7f4c6b400700 1 --2- 172.21.15.2:0/846225903 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4c580a2d30 0x7f4c580a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:01.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.252+0000 7f4c6b400700 1 -- 172.21.15.2:0/846225903 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f4c640cfb50 con 0x7f4c7406aa00 2024-06-13T11:21:01.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.252+0000 7f4c69400700 1 --2- 172.21.15.2:0/846225903 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4c580a2d30 0x7f4c580a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:01.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.253+0000 7f4c69400700 1 --2- 172.21.15.2:0/846225903 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4c580a2d30 0x7f4c580a51f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009680 tx=0x7f4c5c012040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:01.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.255+0000 7f4c6b400700 1 -- 172.21.15.2:0/846225903 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4c6409c560 con 0x7f4c7406aa00 2024-06-13T11:21:01.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:01 smithi077 ceph-mon[36410]: pgmap v406: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:01.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:01 smithi178 ceph-mon[36913]: pgmap v406: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:01.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.488+0000 7f4c78a00700 1 -- 172.21.15.2:0/846225903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c74199f50 con 0x7f4c7406aa00 2024-06-13T11:21:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.493+0000 7f4c6b400700 1 -- 172.21.15.2:0/846225903 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24612 (secure 0 0 0) 0x7f4c74199f50 con 0x7f4c7406aa00 2024-06-13T11:21:01.493 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:21:01.493 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":99,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","created":"2024-06-13T11:09:07.839101+0000","modified":"2024-06-13T11:20:27.512678+0000","last_up_change":"2024-06-13T11:17:28.731479+0000","last_in_change":"2024-06-13T11:17:08.849067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:13:13.793461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:18:36.784824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:18:41.824835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:18:55.545870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f5614d91-49a7-4983-a309-0de3b3e6263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6803","nonce":4127571834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6805","nonce":4127571834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6809","nonce":4127571834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6807","nonce":4127571834}]},"public_addr":"172.21.15.2:6803/4127571834","cluster_addr":"172.21.15.2:6805/4127571834","heartbeat_back_addr":"172.21.15.2:6809/4127571834","heartbeat_front_addr":"172.21.15.2:6807/4127571834","state":["exists","up"]},{"osd":1,"uuid":"d9dbe278-309f-4726-828a-da922f486b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6801","nonce":3180360713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6803","nonce":3180360713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6807","nonce":3180360713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6805","nonce":3180360713}]},"public_addr":"172.21.15.77:6801/3180360713","cluster_addr":"172.21.15.77:6803/3180360713","heartbeat_back_addr":"172.21.15.77:6807/3180360713","heartbeat_front_addr":"172.21.15.77:6805/3180360713","state":["exists","up"]},{"osd":2,"uuid":"04c267dc-7454-418f-9965-3ff96ef280ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6801","nonce":3825510575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6803","nonce":3825510575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6807","nonce":3825510575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6805","nonce":3825510575}]},"public_addr":"172.21.15.178:6801/3825510575","cluster_addr":"172.21.15.178:6803/3825510575","heartbeat_back_addr":"172.21.15.178:6807/3825510575","heartbeat_front_addr":"172.21.15.178:6805/3825510575","state":["exists","up"]},{"osd":3,"uuid":"3847bd4f-ca04-41de-9d88-e1523dd7ff8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6811","nonce":1982693353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6813","nonce":1982693353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6817","nonce":1982693353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6815","nonce":1982693353}]},"public_addr":"172.21.15.2:6811/1982693353","cluster_addr":"172.21.15.2:6813/1982693353","heartbeat_back_addr":"172.21.15.2:6817/1982693353","heartbeat_front_addr":"172.21.15.2:6815/1982693353","state":["exists","up"]},{"osd":4,"uuid":"34d7d2e8-3dee-42b9-a6cb-d4162b122b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6809","nonce":3916694904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6811","nonce":3916694904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6815","nonce":3916694904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6813","nonce":3916694904}]},"public_addr":"172.21.15.77:6809/3916694904","cluster_addr":"172.21.15.77:6811/3916694904","heartbeat_back_addr":"172.21.15.77:6815/3916694904","heartbeat_front_addr":"172.21.15.77:6813/3916694904","state":["exists","up"]},{"osd":5,"uuid":"0468aefc-c3c8-4758-9bbf-1225b7a5ae79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6809","nonce":3572805887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6811","nonce":3572805887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6815","nonce":3572805887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6813","nonce":3572805887}]},"public_addr":"172.21.15.178:6809/3572805887","cluster_addr":"172.21.15.178:6811/3572805887","heartbeat_back_addr":"172.21.15.178:6815/3572805887","heartbeat_front_addr":"172.21.15.178:6813/3572805887","state":["exists","up"]},{"osd":6,"uuid":"0a186a4a-0e28-47bd-b5ad-9bf8079f74c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6819","nonce":1592309584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6821","nonce":1592309584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6825","nonce":1592309584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6823","nonce":1592309584}]},"public_addr":"172.21.15.2:6819/1592309584","cluster_addr":"172.21.15.2:6821/1592309584","heartbeat_back_addr":"172.21.15.2:6825/1592309584","heartbeat_front_addr":"172.21.15.2:6823/1592309584","state":["exists","up"]},{"osd":7,"uuid":"646e66f7-1ef8-428d-a842-bf28c8606df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6817","nonce":1580055775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6819","nonce":1580055775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6823","nonce":1580055775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6821","nonce":1580055775}]},"public_addr":"172.21.15.77:6817/1580055775","cluster_addr":"172.21.15.77:6819/1580055775","heartbeat_back_addr":"172.21.15.77:6823/1580055775","heartbeat_front_addr":"172.21.15.77:6821/1580055775","state":["exists","up"]},{"osd":8,"uuid":"bcc971fc-47d7-4289-8a9a-c76996c57370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6817","nonce":4285192591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6819","nonce":4285192591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6823","nonce":4285192591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6821","nonce":4285192591}]},"public_addr":"172.21.15.178:6817/4285192591","cluster_addr":"172.21.15.178:6819/4285192591","heartbeat_back_addr":"172.21.15.178:6823/4285192591","heartbeat_front_addr":"172.21.15.178:6821/4285192591","state":["exists","up"]},{"osd":9,"uuid":"899d7d4f-a24c-4508-b42c-0b363275c459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6827","nonce":4187017478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6829","nonce":4187017478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6833","nonce":4187017478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6831","nonce":4187017478}]},"public_addr":"172.21.15.2:6827/4187017478","cluster_addr":"172.21.15.2:6829/4187017478","heartbeat_back_addr":"172.21.15.2:6833/4187017478","heartbeat_front_addr":"172.21.15.2:6831/4187017478","state":["exists","up"]},{"osd":10,"uuid":"112d2b8e-9673-4d7a-97e9-2089793fdd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6825","nonce":2039538463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6827","nonce":2039538463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6831","nonce":2039538463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6829","nonce":2039538463}]},"public_addr":"172.21.15.77:6825/2039538463","cluster_addr":"172.21.15.77:6827/2039538463","heartbeat_back_addr":"172.21.15.77:6831/2039538463","heartbeat_front_addr":"172.21.15.77:6829/2039538463","state":["exists","up"]},{"osd":11,"uuid":"6b8001f5-9c74-4cc7-8c41-906cb5ac9b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6825","nonce":1915058767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6827","nonce":1915058767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6831","nonce":1915058767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6829","nonce":1915058767}]},"public_addr":"172.21.15.178:6825/1915058767","cluster_addr":"172.21.15.178:6827/1915058767","heartbeat_back_addr":"172.21.15.178:6831/1915058767","heartbeat_front_addr":"172.21.15.178:6829/1915058767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:21.707572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:46.440115+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:10.197217+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:42.853367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:08.880473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:33.605677+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:07.655377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:33.980900+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:59.397529+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:16:33.983411+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:00.932649+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:26.894098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9},{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/315567313":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/2084201061":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/3394644803":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6801/1821969949":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/2170469985":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/142516651":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6801/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/3220886565":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6800/1821969949":"2024-06-14T11:10:25.084617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:21:01.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.496+0000 7f4c78a00700 1 -- 172.21.15.2:0/846225903 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4c580a2d30 msgr2=0x7f4c580a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:01.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.496+0000 7f4c78a00700 1 --2- 172.21.15.2:0/846225903 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4c580a2d30 0x7f4c580a51f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009680 tx=0x7f4c5c012040 comp rx=0 tx=0).stop 2024-06-13T11:21:01.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.496+0000 7f4c78a00700 1 -- 172.21.15.2:0/846225903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c7406aa00 msgr2=0x7f4c7419e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:01.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.496+0000 7f4c78a00700 1 --2- 172.21.15.2:0/846225903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c7406aa00 0x7f4c7419e830 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400e9a0 tx=0x7f4c6400ecb0 comp rx=0 tx=0).stop 2024-06-13T11:21:01.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.496+0000 7f4c78a00700 1 -- 172.21.15.2:0/846225903 shutdown_connections 2024-06-13T11:21:01.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.496+0000 7f4c78a00700 1 --2- 172.21.15.2:0/846225903 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4c580a2d30 0x7f4c580a51f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:01.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.496+0000 7f4c78a00700 1 --2- 172.21.15.2:0/846225903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c7406aa00 0x7f4c7419e830 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:01.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.496+0000 7f4c78a00700 1 --2- 172.21.15.2:0/846225903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c741084d0 0x7f4c741989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:01.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.496+0000 7f4c78a00700 1 --2- 172.21.15.2:0/846225903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c7406b3a0 0x7f4c7419ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:01.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.496+0000 7f4c78a00700 1 -- 172.21.15.2:0/846225903 >> 172.21.15.2:0/846225903 conn(0x7f4c74078330 msgr2=0x7f4c740ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:01.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.496+0000 7f4c78a00700 1 -- 172.21.15.2:0/846225903 shutdown_connections 2024-06-13T11:21:01.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:01.497+0000 7f4c78a00700 1 -- 172.21.15.2:0/846225903 wait complete. 2024-06-13T11:21:02.243 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:02 smithi002 ceph-mon[32210]: pgmap v407: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:21:02.243 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:02 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/846225903' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:21:02.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:02 smithi077 ceph-mon[36410]: pgmap v407: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:21:02.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:02 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/846225903' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:21:02.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:02 smithi178 ceph-mon[36913]: pgmap v407: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:21:02.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:02 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/846225903' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:21:02.464 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-06-13T11:21:02.464 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T11:21:02.911 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:04.529 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:04 smithi002 ceph-mon[32210]: pgmap v408: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:04.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:04 smithi178 ceph-mon[36913]: pgmap v408: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:04 smithi077 ceph-mon[36410]: pgmap v408: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:05.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.098+0000 7f36d3200700 1 -- 172.21.15.2:0/2240785267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc105090 msgr2=0x7f36cc1115a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.098+0000 7f36d3200700 1 --2- 172.21.15.2:0/2240785267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc105090 0x7f36cc1115a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009f90 tx=0x7f36c400b330 comp rx=0 tx=0).stop 2024-06-13T11:21:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.098+0000 7f36d3200700 1 -- 172.21.15.2:0/2240785267 shutdown_connections 2024-06-13T11:21:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.098+0000 7f36d3200700 1 --2- 172.21.15.2:0/2240785267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36cc10a6d0 0x7f36cc10aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.098+0000 7f36d3200700 1 --2- 172.21.15.2:0/2240785267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc105090 0x7f36cc1115a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.098+0000 7f36d3200700 1 --2- 172.21.15.2:0/2240785267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36cc1046d0 0x7f36cc104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.098+0000 7f36d3200700 1 -- 172.21.15.2:0/2240785267 >> 172.21.15.2:0/2240785267 conn(0x7f36cc1001c0 msgr2=0x7f36cc1025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.098+0000 7f36d3200700 1 -- 172.21.15.2:0/2240785267 shutdown_connections 2024-06-13T11:21:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.098+0000 7f36d3200700 1 -- 172.21.15.2:0/2240785267 wait complete. 2024-06-13T11:21:05.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.099+0000 7f36d3200700 1 Processor -- start 2024-06-13T11:21:05.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.100+0000 7f36d3200700 1 -- start start 2024-06-13T11:21:05.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.100+0000 7f36d3200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36cc1046d0 0x7f36cc19add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:05.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.100+0000 7f36d3200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc105090 0x7f36cc19b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:05.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.100+0000 7f36d3200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36cc10a6d0 0x7f36cc19f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:05.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.100+0000 7f36d3200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f36cc114a20 con 0x7f36cc10a6d0 2024-06-13T11:21:05.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.100+0000 7f36d3200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f36cc1148a0 con 0x7f36cc105090 2024-06-13T11:21:05.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.100+0000 7f36d3200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f36cc114ba0 con 0x7f36cc1046d0 2024-06-13T11:21:05.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.100+0000 7f36d1200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36cc10a6d0 0x7f36cc19f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.100+0000 7f36c3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc105090 0x7f36cc19b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.100+0000 7f36cbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36cc1046d0 0x7f36cc19add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.100+0000 7f36cbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36cc1046d0 0x7f36cc19add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:50830/0 (socket says 172.21.15.2:50830) 2024-06-13T11:21:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.100+0000 7f36c3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc105090 0x7f36cc19b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:37904/0 (socket says 172.21.15.2:37904) 2024-06-13T11:21:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.100+0000 7f36cbe00700 1 -- 172.21.15.2:0/1236472796 learned_addr learned my addr 172.21.15.2:0/1236472796 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.101+0000 7f36c3e00700 1 -- 172.21.15.2:0/1236472796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36cc1046d0 msgr2=0x7f36cc19add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.101+0000 7f36c3e00700 1 --2- 172.21.15.2:0/1236472796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36cc1046d0 0x7f36cc19add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.101+0000 7f36c3e00700 1 -- 172.21.15.2:0/1236472796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36cc10a6d0 msgr2=0x7f36cc19f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.101+0000 7f36c3e00700 1 --2- 172.21.15.2:0/1236472796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36cc10a6d0 0x7f36cc19f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.101+0000 7f36c3e00700 1 -- 172.21.15.2:0/1236472796 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36cc19fde0 con 0x7f36cc105090 2024-06-13T11:21:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.101+0000 7f36c3e00700 1 --2- 172.21.15.2:0/1236472796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc105090 0x7f36cc19b310 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f36b400e9f0 tx=0x7f36b400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.102+0000 7f36c9600700 1 -- 172.21.15.2:0/1236472796 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4004220 con 0x7f36cc105090 2024-06-13T11:21:05.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.102+0000 7f36d3200700 1 -- 172.21.15.2:0/1236472796 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36cc1a00d0 con 0x7f36cc105090 2024-06-13T11:21:05.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.102+0000 7f36c9600700 1 -- 172.21.15.2:0/1236472796 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36b4004d10 con 0x7f36cc105090 2024-06-13T11:21:05.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.102+0000 7f36c9600700 1 -- 172.21.15.2:0/1236472796 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4005020 con 0x7f36cc105090 2024-06-13T11:21:05.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.102+0000 7f36d3200700 1 -- 172.21.15.2:0/1236472796 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36cc1a7950 con 0x7f36cc105090 2024-06-13T11:21:05.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.103+0000 7f36d3200700 1 -- 172.21.15.2:0/1236472796 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36cc069180 con 0x7f36cc105090 2024-06-13T11:21:05.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.105+0000 7f36c9600700 1 -- 172.21.15.2:0/1236472796 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f36b4042b10 con 0x7f36cc105090 2024-06-13T11:21:05.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.106+0000 7f36c9600700 1 --2- 172.21.15.2:0/1236472796 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f36b00a2cb0 0x7f36b00a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:05.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.106+0000 7f36c9600700 1 -- 172.21.15.2:0/1236472796 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f36b40cf470 con 0x7f36cc105090 2024-06-13T11:21:05.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.107+0000 7f36cbe00700 1 --2- 172.21.15.2:0/1236472796 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f36b00a2cb0 0x7f36b00a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:05.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.107+0000 7f36cbe00700 1 --2- 172.21.15.2:0/1236472796 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f36b00a2cb0 0x7f36b00a5170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009750 tx=0x7f36bc009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:05.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.109+0000 7f36c9600700 1 -- 172.21.15.2:0/1236472796 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f36b401f3a0 con 0x7f36cc105090 2024-06-13T11:21:05.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.341+0000 7f36d3200700 1 -- 172.21.15.2:0/1236472796 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36cc19c130 con 0x7f36cc105090 2024-06-13T11:21:05.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.344+0000 7f36c9600700 1 -- 172.21.15.2:0/1236472796 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24612 (secure 0 0 0) 0x7f36cc19c130 con 0x7f36cc105090 2024-06-13T11:21:05.343 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:21:05.344 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":99,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","created":"2024-06-13T11:09:07.839101+0000","modified":"2024-06-13T11:20:27.512678+0000","last_up_change":"2024-06-13T11:17:28.731479+0000","last_in_change":"2024-06-13T11:17:08.849067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:13:13.793461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:18:36.784824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:18:41.824835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:18:55.545870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f5614d91-49a7-4983-a309-0de3b3e6263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6803","nonce":4127571834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6805","nonce":4127571834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6809","nonce":4127571834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6807","nonce":4127571834}]},"public_addr":"172.21.15.2:6803/4127571834","cluster_addr":"172.21.15.2:6805/4127571834","heartbeat_back_addr":"172.21.15.2:6809/4127571834","heartbeat_front_addr":"172.21.15.2:6807/4127571834","state":["exists","up"]},{"osd":1,"uuid":"d9dbe278-309f-4726-828a-da922f486b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6801","nonce":3180360713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6803","nonce":3180360713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6807","nonce":3180360713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6805","nonce":3180360713}]},"public_addr":"172.21.15.77:6801/3180360713","cluster_addr":"172.21.15.77:6803/3180360713","heartbeat_back_addr":"172.21.15.77:6807/3180360713","heartbeat_front_addr":"172.21.15.77:6805/3180360713","state":["exists","up"]},{"osd":2,"uuid":"04c267dc-7454-418f-9965-3ff96ef280ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6801","nonce":3825510575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6803","nonce":3825510575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6807","nonce":3825510575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6805","nonce":3825510575}]},"public_addr":"172.21.15.178:6801/3825510575","cluster_addr":"172.21.15.178:6803/3825510575","heartbeat_back_addr":"172.21.15.178:6807/3825510575","heartbeat_front_addr":"172.21.15.178:6805/3825510575","state":["exists","up"]},{"osd":3,"uuid":"3847bd4f-ca04-41de-9d88-e1523dd7ff8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6811","nonce":1982693353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6813","nonce":1982693353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6817","nonce":1982693353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6815","nonce":1982693353}]},"public_addr":"172.21.15.2:6811/1982693353","cluster_addr":"172.21.15.2:6813/1982693353","heartbeat_back_addr":"172.21.15.2:6817/1982693353","heartbeat_front_addr":"172.21.15.2:6815/1982693353","state":["exists","up"]},{"osd":4,"uuid":"34d7d2e8-3dee-42b9-a6cb-d4162b122b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6809","nonce":3916694904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6811","nonce":3916694904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6815","nonce":3916694904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6813","nonce":3916694904}]},"public_addr":"172.21.15.77:6809/3916694904","cluster_addr":"172.21.15.77:6811/3916694904","heartbeat_back_addr":"172.21.15.77:6815/3916694904","heartbeat_front_addr":"172.21.15.77:6813/3916694904","state":["exists","up"]},{"osd":5,"uuid":"0468aefc-c3c8-4758-9bbf-1225b7a5ae79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6809","nonce":3572805887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6811","nonce":3572805887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6815","nonce":3572805887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6813","nonce":3572805887}]},"public_addr":"172.21.15.178:6809/3572805887","cluster_addr":"172.21.15.178:6811/3572805887","heartbeat_back_addr":"172.21.15.178:6815/3572805887","heartbeat_front_addr":"172.21.15.178:6813/3572805887","state":["exists","up"]},{"osd":6,"uuid":"0a186a4a-0e28-47bd-b5ad-9bf8079f74c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6819","nonce":1592309584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6821","nonce":1592309584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6825","nonce":1592309584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6823","nonce":1592309584}]},"public_addr":"172.21.15.2:6819/1592309584","cluster_addr":"172.21.15.2:6821/1592309584","heartbeat_back_addr":"172.21.15.2:6825/1592309584","heartbeat_front_addr":"172.21.15.2:6823/1592309584","state":["exists","up"]},{"osd":7,"uuid":"646e66f7-1ef8-428d-a842-bf28c8606df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6817","nonce":1580055775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6819","nonce":1580055775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6823","nonce":1580055775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6821","nonce":1580055775}]},"public_addr":"172.21.15.77:6817/1580055775","cluster_addr":"172.21.15.77:6819/1580055775","heartbeat_back_addr":"172.21.15.77:6823/1580055775","heartbeat_front_addr":"172.21.15.77:6821/1580055775","state":["exists","up"]},{"osd":8,"uuid":"bcc971fc-47d7-4289-8a9a-c76996c57370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6817","nonce":4285192591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6819","nonce":4285192591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6823","nonce":4285192591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6821","nonce":4285192591}]},"public_addr":"172.21.15.178:6817/4285192591","cluster_addr":"172.21.15.178:6819/4285192591","heartbeat_back_addr":"172.21.15.178:6823/4285192591","heartbeat_front_addr":"172.21.15.178:6821/4285192591","state":["exists","up"]},{"osd":9,"uuid":"899d7d4f-a24c-4508-b42c-0b363275c459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6827","nonce":4187017478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6829","nonce":4187017478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6833","nonce":4187017478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6831","nonce":4187017478}]},"public_addr":"172.21.15.2:6827/4187017478","cluster_addr":"172.21.15.2:6829/4187017478","heartbeat_back_addr":"172.21.15.2:6833/4187017478","heartbeat_front_addr":"172.21.15.2:6831/4187017478","state":["exists","up"]},{"osd":10,"uuid":"112d2b8e-9673-4d7a-97e9-2089793fdd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6825","nonce":2039538463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6827","nonce":2039538463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6831","nonce":2039538463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6829","nonce":2039538463}]},"public_addr":"172.21.15.77:6825/2039538463","cluster_addr":"172.21.15.77:6827/2039538463","heartbeat_back_addr":"172.21.15.77:6831/2039538463","heartbeat_front_addr":"172.21.15.77:6829/2039538463","state":["exists","up"]},{"osd":11,"uuid":"6b8001f5-9c74-4cc7-8c41-906cb5ac9b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6825","nonce":1915058767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6827","nonce":1915058767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6831","nonce":1915058767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6829","nonce":1915058767}]},"public_addr":"172.21.15.178:6825/1915058767","cluster_addr":"172.21.15.178:6827/1915058767","heartbeat_back_addr":"172.21.15.178:6831/1915058767","heartbeat_front_addr":"172.21.15.178:6829/1915058767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:21.707572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:46.440115+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:10.197217+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:42.853367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:08.880473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:33.605677+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:07.655377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:33.980900+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:59.397529+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:16:33.983411+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:00.932649+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:26.894098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9},{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/315567313":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/2084201061":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/3394644803":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6801/1821969949":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/2170469985":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/142516651":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6801/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/3220886565":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6800/1821969949":"2024-06-14T11:10:25.084617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:21:05.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.347+0000 7f36d3200700 1 -- 172.21.15.2:0/1236472796 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f36b00a2cb0 msgr2=0x7f36b00a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:05.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.347+0000 7f36d3200700 1 --2- 172.21.15.2:0/1236472796 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f36b00a2cb0 0x7f36b00a5170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009750 tx=0x7f36bc009310 comp rx=0 tx=0).stop 2024-06-13T11:21:05.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.347+0000 7f36d3200700 1 -- 172.21.15.2:0/1236472796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc105090 msgr2=0x7f36cc19b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:05.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.347+0000 7f36d3200700 1 --2- 172.21.15.2:0/1236472796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc105090 0x7f36cc19b310 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f36b400e9f0 tx=0x7f36b400ed00 comp rx=0 tx=0).stop 2024-06-13T11:21:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.347+0000 7f36d3200700 1 -- 172.21.15.2:0/1236472796 shutdown_connections 2024-06-13T11:21:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.347+0000 7f36d3200700 1 --2- 172.21.15.2:0/1236472796 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f36b00a2cb0 0x7f36b00a5170 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.347+0000 7f36d3200700 1 --2- 172.21.15.2:0/1236472796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36cc10a6d0 0x7f36cc19f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.347+0000 7f36d3200700 1 --2- 172.21.15.2:0/1236472796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36cc1046d0 0x7f36cc19add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.347+0000 7f36d3200700 1 --2- 172.21.15.2:0/1236472796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36cc105090 0x7f36cc19b310 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.347+0000 7f36d3200700 1 -- 172.21.15.2:0/1236472796 >> 172.21.15.2:0/1236472796 conn(0x7f36cc1001c0 msgr2=0x7f36cc1006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.347+0000 7f36d3200700 1 -- 172.21.15.2:0/1236472796 shutdown_connections 2024-06-13T11:21:05.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:05.347+0000 7f36d3200700 1 -- 172.21.15.2:0/1236472796 wait complete. 2024-06-13T11:21:05.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:05 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1236472796' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:21:05.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:05 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1236472796' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:21:05.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:05 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1236472796' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:21:06.287 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-06-13T11:21:06.288 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-06-13T11:21:06.288 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-06-13T11:21:06.289 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-06-13T11:21:06.289 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-06-13T11:21:06.289 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-06-13T11:21:06.290 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-06-13T11:21:06.290 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-06-13T11:21:06.291 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-06-13T11:21:06.291 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-06-13T11:21:06.292 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-06-13T11:21:06.292 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-06-13T11:21:06.490 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:06 smithi002 ceph-mon[32210]: pgmap v409: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:21:06.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:06 smithi178 ceph-mon[36913]: pgmap v409: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:21:06.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:06 smithi077 ceph-mon[36410]: pgmap v409: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:21:07.273 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:07.310 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:08.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:08 smithi002 ceph-mon[32210]: pgmap v410: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T11:21:08.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:08 smithi178 ceph-mon[36913]: pgmap v410: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T11:21:08.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:08 smithi077 ceph-mon[36410]: pgmap v410: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T11:21:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:10.444 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:10.449 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:10.450 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:10.792 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:10.792 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:10.793 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:10.796 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:10.805 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:11.045 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:10 smithi002 ceph-mon[32210]: pgmap v411: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:11.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:10 smithi077 ceph-mon[36410]: pgmap v411: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:11.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:10 smithi178 ceph-mon[36913]: pgmap v411: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.486+0000 7f4b69000700 1 -- 172.21.15.2:0/731777042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b641045c0 msgr2=0x7f4b64104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.486+0000 7f4b69000700 1 --2- 172.21.15.2:0/731777042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b641045c0 0x7f4b64104a40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0098f0 tx=0x7f4b4c009c00 comp rx=0 tx=0).stop 2024-06-13T11:21:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.487+0000 7f4b69000700 1 -- 172.21.15.2:0/731777042 shutdown_connections 2024-06-13T11:21:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.487+0000 7f4b69000700 1 --2- 172.21.15.2:0/731777042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b6410a650 0x7f4b6410aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.487+0000 7f4b69000700 1 --2- 172.21.15.2:0/731777042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b64104f80 0x7f4b64111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.487+0000 7f4b69000700 1 --2- 172.21.15.2:0/731777042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b641045c0 0x7f4b64104a40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.487+0000 7f4b69000700 1 -- 172.21.15.2:0/731777042 >> 172.21.15.2:0/731777042 conn(0x7f4b641000b0 msgr2=0x7f4b641024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.487+0000 7f4b69000700 1 -- 172.21.15.2:0/731777042 shutdown_connections 2024-06-13T11:21:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.487+0000 7f4b69000700 1 -- 172.21.15.2:0/731777042 wait complete. 2024-06-13T11:21:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.488+0000 7f4b69000700 1 Processor -- start 2024-06-13T11:21:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.488+0000 7f4b69000700 1 -- start start 2024-06-13T11:21:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.489+0000 7f4b69000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b641045c0 0x7f4b6419ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.489+0000 7f4b69000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b64104f80 0x7f4b6419b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.489+0000 7f4b69000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b6410a650 0x7f4b6419f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.489+0000 7f4b69000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4b64114940 con 0x7f4b64104f80 2024-06-13T11:21:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.489+0000 7f4b69000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4b641147c0 con 0x7f4b641045c0 2024-06-13T11:21:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.489+0000 7f4b69000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4b64114ac0 con 0x7f4b6410a650 2024-06-13T11:21:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.489+0000 7f4b63400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b641045c0 0x7f4b6419ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.489+0000 7f4b5aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b64104f80 0x7f4b6419b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.489+0000 7f4b63400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b641045c0 0x7f4b6419ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:44620/0 (socket says 172.21.15.2:44620) 2024-06-13T11:21:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.489+0000 7f4b63e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b6410a650 0x7f4b6419f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.489+0000 7f4b63400700 1 -- 172.21.15.2:0/132513552 learned_addr learned my addr 172.21.15.2:0/132513552 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.490+0000 7f4b63e00700 1 -- 172.21.15.2:0/132513552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b641045c0 msgr2=0x7f4b6419ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.490+0000 7f4b63e00700 1 --2- 172.21.15.2:0/132513552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b641045c0 0x7f4b6419ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.490+0000 7f4b63e00700 1 -- 172.21.15.2:0/132513552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b64104f80 msgr2=0x7f4b6419b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.490+0000 7f4b63e00700 1 --2- 172.21.15.2:0/132513552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b64104f80 0x7f4b6419b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.490+0000 7f4b63e00700 1 -- 172.21.15.2:0/132513552 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6419fd30 con 0x7f4b6410a650 2024-06-13T11:21:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.490+0000 7f4b63400700 1 --2- 172.21.15.2:0/132513552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b641045c0 0x7f4b6419ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:21:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.490+0000 7f4b63e00700 1 --2- 172.21.15.2:0/132513552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b6410a650 0x7f4b6419f5f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00efb0 tx=0x7f4b5c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.490+0000 7f4b60c00700 1 -- 172.21.15.2:0/132513552 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c003a00 con 0x7f4b6410a650 2024-06-13T11:21:13.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.490+0000 7f4b69000700 1 -- 172.21.15.2:0/132513552 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b641a0020 con 0x7f4b6410a650 2024-06-13T11:21:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.491+0000 7f4b60c00700 1 -- 172.21.15.2:0/132513552 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b5c003ba0 con 0x7f4b6410a650 2024-06-13T11:21:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.491+0000 7f4b60c00700 1 -- 172.21.15.2:0/132513552 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c004850 con 0x7f4b6410a650 2024-06-13T11:21:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.491+0000 7f4b69000700 1 -- 172.21.15.2:0/132513552 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b641a78a0 con 0x7f4b6410a650 2024-06-13T11:21:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.491+0000 7f4b69000700 1 -- 172.21.15.2:0/132513552 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4b64062be0 con 0x7f4b6410a650 2024-06-13T11:21:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.494+0000 7f4b60c00700 1 -- 172.21.15.2:0/132513552 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f4b5c012050 con 0x7f4b6410a650 2024-06-13T11:21:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.495+0000 7f4b60c00700 1 --2- 172.21.15.2:0/132513552 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4b480a2cb0 0x7f4b480a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.495+0000 7f4b60c00700 1 -- 172.21.15.2:0/132513552 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f4b5c0cf3c0 con 0x7f4b6410a650 2024-06-13T11:21:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.496+0000 7f4b63400700 1 --2- 172.21.15.2:0/132513552 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4b480a2cb0 0x7f4b480a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.496+0000 7f4b60c00700 1 --2- 172.21.15.2:0/132513552 >> [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775] conn(0x7f4b480ade90 0x7f4b480b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.496+0000 7f4b60c00700 1 -- 172.21.15.2:0/132513552 --> [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b480b0a00 con 0x7f4b480ade90 2024-06-13T11:21:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.496+0000 7f4b60c00700 1 -- 172.21.15.2:0/132513552 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f4b5c0cf770 con 0x7f4b6410a650 2024-06-13T11:21:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.496+0000 7f4b5aa00700 1 --2- 172.21.15.2:0/132513552 >> [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775] conn(0x7f4b480ade90 0x7f4b480b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.497+0000 7f4b63400700 1 --2- 172.21.15.2:0/132513552 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4b480a2cb0 0x7f4b480a5170 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009fd0 tx=0x7f4b54009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.497+0000 7f4b5aa00700 1 --2- 172.21.15.2:0/132513552 >> [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775] conn(0x7f4b480ade90 0x7f4b480b0330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.498+0000 7f4b60c00700 1 -- 172.21.15.2:0/132513552 <== osd.7 v2:172.21.15.77:6816/1580055775 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4b480b0a00 con 0x7f4b480ade90 2024-06-13T11:21:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.516+0000 7f4b69000700 1 -- 172.21.15.2:0/132513552 --> [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4b64063060 con 0x7f4b480ade90 2024-06-13T11:21:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.517+0000 7f4b60c00700 1 -- 172.21.15.2:0/132513552 <== osd.7 v2:172.21.15.77:6816/1580055775 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4b64063060 con 0x7f4b480ade90 2024-06-13T11:21:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.518+0000 7f4b69000700 1 -- 172.21.15.2:0/132513552 >> [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775] conn(0x7f4b480ade90 msgr2=0x7f4b480b0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.518+0000 7f4b69000700 1 --2- 172.21.15.2:0/132513552 >> [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775] conn(0x7f4b480ade90 0x7f4b480b0330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.518+0000 7f4b69000700 1 -- 172.21.15.2:0/132513552 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4b480a2cb0 msgr2=0x7f4b480a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.518+0000 7f4b69000700 1 --2- 172.21.15.2:0/132513552 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4b480a2cb0 0x7f4b480a5170 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009fd0 tx=0x7f4b54009310 comp rx=0 tx=0).stop 2024-06-13T11:21:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.518+0000 7f4b69000700 1 -- 172.21.15.2:0/132513552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b6410a650 msgr2=0x7f4b6419f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.518+0000 7f4b69000700 1 --2- 172.21.15.2:0/132513552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b6410a650 0x7f4b6419f5f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00efb0 tx=0x7f4b5c00c3a0 comp rx=0 tx=0).stop 2024-06-13T11:21:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.518+0000 7f4b63e00700 1 -- 172.21.15.2:0/132513552 reap_dead start 2024-06-13T11:21:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.518+0000 7f4b69000700 1 -- 172.21.15.2:0/132513552 shutdown_connections 2024-06-13T11:21:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.518+0000 7f4b69000700 1 -- 172.21.15.2:0/132513552 >> 172.21.15.2:0/132513552 conn(0x7f4b641000b0 msgr2=0x7f4b641016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:13.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.518+0000 7f4b69000700 1 -- 172.21.15.2:0/132513552 shutdown_connections 2024-06-13T11:21:13.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:12.518+0000 7f4b69000700 1 -- 172.21.15.2:0/132513552 wait complete. 2024-06-13T11:21:13.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:12 smithi002 ceph-mon[32210]: pgmap v412: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:21:13.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:12 smithi077 ceph-mon[36410]: pgmap v412: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:21:13.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:12 smithi178 ceph-mon[36913]: pgmap v412: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:21:15.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:14 smithi002 ceph-mon[32210]: pgmap v413: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:15.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:14 smithi077 ceph-mon[36410]: pgmap v413: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:15.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:14 smithi178 ceph-mon[36913]: pgmap v413: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:17.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.157+0000 7fd245000700 1 -- 172.21.15.2:0/1744386313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240102540 msgr2=0x7fd2401029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:17.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.157+0000 7fd245000700 1 --2- 172.21.15.2:0/1744386313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240102540 0x7fd2401029a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd228009990 tx=0x7fd228009ca0 comp rx=0 tx=0).stop 2024-06-13T11:21:17.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.157+0000 7fd245000700 1 -- 172.21.15.2:0/1744386313 shutdown_connections 2024-06-13T11:21:17.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.157+0000 7fd245000700 1 --2- 172.21.15.2:0/1744386313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd240102ee0 0x7fd24010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:17.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.157+0000 7fd245000700 1 --2- 172.21.15.2:0/1744386313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd240107450 0x7fd240107830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:17.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.157+0000 7fd245000700 1 --2- 172.21.15.2:0/1744386313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240102540 0x7fd2401029a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:17.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.157+0000 7fd245000700 1 -- 172.21.15.2:0/1744386313 >> 172.21.15.2:0/1744386313 conn(0x7fd2400795f0 msgr2=0x7fd240079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:17.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.157+0000 7fd245000700 1 -- 172.21.15.2:0/1744386313 shutdown_connections 2024-06-13T11:21:17.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.157+0000 7fd245000700 1 -- 172.21.15.2:0/1744386313 wait complete. 2024-06-13T11:21:17.158 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:16 smithi002 ceph-mon[32210]: pgmap v414: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:21:17.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.158+0000 7fd245000700 1 Processor -- start 2024-06-13T11:21:17.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.159+0000 7fd245000700 1 -- start start 2024-06-13T11:21:17.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.159+0000 7fd245000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240102540 0x7fd24019e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:17.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.159+0000 7fd245000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd240102ee0 0x7fd24019ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:17.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.159+0000 7fd245000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd240107450 0x7fd240198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:17.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.159+0000 7fd245000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd2401127e0 con 0x7fd240102540 2024-06-13T11:21:17.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.159+0000 7fd245000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd240112660 con 0x7fd240107450 2024-06-13T11:21:17.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.159+0000 7fd245000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd240112960 con 0x7fd240102ee0 2024-06-13T11:21:17.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.159+0000 7fd23de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240102540 0x7fd24019e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:17.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.159+0000 7fd23de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240102540 0x7fd24019e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60108/0 (socket says 172.21.15.2:60108) 2024-06-13T11:21:17.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.159+0000 7fd23de00700 1 -- 172.21.15.2:0/1718320028 learned_addr learned my addr 172.21.15.2:0/1718320028 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:17.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.159+0000 7fd235400700 1 --2- 172.21.15.2:0/1718320028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd240102ee0 0x7fd24019ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:17.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.160+0000 7fd23e800700 1 --2- 172.21.15.2:0/1718320028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd240107450 0x7fd240198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:17.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.160+0000 7fd23de00700 1 -- 172.21.15.2:0/1718320028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd240102ee0 msgr2=0x7fd24019ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:17.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.160+0000 7fd23de00700 1 --2- 172.21.15.2:0/1718320028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd240102ee0 0x7fd24019ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:17.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.160+0000 7fd23de00700 1 -- 172.21.15.2:0/1718320028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd240107450 msgr2=0x7fd240198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:17.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.160+0000 7fd23de00700 1 --2- 172.21.15.2:0/1718320028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd240107450 0x7fd240198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:17.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.160+0000 7fd23de00700 1 -- 172.21.15.2:0/1718320028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2401991c0 con 0x7fd240102540 2024-06-13T11:21:17.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.160+0000 7fd23de00700 1 --2- 172.21.15.2:0/1718320028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240102540 0x7fd24019e8a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd23000c140 tx=0x7fd23000c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:17.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.161+0000 7fd237400700 1 -- 172.21.15.2:0/1718320028 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23000ccd0 con 0x7fd240102540 2024-06-13T11:21:17.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.161+0000 7fd237400700 1 -- 172.21.15.2:0/1718320028 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd230018070 con 0x7fd240102540 2024-06-13T11:21:17.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.161+0000 7fd237400700 1 -- 172.21.15.2:0/1718320028 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd230013660 con 0x7fd240102540 2024-06-13T11:21:17.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.161+0000 7fd245000700 1 -- 172.21.15.2:0/1718320028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd240199450 con 0x7fd240102540 2024-06-13T11:21:17.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.161+0000 7fd245000700 1 -- 172.21.15.2:0/1718320028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2401a5770 con 0x7fd240102540 2024-06-13T11:21:17.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.162+0000 7fd245000700 1 -- 172.21.15.2:0/1718320028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd240062ba0 con 0x7fd240102540 2024-06-13T11:21:17.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.164+0000 7fd237400700 1 -- 172.21.15.2:0/1718320028 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fd230012070 con 0x7fd240102540 2024-06-13T11:21:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.166+0000 7fd237400700 1 --2- 172.21.15.2:0/1718320028 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd2240a2d30 0x7fd2240a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.166+0000 7fd237400700 1 -- 172.21.15.2:0/1718320028 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fd2300cfa00 con 0x7fd240102540 2024-06-13T11:21:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.166+0000 7fd235400700 1 --2- 172.21.15.2:0/1718320028 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd2240a2d30 0x7fd2240a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:17.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.166+0000 7fd237400700 1 --2- 172.21.15.2:0/1718320028 >> [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575] conn(0x7fd2240adf10 0x7fd2240b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.167+0000 7fd237400700 1 -- 172.21.15.2:0/1718320028 --> [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd23000de50 con 0x7fd2240adf10 2024-06-13T11:21:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.167+0000 7fd237400700 1 -- 172.21.15.2:0/1718320028 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7fd2300cfdb0 con 0x7fd240102540 2024-06-13T11:21:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.167+0000 7fd23e800700 1 --2- 172.21.15.2:0/1718320028 >> [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575] conn(0x7fd2240adf10 0x7fd2240b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.167+0000 7fd235400700 1 --2- 172.21.15.2:0/1718320028 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd2240a2d30 0x7fd2240a51f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd2280098e0 tx=0x7fd228005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:17.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.167+0000 7fd23e800700 1 --2- 172.21.15.2:0/1718320028 >> [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575] conn(0x7fd2240adf10 0x7fd2240b03b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:17.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.168+0000 7fd237400700 1 -- 172.21.15.2:0/1718320028 <== osd.2 v2:172.21.15.178:6800/3825510575 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd23000de50 con 0x7fd2240adf10 2024-06-13T11:21:17.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.187+0000 7fd245000700 1 -- 172.21.15.2:0/1718320028 --> [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd240063070 con 0x7fd2240adf10 2024-06-13T11:21:17.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.187+0000 7fd237400700 1 -- 172.21.15.2:0/1718320028 <== osd.2 v2:172.21.15.178:6800/3825510575 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd240063070 con 0x7fd2240adf10 2024-06-13T11:21:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.188+0000 7fd245000700 1 -- 172.21.15.2:0/1718320028 >> [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575] conn(0x7fd2240adf10 msgr2=0x7fd2240b03b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.188+0000 7fd245000700 1 --2- 172.21.15.2:0/1718320028 >> [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575] conn(0x7fd2240adf10 0x7fd2240b03b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.188+0000 7fd245000700 1 -- 172.21.15.2:0/1718320028 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd2240a2d30 msgr2=0x7fd2240a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.188+0000 7fd245000700 1 --2- 172.21.15.2:0/1718320028 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd2240a2d30 0x7fd2240a51f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd2280098e0 tx=0x7fd228005960 comp rx=0 tx=0).stop 2024-06-13T11:21:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.188+0000 7fd245000700 1 -- 172.21.15.2:0/1718320028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240102540 msgr2=0x7fd24019e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.188+0000 7fd245000700 1 --2- 172.21.15.2:0/1718320028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd240102540 0x7fd24019e8a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd23000c140 tx=0x7fd23000c450 comp rx=0 tx=0).stop 2024-06-13T11:21:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.188+0000 7fd23e800700 1 -- 172.21.15.2:0/1718320028 reap_dead start 2024-06-13T11:21:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.189+0000 7fd245000700 1 -- 172.21.15.2:0/1718320028 shutdown_connections 2024-06-13T11:21:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.189+0000 7fd245000700 1 -- 172.21.15.2:0/1718320028 >> 172.21.15.2:0/1718320028 conn(0x7fd2400795f0 msgr2=0x7fd240100550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.189+0000 7fd245000700 1 -- 172.21.15.2:0/1718320028 shutdown_connections 2024-06-13T11:21:17.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:17.189+0000 7fd245000700 1 -- 172.21.15.2:0/1718320028 wait complete. 2024-06-13T11:21:17.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:16 smithi077 ceph-mon[36410]: pgmap v414: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:21:17.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:16 smithi178 ceph-mon[36913]: pgmap v414: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:21:18.728 INFO:teuthology.orchestra.run.smithi002.stdout:219043332166 2024-06-13T11:21:18.728 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-06-13T11:21:19.234 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:18 smithi002 ceph-mon[32210]: pgmap v415: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T11:21:19.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:18 smithi077 ceph-mon[36410]: pgmap v415: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T11:21:19.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:18 smithi178 ceph-mon[36913]: pgmap v415: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T11:21:21.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:20 smithi077 ceph-mon[36410]: pgmap v416: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:21.307 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:20 smithi002 ceph-mon[32210]: pgmap v416: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:21.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:20 smithi178 ceph-mon[36913]: pgmap v416: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:23.087 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:22 smithi002 ceph-mon[32210]: pgmap v417: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:21:23.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.173+0000 7f4f3fa00700 1 -- 172.21.15.2:0/1498060181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f38107840 msgr2=0x7f4f3810f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:23.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.173+0000 7f4f3fa00700 1 --2- 172.21.15.2:0/1498060181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f38107840 0x7f4f3810f3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000b0d0 tx=0x7f4f3000b3e0 comp rx=0 tx=0).stop 2024-06-13T11:21:23.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.173+0000 7f4f3fa00700 1 -- 172.21.15.2:0/1498060181 shutdown_connections 2024-06-13T11:21:23.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.173+0000 7f4f3fa00700 1 --2- 172.21.15.2:0/1498060181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38102740 0x7f4f38102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:23.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.173+0000 7f4f3fa00700 1 --2- 172.21.15.2:0/1498060181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f38107840 0x7f4f3810f3c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:23.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.173+0000 7f4f3fa00700 1 --2- 172.21.15.2:0/1498060181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f381030f0 0x7f4f38107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:23.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.173+0000 7f4f3fa00700 1 -- 172.21.15.2:0/1498060181 >> 172.21.15.2:0/1498060181 conn(0x7f4f380795f0 msgr2=0x7f4f38079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:23.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.173+0000 7f4f3fa00700 1 -- 172.21.15.2:0/1498060181 shutdown_connections 2024-06-13T11:21:23.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.173+0000 7f4f3fa00700 1 -- 172.21.15.2:0/1498060181 wait complete. 2024-06-13T11:21:23.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.174+0000 7f4f3fa00700 1 Processor -- start 2024-06-13T11:21:23.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.175+0000 7f4f3fa00700 1 -- start start 2024-06-13T11:21:23.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.175+0000 7f4f3fa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38102740 0x7f4f3819e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:23.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.175+0000 7f4f3fa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f381030f0 0x7f4f3819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:23.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.175+0000 7f4f3fa00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f38107840 0x7f4f381989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:23.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.175+0000 7f4f3fa00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4f381127b0 con 0x7f4f38102740 2024-06-13T11:21:23.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.175+0000 7f4f3fa00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4f38112630 con 0x7f4f38107840 2024-06-13T11:21:23.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.175+0000 7f4f3fa00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4f38112930 con 0x7f4f381030f0 2024-06-13T11:21:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.175+0000 7f4f3d000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38102740 0x7f4f3819e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.175+0000 7f4f3da00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f38107840 0x7f4f381989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.175+0000 7f4f37e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f381030f0 0x7f4f3819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.175+0000 7f4f3da00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f38107840 0x7f4f381989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:42298/0 (socket says 172.21.15.2:42298) 2024-06-13T11:21:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.176+0000 7f4f3da00700 1 -- 172.21.15.2:0/999092782 learned_addr learned my addr 172.21.15.2:0/999092782 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.176+0000 7f4f3d000700 1 --2- 172.21.15.2:0/999092782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38102740 0x7f4f3819e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60162/0 (socket says 172.21.15.2:60162) 2024-06-13T11:21:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.176+0000 7f4f3da00700 1 -- 172.21.15.2:0/999092782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f381030f0 msgr2=0x7f4f3819ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.176+0000 7f4f3da00700 1 --2- 172.21.15.2:0/999092782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f381030f0 0x7f4f3819ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.176+0000 7f4f3da00700 1 -- 172.21.15.2:0/999092782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38102740 msgr2=0x7f4f3819e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.176+0000 7f4f3da00700 1 --2- 172.21.15.2:0/999092782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38102740 0x7f4f3819e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.176+0000 7f4f3da00700 1 -- 172.21.15.2:0/999092782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f38199150 con 0x7f4f38107840 2024-06-13T11:21:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.176+0000 7f4f3da00700 1 --2- 172.21.15.2:0/999092782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f38107840 0x7f4f381989f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000d010 tx=0x7f4f300079a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:23.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.177+0000 7f4f35600700 1 -- 172.21.15.2:0/999092782 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f30003c00 con 0x7f4f38107840 2024-06-13T11:21:23.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.177+0000 7f4f35600700 1 -- 172.21.15.2:0/999092782 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f30007e10 con 0x7f4f38107840 2024-06-13T11:21:23.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.177+0000 7f4f35600700 1 -- 172.21.15.2:0/999092782 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3001b8d0 con 0x7f4f38107840 2024-06-13T11:21:23.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.177+0000 7f4f3fa00700 1 -- 172.21.15.2:0/999092782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f381993e0 con 0x7f4f38107840 2024-06-13T11:21:23.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.177+0000 7f4f3fa00700 1 -- 172.21.15.2:0/999092782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f381a56b0 con 0x7f4f38107840 2024-06-13T11:21:23.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.178+0000 7f4f3fa00700 1 -- 172.21.15.2:0/999092782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4f38062c20 con 0x7f4f38107840 2024-06-13T11:21:23.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.180+0000 7f4f35600700 1 -- 172.21.15.2:0/999092782 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f4f30009ba0 con 0x7f4f38107840 2024-06-13T11:21:23.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.181+0000 7f4f35600700 1 --2- 172.21.15.2:0/999092782 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4f200a2d30 0x7f4f200a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:23.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.181+0000 7f4f35600700 1 -- 172.21.15.2:0/999092782 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f4f3000f020 con 0x7f4f38107840 2024-06-13T11:21:23.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.182+0000 7f4f3d000700 1 --2- 172.21.15.2:0/999092782 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4f200a2d30 0x7f4f200a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:23.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.182+0000 7f4f35600700 1 --2- 172.21.15.2:0/999092782 >> [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478] conn(0x7f4f200adf10 0x7f4f200b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:23.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.182+0000 7f4f35600700 1 -- 172.21.15.2:0/999092782 --> [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f3002de50 con 0x7f4f200adf10 2024-06-13T11:21:23.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.182+0000 7f4f35600700 1 -- 172.21.15.2:0/999092782 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f4f300d0b80 con 0x7f4f38107840 2024-06-13T11:21:23.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.182+0000 7f4f37e00700 1 --2- 172.21.15.2:0/999092782 >> [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478] conn(0x7f4f200adf10 0x7f4f200b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:23.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.182+0000 7f4f3d000700 1 --2- 172.21.15.2:0/999092782 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4f200a2d30 0x7f4f200a51f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4f38107420 tx=0x7f4f2c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:23.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.183+0000 7f4f37e00700 1 --2- 172.21.15.2:0/999092782 >> [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478] conn(0x7f4f200adf10 0x7f4f200b03b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:23.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.184+0000 7f4f35600700 1 -- 172.21.15.2:0/999092782 <== osd.9 v2:172.21.15.2:6826/4187017478 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4f3002de50 con 0x7f4f200adf10 2024-06-13T11:21:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.202+0000 7f4f3fa00700 1 -- 172.21.15.2:0/999092782 --> [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4f380630f0 con 0x7f4f200adf10 2024-06-13T11:21:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.203+0000 7f4f35600700 1 -- 172.21.15.2:0/999092782 <== osd.9 v2:172.21.15.2:6826/4187017478 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4f380630f0 con 0x7f4f200adf10 2024-06-13T11:21:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.203+0000 7f4f3fa00700 1 -- 172.21.15.2:0/999092782 >> [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478] conn(0x7f4f200adf10 msgr2=0x7f4f200b03b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.203+0000 7f4f3fa00700 1 --2- 172.21.15.2:0/999092782 >> [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478] conn(0x7f4f200adf10 0x7f4f200b03b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:23.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.203+0000 7f4f3fa00700 1 -- 172.21.15.2:0/999092782 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4f200a2d30 msgr2=0x7f4f200a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:23.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.203+0000 7f4f3fa00700 1 --2- 172.21.15.2:0/999092782 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4f200a2d30 0x7f4f200a51f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4f38107420 tx=0x7f4f2c009260 comp rx=0 tx=0).stop 2024-06-13T11:21:23.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.203+0000 7f4f3fa00700 1 -- 172.21.15.2:0/999092782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f38107840 msgr2=0x7f4f381989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:23.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.203+0000 7f4f3fa00700 1 --2- 172.21.15.2:0/999092782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f38107840 0x7f4f381989f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000d010 tx=0x7f4f300079a0 comp rx=0 tx=0).stop 2024-06-13T11:21:23.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.203+0000 7f4f3da00700 1 -- 172.21.15.2:0/999092782 reap_dead start 2024-06-13T11:21:23.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.204+0000 7f4f3fa00700 1 -- 172.21.15.2:0/999092782 shutdown_connections 2024-06-13T11:21:23.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.204+0000 7f4f3fa00700 1 -- 172.21.15.2:0/999092782 >> 172.21.15.2:0/999092782 conn(0x7f4f380795f0 msgr2=0x7f4f38100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:23.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.204+0000 7f4f3fa00700 1 -- 172.21.15.2:0/999092782 shutdown_connections 2024-06-13T11:21:23.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.204+0000 7f4f3fa00700 1 -- 172.21.15.2:0/999092782 wait complete. 2024-06-13T11:21:23.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:22 smithi077 ceph-mon[36410]: pgmap v417: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:21:23.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:22 smithi178 ceph-mon[36913]: pgmap v417: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:21:23.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.608+0000 7f29ebe00700 1 -- 172.21.15.2:0/1811229759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29ec103ea0 msgr2=0x7f29ec10c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:23.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.608+0000 7f29ebe00700 1 --2- 172.21.15.2:0/1811229759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29ec103ea0 0x7f29ec10c390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f29d80098f0 tx=0x7f29d8009c00 comp rx=0 tx=0).stop 2024-06-13T11:21:23.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.609+0000 7f29ebe00700 1 -- 172.21.15.2:0/1811229759 shutdown_connections 2024-06-13T11:21:23.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.609+0000 7f29ebe00700 1 --2- 172.21.15.2:0/1811229759 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29ec10c9b0 0x7f29ec10ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:23.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.609+0000 7f29ebe00700 1 --2- 172.21.15.2:0/1811229759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29ec103580 0x7f29ec103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:23.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.609+0000 7f29ebe00700 1 --2- 172.21.15.2:0/1811229759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29ec103ea0 0x7f29ec10c390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:23.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.609+0000 7f29ebe00700 1 -- 172.21.15.2:0/1811229759 >> 172.21.15.2:0/1811229759 conn(0x7f29ec0fcdb0 msgr2=0x7f29ec0ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:23.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.609+0000 7f29ebe00700 1 -- 172.21.15.2:0/1811229759 shutdown_connections 2024-06-13T11:21:23.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.609+0000 7f29ebe00700 1 -- 172.21.15.2:0/1811229759 wait complete. 2024-06-13T11:21:23.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.610+0000 7f29ebe00700 1 Processor -- start 2024-06-13T11:21:23.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.610+0000 7f29ebe00700 1 -- start start 2024-06-13T11:21:23.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29ebe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29ec103580 0x7f29ec19ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:23.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29ebe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29ec103ea0 0x7f29ec19b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:23.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29ebe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29ec10c9b0 0x7f29ec19f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:23.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29ebe00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec1126d0 con 0x7f29ec10c9b0 2024-06-13T11:21:23.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29ebe00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec112550 con 0x7f29ec103ea0 2024-06-13T11:21:23.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29ebe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec112850 con 0x7f29ec103580 2024-06-13T11:21:23.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29eb400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29ec10c9b0 0x7f29ec19f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:23.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29eaa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29ec103580 0x7f29ec19ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:23.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29ea000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29ec103ea0 0x7f29ec19b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:23.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29eb400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29ec10c9b0 0x7f29ec19f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60128/0 (socket says 172.21.15.2:60128) 2024-06-13T11:21:23.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29eaa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29ec103580 0x7f29ec19ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:48240/0 (socket says 172.21.15.2:48240) 2024-06-13T11:21:23.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29eb400700 1 -- 172.21.15.2:0/2233281790 learned_addr learned my addr 172.21.15.2:0/2233281790 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:23.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29ea000700 1 -- 172.21.15.2:0/2233281790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29ec103580 msgr2=0x7f29ec19ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:23.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29ea000700 1 --2- 172.21.15.2:0/2233281790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29ec103580 0x7f29ec19ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:23.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29ea000700 1 -- 172.21.15.2:0/2233281790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29ec10c9b0 msgr2=0x7f29ec19f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:23.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29ea000700 1 --2- 172.21.15.2:0/2233281790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29ec10c9b0 0x7f29ec19f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:23.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.611+0000 7f29ea000700 1 -- 172.21.15.2:0/2233281790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ec19fe30 con 0x7f29ec103ea0 2024-06-13T11:21:23.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.612+0000 7f29ea000700 1 --2- 172.21.15.2:0/2233281790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29ec103ea0 0x7f29ec19b360 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29d8000c00 tx=0x7f29d800f9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:23.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.612+0000 7f29e3400700 1 -- 172.21.15.2:0/2233281790 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d8005100 con 0x7f29ec103ea0 2024-06-13T11:21:23.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.612+0000 7f29ebe00700 1 -- 172.21.15.2:0/2233281790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29ec1a00c0 con 0x7f29ec103ea0 2024-06-13T11:21:23.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.612+0000 7f29e3400700 1 -- 172.21.15.2:0/2233281790 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29d800b560 con 0x7f29ec103ea0 2024-06-13T11:21:23.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.612+0000 7f29e3400700 1 -- 172.21.15.2:0/2233281790 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d8003a00 con 0x7f29ec103ea0 2024-06-13T11:21:23.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.612+0000 7f29ebe00700 1 -- 172.21.15.2:0/2233281790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29ec1a79a0 con 0x7f29ec103ea0 2024-06-13T11:21:23.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.613+0000 7f29ebe00700 1 -- 172.21.15.2:0/2233281790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29ec102ca0 con 0x7f29ec103ea0 2024-06-13T11:21:23.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.616+0000 7f29e3400700 1 -- 172.21.15.2:0/2233281790 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f29d800b710 con 0x7f29ec103ea0 2024-06-13T11:21:23.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.617+0000 7f29e3400700 1 --2- 172.21.15.2:0/2233281790 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29d00a2d30 0x7f29d00a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:23.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.617+0000 7f29e3400700 1 -- 172.21.15.2:0/2233281790 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f29d80d02d0 con 0x7f29ec103ea0 2024-06-13T11:21:23.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.617+0000 7f29eaa00700 1 --2- 172.21.15.2:0/2233281790 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29d00a2d30 0x7f29d00a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:23.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.617+0000 7f29e3400700 1 --2- 172.21.15.2:0/2233281790 >> [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887] conn(0x7f29d00adf10 0x7f29d00b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:23.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.617+0000 7f29e3400700 1 -- 172.21.15.2:0/2233281790 --> [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29d8028e50 con 0x7f29d00adf10 2024-06-13T11:21:23.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.617+0000 7f29e3400700 1 -- 172.21.15.2:0/2233281790 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f29d80d0680 con 0x7f29ec103ea0 2024-06-13T11:21:23.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.618+0000 7f29eb400700 1 --2- 172.21.15.2:0/2233281790 >> [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887] conn(0x7f29d00adf10 0x7f29d00b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:23.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.618+0000 7f29eaa00700 1 --2- 172.21.15.2:0/2233281790 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29d00a2d30 0x7f29d00a51f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009c60 tx=0x7f29dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:23.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.618+0000 7f29eb400700 1 --2- 172.21.15.2:0/2233281790 >> [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887] conn(0x7f29d00adf10 0x7f29d00b03b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:23.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.619+0000 7f29e3400700 1 -- 172.21.15.2:0/2233281790 <== osd.5 v2:172.21.15.178:6808/3572805887 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29d8028e50 con 0x7f29d00adf10 2024-06-13T11:21:23.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.637+0000 7f29ebe00700 1 -- 172.21.15.2:0/2233281790 --> [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f29ec06aa50 con 0x7f29d00adf10 2024-06-13T11:21:23.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.638+0000 7f29e3400700 1 -- 172.21.15.2:0/2233281790 <== osd.5 v2:172.21.15.178:6808/3572805887 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f29ec06aa50 con 0x7f29d00adf10 2024-06-13T11:21:23.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.639+0000 7f29ebe00700 1 -- 172.21.15.2:0/2233281790 >> [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887] conn(0x7f29d00adf10 msgr2=0x7f29d00b03b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:23.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.639+0000 7f29ebe00700 1 --2- 172.21.15.2:0/2233281790 >> [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887] conn(0x7f29d00adf10 0x7f29d00b03b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:23.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.639+0000 7f29ebe00700 1 -- 172.21.15.2:0/2233281790 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29d00a2d30 msgr2=0x7f29d00a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:23.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.639+0000 7f29ebe00700 1 --2- 172.21.15.2:0/2233281790 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29d00a2d30 0x7f29d00a51f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009c60 tx=0x7f29dc009260 comp rx=0 tx=0).stop 2024-06-13T11:21:23.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.639+0000 7f29ebe00700 1 -- 172.21.15.2:0/2233281790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29ec103ea0 msgr2=0x7f29ec19b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:23.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.639+0000 7f29ebe00700 1 --2- 172.21.15.2:0/2233281790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29ec103ea0 0x7f29ec19b360 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29d8000c00 tx=0x7f29d800f9c0 comp rx=0 tx=0).stop 2024-06-13T11:21:23.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.639+0000 7f29eb400700 1 -- 172.21.15.2:0/2233281790 reap_dead start 2024-06-13T11:21:23.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.640+0000 7f29ebe00700 1 -- 172.21.15.2:0/2233281790 shutdown_connections 2024-06-13T11:21:23.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.640+0000 7f29ebe00700 1 -- 172.21.15.2:0/2233281790 >> 172.21.15.2:0/2233281790 conn(0x7f29ec0fcdb0 msgr2=0x7f29ec0ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:23.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.640+0000 7f29ebe00700 1 -- 172.21.15.2:0/2233281790 shutdown_connections 2024-06-13T11:21:23.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:21.640+0000 7f29ebe00700 1 -- 172.21.15.2:0/2233281790 wait complete. 2024-06-13T11:21:24.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.393+0000 7f1520600700 1 -- 172.21.15.2:0/3064563821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15180746c0 msgr2=0x7f1518074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:24.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.393+0000 7f1520600700 1 --2- 172.21.15.2:0/3064563821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15180746c0 0x7f1518074aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f150c009990 tx=0x7f150c009ca0 comp rx=0 tx=0).stop 2024-06-13T11:21:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.393+0000 7f1520600700 1 -- 172.21.15.2:0/3064563821 shutdown_connections 2024-06-13T11:21:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.393+0000 7f1520600700 1 --2- 172.21.15.2:0/3064563821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15180746c0 0x7f1518074aa0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.393+0000 7f1520600700 1 --2- 172.21.15.2:0/3064563821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f151810ee90 0x7f1518111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.393+0000 7f1520600700 1 --2- 172.21.15.2:0/3064563821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1518074fe0 0x7f151810e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.393+0000 7f1520600700 1 -- 172.21.15.2:0/3064563821 >> 172.21.15.2:0/3064563821 conn(0x7f15180795f0 msgr2=0x7f1518079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.393+0000 7f1520600700 1 -- 172.21.15.2:0/3064563821 shutdown_connections 2024-06-13T11:21:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.393+0000 7f1520600700 1 -- 172.21.15.2:0/3064563821 wait complete. 2024-06-13T11:21:24.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.394+0000 7f1520600700 1 Processor -- start 2024-06-13T11:21:24.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.395+0000 7f1520600700 1 -- start start 2024-06-13T11:21:24.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.395+0000 7f1520600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15180746c0 0x7f151819ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:24.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.395+0000 7f1520600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1518074fe0 0x7f151819b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:24.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.395+0000 7f1520600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f151810ee90 0x7f151819f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:24.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.395+0000 7f1520600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f15181149b0 con 0x7f151810ee90 2024-06-13T11:21:24.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.395+0000 7f1520600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1518114830 con 0x7f1518074fe0 2024-06-13T11:21:24.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.395+0000 7f1520600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1518114b30 con 0x7f15180746c0 2024-06-13T11:21:24.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.395+0000 7f151dc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15180746c0 0x7f151819ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:24.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.396+0000 7f151d200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1518074fe0 0x7f151819b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:24.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.396+0000 7f151dc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15180746c0 0x7f151819ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:48304/0 (socket says 172.21.15.2:48304) 2024-06-13T11:21:24.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.396+0000 7f151dc00700 1 -- 172.21.15.2:0/2286447056 learned_addr learned my addr 172.21.15.2:0/2286447056 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:24.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.396+0000 7f151e600700 1 --2- 172.21.15.2:0/2286447056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f151810ee90 0x7f151819f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:24.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.396+0000 7f151dc00700 1 -- 172.21.15.2:0/2286447056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1518074fe0 msgr2=0x7f151819b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:24.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.396+0000 7f151dc00700 1 --2- 172.21.15.2:0/2286447056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1518074fe0 0x7f151819b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:24.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.396+0000 7f151dc00700 1 -- 172.21.15.2:0/2286447056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f151810ee90 msgr2=0x7f151819f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:24.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.396+0000 7f151dc00700 1 --2- 172.21.15.2:0/2286447056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f151810ee90 0x7f151819f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:24.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.396+0000 7f151dc00700 1 -- 172.21.15.2:0/2286447056 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151819fdc0 con 0x7f15180746c0 2024-06-13T11:21:24.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.397+0000 7f151dc00700 1 --2- 172.21.15.2:0/2286447056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15180746c0 0x7f151819ae00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f150c00bae0 tx=0x7f150c00bb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:24.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.397+0000 7f1516000700 1 -- 172.21.15.2:0/2286447056 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c026070 con 0x7f15180746c0 2024-06-13T11:21:24.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.397+0000 7f1516000700 1 -- 172.21.15.2:0/2286447056 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f150c003d70 con 0x7f15180746c0 2024-06-13T11:21:24.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.397+0000 7f1516000700 1 -- 172.21.15.2:0/2286447056 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c021410 con 0x7f15180746c0 2024-06-13T11:21:24.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.397+0000 7f1520600700 1 -- 172.21.15.2:0/2286447056 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15181a0050 con 0x7f15180746c0 2024-06-13T11:21:24.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.397+0000 7f1520600700 1 -- 172.21.15.2:0/2286447056 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15181a7930 con 0x7f15180746c0 2024-06-13T11:21:24.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.398+0000 7f1520600700 1 -- 172.21.15.2:0/2286447056 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1518062c20 con 0x7f15180746c0 2024-06-13T11:21:24.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.400+0000 7f1516000700 1 -- 172.21.15.2:0/2286447056 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f150c029070 con 0x7f15180746c0 2024-06-13T11:21:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.402+0000 7f1516000700 1 --2- 172.21.15.2:0/2286447056 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f15000a2db0 0x7f15000a5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.402+0000 7f1516000700 1 -- 172.21.15.2:0/2286447056 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f150c0d0a60 con 0x7f15180746c0 2024-06-13T11:21:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.402+0000 7f1516000700 1 --2- 172.21.15.2:0/2286447056 >> [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767] conn(0x7f15000adf90 0x7f15000b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.402+0000 7f1516000700 1 -- 172.21.15.2:0/2286447056 --> [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f15000b0b00 con 0x7f15000adf90 2024-06-13T11:21:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.402+0000 7f1516000700 1 -- 172.21.15.2:0/2286447056 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f150c0d0e50 con 0x7f15180746c0 2024-06-13T11:21:24.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.403+0000 7f151d200700 1 --2- 172.21.15.2:0/2286447056 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f15000a2db0 0x7f15000a5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:24.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.403+0000 7f151e600700 1 --2- 172.21.15.2:0/2286447056 >> [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767] conn(0x7f15000adf90 0x7f15000b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:24.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.403+0000 7f151d200700 1 --2- 172.21.15.2:0/2286447056 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f15000a2db0 0x7f15000a5270 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1518110b50 tx=0x7f1504009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:24.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.404+0000 7f151e600700 1 --2- 172.21.15.2:0/2286447056 >> [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767] conn(0x7f15000adf90 0x7f15000b0430 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:24.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.405+0000 7f1516000700 1 -- 172.21.15.2:0/2286447056 <== osd.11 v2:172.21.15.178:6824/1915058767 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f15000b0b00 con 0x7f15000adf90 2024-06-13T11:21:24.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.425+0000 7f1520600700 1 -- 172.21.15.2:0/2286447056 --> [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f15180630f0 con 0x7f15000adf90 2024-06-13T11:21:24.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.426+0000 7f1516000700 1 -- 172.21.15.2:0/2286447056 <== osd.11 v2:172.21.15.178:6824/1915058767 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f15180630f0 con 0x7f15000adf90 2024-06-13T11:21:24.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.426+0000 7f1520600700 1 -- 172.21.15.2:0/2286447056 >> [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767] conn(0x7f15000adf90 msgr2=0x7f15000b0430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:24.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.426+0000 7f1520600700 1 --2- 172.21.15.2:0/2286447056 >> [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767] conn(0x7f15000adf90 0x7f15000b0430 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:24.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.426+0000 7f1520600700 1 -- 172.21.15.2:0/2286447056 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f15000a2db0 msgr2=0x7f15000a5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:24.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.426+0000 7f1520600700 1 --2- 172.21.15.2:0/2286447056 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f15000a2db0 0x7f15000a5270 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1518110b50 tx=0x7f1504009260 comp rx=0 tx=0).stop 2024-06-13T11:21:24.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.426+0000 7f1520600700 1 -- 172.21.15.2:0/2286447056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15180746c0 msgr2=0x7f151819ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:24.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.426+0000 7f1520600700 1 --2- 172.21.15.2:0/2286447056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15180746c0 0x7f151819ae00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f150c00bae0 tx=0x7f150c00bb10 comp rx=0 tx=0).stop 2024-06-13T11:21:24.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.427+0000 7f151e600700 1 -- 172.21.15.2:0/2286447056 reap_dead start 2024-06-13T11:21:24.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.427+0000 7f1520600700 1 -- 172.21.15.2:0/2286447056 shutdown_connections 2024-06-13T11:21:24.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.427+0000 7f1520600700 1 -- 172.21.15.2:0/2286447056 >> 172.21.15.2:0/2286447056 conn(0x7f15180795f0 msgr2=0x7f15180ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:24.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.427+0000 7f1520600700 1 -- 172.21.15.2:0/2286447056 shutdown_connections 2024-06-13T11:21:24.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:24.427+0000 7f1520600700 1 -- 172.21.15.2:0/2286447056 wait complete. 2024-06-13T11:21:25.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:24 smithi002 ceph-mon[32210]: pgmap v418: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:25.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:24 smithi077 ceph-mon[36410]: pgmap v418: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:25.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:24 smithi178 ceph-mon[36913]: pgmap v418: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:25.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.728+0000 7f4fc3200700 1 -- 172.21.15.2:0/1692925821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fc4104f80 msgr2=0x7f4fc4111440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:25.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.728+0000 7f4fc3200700 1 --2- 172.21.15.2:0/1692925821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fc4104f80 0x7f4fc4111440 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00b0d0 tx=0x7f4fbc00b3e0 comp rx=0 tx=0).stop 2024-06-13T11:21:25.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.728+0000 7f4fc3200700 1 -- 172.21.15.2:0/1692925821 shutdown_connections 2024-06-13T11:21:25.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.728+0000 7f4fc3200700 1 --2- 172.21.15.2:0/1692925821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fc4104f80 0x7f4fc4111440 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:25.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.728+0000 7f4fc3200700 1 --2- 172.21.15.2:0/1692925821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fc410a670 0x7f4fc410aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:25.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.728+0000 7f4fc3200700 1 --2- 172.21.15.2:0/1692925821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fc41045c0 0x7f4fc4104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:25.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.729+0000 7f4fc3200700 1 -- 172.21.15.2:0/1692925821 >> 172.21.15.2:0/1692925821 conn(0x7f4fc41000d0 msgr2=0x7f4fc41024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:25.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.729+0000 7f4fc3200700 1 -- 172.21.15.2:0/1692925821 shutdown_connections 2024-06-13T11:21:25.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.729+0000 7f4fc3200700 1 -- 172.21.15.2:0/1692925821 wait complete. 2024-06-13T11:21:25.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.730+0000 7f4fc3200700 1 Processor -- start 2024-06-13T11:21:25.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.730+0000 7f4fc3200700 1 -- start start 2024-06-13T11:21:25.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.731+0000 7f4fc3200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fc41045c0 0x7f4fc41a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:25.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.731+0000 7f4fc3200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fc4104f80 0x7f4fc41a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:25.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.731+0000 7f4fc3200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fc410a670 0x7f4fc419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:25.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.731+0000 7f4fc3200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc4114970 con 0x7f4fc410a670 2024-06-13T11:21:25.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.731+0000 7f4fc3200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41147f0 con 0x7f4fc41045c0 2024-06-13T11:21:25.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.731+0000 7f4fc3200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc4114af0 con 0x7f4fc4104f80 2024-06-13T11:21:25.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.731+0000 7f4fc2800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fc410a670 0x7f4fc419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:25.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.731+0000 7f4fc1e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fc41045c0 0x7f4fc41a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:25.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.731+0000 7f4fc2800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fc410a670 0x7f4fc419aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60192/0 (socket says 172.21.15.2:60192) 2024-06-13T11:21:25.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.731+0000 7f4fc2800700 1 -- 172.21.15.2:0/1826481318 learned_addr learned my addr 172.21.15.2:0/1826481318 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:25.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.731+0000 7f4fc1400700 1 --2- 172.21.15.2:0/1826481318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fc4104f80 0x7f4fc41a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:25.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.732+0000 7f4fc2800700 1 -- 172.21.15.2:0/1826481318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fc4104f80 msgr2=0x7f4fc41a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:25.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.732+0000 7f4fc2800700 1 --2- 172.21.15.2:0/1826481318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fc4104f80 0x7f4fc41a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:25.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.732+0000 7f4fc2800700 1 -- 172.21.15.2:0/1826481318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fc41045c0 msgr2=0x7f4fc41a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:25.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.732+0000 7f4fc2800700 1 --2- 172.21.15.2:0/1826481318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4fc41045c0 0x7f4fc41a0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:25.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.732+0000 7f4fc2800700 1 -- 172.21.15.2:0/1826481318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc419b190 con 0x7f4fc410a670 2024-06-13T11:21:25.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.732+0000 7f4fc2800700 1 --2- 172.21.15.2:0/1826481318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fc410a670 0x7f4fc419aa30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00d010 tx=0x7f4fbc0079a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:25.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.732+0000 7f4fbaa00700 1 -- 172.21.15.2:0/1826481318 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc003c00 con 0x7f4fc410a670 2024-06-13T11:21:25.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.733+0000 7f4fbaa00700 1 -- 172.21.15.2:0/1826481318 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fbc022070 con 0x7f4fc410a670 2024-06-13T11:21:25.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.733+0000 7f4fc3200700 1 -- 172.21.15.2:0/1826481318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc419b420 con 0x7f4fc410a670 2024-06-13T11:21:25.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.733+0000 7f4fbaa00700 1 -- 172.21.15.2:0/1826481318 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc01b6c0 con 0x7f4fc410a670 2024-06-13T11:21:25.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.733+0000 7f4fc3200700 1 -- 172.21.15.2:0/1826481318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc41a7740 con 0x7f4fc410a670 2024-06-13T11:21:25.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.734+0000 7f4fc3200700 1 -- 172.21.15.2:0/1826481318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4fc4101f00 con 0x7f4fc410a670 2024-06-13T11:21:25.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.736+0000 7f4fbaa00700 1 -- 172.21.15.2:0/1826481318 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f4fbc009ba0 con 0x7f4fc410a670 2024-06-13T11:21:25.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.737+0000 7f4fbaa00700 1 --2- 172.21.15.2:0/1826481318 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4fa80a2cb0 0x7f4fa80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:25.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.737+0000 7f4fbaa00700 1 -- 172.21.15.2:0/1826481318 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f4fbc00f020 con 0x7f4fc410a670 2024-06-13T11:21:25.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.738+0000 7f4fc1e00700 1 --2- 172.21.15.2:0/1826481318 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4fa80a2cb0 0x7f4fa80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:25.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.738+0000 7f4fbaa00700 1 --2- 172.21.15.2:0/1826481318 >> [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591] conn(0x7f4fa80ade90 0x7f4fa80b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:25.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.738+0000 7f4fbaa00700 1 -- 172.21.15.2:0/1826481318 --> [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4fbc0020b0 con 0x7f4fa80ade90 2024-06-13T11:21:25.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.738+0000 7f4fbaa00700 1 -- 172.21.15.2:0/1826481318 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f4fbc0d0b30 con 0x7f4fc410a670 2024-06-13T11:21:25.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.738+0000 7f4fc1400700 1 --2- 172.21.15.2:0/1826481318 >> [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591] conn(0x7f4fa80ade90 0x7f4fa80b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:25.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.738+0000 7f4fc1e00700 1 --2- 172.21.15.2:0/1826481318 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4fa80a2cb0 0x7f4fa80a5170 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4fc419bb70 tx=0x7f4fb4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:25.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.739+0000 7f4fc1400700 1 --2- 172.21.15.2:0/1826481318 >> [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591] conn(0x7f4fa80ade90 0x7f4fa80b0330 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:25.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.740+0000 7f4fbaa00700 1 -- 172.21.15.2:0/1826481318 <== osd.8 v2:172.21.15.178:6816/4285192591 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4fbc0020b0 con 0x7f4fa80ade90 2024-06-13T11:21:25.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.758+0000 7f4fc3200700 1 -- 172.21.15.2:0/1826481318 --> [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4fc4105ce0 con 0x7f4fa80ade90 2024-06-13T11:21:25.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.759+0000 7f4fbaa00700 1 -- 172.21.15.2:0/1826481318 <== osd.8 v2:172.21.15.178:6816/4285192591 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4fc4105ce0 con 0x7f4fa80ade90 2024-06-13T11:21:25.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.760+0000 7f4fc3200700 1 -- 172.21.15.2:0/1826481318 >> [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591] conn(0x7f4fa80ade90 msgr2=0x7f4fa80b0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:25.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.760+0000 7f4fc3200700 1 --2- 172.21.15.2:0/1826481318 >> [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591] conn(0x7f4fa80ade90 0x7f4fa80b0330 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:25.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.760+0000 7f4fc3200700 1 -- 172.21.15.2:0/1826481318 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4fa80a2cb0 msgr2=0x7f4fa80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:25.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.760+0000 7f4fc3200700 1 --2- 172.21.15.2:0/1826481318 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4fa80a2cb0 0x7f4fa80a5170 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4fc419bb70 tx=0x7f4fb4009260 comp rx=0 tx=0).stop 2024-06-13T11:21:25.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.760+0000 7f4fc3200700 1 -- 172.21.15.2:0/1826481318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fc410a670 msgr2=0x7f4fc419aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:25.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.760+0000 7f4fc3200700 1 --2- 172.21.15.2:0/1826481318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4fc410a670 0x7f4fc419aa30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00d010 tx=0x7f4fbc0079a0 comp rx=0 tx=0).stop 2024-06-13T11:21:25.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.760+0000 7f4fc2800700 1 -- 172.21.15.2:0/1826481318 reap_dead start 2024-06-13T11:21:25.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.760+0000 7f4fc3200700 1 -- 172.21.15.2:0/1826481318 shutdown_connections 2024-06-13T11:21:25.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.760+0000 7f4fc3200700 1 -- 172.21.15.2:0/1826481318 >> 172.21.15.2:0/1826481318 conn(0x7f4fc41000d0 msgr2=0x7f4fc41014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:25.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.760+0000 7f4fc3200700 1 -- 172.21.15.2:0/1826481318 shutdown_connections 2024-06-13T11:21:25.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:25.760+0000 7f4fc3200700 1 -- 172.21.15.2:0/1826481318 wait complete. 2024-06-13T11:21:26.709 INFO:teuthology.orchestra.run.smithi002.stdout:77309411426 2024-06-13T11:21:26.710 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-06-13T11:21:27.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.052+0000 7f1041000700 1 -- 172.21.15.2:0/1758656580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f103c0746c0 msgr2=0x7f103c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.052+0000 7f1041000700 1 --2- 172.21.15.2:0/1758656580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f103c0746c0 0x7f103c074aa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f102c009990 tx=0x7f102c009ca0 comp rx=0 tx=0).stop 2024-06-13T11:21:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.052+0000 7f1041000700 1 -- 172.21.15.2:0/1758656580 shutdown_connections 2024-06-13T11:21:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.052+0000 7f1041000700 1 --2- 172.21.15.2:0/1758656580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f103c0746c0 0x7f103c074aa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.052+0000 7f1041000700 1 --2- 172.21.15.2:0/1758656580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f103c10eec0 0x7f103c1112b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.052+0000 7f1041000700 1 --2- 172.21.15.2:0/1758656580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f103c074fe0 0x7f103c10e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.052+0000 7f1041000700 1 -- 172.21.15.2:0/1758656580 >> 172.21.15.2:0/1758656580 conn(0x7f103c079560 msgr2=0x7f103c079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.052+0000 7f1041000700 1 -- 172.21.15.2:0/1758656580 shutdown_connections 2024-06-13T11:21:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.052+0000 7f1041000700 1 -- 172.21.15.2:0/1758656580 wait complete. 2024-06-13T11:21:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.054+0000 7f1041000700 1 Processor -- start 2024-06-13T11:21:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.054+0000 7f1041000700 1 -- start start 2024-06-13T11:21:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.054+0000 7f1041000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f103c0746c0 0x7f103c19ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:27.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.054+0000 7f1041000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f103c074fe0 0x7f103c19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:27.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.054+0000 7f1041000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f103c10eec0 0x7f103c19f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:27.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.054+0000 7f1041000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f103c114a30 con 0x7f103c0746c0 2024-06-13T11:21:27.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.054+0000 7f1041000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f103c1148b0 con 0x7f103c10eec0 2024-06-13T11:21:27.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.054+0000 7f1041000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f103c114bb0 con 0x7f103c074fe0 2024-06-13T11:21:27.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.055+0000 7f1039e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f103c0746c0 0x7f103c19ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:27.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.055+0000 7f1039400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f103c074fe0 0x7f103c19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:27.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.055+0000 7f1039400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f103c074fe0 0x7f103c19b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:48264/0 (socket says 172.21.15.2:48264) 2024-06-13T11:21:27.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.055+0000 7f1039400700 1 -- 172.21.15.2:0/323338750 learned_addr learned my addr 172.21.15.2:0/323338750 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:27.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.055+0000 7f1039400700 1 -- 172.21.15.2:0/323338750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f103c10eec0 msgr2=0x7f103c19f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:27.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.055+0000 7f1039400700 1 --2- 172.21.15.2:0/323338750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f103c10eec0 0x7f103c19f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:27.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.055+0000 7f1039400700 1 -- 172.21.15.2:0/323338750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f103c0746c0 msgr2=0x7f103c19ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:27.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.055+0000 7f1039400700 1 --2- 172.21.15.2:0/323338750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f103c0746c0 0x7f103c19ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.055+0000 7f1039400700 1 -- 172.21.15.2:0/323338750 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103c19fe40 con 0x7f103c074fe0 2024-06-13T11:21:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.056+0000 7f1039400700 1 --2- 172.21.15.2:0/323338750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f103c074fe0 0x7f103c19b3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f102800e950 tx=0x7f102800ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.056+0000 7f1032a00700 1 -- 172.21.15.2:0/323338750 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102800eea0 con 0x7f103c074fe0 2024-06-13T11:21:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.056+0000 7f1032a00700 1 -- 172.21.15.2:0/323338750 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1028004510 con 0x7f103c074fe0 2024-06-13T11:21:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.056+0000 7f1032a00700 1 -- 172.21.15.2:0/323338750 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028003dc0 con 0x7f103c074fe0 2024-06-13T11:21:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.056+0000 7f1041000700 1 -- 172.21.15.2:0/323338750 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103c1a0130 con 0x7f103c074fe0 2024-06-13T11:21:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.056+0000 7f1041000700 1 -- 172.21.15.2:0/323338750 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f103c1a79b0 con 0x7f103c074fe0 2024-06-13T11:21:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.057+0000 7f1041000700 1 -- 172.21.15.2:0/323338750 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f103c062c20 con 0x7f103c074fe0 2024-06-13T11:21:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.060+0000 7f1032a00700 1 -- 172.21.15.2:0/323338750 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f1028004000 con 0x7f103c074fe0 2024-06-13T11:21:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.061+0000 7f1032a00700 1 --2- 172.21.15.2:0/323338750 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f10200a2d30 0x7f10200a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.062+0000 7f1032a00700 1 -- 172.21.15.2:0/323338750 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f10280cf890 con 0x7f103c074fe0 2024-06-13T11:21:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.062+0000 7f1039e00700 1 --2- 172.21.15.2:0/323338750 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f10200a2d30 0x7f10200a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:27.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.062+0000 7f1032a00700 1 --2- 172.21.15.2:0/323338750 >> [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834] conn(0x7f10200adf00 0x7f10200b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:27.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.062+0000 7f1032a00700 1 -- 172.21.15.2:0/323338750 --> [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10200b0a70 con 0x7f10200adf00 2024-06-13T11:21:27.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.062+0000 7f1032a00700 1 -- 172.21.15.2:0/323338750 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f10280d42a0 con 0x7f103c074fe0 2024-06-13T11:21:27.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.062+0000 7f103a800700 1 --2- 172.21.15.2:0/323338750 >> [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834] conn(0x7f10200adf00 0x7f10200b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:27.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.063+0000 7f1039e00700 1 --2- 172.21.15.2:0/323338750 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f10200a2d30 0x7f10200a51f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f102c006010 tx=0x7f102c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:27.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.063+0000 7f103a800700 1 --2- 172.21.15.2:0/323338750 >> [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834] conn(0x7f10200adf00 0x7f10200b03a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:27.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.065+0000 7f1032a00700 1 -- 172.21.15.2:0/323338750 <== osd.0 v2:172.21.15.2:6802/4127571834 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10200b0a70 con 0x7f10200adf00 2024-06-13T11:21:27.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.087+0000 7f1041000700 1 -- 172.21.15.2:0/323338750 --> [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f103c0630a0 con 0x7f10200adf00 2024-06-13T11:21:27.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.088+0000 7f1032a00700 1 -- 172.21.15.2:0/323338750 <== osd.0 v2:172.21.15.2:6802/4127571834 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f103c0630a0 con 0x7f10200adf00 2024-06-13T11:21:27.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.089+0000 7f1041000700 1 -- 172.21.15.2:0/323338750 >> [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834] conn(0x7f10200adf00 msgr2=0x7f10200b03a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:27.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.089+0000 7f1041000700 1 --2- 172.21.15.2:0/323338750 >> [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834] conn(0x7f10200adf00 0x7f10200b03a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:27.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.089+0000 7f1041000700 1 -- 172.21.15.2:0/323338750 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f10200a2d30 msgr2=0x7f10200a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:27.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.089+0000 7f1041000700 1 --2- 172.21.15.2:0/323338750 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f10200a2d30 0x7f10200a51f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f102c006010 tx=0x7f102c00b260 comp rx=0 tx=0).stop 2024-06-13T11:21:27.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.089+0000 7f1041000700 1 -- 172.21.15.2:0/323338750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f103c074fe0 msgr2=0x7f103c19b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:27.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.089+0000 7f1041000700 1 --2- 172.21.15.2:0/323338750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f103c074fe0 0x7f103c19b3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f102800e950 tx=0x7f102800ec60 comp rx=0 tx=0).stop 2024-06-13T11:21:27.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.089+0000 7f103a800700 1 -- 172.21.15.2:0/323338750 reap_dead start 2024-06-13T11:21:27.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.089+0000 7f1041000700 1 -- 172.21.15.2:0/323338750 shutdown_connections 2024-06-13T11:21:27.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.089+0000 7f1041000700 1 -- 172.21.15.2:0/323338750 >> 172.21.15.2:0/323338750 conn(0x7f103c079560 msgr2=0x7f103c0ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:27.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.089+0000 7f1041000700 1 -- 172.21.15.2:0/323338750 shutdown_connections 2024-06-13T11:21:27.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:23.089+0000 7f1041000700 1 -- 172.21.15.2:0/323338750 wait complete. 2024-06-13T11:21:27.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:27 smithi077 ceph-mon[36410]: pgmap v419: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T11:21:27.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:27 smithi002 ceph-mon[32210]: pgmap v419: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T11:21:27.775 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:27 smithi178 ceph-mon[36913]: pgmap v419: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T11:21:27.970 INFO:teuthology.orchestra.run.smithi002.stdout:163208757332 2024-06-13T11:21:27.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-06-13T11:21:28.310 INFO:teuthology.orchestra.run.smithi002.stdout:34359738479 2024-06-13T11:21:28.311 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-06-13T11:21:29.069 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:29 smithi002 ceph-mon[32210]: pgmap v420: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T11:21:29.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:29 smithi077 ceph-mon[36410]: pgmap v420: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T11:21:29.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.245+0000 7f416e800700 1 -- 172.21.15.2:0/2935611089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168102540 msgr2=0x7f41681029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:29.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.245+0000 7f416e800700 1 --2- 172.21.15.2:0/2935611089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168102540 0x7f41681029a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4154009990 tx=0x7f4154009ca0 comp rx=0 tx=0).stop 2024-06-13T11:21:29.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.246+0000 7f416e800700 1 -- 172.21.15.2:0/2935611089 shutdown_connections 2024-06-13T11:21:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.246+0000 7f416e800700 1 --2- 172.21.15.2:0/2935611089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4168102ee0 0x7f416810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.246+0000 7f416e800700 1 --2- 172.21.15.2:0/2935611089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4168107450 0x7f4168107830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.246+0000 7f416e800700 1 --2- 172.21.15.2:0/2935611089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168102540 0x7f41681029a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.246+0000 7f416e800700 1 -- 172.21.15.2:0/2935611089 >> 172.21.15.2:0/2935611089 conn(0x7f41680795f0 msgr2=0x7f4168079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.246+0000 7f416e800700 1 -- 172.21.15.2:0/2935611089 shutdown_connections 2024-06-13T11:21:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.246+0000 7f416e800700 1 -- 172.21.15.2:0/2935611089 wait complete. 2024-06-13T11:21:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.247+0000 7f416e800700 1 Processor -- start 2024-06-13T11:21:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.247+0000 7f416e800700 1 -- start start 2024-06-13T11:21:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.247+0000 7f416e800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4168102540 0x7f416819aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.247+0000 7f416e800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4168102ee0 0x7f416819b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.247+0000 7f416e800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168107450 0x7f416819f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.247+0000 7f416e800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4168112840 con 0x7f4168102540 2024-06-13T11:21:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.247+0000 7f416e800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f41681126c0 con 0x7f4168107450 2024-06-13T11:21:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.247+0000 7f416e800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f41681129c0 con 0x7f4168102ee0 2024-06-13T11:21:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.248+0000 7f4167400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4168102540 0x7f416819aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.248+0000 7f4167e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168107450 0x7f416819f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.248+0000 7f4167400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4168102540 0x7f416819aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54890/0 (socket says 172.21.15.2:54890) 2024-06-13T11:21:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.248+0000 7f4167400700 1 -- 172.21.15.2:0/2597436082 learned_addr learned my addr 172.21.15.2:0/2597436082 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.248+0000 7f4166a00700 1 --2- 172.21.15.2:0/2597436082 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4168102ee0 0x7f416819b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.248+0000 7f4167e00700 1 -- 172.21.15.2:0/2597436082 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4168102ee0 msgr2=0x7f416819b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.248+0000 7f4167e00700 1 --2- 172.21.15.2:0/2597436082 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4168102ee0 0x7f416819b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.248+0000 7f4167e00700 1 -- 172.21.15.2:0/2597436082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4168102540 msgr2=0x7f416819aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.248+0000 7f4167e00700 1 --2- 172.21.15.2:0/2597436082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4168102540 0x7f416819aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:29.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.248+0000 7f4167e00700 1 -- 172.21.15.2:0/2597436082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416819feb0 con 0x7f4168107450 2024-06-13T11:21:29.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.248+0000 7f4167e00700 1 --2- 172.21.15.2:0/2597436082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168107450 0x7f416819f770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f416000efc0 tx=0x7f416000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:29.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.249+0000 7f415fe00700 1 -- 172.21.15.2:0/2597436082 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41600092e0 con 0x7f4168107450 2024-06-13T11:21:29.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.249+0000 7f415fe00700 1 -- 172.21.15.2:0/2597436082 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4160004bb0 con 0x7f4168107450 2024-06-13T11:21:29.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.249+0000 7f415fe00700 1 -- 172.21.15.2:0/2597436082 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160004280 con 0x7f4168107450 2024-06-13T11:21:29.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.249+0000 7f416e800700 1 -- 172.21.15.2:0/2597436082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41681a0140 con 0x7f4168107450 2024-06-13T11:21:29.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.249+0000 7f416e800700 1 -- 172.21.15.2:0/2597436082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41681a7a20 con 0x7f4168107450 2024-06-13T11:21:29.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.250+0000 7f416e800700 1 -- 172.21.15.2:0/2597436082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4168100e30 con 0x7f4168107450 2024-06-13T11:21:29.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.252+0000 7f415fe00700 1 -- 172.21.15.2:0/2597436082 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f416001b030 con 0x7f4168107450 2024-06-13T11:21:29.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.253+0000 7f415fe00700 1 --2- 172.21.15.2:0/2597436082 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f414c0a2d30 0x7f414c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.254+0000 7f415fe00700 1 -- 172.21.15.2:0/2597436082 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f41600cf940 con 0x7f4168107450 2024-06-13T11:21:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.254+0000 7f415fe00700 1 --2- 172.21.15.2:0/2597436082 >> [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463] conn(0x7f414c0adf10 0x7f414c0b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.254+0000 7f415fe00700 1 -- 172.21.15.2:0/2597436082 --> [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f416001fe50 con 0x7f414c0adf10 2024-06-13T11:21:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.254+0000 7f415fe00700 1 -- 172.21.15.2:0/2597436082 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f41600cfcf0 con 0x7f4168107450 2024-06-13T11:21:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.254+0000 7f4167400700 1 --2- 172.21.15.2:0/2597436082 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f414c0a2d30 0x7f414c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.254+0000 7f4166a00700 1 --2- 172.21.15.2:0/2597436082 >> [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463] conn(0x7f414c0adf10 0x7f414c0b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.255+0000 7f4167400700 1 --2- 172.21.15.2:0/2597436082 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f414c0a2d30 0x7f414c0a51f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4158005950 tx=0x7f4158009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.255+0000 7f4166a00700 1 --2- 172.21.15.2:0/2597436082 >> [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463] conn(0x7f414c0adf10 0x7f414c0b03b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.256+0000 7f415fe00700 1 -- 172.21.15.2:0/2597436082 <== osd.10 v2:172.21.15.77:6824/2039538463 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f416001fe50 con 0x7f414c0adf10 2024-06-13T11:21:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.275+0000 7f416e800700 1 -- 172.21.15.2:0/2597436082 --> [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4168103c00 con 0x7f414c0adf10 2024-06-13T11:21:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.275+0000 7f415fe00700 1 -- 172.21.15.2:0/2597436082 <== osd.10 v2:172.21.15.77:6824/2039538463 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4168103c00 con 0x7f414c0adf10 2024-06-13T11:21:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.276+0000 7f416e800700 1 -- 172.21.15.2:0/2597436082 >> [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463] conn(0x7f414c0adf10 msgr2=0x7f414c0b03b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.276+0000 7f416e800700 1 --2- 172.21.15.2:0/2597436082 >> [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463] conn(0x7f414c0adf10 0x7f414c0b03b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.276+0000 7f416e800700 1 -- 172.21.15.2:0/2597436082 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f414c0a2d30 msgr2=0x7f414c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.276+0000 7f416e800700 1 --2- 172.21.15.2:0/2597436082 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f414c0a2d30 0x7f414c0a51f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4158005950 tx=0x7f4158009260 comp rx=0 tx=0).stop 2024-06-13T11:21:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.276+0000 7f416e800700 1 -- 172.21.15.2:0/2597436082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168107450 msgr2=0x7f416819f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.276+0000 7f416e800700 1 --2- 172.21.15.2:0/2597436082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4168107450 0x7f416819f770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f416000efc0 tx=0x7f416000c3a0 comp rx=0 tx=0).stop 2024-06-13T11:21:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.276+0000 7f4167e00700 1 -- 172.21.15.2:0/2597436082 reap_dead start 2024-06-13T11:21:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.276+0000 7f416e800700 1 -- 172.21.15.2:0/2597436082 shutdown_connections 2024-06-13T11:21:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.276+0000 7f416e800700 1 -- 172.21.15.2:0/2597436082 >> 172.21.15.2:0/2597436082 conn(0x7f41680795f0 msgr2=0x7f4168100410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.277+0000 7f416e800700 1 -- 172.21.15.2:0/2597436082 shutdown_connections 2024-06-13T11:21:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:29.277+0000 7f416e800700 1 -- 172.21.15.2:0/2597436082 wait complete. 2024-06-13T11:21:29.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:29 smithi178 ceph-mon[36913]: pgmap v420: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T11:21:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.419+0000 7fe4ddc00700 1 -- 172.21.15.2:0/3464800975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d8103580 msgr2=0x7fe4d8103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.419+0000 7fe4ddc00700 1 --2- 172.21.15.2:0/3464800975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d8103580 0x7fe4d8103960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009990 tx=0x7fe4c8009ca0 comp rx=0 tx=0).stop 2024-06-13T11:21:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.420+0000 7fe4ddc00700 1 -- 172.21.15.2:0/3464800975 shutdown_connections 2024-06-13T11:21:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.420+0000 7fe4ddc00700 1 --2- 172.21.15.2:0/3464800975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d8103580 0x7fe4d8103960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.420+0000 7fe4ddc00700 1 --2- 172.21.15.2:0/3464800975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d810c9b0 0x7fe4d810ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.420+0000 7fe4ddc00700 1 --2- 172.21.15.2:0/3464800975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4d8103ea0 0x7fe4d810c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.420+0000 7fe4ddc00700 1 -- 172.21.15.2:0/3464800975 >> 172.21.15.2:0/3464800975 conn(0x7fe4d80fcdb0 msgr2=0x7fe4d80ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.420+0000 7fe4ddc00700 1 -- 172.21.15.2:0/3464800975 shutdown_connections 2024-06-13T11:21:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.420+0000 7fe4ddc00700 1 -- 172.21.15.2:0/3464800975 wait complete. 2024-06-13T11:21:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.421+0000 7fe4ddc00700 1 Processor -- start 2024-06-13T11:21:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.421+0000 7fe4ddc00700 1 -- start start 2024-06-13T11:21:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.422+0000 7fe4ddc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d8103580 0x7fe4d81011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.422+0000 7fe4ddc00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4d8103ea0 0x7fe4d8101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.422+0000 7fe4ddc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d810c9b0 0x7fe4d8101c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.422+0000 7fe4ddc00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d8112710 con 0x7fe4d8103580 2024-06-13T11:21:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.422+0000 7fe4ddc00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d8112590 con 0x7fe4d8103ea0 2024-06-13T11:21:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.422+0000 7fe4ddc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d8112890 con 0x7fe4d810c9b0 2024-06-13T11:21:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.422+0000 7fe4d7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d8103580 0x7fe4d81011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.422+0000 7fe4d7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d8103580 0x7fe4d81011e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54894/0 (socket says 172.21.15.2:54894) 2024-06-13T11:21:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.422+0000 7fe4d7e00700 1 -- 172.21.15.2:0/1026638404 learned_addr learned my addr 172.21.15.2:0/1026638404 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.422+0000 7fe4d7400700 1 --2- 172.21.15.2:0/1026638404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4d8103ea0 0x7fe4d8101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.423+0000 7fe4dd200700 1 --2- 172.21.15.2:0/1026638404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d810c9b0 0x7fe4d8101c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.423+0000 7fe4d7e00700 1 -- 172.21.15.2:0/1026638404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d810c9b0 msgr2=0x7fe4d8101c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.423+0000 7fe4d7e00700 1 --2- 172.21.15.2:0/1026638404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d810c9b0 0x7fe4d8101c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.423+0000 7fe4d7e00700 1 -- 172.21.15.2:0/1026638404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4d8103ea0 msgr2=0x7fe4d8101720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.423+0000 7fe4d7e00700 1 --2- 172.21.15.2:0/1026638404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4d8103ea0 0x7fe4d8101720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.423+0000 7fe4d7e00700 1 -- 172.21.15.2:0/1026638404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d81a70b0 con 0x7fe4d8103580 2024-06-13T11:21:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.423+0000 7fe4dd200700 1 --2- 172.21.15.2:0/1026638404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d810c9b0 0x7fe4d8101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:21:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.423+0000 7fe4d7e00700 1 --2- 172.21.15.2:0/1026638404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d8103580 0x7fe4d81011e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800bae0 tx=0x7fe4c800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.424+0000 7fe4d4c00700 1 -- 172.21.15.2:0/1026638404 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8026070 con 0x7fe4d8103580 2024-06-13T11:21:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.424+0000 7fe4d4c00700 1 -- 172.21.15.2:0/1026638404 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4c8003d70 con 0x7fe4d8103580 2024-06-13T11:21:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.424+0000 7fe4ddc00700 1 -- 172.21.15.2:0/1026638404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d81a7340 con 0x7fe4d8103580 2024-06-13T11:21:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.424+0000 7fe4d4c00700 1 -- 172.21.15.2:0/1026638404 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8021410 con 0x7fe4d8103580 2024-06-13T11:21:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.424+0000 7fe4ddc00700 1 -- 172.21.15.2:0/1026638404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d81a7820 con 0x7fe4d8103580 2024-06-13T11:21:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.425+0000 7fe4ddc00700 1 -- 172.21.15.2:0/1026638404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe4d8062ba0 con 0x7fe4d8103580 2024-06-13T11:21:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.427+0000 7fe4d4c00700 1 -- 172.21.15.2:0/1026638404 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fe4c8029070 con 0x7fe4d8103580 2024-06-13T11:21:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.429+0000 7fe4d4c00700 1 --2- 172.21.15.2:0/1026638404 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe4bc0a2cb0 0x7fe4bc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.429+0000 7fe4d4c00700 1 -- 172.21.15.2:0/1026638404 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fe4c80d0bc0 con 0x7fe4d8103580 2024-06-13T11:21:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.429+0000 7fe4d7400700 1 --2- 172.21.15.2:0/1026638404 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe4bc0a2cb0 0x7fe4bc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.429+0000 7fe4d4c00700 1 --2- 172.21.15.2:0/1026638404 >> [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713] conn(0x7fe4bc0add60 0x7fe4bc0b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.429+0000 7fe4d4c00700 1 -- 172.21.15.2:0/1026638404 --> [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe4bc0b08d0 con 0x7fe4bc0add60 2024-06-13T11:21:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.429+0000 7fe4d4c00700 1 -- 172.21.15.2:0/1026638404 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7fe4c80d0f70 con 0x7fe4d8103580 2024-06-13T11:21:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.429+0000 7fe4dd200700 1 --2- 172.21.15.2:0/1026638404 >> [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713] conn(0x7fe4bc0add60 0x7fe4bc0b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.430+0000 7fe4d7400700 1 --2- 172.21.15.2:0/1026638404 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe4bc0a2cb0 0x7fe4bc0a5170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe4d810dd00 tx=0x7fe4c4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.430+0000 7fe4dd200700 1 --2- 172.21.15.2:0/1026638404 >> [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713] conn(0x7fe4bc0add60 0x7fe4bc0b0200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.431+0000 7fe4d4c00700 1 -- 172.21.15.2:0/1026638404 <== osd.1 v2:172.21.15.77:6800/3180360713 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe4bc0b08d0 con 0x7fe4bc0add60 2024-06-13T11:21:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.449+0000 7fe4ddc00700 1 -- 172.21.15.2:0/1026638404 --> [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe4d8063020 con 0x7fe4bc0add60 2024-06-13T11:21:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.450+0000 7fe4d4c00700 1 -- 172.21.15.2:0/1026638404 <== osd.1 v2:172.21.15.77:6800/3180360713 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe4d8063020 con 0x7fe4bc0add60 2024-06-13T11:21:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.451+0000 7fe4ddc00700 1 -- 172.21.15.2:0/1026638404 >> [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713] conn(0x7fe4bc0add60 msgr2=0x7fe4bc0b0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.451+0000 7fe4ddc00700 1 --2- 172.21.15.2:0/1026638404 >> [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713] conn(0x7fe4bc0add60 0x7fe4bc0b0200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.451+0000 7fe4ddc00700 1 -- 172.21.15.2:0/1026638404 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe4bc0a2cb0 msgr2=0x7fe4bc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.451+0000 7fe4ddc00700 1 --2- 172.21.15.2:0/1026638404 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe4bc0a2cb0 0x7fe4bc0a5170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe4d810dd00 tx=0x7fe4c4009260 comp rx=0 tx=0).stop 2024-06-13T11:21:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.451+0000 7fe4ddc00700 1 -- 172.21.15.2:0/1026638404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d8103580 msgr2=0x7fe4d81011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.451+0000 7fe4ddc00700 1 --2- 172.21.15.2:0/1026638404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d8103580 0x7fe4d81011e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800bae0 tx=0x7fe4c800bb10 comp rx=0 tx=0).stop 2024-06-13T11:21:30.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.451+0000 7fe4dd200700 1 -- 172.21.15.2:0/1026638404 reap_dead start 2024-06-13T11:21:30.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.451+0000 7fe4ddc00700 1 -- 172.21.15.2:0/1026638404 shutdown_connections 2024-06-13T11:21:30.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.451+0000 7fe4ddc00700 1 -- 172.21.15.2:0/1026638404 >> 172.21.15.2:0/1026638404 conn(0x7fe4d80fcdb0 msgr2=0x7fe4d80fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:30.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.451+0000 7fe4ddc00700 1 -- 172.21.15.2:0/1026638404 shutdown_connections 2024-06-13T11:21:30.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:30.451+0000 7fe4ddc00700 1 -- 172.21.15.2:0/1026638404 wait complete. 2024-06-13T11:21:31.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:31 smithi077 ceph-mon[36410]: pgmap v421: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-13T11:21:31.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:31 smithi002 ceph-mon[32210]: pgmap v421: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-13T11:21:31.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:31 smithi178 ceph-mon[36913]: pgmap v421: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-13T11:21:31.836 INFO:teuthology.orchestra.run.smithi002.stdout:253403070530 2024-06-13T11:21:31.837 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-06-13T11:21:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.057+0000 7f4e7ba00700 1 -- 172.21.15.2:0/2271468976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e7406a170 msgr2=0x7f4e7406a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.057+0000 7f4e7ba00700 1 --2- 172.21.15.2:0/2271468976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e7406a170 0x7f4e7406a5d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4e600099c0 tx=0x7f4e60009cd0 comp rx=0 tx=0).stop 2024-06-13T11:21:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.057+0000 7f4e7ba00700 1 -- 172.21.15.2:0/2271468976 shutdown_connections 2024-06-13T11:21:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.057+0000 7f4e7ba00700 1 --2- 172.21.15.2:0/2271468976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e7406ab10 0x7f4e7410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:32.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.057+0000 7f4e7ba00700 1 --2- 172.21.15.2:0/2271468976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e741084e0 0x7f4e741088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:32.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.057+0000 7f4e7ba00700 1 --2- 172.21.15.2:0/2271468976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e7406a170 0x7f4e7406a5d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:32.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.057+0000 7f4e7ba00700 1 -- 172.21.15.2:0/2271468976 >> 172.21.15.2:0/2271468976 conn(0x7f4e740782c0 msgr2=0x7f4e740786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:32.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.058+0000 7f4e7ba00700 1 -- 172.21.15.2:0/2271468976 shutdown_connections 2024-06-13T11:21:32.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.059+0000 7f4e7ba00700 1 -- 172.21.15.2:0/2271468976 wait complete. 2024-06-13T11:21:32.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.060+0000 7f4e7ba00700 1 Processor -- start 2024-06-13T11:21:32.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.061+0000 7f4e7ba00700 1 -- start start 2024-06-13T11:21:32.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.061+0000 7f4e7ba00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e7406a170 0x7f4e7419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:32.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.061+0000 7f4e7ba00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e7406ab10 0x7f4e7419eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:32.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.061+0000 7f4e7ba00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e741084e0 0x7f4e74198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:32.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.061+0000 7f4e7ba00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4e74112790 con 0x7f4e7406ab10 2024-06-13T11:21:32.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.061+0000 7f4e7ba00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e74112610 con 0x7f4e741084e0 2024-06-13T11:21:32.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.061+0000 7f4e7ba00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4e74112910 con 0x7f4e7406a170 2024-06-13T11:21:32.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.062+0000 7f4e73e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e7406ab10 0x7f4e7419eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:32.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.062+0000 7f4e73e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e7406ab10 0x7f4e7419eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54922/0 (socket says 172.21.15.2:54922) 2024-06-13T11:21:32.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.062+0000 7f4e73e00700 1 -- 172.21.15.2:0/284374874 learned_addr learned my addr 172.21.15.2:0/284374874 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:32.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.062+0000 7f4e79000700 1 --2- 172.21.15.2:0/284374874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e7406a170 0x7f4e7419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:32.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.062+0000 7f4e79a00700 1 --2- 172.21.15.2:0/284374874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e741084e0 0x7f4e74198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:32.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.062+0000 7f4e73e00700 1 -- 172.21.15.2:0/284374874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e7406a170 msgr2=0x7f4e7419e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:32.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.062+0000 7f4e73e00700 1 --2- 172.21.15.2:0/284374874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e7406a170 0x7f4e7419e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:32.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.062+0000 7f4e73e00700 1 -- 172.21.15.2:0/284374874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e741084e0 msgr2=0x7f4e74198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:32.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.062+0000 7f4e73e00700 1 --2- 172.21.15.2:0/284374874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e741084e0 0x7f4e74198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:32.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.062+0000 7f4e73e00700 1 -- 172.21.15.2:0/284374874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e741991d0 con 0x7f4e7406ab10 2024-06-13T11:21:32.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.063+0000 7f4e79a00700 1 --2- 172.21.15.2:0/284374874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e741084e0 0x7f4e74198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:21:32.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.063+0000 7f4e73e00700 1 --2- 172.21.15.2:0/284374874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e7406ab10 0x7f4e7419eda0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4e60006010 tx=0x7f4e60003a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:32.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.063+0000 7f4e71600700 1 -- 172.21.15.2:0/284374874 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e600050c0 con 0x7f4e7406ab10 2024-06-13T11:21:32.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.063+0000 7f4e71600700 1 -- 172.21.15.2:0/284374874 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e6000f460 con 0x7f4e7406ab10 2024-06-13T11:21:32.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.063+0000 7f4e7ba00700 1 -- 172.21.15.2:0/284374874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e74199460 con 0x7f4e7406ab10 2024-06-13T11:21:32.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.064+0000 7f4e7ba00700 1 -- 172.21.15.2:0/284374874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e741a5730 con 0x7f4e7406ab10 2024-06-13T11:21:32.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.064+0000 7f4e71600700 1 -- 172.21.15.2:0/284374874 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60017650 con 0x7f4e7406ab10 2024-06-13T11:21:32.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.065+0000 7f4e7ba00700 1 -- 172.21.15.2:0/284374874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e54001030 con 0x7f4e7406ab10 2024-06-13T11:21:32.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.067+0000 7f4e71600700 1 -- 172.21.15.2:0/284374874 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f4e60005260 con 0x7f4e7406ab10 2024-06-13T11:21:32.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.069+0000 7f4e71600700 1 --2- 172.21.15.2:0/284374874 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4e5c0a2d30 0x7f4e5c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:32.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.070+0000 7f4e71600700 1 -- 172.21.15.2:0/284374874 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f4e600d0340 con 0x7f4e7406ab10 2024-06-13T11:21:32.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.070+0000 7f4e79000700 1 --2- 172.21.15.2:0/284374874 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4e5c0a2d30 0x7f4e5c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:32.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.070+0000 7f4e71600700 1 --2- 172.21.15.2:0/284374874 >> [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584] conn(0x7f4e5c0adf10 0x7f4e5c0b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:32.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.070+0000 7f4e71600700 1 -- 172.21.15.2:0/284374874 --> [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e5c0b0a80 con 0x7f4e5c0adf10 2024-06-13T11:21:32.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.070+0000 7f4e71600700 1 -- 172.21.15.2:0/284374874 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f4e600d06f0 con 0x7f4e7406ab10 2024-06-13T11:21:32.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.071+0000 7f4e79000700 1 --2- 172.21.15.2:0/284374874 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4e5c0a2d30 0x7f4e5c0a51f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4e74101340 tx=0x7f4e68009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:32.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.071+0000 7f4e79a00700 1 --2- 172.21.15.2:0/284374874 >> [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584] conn(0x7f4e5c0adf10 0x7f4e5c0b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:32.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.072+0000 7f4e79a00700 1 --2- 172.21.15.2:0/284374874 >> [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584] conn(0x7f4e5c0adf10 0x7f4e5c0b03b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:32.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.073+0000 7f4e71600700 1 -- 172.21.15.2:0/284374874 <== osd.6 v2:172.21.15.2:6818/1592309584 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4e5c0b0a80 con 0x7f4e5c0adf10 2024-06-13T11:21:32.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.107+0000 7f4e7ba00700 1 -- 172.21.15.2:0/284374874 --> [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4e54002e60 con 0x7f4e5c0adf10 2024-06-13T11:21:32.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.107+0000 7f4e71600700 1 -- 172.21.15.2:0/284374874 <== osd.6 v2:172.21.15.2:6818/1592309584 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4e54002e60 con 0x7f4e5c0adf10 2024-06-13T11:21:32.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.108+0000 7f4e7ba00700 1 -- 172.21.15.2:0/284374874 >> [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584] conn(0x7f4e5c0adf10 msgr2=0x7f4e5c0b03b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:32.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.108+0000 7f4e7ba00700 1 --2- 172.21.15.2:0/284374874 >> [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584] conn(0x7f4e5c0adf10 0x7f4e5c0b03b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:32.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.108+0000 7f4e7ba00700 1 -- 172.21.15.2:0/284374874 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4e5c0a2d30 msgr2=0x7f4e5c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:32.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.108+0000 7f4e7ba00700 1 --2- 172.21.15.2:0/284374874 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4e5c0a2d30 0x7f4e5c0a51f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4e74101340 tx=0x7f4e68009260 comp rx=0 tx=0).stop 2024-06-13T11:21:32.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.108+0000 7f4e7ba00700 1 -- 172.21.15.2:0/284374874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e7406ab10 msgr2=0x7f4e7419eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:32.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.108+0000 7f4e7ba00700 1 --2- 172.21.15.2:0/284374874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e7406ab10 0x7f4e7419eda0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4e60006010 tx=0x7f4e60003a90 comp rx=0 tx=0).stop 2024-06-13T11:21:32.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.109+0000 7f4e79a00700 1 -- 172.21.15.2:0/284374874 reap_dead start 2024-06-13T11:21:32.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.109+0000 7f4e7ba00700 1 -- 172.21.15.2:0/284374874 shutdown_connections 2024-06-13T11:21:32.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.109+0000 7f4e7ba00700 1 -- 172.21.15.2:0/284374874 >> 172.21.15.2:0/284374874 conn(0x7f4e740782c0 msgr2=0x7f4e740ff480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:32.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.109+0000 7f4e7ba00700 1 -- 172.21.15.2:0/284374874 shutdown_connections 2024-06-13T11:21:32.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.109+0000 7f4e7ba00700 1 -- 172.21.15.2:0/284374874 wait complete. 2024-06-13T11:21:32.163 INFO:teuthology.orchestra.run.smithi002.stdout:287762808892 2024-06-13T11:21:32.163 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-06-13T11:21:32.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.666+0000 7f3872e00700 1 -- 172.21.15.2:0/2193402140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f386c102510 msgr2=0x7f386c102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:32.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.666+0000 7f3872e00700 1 --2- 172.21.15.2:0/2193402140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f386c102510 0x7f386c102990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3858009990 tx=0x7f3858009ca0 comp rx=0 tx=0).stop 2024-06-13T11:21:32.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.666+0000 7f3872e00700 1 -- 172.21.15.2:0/2193402140 shutdown_connections 2024-06-13T11:21:32.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.666+0000 7f3872e00700 1 --2- 172.21.15.2:0/2193402140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f386c102ed0 0x7f386c10f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:32.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.666+0000 7f3872e00700 1 --2- 172.21.15.2:0/2193402140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f386c108520 0x7f386c108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:32.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.666+0000 7f3872e00700 1 --2- 172.21.15.2:0/2193402140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f386c102510 0x7f386c102990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:32.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.666+0000 7f3872e00700 1 -- 172.21.15.2:0/2193402140 >> 172.21.15.2:0/2193402140 conn(0x7f386c079560 msgr2=0x7f386c079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:32.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.667+0000 7f3872e00700 1 -- 172.21.15.2:0/2193402140 shutdown_connections 2024-06-13T11:21:32.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.667+0000 7f3872e00700 1 -- 172.21.15.2:0/2193402140 wait complete. 2024-06-13T11:21:32.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.668+0000 7f3872e00700 1 Processor -- start 2024-06-13T11:21:32.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.668+0000 7f3872e00700 1 -- start start 2024-06-13T11:21:32.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.669+0000 7f3872e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f386c102510 0x7f386c074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:32.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.669+0000 7f3872e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f386c102ed0 0x7f386c074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:32.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.669+0000 7f3872e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f386c108520 0x7f386c075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:32.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.669+0000 7f3872e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f386c1127f0 con 0x7f386c102510 2024-06-13T11:21:32.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.669+0000 7f3872e00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f386c112670 con 0x7f386c102ed0 2024-06-13T11:21:32.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.669+0000 7f3872e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f386c112970 con 0x7f386c108520 2024-06-13T11:21:32.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.669+0000 7f386be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f386c102510 0x7f386c074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:32.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.669+0000 7f386be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f386c102510 0x7f386c074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54942/0 (socket says 172.21.15.2:54942) 2024-06-13T11:21:32.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.669+0000 7f386be00700 1 -- 172.21.15.2:0/3073391443 learned_addr learned my addr 172.21.15.2:0/3073391443 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:32.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.669+0000 7f386b400700 1 --2- 172.21.15.2:0/3073391443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f386c102ed0 0x7f386c074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:32.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.669+0000 7f3870e00700 1 --2- 172.21.15.2:0/3073391443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f386c108520 0x7f386c075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:32.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.670+0000 7f386b400700 1 -- 172.21.15.2:0/3073391443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f386c108520 msgr2=0x7f386c075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:32.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.670+0000 7f386b400700 1 --2- 172.21.15.2:0/3073391443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f386c108520 0x7f386c075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:32.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.670+0000 7f386b400700 1 -- 172.21.15.2:0/3073391443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f386c102510 msgr2=0x7f386c074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:32.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.670+0000 7f386b400700 1 --2- 172.21.15.2:0/3073391443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f386c102510 0x7f386c074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:32.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.670+0000 7f386b400700 1 -- 172.21.15.2:0/3073391443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c1a7150 con 0x7f386c102ed0 2024-06-13T11:21:32.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.670+0000 7f386b400700 1 --2- 172.21.15.2:0/3073391443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f386c102ed0 0x7f386c074cd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38580098e0 tx=0x7f385800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:32.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.671+0000 7f3868c00700 1 -- 172.21.15.2:0/3073391443 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858027070 con 0x7f386c102ed0 2024-06-13T11:21:32.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.671+0000 7f3872e00700 1 -- 172.21.15.2:0/3073391443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386c1a73e0 con 0x7f386c102ed0 2024-06-13T11:21:32.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.671+0000 7f3868c00700 1 -- 172.21.15.2:0/3073391443 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f385800be60 con 0x7f386c102ed0 2024-06-13T11:21:32.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.671+0000 7f3868c00700 1 -- 172.21.15.2:0/3073391443 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858022dd0 con 0x7f386c102ed0 2024-06-13T11:21:32.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.671+0000 7f3872e00700 1 -- 172.21.15.2:0/3073391443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386c1a7890 con 0x7f386c102ed0 2024-06-13T11:21:32.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.672+0000 7f3872e00700 1 -- 172.21.15.2:0/3073391443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f386c062c20 con 0x7f386c102ed0 2024-06-13T11:21:32.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.677+0000 7f3868c00700 1 -- 172.21.15.2:0/3073391443 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f385802a070 con 0x7f386c102ed0 2024-06-13T11:21:32.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.678+0000 7f3868c00700 1 --2- 172.21.15.2:0/3073391443 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f38500a2cb0 0x7f38500a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:32.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.678+0000 7f3868c00700 1 -- 172.21.15.2:0/3073391443 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f38580d0eb0 con 0x7f386c102ed0 2024-06-13T11:21:32.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.678+0000 7f386be00700 1 --2- 172.21.15.2:0/3073391443 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f38500a2cb0 0x7f38500a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:32.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.679+0000 7f3868c00700 1 --2- 172.21.15.2:0/3073391443 >> [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904] conn(0x7f38500ade90 0x7f38500b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:32.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.679+0000 7f3868c00700 1 -- 172.21.15.2:0/3073391443 --> [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3858024ec0 con 0x7f38500ade90 2024-06-13T11:21:32.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.679+0000 7f3868c00700 1 -- 172.21.15.2:0/3073391443 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f38580d1260 con 0x7f386c102ed0 2024-06-13T11:21:32.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.679+0000 7f3870e00700 1 --2- 172.21.15.2:0/3073391443 >> [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904] conn(0x7f38500ade90 0x7f38500b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:32.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.679+0000 7f386be00700 1 --2- 172.21.15.2:0/3073391443 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f38500a2cb0 0x7f38500a5170 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f385c009ca0 tx=0x7f385c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:32.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.680+0000 7f3870e00700 1 --2- 172.21.15.2:0/3073391443 >> [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904] conn(0x7f38500ade90 0x7f38500b0330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:32.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.681+0000 7f3868c00700 1 -- 172.21.15.2:0/3073391443 <== osd.4 v2:172.21.15.77:6808/3916694904 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3858024ec0 con 0x7f38500ade90 2024-06-13T11:21:32.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.699+0000 7f3872e00700 1 -- 172.21.15.2:0/3073391443 --> [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f386c0630a0 con 0x7f38500ade90 2024-06-13T11:21:32.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.699+0000 7f3868c00700 1 -- 172.21.15.2:0/3073391443 <== osd.4 v2:172.21.15.77:6808/3916694904 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f386c0630a0 con 0x7f38500ade90 2024-06-13T11:21:32.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.700+0000 7f3872e00700 1 -- 172.21.15.2:0/3073391443 >> [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904] conn(0x7f38500ade90 msgr2=0x7f38500b0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:32.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.700+0000 7f3872e00700 1 --2- 172.21.15.2:0/3073391443 >> [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904] conn(0x7f38500ade90 0x7f38500b0330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:32.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.700+0000 7f3872e00700 1 -- 172.21.15.2:0/3073391443 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f38500a2cb0 msgr2=0x7f38500a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:32.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.700+0000 7f3872e00700 1 --2- 172.21.15.2:0/3073391443 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f38500a2cb0 0x7f38500a5170 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f385c009ca0 tx=0x7f385c009260 comp rx=0 tx=0).stop 2024-06-13T11:21:32.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.700+0000 7f3872e00700 1 -- 172.21.15.2:0/3073391443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f386c102ed0 msgr2=0x7f386c074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:32.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.700+0000 7f3872e00700 1 --2- 172.21.15.2:0/3073391443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f386c102ed0 0x7f386c074cd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38580098e0 tx=0x7f385800b8a0 comp rx=0 tx=0).stop 2024-06-13T11:21:32.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.700+0000 7f3870e00700 1 -- 172.21.15.2:0/3073391443 reap_dead start 2024-06-13T11:21:32.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.701+0000 7f3872e00700 1 -- 172.21.15.2:0/3073391443 shutdown_connections 2024-06-13T11:21:32.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.701+0000 7f3872e00700 1 -- 172.21.15.2:0/3073391443 >> 172.21.15.2:0/3073391443 conn(0x7f386c079560 msgr2=0x7f386c1011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:32.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.701+0000 7f3872e00700 1 -- 172.21.15.2:0/3073391443 shutdown_connections 2024-06-13T11:21:32.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:32.701+0000 7f3872e00700 1 -- 172.21.15.2:0/3073391443 wait complete. 2024-06-13T11:21:33.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:33 smithi077 ceph-mon[36410]: pgmap v422: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-06-13T11:21:33.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:33 smithi002 ceph-mon[32210]: pgmap v422: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-06-13T11:21:33.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:33 smithi178 ceph-mon[36913]: pgmap v422: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-06-13T11:21:33.929 INFO:teuthology.orchestra.run.smithi002.stdout:343597383731 2024-06-13T11:21:33.929 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-06-13T11:21:34.017 INFO:teuthology.orchestra.run.smithi002.stdout:55834574956 2024-06-13T11:21:34.018 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-06-13T11:21:34.434 INFO:teuthology.orchestra.run.smithi002.stdout:197568495696 2024-06-13T11:21:34.434 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-06-13T11:21:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.103+0000 7f8c5c600700 1 -- 172.21.15.2:0/848840908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c54104690 msgr2=0x7f8c54104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.103+0000 7f8c5c600700 1 --2- 172.21.15.2:0/848840908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c54104690 0x7f8c54104b10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009990 tx=0x7f8c40009ca0 comp rx=0 tx=0).stop 2024-06-13T11:21:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.103+0000 7f8c5c600700 1 -- 172.21.15.2:0/848840908 shutdown_connections 2024-06-13T11:21:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.103+0000 7f8c5c600700 1 --2- 172.21.15.2:0/848840908 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c54105050 0x7f8c54111560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.103+0000 7f8c5c600700 1 --2- 172.21.15.2:0/848840908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c5410a690 0x7f8c5410aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.103+0000 7f8c5c600700 1 --2- 172.21.15.2:0/848840908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c54104690 0x7f8c54104b10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.103+0000 7f8c5c600700 1 -- 172.21.15.2:0/848840908 >> 172.21.15.2:0/848840908 conn(0x7f8c541001a0 msgr2=0x7f8c541025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.103+0000 7f8c5c600700 1 -- 172.21.15.2:0/848840908 shutdown_connections 2024-06-13T11:21:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.103+0000 7f8c5c600700 1 -- 172.21.15.2:0/848840908 wait complete. 2024-06-13T11:21:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.105+0000 7f8c5c600700 1 Processor -- start 2024-06-13T11:21:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.105+0000 7f8c5c600700 1 -- start start 2024-06-13T11:21:35.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.105+0000 7f8c5c600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c54104690 0x7f8c5419ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:35.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.105+0000 7f8c5c600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c54105050 0x7f8c5419b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:35.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.105+0000 7f8c5c600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c5410a690 0x7f8c5419f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:35.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.105+0000 7f8c5c600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8c54114a30 con 0x7f8c54105050 2024-06-13T11:21:35.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.105+0000 7f8c5c600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8c541148b0 con 0x7f8c5410a690 2024-06-13T11:21:35.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.105+0000 7f8c5c600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8c54114bb0 con 0x7f8c54104690 2024-06-13T11:21:35.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.106+0000 7f8c59c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c54104690 0x7f8c5419ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:35.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.106+0000 7f8c59200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c54105050 0x7f8c5419b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:35.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.106+0000 7f8c59c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c54104690 0x7f8c5419ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:42274/0 (socket says 172.21.15.2:42274) 2024-06-13T11:21:35.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.106+0000 7f8c59c00700 1 -- 172.21.15.2:0/7812437 learned_addr learned my addr 172.21.15.2:0/7812437 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:35.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.106+0000 7f8c5a600700 1 --2- 172.21.15.2:0/7812437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c5410a690 0x7f8c5419f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:35.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.106+0000 7f8c5a600700 1 -- 172.21.15.2:0/7812437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c54104690 msgr2=0x7f8c5419ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:35.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.106+0000 7f8c5a600700 1 --2- 172.21.15.2:0/7812437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c54104690 0x7f8c5419ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:35.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.106+0000 7f8c5a600700 1 -- 172.21.15.2:0/7812437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c54105050 msgr2=0x7f8c5419b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:35.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.106+0000 7f8c5a600700 1 --2- 172.21.15.2:0/7812437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c54105050 0x7f8c5419b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:35.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.106+0000 7f8c5a600700 1 -- 172.21.15.2:0/7812437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5419fe20 con 0x7f8c5410a690 2024-06-13T11:21:35.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.106+0000 7f8c59200700 1 --2- 172.21.15.2:0/7812437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c54105050 0x7f8c5419b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:21:35.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.106+0000 7f8c5a600700 1 --2- 172.21.15.2:0/7812437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c5410a690 0x7f8c5419f6e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00efc0 tx=0x7f8c4c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:35.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.107+0000 7f8c52000700 1 -- 172.21.15.2:0/7812437 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c0092e0 con 0x7f8c5410a690 2024-06-13T11:21:35.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.107+0000 7f8c5c600700 1 -- 172.21.15.2:0/7812437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c541a00b0 con 0x7f8c5410a690 2024-06-13T11:21:35.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.107+0000 7f8c52000700 1 -- 172.21.15.2:0/7812437 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c4c004bb0 con 0x7f8c5410a690 2024-06-13T11:21:35.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.107+0000 7f8c52000700 1 -- 172.21.15.2:0/7812437 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c004280 con 0x7f8c5410a690 2024-06-13T11:21:35.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.107+0000 7f8c5c600700 1 -- 172.21.15.2:0/7812437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c541a7990 con 0x7f8c5410a690 2024-06-13T11:21:35.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.108+0000 7f8c5c600700 1 -- 172.21.15.2:0/7812437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c34001030 con 0x7f8c5410a690 2024-06-13T11:21:35.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.110+0000 7f8c52000700 1 -- 172.21.15.2:0/7812437 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f8c4c01b030 con 0x7f8c5410a690 2024-06-13T11:21:35.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.111+0000 7f8c52000700 1 --2- 172.21.15.2:0/7812437 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8c3c0a2cb0 0x7f8c3c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.112+0000 7f8c52000700 1 -- 172.21.15.2:0/7812437 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f8c4c0cf990 con 0x7f8c5410a690 2024-06-13T11:21:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.112+0000 7f8c59c00700 1 --2- 172.21.15.2:0/7812437 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8c3c0a2cb0 0x7f8c3c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.112+0000 7f8c52000700 1 --2- 172.21.15.2:0/7812437 >> [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353] conn(0x7f8c3c0ade90 0x7f8c3c0b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.112+0000 7f8c52000700 1 -- 172.21.15.2:0/7812437 --> [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c4c01fe50 con 0x7f8c3c0ade90 2024-06-13T11:21:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.112+0000 7f8c52000700 1 -- 172.21.15.2:0/7812437 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f8c4c0cfd40 con 0x7f8c5410a690 2024-06-13T11:21:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.112+0000 7f8c59200700 1 --2- 172.21.15.2:0/7812437 >> [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353] conn(0x7f8c3c0ade90 0x7f8c3c0b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.113+0000 7f8c59c00700 1 --2- 172.21.15.2:0/7812437 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8c3c0a2cb0 0x7f8c3c0a5170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009ca0 tx=0x7f8c48009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.113+0000 7f8c59200700 1 --2- 172.21.15.2:0/7812437 >> [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353] conn(0x7f8c3c0ade90 0x7f8c3c0b0330 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.114+0000 7f8c52000700 1 -- 172.21.15.2:0/7812437 <== osd.3 v2:172.21.15.2:6810/1982693353 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c4c01fe50 con 0x7f8c3c0ade90 2024-06-13T11:21:35.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.132+0000 7f8c5c600700 1 -- 172.21.15.2:0/7812437 --> [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8c34002e60 con 0x7f8c3c0ade90 2024-06-13T11:21:35.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.133+0000 7f8c52000700 1 -- 172.21.15.2:0/7812437 <== osd.3 v2:172.21.15.2:6810/1982693353 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8c34002e60 con 0x7f8c3c0ade90 2024-06-13T11:21:35.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.134+0000 7f8c5c600700 1 -- 172.21.15.2:0/7812437 >> [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353] conn(0x7f8c3c0ade90 msgr2=0x7f8c3c0b0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:35.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.134+0000 7f8c5c600700 1 --2- 172.21.15.2:0/7812437 >> [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353] conn(0x7f8c3c0ade90 0x7f8c3c0b0330 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:35.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.134+0000 7f8c5c600700 1 -- 172.21.15.2:0/7812437 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8c3c0a2cb0 msgr2=0x7f8c3c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:35.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.134+0000 7f8c5c600700 1 --2- 172.21.15.2:0/7812437 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f8c3c0a2cb0 0x7f8c3c0a5170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009ca0 tx=0x7f8c48009260 comp rx=0 tx=0).stop 2024-06-13T11:21:35.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.134+0000 7f8c5c600700 1 -- 172.21.15.2:0/7812437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c5410a690 msgr2=0x7f8c5419f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:35.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.134+0000 7f8c5c600700 1 --2- 172.21.15.2:0/7812437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c5410a690 0x7f8c5419f6e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00efc0 tx=0x7f8c4c00c3a0 comp rx=0 tx=0).stop 2024-06-13T11:21:35.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.134+0000 7f8c5a600700 1 -- 172.21.15.2:0/7812437 reap_dead start 2024-06-13T11:21:35.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.134+0000 7f8c5c600700 1 -- 172.21.15.2:0/7812437 shutdown_connections 2024-06-13T11:21:35.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.134+0000 7f8c5c600700 1 -- 172.21.15.2:0/7812437 >> 172.21.15.2:0/7812437 conn(0x7f8c541001a0 msgr2=0x7f8c541006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:35.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.134+0000 7f8c5c600700 1 -- 172.21.15.2:0/7812437 shutdown_connections 2024-06-13T11:21:35.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:35.134+0000 7f8c5c600700 1 -- 172.21.15.2:0/7812437 wait complete. 2024-06-13T11:21:35.150 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:35 smithi002 ceph-mon[32210]: pgmap v423: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-06-13T11:21:35.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:35 smithi077 ceph-mon[36410]: pgmap v423: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-06-13T11:21:35.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:35 smithi178 ceph-mon[36913]: pgmap v423: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-06-13T11:21:35.581 INFO:teuthology.orchestra.run.smithi002.stdout:141733920859 2024-06-13T11:21:35.581 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-06-13T11:21:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:35.918 INFO:teuthology.orchestra.run.smithi002.stdout:309237645367 2024-06-13T11:21:35.918 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-06-13T11:21:36.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:36 smithi002 ceph-mon[32210]: pgmap v424: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4 op/s 2024-06-13T11:21:36.300 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:36.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:36 smithi178 ceph-mon[36913]: pgmap v424: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4 op/s 2024-06-13T11:21:36.539 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:36 smithi077 ceph-mon[36410]: pgmap v424: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4 op/s 2024-06-13T11:21:36.640 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:36.651 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:36.651 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:36.662 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:36.690 INFO:teuthology.orchestra.run.smithi002.stdout:107374182496 2024-06-13T11:21:36.691 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-06-13T11:21:38.436 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:38 smithi002 ceph-mon[32210]: pgmap v425: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:21:38.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:38 smithi178 ceph-mon[36913]: pgmap v425: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:21:38.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:38 smithi077 ceph-mon[36410]: pgmap v425: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:21:40.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:40 smithi002 ceph-mon[32210]: pgmap v426: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:40.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:40 smithi178 ceph-mon[36913]: pgmap v426: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:40.750 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:40.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:40 smithi077 ceph-mon[36410]: pgmap v426: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:42.383 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:42.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:42 smithi002 ceph-mon[32210]: pgmap v427: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:21:42.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:42 smithi178 ceph-mon[36913]: pgmap v427: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:21:42.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:42 smithi077 ceph-mon[36410]: pgmap v427: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.576+0000 7f4b9fe00700 1 -- 172.21.15.2:0/1458086300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba01018d0 msgr2=0x7f4ba01070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.576+0000 7f4b9fe00700 1 --2- 172.21.15.2:0/1458086300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba01018d0 0x7f4ba01070b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009990 tx=0x7f4b8c009ca0 comp rx=0 tx=0).stop 2024-06-13T11:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.577+0000 7f4b9fe00700 1 -- 172.21.15.2:0/1458086300 shutdown_connections 2024-06-13T11:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.577+0000 7f4b9fe00700 1 --2- 172.21.15.2:0/1458086300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ba0107790 0x7f4ba010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.577+0000 7f4b9fe00700 1 --2- 172.21.15.2:0/1458086300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ba0100f20 0x7f4ba0101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.577+0000 7f4b9fe00700 1 --2- 172.21.15.2:0/1458086300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba01018d0 0x7f4ba01070b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.577+0000 7f4b9fe00700 1 -- 172.21.15.2:0/1458086300 >> 172.21.15.2:0/1458086300 conn(0x7f4ba0076640 msgr2=0x7f4ba0076a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:43.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.577+0000 7f4b9fe00700 1 -- 172.21.15.2:0/1458086300 shutdown_connections 2024-06-13T11:21:43.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.577+0000 7f4b9fe00700 1 -- 172.21.15.2:0/1458086300 wait complete. 2024-06-13T11:21:43.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.578+0000 7f4b9fe00700 1 Processor -- start 2024-06-13T11:21:43.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.578+0000 7f4b9fe00700 1 -- start start 2024-06-13T11:21:43.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.579+0000 7f4b9fe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ba0100f20 0x7f4ba019ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:43.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.579+0000 7f4b9fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ba01018d0 0x7f4ba019b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:43.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.579+0000 7f4b9fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba0107790 0x7f4ba019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:43.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.579+0000 7f4b9fe00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba0112710 con 0x7f4ba0107790 2024-06-13T11:21:43.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.579+0000 7f4b9fe00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba0112590 con 0x7f4ba0100f20 2024-06-13T11:21:43.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.579+0000 7f4b9fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba0112890 con 0x7f4ba01018d0 2024-06-13T11:21:43.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.579+0000 7f4b9ea00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ba0100f20 0x7f4ba019ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:43.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.579+0000 7f4b9ea00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ba0100f20 0x7f4ba019ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:58502/0 (socket says 172.21.15.2:58502) 2024-06-13T11:21:43.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.579+0000 7f4b9ea00700 1 -- 172.21.15.2:0/4270170806 learned_addr learned my addr 172.21.15.2:0/4270170806 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:43.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.579+0000 7f4b9e000700 1 --2- 172.21.15.2:0/4270170806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ba01018d0 0x7f4ba019b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.580+0000 7f4b9f400700 1 --2- 172.21.15.2:0/4270170806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba0107790 0x7f4ba019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.580+0000 7f4b9ea00700 1 -- 172.21.15.2:0/4270170806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ba01018d0 msgr2=0x7f4ba019b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.580+0000 7f4b9ea00700 1 --2- 172.21.15.2:0/4270170806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ba01018d0 0x7f4ba019b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.580+0000 7f4b9ea00700 1 -- 172.21.15.2:0/4270170806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba0107790 msgr2=0x7f4ba019f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.580+0000 7f4b9ea00700 1 --2- 172.21.15.2:0/4270170806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba0107790 0x7f4ba019f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.580+0000 7f4b9ea00700 1 -- 172.21.15.2:0/4270170806 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba019fd70 con 0x7f4ba0100f20 2024-06-13T11:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.580+0000 7f4b9ea00700 1 --2- 172.21.15.2:0/4270170806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ba0100f20 0x7f4ba019ad60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000e9a0 tx=0x7f4b9000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.580+0000 7f4b97400700 1 -- 172.21.15.2:0/4270170806 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9000cbd0 con 0x7f4ba0100f20 2024-06-13T11:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.580+0000 7f4b9fe00700 1 -- 172.21.15.2:0/4270170806 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba01a0060 con 0x7f4ba0100f20 2024-06-13T11:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.580+0000 7f4b97400700 1 -- 172.21.15.2:0/4270170806 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b9000cd70 con 0x7f4ba0100f20 2024-06-13T11:21:43.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.580+0000 7f4b97400700 1 -- 172.21.15.2:0/4270170806 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90018750 con 0x7f4ba0100f20 2024-06-13T11:21:43.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.581+0000 7f4b9fe00700 1 -- 172.21.15.2:0/4270170806 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba01a78e0 con 0x7f4ba0100f20 2024-06-13T11:21:43.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.582+0000 7f4b9fe00700 1 -- 172.21.15.2:0/4270170806 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba0069180 con 0x7f4ba0100f20 2024-06-13T11:21:43.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.584+0000 7f4b97400700 1 -- 172.21.15.2:0/4270170806 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f4b90010430 con 0x7f4ba0100f20 2024-06-13T11:21:43.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.585+0000 7f4b97400700 1 --2- 172.21.15.2:0/4270170806 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4b840a2cb0 0x7f4b840a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:43.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.585+0000 7f4b97400700 1 -- 172.21.15.2:0/4270170806 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f4b900cfbd0 con 0x7f4ba0100f20 2024-06-13T11:21:43.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.585+0000 7f4b9e000700 1 --2- 172.21.15.2:0/4270170806 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4b840a2cb0 0x7f4b840a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:43.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.586+0000 7f4b9e000700 1 --2- 172.21.15.2:0/4270170806 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4b840a2cb0 0x7f4b840a5170 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00b2e0 tx=0x7f4b8c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:43.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.587+0000 7f4b97400700 1 -- 172.21.15.2:0/4270170806 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4b9009c5e0 con 0x7f4ba0100f20 2024-06-13T11:21:43.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.823+0000 7f4b9fe00700 1 -- 172.21.15.2:0/4270170806 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4ba01a7ab0 con 0x7f4ba0100f20 2024-06-13T11:21:43.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.824+0000 7f4b97400700 1 -- 172.21.15.2:0/4270170806 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4b9009bee0 con 0x7f4ba0100f20 2024-06-13T11:21:43.823 INFO:teuthology.orchestra.run.smithi002.stdout:34359738483 2024-06-13T11:21:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.827+0000 7f4b9fe00700 1 -- 172.21.15.2:0/4270170806 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4b840a2cb0 msgr2=0x7f4b840a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.827+0000 7f4b9fe00700 1 --2- 172.21.15.2:0/4270170806 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4b840a2cb0 0x7f4b840a5170 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00b2e0 tx=0x7f4b8c005960 comp rx=0 tx=0).stop 2024-06-13T11:21:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.827+0000 7f4b9fe00700 1 -- 172.21.15.2:0/4270170806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ba0100f20 msgr2=0x7f4ba019ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.827+0000 7f4b9fe00700 1 --2- 172.21.15.2:0/4270170806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ba0100f20 0x7f4ba019ad60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000e9a0 tx=0x7f4b9000ecb0 comp rx=0 tx=0).stop 2024-06-13T11:21:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.827+0000 7f4b9fe00700 1 -- 172.21.15.2:0/4270170806 shutdown_connections 2024-06-13T11:21:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.827+0000 7f4b9fe00700 1 --2- 172.21.15.2:0/4270170806 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f4b840a2cb0 0x7f4b840a5170 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.827+0000 7f4b9fe00700 1 --2- 172.21.15.2:0/4270170806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba0107790 0x7f4ba019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.827+0000 7f4b9fe00700 1 --2- 172.21.15.2:0/4270170806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ba0100f20 0x7f4ba019ad60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.827+0000 7f4b9fe00700 1 --2- 172.21.15.2:0/4270170806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ba01018d0 0x7f4ba019b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.827+0000 7f4b9fe00700 1 -- 172.21.15.2:0/4270170806 >> 172.21.15.2:0/4270170806 conn(0x7f4ba0076640 msgr2=0x7f4ba010dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.827+0000 7f4b9fe00700 1 -- 172.21.15.2:0/4270170806 shutdown_connections 2024-06-13T11:21:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:43.827+0000 7f4b9fe00700 1 -- 172.21.15.2:0/4270170806 wait complete. 2024-06-13T11:21:44.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:44 smithi002 ceph-mon[32210]: pgmap v428: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-06-13T11:21:44.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:44 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/4270170806' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-13T11:21:44.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:44 smithi178 ceph-mon[36913]: pgmap v428: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-06-13T11:21:44.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:44 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/4270170806' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-13T11:21:44.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:44 smithi077 ceph-mon[36410]: pgmap v428: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-06-13T11:21:44.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:44 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/4270170806' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-13T11:21:45.893 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738479 got 34359738483 for osd.0 2024-06-13T11:21:45.894 DEBUG:teuthology.parallel:result is None 2024-06-13T11:21:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.136+0000 7f095c200700 1 -- 172.21.15.2:0/4085655322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0954108580 msgr2=0x7f0954108960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.136+0000 7f095c200700 1 --2- 172.21.15.2:0/4085655322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0954108580 0x7f0954108960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0948009f90 tx=0x7f094800b330 comp rx=0 tx=0).stop 2024-06-13T11:21:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.136+0000 7f095c200700 1 -- 172.21.15.2:0/4085655322 shutdown_connections 2024-06-13T11:21:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.136+0000 7f095c200700 1 --2- 172.21.15.2:0/4085655322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0954102e90 0x7f095410f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.136+0000 7f095c200700 1 --2- 172.21.15.2:0/4085655322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0954108580 0x7f0954108960 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.136+0000 7f095c200700 1 --2- 172.21.15.2:0/4085655322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09541024d0 0x7f0954102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.136+0000 7f095c200700 1 -- 172.21.15.2:0/4085655322 >> 172.21.15.2:0/4085655322 conn(0x7f09540fdf60 msgr2=0x7f0954100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.136+0000 7f095c200700 1 -- 172.21.15.2:0/4085655322 shutdown_connections 2024-06-13T11:21:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.137+0000 7f095c200700 1 -- 172.21.15.2:0/4085655322 wait complete. 2024-06-13T11:21:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.137+0000 7f095c200700 1 Processor -- start 2024-06-13T11:21:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.138+0000 7f095c200700 1 -- start start 2024-06-13T11:21:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.138+0000 7f095c200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09541024d0 0x7f0954074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.138+0000 7f095c200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0954102e90 0x7f0954074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.138+0000 7f095c200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0954108580 0x7f0954075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.138+0000 7f095c200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0954112810 con 0x7f0954102e90 2024-06-13T11:21:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.138+0000 7f095c200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0954112690 con 0x7f09541024d0 2024-06-13T11:21:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.138+0000 7f095c200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0954112990 con 0x7f0954108580 2024-06-13T11:21:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.138+0000 7f0958e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0954102e90 0x7f0954074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.138+0000 7f0958e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0954102e90 0x7f0954074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48634/0 (socket says 172.21.15.2:48634) 2024-06-13T11:21:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.138+0000 7f0958e00700 1 -- 172.21.15.2:0/3582915357 learned_addr learned my addr 172.21.15.2:0/3582915357 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.139+0000 7f095a200700 1 --2- 172.21.15.2:0/3582915357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0954108580 0x7f0954075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.139+0000 7f0959800700 1 --2- 172.21.15.2:0/3582915357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09541024d0 0x7f0954074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.139+0000 7f0958e00700 1 -- 172.21.15.2:0/3582915357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0954108580 msgr2=0x7f0954075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.139+0000 7f0958e00700 1 --2- 172.21.15.2:0/3582915357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0954108580 0x7f0954075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.139+0000 7f0958e00700 1 -- 172.21.15.2:0/3582915357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09541024d0 msgr2=0x7f0954074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.139+0000 7f0958e00700 1 --2- 172.21.15.2:0/3582915357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09541024d0 0x7f0954074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.139+0000 7f0958e00700 1 -- 172.21.15.2:0/3582915357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09541a7230 con 0x7f0954102e90 2024-06-13T11:21:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.139+0000 7f095a200700 1 --2- 172.21.15.2:0/3582915357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0954108580 0x7f0954075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:21:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.139+0000 7f0958e00700 1 --2- 172.21.15.2:0/3582915357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0954102e90 0x7f0954074cd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f094000ec10 tx=0x7f094000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.140+0000 7f0952000700 1 -- 172.21.15.2:0/3582915357 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094000cc90 con 0x7f0954102e90 2024-06-13T11:21:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.140+0000 7f095c200700 1 -- 172.21.15.2:0/3582915357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09541a7520 con 0x7f0954102e90 2024-06-13T11:21:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.140+0000 7f0952000700 1 -- 172.21.15.2:0/3582915357 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f094000ce30 con 0x7f0954102e90 2024-06-13T11:21:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.140+0000 7f0952000700 1 -- 172.21.15.2:0/3582915357 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940010690 con 0x7f0954102e90 2024-06-13T11:21:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.140+0000 7f095c200700 1 -- 172.21.15.2:0/3582915357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09541a7ab0 con 0x7f0954102e90 2024-06-13T11:21:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.141+0000 7f095c200700 1 -- 172.21.15.2:0/3582915357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f095410aa10 con 0x7f0954102e90 2024-06-13T11:21:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.143+0000 7f0952000700 1 -- 172.21.15.2:0/3582915357 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f0940003680 con 0x7f0954102e90 2024-06-13T11:21:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.145+0000 7f0952000700 1 --2- 172.21.15.2:0/3582915357 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f093c0a2cb0 0x7f093c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.145+0000 7f0952000700 1 -- 172.21.15.2:0/3582915357 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f09400cf920 con 0x7f0954102e90 2024-06-13T11:21:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.145+0000 7f0959800700 1 --2- 172.21.15.2:0/3582915357 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f093c0a2cb0 0x7f093c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.146+0000 7f0959800700 1 --2- 172.21.15.2:0/3582915357 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f093c0a2cb0 0x7f093c0a5170 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f094800b6c0 tx=0x7f09480096c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.149+0000 7f0952000700 1 -- 172.21.15.2:0/3582915357 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f094009c330 con 0x7f0954102e90 2024-06-13T11:21:46.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.388+0000 7f095c200700 1 -- 172.21.15.2:0/3582915357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f0954075cc0 con 0x7f0954102e90 2024-06-13T11:21:46.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.389+0000 7f0952000700 1 -- 172.21.15.2:0/3582915357 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f094009bc30 con 0x7f0954102e90 2024-06-13T11:21:46.388 INFO:teuthology.orchestra.run.smithi002.stdout:253403070534 2024-06-13T11:21:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.392+0000 7f095c200700 1 -- 172.21.15.2:0/3582915357 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f093c0a2cb0 msgr2=0x7f093c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.392+0000 7f095c200700 1 --2- 172.21.15.2:0/3582915357 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f093c0a2cb0 0x7f093c0a5170 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f094800b6c0 tx=0x7f09480096c0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.392+0000 7f095c200700 1 -- 172.21.15.2:0/3582915357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0954102e90 msgr2=0x7f0954074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.392+0000 7f095c200700 1 --2- 172.21.15.2:0/3582915357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0954102e90 0x7f0954074cd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f094000ec10 tx=0x7f094000ef20 comp rx=0 tx=0).stop 2024-06-13T11:21:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.392+0000 7f095c200700 1 -- 172.21.15.2:0/3582915357 shutdown_connections 2024-06-13T11:21:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.393+0000 7f095c200700 1 --2- 172.21.15.2:0/3582915357 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f093c0a2cb0 0x7f093c0a5170 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.393+0000 7f095c200700 1 --2- 172.21.15.2:0/3582915357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0954108580 0x7f0954075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.393+0000 7f095c200700 1 --2- 172.21.15.2:0/3582915357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09541024d0 0x7f0954074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.393+0000 7f095c200700 1 --2- 172.21.15.2:0/3582915357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0954102e90 0x7f0954074cd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.393+0000 7f095c200700 1 -- 172.21.15.2:0/3582915357 >> 172.21.15.2:0/3582915357 conn(0x7f09540fdf60 msgr2=0x7f09540ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.393+0000 7f095c200700 1 -- 172.21.15.2:0/3582915357 shutdown_connections 2024-06-13T11:21:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.393+0000 7f095c200700 1 -- 172.21.15.2:0/3582915357 wait complete. 2024-06-13T11:21:46.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:46 smithi002 ceph-mon[32210]: pgmap v429: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-06-13T11:21:46.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:46 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2059072997' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-13T11:21:46.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:46 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3582915357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-13T11:21:46.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:46 smithi178 ceph-mon[36913]: pgmap v429: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-06-13T11:21:46.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:46 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2059072997' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-13T11:21:46.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:46 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3582915357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-13T11:21:46.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:46 smithi077 ceph-mon[36410]: pgmap v429: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-06-13T11:21:46.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:46 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2059072997' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-13T11:21:46.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:46 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3582915357' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-13T11:21:46.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.678+0000 7f926e400700 1 -- 172.21.15.2:0/1819645414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f926806b3c0 msgr2=0x7f926810f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.678+0000 7f926e400700 1 --2- 172.21.15.2:0/1819645414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f926806b3c0 0x7f926810f310 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f926000b0a0 tx=0x7f926000b3b0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.678+0000 7f926e400700 1 -- 172.21.15.2:0/1819645414 shutdown_connections 2024-06-13T11:21:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.678+0000 7f926e400700 1 --2- 172.21.15.2:0/1819645414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92681084f0 0x7f92681088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.678+0000 7f926e400700 1 --2- 172.21.15.2:0/1819645414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f926806b3c0 0x7f926810f310 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.678+0000 7f926e400700 1 --2- 172.21.15.2:0/1819645414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f926806aa00 0x7f926806ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.678+0000 7f926e400700 1 -- 172.21.15.2:0/1819645414 >> 172.21.15.2:0/1819645414 conn(0x7f9268078300 msgr2=0x7f9268078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.679+0000 7f926e400700 1 -- 172.21.15.2:0/1819645414 shutdown_connections 2024-06-13T11:21:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.679+0000 7f926e400700 1 -- 172.21.15.2:0/1819645414 wait complete. 2024-06-13T11:21:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.680+0000 7f926e400700 1 Processor -- start 2024-06-13T11:21:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.680+0000 7f926e400700 1 -- start start 2024-06-13T11:21:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f926e400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f926806aa00 0x7f926819ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f926e400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f926806b3c0 0x7f926819b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:46.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f926e400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92681084f0 0x7f926819f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:46.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f926e400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f92681127a0 con 0x7f926806aa00 2024-06-13T11:21:46.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f926e400700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9268112620 con 0x7f92681084f0 2024-06-13T11:21:46.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f926e400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9268112920 con 0x7f926806b3c0 2024-06-13T11:21:46.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f9267400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f926806aa00 0x7f926819ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:46.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f9267e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92681084f0 0x7f926819f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f925ea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f926806b3c0 0x7f926819b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f9267e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92681084f0 0x7f926819f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:58520/0 (socket says 172.21.15.2:58520) 2024-06-13T11:21:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f9267e00700 1 -- 172.21.15.2:0/2059072997 learned_addr learned my addr 172.21.15.2:0/2059072997 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f9267e00700 1 -- 172.21.15.2:0/2059072997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f926806b3c0 msgr2=0x7f926819b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f9267e00700 1 --2- 172.21.15.2:0/2059072997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f926806b3c0 0x7f926819b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f9267e00700 1 -- 172.21.15.2:0/2059072997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f926806aa00 msgr2=0x7f926819ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f9267e00700 1 --2- 172.21.15.2:0/2059072997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f926806aa00 0x7f926819ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f9267e00700 1 -- 172.21.15.2:0/2059072997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926819fdb0 con 0x7f92681084f0 2024-06-13T11:21:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.681+0000 7f9267400700 1 --2- 172.21.15.2:0/2059072997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f926806aa00 0x7f926819ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:21:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.682+0000 7f9267e00700 1 --2- 172.21.15.2:0/2059072997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92681084f0 0x7f926819f670 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f926000b070 tx=0x7f9260004c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.682+0000 7f9264c00700 1 -- 172.21.15.2:0/2059072997 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9260021070 con 0x7f92681084f0 2024-06-13T11:21:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.682+0000 7f9264c00700 1 -- 172.21.15.2:0/2059072997 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9260003c00 con 0x7f92681084f0 2024-06-13T11:21:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.682+0000 7f926e400700 1 -- 172.21.15.2:0/2059072997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92681a0040 con 0x7f92681084f0 2024-06-13T11:21:46.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.682+0000 7f9264c00700 1 -- 172.21.15.2:0/2059072997 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92600047f0 con 0x7f92681084f0 2024-06-13T11:21:46.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.682+0000 7f926e400700 1 -- 172.21.15.2:0/2059072997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92681a7920 con 0x7f92681084f0 2024-06-13T11:21:46.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.683+0000 7f926e400700 1 -- 172.21.15.2:0/2059072997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9268069180 con 0x7f92681084f0 2024-06-13T11:21:46.947 INFO:teuthology.orchestra.run.smithi002.stdout:287762808896 2024-06-13T11:21:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.685+0000 7f9264c00700 1 -- 172.21.15.2:0/2059072997 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f9260007980 con 0x7f92681084f0 2024-06-13T11:21:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.687+0000 7f9264c00700 1 --2- 172.21.15.2:0/2059072997 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f924c0a2cb0 0x7f924c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.687+0000 7f9264c00700 1 -- 172.21.15.2:0/2059072997 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f926000f020 con 0x7f92681084f0 2024-06-13T11:21:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.687+0000 7f9267400700 1 --2- 172.21.15.2:0/2059072997 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f924c0a2cb0 0x7f924c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.688+0000 7f9267400700 1 --2- 172.21.15.2:0/2059072997 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f924c0a2cb0 0x7f924c0a5170 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9258009c90 tx=0x7f9258009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.689+0000 7f9264c00700 1 -- 172.21.15.2:0/2059072997 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f926002a020 con 0x7f92681084f0 2024-06-13T11:21:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.924+0000 7f926e400700 1 -- 172.21.15.2:0/2059072997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f92681a7af0 con 0x7f92681084f0 2024-06-13T11:21:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.925+0000 7f9264c00700 1 -- 172.21.15.2:0/2059072997 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f926009d7f0 con 0x7f92681084f0 2024-06-13T11:21:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.928+0000 7f926e400700 1 -- 172.21.15.2:0/2059072997 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f924c0a2cb0 msgr2=0x7f924c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.928+0000 7f926e400700 1 --2- 172.21.15.2:0/2059072997 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f924c0a2cb0 0x7f924c0a5170 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9258009c90 tx=0x7f9258009260 comp rx=0 tx=0).stop 2024-06-13T11:21:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.928+0000 7f926e400700 1 -- 172.21.15.2:0/2059072997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92681084f0 msgr2=0x7f926819f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.928+0000 7f926e400700 1 --2- 172.21.15.2:0/2059072997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92681084f0 0x7f926819f670 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f926000b070 tx=0x7f9260004c60 comp rx=0 tx=0).stop 2024-06-13T11:21:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.928+0000 7f926e400700 1 -- 172.21.15.2:0/2059072997 shutdown_connections 2024-06-13T11:21:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.928+0000 7f926e400700 1 --2- 172.21.15.2:0/2059072997 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f924c0a2cb0 0x7f924c0a5170 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.928+0000 7f926e400700 1 --2- 172.21.15.2:0/2059072997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f926806aa00 0x7f926819ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.928+0000 7f926e400700 1 --2- 172.21.15.2:0/2059072997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92681084f0 0x7f926819f670 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.928+0000 7f926e400700 1 --2- 172.21.15.2:0/2059072997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f926806b3c0 0x7f926819b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.928+0000 7f926e400700 1 -- 172.21.15.2:0/2059072997 >> 172.21.15.2:0/2059072997 conn(0x7f9268078300 msgr2=0x7f926810d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.929+0000 7f926e400700 1 -- 172.21.15.2:0/2059072997 shutdown_connections 2024-06-13T11:21:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:45.929+0000 7f926e400700 1 -- 172.21.15.2:0/2059072997 wait complete. 2024-06-13T11:21:47.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.600+0000 7ff877200700 1 -- 172.21.15.2:0/2089458829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8781045c0 msgr2=0x7ff878104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:47.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.600+0000 7ff877200700 1 --2- 172.21.15.2:0/2089458829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8781045c0 0x7ff878104a40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff864009990 tx=0x7ff864009ca0 comp rx=0 tx=0).stop 2024-06-13T11:21:47.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.600+0000 7ff877200700 1 -- 172.21.15.2:0/2089458829 shutdown_connections 2024-06-13T11:21:47.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.600+0000 7ff877200700 1 --2- 172.21.15.2:0/2089458829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff878104f80 0x7ff878111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:47.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.600+0000 7ff877200700 1 --2- 172.21.15.2:0/2089458829 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff87810a650 0x7ff87810aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:47.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.600+0000 7ff877200700 1 --2- 172.21.15.2:0/2089458829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8781045c0 0x7ff878104a40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:47.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.600+0000 7ff877200700 1 -- 172.21.15.2:0/2089458829 >> 172.21.15.2:0/2089458829 conn(0x7ff8781000b0 msgr2=0x7ff8781024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:47.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.600+0000 7ff877200700 1 -- 172.21.15.2:0/2089458829 shutdown_connections 2024-06-13T11:21:47.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.600+0000 7ff877200700 1 -- 172.21.15.2:0/2089458829 wait complete. 2024-06-13T11:21:47.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.602+0000 7ff877200700 1 Processor -- start 2024-06-13T11:21:47.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.602+0000 7ff877200700 1 -- start start 2024-06-13T11:21:47.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.603+0000 7ff877200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8781045c0 0x7ff8781a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:47.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.603+0000 7ff877200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff878104f80 0x7ff8781a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:47.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.603+0000 7ff877200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff87810a650 0x7ff87819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:47.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.603+0000 7ff877200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff878114960 con 0x7ff8781045c0 2024-06-13T11:21:47.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.603+0000 7ff877200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff8781147e0 con 0x7ff87810a650 2024-06-13T11:21:47.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.603+0000 7ff877200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff878114ae0 con 0x7ff878104f80 2024-06-13T11:21:47.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.603+0000 7ff875e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8781045c0 0x7ff8781a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:47.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.603+0000 7ff875e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8781045c0 0x7ff8781a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48648/0 (socket says 172.21.15.2:48648) 2024-06-13T11:21:47.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.603+0000 7ff875400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff878104f80 0x7ff8781a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:47.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.603+0000 7ff875e00700 1 -- 172.21.15.2:0/2981015026 learned_addr learned my addr 172.21.15.2:0/2981015026 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:47.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.603+0000 7ff876800700 1 --2- 172.21.15.2:0/2981015026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff87810a650 0x7ff87819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:47.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.603+0000 7ff875e00700 1 -- 172.21.15.2:0/2981015026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff878104f80 msgr2=0x7ff8781a0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:47.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.603+0000 7ff875e00700 1 --2- 172.21.15.2:0/2981015026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff878104f80 0x7ff8781a0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:47.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.603+0000 7ff875e00700 1 -- 172.21.15.2:0/2981015026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff87810a650 msgr2=0x7ff87819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:47.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.603+0000 7ff875e00700 1 --2- 172.21.15.2:0/2981015026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff87810a650 0x7ff87819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:47.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.603+0000 7ff875e00700 1 -- 172.21.15.2:0/2981015026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87819b2a0 con 0x7ff8781045c0 2024-06-13T11:21:47.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.604+0000 7ff875400700 1 --2- 172.21.15.2:0/2981015026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff878104f80 0x7ff8781a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:21:47.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.604+0000 7ff876800700 1 --2- 172.21.15.2:0/2981015026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff87810a650 0x7ff87819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:21:47.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.604+0000 7ff875e00700 1 --2- 172.21.15.2:0/2981015026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8781045c0 0x7ff8781a0930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff86800ea50 tx=0x7ff86800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:47.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.604+0000 7ff86ea00700 1 -- 172.21.15.2:0/2981015026 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86800cbd0 con 0x7ff8781045c0 2024-06-13T11:21:47.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.604+0000 7ff877200700 1 -- 172.21.15.2:0/2981015026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff87819b590 con 0x7ff8781045c0 2024-06-13T11:21:47.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.604+0000 7ff86ea00700 1 -- 172.21.15.2:0/2981015026 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff86800cd70 con 0x7ff8781045c0 2024-06-13T11:21:47.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.604+0000 7ff877200700 1 -- 172.21.15.2:0/2981015026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8781a7800 con 0x7ff8781045c0 2024-06-13T11:21:47.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.604+0000 7ff86ea00700 1 -- 172.21.15.2:0/2981015026 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff868004a70 con 0x7ff8781045c0 2024-06-13T11:21:47.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.606+0000 7ff877200700 1 -- 172.21.15.2:0/2981015026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff878069180 con 0x7ff8781045c0 2024-06-13T11:21:47.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.608+0000 7ff86ea00700 1 -- 172.21.15.2:0/2981015026 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7ff86801f020 con 0x7ff8781045c0 2024-06-13T11:21:47.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.609+0000 7ff86ea00700 1 --2- 172.21.15.2:0/2981015026 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff85c0a2cb0 0x7ff85c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:47.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.609+0000 7ff86ea00700 1 -- 172.21.15.2:0/2981015026 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7ff8680cf6b0 con 0x7ff8781045c0 2024-06-13T11:21:47.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.609+0000 7ff875400700 1 --2- 172.21.15.2:0/2981015026 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff85c0a2cb0 0x7ff85c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:47.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.610+0000 7ff875400700 1 --2- 172.21.15.2:0/2981015026 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff85c0a2cb0 0x7ff85c0a5170 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff878109cd0 tx=0x7ff86400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:47.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.614+0000 7ff86ea00700 1 -- 172.21.15.2:0/2981015026 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff868053850 con 0x7ff8781045c0 2024-06-13T11:21:47.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.853+0000 7ff877200700 1 -- 172.21.15.2:0/2981015026 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff87802dca0 con 0x7ff8781045c0 2024-06-13T11:21:47.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.853+0000 7ff86ea00700 1 -- 172.21.15.2:0/2981015026 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff86809c0c0 con 0x7ff8781045c0 2024-06-13T11:21:47.568 INFO:teuthology.orchestra.run.smithi002.stdout:77309411432 2024-06-13T11:21:47.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.856+0000 7ff877200700 1 -- 172.21.15.2:0/2981015026 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff85c0a2cb0 msgr2=0x7ff85c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:47.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.856+0000 7ff877200700 1 --2- 172.21.15.2:0/2981015026 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff85c0a2cb0 0x7ff85c0a5170 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff878109cd0 tx=0x7ff86400b260 comp rx=0 tx=0).stop 2024-06-13T11:21:47.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.856+0000 7ff877200700 1 -- 172.21.15.2:0/2981015026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8781045c0 msgr2=0x7ff8781a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:47.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.856+0000 7ff877200700 1 --2- 172.21.15.2:0/2981015026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8781045c0 0x7ff8781a0930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff86800ea50 tx=0x7ff86800ed60 comp rx=0 tx=0).stop 2024-06-13T11:21:47.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.857+0000 7ff877200700 1 -- 172.21.15.2:0/2981015026 shutdown_connections 2024-06-13T11:21:47.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.857+0000 7ff877200700 1 --2- 172.21.15.2:0/2981015026 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff85c0a2cb0 0x7ff85c0a5170 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:47.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.857+0000 7ff877200700 1 --2- 172.21.15.2:0/2981015026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8781045c0 0x7ff8781a0930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:47.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.857+0000 7ff877200700 1 --2- 172.21.15.2:0/2981015026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff87810a650 0x7ff87819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:47.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.857+0000 7ff877200700 1 --2- 172.21.15.2:0/2981015026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff878104f80 0x7ff8781a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:47.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.857+0000 7ff877200700 1 -- 172.21.15.2:0/2981015026 >> 172.21.15.2:0/2981015026 conn(0x7ff8781000b0 msgr2=0x7ff878101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:47.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.857+0000 7ff877200700 1 -- 172.21.15.2:0/2981015026 shutdown_connections 2024-06-13T11:21:47.570 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:47 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2981015026' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-13T11:21:47.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:46.857+0000 7ff877200700 1 -- 172.21.15.2:0/2981015026 wait complete. 2024-06-13T11:21:47.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:47 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2981015026' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-13T11:21:47.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:47 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2981015026' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-13T11:21:48.635 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808892 got 287762808896 for osd.9 2024-06-13T11:21:48.636 DEBUG:teuthology.parallel:result is None 2024-06-13T11:21:48.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:48 smithi002 ceph-mon[32210]: pgmap v430: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:21:48.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:48 smithi178 ceph-mon[36913]: pgmap v430: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:21:48.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:48 smithi077 ceph-mon[36410]: pgmap v430: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:21:49.432 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070530 got 253403070534 for osd.8 2024-06-13T11:21:49.432 DEBUG:teuthology.parallel:result is None 2024-06-13T11:21:50.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:50 smithi178 ceph-mon[36913]: pgmap v431: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:21:50.729 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:50 smithi002 ceph-mon[32210]: pgmap v431: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:21:50.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:50 smithi077 ceph-mon[36410]: pgmap v431: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:21:50.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.729+0000 7efd3cc00700 1 -- 172.21.15.2:0/3479389115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd380769c0 msgr2=0x7efd38076da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:50.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.729+0000 7efd3cc00700 1 --2- 172.21.15.2:0/3479389115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd380769c0 0x7efd38076da0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efd28009990 tx=0x7efd28009ca0 comp rx=0 tx=0).stop 2024-06-13T11:21:50.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.729+0000 7efd3cc00700 1 -- 172.21.15.2:0/3479389115 shutdown_connections 2024-06-13T11:21:50.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.729+0000 7efd3cc00700 1 --2- 172.21.15.2:0/3479389115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd380769c0 0x7efd38076da0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:50.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.729+0000 7efd3cc00700 1 --2- 172.21.15.2:0/3479389115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd38113240 0x7efd38115630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:50.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.729+0000 7efd3cc00700 1 --2- 172.21.15.2:0/3479389115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd380772e0 0x7efd38112d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:50.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.729+0000 7efd3cc00700 1 -- 172.21.15.2:0/3479389115 >> 172.21.15.2:0/3479389115 conn(0x7efd38100070 msgr2=0x7efd38102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.730+0000 7efd3cc00700 1 -- 172.21.15.2:0/3479389115 shutdown_connections 2024-06-13T11:21:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.730+0000 7efd3cc00700 1 -- 172.21.15.2:0/3479389115 wait complete. 2024-06-13T11:21:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.731+0000 7efd3cc00700 1 Processor -- start 2024-06-13T11:21:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.731+0000 7efd3cc00700 1 -- start start 2024-06-13T11:21:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.731+0000 7efd3cc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd380769c0 0x7efd3819f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.731+0000 7efd3cc00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd380772e0 0x7efd3819f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.731+0000 7efd3cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd38113240 0x7efd381a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.731+0000 7efd3cc00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efd38118d70 con 0x7efd38113240 2024-06-13T11:21:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.731+0000 7efd3cc00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd38118bf0 con 0x7efd380772e0 2024-06-13T11:21:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.731+0000 7efd3cc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efd38118ef0 con 0x7efd380769c0 2024-06-13T11:21:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.732+0000 7efd37e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd38113240 0x7efd381a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:50.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.732+0000 7efd37e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd38113240 0x7efd381a3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48666/0 (socket says 172.21.15.2:48666) 2024-06-13T11:21:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.732+0000 7efd36a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd380772e0 0x7efd3819f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.732+0000 7efd37e00700 1 -- 172.21.15.2:0/2324051146 learned_addr learned my addr 172.21.15.2:0/2324051146 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.732+0000 7efd37400700 1 --2- 172.21.15.2:0/2324051146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd380769c0 0x7efd3819f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.732+0000 7efd36a00700 1 -- 172.21.15.2:0/2324051146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd380769c0 msgr2=0x7efd3819f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.732+0000 7efd36a00700 1 --2- 172.21.15.2:0/2324051146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd380769c0 0x7efd3819f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.732+0000 7efd36a00700 1 -- 172.21.15.2:0/2324051146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd38113240 msgr2=0x7efd381a3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.732+0000 7efd36a00700 1 --2- 172.21.15.2:0/2324051146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd38113240 0x7efd381a3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.732+0000 7efd36a00700 1 -- 172.21.15.2:0/2324051146 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd381a4190 con 0x7efd380772e0 2024-06-13T11:21:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.732+0000 7efd37e00700 1 --2- 172.21.15.2:0/2324051146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd38113240 0x7efd381a3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:21:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.733+0000 7efd36a00700 1 --2- 172.21.15.2:0/2324051146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd380772e0 0x7efd3819f6c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efd2400d750 tx=0x7efd2400da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.733+0000 7efd2fe00700 1 -- 172.21.15.2:0/2324051146 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd24016070 con 0x7efd380772e0 2024-06-13T11:21:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.733+0000 7efd2fe00700 1 -- 172.21.15.2:0/2324051146 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd24005020 con 0x7efd380772e0 2024-06-13T11:21:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.733+0000 7efd3cc00700 1 -- 172.21.15.2:0/2324051146 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd381a4480 con 0x7efd380772e0 2024-06-13T11:21:50.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.733+0000 7efd2fe00700 1 -- 172.21.15.2:0/2324051146 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2400fb30 con 0x7efd380772e0 2024-06-13T11:21:50.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.733+0000 7efd3cc00700 1 -- 172.21.15.2:0/2324051146 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd381abd00 con 0x7efd380772e0 2024-06-13T11:21:50.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.734+0000 7efd3cc00700 1 -- 172.21.15.2:0/2324051146 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd38069180 con 0x7efd380772e0 2024-06-13T11:21:50.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.737+0000 7efd2fe00700 1 -- 172.21.15.2:0/2324051146 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7efd240051d0 con 0x7efd380772e0 2024-06-13T11:21:50.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.738+0000 7efd2fe00700 1 --2- 172.21.15.2:0/2324051146 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7efd1c0a2cb0 0x7efd1c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:50.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.739+0000 7efd2fe00700 1 -- 172.21.15.2:0/2324051146 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7efd240cf170 con 0x7efd380772e0 2024-06-13T11:21:50.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.739+0000 7efd37400700 1 --2- 172.21.15.2:0/2324051146 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7efd1c0a2cb0 0x7efd1c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:50.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.740+0000 7efd37400700 1 --2- 172.21.15.2:0/2324051146 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7efd1c0a2cb0 0x7efd1c0a5170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efd28006010 tx=0x7efd2800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:50.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.740+0000 7efd2fe00700 1 -- 172.21.15.2:0/2324051146 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7efd2409bb80 con 0x7efd380772e0 2024-06-13T11:21:50.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.982+0000 7efd3cc00700 1 -- 172.21.15.2:0/2324051146 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7efd3802dca0 con 0x7efd380772e0 2024-06-13T11:21:50.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.983+0000 7efd2fe00700 1 -- 172.21.15.2:0/2324051146 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7efd2409b480 con 0x7efd380772e0 2024-06-13T11:21:50.982 INFO:teuthology.orchestra.run.smithi002.stdout:219043332173 2024-06-13T11:21:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.986+0000 7efd3cc00700 1 -- 172.21.15.2:0/2324051146 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7efd1c0a2cb0 msgr2=0x7efd1c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.986+0000 7efd3cc00700 1 --2- 172.21.15.2:0/2324051146 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7efd1c0a2cb0 0x7efd1c0a5170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efd28006010 tx=0x7efd2800b260 comp rx=0 tx=0).stop 2024-06-13T11:21:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.986+0000 7efd3cc00700 1 -- 172.21.15.2:0/2324051146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd380772e0 msgr2=0x7efd3819f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.986+0000 7efd3cc00700 1 --2- 172.21.15.2:0/2324051146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd380772e0 0x7efd3819f6c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efd2400d750 tx=0x7efd2400da60 comp rx=0 tx=0).stop 2024-06-13T11:21:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.987+0000 7efd3cc00700 1 -- 172.21.15.2:0/2324051146 shutdown_connections 2024-06-13T11:21:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.987+0000 7efd3cc00700 1 --2- 172.21.15.2:0/2324051146 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7efd1c0a2cb0 0x7efd1c0a5170 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.987+0000 7efd3cc00700 1 --2- 172.21.15.2:0/2324051146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd38113240 0x7efd381a3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.987+0000 7efd3cc00700 1 --2- 172.21.15.2:0/2324051146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd380769c0 0x7efd3819f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.987+0000 7efd3cc00700 1 --2- 172.21.15.2:0/2324051146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd380772e0 0x7efd3819f6c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.987+0000 7efd3cc00700 1 -- 172.21.15.2:0/2324051146 >> 172.21.15.2:0/2324051146 conn(0x7efd38100070 msgr2=0x7efd38102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.987+0000 7efd3cc00700 1 -- 172.21.15.2:0/2324051146 shutdown_connections 2024-06-13T11:21:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:50.987+0000 7efd3cc00700 1 -- 172.21.15.2:0/2324051146 wait complete. 2024-06-13T11:21:51.027 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411426 got 77309411432 for osd.2 2024-06-13T11:21:51.027 DEBUG:teuthology.parallel:result is None 2024-06-13T11:21:51.320 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:51.322 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:51.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:51 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2324051146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-13T11:21:51.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:51 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:21:51.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:51 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2324051146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-13T11:21:51.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:51 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:21:51.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:51 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2324051146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-13T11:21:51.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:51 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:21:52.799 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332166 got 219043332173 for osd.7 2024-06-13T11:21:52.799 DEBUG:teuthology.parallel:result is None 2024-06-13T11:21:53.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:52 smithi002 ceph-mon[32210]: pgmap v432: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:21:53.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:21:53.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:21:53.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:21:53.025 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:52 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:21:53.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:52 smithi178 ceph-mon[36913]: pgmap v432: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:21:53.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:21:53.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:21:53.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:21:53.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:52 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:21:53.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:52 smithi077 ceph-mon[36410]: pgmap v432: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:21:53.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:21:53.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:21:53.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:21:53.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:52 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:21:54.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:53 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:21:54.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:53 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:21:54.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:53 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:21:54.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:53 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:21:54.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:53 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:21:54.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:53 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:21:54.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:53 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:21:54.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:53 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:21:54.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:53 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:21:54.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.425+0000 7fadcbe00700 1 -- 172.21.15.2:0/4096551347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadcc104f80 msgr2=0x7fadcc111490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:54.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.425+0000 7fadcbe00700 1 --2- 172.21.15.2:0/4096551347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadcc104f80 0x7fadcc111490 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fadc400b0a0 tx=0x7fadc400b3b0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.425+0000 7fadcbe00700 1 -- 172.21.15.2:0/4096551347 shutdown_connections 2024-06-13T11:21:54.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.425+0000 7fadcbe00700 1 --2- 172.21.15.2:0/4096551347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadcc104f80 0x7fadcc111490 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.425+0000 7fadcbe00700 1 --2- 172.21.15.2:0/4096551347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadcc10a650 0x7fadcc10aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.425+0000 7fadcbe00700 1 --2- 172.21.15.2:0/4096551347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadcc1045c0 0x7fadcc104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.425+0000 7fadcbe00700 1 -- 172.21.15.2:0/4096551347 >> 172.21.15.2:0/4096551347 conn(0x7fadcc1000b0 msgr2=0x7fadcc1024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:54.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.425+0000 7fadcbe00700 1 -- 172.21.15.2:0/4096551347 shutdown_connections 2024-06-13T11:21:54.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.425+0000 7fadcbe00700 1 -- 172.21.15.2:0/4096551347 wait complete. 2024-06-13T11:21:54.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.427+0000 7fadcbe00700 1 Processor -- start 2024-06-13T11:21:54.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.427+0000 7fadcbe00700 1 -- start start 2024-06-13T11:21:54.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.427+0000 7fadcbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadcc1045c0 0x7fadcc1a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:54.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.427+0000 7fadcbe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadcc104f80 0x7fadcc1a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:54.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.428+0000 7fadcbe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadcc10a650 0x7fadcc19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:54.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.428+0000 7fadcbe00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc114960 con 0x7fadcc104f80 2024-06-13T11:21:54.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.428+0000 7fadcbe00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1147e0 con 0x7fadcc10a650 2024-06-13T11:21:54.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.428+0000 7fadcbe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc114ae0 con 0x7fadcc1045c0 2024-06-13T11:21:54.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.428+0000 7fadca000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadcc104f80 0x7fadcc1a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:54.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.428+0000 7fadcaa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadcc1045c0 0x7fadcc1a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:54.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.428+0000 7fadca000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadcc104f80 0x7fadcc1a0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48680/0 (socket says 172.21.15.2:48680) 2024-06-13T11:21:54.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.428+0000 7fadcaa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadcc1045c0 0x7fadcc1a08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:39890/0 (socket says 172.21.15.2:39890) 2024-06-13T11:21:54.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.428+0000 7fadca000700 1 -- 172.21.15.2:0/893376993 learned_addr learned my addr 172.21.15.2:0/893376993 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:54.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.428+0000 7fadcb400700 1 --2- 172.21.15.2:0/893376993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadcc10a650 0x7fadcc19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:54.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.428+0000 7fadcaa00700 1 -- 172.21.15.2:0/893376993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadcc10a650 msgr2=0x7fadcc19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:54.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.428+0000 7fadcaa00700 1 --2- 172.21.15.2:0/893376993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadcc10a650 0x7fadcc19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.428+0000 7fadcaa00700 1 -- 172.21.15.2:0/893376993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadcc104f80 msgr2=0x7fadcc1a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:54.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.428+0000 7fadcaa00700 1 --2- 172.21.15.2:0/893376993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadcc104f80 0x7fadcc1a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.428+0000 7fadcaa00700 1 -- 172.21.15.2:0/893376993 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc19b260 con 0x7fadcc1045c0 2024-06-13T11:21:54.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.429+0000 7fadcaa00700 1 --2- 172.21.15.2:0/893376993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadcc1045c0 0x7fadcc1a08f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00e9c0 tx=0x7fadbc00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:54.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.429+0000 7fadc3400700 1 -- 172.21.15.2:0/893376993 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc004230 con 0x7fadcc1045c0 2024-06-13T11:21:54.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.429+0000 7fadc3400700 1 -- 172.21.15.2:0/893376993 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadbc0043d0 con 0x7fadcc1045c0 2024-06-13T11:21:54.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.429+0000 7fadcbe00700 1 -- 172.21.15.2:0/893376993 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc19b550 con 0x7fadcc1045c0 2024-06-13T11:21:54.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.429+0000 7fadc3400700 1 -- 172.21.15.2:0/893376993 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc010430 con 0x7fadcc1045c0 2024-06-13T11:21:54.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.429+0000 7fadcbe00700 1 -- 172.21.15.2:0/893376993 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc1a77c0 con 0x7fadcc1045c0 2024-06-13T11:21:54.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.430+0000 7fadcbe00700 1 -- 172.21.15.2:0/893376993 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadcc069180 con 0x7fadcc1045c0 2024-06-13T11:21:54.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.432+0000 7fadc3400700 1 -- 172.21.15.2:0/893376993 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fadbc00c7c0 con 0x7fadcc1045c0 2024-06-13T11:21:54.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.434+0000 7fadc3400700 1 --2- 172.21.15.2:0/893376993 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fadb00a2d30 0x7fadb00a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:54.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.434+0000 7fadc3400700 1 -- 172.21.15.2:0/893376993 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fadbc0cf8d0 con 0x7fadcc1045c0 2024-06-13T11:21:54.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.434+0000 7fadca000700 1 --2- 172.21.15.2:0/893376993 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fadb00a2d30 0x7fadb00a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:54.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.435+0000 7fadca000700 1 --2- 172.21.15.2:0/893376993 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fadb00a2d30 0x7fadb00a51f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009680 tx=0x7fadb8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:54.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.438+0000 7fadc3400700 1 -- 172.21.15.2:0/893376993 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fadbc09c2e0 con 0x7fadcc1045c0 2024-06-13T11:21:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.629+0000 7ff364600700 1 -- 172.21.15.2:0/3876641224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c06a170 msgr2=0x7ff35c06a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.629+0000 7ff364600700 1 --2- 172.21.15.2:0/3876641224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c06a170 0x7ff35c06a5f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff3480098f0 tx=0x7ff348009c00 comp rx=0 tx=0).stop 2024-06-13T11:21:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.629+0000 7ff364600700 1 -- 172.21.15.2:0/3876641224 shutdown_connections 2024-06-13T11:21:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.629+0000 7ff364600700 1 --2- 172.21.15.2:0/3876641224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff35c108500 0x7ff35c1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.629+0000 7ff364600700 1 --2- 172.21.15.2:0/3876641224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c06ab30 0x7ff35c10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.629+0000 7ff364600700 1 --2- 172.21.15.2:0/3876641224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c06a170 0x7ff35c06a5f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.629+0000 7ff364600700 1 -- 172.21.15.2:0/3876641224 >> 172.21.15.2:0/3876641224 conn(0x7ff35c078340 msgr2=0x7ff35c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.629+0000 7ff364600700 1 -- 172.21.15.2:0/3876641224 shutdown_connections 2024-06-13T11:21:54.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.629+0000 7ff364600700 1 -- 172.21.15.2:0/3876641224 wait complete. 2024-06-13T11:21:54.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.631+0000 7ff364600700 1 Processor -- start 2024-06-13T11:21:54.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.631+0000 7ff364600700 1 -- start start 2024-06-13T11:21:54.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.631+0000 7ff364600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c06a170 0x7ff35c19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:54.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.631+0000 7ff364600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c06ab30 0x7ff35c19ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:54.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.631+0000 7ff364600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff35c108500 0x7ff35c198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:54.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.631+0000 7ff364600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c1127b0 con 0x7ff35c108500 2024-06-13T11:21:54.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.631+0000 7ff364600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c112630 con 0x7ff35c06a170 2024-06-13T11:21:54.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.631+0000 7ff364600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c112930 con 0x7ff35c06ab30 2024-06-13T11:21:54.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.632+0000 7ff362600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff35c108500 0x7ff35c198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:54.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.632+0000 7ff362600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff35c108500 0x7ff35c198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48698/0 (socket says 172.21.15.2:48698) 2024-06-13T11:21:54.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.632+0000 7ff362600700 1 -- 172.21.15.2:0/1778657661 learned_addr learned my addr 172.21.15.2:0/1778657661 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:54.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.632+0000 7ff361c00700 1 --2- 172.21.15.2:0/1778657661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c06a170 0x7ff35c19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:54.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.632+0000 7ff361200700 1 --2- 172.21.15.2:0/1778657661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c06ab30 0x7ff35c19ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:54.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.632+0000 7ff362600700 1 -- 172.21.15.2:0/1778657661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c06ab30 msgr2=0x7ff35c19ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:54.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.632+0000 7ff362600700 1 --2- 172.21.15.2:0/1778657661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c06ab30 0x7ff35c19ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.632+0000 7ff362600700 1 -- 172.21.15.2:0/1778657661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c06a170 msgr2=0x7ff35c19e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:54.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.632+0000 7ff362600700 1 --2- 172.21.15.2:0/1778657661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c06a170 0x7ff35c19e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.632+0000 7ff362600700 1 -- 172.21.15.2:0/1778657661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35c199230 con 0x7ff35c108500 2024-06-13T11:21:54.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.632+0000 7ff361200700 1 --2- 172.21.15.2:0/1778657661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c06ab30 0x7ff35c19ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:21:54.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.632+0000 7ff361c00700 1 --2- 172.21.15.2:0/1778657661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c06a170 0x7ff35c19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:21:54.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.633+0000 7ff362600700 1 --2- 172.21.15.2:0/1778657661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff35c108500 0x7ff35c198ad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff35400ef30 tx=0x7ff35400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:54.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.633+0000 7ff35a000700 1 -- 172.21.15.2:0/1778657661 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3540092e0 con 0x7ff35c108500 2024-06-13T11:21:54.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.633+0000 7ff35a000700 1 -- 172.21.15.2:0/1778657661 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff354004bb0 con 0x7ff35c108500 2024-06-13T11:21:54.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.633+0000 7ff364600700 1 -- 172.21.15.2:0/1778657661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff35c1994c0 con 0x7ff35c108500 2024-06-13T11:21:54.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.633+0000 7ff35a000700 1 -- 172.21.15.2:0/1778657661 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff354004280 con 0x7ff35c108500 2024-06-13T11:21:54.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.633+0000 7ff364600700 1 -- 172.21.15.2:0/1778657661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff35c1a57e0 con 0x7ff35c108500 2024-06-13T11:21:54.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.634+0000 7ff364600700 1 -- 172.21.15.2:0/1778657661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff35c069180 con 0x7ff35c108500 2024-06-13T11:21:54.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.636+0000 7ff35a000700 1 -- 172.21.15.2:0/1778657661 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7ff35401b030 con 0x7ff35c108500 2024-06-13T11:21:54.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.638+0000 7ff35a000700 1 --2- 172.21.15.2:0/1778657661 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff3440a2cb0 0x7ff3440a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:54.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.638+0000 7ff35a000700 1 -- 172.21.15.2:0/1778657661 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7ff3540cec30 con 0x7ff35c108500 2024-06-13T11:21:54.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.638+0000 7ff361c00700 1 --2- 172.21.15.2:0/1778657661 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff3440a2cb0 0x7ff3440a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:54.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.639+0000 7ff361c00700 1 --2- 172.21.15.2:0/1778657661 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff3440a2cb0 0x7ff3440a5170 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff350005fd0 tx=0x7ff350009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:54.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.643+0000 7ff35a000700 1 -- 172.21.15.2:0/1778657661 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff354010040 con 0x7ff35c108500 2024-06-13T11:21:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.681+0000 7fadcbe00700 1 -- 172.21.15.2:0/893376993 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fadcc19bfe0 con 0x7fadcc1045c0 2024-06-13T11:21:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.682+0000 7fadc3400700 1 -- 172.21.15.2:0/893376993 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fadbc09bbe0 con 0x7fadcc1045c0 2024-06-13T11:21:54.681 INFO:teuthology.orchestra.run.smithi002.stdout:163208757338 2024-06-13T11:21:54.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.685+0000 7fadcbe00700 1 -- 172.21.15.2:0/893376993 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fadb00a2d30 msgr2=0x7fadb00a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:54.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.685+0000 7fadcbe00700 1 --2- 172.21.15.2:0/893376993 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fadb00a2d30 0x7fadb00a51f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009680 tx=0x7fadb8009260 comp rx=0 tx=0).stop 2024-06-13T11:21:54.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.685+0000 7fadcbe00700 1 -- 172.21.15.2:0/893376993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadcc1045c0 msgr2=0x7fadcc1a08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:54.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.685+0000 7fadcbe00700 1 --2- 172.21.15.2:0/893376993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadcc1045c0 0x7fadcc1a08f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00e9c0 tx=0x7fadbc00ecd0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.685+0000 7fadcbe00700 1 -- 172.21.15.2:0/893376993 shutdown_connections 2024-06-13T11:21:54.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.685+0000 7fadcbe00700 1 --2- 172.21.15.2:0/893376993 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fadb00a2d30 0x7fadb00a51f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.685+0000 7fadcbe00700 1 --2- 172.21.15.2:0/893376993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadcc10a650 0x7fadcc19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.685+0000 7fadcbe00700 1 --2- 172.21.15.2:0/893376993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadcc1045c0 0x7fadcc1a08f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.685+0000 7fadcbe00700 1 --2- 172.21.15.2:0/893376993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadcc104f80 0x7fadcc1a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.685+0000 7fadcbe00700 1 -- 172.21.15.2:0/893376993 >> 172.21.15.2:0/893376993 conn(0x7fadcc1000b0 msgr2=0x7fadcc101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:54.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.685+0000 7fadcbe00700 1 -- 172.21.15.2:0/893376993 shutdown_connections 2024-06-13T11:21:54.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.685+0000 7fadcbe00700 1 -- 172.21.15.2:0/893376993 wait complete. 2024-06-13T11:21:54.722 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:54.722 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:21:54.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.907+0000 7ff364600700 1 -- 172.21.15.2:0/1778657661 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7ff35c02dca0 con 0x7ff35c108500 2024-06-13T11:21:54.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.908+0000 7ff35a000700 1 -- 172.21.15.2:0/1778657661 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7ff35401b320 con 0x7ff35c108500 2024-06-13T11:21:54.907 INFO:teuthology.orchestra.run.smithi002.stdout:343597383736 2024-06-13T11:21:54.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.911+0000 7ff364600700 1 -- 172.21.15.2:0/1778657661 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff3440a2cb0 msgr2=0x7ff3440a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:54.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.911+0000 7ff364600700 1 --2- 172.21.15.2:0/1778657661 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff3440a2cb0 0x7ff3440a5170 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff350005fd0 tx=0x7ff350009310 comp rx=0 tx=0).stop 2024-06-13T11:21:54.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.911+0000 7ff364600700 1 -- 172.21.15.2:0/1778657661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff35c108500 msgr2=0x7ff35c198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:54.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.911+0000 7ff364600700 1 --2- 172.21.15.2:0/1778657661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff35c108500 0x7ff35c198ad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff35400ef30 tx=0x7ff35400c3a0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.911+0000 7ff364600700 1 -- 172.21.15.2:0/1778657661 shutdown_connections 2024-06-13T11:21:54.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.911+0000 7ff364600700 1 --2- 172.21.15.2:0/1778657661 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff3440a2cb0 0x7ff3440a5170 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.911+0000 7ff364600700 1 --2- 172.21.15.2:0/1778657661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff35c108500 0x7ff35c198ad0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.911+0000 7ff364600700 1 --2- 172.21.15.2:0/1778657661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c06a170 0x7ff35c19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.911+0000 7ff364600700 1 --2- 172.21.15.2:0/1778657661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c06ab30 0x7ff35c19ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.911+0000 7ff364600700 1 -- 172.21.15.2:0/1778657661 >> 172.21.15.2:0/1778657661 conn(0x7ff35c078340 msgr2=0x7ff35c100030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.911+0000 7ff364600700 1 -- 172.21.15.2:0/1778657661 shutdown_connections 2024-06-13T11:21:54.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:54.911+0000 7ff364600700 1 -- 172.21.15.2:0/1778657661 wait complete. 2024-06-13T11:21:55.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:54 smithi002 ceph-mon[32210]: pgmap v433: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:55.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:54 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/893376993' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-13T11:21:55.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:54 smithi178 ceph-mon[36913]: pgmap v433: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:55.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:54 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/893376993' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-13T11:21:55.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:54 smithi077 ceph-mon[36410]: pgmap v433: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:21:55.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:54 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/893376993' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-13T11:21:56.092 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:55 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1778657661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-13T11:21:56.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:55 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1778657661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-13T11:21:56.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:55 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1778657661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-13T11:21:57.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:56 smithi002 ceph-mon[32210]: pgmap v434: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:21:57.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:56 smithi002 ceph-mon[32210]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-06-13T11:21:57.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:56 smithi178 ceph-mon[36913]: pgmap v434: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:21:57.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:56 smithi178 ceph-mon[36913]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-06-13T11:21:57.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.252+0000 7f2d3d800700 1 -- 172.21.15.2:0/2523441911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d3810a6b0 msgr2=0x7f2d3810aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.252+0000 7f2d3d800700 1 --2- 172.21.15.2:0/2523441911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d3810a6b0 0x7f2d3810aa90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009990 tx=0x7f2d28009ca0 comp rx=0 tx=0).stop 2024-06-13T11:21:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.252+0000 7f2d3d800700 1 -- 172.21.15.2:0/2523441911 shutdown_connections 2024-06-13T11:21:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.252+0000 7f2d3d800700 1 --2- 172.21.15.2:0/2523441911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38105070 0x7f2d38111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.252+0000 7f2d3d800700 1 --2- 172.21.15.2:0/2523441911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d3810a6b0 0x7f2d3810aa90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.252+0000 7f2d3d800700 1 --2- 172.21.15.2:0/2523441911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d381046b0 0x7f2d38104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.252+0000 7f2d3d800700 1 -- 172.21.15.2:0/2523441911 >> 172.21.15.2:0/2523441911 conn(0x7f2d381001a0 msgr2=0x7f2d381025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.252+0000 7f2d3d800700 1 -- 172.21.15.2:0/2523441911 shutdown_connections 2024-06-13T11:21:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.252+0000 7f2d3d800700 1 -- 172.21.15.2:0/2523441911 wait complete. 2024-06-13T11:21:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.253+0000 7f2d3d800700 1 Processor -- start 2024-06-13T11:21:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.254+0000 7f2d3d800700 1 -- start start 2024-06-13T11:21:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.254+0000 7f2d3d800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d381046b0 0x7f2d3819ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.254+0000 7f2d3d800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38105070 0x7f2d3819b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.254+0000 7f2d3d800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d3810a6b0 0x7f2d3819f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.254+0000 7f2d3d800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2d38114a00 con 0x7f2d38105070 2024-06-13T11:21:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.254+0000 7f2d3d800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2d38114880 con 0x7f2d381046b0 2024-06-13T11:21:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.254+0000 7f2d3d800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2d38114b80 con 0x7f2d3810a6b0 2024-06-13T11:21:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.254+0000 7f2d36000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38105070 0x7f2d3819b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.254+0000 7f2d37400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d3810a6b0 0x7f2d3819f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:57.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.254+0000 7f2d36000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38105070 0x7f2d3819b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32880/0 (socket says 172.21.15.2:32880) 2024-06-13T11:21:57.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.254+0000 7f2d36000700 1 -- 172.21.15.2:0/2007444953 learned_addr learned my addr 172.21.15.2:0/2007444953 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:21:57.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.254+0000 7f2d36a00700 1 --2- 172.21.15.2:0/2007444953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d381046b0 0x7f2d3819ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:57.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.255+0000 7f2d37400700 1 -- 172.21.15.2:0/2007444953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d381046b0 msgr2=0x7f2d3819ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:57.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.255+0000 7f2d37400700 1 --2- 172.21.15.2:0/2007444953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d381046b0 0x7f2d3819ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:57.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.255+0000 7f2d37400700 1 -- 172.21.15.2:0/2007444953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38105070 msgr2=0x7f2d3819b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:57.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.255+0000 7f2d37400700 1 --2- 172.21.15.2:0/2007444953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38105070 0x7f2d3819b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:57.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.255+0000 7f2d37400700 1 -- 172.21.15.2:0/2007444953 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3819fe40 con 0x7f2d3810a6b0 2024-06-13T11:21:57.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.255+0000 7f2d37400700 1 --2- 172.21.15.2:0/2007444953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d3810a6b0 0x7f2d3819f700 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000efc0 tx=0x7f2d3000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:57.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.255+0000 7f2d2f400700 1 -- 172.21.15.2:0/2007444953 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d300092e0 con 0x7f2d3810a6b0 2024-06-13T11:21:57.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.256+0000 7f2d2f400700 1 -- 172.21.15.2:0/2007444953 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d30004bb0 con 0x7f2d3810a6b0 2024-06-13T11:21:57.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.256+0000 7f2d3d800700 1 -- 172.21.15.2:0/2007444953 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d381a00d0 con 0x7f2d3810a6b0 2024-06-13T11:21:57.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.256+0000 7f2d2f400700 1 -- 172.21.15.2:0/2007444953 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30004280 con 0x7f2d3810a6b0 2024-06-13T11:21:57.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.256+0000 7f2d3d800700 1 -- 172.21.15.2:0/2007444953 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d381a79b0 con 0x7f2d3810a6b0 2024-06-13T11:21:57.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.257+0000 7f2d3d800700 1 -- 172.21.15.2:0/2007444953 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d3810cc40 con 0x7f2d3810a6b0 2024-06-13T11:21:57.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.259+0000 7f2d2f400700 1 -- 172.21.15.2:0/2007444953 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f2d30044d10 con 0x7f2d3810a6b0 2024-06-13T11:21:57.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.260+0000 7f2d2f400700 1 --2- 172.21.15.2:0/2007444953 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2d1c0a2c20 0x7f2d1c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:21:57.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.260+0000 7f2d2f400700 1 -- 172.21.15.2:0/2007444953 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f2d300cf310 con 0x7f2d3810a6b0 2024-06-13T11:21:57.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.261+0000 7f2d36a00700 1 --2- 172.21.15.2:0/2007444953 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2d1c0a2c20 0x7f2d1c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:21:57.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.261+0000 7f2d36a00700 1 --2- 172.21.15.2:0/2007444953 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2d1c0a2c20 0x7f2d1c0a50e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2d280098e0 tx=0x7f2d28005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:21:57.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.263+0000 7f2d2f400700 1 -- 172.21.15.2:0/2007444953 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2d30022020 con 0x7f2d3810a6b0 2024-06-13T11:21:57.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:56 smithi077 ceph-mon[36410]: pgmap v434: 129 pgs: 129 active+clean; 643 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:21:57.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:56 smithi077 ceph-mon[36410]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-06-13T11:21:57.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.520+0000 7f2d3d800700 1 -- 172.21.15.2:0/2007444953 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2d3810c620 con 0x7f2d3810a6b0 2024-06-13T11:21:57.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.521+0000 7f2d2f400700 1 -- 172.21.15.2:0/2007444953 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2d30010040 con 0x7f2d3810a6b0 2024-06-13T11:21:57.521 INFO:teuthology.orchestra.run.smithi002.stdout:197568495700 2024-06-13T11:21:57.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.524+0000 7f2d3d800700 1 -- 172.21.15.2:0/2007444953 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2d1c0a2c20 msgr2=0x7f2d1c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:57.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.524+0000 7f2d3d800700 1 --2- 172.21.15.2:0/2007444953 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2d1c0a2c20 0x7f2d1c0a50e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2d280098e0 tx=0x7f2d28005960 comp rx=0 tx=0).stop 2024-06-13T11:21:57.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.524+0000 7f2d3d800700 1 -- 172.21.15.2:0/2007444953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d3810a6b0 msgr2=0x7f2d3819f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:21:57.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.524+0000 7f2d3d800700 1 --2- 172.21.15.2:0/2007444953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d3810a6b0 0x7f2d3819f700 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000efc0 tx=0x7f2d3000c3a0 comp rx=0 tx=0).stop 2024-06-13T11:21:57.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.525+0000 7f2d3d800700 1 -- 172.21.15.2:0/2007444953 shutdown_connections 2024-06-13T11:21:57.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.525+0000 7f2d3d800700 1 --2- 172.21.15.2:0/2007444953 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2d1c0a2c20 0x7f2d1c0a50e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:57.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.525+0000 7f2d3d800700 1 --2- 172.21.15.2:0/2007444953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d3810a6b0 0x7f2d3819f700 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:57.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.525+0000 7f2d3d800700 1 --2- 172.21.15.2:0/2007444953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d381046b0 0x7f2d3819ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:57.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.525+0000 7f2d3d800700 1 --2- 172.21.15.2:0/2007444953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d38105070 0x7f2d3819b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:21:57.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.525+0000 7f2d3d800700 1 -- 172.21.15.2:0/2007444953 >> 172.21.15.2:0/2007444953 conn(0x7f2d381001a0 msgr2=0x7f2d381008d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:21:57.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.525+0000 7f2d3d800700 1 -- 172.21.15.2:0/2007444953 shutdown_connections 2024-06-13T11:21:57.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:21:57.526+0000 7f2d3d800700 1 -- 172.21.15.2:0/2007444953 wait complete. 2024-06-13T11:21:57.573 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757332 got 163208757338 for osd.5 2024-06-13T11:21:57.573 DEBUG:teuthology.parallel:result is None 2024-06-13T11:21:58.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:57 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2007444953' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-13T11:21:58.273 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:57 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2007444953' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-13T11:21:58.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:57 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2007444953' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-13T11:21:58.899 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383731 got 343597383736 for osd.11 2024-06-13T11:21:58.899 DEBUG:teuthology.parallel:result is None 2024-06-13T11:21:59.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:21:58 smithi002 ceph-mon[32210]: pgmap v435: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 8 op/s 2024-06-13T11:21:59.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:21:58 smithi178 ceph-mon[36913]: pgmap v435: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 8 op/s 2024-06-13T11:21:59.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:21:58 smithi077 ceph-mon[36410]: pgmap v435: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 8 op/s 2024-06-13T11:22:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.339+0000 7f371e600700 1 -- 172.21.15.2:0/25488074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3718108500 msgr2=0x7f37181088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.339+0000 7f371e600700 1 --2- 172.21.15.2:0/25488074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3718108500 0x7f37181088e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3708009990 tx=0x7f3708009ca0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.339+0000 7f371e600700 1 -- 172.21.15.2:0/25488074 shutdown_connections 2024-06-13T11:22:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.339+0000 7f371e600700 1 --2- 172.21.15.2:0/25488074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3718108500 0x7f37181088e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.339+0000 7f371e600700 1 --2- 172.21.15.2:0/25488074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f371806ab30 0x7f371810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.339+0000 7f371e600700 1 --2- 172.21.15.2:0/25488074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f371806a170 0x7f371806a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.339+0000 7f371e600700 1 -- 172.21.15.2:0/25488074 >> 172.21.15.2:0/25488074 conn(0x7f3718078340 msgr2=0x7f3718078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.340+0000 7f371e600700 1 -- 172.21.15.2:0/25488074 shutdown_connections 2024-06-13T11:22:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.340+0000 7f371e600700 1 -- 172.21.15.2:0/25488074 wait complete. 2024-06-13T11:22:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.342+0000 7f371e600700 1 Processor -- start 2024-06-13T11:22:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.342+0000 7f371e600700 1 -- start start 2024-06-13T11:22:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.342+0000 7f371e600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f371806a170 0x7f371819ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.342+0000 7f371e600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f371806ab30 0x7f371819b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.342+0000 7f371e600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3718108500 0x7f371819f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.342+0000 7f371e600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37181127d0 con 0x7f371806ab30 2024-06-13T11:22:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.342+0000 7f371e600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3718112650 con 0x7f3718108500 2024-06-13T11:22:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.342+0000 7f371e600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3718112950 con 0x7f371806a170 2024-06-13T11:22:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.342+0000 7f3716a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f371806ab30 0x7f371819b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.343+0000 7f3716a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f371806ab30 0x7f371819b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32898/0 (socket says 172.21.15.2:32898) 2024-06-13T11:22:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.343+0000 7f3717400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f371806a170 0x7f371819ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.343+0000 7f3716a00700 1 -- 172.21.15.2:0/2661096682 learned_addr learned my addr 172.21.15.2:0/2661096682 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.343+0000 7f3717e00700 1 --2- 172.21.15.2:0/2661096682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3718108500 0x7f371819f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.343+0000 7f3717400700 1 -- 172.21.15.2:0/2661096682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3718108500 msgr2=0x7f371819f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.343+0000 7f3717400700 1 --2- 172.21.15.2:0/2661096682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3718108500 0x7f371819f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.343+0000 7f3717400700 1 -- 172.21.15.2:0/2661096682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f371806ab30 msgr2=0x7f371819b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.343+0000 7f3717400700 1 --2- 172.21.15.2:0/2661096682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f371806ab30 0x7f371819b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.343+0000 7f3717400700 1 -- 172.21.15.2:0/2661096682 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371819fea0 con 0x7f371806a170 2024-06-13T11:22:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.343+0000 7f3717400700 1 --2- 172.21.15.2:0/2661096682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f371806a170 0x7f371819ae90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f37080098e0 tx=0x7f370800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.344+0000 7f370fe00700 1 -- 172.21.15.2:0/2661096682 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3708027070 con 0x7f371806a170 2024-06-13T11:22:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.344+0000 7f371e600700 1 -- 172.21.15.2:0/2661096682 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37181a0130 con 0x7f371806a170 2024-06-13T11:22:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.344+0000 7f370fe00700 1 -- 172.21.15.2:0/2661096682 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3708003b60 con 0x7f371806a170 2024-06-13T11:22:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.344+0000 7f370fe00700 1 -- 172.21.15.2:0/2661096682 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3708022d50 con 0x7f371806a170 2024-06-13T11:22:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.344+0000 7f371e600700 1 -- 172.21.15.2:0/2661096682 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37181a7a10 con 0x7f371806a170 2024-06-13T11:22:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.346+0000 7f371e600700 1 -- 172.21.15.2:0/2661096682 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3718103bc0 con 0x7f371806a170 2024-06-13T11:22:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.347+0000 7f370fe00700 1 -- 172.21.15.2:0/2661096682 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f370802a070 con 0x7f371806a170 2024-06-13T11:22:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.348+0000 7f370fe00700 1 --2- 172.21.15.2:0/2661096682 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f36fc0a2c20 0x7f36fc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.349+0000 7f370fe00700 1 -- 172.21.15.2:0/2661096682 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f37080d0310 con 0x7f371806a170 2024-06-13T11:22:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.349+0000 7f3716a00700 1 --2- 172.21.15.2:0/2661096682 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f36fc0a2c20 0x7f36fc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.349+0000 7f3716a00700 1 --2- 172.21.15.2:0/2661096682 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f36fc0a2c20 0x7f36fc0a50e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3718102d40 tx=0x7f3704009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.353+0000 7f370fe00700 1 -- 172.21.15.2:0/2661096682 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f370805e850 con 0x7f371806a170 2024-06-13T11:22:00.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.452+0000 7f29a9600700 1 -- 172.21.15.2:0/1679839815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29a4102740 msgr2=0x7f29a4102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:00.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.452+0000 7f29a9600700 1 --2- 172.21.15.2:0/1679839815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29a4102740 0x7f29a4102b20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f29940099c0 tx=0x7f2994009cd0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.453+0000 7f29a9600700 1 -- 172.21.15.2:0/1679839815 shutdown_connections 2024-06-13T11:22:00.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.453+0000 7f29a9600700 1 --2- 172.21.15.2:0/1679839815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29a4107840 0x7f29a410f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.453+0000 7f29a9600700 1 --2- 172.21.15.2:0/1679839815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29a4102740 0x7f29a4102b20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.453+0000 7f29a9600700 1 --2- 172.21.15.2:0/1679839815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29a41030f0 0x7f29a4107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.453+0000 7f29a9600700 1 -- 172.21.15.2:0/1679839815 >> 172.21.15.2:0/1679839815 conn(0x7f29a40795f0 msgr2=0x7f29a4079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:00.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.453+0000 7f29a9600700 1 -- 172.21.15.2:0/1679839815 shutdown_connections 2024-06-13T11:22:00.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.453+0000 7f29a9600700 1 -- 172.21.15.2:0/1679839815 wait complete. 2024-06-13T11:22:00.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.454+0000 7f29a9600700 1 Processor -- start 2024-06-13T11:22:00.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.454+0000 7f29a9600700 1 -- start start 2024-06-13T11:22:00.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.455+0000 7f29a9600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29a4102740 0x7f29a419adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:00.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.455+0000 7f29a9600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29a41030f0 0x7f29a419b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:00.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.455+0000 7f29a9600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29a4107840 0x7f29a419f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:00.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.455+0000 7f29a9600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f29a4112760 con 0x7f29a41030f0 2024-06-13T11:22:00.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.455+0000 7f29a9600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f29a41125e0 con 0x7f29a4102740 2024-06-13T11:22:00.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.455+0000 7f29a9600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f29a41128e0 con 0x7f29a4107840 2024-06-13T11:22:00.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.455+0000 7f29a2a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29a4102740 0x7f29a419adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:00.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.455+0000 7f29a2a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29a4102740 0x7f29a419adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:38072/0 (socket says 172.21.15.2:38072) 2024-06-13T11:22:00.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.455+0000 7f29a2a00700 1 -- 172.21.15.2:0/1443280409 learned_addr learned my addr 172.21.15.2:0/1443280409 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:00.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.455+0000 7f299a000700 1 --2- 172.21.15.2:0/1443280409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29a41030f0 0x7f29a419b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:00.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.455+0000 7f29a3400700 1 --2- 172.21.15.2:0/1443280409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29a4107840 0x7f29a419f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:00.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.455+0000 7f29a2a00700 1 -- 172.21.15.2:0/1443280409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29a4107840 msgr2=0x7f29a419f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:00.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.455+0000 7f29a2a00700 1 --2- 172.21.15.2:0/1443280409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29a4107840 0x7f29a419f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.455+0000 7f29a2a00700 1 -- 172.21.15.2:0/1443280409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29a41030f0 msgr2=0x7f29a419b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:00.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.455+0000 7f29a2a00700 1 --2- 172.21.15.2:0/1443280409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29a41030f0 0x7f29a419b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.455+0000 7f29a2a00700 1 -- 172.21.15.2:0/1443280409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a419fdc0 con 0x7f29a4102740 2024-06-13T11:22:00.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.456+0000 7f29a2a00700 1 --2- 172.21.15.2:0/1443280409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29a4102740 0x7f29a419adb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2994006010 tx=0x7f2994003a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:00.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.456+0000 7f299be00700 1 -- 172.21.15.2:0/1443280409 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994003680 con 0x7f29a4102740 2024-06-13T11:22:00.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.456+0000 7f299be00700 1 -- 172.21.15.2:0/1443280409 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2994003e50 con 0x7f29a4102740 2024-06-13T11:22:00.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.456+0000 7f29a9600700 1 -- 172.21.15.2:0/1443280409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a41a0050 con 0x7f29a4102740 2024-06-13T11:22:00.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.456+0000 7f299be00700 1 -- 172.21.15.2:0/1443280409 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299400fe10 con 0x7f29a4102740 2024-06-13T11:22:00.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.456+0000 7f29a9600700 1 -- 172.21.15.2:0/1443280409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a41a7930 con 0x7f29a4102740 2024-06-13T11:22:00.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.458+0000 7f29a9600700 1 -- 172.21.15.2:0/1443280409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a4069180 con 0x7f29a4102740 2024-06-13T11:22:00.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.460+0000 7f299be00700 1 -- 172.21.15.2:0/1443280409 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f299400f460 con 0x7f29a4102740 2024-06-13T11:22:00.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.461+0000 7f299be00700 1 --2- 172.21.15.2:0/1443280409 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29880a2e40 0x7f29880a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:00.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.461+0000 7f299be00700 1 -- 172.21.15.2:0/1443280409 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f29940cfff0 con 0x7f29a4102740 2024-06-13T11:22:00.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.461+0000 7f299a000700 1 --2- 172.21.15.2:0/1443280409 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29880a2e40 0x7f29880a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:00.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.462+0000 7f299a000700 1 --2- 172.21.15.2:0/1443280409 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29880a2e40 0x7f29880a5300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f29a410f800 tx=0x7f298c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:00.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.463+0000 7f299be00700 1 -- 172.21.15.2:0/1443280409 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2994013070 con 0x7f29a4102740 2024-06-13T11:22:00.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.607+0000 7f371e600700 1 -- 172.21.15.2:0/2661096682 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f371819c1f0 con 0x7f371806a170 2024-06-13T11:22:00.607 INFO:teuthology.orchestra.run.smithi002.stdout:55834574962 2024-06-13T11:22:00.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.608+0000 7f370fe00700 1 -- 172.21.15.2:0/2661096682 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3708013070 con 0x7f371806a170 2024-06-13T11:22:00.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.612+0000 7f371e600700 1 -- 172.21.15.2:0/2661096682 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f36fc0a2c20 msgr2=0x7f36fc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:00.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.612+0000 7f371e600700 1 --2- 172.21.15.2:0/2661096682 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f36fc0a2c20 0x7f36fc0a50e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3718102d40 tx=0x7f3704009260 comp rx=0 tx=0).stop 2024-06-13T11:22:00.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.612+0000 7f371e600700 1 -- 172.21.15.2:0/2661096682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f371806a170 msgr2=0x7f371819ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:00.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.612+0000 7f371e600700 1 --2- 172.21.15.2:0/2661096682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f371806a170 0x7f371819ae90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f37080098e0 tx=0x7f370800b8a0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.612+0000 7f371e600700 1 -- 172.21.15.2:0/2661096682 shutdown_connections 2024-06-13T11:22:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.612+0000 7f371e600700 1 --2- 172.21.15.2:0/2661096682 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f36fc0a2c20 0x7f36fc0a50e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.612+0000 7f371e600700 1 --2- 172.21.15.2:0/2661096682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3718108500 0x7f371819f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.612+0000 7f371e600700 1 --2- 172.21.15.2:0/2661096682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f371806a170 0x7f371819ae90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.612+0000 7f371e600700 1 --2- 172.21.15.2:0/2661096682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f371806ab30 0x7f371819b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.612+0000 7f371e600700 1 -- 172.21.15.2:0/2661096682 >> 172.21.15.2:0/2661096682 conn(0x7f3718078340 msgr2=0x7f371810d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:00.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.613+0000 7f371e600700 1 -- 172.21.15.2:0/2661096682 shutdown_connections 2024-06-13T11:22:00.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.613+0000 7f371e600700 1 -- 172.21.15.2:0/2661096682 wait complete. 2024-06-13T11:22:00.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.717+0000 7f29a9600700 1 -- 172.21.15.2:0/1443280409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f29a419c110 con 0x7f29a4102740 2024-06-13T11:22:00.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.718+0000 7f299be00700 1 -- 172.21.15.2:0/1443280409 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f29a419c110 con 0x7f29a4102740 2024-06-13T11:22:00.717 INFO:teuthology.orchestra.run.smithi002.stdout:107374182500 2024-06-13T11:22:00.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.721+0000 7f29a9600700 1 -- 172.21.15.2:0/1443280409 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29880a2e40 msgr2=0x7f29880a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:00.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.721+0000 7f29a9600700 1 --2- 172.21.15.2:0/1443280409 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29880a2e40 0x7f29880a5300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f29a410f800 tx=0x7f298c009260 comp rx=0 tx=0).stop 2024-06-13T11:22:00.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.721+0000 7f29a9600700 1 -- 172.21.15.2:0/1443280409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29a4102740 msgr2=0x7f29a419adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:00.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.721+0000 7f29a9600700 1 --2- 172.21.15.2:0/1443280409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29a4102740 0x7f29a419adb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2994006010 tx=0x7f2994003a90 comp rx=0 tx=0).stop 2024-06-13T11:22:00.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.721+0000 7f29a9600700 1 -- 172.21.15.2:0/1443280409 shutdown_connections 2024-06-13T11:22:00.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.721+0000 7f29a9600700 1 --2- 172.21.15.2:0/1443280409 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f29880a2e40 0x7f29880a5300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.721+0000 7f29a9600700 1 --2- 172.21.15.2:0/1443280409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29a4107840 0x7f29a419f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.721+0000 7f29a9600700 1 --2- 172.21.15.2:0/1443280409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29a4102740 0x7f29a419adb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.721+0000 7f29a9600700 1 --2- 172.21.15.2:0/1443280409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29a41030f0 0x7f29a419b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:00.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.721+0000 7f29a9600700 1 -- 172.21.15.2:0/1443280409 >> 172.21.15.2:0/1443280409 conn(0x7f29a40795f0 msgr2=0x7f29a4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:00.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.721+0000 7f29a9600700 1 -- 172.21.15.2:0/1443280409 shutdown_connections 2024-06-13T11:22:00.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:00.721+0000 7f29a9600700 1 -- 172.21.15.2:0/1443280409 wait complete. 2024-06-13T11:22:00.872 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:00 smithi002 ceph-mon[32210]: pgmap v436: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-13T11:22:00.872 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:00 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2661096682' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-13T11:22:00.872 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:00 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1443280409' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-13T11:22:01.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:00 smithi178 ceph-mon[36913]: pgmap v436: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-13T11:22:01.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:00 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2661096682' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-13T11:22:01.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:00 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1443280409' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-13T11:22:01.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:00 smithi077 ceph-mon[36410]: pgmap v436: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-13T11:22:01.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:00 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2661096682' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-13T11:22:01.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:00 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1443280409' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-13T11:22:02.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.022+0000 7f169b600700 1 -- 172.21.15.2:0/2942938298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f169406ab10 msgr2=0x7f169410f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:02.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.022+0000 7f169b600700 1 --2- 172.21.15.2:0/2942938298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f169406ab10 0x7f169410f320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f168c00b0d0 tx=0x7f168c00b3e0 comp rx=0 tx=0).stop 2024-06-13T11:22:02.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.022+0000 7f169b600700 1 -- 172.21.15.2:0/2942938298 shutdown_connections 2024-06-13T11:22:02.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.022+0000 7f169b600700 1 --2- 172.21.15.2:0/2942938298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f169406ab10 0x7f169410f320 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:02.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.022+0000 7f169b600700 1 --2- 172.21.15.2:0/2942938298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16941084e0 0x7f16941088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:02.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.022+0000 7f169b600700 1 --2- 172.21.15.2:0/2942938298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f169406a170 0x7f169406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:02.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.022+0000 7f169b600700 1 -- 172.21.15.2:0/2942938298 >> 172.21.15.2:0/2942938298 conn(0x7f16940782c0 msgr2=0x7f16940786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:02.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.023+0000 7f169b600700 1 -- 172.21.15.2:0/2942938298 shutdown_connections 2024-06-13T11:22:02.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.023+0000 7f169b600700 1 -- 172.21.15.2:0/2942938298 wait complete. 2024-06-13T11:22:02.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.024+0000 7f169b600700 1 Processor -- start 2024-06-13T11:22:02.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.024+0000 7f169b600700 1 -- start start 2024-06-13T11:22:02.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.025+0000 7f169b600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f169406a170 0x7f169419ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:02.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.025+0000 7f169b600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f169406ab10 0x7f169419b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:02.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.025+0000 7f169b600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16941084e0 0x7f169419f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:02.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.025+0000 7f169b600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1694112730 con 0x7f16941084e0 2024-06-13T11:22:02.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.025+0000 7f169b600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f16941125b0 con 0x7f169406a170 2024-06-13T11:22:02.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.025+0000 7f169b600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f16941128b0 con 0x7f169406ab10 2024-06-13T11:22:02.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.025+0000 7f1698c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f169406a170 0x7f169419ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:02.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.025+0000 7f1698c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f169406a170 0x7f169419ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:38088/0 (socket says 172.21.15.2:38088) 2024-06-13T11:22:02.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.025+0000 7f1698c00700 1 -- 172.21.15.2:0/1178397649 learned_addr learned my addr 172.21.15.2:0/1178397649 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:02.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.025+0000 7f1699600700 1 --2- 172.21.15.2:0/1178397649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16941084e0 0x7f169419f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:02.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.025+0000 7f1693e00700 1 --2- 172.21.15.2:0/1178397649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f169406ab10 0x7f169419b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.026+0000 7f1698c00700 1 -- 172.21.15.2:0/1178397649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f169406ab10 msgr2=0x7f169419b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.026+0000 7f1698c00700 1 --2- 172.21.15.2:0/1178397649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f169406ab10 0x7f169419b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.026+0000 7f1698c00700 1 -- 172.21.15.2:0/1178397649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16941084e0 msgr2=0x7f169419f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.026+0000 7f1698c00700 1 --2- 172.21.15.2:0/1178397649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16941084e0 0x7f169419f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.026+0000 7f1698c00700 1 -- 172.21.15.2:0/1178397649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169419fd40 con 0x7f169406a170 2024-06-13T11:22:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.026+0000 7f1698c00700 1 --2- 172.21.15.2:0/1178397649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f169406a170 0x7f169419ad30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f168800eb30 tx=0x7f168800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.026+0000 7f1691600700 1 -- 172.21.15.2:0/1178397649 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168800cbd0 con 0x7f169406a170 2024-06-13T11:22:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.026+0000 7f1691600700 1 -- 172.21.15.2:0/1178397649 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1688004500 con 0x7f169406a170 2024-06-13T11:22:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.026+0000 7f169b600700 1 -- 172.21.15.2:0/1178397649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16941a0030 con 0x7f169406a170 2024-06-13T11:22:02.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.026+0000 7f1691600700 1 -- 172.21.15.2:0/1178397649 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1688010430 con 0x7f169406a170 2024-06-13T11:22:02.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.026+0000 7f169b600700 1 -- 172.21.15.2:0/1178397649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16941a78b0 con 0x7f169406a170 2024-06-13T11:22:02.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.028+0000 7f169b600700 1 -- 172.21.15.2:0/1178397649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1694069180 con 0x7f169406a170 2024-06-13T11:22:02.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.029+0000 7f1691600700 1 -- 172.21.15.2:0/1178397649 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f1688003f00 con 0x7f169406a170 2024-06-13T11:22:02.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.031+0000 7f1691600700 1 --2- 172.21.15.2:0/1178397649 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f167c0a2c20 0x7f167c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:02.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.031+0000 7f1691600700 1 -- 172.21.15.2:0/1178397649 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f16880cf730 con 0x7f169406a170 2024-06-13T11:22:02.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.031+0000 7f1693e00700 1 --2- 172.21.15.2:0/1178397649 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f167c0a2c20 0x7f167c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:02.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.032+0000 7f1693e00700 1 --2- 172.21.15.2:0/1178397649 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f167c0a2c20 0x7f167c0a50e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f169410f760 tx=0x7f1680009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:02.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.035+0000 7f1691600700 1 -- 172.21.15.2:0/1178397649 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f168809c2a0 con 0x7f169406a170 2024-06-13T11:22:02.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.271+0000 7f169b600700 1 -- 172.21.15.2:0/1178397649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f16941a7ae0 con 0x7f169406a170 2024-06-13T11:22:02.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.271+0000 7f1691600700 1 -- 172.21.15.2:0/1178397649 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f168809bba0 con 0x7f169406a170 2024-06-13T11:22:02.270 INFO:teuthology.orchestra.run.smithi002.stdout:309237645373 2024-06-13T11:22:02.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.275+0000 7f169b600700 1 -- 172.21.15.2:0/1178397649 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f167c0a2c20 msgr2=0x7f167c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:02.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.275+0000 7f169b600700 1 --2- 172.21.15.2:0/1178397649 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f167c0a2c20 0x7f167c0a50e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f169410f760 tx=0x7f1680009260 comp rx=0 tx=0).stop 2024-06-13T11:22:02.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.275+0000 7f169b600700 1 -- 172.21.15.2:0/1178397649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f169406a170 msgr2=0x7f169419ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:02.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.275+0000 7f169b600700 1 --2- 172.21.15.2:0/1178397649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f169406a170 0x7f169419ad30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f168800eb30 tx=0x7f168800ee40 comp rx=0 tx=0).stop 2024-06-13T11:22:02.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.275+0000 7f169b600700 1 -- 172.21.15.2:0/1178397649 shutdown_connections 2024-06-13T11:22:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.275+0000 7f169b600700 1 --2- 172.21.15.2:0/1178397649 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f167c0a2c20 0x7f167c0a50e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.275+0000 7f169b600700 1 --2- 172.21.15.2:0/1178397649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16941084e0 0x7f169419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.275+0000 7f169b600700 1 --2- 172.21.15.2:0/1178397649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f169406a170 0x7f169419ad30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.275+0000 7f169b600700 1 --2- 172.21.15.2:0/1178397649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f169406ab10 0x7f169419b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.275+0000 7f169b600700 1 -- 172.21.15.2:0/1178397649 >> 172.21.15.2:0/1178397649 conn(0x7f16940782c0 msgr2=0x7f16940ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.276+0000 7f169b600700 1 -- 172.21.15.2:0/1178397649 shutdown_connections 2024-06-13T11:22:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:02.276+0000 7f169b600700 1 -- 172.21.15.2:0/1178397649 wait complete. 2024-06-13T11:22:02.762 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495696 got 197568495700 for osd.6 2024-06-13T11:22:02.763 DEBUG:teuthology.parallel:result is None 2024-06-13T11:22:03.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:02 smithi002 ceph-mon[32210]: pgmap v437: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-06-13T11:22:03.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:02 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1178397649' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-13T11:22:03.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:02 smithi178 ceph-mon[36913]: pgmap v437: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-06-13T11:22:03.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:02 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1178397649' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-13T11:22:03.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:02 smithi077 ceph-mon[36410]: pgmap v437: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-06-13T11:22:03.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:02 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1178397649' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-13T11:22:03.369 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574956 got 55834574962 for osd.1 2024-06-13T11:22:03.369 DEBUG:teuthology.parallel:result is None 2024-06-13T11:22:03.656 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182496 got 107374182500 for osd.3 2024-06-13T11:22:03.657 DEBUG:teuthology.parallel:result is None 2024-06-13T11:22:04.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.000+0000 7f838b400700 1 -- 172.21.15.2:0/1356286965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83840746c0 msgr2=0x7f8384074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:04.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.000+0000 7f838b400700 1 --2- 172.21.15.2:0/1356286965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83840746c0 0x7f8384074aa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8378009990 tx=0x7f8378009ca0 comp rx=0 tx=0).stop 2024-06-13T11:22:04.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.001+0000 7f838b400700 1 -- 172.21.15.2:0/1356286965 shutdown_connections 2024-06-13T11:22:04.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.001+0000 7f838b400700 1 --2- 172.21.15.2:0/1356286965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f838410eef0 0x7f83841112e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:04.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.001+0000 7f838b400700 1 --2- 172.21.15.2:0/1356286965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83840746c0 0x7f8384074aa0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:04.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.001+0000 7f838b400700 1 --2- 172.21.15.2:0/1356286965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8384074fe0 0x7f838410e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:04.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.001+0000 7f838b400700 1 -- 172.21.15.2:0/1356286965 >> 172.21.15.2:0/1356286965 conn(0x7f83840795f0 msgr2=0x7f8384079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:04.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.001+0000 7f838b400700 1 -- 172.21.15.2:0/1356286965 shutdown_connections 2024-06-13T11:22:04.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.001+0000 7f838b400700 1 -- 172.21.15.2:0/1356286965 wait complete. 2024-06-13T11:22:04.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.002+0000 7f838b400700 1 Processor -- start 2024-06-13T11:22:04.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.002+0000 7f838b400700 1 -- start start 2024-06-13T11:22:04.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f838b400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840746c0 0x7f838419adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:04.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f838b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8384074fe0 0x7f838419b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f838b400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838410eef0 0x7f838419f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f838b400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8384114a40 con 0x7f8384074fe0 2024-06-13T11:22:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f838b400700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f83841148c0 con 0x7f83840746c0 2024-06-13T11:22:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f838b400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8384114bc0 con 0x7f838410eef0 2024-06-13T11:22:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f8383e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8384074fe0 0x7f838419b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f8388a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840746c0 0x7f838419adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f8383e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8384074fe0 0x7f838419b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32954/0 (socket says 172.21.15.2:32954) 2024-06-13T11:22:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f8383e00700 1 -- 172.21.15.2:0/4103696914 learned_addr learned my addr 172.21.15.2:0/4103696914 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f8388a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840746c0 0x7f838419adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:38104/0 (socket says 172.21.15.2:38104) 2024-06-13T11:22:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f8389400700 1 --2- 172.21.15.2:0/4103696914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838410eef0 0x7f838419f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f8388a00700 1 -- 172.21.15.2:0/4103696914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838410eef0 msgr2=0x7f838419f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f8388a00700 1 --2- 172.21.15.2:0/4103696914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838410eef0 0x7f838419f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f8388a00700 1 -- 172.21.15.2:0/4103696914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8384074fe0 msgr2=0x7f838419b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f8388a00700 1 --2- 172.21.15.2:0/4103696914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8384074fe0 0x7f838419b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.003+0000 7f8388a00700 1 -- 172.21.15.2:0/4103696914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838419fe00 con 0x7f83840746c0 2024-06-13T11:22:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.004+0000 7f8388a00700 1 --2- 172.21.15.2:0/4103696914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840746c0 0x7f838419adf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f83780098e0 tx=0x7f837800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.004+0000 7f8381600700 1 -- 172.21.15.2:0/4103696914 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378027070 con 0x7f83840746c0 2024-06-13T11:22:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.004+0000 7f8381600700 1 -- 172.21.15.2:0/4103696914 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8378003b60 con 0x7f83840746c0 2024-06-13T11:22:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.004+0000 7f838b400700 1 -- 172.21.15.2:0/4103696914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83841a0090 con 0x7f83840746c0 2024-06-13T11:22:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.004+0000 7f838b400700 1 -- 172.21.15.2:0/4103696914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83841a7970 con 0x7f83840746c0 2024-06-13T11:22:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.004+0000 7f8381600700 1 -- 172.21.15.2:0/4103696914 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378022d50 con 0x7f83840746c0 2024-06-13T11:22:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.006+0000 7f838b400700 1 -- 172.21.15.2:0/4103696914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8384075d80 con 0x7f83840746c0 2024-06-13T11:22:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.007+0000 7f8381600700 1 -- 172.21.15.2:0/4103696914 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f837802a070 con 0x7f83840746c0 2024-06-13T11:22:04.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.009+0000 7f8381600700 1 --2- 172.21.15.2:0/4103696914 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f836c0a2c20 0x7f836c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:04.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.009+0000 7f8381600700 1 -- 172.21.15.2:0/4103696914 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f83780d0140 con 0x7f83840746c0 2024-06-13T11:22:04.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.009+0000 7f8383e00700 1 --2- 172.21.15.2:0/4103696914 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f836c0a2c20 0x7f836c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:04.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.010+0000 7f8383e00700 1 --2- 172.21.15.2:0/4103696914 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f836c0a2c20 0x7f836c0a50e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8384110ab0 tx=0x7f8370009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:04.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.013+0000 7f8381600700 1 -- 172.21.15.2:0/4103696914 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8378013070 con 0x7f83840746c0 2024-06-13T11:22:04.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.247+0000 7f838b400700 1 -- 172.21.15.2:0/4103696914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f83841a7b40 con 0x7f83840746c0 2024-06-13T11:22:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.247+0000 7f8381600700 1 -- 172.21.15.2:0/4103696914 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8378098030 con 0x7f83840746c0 2024-06-13T11:22:04.247 INFO:teuthology.orchestra.run.smithi002.stdout:141733920865 2024-06-13T11:22:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.251+0000 7f838b400700 1 -- 172.21.15.2:0/4103696914 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f836c0a2c20 msgr2=0x7f836c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.251+0000 7f838b400700 1 --2- 172.21.15.2:0/4103696914 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f836c0a2c20 0x7f836c0a50e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8384110ab0 tx=0x7f8370009260 comp rx=0 tx=0).stop 2024-06-13T11:22:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.251+0000 7f838b400700 1 -- 172.21.15.2:0/4103696914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840746c0 msgr2=0x7f838419adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.251+0000 7f838b400700 1 --2- 172.21.15.2:0/4103696914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840746c0 0x7f838419adf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f83780098e0 tx=0x7f837800b8a0 comp rx=0 tx=0).stop 2024-06-13T11:22:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.251+0000 7f838b400700 1 -- 172.21.15.2:0/4103696914 shutdown_connections 2024-06-13T11:22:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.251+0000 7f838b400700 1 --2- 172.21.15.2:0/4103696914 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f836c0a2c20 0x7f836c0a50e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.251+0000 7f838b400700 1 --2- 172.21.15.2:0/4103696914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838410eef0 0x7f838419f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.251+0000 7f838b400700 1 --2- 172.21.15.2:0/4103696914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83840746c0 0x7f838419adf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.251+0000 7f838b400700 1 --2- 172.21.15.2:0/4103696914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8384074fe0 0x7f838419b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.251+0000 7f838b400700 1 -- 172.21.15.2:0/4103696914 >> 172.21.15.2:0/4103696914 conn(0x7f83840795f0 msgr2=0x7f83840ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.252+0000 7f838b400700 1 -- 172.21.15.2:0/4103696914 shutdown_connections 2024-06-13T11:22:04.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:04.252+0000 7f838b400700 1 -- 172.21.15.2:0/4103696914 wait complete. 2024-06-13T11:22:04.953 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:04 smithi002 ceph-mon[32210]: pgmap v438: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 7 op/s 2024-06-13T11:22:04.953 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:04 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/4103696914' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-13T11:22:04.957 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645367 got 309237645373 for osd.10 2024-06-13T11:22:04.957 DEBUG:teuthology.parallel:result is None 2024-06-13T11:22:05.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:04 smithi178 ceph-mon[36913]: pgmap v438: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 7 op/s 2024-06-13T11:22:05.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:04 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/4103696914' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-13T11:22:05.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:04 smithi077 ceph-mon[36410]: pgmap v438: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 7 op/s 2024-06-13T11:22:05.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:04 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/4103696914' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-13T11:22:05.459 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920859 got 141733920865 for osd.4 2024-06-13T11:22:05.459 DEBUG:teuthology.parallel:result is None 2024-06-13T11:22:05.460 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-13T11:22:05.460 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph pg dump --format=json 2024-06-13T11:22:05.925 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:22:07.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:06 smithi002 ceph-mon[32210]: pgmap v439: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-13T11:22:07.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:06 smithi178 ceph-mon[36913]: pgmap v439: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-13T11:22:07.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:06 smithi077 ceph-mon[36410]: pgmap v439: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-13T11:22:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.220+0000 7f01ac400700 1 -- 172.21.15.2:0/3500496623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a406a1a0 msgr2=0x7f01a406a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.220+0000 7f01ac400700 1 --2- 172.21.15.2:0/3500496623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a406a1a0 0x7f01a406a580 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f01980098f0 tx=0x7f0198009c00 comp rx=0 tx=0).stop 2024-06-13T11:22:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.220+0000 7f01ac400700 1 -- 172.21.15.2:0/3500496623 shutdown_connections 2024-06-13T11:22:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.220+0000 7f01ac400700 1 --2- 172.21.15.2:0/3500496623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01a410ef40 0x7f01a4111330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.220+0000 7f01ac400700 1 --2- 172.21.15.2:0/3500496623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a406a1a0 0x7f01a406a580 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.220+0000 7f01ac400700 1 --2- 172.21.15.2:0/3500496623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a406aac0 0x7f01a410ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.220+0000 7f01ac400700 1 -- 172.21.15.2:0/3500496623 >> 172.21.15.2:0/3500496623 conn(0x7f01a4078340 msgr2=0x7f01a4078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:08.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.220+0000 7f01ac400700 1 -- 172.21.15.2:0/3500496623 shutdown_connections 2024-06-13T11:22:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.220+0000 7f01ac400700 1 -- 172.21.15.2:0/3500496623 wait complete. 2024-06-13T11:22:08.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.223+0000 7f01ac400700 1 Processor -- start 2024-06-13T11:22:08.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.223+0000 7f01ac400700 1 -- start start 2024-06-13T11:22:08.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.224+0000 7f01ac400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01a406a1a0 0x7f01a419aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:08.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.224+0000 7f01ac400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a406aac0 0x7f01a419b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:08.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.224+0000 7f01ac400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a410ef40 0x7f01a419f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:08.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.224+0000 7f01ac400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f01a41149b0 con 0x7f01a406a1a0 2024-06-13T11:22:08.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.224+0000 7f01ac400700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01a4114830 con 0x7f01a406aac0 2024-06-13T11:22:08.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.224+0000 7f01ac400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f01a4114b30 con 0x7f01a410ef40 2024-06-13T11:22:08.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.224+0000 7f01a9000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a406aac0 0x7f01a419b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:08.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.224+0000 7f01aa400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a410ef40 0x7f01a419f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:08.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.225+0000 7f01a9000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a406aac0 0x7f01a419b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:55948/0 (socket says 172.21.15.2:55948) 2024-06-13T11:22:08.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.225+0000 7f01a9000700 1 -- 172.21.15.2:0/3430126014 learned_addr learned my addr 172.21.15.2:0/3430126014 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:08.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.225+0000 7f01aa400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a410ef40 0x7f01a419f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:36136/0 (socket says 172.21.15.2:36136) 2024-06-13T11:22:08.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.225+0000 7f01a9a00700 1 --2- 172.21.15.2:0/3430126014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01a406a1a0 0x7f01a419aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:08.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.225+0000 7f01aa400700 1 -- 172.21.15.2:0/3430126014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a406aac0 msgr2=0x7f01a419b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:08.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.225+0000 7f01aa400700 1 --2- 172.21.15.2:0/3430126014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a406aac0 0x7f01a419b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:08.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.225+0000 7f01aa400700 1 -- 172.21.15.2:0/3430126014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01a406a1a0 msgr2=0x7f01a419aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.225+0000 7f01aa400700 1 --2- 172.21.15.2:0/3430126014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01a406a1a0 0x7f01a419aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.225+0000 7f01aa400700 1 -- 172.21.15.2:0/3430126014 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a419feb0 con 0x7f01a410ef40 2024-06-13T11:22:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.225+0000 7f01a9a00700 1 --2- 172.21.15.2:0/3430126014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01a406a1a0 0x7f01a419aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:22:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.225+0000 7f01aa400700 1 --2- 172.21.15.2:0/3430126014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a410ef40 0x7f01a419f770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f019c00ef90 tx=0x7f019c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.226+0000 7f01a2000700 1 -- 172.21.15.2:0/3430126014 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c0092e0 con 0x7f01a410ef40 2024-06-13T11:22:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.226+0000 7f01a2000700 1 -- 172.21.15.2:0/3430126014 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f019c004bb0 con 0x7f01a410ef40 2024-06-13T11:22:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.226+0000 7f01a2000700 1 -- 172.21.15.2:0/3430126014 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019c004280 con 0x7f01a410ef40 2024-06-13T11:22:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.226+0000 7f01ac400700 1 -- 172.21.15.2:0/3430126014 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a41a0140 con 0x7f01a410ef40 2024-06-13T11:22:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.226+0000 7f01ac400700 1 -- 172.21.15.2:0/3430126014 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a41a7a20 con 0x7f01a410ef40 2024-06-13T11:22:08.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.227+0000 7f01ac400700 1 -- 172.21.15.2:0/3430126014 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a4069180 con 0x7f01a410ef40 2024-06-13T11:22:08.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.229+0000 7f01a2000700 1 -- 172.21.15.2:0/3430126014 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f019c044d10 con 0x7f01a410ef40 2024-06-13T11:22:08.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.231+0000 7f01a2000700 1 --2- 172.21.15.2:0/3430126014 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f018c0a2ca0 0x7f018c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:08.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.231+0000 7f01a2000700 1 -- 172.21.15.2:0/3430126014 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f019c0cf2d0 con 0x7f01a410ef40 2024-06-13T11:22:08.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.231+0000 7f01a9a00700 1 --2- 172.21.15.2:0/3430126014 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f018c0a2ca0 0x7f018c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:08.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.232+0000 7f01a9a00700 1 --2- 172.21.15.2:0/3430126014 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f018c0a2ca0 0x7f018c0a5160 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0198009fd0 tx=0x7f0198019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:08.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.233+0000 7f01a2000700 1 -- 172.21.15.2:0/3430126014 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f019c022020 con 0x7f01a410ef40 2024-06-13T11:22:08.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.460+0000 7f01ac400700 1 -- 172.21.15.2:0/3430126014 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01a40628d0 con 0x7f018c0a2ca0 2024-06-13T11:22:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.490+0000 7f01a2000700 1 -- 172.21.15.2:0/3430126014 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340754 (secure 0 0 0) 0x7f0198079330 con 0x7f018c0a2ca0 2024-06-13T11:22:08.497 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:22:08.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.499+0000 7f01ac400700 1 -- 172.21.15.2:0/3430126014 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f018c0a2ca0 msgr2=0x7f018c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:08.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.499+0000 7f01ac400700 1 --2- 172.21.15.2:0/3430126014 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f018c0a2ca0 0x7f018c0a5160 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0198009fd0 tx=0x7f0198019040 comp rx=0 tx=0).stop 2024-06-13T11:22:08.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.499+0000 7f01ac400700 1 -- 172.21.15.2:0/3430126014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a410ef40 msgr2=0x7f01a419f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:08.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.499+0000 7f01ac400700 1 --2- 172.21.15.2:0/3430126014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a410ef40 0x7f01a419f770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f019c00ef90 tx=0x7f019c00c3a0 comp rx=0 tx=0).stop 2024-06-13T11:22:08.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.500+0000 7f01ac400700 1 -- 172.21.15.2:0/3430126014 shutdown_connections 2024-06-13T11:22:08.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.500+0000 7f01ac400700 1 --2- 172.21.15.2:0/3430126014 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f018c0a2ca0 0x7f018c0a5160 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:08.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.500+0000 7f01ac400700 1 --2- 172.21.15.2:0/3430126014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01a406a1a0 0x7f01a419aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:08.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.500+0000 7f01ac400700 1 --2- 172.21.15.2:0/3430126014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a410ef40 0x7f01a419f770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:08.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.500+0000 7f01ac400700 1 --2- 172.21.15.2:0/3430126014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a406aac0 0x7f01a419b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:08.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.500+0000 7f01ac400700 1 -- 172.21.15.2:0/3430126014 >> 172.21.15.2:0/3430126014 conn(0x7f01a4078340 msgr2=0x7f01a41103f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:08.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.500+0000 7f01ac400700 1 -- 172.21.15.2:0/3430126014 shutdown_connections 2024-06-13T11:22:08.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:08.500+0000 7f01ac400700 1 -- 172.21.15.2:0/3430126014 wait complete. 2024-06-13T11:22:08.501 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-06-13T11:22:09.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:08 smithi002 ceph-mon[32210]: pgmap v440: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 8 op/s 2024-06-13T11:22:09.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:08 smithi178 ceph-mon[36913]: pgmap v440: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 8 op/s 2024-06-13T11:22:09.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:08 smithi077 ceph-mon[36410]: pgmap v440: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 8 op/s 2024-06-13T11:22:09.397 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":440,"stamp":"2024-06-13T11:22:07.330418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659072,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":866,"num_read_kb":557,"num_write":362,"num_write_kb":3066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":792,"ondisk_log_size":792,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391588,"kb_used_data":13316,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550236,"statfs":{"total":1151940427776,"available":1151539441664,"internally_reserved":0,"allocated":13635584,"data_stored":8788850,"data_compressed":498924,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":531,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":47,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005226"},"pg_stats":[{"pgid":"3.3f","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.280201+0000","last_change":"2024-06-13T11:18:42.925351+0000","last_active":"2024-06-13T11:21:55.280201+0000","last_peered":"2024-06-13T11:21:55.280201+0000","last_clean":"2024-06-13T11:21:55.280201+0000","last_became_active":"2024-06-13T11:18:42.924971+0000","last_became_peered":"2024-06-13T11:18:42.924971+0000","last_unstale":"2024-06-13T11:21:55.280201+0000","last_undegraded":"2024-06-13T11:21:55.280201+0000","last_fullsized":"2024-06-13T11:21:55.280201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:33:49.563311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.280934+0000","last_change":"2024-06-13T11:18:42.923771+0000","last_active":"2024-06-13T11:21:55.280934+0000","last_peered":"2024-06-13T11:21:55.280934+0000","last_clean":"2024-06-13T11:21:55.280934+0000","last_became_active":"2024-06-13T11:18:42.918410+0000","last_became_peered":"2024-06-13T11:18:42.918410+0000","last_unstale":"2024-06-13T11:21:55.280934+0000","last_undegraded":"2024-06-13T11:21:55.280934+0000","last_fullsized":"2024-06-13T11:21:55.280934+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:11:28.256622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.278891+0000","last_change":"2024-06-13T11:18:42.919502+0000","last_active":"2024-06-13T11:21:55.278891+0000","last_peered":"2024-06-13T11:21:55.278891+0000","last_clean":"2024-06-13T11:21:55.278891+0000","last_became_active":"2024-06-13T11:18:42.915747+0000","last_became_peered":"2024-06-13T11:18:42.915747+0000","last_unstale":"2024-06-13T11:21:55.278891+0000","last_undegraded":"2024-06-13T11:21:55.278891+0000","last_fullsized":"2024-06-13T11:21:55.278891+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:39:23.555604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.258819+0000","last_change":"2024-06-13T11:18:42.905944+0000","last_active":"2024-06-13T11:21:55.258819+0000","last_peered":"2024-06-13T11:21:55.258819+0000","last_clean":"2024-06-13T11:21:55.258819+0000","last_became_active":"2024-06-13T11:18:42.905494+0000","last_became_peered":"2024-06-13T11:18:42.905494+0000","last_unstale":"2024-06-13T11:21:55.258819+0000","last_undegraded":"2024-06-13T11:21:55.258819+0000","last_fullsized":"2024-06-13T11:21:55.258819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:26:44.396593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.274192+0000","last_change":"2024-06-13T11:18:42.924212+0000","last_active":"2024-06-13T11:21:55.274192+0000","last_peered":"2024-06-13T11:21:55.274192+0000","last_clean":"2024-06-13T11:21:55.274192+0000","last_became_active":"2024-06-13T11:18:42.923848+0000","last_became_peered":"2024-06-13T11:18:42.923848+0000","last_unstale":"2024-06-13T11:21:55.274192+0000","last_undegraded":"2024-06-13T11:21:55.274192+0000","last_fullsized":"2024-06-13T11:21:55.274192+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:01.754609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.252721+0000","last_change":"2024-06-13T11:18:42.915283+0000","last_active":"2024-06-13T11:21:55.252721+0000","last_peered":"2024-06-13T11:21:55.252721+0000","last_clean":"2024-06-13T11:21:55.252721+0000","last_became_active":"2024-06-13T11:18:42.914921+0000","last_became_peered":"2024-06-13T11:18:42.914921+0000","last_unstale":"2024-06-13T11:21:55.252721+0000","last_undegraded":"2024-06-13T11:21:55.252721+0000","last_fullsized":"2024-06-13T11:21:55.252721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:48:42.116314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.257630+0000","last_change":"2024-06-13T11:18:42.911614+0000","last_active":"2024-06-13T11:21:55.257630+0000","last_peered":"2024-06-13T11:21:55.257630+0000","last_clean":"2024-06-13T11:21:55.257630+0000","last_became_active":"2024-06-13T11:18:42.911360+0000","last_became_peered":"2024-06-13T11:18:42.911360+0000","last_unstale":"2024-06-13T11:21:55.257630+0000","last_undegraded":"2024-06-13T11:21:55.257630+0000","last_fullsized":"2024-06-13T11:21:55.257630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:23:55.161725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"99'9","reported_seq":25,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.261197+0000","last_change":"2024-06-13T11:19:27.074801+0000","last_active":"2024-06-13T11:21:55.261197+0000","last_peered":"2024-06-13T11:21:55.261197+0000","last_clean":"2024-06-13T11:21:55.261197+0000","last_became_active":"2024-06-13T11:19:27.072783+0000","last_became_peered":"2024-06-13T11:19:27.072783+0000","last_unstale":"2024-06-13T11:21:55.261197+0000","last_undegraded":"2024-06-13T11:21:55.261197+0000","last_fullsized":"2024-06-13T11:21:55.261197+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:34.658008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.265213+0000","last_change":"2024-06-13T11:18:42.913482+0000","last_active":"2024-06-13T11:21:55.265213+0000","last_peered":"2024-06-13T11:21:55.265213+0000","last_clean":"2024-06-13T11:21:55.265213+0000","last_became_active":"2024-06-13T11:18:42.912700+0000","last_became_peered":"2024-06-13T11:18:42.912700+0000","last_unstale":"2024-06-13T11:21:55.265213+0000","last_undegraded":"2024-06-13T11:21:55.265213+0000","last_fullsized":"2024-06-13T11:21:55.265213+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:38:42.053801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"99'16","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.257189+0000","last_change":"2024-06-13T11:18:42.905824+0000","last_active":"2024-06-13T11:21:55.257189+0000","last_peered":"2024-06-13T11:21:55.257189+0000","last_clean":"2024-06-13T11:21:55.257189+0000","last_became_active":"2024-06-13T11:18:42.905443+0000","last_became_peered":"2024-06-13T11:18:42.905443+0000","last_unstale":"2024-06-13T11:21:55.257189+0000","last_undegraded":"2024-06-13T11:21:55.257189+0000","last_fullsized":"2024-06-13T11:21:55.257189+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:51:46.957656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.262075+0000","last_change":"2024-06-13T11:18:42.901987+0000","last_active":"2024-06-13T11:21:55.262075+0000","last_peered":"2024-06-13T11:21:55.262075+0000","last_clean":"2024-06-13T11:21:55.262075+0000","last_became_active":"2024-06-13T11:18:42.901641+0000","last_became_peered":"2024-06-13T11:18:42.901641+0000","last_unstale":"2024-06-13T11:21:55.262075+0000","last_undegraded":"2024-06-13T11:21:55.262075+0000","last_fullsized":"2024-06-13T11:21:55.262075+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:52:29.036172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.258346+0000","last_change":"2024-06-13T11:18:42.899161+0000","last_active":"2024-06-13T11:21:55.258346+0000","last_peered":"2024-06-13T11:21:55.258346+0000","last_clean":"2024-06-13T11:21:55.258346+0000","last_became_active":"2024-06-13T11:18:42.898823+0000","last_became_peered":"2024-06-13T11:18:42.898823+0000","last_unstale":"2024-06-13T11:21:55.258346+0000","last_undegraded":"2024-06-13T11:21:55.258346+0000","last_fullsized":"2024-06-13T11:21:55.258346+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:21:20.968759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.277889+0000","last_change":"2024-06-13T11:18:42.908954+0000","last_active":"2024-06-13T11:21:55.277889+0000","last_peered":"2024-06-13T11:21:55.277889+0000","last_clean":"2024-06-13T11:21:55.277889+0000","last_became_active":"2024-06-13T11:18:42.908604+0000","last_became_peered":"2024-06-13T11:18:42.908604+0000","last_unstale":"2024-06-13T11:21:55.277889+0000","last_undegraded":"2024-06-13T11:21:55.277889+0000","last_fullsized":"2024-06-13T11:21:55.277889+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:00:30.662233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.282751+0000","last_change":"2024-06-13T11:18:42.925374+0000","last_active":"2024-06-13T11:21:55.282751+0000","last_peered":"2024-06-13T11:21:55.282751+0000","last_clean":"2024-06-13T11:21:55.282751+0000","last_became_active":"2024-06-13T11:18:42.924624+0000","last_became_peered":"2024-06-13T11:18:42.924624+0000","last_unstale":"2024-06-13T11:21:55.282751+0000","last_undegraded":"2024-06-13T11:21:55.282751+0000","last_fullsized":"2024-06-13T11:21:55.282751+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:07.989887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.278576+0000","last_change":"2024-06-13T11:18:42.924457+0000","last_active":"2024-06-13T11:21:55.278576+0000","last_peered":"2024-06-13T11:21:55.278576+0000","last_clean":"2024-06-13T11:21:55.278576+0000","last_became_active":"2024-06-13T11:18:42.922641+0000","last_became_peered":"2024-06-13T11:18:42.922641+0000","last_unstale":"2024-06-13T11:21:55.278576+0000","last_undegraded":"2024-06-13T11:21:55.278576+0000","last_fullsized":"2024-06-13T11:21:55.278576+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:52:56.769565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.268412+0000","last_change":"2024-06-13T11:18:42.925333+0000","last_active":"2024-06-13T11:21:55.268412+0000","last_peered":"2024-06-13T11:21:55.268412+0000","last_clean":"2024-06-13T11:21:55.268412+0000","last_became_active":"2024-06-13T11:18:42.924854+0000","last_became_peered":"2024-06-13T11:18:42.924854+0000","last_unstale":"2024-06-13T11:21:55.268412+0000","last_undegraded":"2024-06-13T11:21:55.268412+0000","last_fullsized":"2024-06-13T11:21:55.268412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:30:38.554616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.280314+0000","last_change":"2024-06-13T11:18:42.926652+0000","last_active":"2024-06-13T11:21:55.280314+0000","last_peered":"2024-06-13T11:21:55.280314+0000","last_clean":"2024-06-13T11:21:55.280314+0000","last_became_active":"2024-06-13T11:18:42.926281+0000","last_became_peered":"2024-06-13T11:18:42.926281+0000","last_unstale":"2024-06-13T11:21:55.280314+0000","last_undegraded":"2024-06-13T11:21:55.280314+0000","last_fullsized":"2024-06-13T11:21:55.280314+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:50:50.483047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.269717+0000","last_change":"2024-06-13T11:18:42.917743+0000","last_active":"2024-06-13T11:21:55.269717+0000","last_peered":"2024-06-13T11:21:55.269717+0000","last_clean":"2024-06-13T11:21:55.269717+0000","last_became_active":"2024-06-13T11:18:42.916473+0000","last_became_peered":"2024-06-13T11:18:42.916473+0000","last_unstale":"2024-06-13T11:21:55.269717+0000","last_undegraded":"2024-06-13T11:21:55.269717+0000","last_fullsized":"2024-06-13T11:21:55.269717+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:20:12.909524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.277878+0000","last_change":"2024-06-13T11:18:42.930712+0000","last_active":"2024-06-13T11:21:55.277878+0000","last_peered":"2024-06-13T11:21:55.277878+0000","last_clean":"2024-06-13T11:21:55.277878+0000","last_became_active":"2024-06-13T11:18:42.930446+0000","last_became_peered":"2024-06-13T11:18:42.930446+0000","last_unstale":"2024-06-13T11:21:55.277878+0000","last_undegraded":"2024-06-13T11:21:55.277878+0000","last_fullsized":"2024-06-13T11:21:55.277878+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:08:28.729916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.531381+0000","last_change":"2024-06-13T11:18:57.027006+0000","last_active":"2024-06-13T11:20:27.531381+0000","last_peered":"2024-06-13T11:20:27.531381+0000","last_clean":"2024-06-13T11:20:27.531381+0000","last_became_active":"2024-06-13T11:18:57.026562+0000","last_became_peered":"2024-06-13T11:18:57.026562+0000","last_unstale":"2024-06-13T11:20:27.531381+0000","last_undegraded":"2024-06-13T11:20:27.531381+0000","last_fullsized":"2024-06-13T11:20:27.531381+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:17:32.180729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"97'9","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767734+0000","last_change":"2024-06-13T11:18:38.172704+0000","last_active":"2024-06-13T11:20:27.767734+0000","last_peered":"2024-06-13T11:20:27.767734+0000","last_clean":"2024-06-13T11:20:27.767734+0000","last_became_active":"2024-06-13T11:18:38.172125+0000","last_became_peered":"2024-06-13T11:18:38.172125+0000","last_unstale":"2024-06-13T11:20:27.767734+0000","last_undegraded":"2024-06-13T11:20:27.767734+0000","last_fullsized":"2024-06-13T11:20:27.767734+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:40:52.578805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.273540+0000","last_change":"2024-06-13T11:18:42.922864+0000","last_active":"2024-06-13T11:21:55.273540+0000","last_peered":"2024-06-13T11:21:55.273540+0000","last_clean":"2024-06-13T11:21:55.273540+0000","last_became_active":"2024-06-13T11:18:42.921283+0000","last_became_peered":"2024-06-13T11:18:42.921283+0000","last_unstale":"2024-06-13T11:21:55.273540+0000","last_undegraded":"2024-06-13T11:21:55.273540+0000","last_fullsized":"2024-06-13T11:21:55.273540+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:44.421502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.905377+0000","last_change":"2024-06-13T11:20:27.904814+0000","last_active":"2024-06-13T11:20:27.905377+0000","last_peered":"2024-06-13T11:20:27.905377+0000","last_clean":"2024-06-13T11:20:27.905377+0000","last_became_active":"2024-06-13T11:20:27.904342+0000","last_became_peered":"2024-06-13T11:20:27.904342+0000","last_unstale":"2024-06-13T11:20:27.905377+0000","last_undegraded":"2024-06-13T11:20:27.905377+0000","last_fullsized":"2024-06-13T11:20:27.905377+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:45:59.215429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,10,3],"acting":[4,6,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.903753+0000","last_change":"2024-06-13T11:18:38.483021+0000","last_active":"2024-06-13T11:20:27.903753+0000","last_peered":"2024-06-13T11:20:27.903753+0000","last_clean":"2024-06-13T11:20:27.903753+0000","last_became_active":"2024-06-13T11:18:38.482594+0000","last_became_peered":"2024-06-13T11:18:38.482594+0000","last_unstale":"2024-06-13T11:20:27.903753+0000","last_undegraded":"2024-06-13T11:20:27.903753+0000","last_fullsized":"2024-06-13T11:20:27.903753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:27:07.660961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.282621+0000","last_change":"2024-06-13T11:18:42.926272+0000","last_active":"2024-06-13T11:21:55.282621+0000","last_peered":"2024-06-13T11:21:55.282621+0000","last_clean":"2024-06-13T11:21:55.282621+0000","last_became_active":"2024-06-13T11:18:42.925864+0000","last_became_peered":"2024-06-13T11:18:42.925864+0000","last_unstale":"2024-06-13T11:21:55.282621+0000","last_undegraded":"2024-06-13T11:21:55.282621+0000","last_fullsized":"2024-06-13T11:21:55.282621+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:51:59.562266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529404+0000","last_change":"2024-06-13T11:18:57.033152+0000","last_active":"2024-06-13T11:20:27.529404+0000","last_peered":"2024-06-13T11:20:27.529404+0000","last_clean":"2024-06-13T11:20:27.529404+0000","last_became_active":"2024-06-13T11:18:57.032696+0000","last_became_peered":"2024-06-13T11:18:57.032696+0000","last_unstale":"2024-06-13T11:20:27.529404+0000","last_undegraded":"2024-06-13T11:20:27.529404+0000","last_fullsized":"2024-06-13T11:20:27.529404+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:59:20.584476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526219+0000","last_change":"2024-06-13T11:18:38.168246+0000","last_active":"2024-06-13T11:20:27.526219+0000","last_peered":"2024-06-13T11:20:27.526219+0000","last_clean":"2024-06-13T11:20:27.526219+0000","last_became_active":"2024-06-13T11:18:38.167918+0000","last_became_peered":"2024-06-13T11:18:38.167918+0000","last_unstale":"2024-06-13T11:20:27.526219+0000","last_undegraded":"2024-06-13T11:20:27.526219+0000","last_fullsized":"2024-06-13T11:20:27.526219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:23:39.079356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.275423+0000","last_change":"2024-06-13T11:18:42.901291+0000","last_active":"2024-06-13T11:21:55.275423+0000","last_peered":"2024-06-13T11:21:55.275423+0000","last_clean":"2024-06-13T11:21:55.275423+0000","last_became_active":"2024-06-13T11:18:42.900990+0000","last_became_peered":"2024-06-13T11:18:42.900990+0000","last_unstale":"2024-06-13T11:21:55.275423+0000","last_undegraded":"2024-06-13T11:21:55.275423+0000","last_fullsized":"2024-06-13T11:21:55.275423+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:59:03.521767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.906045+0000","last_change":"2024-06-13T11:20:27.905640+0000","last_active":"2024-06-13T11:20:27.906045+0000","last_peered":"2024-06-13T11:20:27.906045+0000","last_clean":"2024-06-13T11:20:27.906045+0000","last_became_active":"2024-06-13T11:20:27.905149+0000","last_became_peered":"2024-06-13T11:20:27.905149+0000","last_unstale":"2024-06-13T11:20:27.906045+0000","last_undegraded":"2024-06-13T11:20:27.906045+0000","last_fullsized":"2024-06-13T11:20:27.906045+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:24:14.702582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526125+0000","last_change":"2024-06-13T11:18:38.170301+0000","last_active":"2024-06-13T11:20:27.526125+0000","last_peered":"2024-06-13T11:20:27.526125+0000","last_clean":"2024-06-13T11:20:27.526125+0000","last_became_active":"2024-06-13T11:18:38.169926+0000","last_became_peered":"2024-06-13T11:18:38.169926+0000","last_unstale":"2024-06-13T11:20:27.526125+0000","last_undegraded":"2024-06-13T11:20:27.526125+0000","last_fullsized":"2024-06-13T11:20:27.526125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:02:02.877638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.267560+0000","last_change":"2024-06-13T11:18:42.907869+0000","last_active":"2024-06-13T11:21:55.267560+0000","last_peered":"2024-06-13T11:21:55.267560+0000","last_clean":"2024-06-13T11:21:55.267560+0000","last_became_active":"2024-06-13T11:18:42.907349+0000","last_became_peered":"2024-06-13T11:18:42.907349+0000","last_unstale":"2024-06-13T11:21:55.267560+0000","last_undegraded":"2024-06-13T11:21:55.267560+0000","last_fullsized":"2024-06-13T11:21:55.267560+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:54:33.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.530987+0000","last_change":"2024-06-13T11:18:57.009598+0000","last_active":"2024-06-13T11:20:27.530987+0000","last_peered":"2024-06-13T11:20:27.530987+0000","last_clean":"2024-06-13T11:20:27.530987+0000","last_became_active":"2024-06-13T11:18:57.009186+0000","last_became_peered":"2024-06-13T11:18:57.009186+0000","last_unstale":"2024-06-13T11:20:27.530987+0000","last_undegraded":"2024-06-13T11:20:27.530987+0000","last_fullsized":"2024-06-13T11:20:27.530987+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:41:46.784749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"99'7","reported_seq":171,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:22:03.595066+0000","last_change":"2024-06-13T11:18:38.167060+0000","last_active":"2024-06-13T11:22:03.595066+0000","last_peered":"2024-06-13T11:22:03.595066+0000","last_clean":"2024-06-13T11:22:03.595066+0000","last_became_active":"2024-06-13T11:18:38.166704+0000","last_became_peered":"2024-06-13T11:18:38.166704+0000","last_unstale":"2024-06-13T11:22:03.595066+0000","last_undegraded":"2024-06-13T11:22:03.595066+0000","last_fullsized":"2024-06-13T11:22:03.595066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:30:51.754276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.262418+0000","last_change":"2024-06-13T11:18:42.915361+0000","last_active":"2024-06-13T11:21:55.262418+0000","last_peered":"2024-06-13T11:21:55.262418+0000","last_clean":"2024-06-13T11:21:55.262418+0000","last_became_active":"2024-06-13T11:18:42.914977+0000","last_became_peered":"2024-06-13T11:18:42.914977+0000","last_unstale":"2024-06-13T11:21:55.262418+0000","last_undegraded":"2024-06-13T11:21:55.262418+0000","last_fullsized":"2024-06-13T11:21:55.262418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:04:30.677548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.604440+0000","last_change":"2024-06-13T11:20:27.603953+0000","last_active":"2024-06-13T11:20:27.604440+0000","last_peered":"2024-06-13T11:20:27.604440+0000","last_clean":"2024-06-13T11:20:27.604440+0000","last_became_active":"2024-06-13T11:20:27.603306+0000","last_became_peered":"2024-06-13T11:20:27.603306+0000","last_unstale":"2024-06-13T11:20:27.604440+0000","last_undegraded":"2024-06-13T11:20:27.604440+0000","last_fullsized":"2024-06-13T11:20:27.604440+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:02:01.228984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.799664+0000","last_change":"2024-06-13T11:18:38.170126+0000","last_active":"2024-06-13T11:20:27.799664+0000","last_peered":"2024-06-13T11:20:27.799664+0000","last_clean":"2024-06-13T11:20:27.799664+0000","last_became_active":"2024-06-13T11:18:38.169736+0000","last_became_peered":"2024-06-13T11:18:38.169736+0000","last_unstale":"2024-06-13T11:20:27.799664+0000","last_undegraded":"2024-06-13T11:20:27.799664+0000","last_fullsized":"2024-06-13T11:20:27.799664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:07:22.778093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.275925+0000","last_change":"2024-06-13T11:18:42.929004+0000","last_active":"2024-06-13T11:21:55.275925+0000","last_peered":"2024-06-13T11:21:55.275925+0000","last_clean":"2024-06-13T11:21:55.275925+0000","last_became_active":"2024-06-13T11:18:42.928579+0000","last_became_peered":"2024-06-13T11:18:42.928579+0000","last_unstale":"2024-06-13T11:21:55.275925+0000","last_undegraded":"2024-06-13T11:21:55.275925+0000","last_fullsized":"2024-06-13T11:21:55.275925+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:31:15.703033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899599+0000","last_change":"2024-06-13T11:18:57.031059+0000","last_active":"2024-06-13T11:20:27.899599+0000","last_peered":"2024-06-13T11:20:27.899599+0000","last_clean":"2024-06-13T11:20:27.899599+0000","last_became_active":"2024-06-13T11:18:57.030723+0000","last_became_peered":"2024-06-13T11:18:57.030723+0000","last_unstale":"2024-06-13T11:20:27.899599+0000","last_undegraded":"2024-06-13T11:20:27.899599+0000","last_fullsized":"2024-06-13T11:20:27.899599+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:19:36.883790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.527702+0000","last_change":"2024-06-13T11:18:38.175189+0000","last_active":"2024-06-13T11:20:27.527702+0000","last_peered":"2024-06-13T11:20:27.527702+0000","last_clean":"2024-06-13T11:20:27.527702+0000","last_became_active":"2024-06-13T11:18:38.173817+0000","last_became_peered":"2024-06-13T11:18:38.173817+0000","last_unstale":"2024-06-13T11:20:27.527702+0000","last_undegraded":"2024-06-13T11:20:27.527702+0000","last_fullsized":"2024-06-13T11:20:27.527702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:02:18.422449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.276155+0000","last_change":"2024-06-13T11:18:42.920665+0000","last_active":"2024-06-13T11:21:55.276155+0000","last_peered":"2024-06-13T11:21:55.276155+0000","last_clean":"2024-06-13T11:21:55.276155+0000","last_became_active":"2024-06-13T11:18:42.919461+0000","last_became_peered":"2024-06-13T11:18:42.919461+0000","last_unstale":"2024-06-13T11:21:55.276155+0000","last_undegraded":"2024-06-13T11:21:55.276155+0000","last_fullsized":"2024-06-13T11:21:55.276155+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:56:23.042481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.114260+0000","last_change":"2024-06-13T11:18:57.025822+0000","last_active":"2024-06-13T11:20:28.114260+0000","last_peered":"2024-06-13T11:20:28.114260+0000","last_clean":"2024-06-13T11:20:28.114260+0000","last_became_active":"2024-06-13T11:18:57.025408+0000","last_became_peered":"2024-06-13T11:18:57.025408+0000","last_unstale":"2024-06-13T11:20:28.114260+0000","last_undegraded":"2024-06-13T11:20:28.114260+0000","last_fullsized":"2024-06-13T11:20:28.114260+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:39:28.295433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.601997+0000","last_change":"2024-06-13T11:18:38.168097+0000","last_active":"2024-06-13T11:20:27.601997+0000","last_peered":"2024-06-13T11:20:27.601997+0000","last_clean":"2024-06-13T11:20:27.601997+0000","last_became_active":"2024-06-13T11:18:38.167812+0000","last_became_peered":"2024-06-13T11:18:38.167812+0000","last_unstale":"2024-06-13T11:20:27.601997+0000","last_undegraded":"2024-06-13T11:20:27.601997+0000","last_fullsized":"2024-06-13T11:20:27.601997+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:24:20.247579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.276157+0000","last_change":"2024-06-13T11:18:42.932941+0000","last_active":"2024-06-13T11:21:55.276157+0000","last_peered":"2024-06-13T11:21:55.276157+0000","last_clean":"2024-06-13T11:21:55.276157+0000","last_became_active":"2024-06-13T11:18:42.931942+0000","last_became_peered":"2024-06-13T11:18:42.931942+0000","last_unstale":"2024-06-13T11:21:55.276157+0000","last_undegraded":"2024-06-13T11:21:55.276157+0000","last_fullsized":"2024-06-13T11:21:55.276157+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:12:38.625753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.902456+0000","last_change":"2024-06-13T11:18:57.026834+0000","last_active":"2024-06-13T11:20:27.902456+0000","last_peered":"2024-06-13T11:20:27.902456+0000","last_clean":"2024-06-13T11:20:27.902456+0000","last_became_active":"2024-06-13T11:18:57.026401+0000","last_became_peered":"2024-06-13T11:18:57.026401+0000","last_unstale":"2024-06-13T11:20:27.902456+0000","last_undegraded":"2024-06-13T11:20:27.902456+0000","last_fullsized":"2024-06-13T11:20:27.902456+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:11:19.993946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"99'4","reported_seq":166,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:22:05.597300+0000","last_change":"2024-06-13T11:18:38.172648+0000","last_active":"2024-06-13T11:22:05.597300+0000","last_peered":"2024-06-13T11:22:05.597300+0000","last_clean":"2024-06-13T11:22:05.597300+0000","last_became_active":"2024-06-13T11:18:38.172311+0000","last_became_peered":"2024-06-13T11:18:38.172311+0000","last_unstale":"2024-06-13T11:22:05.597300+0000","last_undegraded":"2024-06-13T11:22:05.597300+0000","last_fullsized":"2024-06-13T11:22:05.597300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:59:10.620378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.267109+0000","last_change":"2024-06-13T11:18:42.920352+0000","last_active":"2024-06-13T11:21:55.267109+0000","last_peered":"2024-06-13T11:21:55.267109+0000","last_clean":"2024-06-13T11:21:55.267109+0000","last_became_active":"2024-06-13T11:18:42.919969+0000","last_became_peered":"2024-06-13T11:18:42.919969+0000","last_unstale":"2024-06-13T11:21:55.267109+0000","last_undegraded":"2024-06-13T11:21:55.267109+0000","last_fullsized":"2024-06-13T11:21:55.267109+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:10:59.832735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.766483+0000","last_change":"2024-06-13T11:18:57.034774+0000","last_active":"2024-06-13T11:20:27.766483+0000","last_peered":"2024-06-13T11:20:27.766483+0000","last_clean":"2024-06-13T11:20:27.766483+0000","last_became_active":"2024-06-13T11:18:57.031812+0000","last_became_peered":"2024-06-13T11:18:57.031812+0000","last_unstale":"2024-06-13T11:20:27.766483+0000","last_undegraded":"2024-06-13T11:20:27.766483+0000","last_fullsized":"2024-06-13T11:20:27.766483+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:26.195958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526015+0000","last_change":"2024-06-13T11:18:38.168169+0000","last_active":"2024-06-13T11:20:27.526015+0000","last_peered":"2024-06-13T11:20:27.526015+0000","last_clean":"2024-06-13T11:20:27.526015+0000","last_became_active":"2024-06-13T11:18:38.167791+0000","last_became_peered":"2024-06-13T11:18:38.167791+0000","last_unstale":"2024-06-13T11:20:27.526015+0000","last_undegraded":"2024-06-13T11:20:27.526015+0000","last_fullsized":"2024-06-13T11:20:27.526015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:04.879468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"99'9","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.278323+0000","last_change":"2024-06-13T11:19:27.077888+0000","last_active":"2024-06-13T11:21:55.278323+0000","last_peered":"2024-06-13T11:21:55.278323+0000","last_clean":"2024-06-13T11:21:55.278323+0000","last_became_active":"2024-06-13T11:19:27.075904+0000","last_became_peered":"2024-06-13T11:19:27.075904+0000","last_unstale":"2024-06-13T11:21:55.278323+0000","last_undegraded":"2024-06-13T11:21:55.278323+0000","last_fullsized":"2024-06-13T11:21:55.278323+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:59.920163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529116+0000","last_change":"2024-06-13T11:19:27.073568+0000","last_active":"2024-06-13T11:20:27.529116+0000","last_peered":"2024-06-13T11:20:27.529116+0000","last_clean":"2024-06-13T11:20:27.529116+0000","last_became_active":"2024-06-13T11:19:27.072954+0000","last_became_peered":"2024-06-13T11:19:27.072954+0000","last_unstale":"2024-06-13T11:20:27.529116+0000","last_undegraded":"2024-06-13T11:20:27.529116+0000","last_fullsized":"2024-06-13T11:20:27.529116+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:10:25.492093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'4","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602788+0000","last_change":"2024-06-13T11:18:38.482021+0000","last_active":"2024-06-13T11:20:27.602788+0000","last_peered":"2024-06-13T11:20:27.602788+0000","last_clean":"2024-06-13T11:20:27.602788+0000","last_became_active":"2024-06-13T11:18:38.481574+0000","last_became_peered":"2024-06-13T11:18:38.481574+0000","last_unstale":"2024-06-13T11:20:27.602788+0000","last_undegraded":"2024-06-13T11:20:27.602788+0000","last_fullsized":"2024-06-13T11:20:27.602788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:50:54.297559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"99'11","reported_seq":56,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.275646+0000","last_change":"2024-06-13T11:19:27.072380+0000","last_active":"2024-06-13T11:21:55.275646+0000","last_peered":"2024-06-13T11:21:55.275646+0000","last_clean":"2024-06-13T11:21:55.275646+0000","last_became_active":"2024-06-13T11:19:27.072027+0000","last_became_peered":"2024-06-13T11:19:27.072027+0000","last_unstale":"2024-06-13T11:21:55.275646+0000","last_undegraded":"2024-06-13T11:21:55.275646+0000","last_fullsized":"2024-06-13T11:21:55.275646+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:37:10.455890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.766951+0000","last_change":"2024-06-13T11:18:57.028370+0000","last_active":"2024-06-13T11:20:27.766951+0000","last_peered":"2024-06-13T11:20:27.766951+0000","last_clean":"2024-06-13T11:20:27.766951+0000","last_became_active":"2024-06-13T11:18:57.023478+0000","last_became_peered":"2024-06-13T11:18:57.023478+0000","last_unstale":"2024-06-13T11:20:27.766951+0000","last_undegraded":"2024-06-13T11:20:27.766951+0000","last_fullsized":"2024-06-13T11:20:27.766951+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:25:01.237698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"99'37","reported_seq":326,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:22:06.599026+0000","last_change":"2024-06-13T11:18:38.169179+0000","last_active":"2024-06-13T11:22:06.599026+0000","last_peered":"2024-06-13T11:22:06.599026+0000","last_clean":"2024-06-13T11:22:06.599026+0000","last_became_active":"2024-06-13T11:18:38.168775+0000","last_became_peered":"2024-06-13T11:18:38.168775+0000","last_unstale":"2024-06-13T11:22:06.599026+0000","last_undegraded":"2024-06-13T11:22:06.599026+0000","last_fullsized":"2024-06-13T11:22:06.599026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:53:39.290755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63798,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":244,"num_read_kb":184,"num_write":38,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.252170+0000","last_change":"2024-06-13T11:18:42.903744+0000","last_active":"2024-06-13T11:21:55.252170+0000","last_peered":"2024-06-13T11:21:55.252170+0000","last_clean":"2024-06-13T11:21:55.252170+0000","last_became_active":"2024-06-13T11:18:42.903410+0000","last_became_peered":"2024-06-13T11:18:42.903410+0000","last_unstale":"2024-06-13T11:21:55.252170+0000","last_undegraded":"2024-06-13T11:21:55.252170+0000","last_fullsized":"2024-06-13T11:21:55.252170+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:17:55.975517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.603296+0000","last_change":"2024-06-13T11:18:57.026052+0000","last_active":"2024-06-13T11:20:27.603296+0000","last_peered":"2024-06-13T11:20:27.603296+0000","last_clean":"2024-06-13T11:20:27.603296+0000","last_became_active":"2024-06-13T11:18:57.025677+0000","last_became_peered":"2024-06-13T11:18:57.025677+0000","last_unstale":"2024-06-13T11:20:27.603296+0000","last_undegraded":"2024-06-13T11:20:27.603296+0000","last_fullsized":"2024-06-13T11:20:27.603296+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:41.061675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'6","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.530995+0000","last_change":"2024-06-13T11:18:38.166672+0000","last_active":"2024-06-13T11:20:27.530995+0000","last_peered":"2024-06-13T11:20:27.530995+0000","last_clean":"2024-06-13T11:20:27.530995+0000","last_became_active":"2024-06-13T11:18:38.165923+0000","last_became_peered":"2024-06-13T11:18:38.165923+0000","last_unstale":"2024-06-13T11:20:27.530995+0000","last_undegraded":"2024-06-13T11:20:27.530995+0000","last_fullsized":"2024-06-13T11:20:27.530995+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:54:00.989462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.279563+0000","last_change":"2024-06-13T11:18:42.919280+0000","last_active":"2024-06-13T11:21:55.279563+0000","last_peered":"2024-06-13T11:21:55.279563+0000","last_clean":"2024-06-13T11:21:55.279563+0000","last_became_active":"2024-06-13T11:18:42.917421+0000","last_became_peered":"2024-06-13T11:18:42.917421+0000","last_unstale":"2024-06-13T11:21:55.279563+0000","last_undegraded":"2024-06-13T11:21:55.279563+0000","last_fullsized":"2024-06-13T11:21:55.279563+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:52:23.765290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899319+0000","last_change":"2024-06-13T11:18:57.031244+0000","last_active":"2024-06-13T11:20:27.899319+0000","last_peered":"2024-06-13T11:20:27.899319+0000","last_clean":"2024-06-13T11:20:27.899319+0000","last_became_active":"2024-06-13T11:18:57.030781+0000","last_became_peered":"2024-06-13T11:18:57.030781+0000","last_unstale":"2024-06-13T11:20:27.899319+0000","last_undegraded":"2024-06-13T11:20:27.899319+0000","last_fullsized":"2024-06-13T11:20:27.899319+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:19:51.722256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602575+0000","last_change":"2024-06-13T11:18:38.171060+0000","last_active":"2024-06-13T11:20:27.602575+0000","last_peered":"2024-06-13T11:20:27.602575+0000","last_clean":"2024-06-13T11:20:27.602575+0000","last_became_active":"2024-06-13T11:18:38.170682+0000","last_became_peered":"2024-06-13T11:18:38.170682+0000","last_unstale":"2024-06-13T11:20:27.602575+0000","last_undegraded":"2024-06-13T11:20:27.602575+0000","last_fullsized":"2024-06-13T11:20:27.602575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:05:53.157074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.279718+0000","last_change":"2024-06-13T11:18:42.902700+0000","last_active":"2024-06-13T11:21:55.279718+0000","last_peered":"2024-06-13T11:21:55.279718+0000","last_clean":"2024-06-13T11:21:55.279718+0000","last_became_active":"2024-06-13T11:18:42.902351+0000","last_became_peered":"2024-06-13T11:18:42.902351+0000","last_unstale":"2024-06-13T11:21:55.279718+0000","last_undegraded":"2024-06-13T11:21:55.279718+0000","last_fullsized":"2024-06-13T11:21:55.279718+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:55:16.769324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767300+0000","last_change":"2024-06-13T11:18:57.034840+0000","last_active":"2024-06-13T11:20:27.767300+0000","last_peered":"2024-06-13T11:20:27.767300+0000","last_clean":"2024-06-13T11:20:27.767300+0000","last_became_active":"2024-06-13T11:18:57.033552+0000","last_became_peered":"2024-06-13T11:18:57.033552+0000","last_unstale":"2024-06-13T11:20:27.767300+0000","last_undegraded":"2024-06-13T11:20:27.767300+0000","last_fullsized":"2024-06-13T11:20:27.767300+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:44:25.463043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"99'5","reported_seq":171,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:22:05.668315+0000","last_change":"2024-06-13T11:18:38.170644+0000","last_active":"2024-06-13T11:22:05.668315+0000","last_peered":"2024-06-13T11:22:05.668315+0000","last_clean":"2024-06-13T11:22:05.668315+0000","last_became_active":"2024-06-13T11:18:38.169986+0000","last_became_peered":"2024-06-13T11:18:38.169986+0000","last_unstale":"2024-06-13T11:22:05.668315+0000","last_undegraded":"2024-06-13T11:22:05.668315+0000","last_fullsized":"2024-06-13T11:22:05.668315+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:45:48.817898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.243447+0000","last_change":"2024-06-13T11:18:42.903465+0000","last_active":"2024-06-13T11:21:55.243447+0000","last_peered":"2024-06-13T11:21:55.243447+0000","last_clean":"2024-06-13T11:21:55.243447+0000","last_became_active":"2024-06-13T11:18:42.903001+0000","last_became_peered":"2024-06-13T11:18:42.903001+0000","last_unstale":"2024-06-13T11:21:55.243447+0000","last_undegraded":"2024-06-13T11:21:55.243447+0000","last_fullsized":"2024-06-13T11:21:55.243447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:25:24.331890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529375+0000","last_change":"2024-06-13T11:18:57.033966+0000","last_active":"2024-06-13T11:20:27.529375+0000","last_peered":"2024-06-13T11:20:27.529375+0000","last_clean":"2024-06-13T11:20:27.529375+0000","last_became_active":"2024-06-13T11:18:57.032448+0000","last_became_peered":"2024-06-13T11:18:57.032448+0000","last_unstale":"2024-06-13T11:20:27.529375+0000","last_undegraded":"2024-06-13T11:20:27.529375+0000","last_fullsized":"2024-06-13T11:20:27.529375+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:51:40.473020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'15","reported_seq":61,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525611+0000","last_change":"2024-06-13T11:18:38.483204+0000","last_active":"2024-06-13T11:20:27.525611+0000","last_peered":"2024-06-13T11:20:27.525611+0000","last_clean":"2024-06-13T11:20:27.525611+0000","last_became_active":"2024-06-13T11:18:38.482800+0000","last_became_peered":"2024-06-13T11:18:38.482800+0000","last_unstale":"2024-06-13T11:20:27.525611+0000","last_undegraded":"2024-06-13T11:20:27.525611+0000","last_fullsized":"2024-06-13T11:20:27.525611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:28:44.636201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.266630+0000","last_change":"2024-06-13T11:18:42.899944+0000","last_active":"2024-06-13T11:21:55.266630+0000","last_peered":"2024-06-13T11:21:55.266630+0000","last_clean":"2024-06-13T11:21:55.266630+0000","last_became_active":"2024-06-13T11:18:42.899551+0000","last_became_peered":"2024-06-13T11:18:42.899551+0000","last_unstale":"2024-06-13T11:21:55.266630+0000","last_undegraded":"2024-06-13T11:21:55.266630+0000","last_fullsized":"2024-06-13T11:21:55.266630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:18:21.109043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602168+0000","last_change":"2024-06-13T11:18:57.028817+0000","last_active":"2024-06-13T11:20:27.602168+0000","last_peered":"2024-06-13T11:20:27.602168+0000","last_clean":"2024-06-13T11:20:27.602168+0000","last_became_active":"2024-06-13T11:18:57.028433+0000","last_became_peered":"2024-06-13T11:18:57.028433+0000","last_unstale":"2024-06-13T11:20:27.602168+0000","last_undegraded":"2024-06-13T11:20:27.602168+0000","last_fullsized":"2024-06-13T11:20:27.602168+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:56:24.180096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526225+0000","last_change":"2024-06-13T11:18:38.165907+0000","last_active":"2024-06-13T11:20:27.526225+0000","last_peered":"2024-06-13T11:20:27.526225+0000","last_clean":"2024-06-13T11:20:27.526225+0000","last_became_active":"2024-06-13T11:18:38.165516+0000","last_became_peered":"2024-06-13T11:18:38.165516+0000","last_unstale":"2024-06-13T11:20:27.526225+0000","last_undegraded":"2024-06-13T11:20:27.526225+0000","last_fullsized":"2024-06-13T11:20:27.526225+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:51:15.774967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"99'5","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.256559+0000","last_change":"2024-06-13T11:19:27.004377+0000","last_active":"2024-06-13T11:21:55.256559+0000","last_peered":"2024-06-13T11:21:55.256559+0000","last_clean":"2024-06-13T11:21:55.256559+0000","last_became_active":"2024-06-13T11:19:27.003954+0000","last_became_peered":"2024-06-13T11:19:27.003954+0000","last_unstale":"2024-06-13T11:21:55.256559+0000","last_undegraded":"2024-06-13T11:21:55.256559+0000","last_fullsized":"2024-06-13T11:21:55.256559+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:53:25.967036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525662+0000","last_change":"2024-06-13T11:18:57.184912+0000","last_active":"2024-06-13T11:20:27.525662+0000","last_peered":"2024-06-13T11:20:27.525662+0000","last_clean":"2024-06-13T11:20:27.525662+0000","last_became_active":"2024-06-13T11:18:57.184442+0000","last_became_peered":"2024-06-13T11:18:57.184442+0000","last_unstale":"2024-06-13T11:20:27.525662+0000","last_undegraded":"2024-06-13T11:20:27.525662+0000","last_fullsized":"2024-06-13T11:20:27.525662+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:47:17.961086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767283+0000","last_change":"2024-06-13T11:18:38.484487+0000","last_active":"2024-06-13T11:20:27.767283+0000","last_peered":"2024-06-13T11:20:27.767283+0000","last_clean":"2024-06-13T11:20:27.767283+0000","last_became_active":"2024-06-13T11:18:38.483587+0000","last_became_peered":"2024-06-13T11:18:38.483587+0000","last_unstale":"2024-06-13T11:20:27.767283+0000","last_undegraded":"2024-06-13T11:20:27.767283+0000","last_fullsized":"2024-06-13T11:20:27.767283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:50:19.773340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.276032+0000","last_change":"2024-06-13T11:18:42.913275+0000","last_active":"2024-06-13T11:21:55.276032+0000","last_peered":"2024-06-13T11:21:55.276032+0000","last_clean":"2024-06-13T11:21:55.276032+0000","last_became_active":"2024-06-13T11:18:42.912880+0000","last_became_peered":"2024-06-13T11:18:42.912880+0000","last_unstale":"2024-06-13T11:21:55.276032+0000","last_undegraded":"2024-06-13T11:21:55.276032+0000","last_fullsized":"2024-06-13T11:21:55.276032+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:01:55.261976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528903+0000","last_change":"2024-06-13T11:18:57.027893+0000","last_active":"2024-06-13T11:20:27.528903+0000","last_peered":"2024-06-13T11:20:27.528903+0000","last_clean":"2024-06-13T11:20:27.528903+0000","last_became_active":"2024-06-13T11:18:57.025683+0000","last_became_peered":"2024-06-13T11:18:57.025683+0000","last_unstale":"2024-06-13T11:20:27.528903+0000","last_undegraded":"2024-06-13T11:20:27.528903+0000","last_fullsized":"2024-06-13T11:20:27.528903+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:25:59.348570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526081+0000","last_change":"2024-06-13T11:18:38.167932+0000","last_active":"2024-06-13T11:20:27.526081+0000","last_peered":"2024-06-13T11:20:27.526081+0000","last_clean":"2024-06-13T11:20:27.526081+0000","last_became_active":"2024-06-13T11:18:38.167520+0000","last_became_peered":"2024-06-13T11:18:38.167520+0000","last_unstale":"2024-06-13T11:20:27.526081+0000","last_undegraded":"2024-06-13T11:20:27.526081+0000","last_fullsized":"2024-06-13T11:20:27.526081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:00:04.537091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.254445+0000","last_change":"2024-06-13T11:18:42.923211+0000","last_active":"2024-06-13T11:21:55.254445+0000","last_peered":"2024-06-13T11:21:55.254445+0000","last_clean":"2024-06-13T11:21:55.254445+0000","last_became_active":"2024-06-13T11:18:42.922858+0000","last_became_peered":"2024-06-13T11:18:42.922858+0000","last_unstale":"2024-06-13T11:21:55.254445+0000","last_undegraded":"2024-06-13T11:21:55.254445+0000","last_fullsized":"2024-06-13T11:21:55.254445+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:56:18.163502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528851+0000","last_change":"2024-06-13T11:18:57.185071+0000","last_active":"2024-06-13T11:20:27.528851+0000","last_peered":"2024-06-13T11:20:27.528851+0000","last_clean":"2024-06-13T11:20:27.528851+0000","last_became_active":"2024-06-13T11:18:57.184526+0000","last_became_peered":"2024-06-13T11:18:57.184526+0000","last_unstale":"2024-06-13T11:20:27.528851+0000","last_undegraded":"2024-06-13T11:20:27.528851+0000","last_fullsized":"2024-06-13T11:20:27.528851+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:51:37.715832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.266829+0000","last_change":"2024-06-13T11:18:42.912483+0000","last_active":"2024-06-13T11:21:55.266829+0000","last_peered":"2024-06-13T11:21:55.266829+0000","last_clean":"2024-06-13T11:21:55.266829+0000","last_became_active":"2024-06-13T11:18:42.912117+0000","last_became_peered":"2024-06-13T11:18:42.912117+0000","last_unstale":"2024-06-13T11:21:55.266829+0000","last_undegraded":"2024-06-13T11:21:55.266829+0000","last_fullsized":"2024-06-13T11:21:55.266829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:23.769097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"99'5","reported_seq":165,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:22:03.662910+0000","last_change":"2024-06-13T11:18:38.483334+0000","last_active":"2024-06-13T11:22:03.662910+0000","last_peered":"2024-06-13T11:22:03.662910+0000","last_clean":"2024-06-13T11:22:03.662910+0000","last_became_active":"2024-06-13T11:18:38.482885+0000","last_became_peered":"2024-06-13T11:18:38.482885+0000","last_unstale":"2024-06-13T11:22:03.662910+0000","last_undegraded":"2024-06-13T11:22:03.662910+0000","last_fullsized":"2024-06-13T11:22:03.662910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:55:19.986526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"97'1","reported_seq":30,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525950+0000","last_change":"2024-06-13T11:18:57.016960+0000","last_active":"2024-06-13T11:20:27.525950+0000","last_peered":"2024-06-13T11:20:27.525950+0000","last_clean":"2024-06-13T11:20:27.525950+0000","last_became_active":"2024-06-13T11:18:57.016490+0000","last_became_peered":"2024-06-13T11:18:57.016490+0000","last_unstale":"2024-06-13T11:20:27.525950+0000","last_undegraded":"2024-06-13T11:20:27.525950+0000","last_fullsized":"2024-06-13T11:20:27.525950+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:40:19.796594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.278617+0000","last_change":"2024-06-13T11:18:42.921581+0000","last_active":"2024-06-13T11:21:55.278617+0000","last_peered":"2024-06-13T11:21:55.278617+0000","last_clean":"2024-06-13T11:21:55.278617+0000","last_became_active":"2024-06-13T11:18:42.917820+0000","last_became_peered":"2024-06-13T11:18:42.917820+0000","last_unstale":"2024-06-13T11:21:55.278617+0000","last_undegraded":"2024-06-13T11:21:55.278617+0000","last_fullsized":"2024-06-13T11:21:55.278617+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:59:28.460363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'3","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528941+0000","last_change":"2024-06-13T11:18:38.168111+0000","last_active":"2024-06-13T11:20:27.528941+0000","last_peered":"2024-06-13T11:20:27.528941+0000","last_clean":"2024-06-13T11:20:27.528941+0000","last_became_active":"2024-06-13T11:18:38.167732+0000","last_became_peered":"2024-06-13T11:18:38.167732+0000","last_unstale":"2024-06-13T11:20:27.528941+0000","last_undegraded":"2024-06-13T11:20:27.528941+0000","last_fullsized":"2024-06-13T11:20:27.528941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:36:55.993553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":378,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525505+0000","last_change":"2024-06-13T11:17:06.317849+0000","last_active":"2024-06-13T11:20:27.525505+0000","last_peered":"2024-06-13T11:20:27.525505+0000","last_clean":"2024-06-13T11:20:27.525505+0000","last_became_active":"2024-06-13T11:17:06.317293+0000","last_became_peered":"2024-06-13T11:17:06.317293+0000","last_unstale":"2024-06-13T11:20:27.525505+0000","last_undegraded":"2024-06-13T11:20:27.525505+0000","last_fullsized":"2024-06-13T11:20:27.525505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:13:14.002581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:13:14.002581+0000","last_clean_scrub_stamp":"2024-06-13T11:13:14.002581+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:54:32.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602868+0000","last_change":"2024-06-13T11:18:57.185880+0000","last_active":"2024-06-13T11:20:27.602868+0000","last_peered":"2024-06-13T11:20:27.602868+0000","last_clean":"2024-06-13T11:20:27.602868+0000","last_became_active":"2024-06-13T11:18:57.185140+0000","last_became_peered":"2024-06-13T11:18:57.185140+0000","last_unstale":"2024-06-13T11:20:27.602868+0000","last_undegraded":"2024-06-13T11:20:27.602868+0000","last_fullsized":"2024-06-13T11:20:27.602868+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:43:40.195809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"99'5","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.273900+0000","last_change":"2024-06-13T11:19:27.006408+0000","last_active":"2024-06-13T11:21:55.273900+0000","last_peered":"2024-06-13T11:21:55.273900+0000","last_clean":"2024-06-13T11:21:55.273900+0000","last_became_active":"2024-06-13T11:19:27.005525+0000","last_became_peered":"2024-06-13T11:19:27.005525+0000","last_unstale":"2024-06-13T11:21:55.273900+0000","last_undegraded":"2024-06-13T11:21:55.273900+0000","last_fullsized":"2024-06-13T11:21:55.273900+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:09:39.891543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525753+0000","last_change":"2024-06-13T11:18:38.171089+0000","last_active":"2024-06-13T11:20:27.525753+0000","last_peered":"2024-06-13T11:20:27.525753+0000","last_clean":"2024-06-13T11:20:27.525753+0000","last_became_active":"2024-06-13T11:18:38.170769+0000","last_became_peered":"2024-06-13T11:18:38.170769+0000","last_unstale":"2024-06-13T11:20:27.525753+0000","last_undegraded":"2024-06-13T11:20:27.525753+0000","last_fullsized":"2024-06-13T11:20:27.525753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:07:46.355159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899277+0000","last_change":"2024-06-13T11:18:57.015609+0000","last_active":"2024-06-13T11:20:27.899277+0000","last_peered":"2024-06-13T11:20:27.899277+0000","last_clean":"2024-06-13T11:20:27.899277+0000","last_became_active":"2024-06-13T11:18:57.015164+0000","last_became_peered":"2024-06-13T11:18:57.015164+0000","last_unstale":"2024-06-13T11:20:27.899277+0000","last_undegraded":"2024-06-13T11:20:27.899277+0000","last_fullsized":"2024-06-13T11:20:27.899277+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:32:15.725778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'1","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526065+0000","last_change":"2024-06-13T11:18:38.483215+0000","last_active":"2024-06-13T11:20:27.526065+0000","last_peered":"2024-06-13T11:20:27.526065+0000","last_clean":"2024-06-13T11:20:27.526065+0000","last_became_active":"2024-06-13T11:18:38.482789+0000","last_became_peered":"2024-06-13T11:18:38.482789+0000","last_unstale":"2024-06-13T11:20:27.526065+0000","last_undegraded":"2024-06-13T11:20:27.526065+0000","last_fullsized":"2024-06-13T11:20:27.526065+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:01:58.020310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.275670+0000","last_change":"2024-06-13T11:18:42.914846+0000","last_active":"2024-06-13T11:21:55.275670+0000","last_peered":"2024-06-13T11:21:55.275670+0000","last_clean":"2024-06-13T11:21:55.275670+0000","last_became_active":"2024-06-13T11:18:42.912614+0000","last_became_peered":"2024-06-13T11:18:42.912614+0000","last_unstale":"2024-06-13T11:21:55.275670+0000","last_undegraded":"2024-06-13T11:21:55.275670+0000","last_fullsized":"2024-06-13T11:21:55.275670+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:00:13.066079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.902817+0000","last_change":"2024-06-13T11:18:57.185117+0000","last_active":"2024-06-13T11:20:27.902817+0000","last_peered":"2024-06-13T11:20:27.902817+0000","last_clean":"2024-06-13T11:20:27.902817+0000","last_became_active":"2024-06-13T11:18:57.184498+0000","last_became_peered":"2024-06-13T11:18:57.184498+0000","last_unstale":"2024-06-13T11:20:27.902817+0000","last_undegraded":"2024-06-13T11:20:27.902817+0000","last_fullsized":"2024-06-13T11:20:27.902817+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:04:28.800984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"99'12","reported_seq":57,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:51.924646+0000","last_change":"2024-06-13T11:18:38.176918+0000","last_active":"2024-06-13T11:20:51.924646+0000","last_peered":"2024-06-13T11:20:51.924646+0000","last_clean":"2024-06-13T11:20:51.924646+0000","last_became_active":"2024-06-13T11:18:38.176236+0000","last_became_peered":"2024-06-13T11:18:38.176236+0000","last_unstale":"2024-06-13T11:20:51.924646+0000","last_undegraded":"2024-06-13T11:20:51.924646+0000","last_fullsized":"2024-06-13T11:20:51.924646+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:10:20.684891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.274269+0000","last_change":"2024-06-13T11:18:42.920930+0000","last_active":"2024-06-13T11:21:55.274269+0000","last_peered":"2024-06-13T11:21:55.274269+0000","last_clean":"2024-06-13T11:21:55.274269+0000","last_became_active":"2024-06-13T11:18:42.915838+0000","last_became_peered":"2024-06-13T11:18:42.915838+0000","last_unstale":"2024-06-13T11:21:55.274269+0000","last_undegraded":"2024-06-13T11:21:55.274269+0000","last_fullsized":"2024-06-13T11:21:55.274269+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:07:43.483317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.530754+0000","last_change":"2024-06-13T11:18:57.009043+0000","last_active":"2024-06-13T11:20:27.530754+0000","last_peered":"2024-06-13T11:20:27.530754+0000","last_clean":"2024-06-13T11:20:27.530754+0000","last_became_active":"2024-06-13T11:18:57.008533+0000","last_became_peered":"2024-06-13T11:18:57.008533+0000","last_unstale":"2024-06-13T11:20:27.530754+0000","last_undegraded":"2024-06-13T11:20:27.530754+0000","last_fullsized":"2024-06-13T11:20:27.530754+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:30:29.614810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529247+0000","last_change":"2024-06-13T11:18:38.523042+0000","last_active":"2024-06-13T11:20:27.529247+0000","last_peered":"2024-06-13T11:20:27.529247+0000","last_clean":"2024-06-13T11:20:27.529247+0000","last_became_active":"2024-06-13T11:18:38.522673+0000","last_became_peered":"2024-06-13T11:18:38.522673+0000","last_unstale":"2024-06-13T11:20:27.529247+0000","last_undegraded":"2024-06-13T11:20:27.529247+0000","last_fullsized":"2024-06-13T11:20:27.529247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:25:50.725281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.282787+0000","last_change":"2024-06-13T11:18:42.934090+0000","last_active":"2024-06-13T11:21:55.282787+0000","last_peered":"2024-06-13T11:21:55.282787+0000","last_clean":"2024-06-13T11:21:55.282787+0000","last_became_active":"2024-06-13T11:18:42.933680+0000","last_became_peered":"2024-06-13T11:18:42.933680+0000","last_unstale":"2024-06-13T11:21:55.282787+0000","last_undegraded":"2024-06-13T11:21:55.282787+0000","last_fullsized":"2024-06-13T11:21:55.282787+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:39:30.214272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529069+0000","last_change":"2024-06-13T11:18:57.185186+0000","last_active":"2024-06-13T11:20:27.529069+0000","last_peered":"2024-06-13T11:20:27.529069+0000","last_clean":"2024-06-13T11:20:27.529069+0000","last_became_active":"2024-06-13T11:18:57.184448+0000","last_became_peered":"2024-06-13T11:18:57.184448+0000","last_unstale":"2024-06-13T11:20:27.529069+0000","last_undegraded":"2024-06-13T11:20:27.529069+0000","last_fullsized":"2024-06-13T11:20:27.529069+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:18:32.514993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":53,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.898853+0000","last_change":"2024-06-13T11:19:26.999451+0000","last_active":"2024-06-13T11:20:27.898853+0000","last_peered":"2024-06-13T11:20:27.898853+0000","last_clean":"2024-06-13T11:20:27.898853+0000","last_became_active":"2024-06-13T11:19:26.999153+0000","last_became_peered":"2024-06-13T11:19:26.999153+0000","last_unstale":"2024-06-13T11:20:27.898853+0000","last_undegraded":"2024-06-13T11:20:27.898853+0000","last_fullsized":"2024-06-13T11:20:27.898853+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:42:34.755569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.222871+0000","last_change":"2024-06-13T11:18:42.903741+0000","last_active":"2024-06-13T11:21:55.222871+0000","last_peered":"2024-06-13T11:21:55.222871+0000","last_clean":"2024-06-13T11:21:55.222871+0000","last_became_active":"2024-06-13T11:18:42.903351+0000","last_became_peered":"2024-06-13T11:18:42.903351+0000","last_unstale":"2024-06-13T11:21:55.222871+0000","last_undegraded":"2024-06-13T11:21:55.222871+0000","last_fullsized":"2024-06-13T11:21:55.222871+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:47:21.206540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767485+0000","last_change":"2024-06-13T11:18:57.035149+0000","last_active":"2024-06-13T11:20:27.767485+0000","last_peered":"2024-06-13T11:20:27.767485+0000","last_clean":"2024-06-13T11:20:27.767485+0000","last_became_active":"2024-06-13T11:18:57.033208+0000","last_became_peered":"2024-06-13T11:18:57.033208+0000","last_unstale":"2024-06-13T11:20:27.767485+0000","last_undegraded":"2024-06-13T11:20:27.767485+0000","last_fullsized":"2024-06-13T11:20:27.767485+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:19:01.353814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.902458+0000","last_change":"2024-06-13T11:18:38.170464+0000","last_active":"2024-06-13T11:20:27.902458+0000","last_peered":"2024-06-13T11:20:27.902458+0000","last_clean":"2024-06-13T11:20:27.902458+0000","last_became_active":"2024-06-13T11:18:38.169945+0000","last_became_peered":"2024-06-13T11:18:38.169945+0000","last_unstale":"2024-06-13T11:20:27.902458+0000","last_undegraded":"2024-06-13T11:20:27.902458+0000","last_fullsized":"2024-06-13T11:20:27.902458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:53:20.112176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.280073+0000","last_change":"2024-06-13T11:18:42.925391+0000","last_active":"2024-06-13T11:21:55.280073+0000","last_peered":"2024-06-13T11:21:55.280073+0000","last_clean":"2024-06-13T11:21:55.280073+0000","last_became_active":"2024-06-13T11:18:42.924900+0000","last_became_peered":"2024-06-13T11:18:42.924900+0000","last_unstale":"2024-06-13T11:21:55.280073+0000","last_undegraded":"2024-06-13T11:21:55.280073+0000","last_fullsized":"2024-06-13T11:21:55.280073+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:10.954502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"99'1","reported_seq":30,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:30.009666+0000","last_change":"2024-06-13T11:18:57.029448+0000","last_active":"2024-06-13T11:20:30.009666+0000","last_peered":"2024-06-13T11:20:30.009666+0000","last_clean":"2024-06-13T11:20:30.009666+0000","last_became_active":"2024-06-13T11:18:57.028918+0000","last_became_peered":"2024-06-13T11:18:57.028918+0000","last_unstale":"2024-06-13T11:20:30.009666+0000","last_undegraded":"2024-06-13T11:20:30.009666+0000","last_fullsized":"2024-06-13T11:20:30.009666+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:53:06.206458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"97'1","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899218+0000","last_change":"2024-06-13T11:19:27.078724+0000","last_active":"2024-06-13T11:20:27.899218+0000","last_peered":"2024-06-13T11:20:27.899218+0000","last_clean":"2024-06-13T11:20:27.899218+0000","last_became_active":"2024-06-13T11:19:27.078329+0000","last_became_peered":"2024-06-13T11:19:27.078329+0000","last_unstale":"2024-06-13T11:20:27.899218+0000","last_undegraded":"2024-06-13T11:20:27.899218+0000","last_fullsized":"2024-06-13T11:20:27.899218+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:25:38.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.282654+0000","last_change":"2024-06-13T11:18:42.930769+0000","last_active":"2024-06-13T11:21:55.282654+0000","last_peered":"2024-06-13T11:21:55.282654+0000","last_clean":"2024-06-13T11:21:55.282654+0000","last_became_active":"2024-06-13T11:18:42.928727+0000","last_became_peered":"2024-06-13T11:18:42.928727+0000","last_unstale":"2024-06-13T11:21:55.282654+0000","last_undegraded":"2024-06-13T11:21:55.282654+0000","last_fullsized":"2024-06-13T11:21:55.282654+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:14:55.202237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529447+0000","last_change":"2024-06-13T11:18:57.185071+0000","last_active":"2024-06-13T11:20:27.529447+0000","last_peered":"2024-06-13T11:20:27.529447+0000","last_clean":"2024-06-13T11:20:27.529447+0000","last_became_active":"2024-06-13T11:18:57.184534+0000","last_became_peered":"2024-06-13T11:18:57.184534+0000","last_unstale":"2024-06-13T11:20:27.529447+0000","last_undegraded":"2024-06-13T11:20:27.529447+0000","last_fullsized":"2024-06-13T11:20:27.529447+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:55:11.146525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525732+0000","last_change":"2024-06-13T11:18:38.167734+0000","last_active":"2024-06-13T11:20:27.525732+0000","last_peered":"2024-06-13T11:20:27.525732+0000","last_clean":"2024-06-13T11:20:27.525732+0000","last_became_active":"2024-06-13T11:18:38.167345+0000","last_became_peered":"2024-06-13T11:18:38.167345+0000","last_unstale":"2024-06-13T11:20:27.525732+0000","last_undegraded":"2024-06-13T11:20:27.525732+0000","last_fullsized":"2024-06-13T11:20:27.525732+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:55:43.155928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.276715+0000","last_change":"2024-06-13T11:18:42.900884+0000","last_active":"2024-06-13T11:21:55.276715+0000","last_peered":"2024-06-13T11:21:55.276715+0000","last_clean":"2024-06-13T11:21:55.276715+0000","last_became_active":"2024-06-13T11:18:42.900562+0000","last_became_peered":"2024-06-13T11:18:42.900562+0000","last_unstale":"2024-06-13T11:21:55.276715+0000","last_undegraded":"2024-06-13T11:21:55.276715+0000","last_fullsized":"2024-06-13T11:21:55.276715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:38:59.480693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.898930+0000","last_change":"2024-06-13T11:18:57.015496+0000","last_active":"2024-06-13T11:20:27.898930+0000","last_peered":"2024-06-13T11:20:27.898930+0000","last_clean":"2024-06-13T11:20:27.898930+0000","last_became_active":"2024-06-13T11:18:57.015079+0000","last_became_peered":"2024-06-13T11:18:57.015079+0000","last_unstale":"2024-06-13T11:20:27.898930+0000","last_undegraded":"2024-06-13T11:20:27.898930+0000","last_fullsized":"2024-06-13T11:20:27.898930+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:31:40.130018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"97'3","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.531565+0000","last_change":"2024-06-13T11:18:38.523097+0000","last_active":"2024-06-13T11:20:27.531565+0000","last_peered":"2024-06-13T11:20:27.531565+0000","last_clean":"2024-06-13T11:20:27.531565+0000","last_became_active":"2024-06-13T11:18:38.522638+0000","last_became_peered":"2024-06-13T11:18:38.522638+0000","last_unstale":"2024-06-13T11:20:27.531565+0000","last_undegraded":"2024-06-13T11:20:27.531565+0000","last_fullsized":"2024-06-13T11:20:27.531565+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:35:36.843246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.262417+0000","last_change":"2024-06-13T11:18:42.899281+0000","last_active":"2024-06-13T11:21:55.262417+0000","last_peered":"2024-06-13T11:21:55.262417+0000","last_clean":"2024-06-13T11:21:55.262417+0000","last_became_active":"2024-06-13T11:18:42.898924+0000","last_became_peered":"2024-06-13T11:18:42.898924+0000","last_unstale":"2024-06-13T11:21:55.262417+0000","last_undegraded":"2024-06-13T11:21:55.262417+0000","last_fullsized":"2024-06-13T11:21:55.262417+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:18:10.324425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.112859+0000","last_change":"2024-06-13T11:18:57.037070+0000","last_active":"2024-06-13T11:20:28.112859+0000","last_peered":"2024-06-13T11:20:28.112859+0000","last_clean":"2024-06-13T11:20:28.112859+0000","last_became_active":"2024-06-13T11:18:57.036632+0000","last_became_peered":"2024-06-13T11:18:57.036632+0000","last_unstale":"2024-06-13T11:20:28.112859+0000","last_undegraded":"2024-06-13T11:20:28.112859+0000","last_fullsized":"2024-06-13T11:20:28.112859+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:19:35.433902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'1","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.603183+0000","last_change":"2024-06-13T11:18:38.170790+0000","last_active":"2024-06-13T11:20:27.603183+0000","last_peered":"2024-06-13T11:20:27.603183+0000","last_clean":"2024-06-13T11:20:27.603183+0000","last_became_active":"2024-06-13T11:18:38.170260+0000","last_became_peered":"2024-06-13T11:18:38.170260+0000","last_unstale":"2024-06-13T11:20:27.603183+0000","last_undegraded":"2024-06-13T11:20:27.603183+0000","last_fullsized":"2024-06-13T11:20:27.603183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:11:44.070550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.272574+0000","last_change":"2024-06-13T11:18:42.906969+0000","last_active":"2024-06-13T11:21:55.272574+0000","last_peered":"2024-06-13T11:21:55.272574+0000","last_clean":"2024-06-13T11:21:55.272574+0000","last_became_active":"2024-06-13T11:18:42.906657+0000","last_became_peered":"2024-06-13T11:18:42.906657+0000","last_unstale":"2024-06-13T11:21:55.272574+0000","last_undegraded":"2024-06-13T11:21:55.272574+0000","last_fullsized":"2024-06-13T11:21:55.272574+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:30:36.414377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602012+0000","last_change":"2024-06-13T11:18:57.007226+0000","last_active":"2024-06-13T11:20:27.602012+0000","last_peered":"2024-06-13T11:20:27.602012+0000","last_clean":"2024-06-13T11:20:27.602012+0000","last_became_active":"2024-06-13T11:18:57.006803+0000","last_became_peered":"2024-06-13T11:18:57.006803+0000","last_unstale":"2024-06-13T11:20:27.602012+0000","last_undegraded":"2024-06-13T11:20:27.602012+0000","last_fullsized":"2024-06-13T11:20:27.602012+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:08:28.913145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529634+0000","last_change":"2024-06-13T11:18:38.173327+0000","last_active":"2024-06-13T11:20:27.529634+0000","last_peered":"2024-06-13T11:20:27.529634+0000","last_clean":"2024-06-13T11:20:27.529634+0000","last_became_active":"2024-06-13T11:18:38.172786+0000","last_became_peered":"2024-06-13T11:18:38.172786+0000","last_unstale":"2024-06-13T11:20:27.529634+0000","last_undegraded":"2024-06-13T11:20:27.529634+0000","last_fullsized":"2024-06-13T11:20:27.529634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:40:30.330272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.253488+0000","last_change":"2024-06-13T11:18:42.899816+0000","last_active":"2024-06-13T11:21:55.253488+0000","last_peered":"2024-06-13T11:21:55.253488+0000","last_clean":"2024-06-13T11:21:55.253488+0000","last_became_active":"2024-06-13T11:18:42.899495+0000","last_became_peered":"2024-06-13T11:18:42.899495+0000","last_unstale":"2024-06-13T11:21:55.253488+0000","last_undegraded":"2024-06-13T11:21:55.253488+0000","last_fullsized":"2024-06-13T11:21:55.253488+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:16:08.303616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.266264+0000","last_change":"2024-06-13T11:18:42.909944+0000","last_active":"2024-06-13T11:21:55.266264+0000","last_peered":"2024-06-13T11:21:55.266264+0000","last_clean":"2024-06-13T11:21:55.266264+0000","last_became_active":"2024-06-13T11:18:42.909557+0000","last_became_peered":"2024-06-13T11:18:42.909557+0000","last_unstale":"2024-06-13T11:21:55.266264+0000","last_undegraded":"2024-06-13T11:21:55.266264+0000","last_fullsized":"2024-06-13T11:21:55.266264+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:22:07.093462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"99'12","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.256265+0000","last_change":"2024-06-13T11:18:42.912462+0000","last_active":"2024-06-13T11:21:55.256265+0000","last_peered":"2024-06-13T11:21:55.256265+0000","last_clean":"2024-06-13T11:21:55.256265+0000","last_became_active":"2024-06-13T11:18:42.912110+0000","last_became_peered":"2024-06-13T11:18:42.912110+0000","last_unstale":"2024-06-13T11:21:55.256265+0000","last_undegraded":"2024-06-13T11:21:55.256265+0000","last_fullsized":"2024-06-13T11:21:55.256265+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:11:33.123305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.281346+0000","last_change":"2024-06-13T11:18:42.924224+0000","last_active":"2024-06-13T11:21:55.281346+0000","last_peered":"2024-06-13T11:21:55.281346+0000","last_clean":"2024-06-13T11:21:55.281346+0000","last_became_active":"2024-06-13T11:18:42.923858+0000","last_became_peered":"2024-06-13T11:18:42.923858+0000","last_unstale":"2024-06-13T11:21:55.281346+0000","last_undegraded":"2024-06-13T11:21:55.281346+0000","last_fullsized":"2024-06-13T11:21:55.281346+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:36:11.602930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.282509+0000","last_change":"2024-06-13T11:18:42.921160+0000","last_active":"2024-06-13T11:21:55.282509+0000","last_peered":"2024-06-13T11:21:55.282509+0000","last_clean":"2024-06-13T11:21:55.282509+0000","last_became_active":"2024-06-13T11:18:42.920704+0000","last_became_peered":"2024-06-13T11:18:42.920704+0000","last_unstale":"2024-06-13T11:21:55.282509+0000","last_undegraded":"2024-06-13T11:21:55.282509+0000","last_fullsized":"2024-06-13T11:21:55.282509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:07:17.023390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.284434+0000","last_change":"2024-06-13T11:18:42.923637+0000","last_active":"2024-06-13T11:21:55.284434+0000","last_peered":"2024-06-13T11:21:55.284434+0000","last_clean":"2024-06-13T11:21:55.284434+0000","last_became_active":"2024-06-13T11:18:42.923234+0000","last_became_peered":"2024-06-13T11:18:42.923234+0000","last_unstale":"2024-06-13T11:21:55.284434+0000","last_undegraded":"2024-06-13T11:21:55.284434+0000","last_fullsized":"2024-06-13T11:21:55.284434+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:51:19.676747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.259989+0000","last_change":"2024-06-13T11:18:42.910300+0000","last_active":"2024-06-13T11:21:55.259989+0000","last_peered":"2024-06-13T11:21:55.259989+0000","last_clean":"2024-06-13T11:21:55.259989+0000","last_became_active":"2024-06-13T11:18:42.909937+0000","last_became_peered":"2024-06-13T11:18:42.909937+0000","last_unstale":"2024-06-13T11:21:55.259989+0000","last_undegraded":"2024-06-13T11:21:55.259989+0000","last_fullsized":"2024-06-13T11:21:55.259989+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:24:51.407238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.264871+0000","last_change":"2024-06-13T11:18:42.907066+0000","last_active":"2024-06-13T11:21:55.264871+0000","last_peered":"2024-06-13T11:21:55.264871+0000","last_clean":"2024-06-13T11:21:55.264871+0000","last_became_active":"2024-06-13T11:18:42.906582+0000","last_became_peered":"2024-06-13T11:18:42.906582+0000","last_unstale":"2024-06-13T11:21:55.264871+0000","last_undegraded":"2024-06-13T11:21:55.264871+0000","last_fullsized":"2024-06-13T11:21:55.264871+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:40:02.549931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.272944+0000","last_change":"2024-06-13T11:18:42.910290+0000","last_active":"2024-06-13T11:21:55.272944+0000","last_peered":"2024-06-13T11:21:55.272944+0000","last_clean":"2024-06-13T11:21:55.272944+0000","last_became_active":"2024-06-13T11:18:42.909772+0000","last_became_peered":"2024-06-13T11:18:42.909772+0000","last_unstale":"2024-06-13T11:21:55.272944+0000","last_undegraded":"2024-06-13T11:21:55.272944+0000","last_fullsized":"2024-06-13T11:21:55.272944+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:05:56.008087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.274865+0000","last_change":"2024-06-13T11:18:42.928792+0000","last_active":"2024-06-13T11:21:55.274865+0000","last_peered":"2024-06-13T11:21:55.274865+0000","last_clean":"2024-06-13T11:21:55.274865+0000","last_became_active":"2024-06-13T11:18:42.928464+0000","last_became_peered":"2024-06-13T11:18:42.928464+0000","last_unstale":"2024-06-13T11:21:55.274865+0000","last_undegraded":"2024-06-13T11:21:55.274865+0000","last_fullsized":"2024-06-13T11:21:55.274865+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:01:58.686124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.273212+0000","last_change":"2024-06-13T11:18:42.920719+0000","last_active":"2024-06-13T11:21:55.273212+0000","last_peered":"2024-06-13T11:21:55.273212+0000","last_clean":"2024-06-13T11:21:55.273212+0000","last_became_active":"2024-06-13T11:18:42.913355+0000","last_became_peered":"2024-06-13T11:18:42.913355+0000","last_unstale":"2024-06-13T11:21:55.273212+0000","last_undegraded":"2024-06-13T11:21:55.273212+0000","last_fullsized":"2024-06-13T11:21:55.273212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:25:00.020936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.278245+0000","last_change":"2024-06-13T11:18:42.906709+0000","last_active":"2024-06-13T11:21:55.278245+0000","last_peered":"2024-06-13T11:21:55.278245+0000","last_clean":"2024-06-13T11:21:55.278245+0000","last_became_active":"2024-06-13T11:18:42.906309+0000","last_became_peered":"2024-06-13T11:18:42.906309+0000","last_unstale":"2024-06-13T11:21:55.278245+0000","last_undegraded":"2024-06-13T11:21:55.278245+0000","last_fullsized":"2024-06-13T11:21:55.278245+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:09.255670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.283425+0000","last_change":"2024-06-13T11:18:42.926939+0000","last_active":"2024-06-13T11:21:55.283425+0000","last_peered":"2024-06-13T11:21:55.283425+0000","last_clean":"2024-06-13T11:21:55.283425+0000","last_became_active":"2024-06-13T11:18:42.926616+0000","last_became_peered":"2024-06-13T11:18:42.926616+0000","last_unstale":"2024-06-13T11:21:55.283425+0000","last_undegraded":"2024-06-13T11:21:55.283425+0000","last_fullsized":"2024-06-13T11:21:55.283425+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:52:46.468479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.253710+0000","last_change":"2024-06-13T11:18:42.901103+0000","last_active":"2024-06-13T11:21:55.253710+0000","last_peered":"2024-06-13T11:21:55.253710+0000","last_clean":"2024-06-13T11:21:55.253710+0000","last_became_active":"2024-06-13T11:18:42.900726+0000","last_became_peered":"2024-06-13T11:18:42.900726+0000","last_unstale":"2024-06-13T11:21:55.253710+0000","last_undegraded":"2024-06-13T11:21:55.253710+0000","last_fullsized":"2024-06-13T11:21:55.253710+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:55.895451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285250,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68470,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":730,"num_read_kb":438,"num_write":179,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":205410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383739,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1093632,"data_stored":569642,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645375,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36548,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708604,"statfs":{"total":95995035648,"available":95957610496,"internally_reserved":0,"allocated":1241088,"data_stored":1221239,"data_compressed":68781,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808901,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1114112,"data_stored":573974,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070539,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":569798,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332177,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1159168,"data_stored":1166378,"data_compressed":68781,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495703,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1089536,"data_stored":565054,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32308,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712844,"statfs":{"total":95995035648,"available":95961952256,"internally_reserved":0,"allocated":1159168,"data_stored":628762,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738488,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":566442,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411436,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36492,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708660,"statfs":{"total":95995035648,"available":95957667840,"internally_reserved":0,"allocated":1183744,"data_stored":630643,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182502,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":565248,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920866,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1101824,"data_stored":570235,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757341,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36476,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708676,"statfs":{"total":95995035648,"available":95957684224,"internally_reserved":0,"allocated":1167360,"data_stored":1161435,"data_compressed":68781,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34630,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34630,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34630,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T11:22:09.403 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph pg dump --format=json 2024-06-13T11:22:09.898 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:22:10.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:09 smithi002 ceph-mon[32210]: from='client.24925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:22:10.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:09 smithi178 ceph-mon[36913]: from='client.24925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:22:10.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:09 smithi077 ceph-mon[36410]: from='client.24925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:22:11.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:10 smithi002 ceph-mon[32210]: pgmap v441: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:22:11.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:10 smithi178 ceph-mon[36913]: pgmap v441: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:22:11.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:10 smithi077 ceph-mon[36410]: pgmap v441: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:22:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.195+0000 7f8811c00700 1 -- 172.21.15.2:0/1974463321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f880c1073c0 msgr2=0x7f880c06a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.195+0000 7f8811c00700 1 --2- 172.21.15.2:0/1974463321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f880c1073c0 0x7f880c06a1a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0098f0 tx=0x7f87fc009c00 comp rx=0 tx=0).stop 2024-06-13T11:22:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.196+0000 7f8811c00700 1 -- 172.21.15.2:0/1974463321 shutdown_connections 2024-06-13T11:22:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.196+0000 7f8811c00700 1 --2- 172.21.15.2:0/1974463321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f880c1073c0 0x7f880c06a1a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.196+0000 7f8811c00700 1 --2- 172.21.15.2:0/1974463321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f880c104ed0 0x7f880c105360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:12.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.196+0000 7f8811c00700 1 --2- 172.21.15.2:0/1974463321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f880c06a6e0 0x7f880c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:12.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.196+0000 7f8811c00700 1 -- 172.21.15.2:0/1974463321 >> 172.21.15.2:0/1974463321 conn(0x7f880c078340 msgr2=0x7f880c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:12.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.196+0000 7f8811c00700 1 -- 172.21.15.2:0/1974463321 shutdown_connections 2024-06-13T11:22:12.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.196+0000 7f8811c00700 1 -- 172.21.15.2:0/1974463321 wait complete. 2024-06-13T11:22:12.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.197+0000 7f8811c00700 1 Processor -- start 2024-06-13T11:22:12.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.197+0000 7f8811c00700 1 -- start start 2024-06-13T11:22:12.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.197+0000 7f8811c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f880c06a6e0 0x7f880c19f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:12.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.197+0000 7f8811c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f880c104ed0 0x7f880c19f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:12.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.197+0000 7f8811c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f880c1073c0 0x7f880c1a3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:12.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.197+0000 7f8811c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f880c118d70 con 0x7f880c104ed0 2024-06-13T11:22:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.197+0000 7f8811c00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f880c118bf0 con 0x7f880c1073c0 2024-06-13T11:22:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.197+0000 7f8811c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f880c118ef0 con 0x7f880c06a6e0 2024-06-13T11:22:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.198+0000 7f880b400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f880c1073c0 0x7f880c1a3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.198+0000 7f880b400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f880c1073c0 0x7f880c1a3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:55970/0 (socket says 172.21.15.2:55970) 2024-06-13T11:22:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.198+0000 7f880b400700 1 -- 172.21.15.2:0/2680072067 learned_addr learned my addr 172.21.15.2:0/2680072067 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.198+0000 7f880a000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f880c104ed0 0x7f880c19f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.198+0000 7f880aa00700 1 --2- 172.21.15.2:0/2680072067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f880c06a6e0 0x7f880c19f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.198+0000 7f880b400700 1 -- 172.21.15.2:0/2680072067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f880c06a6e0 msgr2=0x7f880c19f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.198+0000 7f880b400700 1 --2- 172.21.15.2:0/2680072067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f880c06a6e0 0x7f880c19f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.198+0000 7f880b400700 1 -- 172.21.15.2:0/2680072067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f880c104ed0 msgr2=0x7f880c19f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.198+0000 7f880b400700 1 --2- 172.21.15.2:0/2680072067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f880c104ed0 0x7f880c19f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.198+0000 7f880b400700 1 -- 172.21.15.2:0/2680072067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880c1a4290 con 0x7f880c1073c0 2024-06-13T11:22:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.199+0000 7f880b400700 1 --2- 172.21.15.2:0/2680072067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f880c1073c0 0x7f880c1a3b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f880400ef30 tx=0x7f880400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.199+0000 7f8803400700 1 -- 172.21.15.2:0/2680072067 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88040092e0 con 0x7f880c1073c0 2024-06-13T11:22:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.199+0000 7f8811c00700 1 -- 172.21.15.2:0/2680072067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f880c1a4520 con 0x7f880c1073c0 2024-06-13T11:22:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.199+0000 7f8803400700 1 -- 172.21.15.2:0/2680072067 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8804004bb0 con 0x7f880c1073c0 2024-06-13T11:22:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.199+0000 7f8803400700 1 -- 172.21.15.2:0/2680072067 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8804004280 con 0x7f880c1073c0 2024-06-13T11:22:12.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.199+0000 7f8811c00700 1 -- 172.21.15.2:0/2680072067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f880c1abe00 con 0x7f880c1073c0 2024-06-13T11:22:12.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.200+0000 7f8811c00700 1 -- 172.21.15.2:0/2680072067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f880c069180 con 0x7f880c1073c0 2024-06-13T11:22:12.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.202+0000 7f8803400700 1 -- 172.21.15.2:0/2680072067 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f880401b030 con 0x7f880c1073c0 2024-06-13T11:22:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.203+0000 7f8803400700 1 --2- 172.21.15.2:0/2680072067 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f87f00a2ca0 0x7f87f00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.204+0000 7f8803400700 1 -- 172.21.15.2:0/2680072067 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f88040ced90 con 0x7f880c1073c0 2024-06-13T11:22:12.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.204+0000 7f880aa00700 1 --2- 172.21.15.2:0/2680072067 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f87f00a2ca0 0x7f87f00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:12.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.205+0000 7f880aa00700 1 --2- 172.21.15.2:0/2680072067 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f87f00a2ca0 0x7f87f00a5160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0098c0 tx=0x7f87fc019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:12.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.208+0000 7f8803400700 1 -- 172.21.15.2:0/2680072067 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8804022020 con 0x7f880c1073c0 2024-06-13T11:22:12.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.437+0000 7f8811c00700 1 -- 172.21.15.2:0/2680072067 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f880c100a90 con 0x7f87f00a2ca0 2024-06-13T11:22:12.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.467+0000 7f8803400700 1 -- 172.21.15.2:0/2680072067 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340752 (secure 0 0 0) 0x7f87fc07a320 con 0x7f87f00a2ca0 2024-06-13T11:22:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:22:12.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.476+0000 7f8811c00700 1 -- 172.21.15.2:0/2680072067 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f87f00a2ca0 msgr2=0x7f87f00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:12.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.476+0000 7f8811c00700 1 --2- 172.21.15.2:0/2680072067 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f87f00a2ca0 0x7f87f00a5160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0098c0 tx=0x7f87fc019040 comp rx=0 tx=0).stop 2024-06-13T11:22:12.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.476+0000 7f8811c00700 1 -- 172.21.15.2:0/2680072067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f880c1073c0 msgr2=0x7f880c1a3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:12.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.476+0000 7f8811c00700 1 --2- 172.21.15.2:0/2680072067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f880c1073c0 0x7f880c1a3b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f880400ef30 tx=0x7f880400c3a0 comp rx=0 tx=0).stop 2024-06-13T11:22:12.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.476+0000 7f8811c00700 1 -- 172.21.15.2:0/2680072067 shutdown_connections 2024-06-13T11:22:12.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.476+0000 7f8811c00700 1 --2- 172.21.15.2:0/2680072067 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f87f00a2ca0 0x7f87f00a5160 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:12.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.476+0000 7f8811c00700 1 --2- 172.21.15.2:0/2680072067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f880c1073c0 0x7f880c1a3b50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:12.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.476+0000 7f8811c00700 1 --2- 172.21.15.2:0/2680072067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f880c06a6e0 0x7f880c19f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:12.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.476+0000 7f8811c00700 1 --2- 172.21.15.2:0/2680072067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f880c104ed0 0x7f880c19f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:12.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.476+0000 7f8811c00700 1 -- 172.21.15.2:0/2680072067 >> 172.21.15.2:0/2680072067 conn(0x7f880c078340 msgr2=0x7f880c100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:12.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.476+0000 7f8811c00700 1 -- 172.21.15.2:0/2680072067 shutdown_connections 2024-06-13T11:22:12.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:12.476+0000 7f8811c00700 1 -- 172.21.15.2:0/2680072067 wait complete. 2024-06-13T11:22:12.477 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-06-13T11:22:13.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:12 smithi002 ceph-mon[32210]: pgmap v442: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-06-13T11:22:13.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:12 smithi178 ceph-mon[36913]: pgmap v442: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-06-13T11:22:13.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:12 smithi077 ceph-mon[36410]: pgmap v442: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-06-13T11:22:13.298 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2024-06-13T11:22:11.332536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659072,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":876,"num_read_kb":562,"num_write":362,"num_write_kb":3066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":792,"ondisk_log_size":792,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391588,"kb_used_data":13316,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550236,"statfs":{"total":1151940427776,"available":1151539441664,"internally_reserved":0,"allocated":13635584,"data_stored":8788850,"data_compressed":498924,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":36,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006077"},"pg_stats":[{"pgid":"3.3f","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.280201+0000","last_change":"2024-06-13T11:18:42.925351+0000","last_active":"2024-06-13T11:21:55.280201+0000","last_peered":"2024-06-13T11:21:55.280201+0000","last_clean":"2024-06-13T11:21:55.280201+0000","last_became_active":"2024-06-13T11:18:42.924971+0000","last_became_peered":"2024-06-13T11:18:42.924971+0000","last_unstale":"2024-06-13T11:21:55.280201+0000","last_undegraded":"2024-06-13T11:21:55.280201+0000","last_fullsized":"2024-06-13T11:21:55.280201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:33:49.563311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.280934+0000","last_change":"2024-06-13T11:18:42.923771+0000","last_active":"2024-06-13T11:21:55.280934+0000","last_peered":"2024-06-13T11:21:55.280934+0000","last_clean":"2024-06-13T11:21:55.280934+0000","last_became_active":"2024-06-13T11:18:42.918410+0000","last_became_peered":"2024-06-13T11:18:42.918410+0000","last_unstale":"2024-06-13T11:21:55.280934+0000","last_undegraded":"2024-06-13T11:21:55.280934+0000","last_fullsized":"2024-06-13T11:21:55.280934+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:11:28.256622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.278891+0000","last_change":"2024-06-13T11:18:42.919502+0000","last_active":"2024-06-13T11:21:55.278891+0000","last_peered":"2024-06-13T11:21:55.278891+0000","last_clean":"2024-06-13T11:21:55.278891+0000","last_became_active":"2024-06-13T11:18:42.915747+0000","last_became_peered":"2024-06-13T11:18:42.915747+0000","last_unstale":"2024-06-13T11:21:55.278891+0000","last_undegraded":"2024-06-13T11:21:55.278891+0000","last_fullsized":"2024-06-13T11:21:55.278891+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:39:23.555604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.258819+0000","last_change":"2024-06-13T11:18:42.905944+0000","last_active":"2024-06-13T11:21:55.258819+0000","last_peered":"2024-06-13T11:21:55.258819+0000","last_clean":"2024-06-13T11:21:55.258819+0000","last_became_active":"2024-06-13T11:18:42.905494+0000","last_became_peered":"2024-06-13T11:18:42.905494+0000","last_unstale":"2024-06-13T11:21:55.258819+0000","last_undegraded":"2024-06-13T11:21:55.258819+0000","last_fullsized":"2024-06-13T11:21:55.258819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:26:44.396593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.274192+0000","last_change":"2024-06-13T11:18:42.924212+0000","last_active":"2024-06-13T11:21:55.274192+0000","last_peered":"2024-06-13T11:21:55.274192+0000","last_clean":"2024-06-13T11:21:55.274192+0000","last_became_active":"2024-06-13T11:18:42.923848+0000","last_became_peered":"2024-06-13T11:18:42.923848+0000","last_unstale":"2024-06-13T11:21:55.274192+0000","last_undegraded":"2024-06-13T11:21:55.274192+0000","last_fullsized":"2024-06-13T11:21:55.274192+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:01.754609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.252721+0000","last_change":"2024-06-13T11:18:42.915283+0000","last_active":"2024-06-13T11:21:55.252721+0000","last_peered":"2024-06-13T11:21:55.252721+0000","last_clean":"2024-06-13T11:21:55.252721+0000","last_became_active":"2024-06-13T11:18:42.914921+0000","last_became_peered":"2024-06-13T11:18:42.914921+0000","last_unstale":"2024-06-13T11:21:55.252721+0000","last_undegraded":"2024-06-13T11:21:55.252721+0000","last_fullsized":"2024-06-13T11:21:55.252721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:48:42.116314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.257630+0000","last_change":"2024-06-13T11:18:42.911614+0000","last_active":"2024-06-13T11:21:55.257630+0000","last_peered":"2024-06-13T11:21:55.257630+0000","last_clean":"2024-06-13T11:21:55.257630+0000","last_became_active":"2024-06-13T11:18:42.911360+0000","last_became_peered":"2024-06-13T11:18:42.911360+0000","last_unstale":"2024-06-13T11:21:55.257630+0000","last_undegraded":"2024-06-13T11:21:55.257630+0000","last_fullsized":"2024-06-13T11:21:55.257630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:23:55.161725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"99'9","reported_seq":25,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.261197+0000","last_change":"2024-06-13T11:19:27.074801+0000","last_active":"2024-06-13T11:21:55.261197+0000","last_peered":"2024-06-13T11:21:55.261197+0000","last_clean":"2024-06-13T11:21:55.261197+0000","last_became_active":"2024-06-13T11:19:27.072783+0000","last_became_peered":"2024-06-13T11:19:27.072783+0000","last_unstale":"2024-06-13T11:21:55.261197+0000","last_undegraded":"2024-06-13T11:21:55.261197+0000","last_fullsized":"2024-06-13T11:21:55.261197+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:34.658008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.265213+0000","last_change":"2024-06-13T11:18:42.913482+0000","last_active":"2024-06-13T11:21:55.265213+0000","last_peered":"2024-06-13T11:21:55.265213+0000","last_clean":"2024-06-13T11:21:55.265213+0000","last_became_active":"2024-06-13T11:18:42.912700+0000","last_became_peered":"2024-06-13T11:18:42.912700+0000","last_unstale":"2024-06-13T11:21:55.265213+0000","last_undegraded":"2024-06-13T11:21:55.265213+0000","last_fullsized":"2024-06-13T11:21:55.265213+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:38:42.053801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"99'16","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.257189+0000","last_change":"2024-06-13T11:18:42.905824+0000","last_active":"2024-06-13T11:21:55.257189+0000","last_peered":"2024-06-13T11:21:55.257189+0000","last_clean":"2024-06-13T11:21:55.257189+0000","last_became_active":"2024-06-13T11:18:42.905443+0000","last_became_peered":"2024-06-13T11:18:42.905443+0000","last_unstale":"2024-06-13T11:21:55.257189+0000","last_undegraded":"2024-06-13T11:21:55.257189+0000","last_fullsized":"2024-06-13T11:21:55.257189+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:51:46.957656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.262075+0000","last_change":"2024-06-13T11:18:42.901987+0000","last_active":"2024-06-13T11:21:55.262075+0000","last_peered":"2024-06-13T11:21:55.262075+0000","last_clean":"2024-06-13T11:21:55.262075+0000","last_became_active":"2024-06-13T11:18:42.901641+0000","last_became_peered":"2024-06-13T11:18:42.901641+0000","last_unstale":"2024-06-13T11:21:55.262075+0000","last_undegraded":"2024-06-13T11:21:55.262075+0000","last_fullsized":"2024-06-13T11:21:55.262075+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:52:29.036172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.258346+0000","last_change":"2024-06-13T11:18:42.899161+0000","last_active":"2024-06-13T11:21:55.258346+0000","last_peered":"2024-06-13T11:21:55.258346+0000","last_clean":"2024-06-13T11:21:55.258346+0000","last_became_active":"2024-06-13T11:18:42.898823+0000","last_became_peered":"2024-06-13T11:18:42.898823+0000","last_unstale":"2024-06-13T11:21:55.258346+0000","last_undegraded":"2024-06-13T11:21:55.258346+0000","last_fullsized":"2024-06-13T11:21:55.258346+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:21:20.968759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.277889+0000","last_change":"2024-06-13T11:18:42.908954+0000","last_active":"2024-06-13T11:21:55.277889+0000","last_peered":"2024-06-13T11:21:55.277889+0000","last_clean":"2024-06-13T11:21:55.277889+0000","last_became_active":"2024-06-13T11:18:42.908604+0000","last_became_peered":"2024-06-13T11:18:42.908604+0000","last_unstale":"2024-06-13T11:21:55.277889+0000","last_undegraded":"2024-06-13T11:21:55.277889+0000","last_fullsized":"2024-06-13T11:21:55.277889+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:00:30.662233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.282751+0000","last_change":"2024-06-13T11:18:42.925374+0000","last_active":"2024-06-13T11:21:55.282751+0000","last_peered":"2024-06-13T11:21:55.282751+0000","last_clean":"2024-06-13T11:21:55.282751+0000","last_became_active":"2024-06-13T11:18:42.924624+0000","last_became_peered":"2024-06-13T11:18:42.924624+0000","last_unstale":"2024-06-13T11:21:55.282751+0000","last_undegraded":"2024-06-13T11:21:55.282751+0000","last_fullsized":"2024-06-13T11:21:55.282751+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:07.989887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.278576+0000","last_change":"2024-06-13T11:18:42.924457+0000","last_active":"2024-06-13T11:21:55.278576+0000","last_peered":"2024-06-13T11:21:55.278576+0000","last_clean":"2024-06-13T11:21:55.278576+0000","last_became_active":"2024-06-13T11:18:42.922641+0000","last_became_peered":"2024-06-13T11:18:42.922641+0000","last_unstale":"2024-06-13T11:21:55.278576+0000","last_undegraded":"2024-06-13T11:21:55.278576+0000","last_fullsized":"2024-06-13T11:21:55.278576+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:52:56.769565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.268412+0000","last_change":"2024-06-13T11:18:42.925333+0000","last_active":"2024-06-13T11:21:55.268412+0000","last_peered":"2024-06-13T11:21:55.268412+0000","last_clean":"2024-06-13T11:21:55.268412+0000","last_became_active":"2024-06-13T11:18:42.924854+0000","last_became_peered":"2024-06-13T11:18:42.924854+0000","last_unstale":"2024-06-13T11:21:55.268412+0000","last_undegraded":"2024-06-13T11:21:55.268412+0000","last_fullsized":"2024-06-13T11:21:55.268412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:30:38.554616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.280314+0000","last_change":"2024-06-13T11:18:42.926652+0000","last_active":"2024-06-13T11:21:55.280314+0000","last_peered":"2024-06-13T11:21:55.280314+0000","last_clean":"2024-06-13T11:21:55.280314+0000","last_became_active":"2024-06-13T11:18:42.926281+0000","last_became_peered":"2024-06-13T11:18:42.926281+0000","last_unstale":"2024-06-13T11:21:55.280314+0000","last_undegraded":"2024-06-13T11:21:55.280314+0000","last_fullsized":"2024-06-13T11:21:55.280314+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:50:50.483047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.269717+0000","last_change":"2024-06-13T11:18:42.917743+0000","last_active":"2024-06-13T11:21:55.269717+0000","last_peered":"2024-06-13T11:21:55.269717+0000","last_clean":"2024-06-13T11:21:55.269717+0000","last_became_active":"2024-06-13T11:18:42.916473+0000","last_became_peered":"2024-06-13T11:18:42.916473+0000","last_unstale":"2024-06-13T11:21:55.269717+0000","last_undegraded":"2024-06-13T11:21:55.269717+0000","last_fullsized":"2024-06-13T11:21:55.269717+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:20:12.909524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.277878+0000","last_change":"2024-06-13T11:18:42.930712+0000","last_active":"2024-06-13T11:21:55.277878+0000","last_peered":"2024-06-13T11:21:55.277878+0000","last_clean":"2024-06-13T11:21:55.277878+0000","last_became_active":"2024-06-13T11:18:42.930446+0000","last_became_peered":"2024-06-13T11:18:42.930446+0000","last_unstale":"2024-06-13T11:21:55.277878+0000","last_undegraded":"2024-06-13T11:21:55.277878+0000","last_fullsized":"2024-06-13T11:21:55.277878+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:08:28.729916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.531381+0000","last_change":"2024-06-13T11:18:57.027006+0000","last_active":"2024-06-13T11:20:27.531381+0000","last_peered":"2024-06-13T11:20:27.531381+0000","last_clean":"2024-06-13T11:20:27.531381+0000","last_became_active":"2024-06-13T11:18:57.026562+0000","last_became_peered":"2024-06-13T11:18:57.026562+0000","last_unstale":"2024-06-13T11:20:27.531381+0000","last_undegraded":"2024-06-13T11:20:27.531381+0000","last_fullsized":"2024-06-13T11:20:27.531381+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:17:32.180729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"97'9","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767734+0000","last_change":"2024-06-13T11:18:38.172704+0000","last_active":"2024-06-13T11:20:27.767734+0000","last_peered":"2024-06-13T11:20:27.767734+0000","last_clean":"2024-06-13T11:20:27.767734+0000","last_became_active":"2024-06-13T11:18:38.172125+0000","last_became_peered":"2024-06-13T11:18:38.172125+0000","last_unstale":"2024-06-13T11:20:27.767734+0000","last_undegraded":"2024-06-13T11:20:27.767734+0000","last_fullsized":"2024-06-13T11:20:27.767734+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:40:52.578805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.273540+0000","last_change":"2024-06-13T11:18:42.922864+0000","last_active":"2024-06-13T11:21:55.273540+0000","last_peered":"2024-06-13T11:21:55.273540+0000","last_clean":"2024-06-13T11:21:55.273540+0000","last_became_active":"2024-06-13T11:18:42.921283+0000","last_became_peered":"2024-06-13T11:18:42.921283+0000","last_unstale":"2024-06-13T11:21:55.273540+0000","last_undegraded":"2024-06-13T11:21:55.273540+0000","last_fullsized":"2024-06-13T11:21:55.273540+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:44.421502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.905377+0000","last_change":"2024-06-13T11:20:27.904814+0000","last_active":"2024-06-13T11:20:27.905377+0000","last_peered":"2024-06-13T11:20:27.905377+0000","last_clean":"2024-06-13T11:20:27.905377+0000","last_became_active":"2024-06-13T11:20:27.904342+0000","last_became_peered":"2024-06-13T11:20:27.904342+0000","last_unstale":"2024-06-13T11:20:27.905377+0000","last_undegraded":"2024-06-13T11:20:27.905377+0000","last_fullsized":"2024-06-13T11:20:27.905377+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:45:59.215429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,10,3],"acting":[4,6,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.903753+0000","last_change":"2024-06-13T11:18:38.483021+0000","last_active":"2024-06-13T11:20:27.903753+0000","last_peered":"2024-06-13T11:20:27.903753+0000","last_clean":"2024-06-13T11:20:27.903753+0000","last_became_active":"2024-06-13T11:18:38.482594+0000","last_became_peered":"2024-06-13T11:18:38.482594+0000","last_unstale":"2024-06-13T11:20:27.903753+0000","last_undegraded":"2024-06-13T11:20:27.903753+0000","last_fullsized":"2024-06-13T11:20:27.903753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:27:07.660961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.282621+0000","last_change":"2024-06-13T11:18:42.926272+0000","last_active":"2024-06-13T11:21:55.282621+0000","last_peered":"2024-06-13T11:21:55.282621+0000","last_clean":"2024-06-13T11:21:55.282621+0000","last_became_active":"2024-06-13T11:18:42.925864+0000","last_became_peered":"2024-06-13T11:18:42.925864+0000","last_unstale":"2024-06-13T11:21:55.282621+0000","last_undegraded":"2024-06-13T11:21:55.282621+0000","last_fullsized":"2024-06-13T11:21:55.282621+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:51:59.562266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529404+0000","last_change":"2024-06-13T11:18:57.033152+0000","last_active":"2024-06-13T11:20:27.529404+0000","last_peered":"2024-06-13T11:20:27.529404+0000","last_clean":"2024-06-13T11:20:27.529404+0000","last_became_active":"2024-06-13T11:18:57.032696+0000","last_became_peered":"2024-06-13T11:18:57.032696+0000","last_unstale":"2024-06-13T11:20:27.529404+0000","last_undegraded":"2024-06-13T11:20:27.529404+0000","last_fullsized":"2024-06-13T11:20:27.529404+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:59:20.584476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526219+0000","last_change":"2024-06-13T11:18:38.168246+0000","last_active":"2024-06-13T11:20:27.526219+0000","last_peered":"2024-06-13T11:20:27.526219+0000","last_clean":"2024-06-13T11:20:27.526219+0000","last_became_active":"2024-06-13T11:18:38.167918+0000","last_became_peered":"2024-06-13T11:18:38.167918+0000","last_unstale":"2024-06-13T11:20:27.526219+0000","last_undegraded":"2024-06-13T11:20:27.526219+0000","last_fullsized":"2024-06-13T11:20:27.526219+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:23:39.079356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.275423+0000","last_change":"2024-06-13T11:18:42.901291+0000","last_active":"2024-06-13T11:21:55.275423+0000","last_peered":"2024-06-13T11:21:55.275423+0000","last_clean":"2024-06-13T11:21:55.275423+0000","last_became_active":"2024-06-13T11:18:42.900990+0000","last_became_peered":"2024-06-13T11:18:42.900990+0000","last_unstale":"2024-06-13T11:21:55.275423+0000","last_undegraded":"2024-06-13T11:21:55.275423+0000","last_fullsized":"2024-06-13T11:21:55.275423+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:59:03.521767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.906045+0000","last_change":"2024-06-13T11:20:27.905640+0000","last_active":"2024-06-13T11:20:27.906045+0000","last_peered":"2024-06-13T11:20:27.906045+0000","last_clean":"2024-06-13T11:20:27.906045+0000","last_became_active":"2024-06-13T11:20:27.905149+0000","last_became_peered":"2024-06-13T11:20:27.905149+0000","last_unstale":"2024-06-13T11:20:27.906045+0000","last_undegraded":"2024-06-13T11:20:27.906045+0000","last_fullsized":"2024-06-13T11:20:27.906045+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:24:14.702582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526125+0000","last_change":"2024-06-13T11:18:38.170301+0000","last_active":"2024-06-13T11:20:27.526125+0000","last_peered":"2024-06-13T11:20:27.526125+0000","last_clean":"2024-06-13T11:20:27.526125+0000","last_became_active":"2024-06-13T11:18:38.169926+0000","last_became_peered":"2024-06-13T11:18:38.169926+0000","last_unstale":"2024-06-13T11:20:27.526125+0000","last_undegraded":"2024-06-13T11:20:27.526125+0000","last_fullsized":"2024-06-13T11:20:27.526125+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:02:02.877638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.267560+0000","last_change":"2024-06-13T11:18:42.907869+0000","last_active":"2024-06-13T11:21:55.267560+0000","last_peered":"2024-06-13T11:21:55.267560+0000","last_clean":"2024-06-13T11:21:55.267560+0000","last_became_active":"2024-06-13T11:18:42.907349+0000","last_became_peered":"2024-06-13T11:18:42.907349+0000","last_unstale":"2024-06-13T11:21:55.267560+0000","last_undegraded":"2024-06-13T11:21:55.267560+0000","last_fullsized":"2024-06-13T11:21:55.267560+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:54:33.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.530987+0000","last_change":"2024-06-13T11:18:57.009598+0000","last_active":"2024-06-13T11:20:27.530987+0000","last_peered":"2024-06-13T11:20:27.530987+0000","last_clean":"2024-06-13T11:20:27.530987+0000","last_became_active":"2024-06-13T11:18:57.009186+0000","last_became_peered":"2024-06-13T11:18:57.009186+0000","last_unstale":"2024-06-13T11:20:27.530987+0000","last_undegraded":"2024-06-13T11:20:27.530987+0000","last_fullsized":"2024-06-13T11:20:27.530987+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:41:46.784749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"99'7","reported_seq":176,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:22:08.602703+0000","last_change":"2024-06-13T11:18:38.167060+0000","last_active":"2024-06-13T11:22:08.602703+0000","last_peered":"2024-06-13T11:22:08.602703+0000","last_clean":"2024-06-13T11:22:08.602703+0000","last_became_active":"2024-06-13T11:18:38.166704+0000","last_became_peered":"2024-06-13T11:18:38.166704+0000","last_unstale":"2024-06-13T11:22:08.602703+0000","last_undegraded":"2024-06-13T11:22:08.602703+0000","last_fullsized":"2024-06-13T11:22:08.602703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:30:51.754276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.262418+0000","last_change":"2024-06-13T11:18:42.915361+0000","last_active":"2024-06-13T11:21:55.262418+0000","last_peered":"2024-06-13T11:21:55.262418+0000","last_clean":"2024-06-13T11:21:55.262418+0000","last_became_active":"2024-06-13T11:18:42.914977+0000","last_became_peered":"2024-06-13T11:18:42.914977+0000","last_unstale":"2024-06-13T11:21:55.262418+0000","last_undegraded":"2024-06-13T11:21:55.262418+0000","last_fullsized":"2024-06-13T11:21:55.262418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:04:30.677548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.604440+0000","last_change":"2024-06-13T11:20:27.603953+0000","last_active":"2024-06-13T11:20:27.604440+0000","last_peered":"2024-06-13T11:20:27.604440+0000","last_clean":"2024-06-13T11:20:27.604440+0000","last_became_active":"2024-06-13T11:20:27.603306+0000","last_became_peered":"2024-06-13T11:20:27.603306+0000","last_unstale":"2024-06-13T11:20:27.604440+0000","last_undegraded":"2024-06-13T11:20:27.604440+0000","last_fullsized":"2024-06-13T11:20:27.604440+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:02:01.228984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.799664+0000","last_change":"2024-06-13T11:18:38.170126+0000","last_active":"2024-06-13T11:20:27.799664+0000","last_peered":"2024-06-13T11:20:27.799664+0000","last_clean":"2024-06-13T11:20:27.799664+0000","last_became_active":"2024-06-13T11:18:38.169736+0000","last_became_peered":"2024-06-13T11:18:38.169736+0000","last_unstale":"2024-06-13T11:20:27.799664+0000","last_undegraded":"2024-06-13T11:20:27.799664+0000","last_fullsized":"2024-06-13T11:20:27.799664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:07:22.778093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.275925+0000","last_change":"2024-06-13T11:18:42.929004+0000","last_active":"2024-06-13T11:21:55.275925+0000","last_peered":"2024-06-13T11:21:55.275925+0000","last_clean":"2024-06-13T11:21:55.275925+0000","last_became_active":"2024-06-13T11:18:42.928579+0000","last_became_peered":"2024-06-13T11:18:42.928579+0000","last_unstale":"2024-06-13T11:21:55.275925+0000","last_undegraded":"2024-06-13T11:21:55.275925+0000","last_fullsized":"2024-06-13T11:21:55.275925+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:31:15.703033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899599+0000","last_change":"2024-06-13T11:18:57.031059+0000","last_active":"2024-06-13T11:20:27.899599+0000","last_peered":"2024-06-13T11:20:27.899599+0000","last_clean":"2024-06-13T11:20:27.899599+0000","last_became_active":"2024-06-13T11:18:57.030723+0000","last_became_peered":"2024-06-13T11:18:57.030723+0000","last_unstale":"2024-06-13T11:20:27.899599+0000","last_undegraded":"2024-06-13T11:20:27.899599+0000","last_fullsized":"2024-06-13T11:20:27.899599+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:19:36.883790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.527702+0000","last_change":"2024-06-13T11:18:38.175189+0000","last_active":"2024-06-13T11:20:27.527702+0000","last_peered":"2024-06-13T11:20:27.527702+0000","last_clean":"2024-06-13T11:20:27.527702+0000","last_became_active":"2024-06-13T11:18:38.173817+0000","last_became_peered":"2024-06-13T11:18:38.173817+0000","last_unstale":"2024-06-13T11:20:27.527702+0000","last_undegraded":"2024-06-13T11:20:27.527702+0000","last_fullsized":"2024-06-13T11:20:27.527702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:02:18.422449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.276155+0000","last_change":"2024-06-13T11:18:42.920665+0000","last_active":"2024-06-13T11:21:55.276155+0000","last_peered":"2024-06-13T11:21:55.276155+0000","last_clean":"2024-06-13T11:21:55.276155+0000","last_became_active":"2024-06-13T11:18:42.919461+0000","last_became_peered":"2024-06-13T11:18:42.919461+0000","last_unstale":"2024-06-13T11:21:55.276155+0000","last_undegraded":"2024-06-13T11:21:55.276155+0000","last_fullsized":"2024-06-13T11:21:55.276155+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:56:23.042481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.114260+0000","last_change":"2024-06-13T11:18:57.025822+0000","last_active":"2024-06-13T11:20:28.114260+0000","last_peered":"2024-06-13T11:20:28.114260+0000","last_clean":"2024-06-13T11:20:28.114260+0000","last_became_active":"2024-06-13T11:18:57.025408+0000","last_became_peered":"2024-06-13T11:18:57.025408+0000","last_unstale":"2024-06-13T11:20:28.114260+0000","last_undegraded":"2024-06-13T11:20:28.114260+0000","last_fullsized":"2024-06-13T11:20:28.114260+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:39:28.295433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.601997+0000","last_change":"2024-06-13T11:18:38.168097+0000","last_active":"2024-06-13T11:20:27.601997+0000","last_peered":"2024-06-13T11:20:27.601997+0000","last_clean":"2024-06-13T11:20:27.601997+0000","last_became_active":"2024-06-13T11:18:38.167812+0000","last_became_peered":"2024-06-13T11:18:38.167812+0000","last_unstale":"2024-06-13T11:20:27.601997+0000","last_undegraded":"2024-06-13T11:20:27.601997+0000","last_fullsized":"2024-06-13T11:20:27.601997+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:24:20.247579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.276157+0000","last_change":"2024-06-13T11:18:42.932941+0000","last_active":"2024-06-13T11:21:55.276157+0000","last_peered":"2024-06-13T11:21:55.276157+0000","last_clean":"2024-06-13T11:21:55.276157+0000","last_became_active":"2024-06-13T11:18:42.931942+0000","last_became_peered":"2024-06-13T11:18:42.931942+0000","last_unstale":"2024-06-13T11:21:55.276157+0000","last_undegraded":"2024-06-13T11:21:55.276157+0000","last_fullsized":"2024-06-13T11:21:55.276157+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:12:38.625753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.902456+0000","last_change":"2024-06-13T11:18:57.026834+0000","last_active":"2024-06-13T11:20:27.902456+0000","last_peered":"2024-06-13T11:20:27.902456+0000","last_clean":"2024-06-13T11:20:27.902456+0000","last_became_active":"2024-06-13T11:18:57.026401+0000","last_became_peered":"2024-06-13T11:18:57.026401+0000","last_unstale":"2024-06-13T11:20:27.902456+0000","last_undegraded":"2024-06-13T11:20:27.902456+0000","last_fullsized":"2024-06-13T11:20:27.902456+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:11:19.993946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"99'4","reported_seq":166,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:22:05.597300+0000","last_change":"2024-06-13T11:18:38.172648+0000","last_active":"2024-06-13T11:22:05.597300+0000","last_peered":"2024-06-13T11:22:05.597300+0000","last_clean":"2024-06-13T11:22:05.597300+0000","last_became_active":"2024-06-13T11:18:38.172311+0000","last_became_peered":"2024-06-13T11:18:38.172311+0000","last_unstale":"2024-06-13T11:22:05.597300+0000","last_undegraded":"2024-06-13T11:22:05.597300+0000","last_fullsized":"2024-06-13T11:22:05.597300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:59:10.620378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.267109+0000","last_change":"2024-06-13T11:18:42.920352+0000","last_active":"2024-06-13T11:21:55.267109+0000","last_peered":"2024-06-13T11:21:55.267109+0000","last_clean":"2024-06-13T11:21:55.267109+0000","last_became_active":"2024-06-13T11:18:42.919969+0000","last_became_peered":"2024-06-13T11:18:42.919969+0000","last_unstale":"2024-06-13T11:21:55.267109+0000","last_undegraded":"2024-06-13T11:21:55.267109+0000","last_fullsized":"2024-06-13T11:21:55.267109+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:10:59.832735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.766483+0000","last_change":"2024-06-13T11:18:57.034774+0000","last_active":"2024-06-13T11:20:27.766483+0000","last_peered":"2024-06-13T11:20:27.766483+0000","last_clean":"2024-06-13T11:20:27.766483+0000","last_became_active":"2024-06-13T11:18:57.031812+0000","last_became_peered":"2024-06-13T11:18:57.031812+0000","last_unstale":"2024-06-13T11:20:27.766483+0000","last_undegraded":"2024-06-13T11:20:27.766483+0000","last_fullsized":"2024-06-13T11:20:27.766483+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:26.195958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526015+0000","last_change":"2024-06-13T11:18:38.168169+0000","last_active":"2024-06-13T11:20:27.526015+0000","last_peered":"2024-06-13T11:20:27.526015+0000","last_clean":"2024-06-13T11:20:27.526015+0000","last_became_active":"2024-06-13T11:18:38.167791+0000","last_became_peered":"2024-06-13T11:18:38.167791+0000","last_unstale":"2024-06-13T11:20:27.526015+0000","last_undegraded":"2024-06-13T11:20:27.526015+0000","last_fullsized":"2024-06-13T11:20:27.526015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:04.879468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"99'9","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.278323+0000","last_change":"2024-06-13T11:19:27.077888+0000","last_active":"2024-06-13T11:21:55.278323+0000","last_peered":"2024-06-13T11:21:55.278323+0000","last_clean":"2024-06-13T11:21:55.278323+0000","last_became_active":"2024-06-13T11:19:27.075904+0000","last_became_peered":"2024-06-13T11:19:27.075904+0000","last_unstale":"2024-06-13T11:21:55.278323+0000","last_undegraded":"2024-06-13T11:21:55.278323+0000","last_fullsized":"2024-06-13T11:21:55.278323+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:59.920163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529116+0000","last_change":"2024-06-13T11:19:27.073568+0000","last_active":"2024-06-13T11:20:27.529116+0000","last_peered":"2024-06-13T11:20:27.529116+0000","last_clean":"2024-06-13T11:20:27.529116+0000","last_became_active":"2024-06-13T11:19:27.072954+0000","last_became_peered":"2024-06-13T11:19:27.072954+0000","last_unstale":"2024-06-13T11:20:27.529116+0000","last_undegraded":"2024-06-13T11:20:27.529116+0000","last_fullsized":"2024-06-13T11:20:27.529116+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:10:25.492093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'4","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602788+0000","last_change":"2024-06-13T11:18:38.482021+0000","last_active":"2024-06-13T11:20:27.602788+0000","last_peered":"2024-06-13T11:20:27.602788+0000","last_clean":"2024-06-13T11:20:27.602788+0000","last_became_active":"2024-06-13T11:18:38.481574+0000","last_became_peered":"2024-06-13T11:18:38.481574+0000","last_unstale":"2024-06-13T11:20:27.602788+0000","last_undegraded":"2024-06-13T11:20:27.602788+0000","last_fullsized":"2024-06-13T11:20:27.602788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:50:54.297559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"99'11","reported_seq":56,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.275646+0000","last_change":"2024-06-13T11:19:27.072380+0000","last_active":"2024-06-13T11:21:55.275646+0000","last_peered":"2024-06-13T11:21:55.275646+0000","last_clean":"2024-06-13T11:21:55.275646+0000","last_became_active":"2024-06-13T11:19:27.072027+0000","last_became_peered":"2024-06-13T11:19:27.072027+0000","last_unstale":"2024-06-13T11:21:55.275646+0000","last_undegraded":"2024-06-13T11:21:55.275646+0000","last_fullsized":"2024-06-13T11:21:55.275646+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:37:10.455890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.766951+0000","last_change":"2024-06-13T11:18:57.028370+0000","last_active":"2024-06-13T11:20:27.766951+0000","last_peered":"2024-06-13T11:20:27.766951+0000","last_clean":"2024-06-13T11:20:27.766951+0000","last_became_active":"2024-06-13T11:18:57.023478+0000","last_became_peered":"2024-06-13T11:18:57.023478+0000","last_unstale":"2024-06-13T11:20:27.766951+0000","last_undegraded":"2024-06-13T11:20:27.766951+0000","last_fullsized":"2024-06-13T11:20:27.766951+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:25:01.237698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"99'37","reported_seq":326,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:22:06.599026+0000","last_change":"2024-06-13T11:18:38.169179+0000","last_active":"2024-06-13T11:22:06.599026+0000","last_peered":"2024-06-13T11:22:06.599026+0000","last_clean":"2024-06-13T11:22:06.599026+0000","last_became_active":"2024-06-13T11:18:38.168775+0000","last_became_peered":"2024-06-13T11:18:38.168775+0000","last_unstale":"2024-06-13T11:22:06.599026+0000","last_undegraded":"2024-06-13T11:22:06.599026+0000","last_fullsized":"2024-06-13T11:22:06.599026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:53:39.290755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63798,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":244,"num_read_kb":184,"num_write":38,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.252170+0000","last_change":"2024-06-13T11:18:42.903744+0000","last_active":"2024-06-13T11:21:55.252170+0000","last_peered":"2024-06-13T11:21:55.252170+0000","last_clean":"2024-06-13T11:21:55.252170+0000","last_became_active":"2024-06-13T11:18:42.903410+0000","last_became_peered":"2024-06-13T11:18:42.903410+0000","last_unstale":"2024-06-13T11:21:55.252170+0000","last_undegraded":"2024-06-13T11:21:55.252170+0000","last_fullsized":"2024-06-13T11:21:55.252170+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:17:55.975517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.603296+0000","last_change":"2024-06-13T11:18:57.026052+0000","last_active":"2024-06-13T11:20:27.603296+0000","last_peered":"2024-06-13T11:20:27.603296+0000","last_clean":"2024-06-13T11:20:27.603296+0000","last_became_active":"2024-06-13T11:18:57.025677+0000","last_became_peered":"2024-06-13T11:18:57.025677+0000","last_unstale":"2024-06-13T11:20:27.603296+0000","last_undegraded":"2024-06-13T11:20:27.603296+0000","last_fullsized":"2024-06-13T11:20:27.603296+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:41.061675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'6","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.530995+0000","last_change":"2024-06-13T11:18:38.166672+0000","last_active":"2024-06-13T11:20:27.530995+0000","last_peered":"2024-06-13T11:20:27.530995+0000","last_clean":"2024-06-13T11:20:27.530995+0000","last_became_active":"2024-06-13T11:18:38.165923+0000","last_became_peered":"2024-06-13T11:18:38.165923+0000","last_unstale":"2024-06-13T11:20:27.530995+0000","last_undegraded":"2024-06-13T11:20:27.530995+0000","last_fullsized":"2024-06-13T11:20:27.530995+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:54:00.989462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.279563+0000","last_change":"2024-06-13T11:18:42.919280+0000","last_active":"2024-06-13T11:21:55.279563+0000","last_peered":"2024-06-13T11:21:55.279563+0000","last_clean":"2024-06-13T11:21:55.279563+0000","last_became_active":"2024-06-13T11:18:42.917421+0000","last_became_peered":"2024-06-13T11:18:42.917421+0000","last_unstale":"2024-06-13T11:21:55.279563+0000","last_undegraded":"2024-06-13T11:21:55.279563+0000","last_fullsized":"2024-06-13T11:21:55.279563+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:52:23.765290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899319+0000","last_change":"2024-06-13T11:18:57.031244+0000","last_active":"2024-06-13T11:20:27.899319+0000","last_peered":"2024-06-13T11:20:27.899319+0000","last_clean":"2024-06-13T11:20:27.899319+0000","last_became_active":"2024-06-13T11:18:57.030781+0000","last_became_peered":"2024-06-13T11:18:57.030781+0000","last_unstale":"2024-06-13T11:20:27.899319+0000","last_undegraded":"2024-06-13T11:20:27.899319+0000","last_fullsized":"2024-06-13T11:20:27.899319+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:19:51.722256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602575+0000","last_change":"2024-06-13T11:18:38.171060+0000","last_active":"2024-06-13T11:20:27.602575+0000","last_peered":"2024-06-13T11:20:27.602575+0000","last_clean":"2024-06-13T11:20:27.602575+0000","last_became_active":"2024-06-13T11:18:38.170682+0000","last_became_peered":"2024-06-13T11:18:38.170682+0000","last_unstale":"2024-06-13T11:20:27.602575+0000","last_undegraded":"2024-06-13T11:20:27.602575+0000","last_fullsized":"2024-06-13T11:20:27.602575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:05:53.157074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.279718+0000","last_change":"2024-06-13T11:18:42.902700+0000","last_active":"2024-06-13T11:21:55.279718+0000","last_peered":"2024-06-13T11:21:55.279718+0000","last_clean":"2024-06-13T11:21:55.279718+0000","last_became_active":"2024-06-13T11:18:42.902351+0000","last_became_peered":"2024-06-13T11:18:42.902351+0000","last_unstale":"2024-06-13T11:21:55.279718+0000","last_undegraded":"2024-06-13T11:21:55.279718+0000","last_fullsized":"2024-06-13T11:21:55.279718+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:55:16.769324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767300+0000","last_change":"2024-06-13T11:18:57.034840+0000","last_active":"2024-06-13T11:20:27.767300+0000","last_peered":"2024-06-13T11:20:27.767300+0000","last_clean":"2024-06-13T11:20:27.767300+0000","last_became_active":"2024-06-13T11:18:57.033552+0000","last_became_peered":"2024-06-13T11:18:57.033552+0000","last_unstale":"2024-06-13T11:20:27.767300+0000","last_undegraded":"2024-06-13T11:20:27.767300+0000","last_fullsized":"2024-06-13T11:20:27.767300+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:44:25.463043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"99'5","reported_seq":171,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:22:05.668315+0000","last_change":"2024-06-13T11:18:38.170644+0000","last_active":"2024-06-13T11:22:05.668315+0000","last_peered":"2024-06-13T11:22:05.668315+0000","last_clean":"2024-06-13T11:22:05.668315+0000","last_became_active":"2024-06-13T11:18:38.169986+0000","last_became_peered":"2024-06-13T11:18:38.169986+0000","last_unstale":"2024-06-13T11:22:05.668315+0000","last_undegraded":"2024-06-13T11:22:05.668315+0000","last_fullsized":"2024-06-13T11:22:05.668315+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:45:48.817898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.243447+0000","last_change":"2024-06-13T11:18:42.903465+0000","last_active":"2024-06-13T11:21:55.243447+0000","last_peered":"2024-06-13T11:21:55.243447+0000","last_clean":"2024-06-13T11:21:55.243447+0000","last_became_active":"2024-06-13T11:18:42.903001+0000","last_became_peered":"2024-06-13T11:18:42.903001+0000","last_unstale":"2024-06-13T11:21:55.243447+0000","last_undegraded":"2024-06-13T11:21:55.243447+0000","last_fullsized":"2024-06-13T11:21:55.243447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:25:24.331890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529375+0000","last_change":"2024-06-13T11:18:57.033966+0000","last_active":"2024-06-13T11:20:27.529375+0000","last_peered":"2024-06-13T11:20:27.529375+0000","last_clean":"2024-06-13T11:20:27.529375+0000","last_became_active":"2024-06-13T11:18:57.032448+0000","last_became_peered":"2024-06-13T11:18:57.032448+0000","last_unstale":"2024-06-13T11:20:27.529375+0000","last_undegraded":"2024-06-13T11:20:27.529375+0000","last_fullsized":"2024-06-13T11:20:27.529375+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:51:40.473020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'15","reported_seq":61,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525611+0000","last_change":"2024-06-13T11:18:38.483204+0000","last_active":"2024-06-13T11:20:27.525611+0000","last_peered":"2024-06-13T11:20:27.525611+0000","last_clean":"2024-06-13T11:20:27.525611+0000","last_became_active":"2024-06-13T11:18:38.482800+0000","last_became_peered":"2024-06-13T11:18:38.482800+0000","last_unstale":"2024-06-13T11:20:27.525611+0000","last_undegraded":"2024-06-13T11:20:27.525611+0000","last_fullsized":"2024-06-13T11:20:27.525611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:28:44.636201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.266630+0000","last_change":"2024-06-13T11:18:42.899944+0000","last_active":"2024-06-13T11:21:55.266630+0000","last_peered":"2024-06-13T11:21:55.266630+0000","last_clean":"2024-06-13T11:21:55.266630+0000","last_became_active":"2024-06-13T11:18:42.899551+0000","last_became_peered":"2024-06-13T11:18:42.899551+0000","last_unstale":"2024-06-13T11:21:55.266630+0000","last_undegraded":"2024-06-13T11:21:55.266630+0000","last_fullsized":"2024-06-13T11:21:55.266630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:18:21.109043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602168+0000","last_change":"2024-06-13T11:18:57.028817+0000","last_active":"2024-06-13T11:20:27.602168+0000","last_peered":"2024-06-13T11:20:27.602168+0000","last_clean":"2024-06-13T11:20:27.602168+0000","last_became_active":"2024-06-13T11:18:57.028433+0000","last_became_peered":"2024-06-13T11:18:57.028433+0000","last_unstale":"2024-06-13T11:20:27.602168+0000","last_undegraded":"2024-06-13T11:20:27.602168+0000","last_fullsized":"2024-06-13T11:20:27.602168+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:56:24.180096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526225+0000","last_change":"2024-06-13T11:18:38.165907+0000","last_active":"2024-06-13T11:20:27.526225+0000","last_peered":"2024-06-13T11:20:27.526225+0000","last_clean":"2024-06-13T11:20:27.526225+0000","last_became_active":"2024-06-13T11:18:38.165516+0000","last_became_peered":"2024-06-13T11:18:38.165516+0000","last_unstale":"2024-06-13T11:20:27.526225+0000","last_undegraded":"2024-06-13T11:20:27.526225+0000","last_fullsized":"2024-06-13T11:20:27.526225+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:51:15.774967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"99'5","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.256559+0000","last_change":"2024-06-13T11:19:27.004377+0000","last_active":"2024-06-13T11:21:55.256559+0000","last_peered":"2024-06-13T11:21:55.256559+0000","last_clean":"2024-06-13T11:21:55.256559+0000","last_became_active":"2024-06-13T11:19:27.003954+0000","last_became_peered":"2024-06-13T11:19:27.003954+0000","last_unstale":"2024-06-13T11:21:55.256559+0000","last_undegraded":"2024-06-13T11:21:55.256559+0000","last_fullsized":"2024-06-13T11:21:55.256559+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:53:25.967036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525662+0000","last_change":"2024-06-13T11:18:57.184912+0000","last_active":"2024-06-13T11:20:27.525662+0000","last_peered":"2024-06-13T11:20:27.525662+0000","last_clean":"2024-06-13T11:20:27.525662+0000","last_became_active":"2024-06-13T11:18:57.184442+0000","last_became_peered":"2024-06-13T11:18:57.184442+0000","last_unstale":"2024-06-13T11:20:27.525662+0000","last_undegraded":"2024-06-13T11:20:27.525662+0000","last_fullsized":"2024-06-13T11:20:27.525662+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:47:17.961086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767283+0000","last_change":"2024-06-13T11:18:38.484487+0000","last_active":"2024-06-13T11:20:27.767283+0000","last_peered":"2024-06-13T11:20:27.767283+0000","last_clean":"2024-06-13T11:20:27.767283+0000","last_became_active":"2024-06-13T11:18:38.483587+0000","last_became_peered":"2024-06-13T11:18:38.483587+0000","last_unstale":"2024-06-13T11:20:27.767283+0000","last_undegraded":"2024-06-13T11:20:27.767283+0000","last_fullsized":"2024-06-13T11:20:27.767283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:50:19.773340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.276032+0000","last_change":"2024-06-13T11:18:42.913275+0000","last_active":"2024-06-13T11:21:55.276032+0000","last_peered":"2024-06-13T11:21:55.276032+0000","last_clean":"2024-06-13T11:21:55.276032+0000","last_became_active":"2024-06-13T11:18:42.912880+0000","last_became_peered":"2024-06-13T11:18:42.912880+0000","last_unstale":"2024-06-13T11:21:55.276032+0000","last_undegraded":"2024-06-13T11:21:55.276032+0000","last_fullsized":"2024-06-13T11:21:55.276032+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:01:55.261976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528903+0000","last_change":"2024-06-13T11:18:57.027893+0000","last_active":"2024-06-13T11:20:27.528903+0000","last_peered":"2024-06-13T11:20:27.528903+0000","last_clean":"2024-06-13T11:20:27.528903+0000","last_became_active":"2024-06-13T11:18:57.025683+0000","last_became_peered":"2024-06-13T11:18:57.025683+0000","last_unstale":"2024-06-13T11:20:27.528903+0000","last_undegraded":"2024-06-13T11:20:27.528903+0000","last_fullsized":"2024-06-13T11:20:27.528903+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:25:59.348570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526081+0000","last_change":"2024-06-13T11:18:38.167932+0000","last_active":"2024-06-13T11:20:27.526081+0000","last_peered":"2024-06-13T11:20:27.526081+0000","last_clean":"2024-06-13T11:20:27.526081+0000","last_became_active":"2024-06-13T11:18:38.167520+0000","last_became_peered":"2024-06-13T11:18:38.167520+0000","last_unstale":"2024-06-13T11:20:27.526081+0000","last_undegraded":"2024-06-13T11:20:27.526081+0000","last_fullsized":"2024-06-13T11:20:27.526081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:00:04.537091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.254445+0000","last_change":"2024-06-13T11:18:42.923211+0000","last_active":"2024-06-13T11:21:55.254445+0000","last_peered":"2024-06-13T11:21:55.254445+0000","last_clean":"2024-06-13T11:21:55.254445+0000","last_became_active":"2024-06-13T11:18:42.922858+0000","last_became_peered":"2024-06-13T11:18:42.922858+0000","last_unstale":"2024-06-13T11:21:55.254445+0000","last_undegraded":"2024-06-13T11:21:55.254445+0000","last_fullsized":"2024-06-13T11:21:55.254445+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:56:18.163502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528851+0000","last_change":"2024-06-13T11:18:57.185071+0000","last_active":"2024-06-13T11:20:27.528851+0000","last_peered":"2024-06-13T11:20:27.528851+0000","last_clean":"2024-06-13T11:20:27.528851+0000","last_became_active":"2024-06-13T11:18:57.184526+0000","last_became_peered":"2024-06-13T11:18:57.184526+0000","last_unstale":"2024-06-13T11:20:27.528851+0000","last_undegraded":"2024-06-13T11:20:27.528851+0000","last_fullsized":"2024-06-13T11:20:27.528851+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:51:37.715832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.266829+0000","last_change":"2024-06-13T11:18:42.912483+0000","last_active":"2024-06-13T11:21:55.266829+0000","last_peered":"2024-06-13T11:21:55.266829+0000","last_clean":"2024-06-13T11:21:55.266829+0000","last_became_active":"2024-06-13T11:18:42.912117+0000","last_became_peered":"2024-06-13T11:18:42.912117+0000","last_unstale":"2024-06-13T11:21:55.266829+0000","last_undegraded":"2024-06-13T11:21:55.266829+0000","last_fullsized":"2024-06-13T11:21:55.266829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:23.769097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"99'5","reported_seq":170,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:22:08.674970+0000","last_change":"2024-06-13T11:18:38.483334+0000","last_active":"2024-06-13T11:22:08.674970+0000","last_peered":"2024-06-13T11:22:08.674970+0000","last_clean":"2024-06-13T11:22:08.674970+0000","last_became_active":"2024-06-13T11:18:38.482885+0000","last_became_peered":"2024-06-13T11:18:38.482885+0000","last_unstale":"2024-06-13T11:22:08.674970+0000","last_undegraded":"2024-06-13T11:22:08.674970+0000","last_fullsized":"2024-06-13T11:22:08.674970+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:55:19.986526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"97'1","reported_seq":30,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525950+0000","last_change":"2024-06-13T11:18:57.016960+0000","last_active":"2024-06-13T11:20:27.525950+0000","last_peered":"2024-06-13T11:20:27.525950+0000","last_clean":"2024-06-13T11:20:27.525950+0000","last_became_active":"2024-06-13T11:18:57.016490+0000","last_became_peered":"2024-06-13T11:18:57.016490+0000","last_unstale":"2024-06-13T11:20:27.525950+0000","last_undegraded":"2024-06-13T11:20:27.525950+0000","last_fullsized":"2024-06-13T11:20:27.525950+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:40:19.796594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.278617+0000","last_change":"2024-06-13T11:18:42.921581+0000","last_active":"2024-06-13T11:21:55.278617+0000","last_peered":"2024-06-13T11:21:55.278617+0000","last_clean":"2024-06-13T11:21:55.278617+0000","last_became_active":"2024-06-13T11:18:42.917820+0000","last_became_peered":"2024-06-13T11:18:42.917820+0000","last_unstale":"2024-06-13T11:21:55.278617+0000","last_undegraded":"2024-06-13T11:21:55.278617+0000","last_fullsized":"2024-06-13T11:21:55.278617+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:59:28.460363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'3","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.528941+0000","last_change":"2024-06-13T11:18:38.168111+0000","last_active":"2024-06-13T11:20:27.528941+0000","last_peered":"2024-06-13T11:20:27.528941+0000","last_clean":"2024-06-13T11:20:27.528941+0000","last_became_active":"2024-06-13T11:18:38.167732+0000","last_became_peered":"2024-06-13T11:18:38.167732+0000","last_unstale":"2024-06-13T11:20:27.528941+0000","last_undegraded":"2024-06-13T11:20:27.528941+0000","last_fullsized":"2024-06-13T11:20:27.528941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:36:55.993553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":378,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525505+0000","last_change":"2024-06-13T11:17:06.317849+0000","last_active":"2024-06-13T11:20:27.525505+0000","last_peered":"2024-06-13T11:20:27.525505+0000","last_clean":"2024-06-13T11:20:27.525505+0000","last_became_active":"2024-06-13T11:17:06.317293+0000","last_became_peered":"2024-06-13T11:17:06.317293+0000","last_unstale":"2024-06-13T11:20:27.525505+0000","last_undegraded":"2024-06-13T11:20:27.525505+0000","last_fullsized":"2024-06-13T11:20:27.525505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:13:14.002581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:13:14.002581+0000","last_clean_scrub_stamp":"2024-06-13T11:13:14.002581+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:54:32.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602868+0000","last_change":"2024-06-13T11:18:57.185880+0000","last_active":"2024-06-13T11:20:27.602868+0000","last_peered":"2024-06-13T11:20:27.602868+0000","last_clean":"2024-06-13T11:20:27.602868+0000","last_became_active":"2024-06-13T11:18:57.185140+0000","last_became_peered":"2024-06-13T11:18:57.185140+0000","last_unstale":"2024-06-13T11:20:27.602868+0000","last_undegraded":"2024-06-13T11:20:27.602868+0000","last_fullsized":"2024-06-13T11:20:27.602868+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:43:40.195809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"99'5","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.273900+0000","last_change":"2024-06-13T11:19:27.006408+0000","last_active":"2024-06-13T11:21:55.273900+0000","last_peered":"2024-06-13T11:21:55.273900+0000","last_clean":"2024-06-13T11:21:55.273900+0000","last_became_active":"2024-06-13T11:19:27.005525+0000","last_became_peered":"2024-06-13T11:19:27.005525+0000","last_unstale":"2024-06-13T11:21:55.273900+0000","last_undegraded":"2024-06-13T11:21:55.273900+0000","last_fullsized":"2024-06-13T11:21:55.273900+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:09:39.891543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525753+0000","last_change":"2024-06-13T11:18:38.171089+0000","last_active":"2024-06-13T11:20:27.525753+0000","last_peered":"2024-06-13T11:20:27.525753+0000","last_clean":"2024-06-13T11:20:27.525753+0000","last_became_active":"2024-06-13T11:18:38.170769+0000","last_became_peered":"2024-06-13T11:18:38.170769+0000","last_unstale":"2024-06-13T11:20:27.525753+0000","last_undegraded":"2024-06-13T11:20:27.525753+0000","last_fullsized":"2024-06-13T11:20:27.525753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:07:46.355159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899277+0000","last_change":"2024-06-13T11:18:57.015609+0000","last_active":"2024-06-13T11:20:27.899277+0000","last_peered":"2024-06-13T11:20:27.899277+0000","last_clean":"2024-06-13T11:20:27.899277+0000","last_became_active":"2024-06-13T11:18:57.015164+0000","last_became_peered":"2024-06-13T11:18:57.015164+0000","last_unstale":"2024-06-13T11:20:27.899277+0000","last_undegraded":"2024-06-13T11:20:27.899277+0000","last_fullsized":"2024-06-13T11:20:27.899277+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:32:15.725778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'1","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.526065+0000","last_change":"2024-06-13T11:18:38.483215+0000","last_active":"2024-06-13T11:20:27.526065+0000","last_peered":"2024-06-13T11:20:27.526065+0000","last_clean":"2024-06-13T11:20:27.526065+0000","last_became_active":"2024-06-13T11:18:38.482789+0000","last_became_peered":"2024-06-13T11:18:38.482789+0000","last_unstale":"2024-06-13T11:20:27.526065+0000","last_undegraded":"2024-06-13T11:20:27.526065+0000","last_fullsized":"2024-06-13T11:20:27.526065+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:01:58.020310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.275670+0000","last_change":"2024-06-13T11:18:42.914846+0000","last_active":"2024-06-13T11:21:55.275670+0000","last_peered":"2024-06-13T11:21:55.275670+0000","last_clean":"2024-06-13T11:21:55.275670+0000","last_became_active":"2024-06-13T11:18:42.912614+0000","last_became_peered":"2024-06-13T11:18:42.912614+0000","last_unstale":"2024-06-13T11:21:55.275670+0000","last_undegraded":"2024-06-13T11:21:55.275670+0000","last_fullsized":"2024-06-13T11:21:55.275670+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:00:13.066079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.902817+0000","last_change":"2024-06-13T11:18:57.185117+0000","last_active":"2024-06-13T11:20:27.902817+0000","last_peered":"2024-06-13T11:20:27.902817+0000","last_clean":"2024-06-13T11:20:27.902817+0000","last_became_active":"2024-06-13T11:18:57.184498+0000","last_became_peered":"2024-06-13T11:18:57.184498+0000","last_unstale":"2024-06-13T11:20:27.902817+0000","last_undegraded":"2024-06-13T11:20:27.902817+0000","last_fullsized":"2024-06-13T11:20:27.902817+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:04:28.800984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"99'12","reported_seq":57,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:51.924646+0000","last_change":"2024-06-13T11:18:38.176918+0000","last_active":"2024-06-13T11:20:51.924646+0000","last_peered":"2024-06-13T11:20:51.924646+0000","last_clean":"2024-06-13T11:20:51.924646+0000","last_became_active":"2024-06-13T11:18:38.176236+0000","last_became_peered":"2024-06-13T11:18:38.176236+0000","last_unstale":"2024-06-13T11:20:51.924646+0000","last_undegraded":"2024-06-13T11:20:51.924646+0000","last_fullsized":"2024-06-13T11:20:51.924646+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:10:20.684891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.274269+0000","last_change":"2024-06-13T11:18:42.920930+0000","last_active":"2024-06-13T11:21:55.274269+0000","last_peered":"2024-06-13T11:21:55.274269+0000","last_clean":"2024-06-13T11:21:55.274269+0000","last_became_active":"2024-06-13T11:18:42.915838+0000","last_became_peered":"2024-06-13T11:18:42.915838+0000","last_unstale":"2024-06-13T11:21:55.274269+0000","last_undegraded":"2024-06-13T11:21:55.274269+0000","last_fullsized":"2024-06-13T11:21:55.274269+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:07:43.483317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.530754+0000","last_change":"2024-06-13T11:18:57.009043+0000","last_active":"2024-06-13T11:20:27.530754+0000","last_peered":"2024-06-13T11:20:27.530754+0000","last_clean":"2024-06-13T11:20:27.530754+0000","last_became_active":"2024-06-13T11:18:57.008533+0000","last_became_peered":"2024-06-13T11:18:57.008533+0000","last_unstale":"2024-06-13T11:20:27.530754+0000","last_undegraded":"2024-06-13T11:20:27.530754+0000","last_fullsized":"2024-06-13T11:20:27.530754+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:30:29.614810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529247+0000","last_change":"2024-06-13T11:18:38.523042+0000","last_active":"2024-06-13T11:20:27.529247+0000","last_peered":"2024-06-13T11:20:27.529247+0000","last_clean":"2024-06-13T11:20:27.529247+0000","last_became_active":"2024-06-13T11:18:38.522673+0000","last_became_peered":"2024-06-13T11:18:38.522673+0000","last_unstale":"2024-06-13T11:20:27.529247+0000","last_undegraded":"2024-06-13T11:20:27.529247+0000","last_fullsized":"2024-06-13T11:20:27.529247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:25:50.725281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.282787+0000","last_change":"2024-06-13T11:18:42.934090+0000","last_active":"2024-06-13T11:21:55.282787+0000","last_peered":"2024-06-13T11:21:55.282787+0000","last_clean":"2024-06-13T11:21:55.282787+0000","last_became_active":"2024-06-13T11:18:42.933680+0000","last_became_peered":"2024-06-13T11:18:42.933680+0000","last_unstale":"2024-06-13T11:21:55.282787+0000","last_undegraded":"2024-06-13T11:21:55.282787+0000","last_fullsized":"2024-06-13T11:21:55.282787+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:39:30.214272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529069+0000","last_change":"2024-06-13T11:18:57.185186+0000","last_active":"2024-06-13T11:20:27.529069+0000","last_peered":"2024-06-13T11:20:27.529069+0000","last_clean":"2024-06-13T11:20:27.529069+0000","last_became_active":"2024-06-13T11:18:57.184448+0000","last_became_peered":"2024-06-13T11:18:57.184448+0000","last_unstale":"2024-06-13T11:20:27.529069+0000","last_undegraded":"2024-06-13T11:20:27.529069+0000","last_fullsized":"2024-06-13T11:20:27.529069+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:18:32.514993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":53,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.898853+0000","last_change":"2024-06-13T11:19:26.999451+0000","last_active":"2024-06-13T11:20:27.898853+0000","last_peered":"2024-06-13T11:20:27.898853+0000","last_clean":"2024-06-13T11:20:27.898853+0000","last_became_active":"2024-06-13T11:19:26.999153+0000","last_became_peered":"2024-06-13T11:19:26.999153+0000","last_unstale":"2024-06-13T11:20:27.898853+0000","last_undegraded":"2024-06-13T11:20:27.898853+0000","last_fullsized":"2024-06-13T11:20:27.898853+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:42:34.755569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.222871+0000","last_change":"2024-06-13T11:18:42.903741+0000","last_active":"2024-06-13T11:21:55.222871+0000","last_peered":"2024-06-13T11:21:55.222871+0000","last_clean":"2024-06-13T11:21:55.222871+0000","last_became_active":"2024-06-13T11:18:42.903351+0000","last_became_peered":"2024-06-13T11:18:42.903351+0000","last_unstale":"2024-06-13T11:21:55.222871+0000","last_undegraded":"2024-06-13T11:21:55.222871+0000","last_fullsized":"2024-06-13T11:21:55.222871+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:47:21.206540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.767485+0000","last_change":"2024-06-13T11:18:57.035149+0000","last_active":"2024-06-13T11:20:27.767485+0000","last_peered":"2024-06-13T11:20:27.767485+0000","last_clean":"2024-06-13T11:20:27.767485+0000","last_became_active":"2024-06-13T11:18:57.033208+0000","last_became_peered":"2024-06-13T11:18:57.033208+0000","last_unstale":"2024-06-13T11:20:27.767485+0000","last_undegraded":"2024-06-13T11:20:27.767485+0000","last_fullsized":"2024-06-13T11:20:27.767485+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:19:01.353814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.902458+0000","last_change":"2024-06-13T11:18:38.170464+0000","last_active":"2024-06-13T11:20:27.902458+0000","last_peered":"2024-06-13T11:20:27.902458+0000","last_clean":"2024-06-13T11:20:27.902458+0000","last_became_active":"2024-06-13T11:18:38.169945+0000","last_became_peered":"2024-06-13T11:18:38.169945+0000","last_unstale":"2024-06-13T11:20:27.902458+0000","last_undegraded":"2024-06-13T11:20:27.902458+0000","last_fullsized":"2024-06-13T11:20:27.902458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:53:20.112176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.280073+0000","last_change":"2024-06-13T11:18:42.925391+0000","last_active":"2024-06-13T11:21:55.280073+0000","last_peered":"2024-06-13T11:21:55.280073+0000","last_clean":"2024-06-13T11:21:55.280073+0000","last_became_active":"2024-06-13T11:18:42.924900+0000","last_became_peered":"2024-06-13T11:18:42.924900+0000","last_unstale":"2024-06-13T11:21:55.280073+0000","last_undegraded":"2024-06-13T11:21:55.280073+0000","last_fullsized":"2024-06-13T11:21:55.280073+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:10.954502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"99'1","reported_seq":30,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:30.009666+0000","last_change":"2024-06-13T11:18:57.029448+0000","last_active":"2024-06-13T11:20:30.009666+0000","last_peered":"2024-06-13T11:20:30.009666+0000","last_clean":"2024-06-13T11:20:30.009666+0000","last_became_active":"2024-06-13T11:18:57.028918+0000","last_became_peered":"2024-06-13T11:18:57.028918+0000","last_unstale":"2024-06-13T11:20:30.009666+0000","last_undegraded":"2024-06-13T11:20:30.009666+0000","last_fullsized":"2024-06-13T11:20:30.009666+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:53:06.206458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"97'1","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.899218+0000","last_change":"2024-06-13T11:19:27.078724+0000","last_active":"2024-06-13T11:20:27.899218+0000","last_peered":"2024-06-13T11:20:27.899218+0000","last_clean":"2024-06-13T11:20:27.899218+0000","last_became_active":"2024-06-13T11:19:27.078329+0000","last_became_peered":"2024-06-13T11:19:27.078329+0000","last_unstale":"2024-06-13T11:20:27.899218+0000","last_undegraded":"2024-06-13T11:20:27.899218+0000","last_fullsized":"2024-06-13T11:20:27.899218+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:25:38.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.282654+0000","last_change":"2024-06-13T11:18:42.930769+0000","last_active":"2024-06-13T11:21:55.282654+0000","last_peered":"2024-06-13T11:21:55.282654+0000","last_clean":"2024-06-13T11:21:55.282654+0000","last_became_active":"2024-06-13T11:18:42.928727+0000","last_became_peered":"2024-06-13T11:18:42.928727+0000","last_unstale":"2024-06-13T11:21:55.282654+0000","last_undegraded":"2024-06-13T11:21:55.282654+0000","last_fullsized":"2024-06-13T11:21:55.282654+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:14:55.202237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529447+0000","last_change":"2024-06-13T11:18:57.185071+0000","last_active":"2024-06-13T11:20:27.529447+0000","last_peered":"2024-06-13T11:20:27.529447+0000","last_clean":"2024-06-13T11:20:27.529447+0000","last_became_active":"2024-06-13T11:18:57.184534+0000","last_became_peered":"2024-06-13T11:18:57.184534+0000","last_unstale":"2024-06-13T11:20:27.529447+0000","last_undegraded":"2024-06-13T11:20:27.529447+0000","last_fullsized":"2024-06-13T11:20:27.529447+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:55:11.146525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.525732+0000","last_change":"2024-06-13T11:18:38.167734+0000","last_active":"2024-06-13T11:20:27.525732+0000","last_peered":"2024-06-13T11:20:27.525732+0000","last_clean":"2024-06-13T11:20:27.525732+0000","last_became_active":"2024-06-13T11:18:38.167345+0000","last_became_peered":"2024-06-13T11:18:38.167345+0000","last_unstale":"2024-06-13T11:20:27.525732+0000","last_undegraded":"2024-06-13T11:20:27.525732+0000","last_fullsized":"2024-06-13T11:20:27.525732+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:55:43.155928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.276715+0000","last_change":"2024-06-13T11:18:42.900884+0000","last_active":"2024-06-13T11:21:55.276715+0000","last_peered":"2024-06-13T11:21:55.276715+0000","last_clean":"2024-06-13T11:21:55.276715+0000","last_became_active":"2024-06-13T11:18:42.900562+0000","last_became_peered":"2024-06-13T11:18:42.900562+0000","last_unstale":"2024-06-13T11:21:55.276715+0000","last_undegraded":"2024-06-13T11:21:55.276715+0000","last_fullsized":"2024-06-13T11:21:55.276715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:38:59.480693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.898930+0000","last_change":"2024-06-13T11:18:57.015496+0000","last_active":"2024-06-13T11:20:27.898930+0000","last_peered":"2024-06-13T11:20:27.898930+0000","last_clean":"2024-06-13T11:20:27.898930+0000","last_became_active":"2024-06-13T11:18:57.015079+0000","last_became_peered":"2024-06-13T11:18:57.015079+0000","last_unstale":"2024-06-13T11:20:27.898930+0000","last_undegraded":"2024-06-13T11:20:27.898930+0000","last_fullsized":"2024-06-13T11:20:27.898930+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:31:40.130018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"97'3","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.531565+0000","last_change":"2024-06-13T11:18:38.523097+0000","last_active":"2024-06-13T11:20:27.531565+0000","last_peered":"2024-06-13T11:20:27.531565+0000","last_clean":"2024-06-13T11:20:27.531565+0000","last_became_active":"2024-06-13T11:18:38.522638+0000","last_became_peered":"2024-06-13T11:18:38.522638+0000","last_unstale":"2024-06-13T11:20:27.531565+0000","last_undegraded":"2024-06-13T11:20:27.531565+0000","last_fullsized":"2024-06-13T11:20:27.531565+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:35:36.843246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.262417+0000","last_change":"2024-06-13T11:18:42.899281+0000","last_active":"2024-06-13T11:21:55.262417+0000","last_peered":"2024-06-13T11:21:55.262417+0000","last_clean":"2024-06-13T11:21:55.262417+0000","last_became_active":"2024-06-13T11:18:42.898924+0000","last_became_peered":"2024-06-13T11:18:42.898924+0000","last_unstale":"2024-06-13T11:21:55.262417+0000","last_undegraded":"2024-06-13T11:21:55.262417+0000","last_fullsized":"2024-06-13T11:21:55.262417+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:18:10.324425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:28.112859+0000","last_change":"2024-06-13T11:18:57.037070+0000","last_active":"2024-06-13T11:20:28.112859+0000","last_peered":"2024-06-13T11:20:28.112859+0000","last_clean":"2024-06-13T11:20:28.112859+0000","last_became_active":"2024-06-13T11:18:57.036632+0000","last_became_peered":"2024-06-13T11:18:57.036632+0000","last_unstale":"2024-06-13T11:20:28.112859+0000","last_undegraded":"2024-06-13T11:20:28.112859+0000","last_fullsized":"2024-06-13T11:20:28.112859+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:19:35.433902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"88'1","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.603183+0000","last_change":"2024-06-13T11:18:38.170790+0000","last_active":"2024-06-13T11:20:27.603183+0000","last_peered":"2024-06-13T11:20:27.603183+0000","last_clean":"2024-06-13T11:20:27.603183+0000","last_became_active":"2024-06-13T11:18:38.170260+0000","last_became_peered":"2024-06-13T11:18:38.170260+0000","last_unstale":"2024-06-13T11:20:27.603183+0000","last_undegraded":"2024-06-13T11:20:27.603183+0000","last_fullsized":"2024-06-13T11:20:27.603183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:11:44.070550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.272574+0000","last_change":"2024-06-13T11:18:42.906969+0000","last_active":"2024-06-13T11:21:55.272574+0000","last_peered":"2024-06-13T11:21:55.272574+0000","last_clean":"2024-06-13T11:21:55.272574+0000","last_became_active":"2024-06-13T11:18:42.906657+0000","last_became_peered":"2024-06-13T11:18:42.906657+0000","last_unstale":"2024-06-13T11:21:55.272574+0000","last_undegraded":"2024-06-13T11:21:55.272574+0000","last_fullsized":"2024-06-13T11:21:55.272574+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:30:36.414377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.602012+0000","last_change":"2024-06-13T11:18:57.007226+0000","last_active":"2024-06-13T11:20:27.602012+0000","last_peered":"2024-06-13T11:20:27.602012+0000","last_clean":"2024-06-13T11:20:27.602012+0000","last_became_active":"2024-06-13T11:18:57.006803+0000","last_became_peered":"2024-06-13T11:18:57.006803+0000","last_unstale":"2024-06-13T11:20:27.602012+0000","last_undegraded":"2024-06-13T11:20:27.602012+0000","last_fullsized":"2024-06-13T11:20:27.602012+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:08:28.913145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:20:27.529634+0000","last_change":"2024-06-13T11:18:38.173327+0000","last_active":"2024-06-13T11:20:27.529634+0000","last_peered":"2024-06-13T11:20:27.529634+0000","last_clean":"2024-06-13T11:20:27.529634+0000","last_became_active":"2024-06-13T11:18:38.172786+0000","last_became_peered":"2024-06-13T11:18:38.172786+0000","last_unstale":"2024-06-13T11:20:27.529634+0000","last_undegraded":"2024-06-13T11:20:27.529634+0000","last_fullsized":"2024-06-13T11:20:27.529634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:40:30.330272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.253488+0000","last_change":"2024-06-13T11:18:42.899816+0000","last_active":"2024-06-13T11:21:55.253488+0000","last_peered":"2024-06-13T11:21:55.253488+0000","last_clean":"2024-06-13T11:21:55.253488+0000","last_became_active":"2024-06-13T11:18:42.899495+0000","last_became_peered":"2024-06-13T11:18:42.899495+0000","last_unstale":"2024-06-13T11:21:55.253488+0000","last_undegraded":"2024-06-13T11:21:55.253488+0000","last_fullsized":"2024-06-13T11:21:55.253488+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:16:08.303616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.266264+0000","last_change":"2024-06-13T11:18:42.909944+0000","last_active":"2024-06-13T11:21:55.266264+0000","last_peered":"2024-06-13T11:21:55.266264+0000","last_clean":"2024-06-13T11:21:55.266264+0000","last_became_active":"2024-06-13T11:18:42.909557+0000","last_became_peered":"2024-06-13T11:18:42.909557+0000","last_unstale":"2024-06-13T11:21:55.266264+0000","last_undegraded":"2024-06-13T11:21:55.266264+0000","last_fullsized":"2024-06-13T11:21:55.266264+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:22:07.093462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"99'12","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.256265+0000","last_change":"2024-06-13T11:18:42.912462+0000","last_active":"2024-06-13T11:21:55.256265+0000","last_peered":"2024-06-13T11:21:55.256265+0000","last_clean":"2024-06-13T11:21:55.256265+0000","last_became_active":"2024-06-13T11:18:42.912110+0000","last_became_peered":"2024-06-13T11:18:42.912110+0000","last_unstale":"2024-06-13T11:21:55.256265+0000","last_undegraded":"2024-06-13T11:21:55.256265+0000","last_fullsized":"2024-06-13T11:21:55.256265+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:11:33.123305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.281346+0000","last_change":"2024-06-13T11:18:42.924224+0000","last_active":"2024-06-13T11:21:55.281346+0000","last_peered":"2024-06-13T11:21:55.281346+0000","last_clean":"2024-06-13T11:21:55.281346+0000","last_became_active":"2024-06-13T11:18:42.923858+0000","last_became_peered":"2024-06-13T11:18:42.923858+0000","last_unstale":"2024-06-13T11:21:55.281346+0000","last_undegraded":"2024-06-13T11:21:55.281346+0000","last_fullsized":"2024-06-13T11:21:55.281346+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:36:11.602930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.282509+0000","last_change":"2024-06-13T11:18:42.921160+0000","last_active":"2024-06-13T11:21:55.282509+0000","last_peered":"2024-06-13T11:21:55.282509+0000","last_clean":"2024-06-13T11:21:55.282509+0000","last_became_active":"2024-06-13T11:18:42.920704+0000","last_became_peered":"2024-06-13T11:18:42.920704+0000","last_unstale":"2024-06-13T11:21:55.282509+0000","last_undegraded":"2024-06-13T11:21:55.282509+0000","last_fullsized":"2024-06-13T11:21:55.282509+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:07:17.023390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.284434+0000","last_change":"2024-06-13T11:18:42.923637+0000","last_active":"2024-06-13T11:21:55.284434+0000","last_peered":"2024-06-13T11:21:55.284434+0000","last_clean":"2024-06-13T11:21:55.284434+0000","last_became_active":"2024-06-13T11:18:42.923234+0000","last_became_peered":"2024-06-13T11:18:42.923234+0000","last_unstale":"2024-06-13T11:21:55.284434+0000","last_undegraded":"2024-06-13T11:21:55.284434+0000","last_fullsized":"2024-06-13T11:21:55.284434+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:51:19.676747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.259989+0000","last_change":"2024-06-13T11:18:42.910300+0000","last_active":"2024-06-13T11:21:55.259989+0000","last_peered":"2024-06-13T11:21:55.259989+0000","last_clean":"2024-06-13T11:21:55.259989+0000","last_became_active":"2024-06-13T11:18:42.909937+0000","last_became_peered":"2024-06-13T11:18:42.909937+0000","last_unstale":"2024-06-13T11:21:55.259989+0000","last_undegraded":"2024-06-13T11:21:55.259989+0000","last_fullsized":"2024-06-13T11:21:55.259989+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:24:51.407238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.264871+0000","last_change":"2024-06-13T11:18:42.907066+0000","last_active":"2024-06-13T11:21:55.264871+0000","last_peered":"2024-06-13T11:21:55.264871+0000","last_clean":"2024-06-13T11:21:55.264871+0000","last_became_active":"2024-06-13T11:18:42.906582+0000","last_became_peered":"2024-06-13T11:18:42.906582+0000","last_unstale":"2024-06-13T11:21:55.264871+0000","last_undegraded":"2024-06-13T11:21:55.264871+0000","last_fullsized":"2024-06-13T11:21:55.264871+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:40:02.549931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.272944+0000","last_change":"2024-06-13T11:18:42.910290+0000","last_active":"2024-06-13T11:21:55.272944+0000","last_peered":"2024-06-13T11:21:55.272944+0000","last_clean":"2024-06-13T11:21:55.272944+0000","last_became_active":"2024-06-13T11:18:42.909772+0000","last_became_peered":"2024-06-13T11:18:42.909772+0000","last_unstale":"2024-06-13T11:21:55.272944+0000","last_undegraded":"2024-06-13T11:21:55.272944+0000","last_fullsized":"2024-06-13T11:21:55.272944+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:05:56.008087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.274865+0000","last_change":"2024-06-13T11:18:42.928792+0000","last_active":"2024-06-13T11:21:55.274865+0000","last_peered":"2024-06-13T11:21:55.274865+0000","last_clean":"2024-06-13T11:21:55.274865+0000","last_became_active":"2024-06-13T11:18:42.928464+0000","last_became_peered":"2024-06-13T11:18:42.928464+0000","last_unstale":"2024-06-13T11:21:55.274865+0000","last_undegraded":"2024-06-13T11:21:55.274865+0000","last_fullsized":"2024-06-13T11:21:55.274865+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:01:58.686124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.273212+0000","last_change":"2024-06-13T11:18:42.920719+0000","last_active":"2024-06-13T11:21:55.273212+0000","last_peered":"2024-06-13T11:21:55.273212+0000","last_clean":"2024-06-13T11:21:55.273212+0000","last_became_active":"2024-06-13T11:18:42.913355+0000","last_became_peered":"2024-06-13T11:18:42.913355+0000","last_unstale":"2024-06-13T11:21:55.273212+0000","last_undegraded":"2024-06-13T11:21:55.273212+0000","last_fullsized":"2024-06-13T11:21:55.273212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:25:00.020936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.278245+0000","last_change":"2024-06-13T11:18:42.906709+0000","last_active":"2024-06-13T11:21:55.278245+0000","last_peered":"2024-06-13T11:21:55.278245+0000","last_clean":"2024-06-13T11:21:55.278245+0000","last_became_active":"2024-06-13T11:18:42.906309+0000","last_became_peered":"2024-06-13T11:18:42.906309+0000","last_unstale":"2024-06-13T11:21:55.278245+0000","last_undegraded":"2024-06-13T11:21:55.278245+0000","last_fullsized":"2024-06-13T11:21:55.278245+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:09.255670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.283425+0000","last_change":"2024-06-13T11:18:42.926939+0000","last_active":"2024-06-13T11:21:55.283425+0000","last_peered":"2024-06-13T11:21:55.283425+0000","last_clean":"2024-06-13T11:21:55.283425+0000","last_became_active":"2024-06-13T11:18:42.926616+0000","last_became_peered":"2024-06-13T11:18:42.926616+0000","last_unstale":"2024-06-13T11:21:55.283425+0000","last_undegraded":"2024-06-13T11:21:55.283425+0000","last_fullsized":"2024-06-13T11:21:55.283425+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:52:46.468479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-13T11:21:55.253710+0000","last_change":"2024-06-13T11:18:42.901103+0000","last_active":"2024-06-13T11:21:55.253710+0000","last_peered":"2024-06-13T11:21:55.253710+0000","last_clean":"2024-06-13T11:21:55.253710+0000","last_became_active":"2024-06-13T11:18:42.900726+0000","last_became_peered":"2024-06-13T11:18:42.900726+0000","last_unstale":"2024-06-13T11:21:55.253710+0000","last_undegraded":"2024-06-13T11:21:55.253710+0000","last_fullsized":"2024-06-13T11:21:55.253710+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:55.895451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285250,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68470,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":740,"num_read_kb":443,"num_write":179,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":205410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383740,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1093632,"data_stored":569642,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645375,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36548,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708604,"statfs":{"total":95995035648,"available":95957610496,"internally_reserved":0,"allocated":1241088,"data_stored":1221239,"data_compressed":68781,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808901,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1114112,"data_stored":573974,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070540,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":569798,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332177,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1159168,"data_stored":1166378,"data_compressed":68781,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495704,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1089536,"data_stored":565054,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574964,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32308,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712844,"statfs":{"total":95995035648,"available":95961952256,"internally_reserved":0,"allocated":1159168,"data_stored":628762,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738489,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":566442,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411437,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36492,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708660,"statfs":{"total":95995035648,"available":95957667840,"internally_reserved":0,"allocated":1183744,"data_stored":630643,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182503,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":565248,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920866,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1101824,"data_stored":570235,"data_compressed":32509,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757342,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36476,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708676,"statfs":{"total":95995035648,"available":95957684224,"internally_reserved":0,"allocated":1167360,"data_stored":1161435,"data_compressed":68781,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34630,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34630,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34630,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T11:22:13.303 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-13T11:22:13.303 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-13T11:22:13.303 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-06-13T11:22:13.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph health --format=json 2024-06-13T11:22:13.817 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:22:14.172 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:13 smithi002 ceph-mon[32210]: from='client.24905 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:22:14.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:13 smithi178 ceph-mon[36913]: from='client.24905 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:22:14.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:13 smithi077 ceph-mon[36410]: from='client.24905 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:22:15.190 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:14 smithi002 ceph-mon[32210]: pgmap v443: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:22:15.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:14 smithi178 ceph-mon[36913]: pgmap v443: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:22:15.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:14 smithi077 ceph-mon[36410]: pgmap v443: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:22:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.101+0000 7fd02a200700 1 -- 172.21.15.2:0/3112720283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd024105070 msgr2=0x7fd024111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.101+0000 7fd02a200700 1 --2- 172.21.15.2:0/3112720283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd024105070 0x7fd024111580 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00b0a0 tx=0x7fd01c00b3b0 comp rx=0 tx=0).stop 2024-06-13T11:22:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.101+0000 7fd02a200700 1 -- 172.21.15.2:0/3112720283 shutdown_connections 2024-06-13T11:22:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.101+0000 7fd02a200700 1 --2- 172.21.15.2:0/3112720283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd024105070 0x7fd024111580 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.101+0000 7fd02a200700 1 --2- 172.21.15.2:0/3112720283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd02410a6b0 0x7fd02410aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.101+0000 7fd02a200700 1 --2- 172.21.15.2:0/3112720283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0241046b0 0x7fd024104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.101+0000 7fd02a200700 1 -- 172.21.15.2:0/3112720283 >> 172.21.15.2:0/3112720283 conn(0x7fd0241001a0 msgr2=0x7fd0241025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.101+0000 7fd02a200700 1 -- 172.21.15.2:0/3112720283 shutdown_connections 2024-06-13T11:22:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.101+0000 7fd02a200700 1 -- 172.21.15.2:0/3112720283 wait complete. 2024-06-13T11:22:16.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.103+0000 7fd02a200700 1 Processor -- start 2024-06-13T11:22:16.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.103+0000 7fd02a200700 1 -- start start 2024-06-13T11:22:16.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.103+0000 7fd02a200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0241046b0 0x7fd02419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:16.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.103+0000 7fd02a200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd024105070 0x7fd02419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:16.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.103+0000 7fd02a200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd02410a6b0 0x7fd02419f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:16.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.103+0000 7fd02a200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd024114a40 con 0x7fd02410a6b0 2024-06-13T11:22:16.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.103+0000 7fd02a200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd0241148c0 con 0x7fd024105070 2024-06-13T11:22:16.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.103+0000 7fd02a200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd024114bc0 con 0x7fd0241046b0 2024-06-13T11:22:16.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.104+0000 7fd023e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd02410a6b0 0x7fd02419f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:16.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.104+0000 7fd023400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0241046b0 0x7fd02419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:16.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.104+0000 7fd023e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd02410a6b0 0x7fd02419f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37388/0 (socket says 172.21.15.2:37388) 2024-06-13T11:22:16.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.104+0000 7fd023e00700 1 -- 172.21.15.2:0/885694963 learned_addr learned my addr 172.21.15.2:0/885694963 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:16.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.104+0000 7fd022a00700 1 --2- 172.21.15.2:0/885694963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd024105070 0x7fd02419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:16.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.104+0000 7fd022a00700 1 -- 172.21.15.2:0/885694963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0241046b0 msgr2=0x7fd02419ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:16.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.104+0000 7fd022a00700 1 --2- 172.21.15.2:0/885694963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0241046b0 0x7fd02419ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:16.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.104+0000 7fd022a00700 1 -- 172.21.15.2:0/885694963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd02410a6b0 msgr2=0x7fd02419f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:16.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.104+0000 7fd022a00700 1 --2- 172.21.15.2:0/885694963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd02410a6b0 0x7fd02419f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:16.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.104+0000 7fd022a00700 1 -- 172.21.15.2:0/885694963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02419fe20 con 0x7fd024105070 2024-06-13T11:22:16.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.104+0000 7fd023e00700 1 --2- 172.21.15.2:0/885694963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd02410a6b0 0x7fd02419f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:22:16.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.105+0000 7fd022a00700 1 --2- 172.21.15.2:0/885694963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd024105070 0x7fd02419b350 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd01000e9f0 tx=0x7fd01000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:16.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.105+0000 7fd01be00700 1 -- 172.21.15.2:0/885694963 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01000c9c0 con 0x7fd024105070 2024-06-13T11:22:16.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.105+0000 7fd01be00700 1 -- 172.21.15.2:0/885694963 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd01000cb60 con 0x7fd024105070 2024-06-13T11:22:16.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.105+0000 7fd01be00700 1 -- 172.21.15.2:0/885694963 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd010018680 con 0x7fd024105070 2024-06-13T11:22:16.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.105+0000 7fd02a200700 1 -- 172.21.15.2:0/885694963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0241a0110 con 0x7fd024105070 2024-06-13T11:22:16.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.105+0000 7fd02a200700 1 -- 172.21.15.2:0/885694963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0241a7990 con 0x7fd024105070 2024-06-13T11:22:16.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.106+0000 7fd02a200700 1 -- 172.21.15.2:0/885694963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd024069180 con 0x7fd024105070 2024-06-13T11:22:16.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.109+0000 7fd01be00700 1 -- 172.21.15.2:0/885694963 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fd010010430 con 0x7fd024105070 2024-06-13T11:22:16.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.110+0000 7fd01be00700 1 --2- 172.21.15.2:0/885694963 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd0080a2ca0 0x7fd0080a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:16.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.110+0000 7fd01be00700 1 -- 172.21.15.2:0/885694963 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fd0100cf4b0 con 0x7fd024105070 2024-06-13T11:22:16.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.110+0000 7fd023400700 1 --2- 172.21.15.2:0/885694963 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd0080a2ca0 0x7fd0080a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:16.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.111+0000 7fd023400700 1 --2- 172.21.15.2:0/885694963 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd0080a2ca0 0x7fd0080a5160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd014009680 tx=0x7fd014009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:16.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.114+0000 7fd01be00700 1 -- 172.21.15.2:0/885694963 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd01009c020 con 0x7fd024105070 2024-06-13T11:22:16.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.395+0000 7fd02a200700 1 -- 172.21.15.2:0/885694963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd0241a7bf0 con 0x7fd024105070 2024-06-13T11:22:16.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.396+0000 7fd01be00700 1 -- 172.21.15.2:0/885694963 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd01009b920 con 0x7fd024105070 2024-06-13T11:22:16.396 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:22:16.396 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-13T11:22:16.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.399+0000 7fd02a200700 1 -- 172.21.15.2:0/885694963 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd0080a2ca0 msgr2=0x7fd0080a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:16.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.399+0000 7fd02a200700 1 --2- 172.21.15.2:0/885694963 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd0080a2ca0 0x7fd0080a5160 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd014009680 tx=0x7fd014009260 comp rx=0 tx=0).stop 2024-06-13T11:22:16.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.399+0000 7fd02a200700 1 -- 172.21.15.2:0/885694963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd024105070 msgr2=0x7fd02419b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:16.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.399+0000 7fd02a200700 1 --2- 172.21.15.2:0/885694963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd024105070 0x7fd02419b350 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd01000e9f0 tx=0x7fd01000ed00 comp rx=0 tx=0).stop 2024-06-13T11:22:16.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.400+0000 7fd02a200700 1 -- 172.21.15.2:0/885694963 shutdown_connections 2024-06-13T11:22:16.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.400+0000 7fd02a200700 1 --2- 172.21.15.2:0/885694963 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd0080a2ca0 0x7fd0080a5160 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:16.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.400+0000 7fd02a200700 1 --2- 172.21.15.2:0/885694963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd02410a6b0 0x7fd02419f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:16.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.400+0000 7fd02a200700 1 --2- 172.21.15.2:0/885694963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0241046b0 0x7fd02419ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:16.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.400+0000 7fd02a200700 1 --2- 172.21.15.2:0/885694963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd024105070 0x7fd02419b350 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:16.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.400+0000 7fd02a200700 1 -- 172.21.15.2:0/885694963 >> 172.21.15.2:0/885694963 conn(0x7fd0241001a0 msgr2=0x7fd024100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:16.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.400+0000 7fd02a200700 1 -- 172.21.15.2:0/885694963 shutdown_connections 2024-06-13T11:22:16.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:16.400+0000 7fd02a200700 1 -- 172.21.15.2:0/885694963 wait complete. 2024-06-13T11:22:17.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:16 smithi002 ceph-mon[32210]: pgmap v444: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:17.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:16 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/885694963' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-13T11:22:17.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:16 smithi178 ceph-mon[36913]: pgmap v444: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:17.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:16 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/885694963' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-13T11:22:17.232 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-06-13T11:22:17.233 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:22:17.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:16 smithi077 ceph-mon[36410]: pgmap v444: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:17.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:16 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/885694963' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-13T11:22:17.703 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:22:19.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:18 smithi002 ceph-mon[32210]: pgmap v445: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:22:19.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:18 smithi178 ceph-mon[36913]: pgmap v445: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:22:19.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:18 smithi077 ceph-mon[36410]: pgmap v445: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:22:20.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.023+0000 7fe309400700 1 -- 172.21.15.2:0/1990761378 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f400bc40 con 0x7fe30c1046b0 2024-06-13T11:22:20.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.024+0000 7fe311000700 1 -- 172.21.15.2:0/1990761378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c1046b0 msgr2=0x7fe30c104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:20.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.024+0000 7fe311000700 1 --2- 172.21.15.2:0/1990761378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c1046b0 0x7fe30c104b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009990 tx=0x7fe2f4009ca0 comp rx=0 tx=0).stop 2024-06-13T11:22:20.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.024+0000 7fe311000700 1 -- 172.21.15.2:0/1990761378 shutdown_connections 2024-06-13T11:22:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.024+0000 7fe311000700 1 --2- 172.21.15.2:0/1990761378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe30c105070 0x7fe30c111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.024+0000 7fe311000700 1 --2- 172.21.15.2:0/1990761378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c10a6b0 0x7fe30c10aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.024+0000 7fe311000700 1 --2- 172.21.15.2:0/1990761378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c1046b0 0x7fe30c104b30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.024+0000 7fe311000700 1 -- 172.21.15.2:0/1990761378 >> 172.21.15.2:0/1990761378 conn(0x7fe30c1001a0 msgr2=0x7fe30c1025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.024+0000 7fe311000700 1 -- 172.21.15.2:0/1990761378 shutdown_connections 2024-06-13T11:22:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.024+0000 7fe311000700 1 -- 172.21.15.2:0/1990761378 wait complete. 2024-06-13T11:22:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.026+0000 7fe311000700 1 Processor -- start 2024-06-13T11:22:20.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.026+0000 7fe311000700 1 -- start start 2024-06-13T11:22:20.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.026+0000 7fe311000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe30c1046b0 0x7fe30c19add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:20.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.026+0000 7fe311000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c105070 0x7fe30c19b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:20.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.026+0000 7fe311000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c10a6b0 0x7fe30c19f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:20.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.026+0000 7fe311000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c1149e0 con 0x7fe30c105070 2024-06-13T11:22:20.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.026+0000 7fe311000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c114860 con 0x7fe30c10a6b0 2024-06-13T11:22:20.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.026+0000 7fe311000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c114b60 con 0x7fe30c1046b0 2024-06-13T11:22:20.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.027+0000 7fe303e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c105070 0x7fe30c19b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:20.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.027+0000 7fe303e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c105070 0x7fe30c19b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37402/0 (socket says 172.21.15.2:37402) 2024-06-13T11:22:20.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.027+0000 7fe30a800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c10a6b0 0x7fe30c19f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:20.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.027+0000 7fe303e00700 1 -- 172.21.15.2:0/1951079767 learned_addr learned my addr 172.21.15.2:0/1951079767 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:20.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.027+0000 7fe309e00700 1 --2- 172.21.15.2:0/1951079767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe30c1046b0 0x7fe30c19add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:20.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.027+0000 7fe30a800700 1 -- 172.21.15.2:0/1951079767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe30c1046b0 msgr2=0x7fe30c19add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:20.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.027+0000 7fe30a800700 1 --2- 172.21.15.2:0/1951079767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe30c1046b0 0x7fe30c19add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:20.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.027+0000 7fe30a800700 1 -- 172.21.15.2:0/1951079767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c105070 msgr2=0x7fe30c19b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:20.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.027+0000 7fe30a800700 1 --2- 172.21.15.2:0/1951079767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c105070 0x7fe30c19b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:20.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.027+0000 7fe30a800700 1 -- 172.21.15.2:0/1951079767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c19fde0 con 0x7fe30c10a6b0 2024-06-13T11:22:20.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.027+0000 7fe30a800700 1 --2- 172.21.15.2:0/1951079767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c10a6b0 0x7fe30c19f6a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe30400efc0 tx=0x7fe30400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:20.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.028+0000 7fe302a00700 1 -- 172.21.15.2:0/1951079767 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3040092e0 con 0x7fe30c10a6b0 2024-06-13T11:22:20.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.028+0000 7fe302a00700 1 -- 172.21.15.2:0/1951079767 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe304004bb0 con 0x7fe30c10a6b0 2024-06-13T11:22:20.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.028+0000 7fe311000700 1 -- 172.21.15.2:0/1951079767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30c1a0070 con 0x7fe30c10a6b0 2024-06-13T11:22:20.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.028+0000 7fe302a00700 1 -- 172.21.15.2:0/1951079767 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304004280 con 0x7fe30c10a6b0 2024-06-13T11:22:20.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.028+0000 7fe311000700 1 -- 172.21.15.2:0/1951079767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30c1a7950 con 0x7fe30c10a6b0 2024-06-13T11:22:20.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.029+0000 7fe311000700 1 -- 172.21.15.2:0/1951079767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30c069180 con 0x7fe30c10a6b0 2024-06-13T11:22:20.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.031+0000 7fe302a00700 1 -- 172.21.15.2:0/1951079767 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fe30401b030 con 0x7fe30c10a6b0 2024-06-13T11:22:20.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.032+0000 7fe302a00700 1 --2- 172.21.15.2:0/1951079767 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe2f00a2c20 0x7fe2f00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:20.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.033+0000 7fe302a00700 1 -- 172.21.15.2:0/1951079767 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fe3040cef40 con 0x7fe30c10a6b0 2024-06-13T11:22:20.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.033+0000 7fe309e00700 1 --2- 172.21.15.2:0/1951079767 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe2f00a2c20 0x7fe2f00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:20.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.033+0000 7fe309e00700 1 --2- 172.21.15.2:0/1951079767 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe2f00a2c20 0x7fe2f00a50e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009680 tx=0x7fe2fc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:20.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.037+0000 7fe302a00700 1 -- 172.21.15.2:0/1951079767 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe304022020 con 0x7fe30c10a6b0 2024-06-13T11:22:20.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.312+0000 7fe311000700 1 -- 172.21.15.2:0/1951079767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe30c02dca0 con 0x7fe30c10a6b0 2024-06-13T11:22:20.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.313+0000 7fe302a00700 1 -- 172.21.15.2:0/1951079767 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11853 (secure 0 0 0) 0x7fe304010040 con 0x7fe30c10a6b0 2024-06-13T11:22:20.313 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:22:20.313 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:20:14.396526+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24509,24511,24493]},"id":1}]} 2024-06-13T11:22:20.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.317+0000 7fe311000700 1 -- 172.21.15.2:0/1951079767 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe2f00a2c20 msgr2=0x7fe2f00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:20.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.317+0000 7fe311000700 1 --2- 172.21.15.2:0/1951079767 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe2f00a2c20 0x7fe2f00a50e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009680 tx=0x7fe2fc009260 comp rx=0 tx=0).stop 2024-06-13T11:22:20.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.317+0000 7fe311000700 1 -- 172.21.15.2:0/1951079767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c10a6b0 msgr2=0x7fe30c19f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:20.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.317+0000 7fe311000700 1 --2- 172.21.15.2:0/1951079767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c10a6b0 0x7fe30c19f6a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe30400efc0 tx=0x7fe30400c3a0 comp rx=0 tx=0).stop 2024-06-13T11:22:20.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.317+0000 7fe311000700 1 -- 172.21.15.2:0/1951079767 shutdown_connections 2024-06-13T11:22:20.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.317+0000 7fe311000700 1 --2- 172.21.15.2:0/1951079767 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe2f00a2c20 0x7fe2f00a50e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:20.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.317+0000 7fe311000700 1 --2- 172.21.15.2:0/1951079767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c10a6b0 0x7fe30c19f6a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:20.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.317+0000 7fe311000700 1 --2- 172.21.15.2:0/1951079767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe30c1046b0 0x7fe30c19add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:20.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.317+0000 7fe311000700 1 --2- 172.21.15.2:0/1951079767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe30c105070 0x7fe30c19b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:20.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.317+0000 7fe311000700 1 -- 172.21.15.2:0/1951079767 >> 172.21.15.2:0/1951079767 conn(0x7fe30c1001a0 msgr2=0x7fe30c1006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:20.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.317+0000 7fe311000700 1 -- 172.21.15.2:0/1951079767 shutdown_connections 2024-06-13T11:22:20.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:20.317+0000 7fe311000700 1 -- 172.21.15.2:0/1951079767 wait complete. 2024-06-13T11:22:20.318 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-06-13T11:22:21.051 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:20 smithi002 ceph-mon[32210]: pgmap v446: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:21.051 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:20 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1951079767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:22:21.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:22:21.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:20 smithi178 ceph-mon[36913]: pgmap v446: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:21.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:20 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1951079767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:22:21.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:20 smithi077 ceph-mon[36410]: pgmap v446: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:21.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:20 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1951079767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:22:21.594 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:22:23.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:22 smithi002 ceph-mon[32210]: pgmap v447: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:22:23.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:22 smithi178 ceph-mon[36913]: pgmap v447: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:22:23.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:22 smithi077 ceph-mon[36410]: pgmap v447: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:22:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.754+0000 7f9ecf800700 1 -- 172.21.15.2:0/3865400300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec806a170 msgr2=0x7f9ec806a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.754+0000 7f9ecf800700 1 --2- 172.21.15.2:0/3865400300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec806a170 0x7f9ec806a5f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009990 tx=0x7f9eb0009ca0 comp rx=0 tx=0).stop 2024-06-13T11:22:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.754+0000 7f9ecf800700 1 -- 172.21.15.2:0/3865400300 shutdown_connections 2024-06-13T11:22:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.754+0000 7f9ecf800700 1 --2- 172.21.15.2:0/3865400300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec8108500 0x7f9ec81088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.754+0000 7f9ecf800700 1 --2- 172.21.15.2:0/3865400300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec806ab30 0x7f9ec810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.754+0000 7f9ecf800700 1 --2- 172.21.15.2:0/3865400300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec806a170 0x7f9ec806a5f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.754+0000 7f9ecf800700 1 -- 172.21.15.2:0/3865400300 >> 172.21.15.2:0/3865400300 conn(0x7f9ec8078340 msgr2=0x7f9ec8078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.755+0000 7f9ecf800700 1 -- 172.21.15.2:0/3865400300 shutdown_connections 2024-06-13T11:22:23.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.755+0000 7f9ecf800700 1 -- 172.21.15.2:0/3865400300 wait complete. 2024-06-13T11:22:23.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.756+0000 7f9ecf800700 1 Processor -- start 2024-06-13T11:22:23.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.756+0000 7f9ecf800700 1 -- start start 2024-06-13T11:22:23.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.757+0000 7f9ecf800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec806a170 0x7f9ec819ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:23.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.757+0000 7f9ecf800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec806ab30 0x7f9ec819b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:23.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.757+0000 7f9ecf800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec8108500 0x7f9ec819f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:23.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.757+0000 7f9ecf800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec8112760 con 0x7f9ec806ab30 2024-06-13T11:22:23.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.757+0000 7f9ecf800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81125e0 con 0x7f9ec8108500 2024-06-13T11:22:23.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.757+0000 7f9ecf800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81128e0 con 0x7f9ec806a170 2024-06-13T11:22:23.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.757+0000 7f9ecce00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec806a170 0x7f9ec819ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:23.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.757+0000 7f9ebfe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec806ab30 0x7f9ec819b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:23.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.757+0000 7f9ecce00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec806a170 0x7f9ec819ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:48316/0 (socket says 172.21.15.2:48316) 2024-06-13T11:22:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.757+0000 7f9ecce00700 1 -- 172.21.15.2:0/3828146337 learned_addr learned my addr 172.21.15.2:0/3828146337 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.757+0000 7f9ecd800700 1 --2- 172.21.15.2:0/3828146337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec8108500 0x7f9ec819f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.758+0000 7f9ecce00700 1 -- 172.21.15.2:0/3828146337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec8108500 msgr2=0x7f9ec819f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.758+0000 7f9ecce00700 1 --2- 172.21.15.2:0/3828146337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec8108500 0x7f9ec819f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.758+0000 7f9ecce00700 1 -- 172.21.15.2:0/3828146337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec806ab30 msgr2=0x7f9ec819b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.758+0000 7f9ecce00700 1 --2- 172.21.15.2:0/3828146337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec806ab30 0x7f9ec819b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.758+0000 7f9ecce00700 1 -- 172.21.15.2:0/3828146337 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec819fe60 con 0x7f9ec806a170 2024-06-13T11:22:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.758+0000 7f9ecd800700 1 --2- 172.21.15.2:0/3828146337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec8108500 0x7f9ec819f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:22:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.758+0000 7f9ecce00700 1 --2- 172.21.15.2:0/3828146337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec806a170 0x7f9ec819ae50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800e9a0 tx=0x7f9eb800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.758+0000 7f9ec6000700 1 -- 172.21.15.2:0/3828146337 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb800cbd0 con 0x7f9ec806a170 2024-06-13T11:22:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.758+0000 7f9ec6000700 1 -- 172.21.15.2:0/3828146337 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9eb800cd70 con 0x7f9ec806a170 2024-06-13T11:22:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.758+0000 7f9ec6000700 1 -- 172.21.15.2:0/3828146337 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8018750 con 0x7f9ec806a170 2024-06-13T11:22:23.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.758+0000 7f9ecf800700 1 -- 172.21.15.2:0/3828146337 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec81a0150 con 0x7f9ec806a170 2024-06-13T11:22:23.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.759+0000 7f9ecf800700 1 -- 172.21.15.2:0/3828146337 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec81a79d0 con 0x7f9ec806a170 2024-06-13T11:22:23.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.760+0000 7f9ecf800700 1 -- 172.21.15.2:0/3828146337 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ec8069180 con 0x7f9ec806a170 2024-06-13T11:22:23.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.762+0000 7f9ec6000700 1 -- 172.21.15.2:0/3828146337 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f9eb8010430 con 0x7f9ec806a170 2024-06-13T11:22:23.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.763+0000 7f9ec6000700 1 --2- 172.21.15.2:0/3828146337 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9eac0a2ca0 0x7f9eac0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:23.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.763+0000 7f9ec6000700 1 -- 172.21.15.2:0/3828146337 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f9eb80cf620 con 0x7f9ec806a170 2024-06-13T11:22:23.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.764+0000 7f9ebfe00700 1 --2- 172.21.15.2:0/3828146337 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9eac0a2ca0 0x7f9eac0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:23.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.764+0000 7f9ebfe00700 1 --2- 172.21.15.2:0/3828146337 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9eac0a2ca0 0x7f9eac0a5160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000b2e0 tx=0x7f9eb0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:23.768+0000 7f9ec6000700 1 -- 172.21.15.2:0/3828146337 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9eb809c190 con 0x7f9ec806a170 2024-06-13T11:22:24.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:24.047+0000 7f9ecf800700 1 -- 172.21.15.2:0/3828146337 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ec81a7ba0 con 0x7f9ec806a170 2024-06-13T11:22:24.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:24.048+0000 7f9ec6000700 1 -- 172.21.15.2:0/3828146337 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11853 (secure 0 0 0) 0x7f9eb809ba90 con 0x7f9ec806a170 2024-06-13T11:22:24.048 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:22:24.048 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:20:14.396526+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24509,24511,24493]},"id":1}]} 2024-06-13T11:22:24.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:24.053+0000 7f9ecf800700 1 -- 172.21.15.2:0/3828146337 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9eac0a2ca0 msgr2=0x7f9eac0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:24.053+0000 7f9ecf800700 1 --2- 172.21.15.2:0/3828146337 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9eac0a2ca0 0x7f9eac0a5160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000b2e0 tx=0x7f9eb0005960 comp rx=0 tx=0).stop 2024-06-13T11:22:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:24.053+0000 7f9ecf800700 1 -- 172.21.15.2:0/3828146337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec806a170 msgr2=0x7f9ec819ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:24.053+0000 7f9ecf800700 1 --2- 172.21.15.2:0/3828146337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec806a170 0x7f9ec819ae50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800e9a0 tx=0x7f9eb800ecb0 comp rx=0 tx=0).stop 2024-06-13T11:22:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:24.053+0000 7f9ecf800700 1 -- 172.21.15.2:0/3828146337 shutdown_connections 2024-06-13T11:22:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:24.053+0000 7f9ecf800700 1 --2- 172.21.15.2:0/3828146337 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9eac0a2ca0 0x7f9eac0a5160 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:24.053+0000 7f9ecf800700 1 --2- 172.21.15.2:0/3828146337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec8108500 0x7f9ec819f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:24.053+0000 7f9ecf800700 1 --2- 172.21.15.2:0/3828146337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec806a170 0x7f9ec819ae50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:24.053+0000 7f9ecf800700 1 --2- 172.21.15.2:0/3828146337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec806ab30 0x7f9ec819b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:24.053+0000 7f9ecf800700 1 -- 172.21.15.2:0/3828146337 >> 172.21.15.2:0/3828146337 conn(0x7f9ec8078340 msgr2=0x7f9ec810d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:24.053+0000 7f9ecf800700 1 -- 172.21.15.2:0/3828146337 shutdown_connections 2024-06-13T11:22:24.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:24.054+0000 7f9ecf800700 1 -- 172.21.15.2:0/3828146337 wait complete. 2024-06-13T11:22:24.055 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-06-13T11:22:25.009 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T11:22:25.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:24 smithi178 ceph-mon[36913]: pgmap v448: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:22:25.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:24 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3828146337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:22:25.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:24 smithi077 ceph-mon[36410]: pgmap v448: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:22:25.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:24 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3828146337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:22:25.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:24 smithi002 ceph-mon[32210]: pgmap v448: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:22:25.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:24 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3828146337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:22:25.461 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:22:27.141 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:26 smithi002 ceph-mon[32210]: pgmap v449: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:27.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:26 smithi178 ceph-mon[36913]: pgmap v449: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:27.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:26 smithi077 ceph-mon[36410]: pgmap v449: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.676+0000 7fe613200700 1 -- 172.21.15.2:0/2685570483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe60c102620 msgr2=0x7fe60c102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.676+0000 7fe613200700 1 --2- 172.21.15.2:0/2685570483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe60c102620 0x7fe60c102a00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe6000099c0 tx=0x7fe600009cd0 comp rx=0 tx=0).stop 2024-06-13T11:22:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.676+0000 7fe613200700 1 -- 172.21.15.2:0/2685570483 shutdown_connections 2024-06-13T11:22:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.676+0000 7fe613200700 1 --2- 172.21.15.2:0/2685570483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe60c102620 0x7fe60c102a00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.676+0000 7fe613200700 1 --2- 172.21.15.2:0/2685570483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe60c107700 0x7fe60c10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.676+0000 7fe613200700 1 --2- 172.21.15.2:0/2685570483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe60c102fd0 0x7fe60c107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.676+0000 7fe613200700 1 -- 172.21.15.2:0/2685570483 >> 172.21.15.2:0/2685570483 conn(0x7fe60c0fdf10 msgr2=0x7fe60c100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.676+0000 7fe613200700 1 -- 172.21.15.2:0/2685570483 shutdown_connections 2024-06-13T11:22:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.676+0000 7fe613200700 1 -- 172.21.15.2:0/2685570483 wait complete. 2024-06-13T11:22:27.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.678+0000 7fe613200700 1 Processor -- start 2024-06-13T11:22:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.678+0000 7fe613200700 1 -- start start 2024-06-13T11:22:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.678+0000 7fe613200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe60c102620 0x7fe60c19ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.679+0000 7fe613200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe60c102fd0 0x7fe60c19b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.679+0000 7fe613200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe60c107700 0x7fe60c19f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.679+0000 7fe613200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c112730 con 0x7fe60c107700 2024-06-13T11:22:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.679+0000 7fe613200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c1125b0 con 0x7fe60c102620 2024-06-13T11:22:27.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.679+0000 7fe613200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c1128b0 con 0x7fe60c102fd0 2024-06-13T11:22:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.679+0000 7fe611e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe60c102620 0x7fe60c19ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.679+0000 7fe611400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe60c102fd0 0x7fe60c19b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:27.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.679+0000 7fe611e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe60c102620 0x7fe60c19ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:33616/0 (socket says 172.21.15.2:33616) 2024-06-13T11:22:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.679+0000 7fe612800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe60c107700 0x7fe60c19f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.679+0000 7fe611e00700 1 -- 172.21.15.2:0/1231528959 learned_addr learned my addr 172.21.15.2:0/1231528959 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.679+0000 7fe611400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe60c102fd0 0x7fe60c19b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:60508/0 (socket says 172.21.15.2:60508) 2024-06-13T11:22:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.679+0000 7fe611e00700 1 -- 172.21.15.2:0/1231528959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe60c102fd0 msgr2=0x7fe60c19b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.680+0000 7fe611e00700 1 --2- 172.21.15.2:0/1231528959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe60c102fd0 0x7fe60c19b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.680+0000 7fe611e00700 1 -- 172.21.15.2:0/1231528959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe60c107700 msgr2=0x7fe60c19f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.680+0000 7fe611e00700 1 --2- 172.21.15.2:0/1231528959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe60c107700 0x7fe60c19f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:27.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.680+0000 7fe611e00700 1 -- 172.21.15.2:0/1231528959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60c19fd90 con 0x7fe60c102620 2024-06-13T11:22:27.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.680+0000 7fe611e00700 1 --2- 172.21.15.2:0/1231528959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe60c102620 0x7fe60c19ad80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe600005910 tx=0x7fe60000f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:27.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.680+0000 7fe606a00700 1 -- 172.21.15.2:0/1231528959 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe600027070 con 0x7fe60c102620 2024-06-13T11:22:27.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.680+0000 7fe606a00700 1 -- 172.21.15.2:0/1231528959 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe600003680 con 0x7fe60c102620 2024-06-13T11:22:27.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.680+0000 7fe606a00700 1 -- 172.21.15.2:0/1231528959 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6000173f0 con 0x7fe60c102620 2024-06-13T11:22:27.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.680+0000 7fe613200700 1 -- 172.21.15.2:0/1231528959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60c1a0020 con 0x7fe60c102620 2024-06-13T11:22:27.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.680+0000 7fe613200700 1 -- 172.21.15.2:0/1231528959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe60c1a7900 con 0x7fe60c102620 2024-06-13T11:22:27.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.682+0000 7fe613200700 1 -- 172.21.15.2:0/1231528959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe60c069180 con 0x7fe60c102620 2024-06-13T11:22:27.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.684+0000 7fe606a00700 1 -- 172.21.15.2:0/1231528959 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fe600022590 con 0x7fe60c102620 2024-06-13T11:22:27.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.685+0000 7fe606a00700 1 --2- 172.21.15.2:0/1231528959 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe5f40a2c20 0x7fe5f40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:27.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.685+0000 7fe606a00700 1 -- 172.21.15.2:0/1231528959 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fe6000d0220 con 0x7fe60c102620 2024-06-13T11:22:27.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.685+0000 7fe611400700 1 --2- 172.21.15.2:0/1231528959 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe5f40a2c20 0x7fe5f40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:27.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.686+0000 7fe611400700 1 --2- 172.21.15.2:0/1231528959 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe5f40a2c20 0x7fe5f40a50e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe60c108e50 tx=0x7fe5fc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:27.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.687+0000 7fe606a00700 1 -- 172.21.15.2:0/1231528959 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe600013070 con 0x7fe60c102620 2024-06-13T11:22:27.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.919+0000 7fe613200700 1 -- 172.21.15.2:0/1231528959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe60c1a7ad0 con 0x7fe60c102620 2024-06-13T11:22:27.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.921+0000 7fe606a00700 1 -- 172.21.15.2:0/1231528959 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24612 (secure 0 0 0) 0x7fe60009ce20 con 0x7fe60c102620 2024-06-13T11:22:27.921 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:22:27.921 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":99,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","created":"2024-06-13T11:09:07.839101+0000","modified":"2024-06-13T11:20:27.512678+0000","last_up_change":"2024-06-13T11:17:28.731479+0000","last_in_change":"2024-06-13T11:17:08.849067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:13:13.793461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:18:36.784824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:18:41.824835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:18:55.545870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f5614d91-49a7-4983-a309-0de3b3e6263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6803","nonce":4127571834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6805","nonce":4127571834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6809","nonce":4127571834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6807","nonce":4127571834}]},"public_addr":"172.21.15.2:6803/4127571834","cluster_addr":"172.21.15.2:6805/4127571834","heartbeat_back_addr":"172.21.15.2:6809/4127571834","heartbeat_front_addr":"172.21.15.2:6807/4127571834","state":["exists","up"]},{"osd":1,"uuid":"d9dbe278-309f-4726-828a-da922f486b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6801","nonce":3180360713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6803","nonce":3180360713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6807","nonce":3180360713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6805","nonce":3180360713}]},"public_addr":"172.21.15.77:6801/3180360713","cluster_addr":"172.21.15.77:6803/3180360713","heartbeat_back_addr":"172.21.15.77:6807/3180360713","heartbeat_front_addr":"172.21.15.77:6805/3180360713","state":["exists","up"]},{"osd":2,"uuid":"04c267dc-7454-418f-9965-3ff96ef280ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6801","nonce":3825510575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6803","nonce":3825510575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6807","nonce":3825510575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6805","nonce":3825510575}]},"public_addr":"172.21.15.178:6801/3825510575","cluster_addr":"172.21.15.178:6803/3825510575","heartbeat_back_addr":"172.21.15.178:6807/3825510575","heartbeat_front_addr":"172.21.15.178:6805/3825510575","state":["exists","up"]},{"osd":3,"uuid":"3847bd4f-ca04-41de-9d88-e1523dd7ff8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6811","nonce":1982693353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6813","nonce":1982693353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6817","nonce":1982693353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6815","nonce":1982693353}]},"public_addr":"172.21.15.2:6811/1982693353","cluster_addr":"172.21.15.2:6813/1982693353","heartbeat_back_addr":"172.21.15.2:6817/1982693353","heartbeat_front_addr":"172.21.15.2:6815/1982693353","state":["exists","up"]},{"osd":4,"uuid":"34d7d2e8-3dee-42b9-a6cb-d4162b122b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6809","nonce":3916694904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6811","nonce":3916694904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6815","nonce":3916694904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6813","nonce":3916694904}]},"public_addr":"172.21.15.77:6809/3916694904","cluster_addr":"172.21.15.77:6811/3916694904","heartbeat_back_addr":"172.21.15.77:6815/3916694904","heartbeat_front_addr":"172.21.15.77:6813/3916694904","state":["exists","up"]},{"osd":5,"uuid":"0468aefc-c3c8-4758-9bbf-1225b7a5ae79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6809","nonce":3572805887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6811","nonce":3572805887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6815","nonce":3572805887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6813","nonce":3572805887}]},"public_addr":"172.21.15.178:6809/3572805887","cluster_addr":"172.21.15.178:6811/3572805887","heartbeat_back_addr":"172.21.15.178:6815/3572805887","heartbeat_front_addr":"172.21.15.178:6813/3572805887","state":["exists","up"]},{"osd":6,"uuid":"0a186a4a-0e28-47bd-b5ad-9bf8079f74c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6819","nonce":1592309584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6821","nonce":1592309584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6825","nonce":1592309584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6823","nonce":1592309584}]},"public_addr":"172.21.15.2:6819/1592309584","cluster_addr":"172.21.15.2:6821/1592309584","heartbeat_back_addr":"172.21.15.2:6825/1592309584","heartbeat_front_addr":"172.21.15.2:6823/1592309584","state":["exists","up"]},{"osd":7,"uuid":"646e66f7-1ef8-428d-a842-bf28c8606df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6817","nonce":1580055775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6819","nonce":1580055775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6823","nonce":1580055775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6821","nonce":1580055775}]},"public_addr":"172.21.15.77:6817/1580055775","cluster_addr":"172.21.15.77:6819/1580055775","heartbeat_back_addr":"172.21.15.77:6823/1580055775","heartbeat_front_addr":"172.21.15.77:6821/1580055775","state":["exists","up"]},{"osd":8,"uuid":"bcc971fc-47d7-4289-8a9a-c76996c57370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6817","nonce":4285192591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6819","nonce":4285192591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6823","nonce":4285192591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6821","nonce":4285192591}]},"public_addr":"172.21.15.178:6817/4285192591","cluster_addr":"172.21.15.178:6819/4285192591","heartbeat_back_addr":"172.21.15.178:6823/4285192591","heartbeat_front_addr":"172.21.15.178:6821/4285192591","state":["exists","up"]},{"osd":9,"uuid":"899d7d4f-a24c-4508-b42c-0b363275c459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6827","nonce":4187017478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6829","nonce":4187017478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6833","nonce":4187017478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6831","nonce":4187017478}]},"public_addr":"172.21.15.2:6827/4187017478","cluster_addr":"172.21.15.2:6829/4187017478","heartbeat_back_addr":"172.21.15.2:6833/4187017478","heartbeat_front_addr":"172.21.15.2:6831/4187017478","state":["exists","up"]},{"osd":10,"uuid":"112d2b8e-9673-4d7a-97e9-2089793fdd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6825","nonce":2039538463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6827","nonce":2039538463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6831","nonce":2039538463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6829","nonce":2039538463}]},"public_addr":"172.21.15.77:6825/2039538463","cluster_addr":"172.21.15.77:6827/2039538463","heartbeat_back_addr":"172.21.15.77:6831/2039538463","heartbeat_front_addr":"172.21.15.77:6829/2039538463","state":["exists","up"]},{"osd":11,"uuid":"6b8001f5-9c74-4cc7-8c41-906cb5ac9b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6825","nonce":1915058767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6827","nonce":1915058767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6831","nonce":1915058767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6829","nonce":1915058767}]},"public_addr":"172.21.15.178:6825/1915058767","cluster_addr":"172.21.15.178:6827/1915058767","heartbeat_back_addr":"172.21.15.178:6831/1915058767","heartbeat_front_addr":"172.21.15.178:6829/1915058767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:21.707572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:46.440115+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:10.197217+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:42.853367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:08.880473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:33.605677+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:07.655377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:33.980900+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:59.397529+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:16:33.983411+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:00.932649+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:26.894098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9},{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/315567313":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/2084201061":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/3394644803":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6801/1821969949":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/2170469985":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/142516651":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6801/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/3220886565":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6800/1821969949":"2024-06-14T11:10:25.084617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:22:27.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.925+0000 7fe613200700 1 -- 172.21.15.2:0/1231528959 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe5f40a2c20 msgr2=0x7fe5f40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:27.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.925+0000 7fe613200700 1 --2- 172.21.15.2:0/1231528959 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe5f40a2c20 0x7fe5f40a50e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe60c108e50 tx=0x7fe5fc009260 comp rx=0 tx=0).stop 2024-06-13T11:22:27.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.925+0000 7fe613200700 1 -- 172.21.15.2:0/1231528959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe60c102620 msgr2=0x7fe60c19ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:27.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.925+0000 7fe613200700 1 --2- 172.21.15.2:0/1231528959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe60c102620 0x7fe60c19ad80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe600005910 tx=0x7fe60000f690 comp rx=0 tx=0).stop 2024-06-13T11:22:27.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.925+0000 7fe613200700 1 -- 172.21.15.2:0/1231528959 shutdown_connections 2024-06-13T11:22:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.925+0000 7fe613200700 1 --2- 172.21.15.2:0/1231528959 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fe5f40a2c20 0x7fe5f40a50e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.925+0000 7fe613200700 1 --2- 172.21.15.2:0/1231528959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe60c107700 0x7fe60c19f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.925+0000 7fe613200700 1 --2- 172.21.15.2:0/1231528959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe60c102620 0x7fe60c19ad80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.925+0000 7fe613200700 1 --2- 172.21.15.2:0/1231528959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe60c102fd0 0x7fe60c19b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.925+0000 7fe613200700 1 -- 172.21.15.2:0/1231528959 >> 172.21.15.2:0/1231528959 conn(0x7fe60c0fdf10 msgr2=0x7fe60c1001c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.925+0000 7fe613200700 1 -- 172.21.15.2:0/1231528959 shutdown_connections 2024-06-13T11:22:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:27.925+0000 7fe613200700 1 -- 172.21.15.2:0/1231528959 wait complete. 2024-06-13T11:22:28.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:27 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1231528959' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:22:28.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:27 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1231528959' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:22:28.387 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:27 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1231528959' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:22:28.887 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:22:29.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:28 smithi002 ceph-mon[32210]: pgmap v450: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:22:29.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:28 smithi178 ceph-mon[36913]: pgmap v450: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:22:29.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:28 smithi077 ceph-mon[36410]: pgmap v450: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:22:29.371 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:22:31.241 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:30 smithi002 ceph-mon[32210]: pgmap v451: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:31.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:30 smithi077 ceph-mon[36410]: pgmap v451: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:31.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:30 smithi178 ceph-mon[36913]: pgmap v451: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:31.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.809+0000 7f3884800700 1 -- 172.21.15.2:0/683135988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387c0746c0 msgr2=0x7f387c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:31.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.809+0000 7f3884800700 1 --2- 172.21.15.2:0/683135988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387c0746c0 0x7f387c074aa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3870009990 tx=0x7f3870009ca0 comp rx=0 tx=0).stop 2024-06-13T11:22:31.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.809+0000 7f3884800700 1 -- 172.21.15.2:0/683135988 shutdown_connections 2024-06-13T11:22:31.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.809+0000 7f3884800700 1 --2- 172.21.15.2:0/683135988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f387c10ee90 0x7f387c111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:31.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.809+0000 7f3884800700 1 --2- 172.21.15.2:0/683135988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387c0746c0 0x7f387c074aa0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:31.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.809+0000 7f3884800700 1 --2- 172.21.15.2:0/683135988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f387c074fe0 0x7f387c10e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:31.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.809+0000 7f3884800700 1 -- 172.21.15.2:0/683135988 >> 172.21.15.2:0/683135988 conn(0x7f387c0795f0 msgr2=0x7f387c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:31.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.810+0000 7f3884800700 1 -- 172.21.15.2:0/683135988 shutdown_connections 2024-06-13T11:22:31.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.810+0000 7f3884800700 1 -- 172.21.15.2:0/683135988 wait complete. 2024-06-13T11:22:31.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.811+0000 7f3884800700 1 Processor -- start 2024-06-13T11:22:31.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.811+0000 7f3884800700 1 -- start start 2024-06-13T11:22:31.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.811+0000 7f3884800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387c0746c0 0x7f387c19ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:31.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.811+0000 7f3884800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f387c074fe0 0x7f387c19b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:31.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.811+0000 7f3884800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f387c10ee90 0x7f387c19f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:31.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.811+0000 7f3884800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f387c1149f0 con 0x7f387c074fe0 2024-06-13T11:22:31.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.811+0000 7f3884800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f387c114870 con 0x7f387c10ee90 2024-06-13T11:22:31.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.811+0000 7f3884800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f387c114b70 con 0x7f387c0746c0 2024-06-13T11:22:31.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.812+0000 7f3881e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387c0746c0 0x7f387c19ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:31.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.812+0000 7f3881400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f387c074fe0 0x7f387c19b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:31.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.812+0000 7f3882800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f387c10ee90 0x7f387c19f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:31.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.812+0000 7f3881e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387c0746c0 0x7f387c19ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:60526/0 (socket says 172.21.15.2:60526) 2024-06-13T11:22:31.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.812+0000 7f3881e00700 1 -- 172.21.15.2:0/105111577 learned_addr learned my addr 172.21.15.2:0/105111577 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:31.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.812+0000 7f3882800700 1 -- 172.21.15.2:0/105111577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387c0746c0 msgr2=0x7f387c19ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:31.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.812+0000 7f3882800700 1 --2- 172.21.15.2:0/105111577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387c0746c0 0x7f387c19ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:31.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.812+0000 7f3882800700 1 -- 172.21.15.2:0/105111577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f387c074fe0 msgr2=0x7f387c19b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:31.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.812+0000 7f3882800700 1 --2- 172.21.15.2:0/105111577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f387c074fe0 0x7f387c19b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:31.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.812+0000 7f3882800700 1 -- 172.21.15.2:0/105111577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387c19fe10 con 0x7f387c10ee90 2024-06-13T11:22:31.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.813+0000 7f3882800700 1 --2- 172.21.15.2:0/105111577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f387c10ee90 0x7f387c19f6d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f387800ef90 tx=0x7f387800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:31.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.813+0000 7f3876a00700 1 -- 172.21.15.2:0/105111577 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38780092e0 con 0x7f387c10ee90 2024-06-13T11:22:31.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.813+0000 7f3876a00700 1 -- 172.21.15.2:0/105111577 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3878004bb0 con 0x7f387c10ee90 2024-06-13T11:22:31.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.813+0000 7f3876a00700 1 -- 172.21.15.2:0/105111577 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878004280 con 0x7f387c10ee90 2024-06-13T11:22:31.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.813+0000 7f3884800700 1 -- 172.21.15.2:0/105111577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387c1a00a0 con 0x7f387c10ee90 2024-06-13T11:22:31.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.813+0000 7f3884800700 1 -- 172.21.15.2:0/105111577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f387c1a7980 con 0x7f387c10ee90 2024-06-13T11:22:31.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.814+0000 7f3884800700 1 -- 172.21.15.2:0/105111577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f387c069180 con 0x7f387c10ee90 2024-06-13T11:22:31.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.816+0000 7f3876a00700 1 -- 172.21.15.2:0/105111577 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f3878044d10 con 0x7f387c10ee90 2024-06-13T11:22:31.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.818+0000 7f3876a00700 1 --2- 172.21.15.2:0/105111577 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f38640a2ca0 0x7f38640a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:31.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.818+0000 7f3876a00700 1 -- 172.21.15.2:0/105111577 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f38780cf3f0 con 0x7f387c10ee90 2024-06-13T11:22:31.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.818+0000 7f3881e00700 1 --2- 172.21.15.2:0/105111577 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f38640a2ca0 0x7f38640a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:31.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.819+0000 7f3881e00700 1 --2- 172.21.15.2:0/105111577 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f38640a2ca0 0x7f38640a5160 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3870006010 tx=0x7f387000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:31.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:31.820+0000 7f3876a00700 1 -- 172.21.15.2:0/105111577 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3878022020 con 0x7f387c10ee90 2024-06-13T11:22:32.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:32.103+0000 7f3884800700 1 -- 172.21.15.2:0/105111577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f387c1a7b50 con 0x7f387c10ee90 2024-06-13T11:22:32.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:32.104+0000 7f3876a00700 1 -- 172.21.15.2:0/105111577 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11853 (secure 0 0 0) 0x7f3878010040 con 0x7f387c10ee90 2024-06-13T11:22:32.104 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:22:32.104 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:20:14.396526+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24509,24511,24493]},"id":1}]} 2024-06-13T11:22:32.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:32.107+0000 7f3884800700 1 -- 172.21.15.2:0/105111577 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f38640a2ca0 msgr2=0x7f38640a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:32.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:32.107+0000 7f3884800700 1 --2- 172.21.15.2:0/105111577 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f38640a2ca0 0x7f38640a5160 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3870006010 tx=0x7f387000b260 comp rx=0 tx=0).stop 2024-06-13T11:22:32.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:32.107+0000 7f3884800700 1 -- 172.21.15.2:0/105111577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f387c10ee90 msgr2=0x7f387c19f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:32.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:32.107+0000 7f3884800700 1 --2- 172.21.15.2:0/105111577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f387c10ee90 0x7f387c19f6d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f387800ef90 tx=0x7f387800c3a0 comp rx=0 tx=0).stop 2024-06-13T11:22:32.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:32.107+0000 7f3884800700 1 -- 172.21.15.2:0/105111577 shutdown_connections 2024-06-13T11:22:32.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:32.107+0000 7f3884800700 1 --2- 172.21.15.2:0/105111577 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f38640a2ca0 0x7f38640a5160 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:32.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:32.107+0000 7f3884800700 1 --2- 172.21.15.2:0/105111577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f387c10ee90 0x7f387c19f6d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:32.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:32.107+0000 7f3884800700 1 --2- 172.21.15.2:0/105111577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387c0746c0 0x7f387c19ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:32.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:32.107+0000 7f3884800700 1 --2- 172.21.15.2:0/105111577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f387c074fe0 0x7f387c19b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:32.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:32.107+0000 7f3884800700 1 -- 172.21.15.2:0/105111577 >> 172.21.15.2:0/105111577 conn(0x7f387c0795f0 msgr2=0x7f387c0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:32.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:32.108+0000 7f3884800700 1 -- 172.21.15.2:0/105111577 shutdown_connections 2024-06-13T11:22:32.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:32.108+0000 7f3884800700 1 -- 172.21.15.2:0/105111577 wait complete. 2024-06-13T11:22:32.108 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-06-13T11:22:32.952 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-13T11:18:45.943965+0000', 'modified': '2024-06-13T11:20:14.396526+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24511, 'mds_1': 24509, 'mds_2': 24493}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24455': {'gid': 24455, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.77:6835/4100836585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6834', 'nonce': 4100836585}, {'type': 'v1', 'addr': '172.21.15.77:6835', 'nonce': 4100836585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.77:6837/1628379389', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6836', 'nonce': 1628379389}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 1628379389}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6835/2515486418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 2515486418}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 2515486418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 32, 'addr': '172.21.15.178:6837/2179127321', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6836', 'nonce': 2179127321}, {'type': 'v1', 'addr': '172.21.15.178:6837', 'nonce': 2179127321}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24509': {'gid': 24509, 'name': 'b', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 27, 'addr': '172.21.15.77:6839/45629124', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6838', 'nonce': 45629124}, {'type': 'v1', 'addr': '172.21.15.77:6839', 'nonce': 45629124}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24511': {'gid': 24511, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.178:6839/970862278', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6838', 'nonce': 970862278}, {'type': 'v1', 'addr': '172.21.15.178:6839', 'nonce': 970862278}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24511, 'qdb_cluster': [24509, 24511, 24493]} 2024-06-13T11:22:32.952 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-06-13T11:22:32.952 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.c status 2024-06-13T11:22:33.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:32 smithi002 ceph-mon[32210]: pgmap v452: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:22:33.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:32 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/105111577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:22:33.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:32 smithi077 ceph-mon[36410]: pgmap v452: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:22:33.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:32 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/105111577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:22:33.411 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:22:33.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:32 smithi178 ceph-mon[36913]: pgmap v452: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:22:33.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:32 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/105111577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:22:35.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:34 smithi077 ceph-mon[36410]: pgmap v453: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:22:35.336 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:34 smithi002 ceph-mon[32210]: pgmap v453: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:22:35.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:34 smithi178 ceph-mon[36913]: pgmap v453: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:22:35.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.673+0000 7f90ae800700 1 -- 172.21.15.2:0/1055190963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90a81076e0 msgr2=0x7f90a810f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:35.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.673+0000 7f90ae800700 1 --2- 172.21.15.2:0/1055190963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90a81076e0 0x7f90a810f2b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009fc0 tx=0x7f90a000b330 comp rx=0 tx=0).stop 2024-06-13T11:22:35.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.674+0000 7f90ae800700 1 -- 172.21.15.2:0/1055190963 shutdown_connections 2024-06-13T11:22:35.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.674+0000 7f90ae800700 1 --2- 172.21.15.2:0/1055190963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90a81076e0 0x7f90a810f2b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.674+0000 7f90ae800700 1 --2- 172.21.15.2:0/1055190963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a8102600 0x7f90a81029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.674+0000 7f90ae800700 1 --2- 172.21.15.2:0/1055190963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90a8102fb0 0x7f90a8107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.674+0000 7f90ae800700 1 -- 172.21.15.2:0/1055190963 >> 172.21.15.2:0/1055190963 conn(0x7f90a80fdeb0 msgr2=0x7f90a81002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:35.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.674+0000 7f90ae800700 1 -- 172.21.15.2:0/1055190963 shutdown_connections 2024-06-13T11:22:35.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.674+0000 7f90ae800700 1 -- 172.21.15.2:0/1055190963 wait complete. 2024-06-13T11:22:35.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.675+0000 7f90ae800700 1 Processor -- start 2024-06-13T11:22:35.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.676+0000 7f90ae800700 1 -- start start 2024-06-13T11:22:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.676+0000 7f90ae800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90a8102600 0x7f90a819e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.676+0000 7f90ae800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90a8102fb0 0x7f90a819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.676+0000 7f90ae800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a81076e0 0x7f90a8198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.676+0000 7f90ae800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f90a8112720 con 0x7f90a8102600 2024-06-13T11:22:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.676+0000 7f90ae800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f90a81125a0 con 0x7f90a81076e0 2024-06-13T11:22:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.676+0000 7f90ae800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f90a81128a0 con 0x7f90a8102fb0 2024-06-13T11:22:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.676+0000 7f90ad400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90a8102600 0x7f90a819e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.677+0000 7f90aca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90a8102fb0 0x7f90a819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.677+0000 7f90ad400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90a8102600 0x7f90a819e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46162/0 (socket says 172.21.15.2:46162) 2024-06-13T11:22:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.677+0000 7f90ad400700 1 -- 172.21.15.2:0/2236111273 learned_addr learned my addr 172.21.15.2:0/2236111273 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:35.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.677+0000 7f90ade00700 1 --2- 172.21.15.2:0/2236111273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a81076e0 0x7f90a8198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.677+0000 7f90aca00700 1 -- 172.21.15.2:0/2236111273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a81076e0 msgr2=0x7f90a8198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:35.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.677+0000 7f90aca00700 1 --2- 172.21.15.2:0/2236111273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a81076e0 0x7f90a8198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.677+0000 7f90aca00700 1 -- 172.21.15.2:0/2236111273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90a8102600 msgr2=0x7f90a819e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.677+0000 7f90aca00700 1 --2- 172.21.15.2:0/2236111273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90a8102600 0x7f90a819e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.677+0000 7f90aca00700 1 -- 172.21.15.2:0/2236111273 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a8199080 con 0x7f90a8102fb0 2024-06-13T11:22:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.677+0000 7f90ad400700 1 --2- 172.21.15.2:0/2236111273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90a8102600 0x7f90a819e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:22:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.677+0000 7f90aca00700 1 --2- 172.21.15.2:0/2236111273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90a8102fb0 0x7f90a819eca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9094005fd0 tx=0x7f909400eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.678+0000 7f90a6000700 1 -- 172.21.15.2:0/2236111273 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9094010900 con 0x7f90a8102fb0 2024-06-13T11:22:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.678+0000 7f90ae800700 1 -- 172.21.15.2:0/2236111273 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a8199370 con 0x7f90a8102fb0 2024-06-13T11:22:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.678+0000 7f90a6000700 1 -- 172.21.15.2:0/2236111273 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9094018420 con 0x7f90a8102fb0 2024-06-13T11:22:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.678+0000 7f90a6000700 1 -- 172.21.15.2:0/2236111273 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909400f680 con 0x7f90a8102fb0 2024-06-13T11:22:35.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.678+0000 7f90ae800700 1 -- 172.21.15.2:0/2236111273 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a81a5630 con 0x7f90a8102fb0 2024-06-13T11:22:35.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.681+0000 7f90a6000700 1 -- 172.21.15.2:0/2236111273 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f90940185d0 con 0x7f90a8102fb0 2024-06-13T11:22:35.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.683+0000 7f90ba695b80 1 Processor -- start 2024-06-13T11:22:35.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.683+0000 7f90ba695b80 1 -- start start 2024-06-13T11:22:35.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.683+0000 7f90ba695b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 0x5637c8fb83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.683+0000 7f90ba695b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fb8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.683+0000 7f90ba695b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fc1520 0x5637c8fc3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.683+0000 7f90ba695b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5637c8ec59c0 con 0x5637c8fc1520 2024-06-13T11:22:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.683+0000 7f90ba695b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5637c8f08ab0 con 0x5637c8fb8910 2024-06-13T11:22:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.683+0000 7f90ba695b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5637c8ec38a0 con 0x5637c8f32df0 2024-06-13T11:22:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.684+0000 7f90a6000700 1 --2- 172.21.15.2:0/2236111273 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f90900a2c20 0x7f90900a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.684+0000 7f90ad400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fb8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.684+0000 7f90ad400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fb8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:33658/0 (socket says 172.21.15.2:33658) 2024-06-13T11:22:35.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.684+0000 7f90aca00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fc1520 0x5637c8fc3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.684+0000 7f90ad400700 1 -- 172.21.15.2:0/2555177527 learned_addr learned my addr 172.21.15.2:0/2555177527 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:35.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.684+0000 7f90ade00700 1 --2- 172.21.15.2:0/2555177527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 0x5637c8fb83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.684+0000 7f90a6000700 1 -- 172.21.15.2:0/2236111273 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f90940cf490 con 0x7f90a8102fb0 2024-06-13T11:22:35.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.684+0000 7f90ade00700 1 --2- 172.21.15.2:0/2236111273 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f90900a2c20 0x7f90900a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.684+0000 7f90ad400700 1 -- 172.21.15.2:0/2555177527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 msgr2=0x5637c8fb83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:35.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.684+0000 7f90ad400700 1 --2- 172.21.15.2:0/2555177527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 0x5637c8fb83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.684+0000 7f90ad400700 1 -- 172.21.15.2:0/2555177527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fc1520 msgr2=0x5637c8fc3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:35.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.684+0000 7f90ad400700 1 --2- 172.21.15.2:0/2555177527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fc1520 0x5637c8fc3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.684+0000 7f90ad400700 1 -- 172.21.15.2:0/2555177527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637c8eb0f40 con 0x5637c8fb8910 2024-06-13T11:22:35.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.685+0000 7f90ad400700 1 --2- 172.21.15.2:0/2555177527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fb8d90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f909c011680 tx=0x7f909c011990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52180e758a5ba945 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:35.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.685+0000 7f909aa00700 1 -- 172.21.15.2:0/2555177527 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c004230 con 0x5637c8fb8910 2024-06-13T11:22:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.685+0000 7f909aa00700 1 -- 172.21.15.2:0/2555177527 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f909c0043d0 con 0x5637c8fb8910 2024-06-13T11:22:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.685+0000 7f909aa00700 1 -- 172.21.15.2:0/2555177527 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c019a30 con 0x5637c8fb8910 2024-06-13T11:22:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.686+0000 7f90ba695b80 1 -- 172.21.15.2:0/2555177527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 msgr2=0x5637c8fb8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.686+0000 7f90ba695b80 1 --2- 172.21.15.2:0/2555177527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fb8d90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f909c011680 tx=0x7f909c011990 comp rx=0 tx=0).stop 2024-06-13T11:22:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.686+0000 7f90ade00700 1 --2- 172.21.15.2:0/2236111273 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f90900a2c20 0x7f90900a50e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009550 tx=0x7f90a0009f30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.686+0000 7f90ba695b80 1 -- 172.21.15.2:0/2555177527 shutdown_connections 2024-06-13T11:22:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.686+0000 7f90ba695b80 1 --2- 172.21.15.2:0/2555177527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fc1520 0x5637c8fc3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.686+0000 7f90ba695b80 1 --2- 172.21.15.2:0/2555177527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 0x5637c8fb83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.686+0000 7f90ba695b80 1 --2- 172.21.15.2:0/2555177527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fb8d90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.686+0000 7f90ba695b80 1 -- 172.21.15.2:0/2555177527 >> 172.21.15.2:0/2555177527 conn(0x5637c8ee3120 msgr2=0x5637c8fb27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.686+0000 7f90ba695b80 1 -- 172.21.15.2:0/2555177527 shutdown_connections 2024-06-13T11:22:35.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.686+0000 7f90ba695b80 1 -- 172.21.15.2:0/2555177527 wait complete. 2024-06-13T11:22:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.687+0000 7f90ba695b80 1 -- start start 2024-06-13T11:22:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.687+0000 7f90ba695b80 1 Processor -- start 2024-06-13T11:22:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90ba695b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 0x5637c8fcaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90ba695b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fb8910 0x5637c8fcb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90ba695b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fc1520 0x5637c8fc5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90ba695b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5637c8ea4f10 con 0x5637c8fb8910 2024-06-13T11:22:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90ba695b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5637c8f04a70 con 0x5637c8fc1520 2024-06-13T11:22:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90ba695b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5637c8fc4190 con 0x5637c8f32df0 2024-06-13T11:22:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90ba695b80 10 client.0 _ll_register_callbacks cb 0x5637c8ea26d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:22:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90ad400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 0x5637c8fcaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90aca00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fb8910 0x5637c8fcb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90ad400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 0x5637c8fcaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:60552/0 (socket says 172.21.15.2:60552) 2024-06-13T11:22:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90ad400700 1 -- 172.21.15.2:0/92626497 learned_addr learned my addr 172.21.15.2:0/92626497 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90ade00700 1 --2- 172.21.15.2:0/92626497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fc1520 0x5637c8fc5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90ad400700 1 -- 172.21.15.2:0/92626497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fc1520 msgr2=0x5637c8fc5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90ad400700 1 --2- 172.21.15.2:0/92626497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fc1520 0x5637c8fc5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90ad400700 1 -- 172.21.15.2:0/92626497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fb8910 msgr2=0x5637c8fcb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90ad400700 1 --2- 172.21.15.2:0/92626497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fb8910 0x5637c8fcb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90ad400700 1 -- 172.21.15.2:0/92626497 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637c8e57880 con 0x5637c8f32df0 2024-06-13T11:22:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.688+0000 7f90aca00700 1 --2- 172.21.15.2:0/92626497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fb8910 0x5637c8fcb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:22:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.689+0000 7f90ad400700 1 --2- 172.21.15.2:0/92626497 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 0x5637c8fcaef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f909c01b040 tx=0x7f909c003930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59e3b8f5837a7a44 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:35.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.689+0000 7f908f400700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:22:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.689+0000 7f908f400700 1 -- 172.21.15.2:0/92626497 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c027020 con 0x5637c8f32df0 2024-06-13T11:22:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.689+0000 7f908f400700 1 -- 172.21.15.2:0/92626497 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f909c005250 con 0x5637c8f32df0 2024-06-13T11:22:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.689+0000 7f90ba695b80 1 -- 172.21.15.2:0/92626497 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f909c0043d0 con 0x5637c8f32df0 2024-06-13T11:22:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.690+0000 7f908f400700 1 -- 172.21.15.2:0/92626497 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f909c032050 con 0x5637c8f32df0 2024-06-13T11:22:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.690+0000 7f90ba695b80 10 client.24973 fetch_fsmap learned FSMap version 26 2024-06-13T11:22:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.690+0000 7f90ba695b80 1 -- 172.21.15.2:0/92626497 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5637c8fd2c50 con 0x5637c8f32df0 2024-06-13T11:22:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.691+0000 7f908f400700 1 -- 172.21.15.2:0/92626497 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f909c0043d0 con 0x5637c8f32df0 2024-06-13T11:22:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.691+0000 7f908f400700 1 -- 172.21.15.2:0/92626497 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f909c019690 con 0x5637c8f32df0 2024-06-13T11:22:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.691+0000 7f90ba695b80 10 client.24973 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T11:22:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.691+0000 7f90ba695b80 10 client.24973 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-13T11:22:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.691+0000 7f90ba695b80 20 client.24973 populate_metadata read hostname 'smithi002' 2024-06-13T11:22:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.691+0000 7f90ba695b80 1 --2- 172.21.15.2:0/92626497 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5637c8fd5090 0x5637c8fd6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.691+0000 7f90ba695b80 4 client.24973 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:22:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.691+0000 7f90ba695b80 1 -- 172.21.15.2:0/92626497 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637c8f15fb0 con 0x5637c8fd5090 2024-06-13T11:22:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.692+0000 7f90aca00700 1 --2- 172.21.15.2:0/92626497 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5637c8fd5090 0x5637c8fd6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.692+0000 7f90aca00700 1 --2- 172.21.15.2:0/92626497 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5637c8fd5090 0x5637c8fd6500 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ac6144ad1a451f04 server_cookie=8b3f6b1c3426a478 in_seq=0 out_seq=0 2024-06-13T11:22:35.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.692+0000 7f908f400700 10 client.24973 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:22:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.693+0000 7f908f400700 1 -- 172.21.15.2:0/92626497 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5637c8f15fb0 con 0x5637c8fd5090 2024-06-13T11:22:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.693+0000 7f908f400700 10 client.24973 handle_command_reply: tid=0 2024-06-13T11:22:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.693+0000 7f90ba695b80 1 client.24973 shutdown 2024-06-13T11:22:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.693+0000 7f90ba695b80 1 -- 172.21.15.2:0/92626497 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 msgr2=0x5637c8fcaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.693+0000 7f90ba695b80 1 --2- 172.21.15.2:0/92626497 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 0x5637c8fcaef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f909c01b040 tx=0x7f909c003930 comp rx=0 tx=0).stop 2024-06-13T11:22:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.693+0000 7f90ba695b80 1 -- 172.21.15.2:0/92626497 shutdown_connections 2024-06-13T11:22:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.693+0000 7f90ba695b80 1 --2- 172.21.15.2:0/92626497 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5637c8fd5090 0x5637c8fd6500 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.693+0000 7f90ba695b80 1 --2- 172.21.15.2:0/92626497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fc1520 0x5637c8fc5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.693+0000 7f90ba695b80 1 --2- 172.21.15.2:0/92626497 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 0x5637c8fcaef0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.693+0000 7f90ba695b80 1 --2- 172.21.15.2:0/92626497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fb8910 0x5637c8fcb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.693+0000 7f908f400700 0 client.24973 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:22:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.693+0000 7f90ba695b80 1 -- 172.21.15.2:0/92626497 >> 172.21.15.2:0/92626497 conn(0x5637c8ee3120 msgr2=0x5637c8fb23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.694+0000 7f90ba695b80 1 -- 172.21.15.2:0/92626497 shutdown_connections 2024-06-13T11:22:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.694+0000 7f90ba695b80 1 -- 172.21.15.2:0/92626497 wait complete. 2024-06-13T11:22:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.694+0000 7f90ba695b80 20 client.24973 trim_cache size 0 max 16384 2024-06-13T11:22:35.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.717+0000 7f90ba695b80 1 Processor -- start 2024-06-13T11:22:35.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.718+0000 7f90ba695b80 1 -- start start 2024-06-13T11:22:35.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.718+0000 7f90ba695b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8f32df0 0x5637c8fb8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.718+0000 7f90ba695b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fbd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.718+0000 7f90ba695b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8fc1520 0x5637c8fcabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.718+0000 7f90ba695b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5637c8fd4840 con 0x5637c8f32df0 2024-06-13T11:22:35.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.718+0000 7f90ba695b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5637c8fd4f10 con 0x5637c8fb8910 2024-06-13T11:22:35.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.718+0000 7f90ba695b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5637c8fd55e0 con 0x5637c8fc1520 2024-06-13T11:22:35.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.718+0000 7f90ad400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8f32df0 0x5637c8fb8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.718+0000 7f90ad400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8f32df0 0x5637c8fb8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46194/0 (socket says 172.21.15.2:46194) 2024-06-13T11:22:35.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.718+0000 7f90ad400700 1 -- 172.21.15.2:0/2270785663 learned_addr learned my addr 172.21.15.2:0/2270785663 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:35.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.718+0000 7f90aca00700 1 --2- 172.21.15.2:0/2270785663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fbd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.719+0000 7f90ade00700 1 --2- 172.21.15.2:0/2270785663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8fc1520 0x5637c8fcabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.719+0000 7f90ad400700 1 -- 172.21.15.2:0/2270785663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8fc1520 msgr2=0x5637c8fcabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:35.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.719+0000 7f90ad400700 1 --2- 172.21.15.2:0/2270785663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8fc1520 0x5637c8fcabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.719+0000 7f90ad400700 1 -- 172.21.15.2:0/2270785663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 msgr2=0x5637c8fbd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:35.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.719+0000 7f90ad400700 1 --2- 172.21.15.2:0/2270785663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fbd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.719+0000 7f90ad400700 1 -- 172.21.15.2:0/2270785663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637c8fc3c80 con 0x5637c8f32df0 2024-06-13T11:22:35.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.719+0000 7f90aca00700 1 --2- 172.21.15.2:0/2270785663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fbd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:22:35.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.719+0000 7f90ad400700 1 --2- 172.21.15.2:0/2270785663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8f32df0 0x5637c8fb8cf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f909c019b30 tx=0x7f909c003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e6e52229ff46e0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:35.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.719+0000 7f909a000700 1 -- 172.21.15.2:0/2270785663 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c03b070 con 0x5637c8f32df0 2024-06-13T11:22:35.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.720+0000 7f909a000700 1 -- 172.21.15.2:0/2270785663 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f909c015030 con 0x5637c8f32df0 2024-06-13T11:22:35.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.720+0000 7f909a000700 1 -- 172.21.15.2:0/2270785663 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c027070 con 0x5637c8f32df0 2024-06-13T11:22:35.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.720+0000 7f90ba695b80 1 -- 172.21.15.2:0/2270785663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8f32df0 msgr2=0x5637c8fb8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:35.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.720+0000 7f90ba695b80 1 --2- 172.21.15.2:0/2270785663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8f32df0 0x5637c8fb8cf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f909c019b30 tx=0x7f909c003890 comp rx=0 tx=0).stop 2024-06-13T11:22:35.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.720+0000 7f90ba695b80 1 -- 172.21.15.2:0/2270785663 shutdown_connections 2024-06-13T11:22:35.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.720+0000 7f90ba695b80 1 --2- 172.21.15.2:0/2270785663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8f32df0 0x5637c8fb8cf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.720+0000 7f90ba695b80 1 --2- 172.21.15.2:0/2270785663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8fc1520 0x5637c8fcabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.720+0000 7f90ba695b80 1 --2- 172.21.15.2:0/2270785663 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fbd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.720+0000 7f90ba695b80 1 -- 172.21.15.2:0/2270785663 >> 172.21.15.2:0/2270785663 conn(0x5637c8ee3120 msgr2=0x5637c8fd40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:35.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.721+0000 7f90ba695b80 1 -- 172.21.15.2:0/2270785663 shutdown_connections 2024-06-13T11:22:35.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.721+0000 7f90ba695b80 1 -- 172.21.15.2:0/2270785663 wait complete. 2024-06-13T11:22:35.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.721+0000 7f90ba695b80 1 -- start start 2024-06-13T11:22:35.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.721+0000 7f90ba695b80 1 Processor -- start 2024-06-13T11:22:35.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.722+0000 7f90ba695b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 0x5637c8fcc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.722+0000 7f90ba695b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fcc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.722+0000 7f90ba695b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fc1520 0x5637c8fcca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.722+0000 7f90ba695b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5637c8fd6380 con 0x5637c8fc1520 2024-06-13T11:22:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.722+0000 7f90ba695b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5637c8fd5cb0 con 0x5637c8fb8910 2024-06-13T11:22:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.722+0000 7f90ba695b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5637c8fd6a50 con 0x5637c8f32df0 2024-06-13T11:22:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.722+0000 7f90ba695b80 10 client.0 _ll_register_callbacks cb 0x5637c8ea26d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:22:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.722+0000 7f90ade00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fc1520 0x5637c8fcca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.722+0000 7f90aca00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fcc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.722+0000 7f90aca00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fcc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:33690/0 (socket says 172.21.15.2:33690) 2024-06-13T11:22:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.722+0000 7f90aca00700 1 -- 172.21.15.2:0/2561727470 learned_addr learned my addr 172.21.15.2:0/2561727470 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.722+0000 7f90ad400700 1 --2- 172.21.15.2:0/2561727470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 0x5637c8fcc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.722+0000 7f90ade00700 1 -- 172.21.15.2:0/2561727470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 msgr2=0x5637c8fcc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:35.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.723+0000 7f90ade00700 1 --2- 172.21.15.2:0/2561727470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 0x5637c8fcc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.723+0000 7f90ade00700 1 -- 172.21.15.2:0/2561727470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 msgr2=0x5637c8fcc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.723+0000 7f90ade00700 1 --2- 172.21.15.2:0/2561727470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fcc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.723+0000 7f90ade00700 1 -- 172.21.15.2:0/2561727470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637c903e940 con 0x5637c8fc1520 2024-06-13T11:22:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.723+0000 7f90ad400700 1 --2- 172.21.15.2:0/2561727470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 0x5637c8fcc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:22:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.723+0000 7f90aca00700 1 --2- 172.21.15.2:0/2561727470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fcc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:22:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.723+0000 7f90ade00700 1 --2- 172.21.15.2:0/2561727470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fc1520 0x5637c8fcca90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009450 tx=0x7f90a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1238a7244287d4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.723+0000 7f908f400700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:22:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.723+0000 7f908f400700 1 -- 172.21.15.2:0/2561727470 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0022070 con 0x5637c8fc1520 2024-06-13T11:22:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.723+0000 7f90ba695b80 1 -- 172.21.15.2:0/2561727470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f909c015030 con 0x5637c8fc1520 2024-06-13T11:22:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.723+0000 7f908f400700 1 -- 172.21.15.2:0/2561727470 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f90a001e430 con 0x5637c8fc1520 2024-06-13T11:22:35.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.724+0000 7f908f400700 1 -- 172.21.15.2:0/2561727470 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f90a001e630 con 0x5637c8fc1520 2024-06-13T11:22:35.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.724+0000 7f90ba695b80 10 client.14862 fetch_fsmap learned FSMap version 26 2024-06-13T11:22:35.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.724+0000 7f90ba695b80 1 -- 172.21.15.2:0/2561727470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5637c903fc20 con 0x5637c8fc1520 2024-06-13T11:22:35.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.724+0000 7f908f400700 1 -- 172.21.15.2:0/2561727470 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f909c015030 con 0x5637c8fc1520 2024-06-13T11:22:35.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.724+0000 7f908f400700 1 -- 172.21.15.2:0/2561727470 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f90a0011070 con 0x5637c8fc1520 2024-06-13T11:22:35.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.724+0000 7f90ba695b80 10 client.14862 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T11:22:35.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.724+0000 7f90ba695b80 10 client.14862 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-13T11:22:35.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.724+0000 7f90ba695b80 20 client.14862 populate_metadata read hostname 'smithi002' 2024-06-13T11:22:35.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.724+0000 7f90ba695b80 1 --2- 172.21.15.2:0/2561727470 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5637c90448f0 0x5637c9043600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:35.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.724+0000 7f90ba695b80 4 client.14862 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T11:22:35.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.724+0000 7f90ba695b80 1 -- 172.21.15.2:0/2561727470 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "status"}) -- 0x5637c8f10530 con 0x5637c90448f0 2024-06-13T11:22:35.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.725+0000 7f90ad400700 1 --2- 172.21.15.2:0/2561727470 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5637c90448f0 0x5637c9043600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:35.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.725+0000 7f90ad400700 1 --2- 172.21.15.2:0/2561727470 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5637c90448f0 0x5637c9043600 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=93ca955062f9bde9 server_cookie=3176d8bf1d451a3f in_seq=0 out_seq=0 2024-06-13T11:22:35.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.725+0000 7f908f400700 10 client.14862 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:22:35.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.726+0000 7f908f400700 1 -- 172.21.15.2:0/2561727470 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5637c8f10530 con 0x5637c90448f0 2024-06-13T11:22:35.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.726+0000 7f908f400700 10 client.14862 handle_command_reply: tid=0 2024-06-13T11:22:35.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.726+0000 7f90ba695b80 1 client.14862 shutdown 2024-06-13T11:22:35.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.726+0000 7f90ba695b80 1 -- 172.21.15.2:0/2561727470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fc1520 msgr2=0x5637c8fcca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:35.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.726+0000 7f90ba695b80 1 --2- 172.21.15.2:0/2561727470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fc1520 0x5637c8fcca90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009450 tx=0x7f90a000b330 comp rx=0 tx=0).stop 2024-06-13T11:22:35.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.726+0000 7f90ba695b80 1 -- 172.21.15.2:0/2561727470 shutdown_connections 2024-06-13T11:22:35.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.726+0000 7f90ba695b80 1 --2- 172.21.15.2:0/2561727470 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5637c90448f0 0x5637c9043600 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.726+0000 7f90ba695b80 1 --2- 172.21.15.2:0/2561727470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5637c8fc1520 0x5637c8fcca90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.726+0000 7f90ba695b80 1 --2- 172.21.15.2:0/2561727470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5637c8f32df0 0x5637c8fcc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.726+0000 7f90ba695b80 1 --2- 172.21.15.2:0/2561727470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5637c8fb8910 0x5637c8fcc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.726+0000 7f908f400700 0 client.14862 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:22:35.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.726+0000 7f90ba695b80 1 -- 172.21.15.2:0/2561727470 >> 172.21.15.2:0/2561727470 conn(0x5637c8ee3120 msgr2=0x5637c8fbd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:35.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.726+0000 7f90ba695b80 1 -- 172.21.15.2:0/2561727470 shutdown_connections 2024-06-13T11:22:35.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.726+0000 7f90ba695b80 1 -- 172.21.15.2:0/2561727470 wait complete. 2024-06-13T11:22:35.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.726+0000 7f90ba695b80 20 client.14862 trim_cache size 0 max 16384 2024-06-13T11:22:35.728 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:22:35.728 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "3611563c-2975-11ef-bc9c-c7b262605968", 2024-06-13T11:22:35.728 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 2, 2024-06-13T11:22:35.729 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24493, 2024-06-13T11:22:35.729 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-06-13T11:22:35.729 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-06-13T11:22:35.729 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-06-13T11:22:35.729 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 148.33122549699999, 2024-06-13T11:22:35.729 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 26, 2024-06-13T11:22:35.729 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 99, 2024-06-13T11:22:35.729 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 97, 2024-06-13T11:22:35.729 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 270.27200271800001 2024-06-13T11:22:35.729 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:22:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.727+0000 7f90ae800700 1 -- 172.21.15.2:0/2236111273 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f90900a2c20 msgr2=0x7f90900a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.727+0000 7f90ae800700 1 --2- 172.21.15.2:0/2236111273 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f90900a2c20 0x7f90900a50e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009550 tx=0x7f90a0009f30 comp rx=0 tx=0).stop 2024-06-13T11:22:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.727+0000 7f90ae800700 1 -- 172.21.15.2:0/2236111273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90a8102fb0 msgr2=0x7f90a819eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.727+0000 7f90ae800700 1 --2- 172.21.15.2:0/2236111273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90a8102fb0 0x7f90a819eca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9094005fd0 tx=0x7f909400eca0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.727+0000 7f90ae800700 1 -- 172.21.15.2:0/2236111273 shutdown_connections 2024-06-13T11:22:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.727+0000 7f90ae800700 1 --2- 172.21.15.2:0/2236111273 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f90900a2c20 0x7f90900a50e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.727+0000 7f90ae800700 1 --2- 172.21.15.2:0/2236111273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90a8102600 0x7f90a819e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.727+0000 7f90ae800700 1 --2- 172.21.15.2:0/2236111273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a81076e0 0x7f90a8198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.727+0000 7f90ae800700 1 --2- 172.21.15.2:0/2236111273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90a8102fb0 0x7f90a819eca0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.727+0000 7f90ae800700 1 -- 172.21.15.2:0/2236111273 >> 172.21.15.2:0/2236111273 conn(0x7f90a80fdeb0 msgr2=0x7f90a80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.727+0000 7f90ae800700 1 -- 172.21.15.2:0/2236111273 shutdown_connections 2024-06-13T11:22:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:35.727+0000 7f90ae800700 1 -- 172.21.15.2:0/2236111273 wait complete. 2024-06-13T11:22:36.664 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.b status 2024-06-13T11:22:37.138 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:22:37.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:36 smithi077 ceph-mon[36410]: pgmap v454: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:37.291 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:36 smithi002 ceph-mon[32210]: pgmap v454: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:37.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:36 smithi178 ceph-mon[36913]: pgmap v454: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:39.248 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:38 smithi178 ceph-mon[36913]: pgmap v455: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:22:39.250 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:38 smithi002 ceph-mon[32210]: pgmap v455: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:22:39.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:38 smithi077 ceph-mon[36410]: pgmap v455: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:22:39.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.535+0000 7fcd8ca00700 1 -- 172.21.15.2:0/3885197014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd88108ac0 msgr2=0x7fcd88108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:39.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.535+0000 7fcd8ca00700 1 --2- 172.21.15.2:0/3885197014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd88108ac0 0x7fcd88108f40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009990 tx=0x7fcd70009ca0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.536+0000 7fcd8ca00700 1 -- 172.21.15.2:0/3885197014 shutdown_connections 2024-06-13T11:22:39.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.536+0000 7fcd8ca00700 1 --2- 172.21.15.2:0/3885197014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88109480 0x7fcd88115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.536+0000 7fcd8ca00700 1 --2- 172.21.15.2:0/3885197014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd8810eac0 0x7fcd8810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.536+0000 7fcd8ca00700 1 --2- 172.21.15.2:0/3885197014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd88108ac0 0x7fcd88108f40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.536+0000 7fcd8ca00700 1 -- 172.21.15.2:0/3885197014 >> 172.21.15.2:0/3885197014 conn(0x7fcd88075c60 msgr2=0x7fcd881072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:39.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.536+0000 7fcd8ca00700 1 -- 172.21.15.2:0/3885197014 shutdown_connections 2024-06-13T11:22:39.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.536+0000 7fcd8ca00700 1 -- 172.21.15.2:0/3885197014 wait complete. 2024-06-13T11:22:39.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.537+0000 7fcd8ca00700 1 Processor -- start 2024-06-13T11:22:39.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.538+0000 7fcd8ca00700 1 -- start start 2024-06-13T11:22:39.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.538+0000 7fcd8ca00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd88108ac0 0x7fcd8819f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.538+0000 7fcd8ca00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88109480 0x7fcd8819f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.538+0000 7fcd8ca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd8810eac0 0x7fcd881a3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.538+0000 7fcd8ca00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcd88118e40 con 0x7fcd88108ac0 2024-06-13T11:22:39.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.538+0000 7fcd8ca00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcd88118cc0 con 0x7fcd88109480 2024-06-13T11:22:39.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.538+0000 7fcd8ca00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcd88118fc0 con 0x7fcd8810eac0 2024-06-13T11:22:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.539+0000 7fcd7fe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88109480 0x7fcd8819f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.539+0000 7fcd85e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd88108ac0 0x7fcd8819f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.539+0000 7fcd7fe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88109480 0x7fcd8819f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:42194/0 (socket says 172.21.15.2:42194) 2024-06-13T11:22:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.539+0000 7fcd7fe00700 1 -- 172.21.15.2:0/618121079 learned_addr learned my addr 172.21.15.2:0/618121079 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.539+0000 7fcd86800700 1 --2- 172.21.15.2:0/618121079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd8810eac0 0x7fcd881a3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.539+0000 7fcd7fe00700 1 -- 172.21.15.2:0/618121079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd8810eac0 msgr2=0x7fcd881a3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.539+0000 7fcd7fe00700 1 --2- 172.21.15.2:0/618121079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd8810eac0 0x7fcd881a3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.539+0000 7fcd7fe00700 1 -- 172.21.15.2:0/618121079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd88108ac0 msgr2=0x7fcd8819f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.539+0000 7fcd7fe00700 1 --2- 172.21.15.2:0/618121079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd88108ac0 0x7fcd8819f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.539+0000 7fcd7fe00700 1 -- 172.21.15.2:0/618121079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd881a42a0 con 0x7fcd88109480 2024-06-13T11:22:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.539+0000 7fcd7fe00700 1 --2- 172.21.15.2:0/618121079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88109480 0x7fcd8819f7d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcd70000c00 tx=0x7fcd7000bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.540+0000 7fcd7ea00700 1 -- 172.21.15.2:0/618121079 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd70027070 con 0x7fcd88109480 2024-06-13T11:22:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.540+0000 7fcd7ea00700 1 -- 172.21.15.2:0/618121079 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd70003d70 con 0x7fcd88109480 2024-06-13T11:22:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.540+0000 7fcd7ea00700 1 -- 172.21.15.2:0/618121079 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7000f460 con 0x7fcd88109480 2024-06-13T11:22:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.540+0000 7fcd8ca00700 1 -- 172.21.15.2:0/618121079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd881a4530 con 0x7fcd88109480 2024-06-13T11:22:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.540+0000 7fcd8ca00700 1 -- 172.21.15.2:0/618121079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd881abe10 con 0x7fcd88109480 2024-06-13T11:22:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.545+0000 7fcd7ea00700 1 -- 172.21.15.2:0/618121079 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fcd7002a070 con 0x7fcd88109480 2024-06-13T11:22:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.546+0000 7fcd973d6b80 1 Processor -- start 2024-06-13T11:22:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.546+0000 7fcd973d6b80 1 -- start start 2024-06-13T11:22:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.546+0000 7fcd7ea00700 1 --2- 172.21.15.2:0/618121079 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fcd6c0a2c20 0x7fcd6c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.546+0000 7fcd973d6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b693df0 0x55609b717020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.546+0000 7fcd973d6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b717560 0x55609b7179e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.546+0000 7fcd7ea00700 1 -- 172.21.15.2:0/618121079 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fcd700d0140 con 0x7fcd88109480 2024-06-13T11:22:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.546+0000 7fcd973d6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b7222b0 0x55609b7246a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.546+0000 7fcd973d6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55609b6269c0 con 0x55609b7222b0 2024-06-13T11:22:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.546+0000 7fcd973d6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55609b669ab0 con 0x55609b693df0 2024-06-13T11:22:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.546+0000 7fcd973d6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55609b6248a0 con 0x55609b717560 2024-06-13T11:22:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.546+0000 7fcd86800700 1 --2- 172.21.15.2:0/618121079 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fcd6c0a2c20 0x7fcd6c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.547+0000 7fcd85e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b693df0 0x55609b717020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.547+0000 7fcd85e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b693df0 0x55609b717020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:42198/0 (socket says 172.21.15.2:42198) 2024-06-13T11:22:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.547+0000 7fcd85e00700 1 -- 172.21.15.2:0/2383229228 learned_addr learned my addr 172.21.15.2:0/2383229228 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.547+0000 7fcd7fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b717560 0x55609b7179e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.547+0000 7fcd86800700 1 --2- 172.21.15.2:0/2383229228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b7222b0 0x55609b7246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.547+0000 7fcd85e00700 1 -- 172.21.15.2:0/2383229228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b717560 msgr2=0x55609b7179e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.547+0000 7fcd85e00700 1 --2- 172.21.15.2:0/2383229228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b717560 0x55609b7179e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.547+0000 7fcd85e00700 1 -- 172.21.15.2:0/2383229228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b7222b0 msgr2=0x55609b7246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.547+0000 7fcd85e00700 1 --2- 172.21.15.2:0/2383229228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b7222b0 0x55609b7246a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.547+0000 7fcd85e00700 1 -- 172.21.15.2:0/2383229228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55609b611f40 con 0x55609b693df0 2024-06-13T11:22:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.547+0000 7fcd85e00700 1 --2- 172.21.15.2:0/2383229228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b693df0 0x55609b717020 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009d00 tx=0x7fcd78011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5fea0e247f1e561 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.548+0000 7fcd77400700 1 -- 172.21.15.2:0/2383229228 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78004230 con 0x55609b693df0 2024-06-13T11:22:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.548+0000 7fcd77400700 1 -- 172.21.15.2:0/2383229228 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd780043d0 con 0x55609b693df0 2024-06-13T11:22:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.548+0000 7fcd77400700 1 -- 172.21.15.2:0/2383229228 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78019980 con 0x55609b693df0 2024-06-13T11:22:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.549+0000 7fcd973d6b80 1 -- 172.21.15.2:0/2383229228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b693df0 msgr2=0x55609b717020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.549+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/2383229228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b693df0 0x55609b717020 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009d00 tx=0x7fcd78011720 comp rx=0 tx=0).stop 2024-06-13T11:22:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.549+0000 7fcd86800700 1 --2- 172.21.15.2:0/618121079 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fcd6c0a2c20 0x7fcd6c0a50e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009da0 tx=0x7fcd80009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.549+0000 7fcd973d6b80 1 -- 172.21.15.2:0/2383229228 shutdown_connections 2024-06-13T11:22:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.549+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/2383229228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b7222b0 0x55609b7246a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.549+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/2383229228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b693df0 0x55609b717020 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.549+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/2383229228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b717560 0x55609b7179e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.549+0000 7fcd973d6b80 1 -- 172.21.15.2:0/2383229228 >> 172.21.15.2:0/2383229228 conn(0x55609b644120 msgr2=0x55609b713460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.549+0000 7fcd973d6b80 1 -- 172.21.15.2:0/2383229228 shutdown_connections 2024-06-13T11:22:39.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.549+0000 7fcd973d6b80 1 -- 172.21.15.2:0/2383229228 wait complete. 2024-06-13T11:22:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.549+0000 7fcd973d6b80 1 -- start start 2024-06-13T11:22:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.550+0000 7fcd973d6b80 1 Processor -- start 2024-06-13T11:22:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.550+0000 7fcd973d6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b693df0 0x55609b721a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.550+0000 7fcd973d6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b717560 0x55609b71ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.550+0000 7fcd973d6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b7222b0 0x55609b71f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.550+0000 7fcd973d6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55609b605f10 con 0x55609b717560 2024-06-13T11:22:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.550+0000 7fcd973d6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55609b665a70 con 0x55609b7222b0 2024-06-13T11:22:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.550+0000 7fcd973d6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55609b724f70 con 0x55609b693df0 2024-06-13T11:22:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.550+0000 7fcd973d6b80 10 client.0 _ll_register_callbacks cb 0x55609b6036d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:22:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.551+0000 7fcd7fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b717560 0x55609b71ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.551+0000 7fcd7fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b717560 0x55609b71ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38294/0 (socket says 172.21.15.2:38294) 2024-06-13T11:22:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.551+0000 7fcd7fe00700 1 -- 172.21.15.2:0/2429892956 learned_addr learned my addr 172.21.15.2:0/2429892956 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.551+0000 7fcd86800700 1 --2- 172.21.15.2:0/2429892956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b7222b0 0x55609b71f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.551+0000 7fcd85e00700 1 --2- 172.21.15.2:0/2429892956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b693df0 0x55609b721a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.551+0000 7fcd7fe00700 1 -- 172.21.15.2:0/2429892956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b693df0 msgr2=0x55609b721a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.551+0000 7fcd7fe00700 1 --2- 172.21.15.2:0/2429892956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b693df0 0x55609b721a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.551+0000 7fcd7fe00700 1 -- 172.21.15.2:0/2429892956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b7222b0 msgr2=0x55609b71f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.551+0000 7fcd7fe00700 1 --2- 172.21.15.2:0/2429892956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b7222b0 0x55609b71f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.551+0000 7fcd7fe00700 1 -- 172.21.15.2:0/2429892956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55609b5b8880 con 0x55609b717560 2024-06-13T11:22:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.551+0000 7fcd86800700 1 --2- 172.21.15.2:0/2429892956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b7222b0 0x55609b71f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:22:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.551+0000 7fcd7fe00700 1 --2- 172.21.15.2:0/2429892956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b717560 0x55609b71ed20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000beb0 tx=0x7fcd70022970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de97c452017ea1d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.552+0000 7fcd6be00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:22:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.552+0000 7fcd6be00700 1 -- 172.21.15.2:0/2429892956 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7009bfa0 con 0x55609b717560 2024-06-13T11:22:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.552+0000 7fcd6be00700 1 -- 172.21.15.2:0/2429892956 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fcd70085bd0 con 0x55609b717560 2024-06-13T11:22:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.552+0000 7fcd973d6b80 1 -- 172.21.15.2:0/2429892956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd780043d0 con 0x55609b717560 2024-06-13T11:22:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.552+0000 7fcd6be00700 1 -- 172.21.15.2:0/2429892956 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcd7009cd40 con 0x55609b717560 2024-06-13T11:22:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.552+0000 7fcd973d6b80 10 client.14874 fetch_fsmap learned FSMap version 26 2024-06-13T11:22:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.552+0000 7fcd973d6b80 1 -- 172.21.15.2:0/2429892956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55609b72f6a0 con 0x55609b717560 2024-06-13T11:22:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.552+0000 7fcd6be00700 1 -- 172.21.15.2:0/2429892956 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd780043d0 con 0x55609b717560 2024-06-13T11:22:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.553+0000 7fcd6be00700 1 -- 172.21.15.2:0/2429892956 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fcd700a4d90 con 0x55609b717560 2024-06-13T11:22:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.553+0000 7fcd973d6b80 10 client.14874 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T11:22:39.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.553+0000 7fcd973d6b80 10 client.14874 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-13T11:22:39.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.553+0000 7fcd973d6b80 20 client.14874 populate_metadata read hostname 'smithi002' 2024-06-13T11:22:39.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.553+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/2429892956 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55609b731d10 0x55609b733180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.553+0000 7fcd973d6b80 4 client.14874 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:22:39.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.553+0000 7fcd973d6b80 1 -- 172.21.15.2:0/2429892956 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55609b676fb0 con 0x55609b731d10 2024-06-13T11:22:39.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.553+0000 7fcd85e00700 1 --2- 172.21.15.2:0/2429892956 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55609b731d10 0x55609b733180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.554+0000 7fcd85e00700 1 --2- 172.21.15.2:0/2429892956 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55609b731d10 0x55609b733180 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4dbbdc1919efc08f server_cookie=286b53f81afeda72 in_seq=0 out_seq=0 2024-06-13T11:22:39.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.554+0000 7fcd6be00700 10 client.14874 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:22:39.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.555+0000 7fcd6be00700 1 -- 172.21.15.2:0/2429892956 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55609b676fb0 con 0x55609b731d10 2024-06-13T11:22:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.555+0000 7fcd6be00700 10 client.14874 handle_command_reply: tid=0 2024-06-13T11:22:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.555+0000 7fcd973d6b80 1 client.14874 shutdown 2024-06-13T11:22:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.555+0000 7fcd973d6b80 1 -- 172.21.15.2:0/2429892956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b717560 msgr2=0x55609b71ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.555+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/2429892956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b717560 0x55609b71ed20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000beb0 tx=0x7fcd70022970 comp rx=0 tx=0).stop 2024-06-13T11:22:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.555+0000 7fcd973d6b80 1 -- 172.21.15.2:0/2429892956 shutdown_connections 2024-06-13T11:22:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.555+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/2429892956 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55609b731d10 0x55609b733180 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.555+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/2429892956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b7222b0 0x55609b71f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.555+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/2429892956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b693df0 0x55609b721a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.555+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/2429892956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b717560 0x55609b71ed20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.555+0000 7fcd973d6b80 1 -- 172.21.15.2:0/2429892956 >> 172.21.15.2:0/2429892956 conn(0x55609b644120 msgr2=0x55609b7126f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.555+0000 7fcd6be00700 0 client.14874 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:22:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.555+0000 7fcd973d6b80 1 -- 172.21.15.2:0/2429892956 shutdown_connections 2024-06-13T11:22:39.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.556+0000 7fcd973d6b80 1 -- 172.21.15.2:0/2429892956 wait complete. 2024-06-13T11:22:39.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.556+0000 7fcd973d6b80 20 client.14874 trim_cache size 0 max 16384 2024-06-13T11:22:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.579+0000 7fcd973d6b80 1 Processor -- start 2024-06-13T11:22:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.580+0000 7fcd973d6b80 1 -- start start 2024-06-13T11:22:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.580+0000 7fcd973d6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b644120 0x55609b71f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.580+0000 7fcd973d6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b693df0 0x55609b721560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.580+0000 7fcd973d6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b717560 0x55609b7236a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.580+0000 7fcd973d6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55609b7314c0 con 0x55609b693df0 2024-06-13T11:22:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.580+0000 7fcd973d6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55609b731b90 con 0x55609b644120 2024-06-13T11:22:39.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.580+0000 7fcd973d6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55609b732260 con 0x55609b717560 2024-06-13T11:22:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.580+0000 7fcd86800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b717560 0x55609b7236a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.580+0000 7fcd86800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b717560 0x55609b7236a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55084/0 (socket says 172.21.15.2:55084) 2024-06-13T11:22:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.580+0000 7fcd86800700 1 -- 172.21.15.2:0/3020674237 learned_addr learned my addr 172.21.15.2:0/3020674237 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.580+0000 7fcd7fe00700 1 --2- 172.21.15.2:0/3020674237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b693df0 0x55609b721560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.580+0000 7fcd85e00700 1 --2- 172.21.15.2:0/3020674237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b644120 0x55609b71f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.581+0000 7fcd86800700 1 -- 172.21.15.2:0/3020674237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b644120 msgr2=0x55609b71f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.581+0000 7fcd86800700 1 --2- 172.21.15.2:0/3020674237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b644120 0x55609b71f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.581+0000 7fcd86800700 1 -- 172.21.15.2:0/3020674237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b693df0 msgr2=0x55609b721560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.581+0000 7fcd86800700 1 --2- 172.21.15.2:0/3020674237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b693df0 0x55609b721560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.581+0000 7fcd86800700 1 -- 172.21.15.2:0/3020674237 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55609b7249f0 con 0x55609b717560 2024-06-13T11:22:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.581+0000 7fcd85e00700 1 --2- 172.21.15.2:0/3020674237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b644120 0x55609b71f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:22:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.581+0000 7fcd86800700 1 --2- 172.21.15.2:0/3020674237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b717560 0x55609b7236a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcd80017b10 tx=0x7fcd8000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46d3fc0cf342d202 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.582+0000 7fcd76a00700 1 -- 172.21.15.2:0/3020674237 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80003a00 con 0x55609b717560 2024-06-13T11:22:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.582+0000 7fcd76a00700 1 -- 172.21.15.2:0/3020674237 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd80028c30 con 0x55609b717560 2024-06-13T11:22:39.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.582+0000 7fcd76a00700 1 -- 172.21.15.2:0/3020674237 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80004550 con 0x55609b717560 2024-06-13T11:22:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.582+0000 7fcd973d6b80 1 -- 172.21.15.2:0/3020674237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b717560 msgr2=0x55609b7236a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.582+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/3020674237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b717560 0x55609b7236a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcd80017b10 tx=0x7fcd8000b040 comp rx=0 tx=0).stop 2024-06-13T11:22:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.582+0000 7fcd973d6b80 1 -- 172.21.15.2:0/3020674237 shutdown_connections 2024-06-13T11:22:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.582+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/3020674237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b717560 0x55609b7236a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.582+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/3020674237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b644120 0x55609b71f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.582+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/3020674237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b693df0 0x55609b721560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.582+0000 7fcd973d6b80 1 -- 172.21.15.2:0/3020674237 >> 172.21.15.2:0/3020674237 conn(0x55609b70f4b0 msgr2=0x55609b712f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.583+0000 7fcd973d6b80 1 -- 172.21.15.2:0/3020674237 shutdown_connections 2024-06-13T11:22:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.583+0000 7fcd973d6b80 1 -- 172.21.15.2:0/3020674237 wait complete. 2024-06-13T11:22:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.583+0000 7fcd973d6b80 1 -- start start 2024-06-13T11:22:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.583+0000 7fcd973d6b80 1 Processor -- start 2024-06-13T11:22:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.584+0000 7fcd973d6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b644120 0x55609b73ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.584+0000 7fcd973d6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b693df0 0x55609b71b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.584+0000 7fcd973d6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b717560 0x55609b71bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.584+0000 7fcd973d6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55609b733000 con 0x55609b717560 2024-06-13T11:22:39.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.584+0000 7fcd973d6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55609b732930 con 0x55609b644120 2024-06-13T11:22:39.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.584+0000 7fcd973d6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55609b7336d0 con 0x55609b693df0 2024-06-13T11:22:39.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.584+0000 7fcd973d6b80 10 client.0 _ll_register_callbacks cb 0x55609b6036d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:22:39.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.584+0000 7fcd7fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b693df0 0x55609b71b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.584+0000 7fcd86800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b717560 0x55609b71bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.584+0000 7fcd7fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b693df0 0x55609b71b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55088/0 (socket says 172.21.15.2:55088) 2024-06-13T11:22:39.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.584+0000 7fcd7fe00700 1 -- 172.21.15.2:0/155048042 learned_addr learned my addr 172.21.15.2:0/155048042 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:39.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.584+0000 7fcd85e00700 1 --2- 172.21.15.2:0/155048042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b644120 0x55609b73ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.585+0000 7fcd86800700 1 -- 172.21.15.2:0/155048042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b693df0 msgr2=0x55609b71b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:39.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.585+0000 7fcd86800700 1 --2- 172.21.15.2:0/155048042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b693df0 0x55609b71b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.585+0000 7fcd86800700 1 -- 172.21.15.2:0/155048042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b644120 msgr2=0x55609b73ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.585+0000 7fcd86800700 1 --2- 172.21.15.2:0/155048042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b644120 0x55609b73ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.585+0000 7fcd86800700 1 -- 172.21.15.2:0/155048042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55609b71c230 con 0x55609b717560 2024-06-13T11:22:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.585+0000 7fcd85e00700 1 --2- 172.21.15.2:0/155048042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b644120 0x55609b73ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:22:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.585+0000 7fcd86800700 1 --2- 172.21.15.2:0/155048042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b717560 0x55609b71bcc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000b010 tx=0x7fcd80028ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61ddbd56c229436 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.585+0000 7fcd6be00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:22:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.585+0000 7fcd6be00700 1 -- 172.21.15.2:0/155048042 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80037060 con 0x55609b717560 2024-06-13T11:22:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.586+0000 7fcd973d6b80 1 -- 172.21.15.2:0/155048042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd80028c30 con 0x55609b717560 2024-06-13T11:22:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.586+0000 7fcd6be00700 1 -- 172.21.15.2:0/155048042 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fcd80004ce0 con 0x55609b717560 2024-06-13T11:22:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.586+0000 7fcd6be00700 1 -- 172.21.15.2:0/155048042 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcd80003a00 con 0x55609b717560 2024-06-13T11:22:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.586+0000 7fcd973d6b80 10 client.14880 fetch_fsmap learned FSMap version 26 2024-06-13T11:22:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.586+0000 7fcd973d6b80 1 -- 172.21.15.2:0/155048042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55609b739390 con 0x55609b717560 2024-06-13T11:22:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.586+0000 7fcd6be00700 1 -- 172.21.15.2:0/155048042 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd80028c30 con 0x55609b717560 2024-06-13T11:22:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.586+0000 7fcd6be00700 1 -- 172.21.15.2:0/155048042 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fcd80005040 con 0x55609b717560 2024-06-13T11:22:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.587+0000 7fcd973d6b80 10 client.14880 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T11:22:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.587+0000 7fcd973d6b80 10 client.14880 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-13T11:22:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.587+0000 7fcd973d6b80 20 client.14880 populate_metadata read hostname 'smithi002' 2024-06-13T11:22:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.587+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/155048042 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55609b7222b0 0x55609b7a0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.587+0000 7fcd973d6b80 4 client.14880 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T11:22:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.587+0000 7fcd973d6b80 1 -- 172.21.15.2:0/155048042 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "status"}) -- 0x55609b671530 con 0x55609b7222b0 2024-06-13T11:22:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.587+0000 7fcd85e00700 1 --2- 172.21.15.2:0/155048042 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55609b7222b0 0x55609b7a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.587+0000 7fcd85e00700 1 --2- 172.21.15.2:0/155048042 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55609b7222b0 0x55609b7a0840 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5c9d5cc94bf95458 server_cookie=a4eef90d76889cc6 in_seq=0 out_seq=0 2024-06-13T11:22:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.587+0000 7fcd6be00700 10 client.14880 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:22:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.588+0000 7fcd6be00700 1 -- 172.21.15.2:0/155048042 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55609b671530 con 0x55609b7222b0 2024-06-13T11:22:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.588+0000 7fcd6be00700 10 client.14880 handle_command_reply: tid=0 2024-06-13T11:22:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.588+0000 7fcd973d6b80 1 client.14880 shutdown 2024-06-13T11:22:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.588+0000 7fcd973d6b80 1 -- 172.21.15.2:0/155048042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b717560 msgr2=0x55609b71bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.588+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/155048042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b717560 0x55609b71bcc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000b010 tx=0x7fcd80028ba0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.588+0000 7fcd973d6b80 1 -- 172.21.15.2:0/155048042 shutdown_connections 2024-06-13T11:22:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.588+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/155048042 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55609b7222b0 0x55609b7a0840 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.588+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/155048042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55609b717560 0x55609b71bcc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.588+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/155048042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55609b644120 0x55609b73ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.588+0000 7fcd973d6b80 1 --2- 172.21.15.2:0/155048042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55609b693df0 0x55609b71b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.588+0000 7fcd6be00700 0 client.14880 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:22:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.588+0000 7fcd973d6b80 1 -- 172.21.15.2:0/155048042 >> 172.21.15.2:0/155048042 conn(0x55609b70f4b0 msgr2=0x55609b711e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.588+0000 7fcd973d6b80 1 -- 172.21.15.2:0/155048042 shutdown_connections 2024-06-13T11:22:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.588+0000 7fcd973d6b80 1 -- 172.21.15.2:0/155048042 wait complete. 2024-06-13T11:22:39.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.588+0000 7fcd973d6b80 20 client.14880 trim_cache size 0 max 16384 2024-06-13T11:22:39.591 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:22:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "3611563c-2975-11ef-bc9c-c7b262605968", 2024-06-13T11:22:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2024-06-13T11:22:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24509, 2024-06-13T11:22:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-06-13T11:22:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-06-13T11:22:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-06-13T11:22:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 153.215322931, 2024-06-13T11:22:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 26, 2024-06-13T11:22:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 99, 2024-06-13T11:22:39.591 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 97, 2024-06-13T11:22:39.592 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 253.43316231200001 2024-06-13T11:22:39.592 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:22:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.589+0000 7fcd8ca00700 1 -- 172.21.15.2:0/618121079 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fcd6c0a2c20 msgr2=0x7fcd6c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.589+0000 7fcd8ca00700 1 --2- 172.21.15.2:0/618121079 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fcd6c0a2c20 0x7fcd6c0a50e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009da0 tx=0x7fcd80009920 comp rx=0 tx=0).stop 2024-06-13T11:22:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.589+0000 7fcd8ca00700 1 -- 172.21.15.2:0/618121079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88109480 msgr2=0x7fcd8819f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.589+0000 7fcd8ca00700 1 --2- 172.21.15.2:0/618121079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88109480 0x7fcd8819f7d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcd70000c00 tx=0x7fcd7000bab0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.589+0000 7fcd8ca00700 1 -- 172.21.15.2:0/618121079 shutdown_connections 2024-06-13T11:22:39.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.589+0000 7fcd8ca00700 1 --2- 172.21.15.2:0/618121079 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fcd6c0a2c20 0x7fcd6c0a50e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.589+0000 7fcd8ca00700 1 --2- 172.21.15.2:0/618121079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd88108ac0 0x7fcd8819f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.589+0000 7fcd8ca00700 1 --2- 172.21.15.2:0/618121079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd8810eac0 0x7fcd881a3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.589+0000 7fcd8ca00700 1 --2- 172.21.15.2:0/618121079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd88109480 0x7fcd8819f7d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:39.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.589+0000 7fcd8ca00700 1 -- 172.21.15.2:0/618121079 >> 172.21.15.2:0/618121079 conn(0x7fcd88075c60 msgr2=0x7fcd880761e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:39.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.589+0000 7fcd8ca00700 1 -- 172.21.15.2:0/618121079 shutdown_connections 2024-06-13T11:22:39.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:39.590+0000 7fcd8ca00700 1 -- 172.21.15.2:0/618121079 wait complete. 2024-06-13T11:22:40.537 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.i status 2024-06-13T11:22:41.009 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:22:41.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:40 smithi077 ceph-mon[36410]: pgmap v456: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:41.340 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:40 smithi002 ceph-mon[32210]: pgmap v456: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:41.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:40 smithi178 ceph-mon[36913]: pgmap v456: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:43.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:42 smithi002 ceph-mon[32210]: pgmap v457: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:22:43.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:42 smithi077 ceph-mon[36410]: pgmap v457: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:22:43.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.378+0000 7fdf1b200700 1 -- 172.21.15.2:0/3260184898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf1410c970 msgr2=0x7fdf1410ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.378+0000 7fdf1b200700 1 --2- 172.21.15.2:0/3260184898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf1410c970 0x7fdf1410ee10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000b0a0 tx=0x7fdf1000b3b0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.378+0000 7fdf1b200700 1 -- 172.21.15.2:0/3260184898 shutdown_connections 2024-06-13T11:22:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.378+0000 7fdf1b200700 1 --2- 172.21.15.2:0/3260184898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf14103590 0x7fdf14103970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.378+0000 7fdf1b200700 1 --2- 172.21.15.2:0/3260184898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf1410c970 0x7fdf1410ee10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.378+0000 7fdf1b200700 1 --2- 172.21.15.2:0/3260184898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf14103eb0 0x7fdf1410c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.378+0000 7fdf1b200700 1 -- 172.21.15.2:0/3260184898 >> 172.21.15.2:0/3260184898 conn(0x7fdf140fcd80 msgr2=0x7fdf140ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.378+0000 7fdf1b200700 1 -- 172.21.15.2:0/3260184898 shutdown_connections 2024-06-13T11:22:43.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.378+0000 7fdf1b200700 1 -- 172.21.15.2:0/3260184898 wait complete. 2024-06-13T11:22:43.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.379+0000 7fdf1b200700 1 Processor -- start 2024-06-13T11:22:43.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.379+0000 7fdf1b200700 1 -- start start 2024-06-13T11:22:43.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.380+0000 7fdf1b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf14103590 0x7fdf141a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.380+0000 7fdf1b200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf14103eb0 0x7fdf141a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.380+0000 7fdf1b200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf1410c970 0x7fdf1419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.380+0000 7fdf1b200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdf141126a0 con 0x7fdf1410c970 2024-06-13T11:22:43.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.380+0000 7fdf1b200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf14112520 con 0x7fdf14103eb0 2024-06-13T11:22:43.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.380+0000 7fdf1b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdf14112820 con 0x7fdf14103590 2024-06-13T11:22:43.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.380+0000 7fdf19e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf14103590 0x7fdf141a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.380+0000 7fdf19e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf14103590 0x7fdf141a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55110/0 (socket says 172.21.15.2:55110) 2024-06-13T11:22:43.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.380+0000 7fdf19e00700 1 -- 172.21.15.2:0/2151468470 learned_addr learned my addr 172.21.15.2:0/2151468470 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:43.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.380+0000 7fdf19400700 1 --2- 172.21.15.2:0/2151468470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf14103eb0 0x7fdf141a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.380+0000 7fdf1a800700 1 --2- 172.21.15.2:0/2151468470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf1410c970 0x7fdf1419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.381+0000 7fdf19e00700 1 -- 172.21.15.2:0/2151468470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf14103eb0 msgr2=0x7fdf141a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:43.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.381+0000 7fdf19e00700 1 --2- 172.21.15.2:0/2151468470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf14103eb0 0x7fdf141a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.381+0000 7fdf19e00700 1 -- 172.21.15.2:0/2151468470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf1410c970 msgr2=0x7fdf1419aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:43.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.381+0000 7fdf19e00700 1 --2- 172.21.15.2:0/2151468470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf1410c970 0x7fdf1419aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.381+0000 7fdf19e00700 1 -- 172.21.15.2:0/2151468470 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1419b200 con 0x7fdf14103590 2024-06-13T11:22:43.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.381+0000 7fdf19e00700 1 --2- 172.21.15.2:0/2151468470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf14103590 0x7fdf141a08e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800d950 tx=0x7fdf0800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:43.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.381+0000 7fdf0ea00700 1 -- 172.21.15.2:0/2151468470 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf08016070 con 0x7fdf14103590 2024-06-13T11:22:43.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.381+0000 7fdf0ea00700 1 -- 172.21.15.2:0/2151468470 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf0800fd70 con 0x7fdf14103590 2024-06-13T11:22:43.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.381+0000 7fdf0ea00700 1 -- 172.21.15.2:0/2151468470 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0800e610 con 0x7fdf14103590 2024-06-13T11:22:43.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.381+0000 7fdf1b200700 1 -- 172.21.15.2:0/2151468470 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf1419b4f0 con 0x7fdf14103590 2024-06-13T11:22:43.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.382+0000 7fdf1b200700 1 -- 172.21.15.2:0/2151468470 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf141a77b0 con 0x7fdf14103590 2024-06-13T11:22:43.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.386+0000 7fdf0ea00700 1 -- 172.21.15.2:0/2151468470 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fdf08019070 con 0x7fdf14103590 2024-06-13T11:22:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.388+0000 7fdf270c4b80 1 Processor -- start 2024-06-13T11:22:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.388+0000 7fdf0ea00700 1 --2- 172.21.15.2:0/2151468470 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdefc0a2ca0 0x7fdefc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.388+0000 7fdf270c4b80 1 -- start start 2024-06-13T11:22:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.388+0000 7fdf0ea00700 1 -- 172.21.15.2:0/2151468470 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fdf080cee60 con 0x7fdf14103590 2024-06-13T11:22:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.388+0000 7fdf1a800700 1 --2- 172.21.15.2:0/2151468470 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdefc0a2ca0 0x7fdefc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.388+0000 7fdf270c4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83b96d10 0x562d83b970f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.388+0000 7fdf270c4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b97630 0x562d83ba1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.388+0000 7fdf270c4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83ba24e0 0x562d83ba48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.388+0000 7fdf270c4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562d83aa69c0 con 0x562d83b97630 2024-06-13T11:22:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.388+0000 7fdf270c4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562d83ae9ab0 con 0x562d83ba24e0 2024-06-13T11:22:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.388+0000 7fdf270c4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562d83aa48a0 con 0x562d83b96d10 2024-06-13T11:22:43.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.389+0000 7fdf19400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b97630 0x562d83ba1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.389+0000 7fdf19400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b97630 0x562d83ba1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38350/0 (socket says 172.21.15.2:38350) 2024-06-13T11:22:43.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.389+0000 7fdf19e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83b96d10 0x562d83b970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.389+0000 7fdf19400700 1 -- 172.21.15.2:0/551333417 learned_addr learned my addr 172.21.15.2:0/551333417 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.389+0000 7fdf1a800700 1 --2- 172.21.15.2:0/551333417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83ba24e0 0x562d83ba48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.389+0000 7fdf19400700 1 -- 172.21.15.2:0/551333417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83b96d10 msgr2=0x562d83b970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.389+0000 7fdf19400700 1 --2- 172.21.15.2:0/551333417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83b96d10 0x562d83b970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.389+0000 7fdf19400700 1 -- 172.21.15.2:0/551333417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83ba24e0 msgr2=0x562d83ba48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.389+0000 7fdf19400700 1 --2- 172.21.15.2:0/551333417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83ba24e0 0x562d83ba48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.390+0000 7fdf19400700 1 -- 172.21.15.2:0/551333417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d83a91f40 con 0x562d83b97630 2024-06-13T11:22:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.390+0000 7fdf1a800700 1 --2- 172.21.15.2:0/551333417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83ba24e0 0x562d83ba48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:22:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.390+0000 7fdf1a800700 1 --2- 172.21.15.2:0/2151468470 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdefc0a2ca0 0x7fdefc0a5160 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009610 tx=0x7fdf10009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.390+0000 7fdf19400700 1 --2- 172.21.15.2:0/551333417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b97630 0x562d83ba1fa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009cb0 tx=0x7fdf04011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb36bdb9011e476 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.390+0000 7fdf03400700 1 -- 172.21.15.2:0/551333417 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04011d20 con 0x562d83b97630 2024-06-13T11:22:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.390+0000 7fdf03400700 1 -- 172.21.15.2:0/551333417 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf04004530 con 0x562d83b97630 2024-06-13T11:22:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.390+0000 7fdf03400700 1 -- 172.21.15.2:0/551333417 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04019640 con 0x562d83b97630 2024-06-13T11:22:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.391+0000 7fdf270c4b80 1 -- 172.21.15.2:0/551333417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b97630 msgr2=0x562d83ba1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.391+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/551333417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b97630 0x562d83ba1fa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009cb0 tx=0x7fdf04011440 comp rx=0 tx=0).stop 2024-06-13T11:22:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.391+0000 7fdf270c4b80 1 -- 172.21.15.2:0/551333417 shutdown_connections 2024-06-13T11:22:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.391+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/551333417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83ba24e0 0x562d83ba48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.391+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/551333417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83b96d10 0x562d83b970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.391+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/551333417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b97630 0x562d83ba1fa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.391+0000 7fdf270c4b80 1 -- 172.21.15.2:0/551333417 >> 172.21.15.2:0/551333417 conn(0x562d83ac4120 msgr2=0x562d83b93230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.391+0000 7fdf270c4b80 1 -- 172.21.15.2:0/551333417 shutdown_connections 2024-06-13T11:22:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.391+0000 7fdf270c4b80 1 -- 172.21.15.2:0/551333417 wait complete. 2024-06-13T11:22:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.392+0000 7fdf270c4b80 1 -- start start 2024-06-13T11:22:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.392+0000 7fdf270c4b80 1 Processor -- start 2024-06-13T11:22:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf270c4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b96d10 0x562d83ba1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf270c4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83b97630 0x562d83b9ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf270c4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83ba24e0 0x562d83b9f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf270c4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562d83a85f10 con 0x562d83b96d10 2024-06-13T11:22:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf270c4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562d83ae5a70 con 0x562d83b97630 2024-06-13T11:22:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf270c4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562d83ba4f70 con 0x562d83ba24e0 2024-06-13T11:22:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf270c4b80 10 client.0 _ll_register_callbacks cb 0x562d83a7f330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:22:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf19e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b96d10 0x562d83ba1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf19400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83b97630 0x562d83b9ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf19400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83b97630 0x562d83b9ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:42274/0 (socket says 172.21.15.2:42274) 2024-06-13T11:22:43.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf19400700 1 -- 172.21.15.2:0/3458949978 learned_addr learned my addr 172.21.15.2:0/3458949978 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:43.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf1a800700 1 --2- 172.21.15.2:0/3458949978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83ba24e0 0x562d83b9f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf19400700 1 -- 172.21.15.2:0/3458949978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83ba24e0 msgr2=0x562d83b9f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:43.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf19400700 1 --2- 172.21.15.2:0/3458949978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83ba24e0 0x562d83b9f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf19400700 1 -- 172.21.15.2:0/3458949978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b96d10 msgr2=0x562d83ba1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:43.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf19400700 1 --2- 172.21.15.2:0/3458949978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b96d10 0x562d83ba1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.393+0000 7fdf19400700 1 -- 172.21.15.2:0/3458949978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d83a38880 con 0x562d83b97630 2024-06-13T11:22:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.394+0000 7fdf19400700 1 --2- 172.21.15.2:0/3458949978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83b97630 0x562d83b9ef60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdf04000c00 tx=0x7fdf04003f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c88ec5ac886fc793 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.394+0000 7fdef7e00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:22:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.394+0000 7fdef7e00700 1 -- 172.21.15.2:0/3458949978 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04004360 con 0x562d83b97630 2024-06-13T11:22:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.394+0000 7fdf270c4b80 1 -- 172.21.15.2:0/3458949978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf04004530 con 0x562d83b97630 2024-06-13T11:22:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.394+0000 7fdef7e00700 1 -- 172.21.15.2:0/3458949978 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fdf04003680 con 0x562d83b97630 2024-06-13T11:22:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.394+0000 7fdef7e00700 1 -- 172.21.15.2:0/3458949978 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdf04031050 con 0x562d83b97630 2024-06-13T11:22:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.394+0000 7fdf270c4b80 10 client.24983 fetch_fsmap learned FSMap version 26 2024-06-13T11:22:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.394+0000 7fdf270c4b80 1 -- 172.21.15.2:0/3458949978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562d83baf660 con 0x562d83b97630 2024-06-13T11:22:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.395+0000 7fdef7e00700 1 -- 172.21.15.2:0/3458949978 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf04004530 con 0x562d83b97630 2024-06-13T11:22:43.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.395+0000 7fdef7e00700 1 -- 172.21.15.2:0/3458949978 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fdf0402c030 con 0x562d83b97630 2024-06-13T11:22:43.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.395+0000 7fdf270c4b80 10 client.24983 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T11:22:43.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.395+0000 7fdf270c4b80 10 client.24983 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-13T11:22:43.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.395+0000 7fdf270c4b80 20 client.24983 populate_metadata read hostname 'smithi002' 2024-06-13T11:22:43.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.395+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/3458949978 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562d83bb1ae0 0x562d83bb2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.395+0000 7fdf270c4b80 4 client.24983 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:22:43.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.395+0000 7fdf270c4b80 1 -- 172.21.15.2:0/3458949978 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d83af6fb0 con 0x562d83bb1ae0 2024-06-13T11:22:43.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.396+0000 7fdf19e00700 1 --2- 172.21.15.2:0/3458949978 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562d83bb1ae0 0x562d83bb2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.396+0000 7fdf19e00700 1 --2- 172.21.15.2:0/3458949978 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562d83bb1ae0 0x562d83bb2f50 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ebcb503f32fcd86 server_cookie=6656a9ca6df16541 in_seq=0 out_seq=0 2024-06-13T11:22:43.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.396+0000 7fdef7e00700 10 client.24983 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:22:43.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.397+0000 7fdef7e00700 1 -- 172.21.15.2:0/3458949978 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562d83af6fb0 con 0x562d83bb1ae0 2024-06-13T11:22:43.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.397+0000 7fdef7e00700 10 client.24983 handle_command_reply: tid=0 2024-06-13T11:22:43.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.397+0000 7fdf270c4b80 1 client.24983 shutdown 2024-06-13T11:22:43.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.397+0000 7fdf270c4b80 1 -- 172.21.15.2:0/3458949978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83b97630 msgr2=0x562d83b9ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:43.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.397+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/3458949978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83b97630 0x562d83b9ef60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdf04000c00 tx=0x7fdf04003f50 comp rx=0 tx=0).stop 2024-06-13T11:22:43.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.398+0000 7fdf270c4b80 1 -- 172.21.15.2:0/3458949978 shutdown_connections 2024-06-13T11:22:43.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.398+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/3458949978 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562d83bb1ae0 0x562d83bb2f50 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.398+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/3458949978 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b96d10 0x562d83ba1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.398+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/3458949978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83ba24e0 0x562d83b9f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.398+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/3458949978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83b97630 0x562d83b9ef60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.398+0000 7fdf270c4b80 1 -- 172.21.15.2:0/3458949978 >> 172.21.15.2:0/3458949978 conn(0x562d83ac4120 msgr2=0x562d83b92e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:43.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.398+0000 7fdef7e00700 0 client.24983 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:22:43.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.398+0000 7fdf270c4b80 1 -- 172.21.15.2:0/3458949978 shutdown_connections 2024-06-13T11:22:43.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.398+0000 7fdf270c4b80 1 -- 172.21.15.2:0/3458949978 wait complete. 2024-06-13T11:22:43.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.398+0000 7fdf270c4b80 20 client.24983 trim_cache size 0 max 16384 2024-06-13T11:22:43.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.421+0000 7fdf270c4b80 1 Processor -- start 2024-06-13T11:22:43.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.422+0000 7fdf270c4b80 1 -- start start 2024-06-13T11:22:43.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.422+0000 7fdf270c4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b96d10 0x562d83b9f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.422+0000 7fdf270c4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83b97630 0x562d83bad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.422+0000 7fdf270c4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83ba24e0 0x562d83bade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.422+0000 7fdf270c4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562d83bb1290 con 0x562d83b96d10 2024-06-13T11:22:43.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.422+0000 7fdf270c4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562d83bb1960 con 0x562d83b97630 2024-06-13T11:22:43.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.422+0000 7fdf270c4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562d83bb2030 con 0x562d83ba24e0 2024-06-13T11:22:43.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.422+0000 7fdf1a800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83ba24e0 0x562d83bade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.423+0000 7fdf1a800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83ba24e0 0x562d83bade10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55128/0 (socket says 172.21.15.2:55128) 2024-06-13T11:22:43.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.423+0000 7fdf1a800700 1 -- 172.21.15.2:0/169611235 learned_addr learned my addr 172.21.15.2:0/169611235 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:43.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.423+0000 7fdf19400700 1 --2- 172.21.15.2:0/169611235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83b97630 0x562d83bad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.423+0000 7fdf19400700 1 -- 172.21.15.2:0/169611235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83ba24e0 msgr2=0x562d83bade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:43.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.423+0000 7fdf19400700 1 --2- 172.21.15.2:0/169611235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83ba24e0 0x562d83bade10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.423+0000 7fdf19e00700 1 --2- 172.21.15.2:0/169611235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b96d10 0x562d83b9f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.423+0000 7fdf19400700 1 -- 172.21.15.2:0/169611235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b96d10 msgr2=0x562d83b9f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:43.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.423+0000 7fdf19400700 1 --2- 172.21.15.2:0/169611235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b96d10 0x562d83b9f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.423+0000 7fdf19400700 1 -- 172.21.15.2:0/169611235 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d83b9d510 con 0x562d83b97630 2024-06-13T11:22:43.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.423+0000 7fdf19400700 1 --2- 172.21.15.2:0/169611235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83b97630 0x562d83bad8d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdf04004d90 tx=0x7fdf04011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bf692658232093d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:43.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.423+0000 7fdf02a00700 1 -- 172.21.15.2:0/169611235 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0401a440 con 0x562d83b97630 2024-06-13T11:22:43.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.424+0000 7fdf02a00700 1 -- 172.21.15.2:0/169611235 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf04003b60 con 0x562d83b97630 2024-06-13T11:22:43.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.424+0000 7fdf02a00700 1 -- 172.21.15.2:0/169611235 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0401a6f0 con 0x562d83b97630 2024-06-13T11:22:43.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.424+0000 7fdf270c4b80 1 -- 172.21.15.2:0/169611235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83b97630 msgr2=0x562d83bad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.424+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/169611235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83b97630 0x562d83bad8d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdf04004d90 tx=0x7fdf04011440 comp rx=0 tx=0).stop 2024-06-13T11:22:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.424+0000 7fdf270c4b80 1 -- 172.21.15.2:0/169611235 shutdown_connections 2024-06-13T11:22:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.424+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/169611235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b96d10 0x562d83b9f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.424+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/169611235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83ba24e0 0x562d83bade10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.424+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/169611235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83b97630 0x562d83bad8d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.424+0000 7fdf270c4b80 1 -- 172.21.15.2:0/169611235 >> 172.21.15.2:0/169611235 conn(0x562d83ac4120 msgr2=0x562d83bad1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.424+0000 7fdf270c4b80 1 -- 172.21.15.2:0/169611235 shutdown_connections 2024-06-13T11:22:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.424+0000 7fdf270c4b80 1 -- 172.21.15.2:0/169611235 wait complete. 2024-06-13T11:22:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.425+0000 7fdf270c4b80 1 -- start start 2024-06-13T11:22:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.425+0000 7fdf270c4b80 1 Processor -- start 2024-06-13T11:22:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.426+0000 7fdf270c4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83b96d10 0x562d83bb8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.426+0000 7fdf270c4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b97630 0x562d83bb8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.426+0000 7fdf270c4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83ba24e0 0x562d83bb8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.426+0000 7fdf270c4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562d83bb2dd0 con 0x562d83b97630 2024-06-13T11:22:43.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.426+0000 7fdf270c4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562d83bb2700 con 0x562d83ba24e0 2024-06-13T11:22:43.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.426+0000 7fdf270c4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562d83bb34a0 con 0x562d83b96d10 2024-06-13T11:22:43.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.426+0000 7fdf270c4b80 10 client.0 _ll_register_callbacks cb 0x562d83a7f330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:22:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.426+0000 7fdf19e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83b96d10 0x562d83bb8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.426+0000 7fdf1a800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83ba24e0 0x562d83bb8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.426+0000 7fdf19e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83b96d10 0x562d83bb8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55138/0 (socket says 172.21.15.2:55138) 2024-06-13T11:22:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.426+0000 7fdf19e00700 1 -- 172.21.15.2:0/2531973729 learned_addr learned my addr 172.21.15.2:0/2531973729 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.426+0000 7fdf19400700 1 --2- 172.21.15.2:0/2531973729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b97630 0x562d83bb8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.426+0000 7fdf19e00700 1 -- 172.21.15.2:0/2531973729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83ba24e0 msgr2=0x562d83bb8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.426+0000 7fdf19e00700 1 --2- 172.21.15.2:0/2531973729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83ba24e0 0x562d83bb8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.426+0000 7fdf19e00700 1 -- 172.21.15.2:0/2531973729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b97630 msgr2=0x562d83bb8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:22:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.426+0000 7fdf19e00700 1 --2- 172.21.15.2:0/2531973729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b97630 0x562d83bb8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.427+0000 7fdf19e00700 1 -- 172.21.15.2:0/2531973729 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d83c24d90 con 0x562d83b96d10 2024-06-13T11:22:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.427+0000 7fdf1a800700 1 --2- 172.21.15.2:0/2531973729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83ba24e0 0x562d83bb8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:22:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.427+0000 7fdf19e00700 1 --2- 172.21.15.2:0/2531973729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83b96d10 0x562d83bb8310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdf08010ac0 tx=0x7fdf080bb040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42113490e6e06da2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.427+0000 7fdef7e00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:22:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.427+0000 7fdef7e00700 1 -- 172.21.15.2:0/2531973729 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf08020040 con 0x562d83b96d10 2024-06-13T11:22:43.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.427+0000 7fdef7e00700 1 -- 172.21.15.2:0/2531973729 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fdf080cc680 con 0x562d83b96d10 2024-06-13T11:22:43.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.427+0000 7fdf270c4b80 1 -- 172.21.15.2:0/2531973729 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562d83af1530 con 0x562d83b96d10 2024-06-13T11:22:43.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.427+0000 7fdef7e00700 1 -- 172.21.15.2:0/2531973729 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdf080b42b0 con 0x562d83b96d10 2024-06-13T11:22:43.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.427+0000 7fdf270c4b80 10 client.25015 fetch_fsmap learned FSMap version 26 2024-06-13T11:22:43.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.427+0000 7fdf270c4b80 1 -- 172.21.15.2:0/2531973729 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562d83c26050 con 0x562d83b96d10 2024-06-13T11:22:43.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.428+0000 7fdef7e00700 1 -- 172.21.15.2:0/2531973729 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562d83af1530 con 0x562d83b96d10 2024-06-13T11:22:43.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.428+0000 7fdef7e00700 1 -- 172.21.15.2:0/2531973729 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fdf080a3ab0 con 0x562d83b96d10 2024-06-13T11:22:43.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.428+0000 7fdf270c4b80 10 client.25015 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T11:22:43.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.428+0000 7fdf270c4b80 10 client.25015 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-13T11:22:43.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.428+0000 7fdf270c4b80 20 client.25015 populate_metadata read hostname 'smithi002' 2024-06-13T11:22:43.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.428+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/2531973729 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562d83c2abf0 0x562d83c29900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:43.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.428+0000 7fdf270c4b80 4 client.25015 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T11:22:43.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.428+0000 7fdf270c4b80 1 -- 172.21.15.2:0/2531973729 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "status"}) -- 0x562d8396b200 con 0x562d83c2abf0 2024-06-13T11:22:43.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.428+0000 7fdf19400700 1 --2- 172.21.15.2:0/2531973729 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562d83c2abf0 0x562d83c29900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:43.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.429+0000 7fdf19400700 1 --2- 172.21.15.2:0/2531973729 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562d83c2abf0 0x562d83c29900 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bae384b1f2ae3e58 server_cookie=86a84377072e8d4 in_seq=0 out_seq=0 2024-06-13T11:22:43.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.429+0000 7fdef7e00700 10 client.25015 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:22:43.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.429+0000 7fdef7e00700 1 -- 172.21.15.2:0/2531973729 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562d8396b200 con 0x562d83c2abf0 2024-06-13T11:22:43.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.429+0000 7fdef7e00700 10 client.25015 handle_command_reply: tid=0 2024-06-13T11:22:43.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.429+0000 7fdf270c4b80 1 client.25015 shutdown 2024-06-13T11:22:43.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.429+0000 7fdf270c4b80 1 -- 172.21.15.2:0/2531973729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83b96d10 msgr2=0x562d83bb8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:43.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.429+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/2531973729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83b96d10 0x562d83bb8310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdf08010ac0 tx=0x7fdf080bb040 comp rx=0 tx=0).stop 2024-06-13T11:22:43.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.429+0000 7fdf270c4b80 1 -- 172.21.15.2:0/2531973729 shutdown_connections 2024-06-13T11:22:43.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.429+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/2531973729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562d83ba24e0 0x562d83bb8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.429+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/2531973729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562d83b96d10 0x562d83bb8310 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.429+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/2531973729 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562d83c2abf0 0x562d83c29900 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.429+0000 7fdf270c4b80 1 --2- 172.21.15.2:0/2531973729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562d83b97630 0x562d83bb8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.429+0000 7fdef7e00700 0 client.25015 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:22:43.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.429+0000 7fdf270c4b80 1 -- 172.21.15.2:0/2531973729 >> 172.21.15.2:0/2531973729 conn(0x562d83ac4120 msgr2=0x562d83bada50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:43.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.430+0000 7fdf270c4b80 1 -- 172.21.15.2:0/2531973729 shutdown_connections 2024-06-13T11:22:43.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.430+0000 7fdf270c4b80 1 -- 172.21.15.2:0/2531973729 wait complete. 2024-06-13T11:22:43.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.430+0000 7fdf270c4b80 20 client.25015 trim_cache size 0 max 16384 2024-06-13T11:22:43.432 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:22:43.432 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "3611563c-2975-11ef-bc9c-c7b262605968", 2024-06-13T11:22:43.432 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-06-13T11:22:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24511, 2024-06-13T11:22:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-06-13T11:22:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-06-13T11:22:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-06-13T11:22:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 236.533470338, 2024-06-13T11:22:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 26, 2024-06-13T11:22:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 99, 2024-06-13T11:22:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 97, 2024-06-13T11:22:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 272.14091599099999 2024-06-13T11:22:43.433 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:22:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.430+0000 7fdf1b200700 1 -- 172.21.15.2:0/2151468470 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdefc0a2ca0 msgr2=0x7fdefc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.430+0000 7fdf1b200700 1 --2- 172.21.15.2:0/2151468470 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdefc0a2ca0 0x7fdefc0a5160 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009610 tx=0x7fdf10009360 comp rx=0 tx=0).stop 2024-06-13T11:22:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.430+0000 7fdf1b200700 1 -- 172.21.15.2:0/2151468470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf14103590 msgr2=0x7fdf141a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.430+0000 7fdf1b200700 1 --2- 172.21.15.2:0/2151468470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf14103590 0x7fdf141a08e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800d950 tx=0x7fdf0800dc60 comp rx=0 tx=0).stop 2024-06-13T11:22:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.430+0000 7fdf1b200700 1 -- 172.21.15.2:0/2151468470 shutdown_connections 2024-06-13T11:22:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.430+0000 7fdf1b200700 1 --2- 172.21.15.2:0/2151468470 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdefc0a2ca0 0x7fdefc0a5160 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.431+0000 7fdf1b200700 1 --2- 172.21.15.2:0/2151468470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf1410c970 0x7fdf1419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.431+0000 7fdf1b200700 1 --2- 172.21.15.2:0/2151468470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf14103590 0x7fdf141a08e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.431+0000 7fdf1b200700 1 --2- 172.21.15.2:0/2151468470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf14103eb0 0x7fdf141a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.431+0000 7fdf1b200700 1 -- 172.21.15.2:0/2151468470 >> 172.21.15.2:0/2151468470 conn(0x7fdf140fcd80 msgr2=0x7fdf140ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.431+0000 7fdf1b200700 1 -- 172.21.15.2:0/2151468470 shutdown_connections 2024-06-13T11:22:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:43.431+0000 7fdf1b200700 1 -- 172.21.15.2:0/2151468470 wait complete. 2024-06-13T11:22:43.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:42 smithi178 ceph-mon[36913]: pgmap v457: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:22:44.427 INFO:tasks.cephadm:Setup complete, yielding 2024-06-13T11:22:44.427 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-13T11:22:44.440 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T11:22:44.440 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- bash -c 'ceph orch status' 2024-06-13T11:22:44.910 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:22:45.236 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:44 smithi002 ceph-mon[32210]: pgmap v458: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:22:45.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:44 smithi077 ceph-mon[36410]: pgmap v458: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:22:45.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:44 smithi178 ceph-mon[36913]: pgmap v458: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:22:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.246+0000 7fb799400700 1 -- 172.21.15.2:0/2254007606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb794103710 msgr2=0x7fb794103b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.246+0000 7fb799400700 1 --2- 172.21.15.2:0/2254007606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb794103710 0x7fb794103b70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0099c0 tx=0x7fb77c009cd0 comp rx=0 tx=0).stop 2024-06-13T11:22:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.246+0000 7fb799400700 1 -- 172.21.15.2:0/2254007606 shutdown_connections 2024-06-13T11:22:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.246+0000 7fb799400700 1 --2- 172.21.15.2:0/2254007606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7941040b0 0x7fb79410a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.246+0000 7fb799400700 1 --2- 172.21.15.2:0/2254007606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb794102510 0x7fb794102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.246+0000 7fb799400700 1 --2- 172.21.15.2:0/2254007606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb794103710 0x7fb794103b70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.246+0000 7fb799400700 1 -- 172.21.15.2:0/2254007606 >> 172.21.15.2:0/2254007606 conn(0x7fb7940fdab0 msgr2=0x7fb7940ffef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.246+0000 7fb799400700 1 -- 172.21.15.2:0/2254007606 shutdown_connections 2024-06-13T11:22:47.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.246+0000 7fb799400700 1 -- 172.21.15.2:0/2254007606 wait complete. 2024-06-13T11:22:47.247 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:46 smithi002 ceph-mon[32210]: pgmap v459: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.248+0000 7fb799400700 1 Processor -- start 2024-06-13T11:22:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.248+0000 7fb799400700 1 -- start start 2024-06-13T11:22:47.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.248+0000 7fb799400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb794102510 0x7fb79419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.248+0000 7fb799400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb794103710 0x7fb79419ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.248+0000 7fb799400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7941040b0 0x7fb7941a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.248+0000 7fb799400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb79410e120 con 0x7fb794102510 2024-06-13T11:22:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.248+0000 7fb799400700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb79410dfa0 con 0x7fb7941040b0 2024-06-13T11:22:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.248+0000 7fb799400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb79410e2a0 con 0x7fb794103710 2024-06-13T11:22:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.248+0000 7fb792800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb794102510 0x7fb79419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.249+0000 7fb78be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb794103710 0x7fb79419ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.249+0000 7fb792800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb794102510 0x7fb79419a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56572/0 (socket says 172.21.15.2:56572) 2024-06-13T11:22:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.249+0000 7fb792800700 1 -- 172.21.15.2:0/107432092 learned_addr learned my addr 172.21.15.2:0/107432092 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.249+0000 7fb793200700 1 --2- 172.21.15.2:0/107432092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7941040b0 0x7fb7941a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.249+0000 7fb792800700 1 -- 172.21.15.2:0/107432092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb794103710 msgr2=0x7fb79419ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.249+0000 7fb792800700 1 --2- 172.21.15.2:0/107432092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb794103710 0x7fb79419ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.249+0000 7fb792800700 1 -- 172.21.15.2:0/107432092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7941040b0 msgr2=0x7fb7941a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.249+0000 7fb792800700 1 --2- 172.21.15.2:0/107432092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7941040b0 0x7fb7941a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.249+0000 7fb792800700 1 -- 172.21.15.2:0/107432092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7941a25b0 con 0x7fb794102510 2024-06-13T11:22:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.249+0000 7fb78be00700 1 --2- 172.21.15.2:0/107432092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb794103710 0x7fb79419ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:22:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.249+0000 7fb793200700 1 --2- 172.21.15.2:0/107432092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7941040b0 0x7fb7941a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:22:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.250+0000 7fb792800700 1 --2- 172.21.15.2:0/107432092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb794102510 0x7fb79419a950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb78400e9a0 tx=0x7fb78400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:47.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.250+0000 7fb78b400700 1 -- 172.21.15.2:0/107432092 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb784004220 con 0x7fb794102510 2024-06-13T11:22:47.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.250+0000 7fb78b400700 1 -- 172.21.15.2:0/107432092 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7840043c0 con 0x7fb794102510 2024-06-13T11:22:47.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.250+0000 7fb799400700 1 -- 172.21.15.2:0/107432092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7941a28a0 con 0x7fb794102510 2024-06-13T11:22:47.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.250+0000 7fb78b400700 1 -- 172.21.15.2:0/107432092 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb784003da0 con 0x7fb794102510 2024-06-13T11:22:47.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.250+0000 7fb799400700 1 -- 172.21.15.2:0/107432092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7941a2de0 con 0x7fb794102510 2024-06-13T11:22:47.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.251+0000 7fb799400700 1 -- 172.21.15.2:0/107432092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb794069180 con 0x7fb794102510 2024-06-13T11:22:47.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.253+0000 7fb78b400700 1 -- 172.21.15.2:0/107432092 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fb78400c7c0 con 0x7fb794102510 2024-06-13T11:22:47.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.255+0000 7fb78b400700 1 --2- 172.21.15.2:0/107432092 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb7780a2c20 0x7fb7780a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:47.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.255+0000 7fb78b400700 1 -- 172.21.15.2:0/107432092 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fb7840cf600 con 0x7fb794102510 2024-06-13T11:22:47.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.255+0000 7fb78be00700 1 --2- 172.21.15.2:0/107432092 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb7780a2c20 0x7fb7780a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:47.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.256+0000 7fb78be00700 1 --2- 172.21.15.2:0/107432092 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb7780a2c20 0x7fb7780a50e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb77c000c00 tx=0x7fb77c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:47.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.259+0000 7fb78b400700 1 -- 172.21.15.2:0/107432092 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb78409c170 con 0x7fb794102510 2024-06-13T11:22:47.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:46 smithi077 ceph-mon[36410]: pgmap v459: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:47.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:46 smithi178 ceph-mon[36913]: pgmap v459: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.510+0000 7fb799400700 1 -- 172.21.15.2:0/107432092 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fb794075de0 con 0x7fb7780a2c20 2024-06-13T11:22:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.512+0000 7fb78b400700 1 -- 172.21.15.2:0/107432092 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fb794075de0 con 0x7fb7780a2c20 2024-06-13T11:22:47.512 INFO:teuthology.orchestra.run.smithi002.stdout:Backend: cephadm 2024-06-13T11:22:47.512 INFO:teuthology.orchestra.run.smithi002.stdout:Available: Yes 2024-06-13T11:22:47.512 INFO:teuthology.orchestra.run.smithi002.stdout:Paused: No 2024-06-13T11:22:47.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.515+0000 7fb799400700 1 -- 172.21.15.2:0/107432092 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb7780a2c20 msgr2=0x7fb7780a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:47.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.515+0000 7fb799400700 1 --2- 172.21.15.2:0/107432092 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb7780a2c20 0x7fb7780a50e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb77c000c00 tx=0x7fb77c005fb0 comp rx=0 tx=0).stop 2024-06-13T11:22:47.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.515+0000 7fb799400700 1 -- 172.21.15.2:0/107432092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb794102510 msgr2=0x7fb79419a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:47.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.515+0000 7fb799400700 1 --2- 172.21.15.2:0/107432092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb794102510 0x7fb79419a950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb78400e9a0 tx=0x7fb78400ecb0 comp rx=0 tx=0).stop 2024-06-13T11:22:47.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.515+0000 7fb799400700 1 -- 172.21.15.2:0/107432092 shutdown_connections 2024-06-13T11:22:47.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.515+0000 7fb799400700 1 --2- 172.21.15.2:0/107432092 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fb7780a2c20 0x7fb7780a50e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:47.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.515+0000 7fb799400700 1 --2- 172.21.15.2:0/107432092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb794102510 0x7fb79419a950 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:47.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.515+0000 7fb799400700 1 --2- 172.21.15.2:0/107432092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7941040b0 0x7fb7941a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:47.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.515+0000 7fb799400700 1 --2- 172.21.15.2:0/107432092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb794103710 0x7fb79419ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:47.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.515+0000 7fb799400700 1 -- 172.21.15.2:0/107432092 >> 172.21.15.2:0/107432092 conn(0x7fb7940fdab0 msgr2=0x7fb7940746c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:47.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.515+0000 7fb799400700 1 -- 172.21.15.2:0/107432092 shutdown_connections 2024-06-13T11:22:47.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:47.515+0000 7fb799400700 1 -- 172.21.15.2:0/107432092 wait complete. 2024-06-13T11:22:48.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- bash -c 'ceph orch ps' 2024-06-13T11:22:48.897 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:22:49.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:48 smithi002 ceph-mon[32210]: pgmap v460: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:22:49.238 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:48 smithi002 ceph-mon[32210]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:22:49.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:48 smithi077 ceph-mon[36410]: pgmap v460: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:22:49.298 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:48 smithi077 ceph-mon[36410]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:22:49.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:48 smithi178 ceph-mon[36913]: pgmap v460: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:22:49.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:48 smithi178 ceph-mon[36913]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:22:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.225+0000 7ff92cc00700 1 -- 172.21.15.2:0/2160945936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9281058b0 msgr2=0x7ff928107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.225+0000 7ff92cc00700 1 --2- 172.21.15.2:0/2160945936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9281058b0 0x7ff928107ca0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff914009990 tx=0x7ff914009ca0 comp rx=0 tx=0).stop 2024-06-13T11:22:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.225+0000 7ff92cc00700 1 -- 172.21.15.2:0/2160945936 shutdown_connections 2024-06-13T11:22:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.225+0000 7ff92cc00700 1 --2- 172.21.15.2:0/2160945936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9281081e0 0x7ff92810a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.225+0000 7ff92cc00700 1 --2- 172.21.15.2:0/2160945936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff928102f80 0x7ff928105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:51.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.225+0000 7ff92cc00700 1 --2- 172.21.15.2:0/2160945936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9281058b0 0x7ff928107ca0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:51.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.225+0000 7ff92cc00700 1 -- 172.21.15.2:0/2160945936 >> 172.21.15.2:0/2160945936 conn(0x7ff9280fc990 msgr2=0x7ff9280fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:51.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.226+0000 7ff92cc00700 1 -- 172.21.15.2:0/2160945936 shutdown_connections 2024-06-13T11:22:51.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.226+0000 7ff92cc00700 1 -- 172.21.15.2:0/2160945936 wait complete. 2024-06-13T11:22:51.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.227+0000 7ff92cc00700 1 Processor -- start 2024-06-13T11:22:51.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.227+0000 7ff92cc00700 1 -- start start 2024-06-13T11:22:51.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.227+0000 7ff92cc00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff928102f80 0x7ff92819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:51.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.227+0000 7ff92cc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9281058b0 0x7ff92819af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:51.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.227+0000 7ff92cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9281081e0 0x7ff9281a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.227+0000 7ff92cc00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff92810e150 con 0x7ff9281081e0 2024-06-13T11:22:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.227+0000 7ff92cc00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff92810dfd0 con 0x7ff928102f80 2024-06-13T11:22:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.227+0000 7ff92cc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff92810e2d0 con 0x7ff9281058b0 2024-06-13T11:22:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.228+0000 7ff926800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9281081e0 0x7ff9281a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.228+0000 7ff925e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff928102f80 0x7ff92819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.228+0000 7ff926800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9281081e0 0x7ff9281a1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56586/0 (socket says 172.21.15.2:56586) 2024-06-13T11:22:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.228+0000 7ff926800700 1 -- 172.21.15.2:0/1993058960 learned_addr learned my addr 172.21.15.2:0/1993058960 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.228+0000 7ff925400700 1 --2- 172.21.15.2:0/1993058960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9281058b0 0x7ff92819af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.228+0000 7ff926800700 1 -- 172.21.15.2:0/1993058960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9281058b0 msgr2=0x7ff92819af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.228+0000 7ff926800700 1 --2- 172.21.15.2:0/1993058960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9281058b0 0x7ff92819af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.228+0000 7ff926800700 1 -- 172.21.15.2:0/1993058960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff928102f80 msgr2=0x7ff92819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.228+0000 7ff926800700 1 --2- 172.21.15.2:0/1993058960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff928102f80 0x7ff92819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:51.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.228+0000 7ff926800700 1 -- 172.21.15.2:0/1993058960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9281a25f0 con 0x7ff9281081e0 2024-06-13T11:22:51.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.228+0000 7ff925e00700 1 --2- 172.21.15.2:0/1993058960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff928102f80 0x7ff92819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:22:51.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.228+0000 7ff926800700 1 --2- 172.21.15.2:0/1993058960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9281081e0 0x7ff9281a1f50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff92000c140 tx=0x7ff92000c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:51.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.229+0000 7ff91ea00700 1 -- 172.21.15.2:0/1993058960 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9200092e0 con 0x7ff9281081e0 2024-06-13T11:22:51.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.229+0000 7ff91ea00700 1 -- 172.21.15.2:0/1993058960 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff920003a00 con 0x7ff9281081e0 2024-06-13T11:22:51.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.229+0000 7ff92cc00700 1 -- 172.21.15.2:0/1993058960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9281a2880 con 0x7ff9281081e0 2024-06-13T11:22:51.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.229+0000 7ff91ea00700 1 -- 172.21.15.2:0/1993058960 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9200046c0 con 0x7ff9281081e0 2024-06-13T11:22:51.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.229+0000 7ff92cc00700 1 -- 172.21.15.2:0/1993058960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9281a2e10 con 0x7ff9281081e0 2024-06-13T11:22:51.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.230+0000 7ff92cc00700 1 -- 172.21.15.2:0/1993058960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff928069180 con 0x7ff9281081e0 2024-06-13T11:22:51.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.232+0000 7ff91ea00700 1 -- 172.21.15.2:0/1993058960 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ff92001a020 con 0x7ff9281081e0 2024-06-13T11:22:51.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.234+0000 7ff91ea00700 1 --2- 172.21.15.2:0/1993058960 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff90c0a2ca0 0x7ff90c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:51.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.234+0000 7ff91ea00700 1 -- 172.21.15.2:0/1993058960 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7ff9200cebf0 con 0x7ff9281081e0 2024-06-13T11:22:51.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.234+0000 7ff925e00700 1 --2- 172.21.15.2:0/1993058960 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff90c0a2ca0 0x7ff90c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:51.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.235+0000 7ff925e00700 1 --2- 172.21.15.2:0/1993058960 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff90c0a2ca0 0x7ff90c0a5160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff918011490 tx=0x7ff918009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:51.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.239+0000 7ff91ea00700 1 -- 172.21.15.2:0/1993058960 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff920010040 con 0x7ff9281081e0 2024-06-13T11:22:51.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:50 smithi077 ceph-mon[36410]: pgmap v461: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:51.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:50 smithi002 ceph-mon[32210]: pgmap v461: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:51.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:50 smithi178 ceph-mon[36913]: pgmap v461: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:51.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.481+0000 7ff92cc00700 1 -- 172.21.15.2:0/1993058960 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff9280628d0 con 0x7ff90c0a2ca0 2024-06-13T11:22:51.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.522+0000 7ff91ea00700 1 -- 172.21.15.2:0/1993058960 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7ff9280628d0 con 0x7ff90c0a2ca0 2024-06-13T11:22:51.521 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-13T11:22:51.522 INFO:teuthology.orchestra.run.smithi002.stdout:mds.a smithi002 running (4m) 2m ago 4m 12.8M - 19.0.0-2946-g3d89accf b045ac545f82 544f3bb3be50 2024-06-13T11:22:51.522 INFO:teuthology.orchestra.run.smithi002.stdout:mds.b smithi077 running (4m) 2m ago 4m 19.9M - 19.0.0-2946-g3d89accf b045ac545f82 cb01e210b8eb 2024-06-13T11:22:51.522 INFO:teuthology.orchestra.run.smithi002.stdout:mds.c smithi178 running (4m) 2m ago 4m 16.7M - 19.0.0-2946-g3d89accf b045ac545f82 12b3c48dd414 2024-06-13T11:22:51.522 INFO:teuthology.orchestra.run.smithi002.stdout:mds.d smithi002 running (4m) 2m ago 4m 13.0M - 19.0.0-2946-g3d89accf b045ac545f82 e39a0ea6b2a6 2024-06-13T11:22:51.522 INFO:teuthology.orchestra.run.smithi002.stdout:mds.e smithi077 running (4m) 2m ago 4m 20.1M - 19.0.0-2946-g3d89accf b045ac545f82 283d34fc174f 2024-06-13T11:22:51.522 INFO:teuthology.orchestra.run.smithi002.stdout:mds.f smithi178 running (4m) 2m ago 4m 17.7M - 19.0.0-2946-g3d89accf b045ac545f82 12b63918acce 2024-06-13T11:22:51.522 INFO:teuthology.orchestra.run.smithi002.stdout:mds.g smithi002 running (4m) 2m ago 4m 12.8M - 19.0.0-2946-g3d89accf b045ac545f82 2c388cf2f466 2024-06-13T11:22:51.522 INFO:teuthology.orchestra.run.smithi002.stdout:mds.h smithi077 running (4m) 2m ago 4m 17.1M - 19.0.0-2946-g3d89accf b045ac545f82 509e30ce727e 2024-06-13T11:22:51.522 INFO:teuthology.orchestra.run.smithi002.stdout:mds.i smithi178 running (4m) 2m ago 4m 26.1M - 19.0.0-2946-g3d89accf b045ac545f82 e59a8171a075 2024-06-13T11:22:51.522 INFO:teuthology.orchestra.run.smithi002.stdout:mds.j smithi002 running (5m) 2m ago 4m 13.1M - 19.0.0-2946-g3d89accf b045ac545f82 7ae3480c5f00 2024-06-13T11:22:51.522 INFO:teuthology.orchestra.run.smithi002.stdout:mds.k smithi077 running (5m) 2m ago 5m 14.7M - 19.0.0-2946-g3d89accf b045ac545f82 78b12aa278c9 2024-06-13T11:22:51.523 INFO:teuthology.orchestra.run.smithi002.stdout:mds.l smithi178 running (5m) 2m ago 5m 16.1M - 19.0.0-2946-g3d89accf b045ac545f82 6f614becb90e 2024-06-13T11:22:51.523 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.x smithi002 *:9283,8765 running (13m) 2m ago 13m 518M - 19.0.0-2946-g3d89accf b045ac545f82 98d7585ac6f8 2024-06-13T11:22:51.523 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.y smithi077 *:8443,8765 running (11m) 2m ago 11m 457M - 19.0.0-2946-g3d89accf b045ac545f82 21341fdae483 2024-06-13T11:22:51.523 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.z smithi178 *:8443,8765 running (11m) 2m ago 11m 455M - 19.0.0-2946-g3d89accf b045ac545f82 6cbea389b2be 2024-06-13T11:22:51.523 INFO:teuthology.orchestra.run.smithi002.stdout:mon.a smithi002 running (13m) 2m ago 13m 49.7M 2048M 19.0.0-2946-g3d89accf b045ac545f82 1e16928c773b 2024-06-13T11:22:51.523 INFO:teuthology.orchestra.run.smithi002.stdout:mon.b smithi077 running (11m) 2m ago 11m 43.6M 2048M 19.0.0-2946-g3d89accf b045ac545f82 6d9175ddbfb3 2024-06-13T11:22:51.523 INFO:teuthology.orchestra.run.smithi002.stdout:mon.c smithi178 running (11m) 2m ago 11m 46.5M 2048M 19.0.0-2946-g3d89accf b045ac545f82 3394830722fc 2024-06-13T11:22:51.523 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (10m) 2m ago 10m 56.6M 4273M 19.0.0-2946-g3d89accf b045ac545f82 23feef7f718b 2024-06-13T11:22:51.523 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi077 running (10m) 2m ago 10m 57.9M 4272M 19.0.0-2946-g3d89accf b045ac545f82 9e5d0aa1d3db 2024-06-13T11:22:51.523 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi178 running (9m) 2m ago 9m 61.3M 4272M 19.0.0-2946-g3d89accf b045ac545f82 4fe4f0e9845e 2024-06-13T11:22:51.523 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi002 running (9m) 2m ago 9m 43.0M 4273M 19.0.0-2946-g3d89accf b045ac545f82 54dc1f4f2920 2024-06-13T11:22:51.523 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi077 running (8m) 2m ago 8m 53.3M 4272M 19.0.0-2946-g3d89accf b045ac545f82 813c5ffc489b 2024-06-13T11:22:51.523 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi178 running (8m) 2m ago 8m 55.0M 4272M 19.0.0-2946-g3d89accf b045ac545f82 6f51a0e64b54 2024-06-13T11:22:51.523 INFO:teuthology.orchestra.run.smithi002.stdout:osd.6 smithi002 running (7m) 2m ago 7m 53.3M 4273M 19.0.0-2946-g3d89accf b045ac545f82 64f1cb7fcf14 2024-06-13T11:22:51.524 INFO:teuthology.orchestra.run.smithi002.stdout:osd.7 smithi077 running (7m) 2m ago 7m 45.7M 4272M 19.0.0-2946-g3d89accf b045ac545f82 cc2e15d84f98 2024-06-13T11:22:51.524 INFO:teuthology.orchestra.run.smithi002.stdout:osd.8 smithi178 running (6m) 2m ago 6m 43.0M 4272M 19.0.0-2946-g3d89accf b045ac545f82 85d1e0dd06f3 2024-06-13T11:22:51.524 INFO:teuthology.orchestra.run.smithi002.stdout:osd.9 smithi002 running (6m) 2m ago 6m 41.5M 4273M 19.0.0-2946-g3d89accf b045ac545f82 025a3d1e49d7 2024-06-13T11:22:51.524 INFO:teuthology.orchestra.run.smithi002.stdout:osd.10 smithi077 running (5m) 2m ago 5m 54.3M 4272M 19.0.0-2946-g3d89accf b045ac545f82 d857a7f02f17 2024-06-13T11:22:51.524 INFO:teuthology.orchestra.run.smithi002.stdout:osd.11 smithi178 running (5m) 2m ago 5m 51.6M 4272M 19.0.0-2946-g3d89accf b045ac545f82 c7d729a8adf7 2024-06-13T11:22:51.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.526+0000 7ff92cc00700 1 -- 172.21.15.2:0/1993058960 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff90c0a2ca0 msgr2=0x7ff90c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:51.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.526+0000 7ff92cc00700 1 --2- 172.21.15.2:0/1993058960 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff90c0a2ca0 0x7ff90c0a5160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff918011490 tx=0x7ff918009260 comp rx=0 tx=0).stop 2024-06-13T11:22:51.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.526+0000 7ff92cc00700 1 -- 172.21.15.2:0/1993058960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9281081e0 msgr2=0x7ff9281a1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:51.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.526+0000 7ff92cc00700 1 --2- 172.21.15.2:0/1993058960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9281081e0 0x7ff9281a1f50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff92000c140 tx=0x7ff92000c450 comp rx=0 tx=0).stop 2024-06-13T11:22:51.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.526+0000 7ff92cc00700 1 -- 172.21.15.2:0/1993058960 shutdown_connections 2024-06-13T11:22:51.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.526+0000 7ff92cc00700 1 --2- 172.21.15.2:0/1993058960 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7ff90c0a2ca0 0x7ff90c0a5160 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:51.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.526+0000 7ff92cc00700 1 --2- 172.21.15.2:0/1993058960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9281081e0 0x7ff9281a1f50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:51.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.526+0000 7ff92cc00700 1 --2- 172.21.15.2:0/1993058960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff928102f80 0x7ff92819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:51.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.526+0000 7ff92cc00700 1 --2- 172.21.15.2:0/1993058960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9281058b0 0x7ff92819af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:51.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.526+0000 7ff92cc00700 1 -- 172.21.15.2:0/1993058960 >> 172.21.15.2:0/1993058960 conn(0x7ff9280fc990 msgr2=0x7ff9281026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:51.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.526+0000 7ff92cc00700 1 -- 172.21.15.2:0/1993058960 shutdown_connections 2024-06-13T11:22:51.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:51.526+0000 7ff92cc00700 1 -- 172.21.15.2:0/1993058960 wait complete. 2024-06-13T11:22:52.338 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- bash -c 'ceph orch ls' 2024-06-13T11:22:52.809 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:22:53.216 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:53 smithi002 ceph-mon[32210]: pgmap v462: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:22:53.216 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:53 smithi002 ceph-mon[32210]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:22:53.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:53 smithi077 ceph-mon[36410]: pgmap v462: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:22:53.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:53 smithi077 ceph-mon[36410]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:22:53.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:53 smithi178 ceph-mon[36913]: pgmap v462: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:22:53.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:53 smithi178 ceph-mon[36913]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:22:54.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:54 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:22:54.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:54 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:22:54.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:54 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:22:55.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.217+0000 7f9543e00700 1 -- 172.21.15.2:0/49285182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9544105810 msgr2=0x7f9544105c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:55.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.217+0000 7f9543e00700 1 --2- 172.21.15.2:0/49285182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9544105810 0x7f9544105c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9530009990 tx=0x7f9530009ca0 comp rx=0 tx=0).stop 2024-06-13T11:22:55.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.218+0000 7f9543e00700 1 -- 172.21.15.2:0/49285182 shutdown_connections 2024-06-13T11:22:55.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.218+0000 7f9543e00700 1 --2- 172.21.15.2:0/49285182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95441061b0 0x7f954410ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:55.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.218+0000 7f9543e00700 1 --2- 172.21.15.2:0/49285182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9544104610 0x7f9544104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.218+0000 7f9543e00700 1 --2- 172.21.15.2:0/49285182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9544105810 0x7f9544105c70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.218+0000 7f9543e00700 1 -- 172.21.15.2:0/49285182 >> 172.21.15.2:0/49285182 conn(0x7f95440ffbb0 msgr2=0x7f9544101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.218+0000 7f9543e00700 1 -- 172.21.15.2:0/49285182 shutdown_connections 2024-06-13T11:22:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.218+0000 7f9543e00700 1 -- 172.21.15.2:0/49285182 wait complete. 2024-06-13T11:22:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.219+0000 7f9543e00700 1 Processor -- start 2024-06-13T11:22:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.219+0000 7f9543e00700 1 -- start start 2024-06-13T11:22:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.219+0000 7f9543e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9544104610 0x7f954419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.219+0000 7f9543e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9544105810 0x7f954419acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.220+0000 7f9543e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95441061b0 0x7f95441a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.220+0000 7f9543e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f95441101e0 con 0x7f95441061b0 2024-06-13T11:22:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.220+0000 7f9543e00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9544110060 con 0x7f9544105810 2024-06-13T11:22:55.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.220+0000 7f9543e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9544110360 con 0x7f9544104610 2024-06-13T11:22:55.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.220+0000 7f9542a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9544104610 0x7f954419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:55.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.220+0000 7f9542000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9544105810 0x7f954419acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:55.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.220+0000 7f9542a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9544104610 0x7f954419a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:45816/0 (socket says 172.21.15.2:45816) 2024-06-13T11:22:55.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.220+0000 7f9542a00700 1 -- 172.21.15.2:0/2675928578 learned_addr learned my addr 172.21.15.2:0/2675928578 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:55.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.220+0000 7f9542000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9544105810 0x7f954419acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:54162/0 (socket says 172.21.15.2:54162) 2024-06-13T11:22:55.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.220+0000 7f9543400700 1 --2- 172.21.15.2:0/2675928578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95441061b0 0x7f95441a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:55.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.220+0000 7f9542a00700 1 -- 172.21.15.2:0/2675928578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9544105810 msgr2=0x7f954419acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:55.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.220+0000 7f9542a00700 1 --2- 172.21.15.2:0/2675928578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9544105810 0x7f954419acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:55.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.220+0000 7f9542a00700 1 -- 172.21.15.2:0/2675928578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95441061b0 msgr2=0x7f95441a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:55.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.220+0000 7f9542a00700 1 --2- 172.21.15.2:0/2675928578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95441061b0 0x7f95441a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:55.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.220+0000 7f9542a00700 1 -- 172.21.15.2:0/2675928578 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95441a23f0 con 0x7f9544104610 2024-06-13T11:22:55.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.220+0000 7f9542000700 1 --2- 172.21.15.2:0/2675928578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9544105810 0x7f954419acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:22:55.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.221+0000 7f9542a00700 1 --2- 172.21.15.2:0/2675928578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9544104610 0x7f954419a790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f953400e9a0 tx=0x7f953400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:55.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.221+0000 7f953b400700 1 -- 172.21.15.2:0/2675928578 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534004220 con 0x7f9544104610 2024-06-13T11:22:55.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.221+0000 7f953b400700 1 -- 172.21.15.2:0/2675928578 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95340043c0 con 0x7f9544104610 2024-06-13T11:22:55.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.221+0000 7f9543e00700 1 -- 172.21.15.2:0/2675928578 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95441a26e0 con 0x7f9544104610 2024-06-13T11:22:55.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.221+0000 7f953b400700 1 -- 172.21.15.2:0/2675928578 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534003df0 con 0x7f9544104610 2024-06-13T11:22:55.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.221+0000 7f9543e00700 1 -- 172.21.15.2:0/2675928578 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95441a2c70 con 0x7f9544104610 2024-06-13T11:22:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.222+0000 7f9543e00700 1 -- 172.21.15.2:0/2675928578 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9544069180 con 0x7f9544104610 2024-06-13T11:22:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.225+0000 7f953b400700 1 -- 172.21.15.2:0/2675928578 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f9534044b30 con 0x7f9544104610 2024-06-13T11:22:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.226+0000 7f953b400700 1 --2- 172.21.15.2:0/2675928578 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f95280a2ca0 0x7f95280a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.226+0000 7f953b400700 1 -- 172.21.15.2:0/2675928578 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f95340cf5a0 con 0x7f9544104610 2024-06-13T11:22:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.226+0000 7f9542000700 1 --2- 172.21.15.2:0/2675928578 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f95280a2ca0 0x7f95280a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.227+0000 7f9542000700 1 --2- 172.21.15.2:0/2675928578 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f95280a2ca0 0x7f95280a5160 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f953000b2e0 tx=0x7f953000b8f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.229+0000 7f953b400700 1 -- 172.21.15.2:0/2675928578 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9534044e20 con 0x7f9544104610 2024-06-13T11:22:55.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:55 smithi077 ceph-mon[36410]: pgmap v463: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:22:55.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:55 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:22:55.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:55 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:22:55.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:55 smithi002 ceph-mon[32210]: pgmap v463: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:22:55.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:55 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:22:55.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:55 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:22:55.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:55 smithi178 ceph-mon[36913]: pgmap v463: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:22:55.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:55 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:22:55.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:55 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:22:55.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.464+0000 7f9543e00700 1 -- 172.21.15.2:0/2675928578 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f95440628d0 con 0x7f95280a2ca0 2024-06-13T11:22:55.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.481+0000 7f953b400700 1 -- 172.21.15.2:0/2675928578 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f95440628d0 con 0x7f95280a2ca0 2024-06-13T11:22:55.481 INFO:teuthology.orchestra.run.smithi002.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-06-13T11:22:55.481 INFO:teuthology.orchestra.run.smithi002.stdout:mds.all 12/12 2m ago 5m smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi077=b;smithi077=e;smithi077=h;smithi077=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l;count:12 2024-06-13T11:22:55.481 INFO:teuthology.orchestra.run.smithi002.stdout:mgr 3/3 2m ago 11m smithi002=x;smithi077=y;smithi178=z;count:3 2024-06-13T11:22:55.481 INFO:teuthology.orchestra.run.smithi002.stdout:mon 3/3 2m ago 11m smithi002:172.21.15.2=a;smithi077:172.21.15.77=b;smithi178:172.21.15.178=c;count:3 2024-06-13T11:22:55.481 INFO:teuthology.orchestra.run.smithi002.stdout:osd 12 2m ago - 2024-06-13T11:22:55.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.485+0000 7f9543e00700 1 -- 172.21.15.2:0/2675928578 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f95280a2ca0 msgr2=0x7f95280a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:55.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.485+0000 7f9543e00700 1 --2- 172.21.15.2:0/2675928578 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f95280a2ca0 0x7f95280a5160 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f953000b2e0 tx=0x7f953000b8f0 comp rx=0 tx=0).stop 2024-06-13T11:22:55.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.485+0000 7f9543e00700 1 -- 172.21.15.2:0/2675928578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9544104610 msgr2=0x7f954419a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:55.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.485+0000 7f9543e00700 1 --2- 172.21.15.2:0/2675928578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9544104610 0x7f954419a790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f953400e9a0 tx=0x7f953400ecb0 comp rx=0 tx=0).stop 2024-06-13T11:22:55.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.485+0000 7f9543e00700 1 -- 172.21.15.2:0/2675928578 shutdown_connections 2024-06-13T11:22:55.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.485+0000 7f9543e00700 1 --2- 172.21.15.2:0/2675928578 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f95280a2ca0 0x7f95280a5160 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:55.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.485+0000 7f9543e00700 1 --2- 172.21.15.2:0/2675928578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95441061b0 0x7f95441a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:55.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.485+0000 7f9543e00700 1 --2- 172.21.15.2:0/2675928578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9544104610 0x7f954419a790 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:55.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.485+0000 7f9543e00700 1 --2- 172.21.15.2:0/2675928578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9544105810 0x7f954419acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:55.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.485+0000 7f9543e00700 1 -- 172.21.15.2:0/2675928578 >> 172.21.15.2:0/2675928578 conn(0x7f95440ffbb0 msgr2=0x7f9544108b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:55.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.485+0000 7f9543e00700 1 -- 172.21.15.2:0/2675928578 shutdown_connections 2024-06-13T11:22:55.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:55.485+0000 7f9543e00700 1 -- 172.21.15.2:0/2675928578 wait complete. 2024-06-13T11:22:56.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:56 smithi002 ceph-mon[32210]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:22:56.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:56 smithi077 ceph-mon[36410]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:22:56.405 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- bash -c 'ceph orch host ls' 2024-06-13T11:22:56.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:56 smithi178 ceph-mon[36913]: from='mgr.14152 172.21.15.2:0/1417756' entity='mgr.x' 2024-06-13T11:22:56.881 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:22:57.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:57 smithi077 ceph-mon[36410]: pgmap v464: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:57.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:57 smithi077 ceph-mon[36410]: from='client.25033 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:22:57.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:57 smithi002 ceph-mon[32210]: pgmap v464: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:57.350 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:57 smithi002 ceph-mon[32210]: from='client.25033 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:22:57.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:57 smithi178 ceph-mon[36913]: pgmap v464: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:22:57.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:57 smithi178 ceph-mon[36913]: from='client.25033 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:22:59.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.221+0000 7fd124000700 1 -- 172.21.15.2:0/4010655254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd11c100da0 msgr2=0x7fd11c1011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:59.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.221+0000 7fd124000700 1 --2- 172.21.15.2:0/4010655254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd11c100da0 0x7fd11c1011c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd110009990 tx=0x7fd110009ca0 comp rx=0 tx=0).stop 2024-06-13T11:22:59.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.221+0000 7fd124000700 1 -- 172.21.15.2:0/4010655254 shutdown_connections 2024-06-13T11:22:59.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.221+0000 7fd124000700 1 --2- 172.21.15.2:0/4010655254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd11c1020c0 0x7fd11c102540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:59.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.221+0000 7fd124000700 1 --2- 172.21.15.2:0/4010655254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd11c100da0 0x7fd11c1011c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:59.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.221+0000 7fd124000700 1 --2- 172.21.15.2:0/4010655254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd11c101700 0x7fd11c101b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:59.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.221+0000 7fd124000700 1 -- 172.21.15.2:0/4010655254 >> 172.21.15.2:0/4010655254 conn(0x7fd11c0fc9e0 msgr2=0x7fd11c0fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:59.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.221+0000 7fd124000700 1 -- 172.21.15.2:0/4010655254 shutdown_connections 2024-06-13T11:22:59.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.221+0000 7fd124000700 1 -- 172.21.15.2:0/4010655254 wait complete. 2024-06-13T11:22:59.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.222+0000 7fd124000700 1 Processor -- start 2024-06-13T11:22:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.222+0000 7fd124000700 1 -- start start 2024-06-13T11:22:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.223+0000 7fd124000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd11c100da0 0x7fd11c19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.223+0000 7fd124000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd11c101700 0x7fd11c19ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.223+0000 7fd124000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd11c1020c0 0x7fd11c1a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.223+0000 7fd124000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c110310 con 0x7fd11c1020c0 2024-06-13T11:22:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.223+0000 7fd124000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c110190 con 0x7fd11c101700 2024-06-13T11:22:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.223+0000 7fd124000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c110490 con 0x7fd11c100da0 2024-06-13T11:22:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.223+0000 7fd122000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd11c1020c0 0x7fd11c1a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.223+0000 7fd120c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd11c101700 0x7fd11c19ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.223+0000 7fd120c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd11c101700 0x7fd11c19ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:50704/0 (socket says 172.21.15.2:50704) 2024-06-13T11:22:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.223+0000 7fd120c00700 1 -- 172.21.15.2:0/311507238 learned_addr learned my addr 172.21.15.2:0/311507238 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:22:59.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.223+0000 7fd121600700 1 --2- 172.21.15.2:0/311507238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd11c100da0 0x7fd11c19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:59.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.224+0000 7fd120c00700 1 -- 172.21.15.2:0/311507238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd11c100da0 msgr2=0x7fd11c19a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:59.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.224+0000 7fd120c00700 1 --2- 172.21.15.2:0/311507238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd11c100da0 0x7fd11c19a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:59.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.224+0000 7fd120c00700 1 -- 172.21.15.2:0/311507238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd11c1020c0 msgr2=0x7fd11c1a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:59.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.224+0000 7fd120c00700 1 --2- 172.21.15.2:0/311507238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd11c1020c0 0x7fd11c1a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:59.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.224+0000 7fd120c00700 1 -- 172.21.15.2:0/311507238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11c1a2580 con 0x7fd11c101700 2024-06-13T11:22:59.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.224+0000 7fd121600700 1 --2- 172.21.15.2:0/311507238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd11c100da0 0x7fd11c19a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:22:59.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.224+0000 7fd120c00700 1 --2- 172.21.15.2:0/311507238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd11c101700 0x7fd11c19ae60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd10800e9a0 tx=0x7fd10800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:59.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.224+0000 7fd11a000700 1 -- 172.21.15.2:0/311507238 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10800ca10 con 0x7fd11c101700 2024-06-13T11:22:59.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.224+0000 7fd11a000700 1 -- 172.21.15.2:0/311507238 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd10800cbb0 con 0x7fd11c101700 2024-06-13T11:22:59.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.224+0000 7fd124000700 1 -- 172.21.15.2:0/311507238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd11c1a2870 con 0x7fd11c101700 2024-06-13T11:22:59.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.224+0000 7fd11a000700 1 -- 172.21.15.2:0/311507238 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd108018710 con 0x7fd11c101700 2024-06-13T11:22:59.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.225+0000 7fd124000700 1 -- 172.21.15.2:0/311507238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd11c1a2e00 con 0x7fd11c101700 2024-06-13T11:22:59.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.226+0000 7fd124000700 1 -- 172.21.15.2:0/311507238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd11c069180 con 0x7fd11c101700 2024-06-13T11:22:59.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.228+0000 7fd11a000700 1 -- 172.21.15.2:0/311507238 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fd1080188b0 con 0x7fd11c101700 2024-06-13T11:22:59.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.229+0000 7fd11a000700 1 --2- 172.21.15.2:0/311507238 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd1040a2ca0 0x7fd1040a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:22:59.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.229+0000 7fd11a000700 1 -- 172.21.15.2:0/311507238 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fd1080cf530 con 0x7fd11c101700 2024-06-13T11:22:59.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.229+0000 7fd121600700 1 --2- 172.21.15.2:0/311507238 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd1040a2ca0 0x7fd1040a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:22:59.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.230+0000 7fd121600700 1 --2- 172.21.15.2:0/311507238 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd1040a2ca0 0x7fd1040a5160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd11000b2e0 tx=0x7fd110005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:22:59.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.234+0000 7fd11a000700 1 -- 172.21.15.2:0/311507238 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd10809c0a0 con 0x7fd11c101700 2024-06-13T11:22:59.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:22:59 smithi077 ceph-mon[36410]: pgmap v465: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:22:59.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:22:59 smithi002 ceph-mon[32210]: pgmap v465: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:22:59.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:22:59 smithi178 ceph-mon[36913]: pgmap v465: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:22:59.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.474+0000 7fd124000700 1 -- 172.21.15.2:0/311507238 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fd11c0628d0 con 0x7fd1040a2ca0 2024-06-13T11:22:59.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.476+0000 7fd11a000700 1 -- 172.21.15.2:0/311507238 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fd11c0628d0 con 0x7fd1040a2ca0 2024-06-13T11:22:59.476 INFO:teuthology.orchestra.run.smithi002.stdout:HOST ADDR LABELS STATUS 2024-06-13T11:22:59.476 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 172.21.15.2 2024-06-13T11:22:59.476 INFO:teuthology.orchestra.run.smithi002.stdout:smithi077 172.21.15.77 2024-06-13T11:22:59.476 INFO:teuthology.orchestra.run.smithi002.stdout:smithi178 172.21.15.178 2024-06-13T11:22:59.476 INFO:teuthology.orchestra.run.smithi002.stdout:3 hosts in cluster 2024-06-13T11:22:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.479+0000 7fd124000700 1 -- 172.21.15.2:0/311507238 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd1040a2ca0 msgr2=0x7fd1040a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:59.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.479+0000 7fd124000700 1 --2- 172.21.15.2:0/311507238 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd1040a2ca0 0x7fd1040a5160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd11000b2e0 tx=0x7fd110005fd0 comp rx=0 tx=0).stop 2024-06-13T11:22:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.479+0000 7fd124000700 1 -- 172.21.15.2:0/311507238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd11c101700 msgr2=0x7fd11c19ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:22:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.479+0000 7fd124000700 1 --2- 172.21.15.2:0/311507238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd11c101700 0x7fd11c19ae60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd10800e9a0 tx=0x7fd10800ecb0 comp rx=0 tx=0).stop 2024-06-13T11:22:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.480+0000 7fd124000700 1 -- 172.21.15.2:0/311507238 shutdown_connections 2024-06-13T11:22:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.480+0000 7fd124000700 1 --2- 172.21.15.2:0/311507238 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fd1040a2ca0 0x7fd1040a5160 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.480+0000 7fd124000700 1 --2- 172.21.15.2:0/311507238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd11c1020c0 0x7fd11c1a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.480+0000 7fd124000700 1 --2- 172.21.15.2:0/311507238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd11c100da0 0x7fd11c19a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.480+0000 7fd124000700 1 --2- 172.21.15.2:0/311507238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd11c101700 0x7fd11c19ae60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:22:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.480+0000 7fd124000700 1 -- 172.21.15.2:0/311507238 >> 172.21.15.2:0/311507238 conn(0x7fd11c0fc9e0 msgr2=0x7fd11c0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:22:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.480+0000 7fd124000700 1 -- 172.21.15.2:0/311507238 shutdown_connections 2024-06-13T11:22:59.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:22:59.480+0000 7fd124000700 1 -- 172.21.15.2:0/311507238 wait complete. 2024-06-13T11:23:00.277 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- bash -c 'ceph orch device ls' 2024-06-13T11:23:00.357 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:00 smithi002 ceph-mon[32210]: pgmap v466: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:00.357 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:00 smithi002 ceph-mon[32210]: from='client.25013 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:23:00.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:00 smithi178 ceph-mon[36913]: pgmap v466: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:00.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:00 smithi178 ceph-mon[36913]: from='client.25013 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:23:00.539 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:00 smithi077 ceph-mon[36410]: pgmap v466: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:00.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:00 smithi077 ceph-mon[36410]: from='client.25013 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:23:00.754 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:23:02.551 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:02 smithi002 ceph-mon[32210]: pgmap v467: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:23:02.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:02 smithi178 ceph-mon[36913]: pgmap v467: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:23:02.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:02 smithi077 ceph-mon[36410]: pgmap v467: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:23:03.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.101+0000 7f23da400700 1 -- 172.21.15.2:0/4247274296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d4105810 msgr2=0x7f23d4105c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:03.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.101+0000 7f23da400700 1 --2- 172.21.15.2:0/4247274296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d4105810 0x7f23d4105c70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f23c40099c0 tx=0x7f23c4009cd0 comp rx=0 tx=0).stop 2024-06-13T11:23:03.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.102+0000 7f23da400700 1 -- 172.21.15.2:0/4247274296 shutdown_connections 2024-06-13T11:23:03.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.102+0000 7f23da400700 1 --2- 172.21.15.2:0/4247274296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23d41061b0 0x7f23d410ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:03.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.102+0000 7f23da400700 1 --2- 172.21.15.2:0/4247274296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23d4104610 0x7f23d4104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:03.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.102+0000 7f23da400700 1 --2- 172.21.15.2:0/4247274296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d4105810 0x7f23d4105c70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:03.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.102+0000 7f23da400700 1 -- 172.21.15.2:0/4247274296 >> 172.21.15.2:0/4247274296 conn(0x7f23d40ffbb0 msgr2=0x7f23d4101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:03.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.102+0000 7f23da400700 1 -- 172.21.15.2:0/4247274296 shutdown_connections 2024-06-13T11:23:03.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.102+0000 7f23da400700 1 -- 172.21.15.2:0/4247274296 wait complete. 2024-06-13T11:23:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.103+0000 7f23da400700 1 Processor -- start 2024-06-13T11:23:03.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.103+0000 7f23da400700 1 -- start start 2024-06-13T11:23:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23da400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23d4104610 0x7f23d419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23da400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23d4105810 0x7f23d419acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23da400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d41061b0 0x7f23d41a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23da400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41101e0 con 0x7f23d41061b0 2024-06-13T11:23:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23da400700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4110060 con 0x7f23d4105810 2024-06-13T11:23:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23da400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4110360 con 0x7f23d4104610 2024-06-13T11:23:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23d3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23d4105810 0x7f23d419acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23d3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23d4105810 0x7f23d419acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:50712/0 (socket says 172.21.15.2:50712) 2024-06-13T11:23:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23d3e00700 1 -- 172.21.15.2:0/2938943657 learned_addr learned my addr 172.21.15.2:0/2938943657 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23d9000700 1 --2- 172.21.15.2:0/2938943657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23d4104610 0x7f23d419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23d9a00700 1 --2- 172.21.15.2:0/2938943657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d41061b0 0x7f23d41a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23d3e00700 1 -- 172.21.15.2:0/2938943657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23d4104610 msgr2=0x7f23d419a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:03.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23d3e00700 1 --2- 172.21.15.2:0/2938943657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23d4104610 0x7f23d419a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23d3e00700 1 -- 172.21.15.2:0/2938943657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d41061b0 msgr2=0x7f23d41a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23d3e00700 1 --2- 172.21.15.2:0/2938943657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d41061b0 0x7f23d41a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23d3e00700 1 -- 172.21.15.2:0/2938943657 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d41a23f0 con 0x7f23d4105810 2024-06-13T11:23:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.104+0000 7f23d9a00700 1 --2- 172.21.15.2:0/2938943657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d41061b0 0x7f23d41a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:23:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.105+0000 7f23d3e00700 1 --2- 172.21.15.2:0/2938943657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23d4105810 0x7f23d419acd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f23c400b580 tx=0x7f23c400bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.105+0000 7f23d1600700 1 -- 172.21.15.2:0/2938943657 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4003e10 con 0x7f23d4105810 2024-06-13T11:23:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.105+0000 7f23d1600700 1 -- 172.21.15.2:0/2938943657 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23c400f460 con 0x7f23d4105810 2024-06-13T11:23:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.105+0000 7f23da400700 1 -- 172.21.15.2:0/2938943657 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d41a2680 con 0x7f23d4105810 2024-06-13T11:23:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.105+0000 7f23d1600700 1 -- 172.21.15.2:0/2938943657 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4017630 con 0x7f23d4105810 2024-06-13T11:23:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.105+0000 7f23da400700 1 -- 172.21.15.2:0/2938943657 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d41a2b30 con 0x7f23d4105810 2024-06-13T11:23:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.107+0000 7f23da400700 1 -- 172.21.15.2:0/2938943657 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d4069180 con 0x7f23d4105810 2024-06-13T11:23:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.108+0000 7f23d1600700 1 -- 172.21.15.2:0/2938943657 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f23c400f610 con 0x7f23d4105810 2024-06-13T11:23:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.110+0000 7f23d1600700 1 --2- 172.21.15.2:0/2938943657 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f23bc0a2ca0 0x7f23bc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.110+0000 7f23d1600700 1 -- 172.21.15.2:0/2938943657 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f23c40d0190 con 0x7f23d4105810 2024-06-13T11:23:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.110+0000 7f23d9000700 1 --2- 172.21.15.2:0/2938943657 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f23bc0a2ca0 0x7f23bc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.111+0000 7f23d9000700 1 --2- 172.21.15.2:0/2938943657 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f23bc0a2ca0 0x7f23bc0a5160 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f23d4105670 tx=0x7f23c8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.114+0000 7f23d1600700 1 -- 172.21.15.2:0/2938943657 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f23c4013070 con 0x7f23d4105810 2024-06-13T11:23:03.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.356+0000 7f23da400700 1 -- 172.21.15.2:0/2938943657 --> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f23d40628d0 con 0x7f23bc0a2ca0 2024-06-13T11:23:03.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.361+0000 7f23d1600700 1 -- 172.21.15.2:0/2938943657 <== mgr.14152 v2:172.21.15.2:6800/3387272091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f23d40628d0 con 0x7f23bc0a2ca0 2024-06-13T11:23:03.360 INFO:teuthology.orchestra.run.smithi002.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-06-13T11:23:03.360 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EV480DGN 447G No 6m ago Has a FileSystem, LVM detected 2024-06-13T11:23:03.361 INFO:teuthology.orchestra.run.smithi002.stdout:smithi077 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400ZJ400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-06-13T11:23:03.361 INFO:teuthology.orchestra.run.smithi002.stdout:smithi178 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130029480DGN 447G No 5m ago Has a FileSystem, LVM detected 2024-06-13T11:23:03.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.364+0000 7f23da400700 1 -- 172.21.15.2:0/2938943657 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f23bc0a2ca0 msgr2=0x7f23bc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:03.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.364+0000 7f23da400700 1 --2- 172.21.15.2:0/2938943657 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f23bc0a2ca0 0x7f23bc0a5160 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f23d4105670 tx=0x7f23c8009260 comp rx=0 tx=0).stop 2024-06-13T11:23:03.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.364+0000 7f23da400700 1 -- 172.21.15.2:0/2938943657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23d4105810 msgr2=0x7f23d419acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:03.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.364+0000 7f23da400700 1 --2- 172.21.15.2:0/2938943657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23d4105810 0x7f23d419acd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f23c400b580 tx=0x7f23c400bee0 comp rx=0 tx=0).stop 2024-06-13T11:23:03.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.364+0000 7f23da400700 1 -- 172.21.15.2:0/2938943657 shutdown_connections 2024-06-13T11:23:03.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.364+0000 7f23da400700 1 --2- 172.21.15.2:0/2938943657 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f23bc0a2ca0 0x7f23bc0a5160 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:03.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.364+0000 7f23da400700 1 --2- 172.21.15.2:0/2938943657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23d41061b0 0x7f23d41a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:03.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.364+0000 7f23da400700 1 --2- 172.21.15.2:0/2938943657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23d4104610 0x7f23d419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:03.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.364+0000 7f23da400700 1 --2- 172.21.15.2:0/2938943657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23d4105810 0x7f23d419acd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:03.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.364+0000 7f23da400700 1 -- 172.21.15.2:0/2938943657 >> 172.21.15.2:0/2938943657 conn(0x7f23d40ffbb0 msgr2=0x7f23d4108b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:03.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.364+0000 7f23da400700 1 -- 172.21.15.2:0/2938943657 shutdown_connections 2024-06-13T11:23:03.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:03.365+0000 7f23da400700 1 -- 172.21.15.2:0/2938943657 wait complete. 2024-06-13T11:23:04.311 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-13T11:23:04.324 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T11:23:04.325 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- bash -c 'ceph fs dump' 2024-06-13T11:23:04.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:04 smithi178 ceph-mon[36913]: from='client.25019 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:23:04.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:04 smithi178 ceph-mon[36913]: pgmap v468: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:23:04.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:04 smithi077 ceph-mon[36410]: from='client.25019 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:23:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:04 smithi077 ceph-mon[36410]: pgmap v468: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:23:04.796 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:23:04.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:04 smithi002 ceph-mon[32210]: from='client.25019 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:23:04.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:04 smithi002 ceph-mon[32210]: pgmap v468: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:23:06.556 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:06 smithi002 ceph-mon[32210]: pgmap v469: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:06.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:06 smithi178 ceph-mon[36913]: pgmap v469: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:06.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:06 smithi077 ceph-mon[36410]: pgmap v469: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.072+0000 7f8139200700 1 -- 172.21.15.2:0/3017344652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f813410a390 msgr2=0x7f813410c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.072+0000 7f8139200700 1 --2- 172.21.15.2:0/3017344652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f813410a390 0x7f813410c820 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f812c00b0a0 tx=0x7f812c00b3b0 comp rx=0 tx=0).stop 2024-06-13T11:23:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.072+0000 7f8139200700 1 -- 172.21.15.2:0/3017344652 shutdown_connections 2024-06-13T11:23:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.072+0000 7f8139200700 1 --2- 172.21.15.2:0/3017344652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81340764c0 0x7f8134074920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.072+0000 7f8139200700 1 --2- 172.21.15.2:0/3017344652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f813410a390 0x7f813410c820 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.072+0000 7f8139200700 1 --2- 172.21.15.2:0/3017344652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8134074ef0 0x7f8134075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.072+0000 7f8139200700 1 -- 172.21.15.2:0/3017344652 >> 172.21.15.2:0/3017344652 conn(0x7f81340fda60 msgr2=0x7f81340ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.072+0000 7f8139200700 1 -- 172.21.15.2:0/3017344652 shutdown_connections 2024-06-13T11:23:07.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.072+0000 7f8139200700 1 -- 172.21.15.2:0/3017344652 wait complete. 2024-06-13T11:23:07.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.073+0000 7f8139200700 1 Processor -- start 2024-06-13T11:23:07.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.073+0000 7f8139200700 1 -- start start 2024-06-13T11:23:07.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.074+0000 7f8139200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8134074ef0 0x7f813419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:07.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.074+0000 7f8139200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81340764c0 0x7f813419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:07.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.074+0000 7f8139200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f813410a390 0x7f81341a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:07.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.074+0000 7f8139200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f81341102f0 con 0x7f8134074ef0 2024-06-13T11:23:07.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.074+0000 7f8139200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8134110170 con 0x7f81340764c0 2024-06-13T11:23:07.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.074+0000 7f8139200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8134110470 con 0x7f813410a390 2024-06-13T11:23:07.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.074+0000 7f8131e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8134074ef0 0x7f813419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:07.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.074+0000 7f812be00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81340764c0 0x7f813419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:07.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.074+0000 7f812be00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81340764c0 0x7f813419ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:37344/0 (socket says 172.21.15.2:37344) 2024-06-13T11:23:07.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.074+0000 7f812be00700 1 -- 172.21.15.2:0/3513845600 learned_addr learned my addr 172.21.15.2:0/3513845600 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:07.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.074+0000 7f8131e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8134074ef0 0x7f813419a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60254/0 (socket says 172.21.15.2:60254) 2024-06-13T11:23:07.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.074+0000 7f8132800700 1 --2- 172.21.15.2:0/3513845600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f813410a390 0x7f81341a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:07.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.075+0000 7f812be00700 1 -- 172.21.15.2:0/3513845600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f813410a390 msgr2=0x7f81341a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:07.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.075+0000 7f812be00700 1 --2- 172.21.15.2:0/3513845600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f813410a390 0x7f81341a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:07.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.075+0000 7f812be00700 1 -- 172.21.15.2:0/3513845600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8134074ef0 msgr2=0x7f813419a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:07.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.075+0000 7f812be00700 1 --2- 172.21.15.2:0/3513845600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8134074ef0 0x7f813419a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:07.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.075+0000 7f812be00700 1 -- 172.21.15.2:0/3513845600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81341a2530 con 0x7f81340764c0 2024-06-13T11:23:07.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.075+0000 7f812be00700 1 --2- 172.21.15.2:0/3513845600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81340764c0 0x7f813419ae10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f811c00ea50 tx=0x7f811c00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:07.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.075+0000 7f812aa00700 1 -- 172.21.15.2:0/3513845600 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c00cbd0 con 0x7f81340764c0 2024-06-13T11:23:07.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.075+0000 7f812aa00700 1 -- 172.21.15.2:0/3513845600 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f811c00cd70 con 0x7f81340764c0 2024-06-13T11:23:07.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.075+0000 7f812aa00700 1 -- 172.21.15.2:0/3513845600 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811c0187a0 con 0x7f81340764c0 2024-06-13T11:23:07.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.075+0000 7f8139200700 1 -- 172.21.15.2:0/3513845600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81341a2820 con 0x7f81340764c0 2024-06-13T11:23:07.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.075+0000 7f8139200700 1 -- 172.21.15.2:0/3513845600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81341a2d10 con 0x7f81340764c0 2024-06-13T11:23:07.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.076+0000 7f8139200700 1 -- 172.21.15.2:0/3513845600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8134069180 con 0x7f81340764c0 2024-06-13T11:23:07.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.079+0000 7f812aa00700 1 -- 172.21.15.2:0/3513845600 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f811c01f020 con 0x7f81340764c0 2024-06-13T11:23:07.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.081+0000 7f812aa00700 1 --2- 172.21.15.2:0/3513845600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f81180a2ca0 0x7f81180a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:07.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.081+0000 7f812aa00700 1 -- 172.21.15.2:0/3513845600 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f811c0cfb50 con 0x7f81340764c0 2024-06-13T11:23:07.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.081+0000 7f8131e00700 1 --2- 172.21.15.2:0/3513845600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f81180a2ca0 0x7f81180a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:07.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.082+0000 7f8131e00700 1 --2- 172.21.15.2:0/3513845600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f81180a2ca0 0x7f81180a5160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f81340768a0 tx=0x7f8124009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:07.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.082+0000 7f812aa00700 1 -- 172.21.15.2:0/3513845600 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f811c026070 con 0x7f81340764c0 2024-06-13T11:23:07.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.360+0000 7f8139200700 1 -- 172.21.15.2:0/3513845600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f81340630a0 con 0x7f81340764c0 2024-06-13T11:23:07.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.361+0000 7f812aa00700 1 -- 172.21.15.2:0/3513845600 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+3039 (secure 0 0 0) 0x7f811c09c6c0 con 0x7f81340764c0 2024-06-13T11:23:07.361 INFO:teuthology.orchestra.run.smithi002.stdout:e26 2024-06-13T11:23:07.361 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-13T11:23:07.361 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-13T11:23:07.361 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-06-13T11:23:07.361 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:23:07.362 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-06-13T11:23:07.362 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-06-13T11:23:07.362 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 26 2024-06-13T11:23:07.362 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-06-13T11:23:07.362 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-06-13T11:18:45.943965+0000 2024-06-13T11:23:07.362 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-06-13T11:20:14.396526+0000 2024-06-13T11:23:07.362 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-06-13T11:23:07.362 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-06-13T11:23:07.362 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 300 2024-06-13T11:23:07.362 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-06-13T11:23:07.362 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-06-13T11:23:07.362 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-06-13T11:23:07.362 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-06-13T11:23:07.363 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-06-13T11:23:07.363 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 0 2024-06-13T11:23:07.363 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-13T11:23:07.363 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 3 2024-06-13T11:23:07.363 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1,2 2024-06-13T11:23:07.363 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24511,1=24509,2=24493} 2024-06-13T11:23:07.363 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-06-13T11:23:07.363 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-06-13T11:23:07.363 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-06-13T11:23:07.363 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3,4] 2024-06-13T11:23:07.363 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-06-13T11:23:07.363 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data disabled 2024-06-13T11:23:07.363 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-06-13T11:23:07.364 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-06-13T11:23:07.364 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 0 2024-06-13T11:23:07.364 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 24511 members: 24509,24511,24493 2024-06-13T11:23:07.364 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.i{0:24511} state up:active seq 10 addr [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T11:23:07.364 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.f{0:24481} state up:standby-replay seq 1 addr [v2:172.21.15.178:6834/2515486418,v1:172.21.15.178:6835/2515486418] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T11:23:07.364 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b{1:24509} state up:active seq 27 addr [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T11:23:07.364 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.h{1:24470} state up:standby-replay seq 1 addr [v2:172.21.15.77:6836/1628379389,v1:172.21.15.77:6837/1628379389] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T11:23:07.364 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c{2:24493} state up:active seq 32 addr [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T11:23:07.364 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.e{2:24455} state up:standby-replay seq 1 addr [v2:172.21.15.77:6834/4100836585,v1:172.21.15.77:6835/4100836585] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T11:23:07.364 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:23:07.364 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:23:07.364 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-06-13T11:23:07.364 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:23:07.364 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.j{-1:14367} state up:standby seq 1 addr [v2:172.21.15.2:6834/3486542441,v1:172.21.15.2:6835/3486542441] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T11:23:07.365 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.g{-1:14403} state up:standby seq 1 addr [v2:172.21.15.2:6838/4035170856,v1:172.21.15.2:6839/4035170856] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T11:23:07.365 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a{-1:14415} state up:standby seq 1 addr [v2:172.21.15.2:6840/3780644818,v1:172.21.15.2:6841/3780644818] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T11:23:07.365 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.k{-1:24425} state up:standby seq 1 addr [v2:172.21.15.77:6832/1004888584,v1:172.21.15.77:6833/1004888584] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T11:23:07.365 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d{-1:24443} state up:standby seq 1 addr [v2:172.21.15.2:6836/377791267,v1:172.21.15.2:6837/377791267] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T11:23:07.365 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.l{-1:24448} state up:standby seq 1 addr [v2:172.21.15.178:6832/1723286863,v1:172.21.15.178:6833/1723286863] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T11:23:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.364+0000 7f8139200700 1 -- 172.21.15.2:0/3513845600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f81180a2ca0 msgr2=0x7f81180a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:07.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.364+0000 7f8139200700 1 --2- 172.21.15.2:0/3513845600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f81180a2ca0 0x7f81180a5160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f81340768a0 tx=0x7f8124009260 comp rx=0 tx=0).stop 2024-06-13T11:23:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.364+0000 7f8139200700 1 -- 172.21.15.2:0/3513845600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81340764c0 msgr2=0x7f813419ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.364+0000 7f8139200700 1 --2- 172.21.15.2:0/3513845600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81340764c0 0x7f813419ae10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f811c00ea50 tx=0x7f811c00ed60 comp rx=0 tx=0).stop 2024-06-13T11:23:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.364+0000 7f8139200700 1 -- 172.21.15.2:0/3513845600 shutdown_connections 2024-06-13T11:23:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.364+0000 7f8139200700 1 --2- 172.21.15.2:0/3513845600 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f81180a2ca0 0x7f81180a5160 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.364+0000 7f8139200700 1 --2- 172.21.15.2:0/3513845600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8134074ef0 0x7f813419a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.364+0000 7f8139200700 1 --2- 172.21.15.2:0/3513845600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f813410a390 0x7f81341a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.364+0000 7f8139200700 1 --2- 172.21.15.2:0/3513845600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81340764c0 0x7f813419ae10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.364+0000 7f8139200700 1 -- 172.21.15.2:0/3513845600 >> 172.21.15.2:0/3513845600 conn(0x7f81340fda60 msgr2=0x7f8134106290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.364+0000 7f8139200700 1 -- 172.21.15.2:0/3513845600 shutdown_connections 2024-06-13T11:23:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:07.365+0000 7f8139200700 1 -- 172.21.15.2:0/3513845600 wait complete. 2024-06-13T11:23:07.367 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-06-13T11:23:07.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:07 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3513845600' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-13T11:23:07.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:07 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3513845600' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-13T11:23:07.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:07 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3513845600' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-13T11:23:08.302 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- bash -c 'ceph osd dump' 2024-06-13T11:23:08.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:08 smithi002 ceph-mon[32210]: pgmap v470: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:23:08.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:08 smithi178 ceph-mon[36913]: pgmap v470: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:23:08.775 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:23:08.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:08 smithi077 ceph-mon[36410]: pgmap v470: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:23:10.636 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:10 smithi002 ceph-mon[32210]: pgmap v471: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:10.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:10 smithi178 ceph-mon[36913]: pgmap v471: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:10.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:10 smithi077 ceph-mon[36410]: pgmap v471: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.279+0000 7f30a1600700 1 -- 172.21.15.2:0/3828418380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c10a5c0 msgr2=0x7f309c110e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.279+0000 7f30a1600700 1 --2- 172.21.15.2:0/3828418380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c10a5c0 0x7f309c110e70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f309400b0d0 tx=0x7f309400b3e0 comp rx=0 tx=0).stop 2024-06-13T11:23:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.279+0000 7f30a1600700 1 -- 172.21.15.2:0/3828418380 shutdown_connections 2024-06-13T11:23:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.279+0000 7f30a1600700 1 --2- 172.21.15.2:0/3828418380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c10a5c0 0x7f309c110e70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.279+0000 7f30a1600700 1 --2- 172.21.15.2:0/3828418380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f309c108a20 0x7f309c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.279+0000 7f30a1600700 1 --2- 172.21.15.2:0/3828418380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f309c109c20 0x7f309c10a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.279+0000 7f30a1600700 1 -- 172.21.15.2:0/3828418380 >> 172.21.15.2:0/3828418380 conn(0x7f309c0779f0 msgr2=0x7f309c079e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.279+0000 7f30a1600700 1 -- 172.21.15.2:0/3828418380 shutdown_connections 2024-06-13T11:23:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.280+0000 7f30a1600700 1 -- 172.21.15.2:0/3828418380 wait complete. 2024-06-13T11:23:11.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.281+0000 7f30a1600700 1 Processor -- start 2024-06-13T11:23:11.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.281+0000 7f30a1600700 1 -- start start 2024-06-13T11:23:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.282+0000 7f30a1600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f309c108a20 0x7f309c19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.282+0000 7f30a1600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f309c109c20 0x7f309c19f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.282+0000 7f30a1600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c10a5c0 0x7f309c1a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.282+0000 7f30a1600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f309c114640 con 0x7f309c10a5c0 2024-06-13T11:23:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.282+0000 7f30a1600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f309c1144c0 con 0x7f309c109c20 2024-06-13T11:23:11.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.282+0000 7f30a1600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f309c1147c0 con 0x7f309c108a20 2024-06-13T11:23:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.282+0000 7f309be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f309c108a20 0x7f309c19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.282+0000 7f30a0c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c10a5c0 0x7f309c1a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.282+0000 7f309be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f309c108a20 0x7f309c19eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:54964/0 (socket says 172.21.15.2:54964) 2024-06-13T11:23:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.282+0000 7f309be00700 1 -- 172.21.15.2:0/966417655 learned_addr learned my addr 172.21.15.2:0/966417655 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.282+0000 7f309b400700 1 --2- 172.21.15.2:0/966417655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f309c109c20 0x7f309c19f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.283+0000 7f30a0c00700 1 -- 172.21.15.2:0/966417655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f309c108a20 msgr2=0x7f309c19eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.283+0000 7f30a0c00700 1 --2- 172.21.15.2:0/966417655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f309c108a20 0x7f309c19eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.283+0000 7f30a0c00700 1 -- 172.21.15.2:0/966417655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f309c109c20 msgr2=0x7f309c19f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.283+0000 7f30a0c00700 1 --2- 172.21.15.2:0/966417655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f309c109c20 0x7f309c19f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.283+0000 7f30a0c00700 1 -- 172.21.15.2:0/966417655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c1a67f0 con 0x7f309c10a5c0 2024-06-13T11:23:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.283+0000 7f309be00700 1 --2- 172.21.15.2:0/966417655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f309c108a20 0x7f309c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.283+0000 7f30a0c00700 1 --2- 172.21.15.2:0/966417655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c10a5c0 0x7f309c1a6150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f309400b0d0 tx=0x7f3094009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.283+0000 7f3098c00700 1 -- 172.21.15.2:0/966417655 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094021020 con 0x7f309c10a5c0 2024-06-13T11:23:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.283+0000 7f3098c00700 1 -- 172.21.15.2:0/966417655 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3094004c50 con 0x7f309c10a5c0 2024-06-13T11:23:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.283+0000 7f30a1600700 1 -- 172.21.15.2:0/966417655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f309c1a6a80 con 0x7f309c10a5c0 2024-06-13T11:23:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.283+0000 7f3098c00700 1 -- 172.21.15.2:0/966417655 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30940052b0 con 0x7f309c10a5c0 2024-06-13T11:23:11.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.283+0000 7f30a1600700 1 -- 172.21.15.2:0/966417655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f309c1a6f30 con 0x7f309c10a5c0 2024-06-13T11:23:11.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.285+0000 7f30a1600700 1 -- 172.21.15.2:0/966417655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f309c069180 con 0x7f309c10a5c0 2024-06-13T11:23:11.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.287+0000 7f3098c00700 1 -- 172.21.15.2:0/966417655 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f3094024020 con 0x7f309c10a5c0 2024-06-13T11:23:11.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.288+0000 7f3098c00700 1 --2- 172.21.15.2:0/966417655 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f30800a2ca0 0x7f30800a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:11.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.288+0000 7f3098c00700 1 -- 172.21.15.2:0/966417655 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f30940d0540 con 0x7f309c10a5c0 2024-06-13T11:23:11.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.289+0000 7f309be00700 1 --2- 172.21.15.2:0/966417655 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f30800a2ca0 0x7f30800a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:11.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.289+0000 7f309be00700 1 --2- 172.21.15.2:0/966417655 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f30800a2ca0 0x7f30800a5160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f308c005950 tx=0x7f308c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:11.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.293+0000 7f3098c00700 1 -- 172.21.15.2:0/966417655 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f309402b020 con 0x7f309c10a5c0 2024-06-13T11:23:11.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.521+0000 7f30a1600700 1 -- 172.21.15.2:0/966417655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f309c0630a0 con 0x7f309c10a5c0 2024-06-13T11:23:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.523+0000 7f3098c00700 1 -- 172.21.15.2:0/966417655 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v99) ==== 56+0+5606 (secure 0 0 0) 0x7f309409d140 con 0x7f309c10a5c0 2024-06-13T11:23:11.523 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 99 2024-06-13T11:23:11.523 INFO:teuthology.orchestra.run.smithi002.stdout:fsid 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:23:11.523 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-06-13T11:09:07.839101+0000 2024-06-13T11:23:11.523 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-06-13T11:20:27.512678+0000 2024-06-13T11:23:11.523 INFO:teuthology.orchestra.run.smithi002.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-06-13T11:23:11.523 INFO:teuthology.orchestra.run.smithi002.stdout:crush_version 27 2024-06-13T11:23:11.523 INFO:teuthology.orchestra.run.smithi002.stdout:full_ratio 0.95 2024-06-13T11:23:11.523 INFO:teuthology.orchestra.run.smithi002.stdout:backfillfull_ratio 0.9 2024-06-13T11:23:11.524 INFO:teuthology.orchestra.run.smithi002.stdout:nearfull_ratio 0.85 2024-06-13T11:23:11.524 INFO:teuthology.orchestra.run.smithi002.stdout:require_min_compat_client luminous 2024-06-13T11:23:11.524 INFO:teuthology.orchestra.run.smithi002.stdout:min_compat_client luminous 2024-06-13T11:23:11.524 INFO:teuthology.orchestra.run.smithi002.stdout:require_osd_release squid 2024-06-13T11:23:11.524 INFO:teuthology.orchestra.run.smithi002.stdout:stretch_mode_enabled false 2024-06-13T11:23:11.524 INFO:teuthology.orchestra.run.smithi002.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-06-13T11:23:11.524 INFO:teuthology.orchestra.run.smithi002.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 88 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-06-13T11:23:11.524 INFO:teuthology.orchestra.run.smithi002.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 88 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-06-13T11:23:11.524 INFO:teuthology.orchestra.run.smithi002.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 95 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-06-13T11:23:11.524 INFO:teuthology.orchestra.run.smithi002.stdout:max_osd 12 2024-06-13T11:23:11.524 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 up in weight 1 up_from 8 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6802/4127571834,v1:172.21.15.2:6803/4127571834] [v2:172.21.15.2:6804/4127571834,v1:172.21.15.2:6805/4127571834] exists,up f5614d91-49a7-4983-a309-0de3b3e6263c 2024-06-13T11:23:11.524 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 up in weight 1 up_from 13 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6800/3180360713,v1:172.21.15.77:6801/3180360713] [v2:172.21.15.77:6802/3180360713,v1:172.21.15.77:6803/3180360713] exists,up d9dbe278-309f-4726-828a-da922f486b82 2024-06-13T11:23:11.525 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 up in weight 1 up_from 18 up_thru 98 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6800/3825510575,v1:172.21.15.178:6801/3825510575] [v2:172.21.15.178:6802/3825510575,v1:172.21.15.178:6803/3825510575] exists,up 04c267dc-7454-418f-9965-3ff96ef280ce 2024-06-13T11:23:11.525 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 up in weight 1 up_from 25 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6810/1982693353,v1:172.21.15.2:6811/1982693353] [v2:172.21.15.2:6812/1982693353,v1:172.21.15.2:6813/1982693353] exists,up 3847bd4f-ca04-41de-9d88-e1523dd7ff8d 2024-06-13T11:23:11.525 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 up in weight 1 up_from 33 up_thru 98 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6808/3916694904,v1:172.21.15.77:6809/3916694904] [v2:172.21.15.77:6810/3916694904,v1:172.21.15.77:6811/3916694904] exists,up 34d7d2e8-3dee-42b9-a6cb-d4162b122b48 2024-06-13T11:23:11.525 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 up in weight 1 up_from 38 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6808/3572805887,v1:172.21.15.178:6809/3572805887] [v2:172.21.15.178:6810/3572805887,v1:172.21.15.178:6811/3572805887] exists,up 0468aefc-c3c8-4758-9bbf-1225b7a5ae79 2024-06-13T11:23:11.525 INFO:teuthology.orchestra.run.smithi002.stdout:osd.6 up in weight 1 up_from 46 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6818/1592309584,v1:172.21.15.2:6819/1592309584] [v2:172.21.15.2:6820/1592309584,v1:172.21.15.2:6821/1592309584] exists,up 0a186a4a-0e28-47bd-b5ad-9bf8079f74c7 2024-06-13T11:23:11.525 INFO:teuthology.orchestra.run.smithi002.stdout:osd.7 up in weight 1 up_from 51 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6816/1580055775,v1:172.21.15.77:6817/1580055775] [v2:172.21.15.77:6818/1580055775,v1:172.21.15.77:6819/1580055775] exists,up 646e66f7-1ef8-428d-a842-bf28c8606df2 2024-06-13T11:23:11.525 INFO:teuthology.orchestra.run.smithi002.stdout:osd.8 up in weight 1 up_from 59 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6816/4285192591,v1:172.21.15.178:6817/4285192591] [v2:172.21.15.178:6818/4285192591,v1:172.21.15.178:6819/4285192591] exists,up bcc971fc-47d7-4289-8a9a-c76996c57370 2024-06-13T11:23:11.525 INFO:teuthology.orchestra.run.smithi002.stdout:osd.9 up in weight 1 up_from 67 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6826/4187017478,v1:172.21.15.2:6827/4187017478] [v2:172.21.15.2:6828/4187017478,v1:172.21.15.2:6829/4187017478] exists,up 899d7d4f-a24c-4508-b42c-0b363275c459 2024-06-13T11:23:11.525 INFO:teuthology.orchestra.run.smithi002.stdout:osd.10 up in weight 1 up_from 72 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6824/2039538463,v1:172.21.15.77:6825/2039538463] [v2:172.21.15.77:6826/2039538463,v1:172.21.15.77:6827/2039538463] exists,up 112d2b8e-9673-4d7a-97e9-2089793fdd37 2024-06-13T11:23:11.526 INFO:teuthology.orchestra.run.smithi002.stdout:osd.11 up in weight 1 up_from 80 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6824/1915058767,v1:172.21.15.178:6825/1915058767] [v2:172.21.15.178:6826/1915058767,v1:172.21.15.178:6827/1915058767] exists,up 6b8001f5-9c74-4cc7-8c41-906cb5ac9b07 2024-06-13T11:23:11.526 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.8 [2,11] 2024-06-13T11:23:11.526 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.a [2,11,8,1] 2024-06-13T11:23:11.526 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.1 [4,9] 2024-06-13T11:23:11.526 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.e [5,9] 2024-06-13T11:23:11.526 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.14 [4,6] 2024-06-13T11:23:11.526 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.17 [4,8] 2024-06-13T11:23:11.526 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.38 [3,9,5,7] 2024-06-13T11:23:11.526 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 4.13 [9,8] 2024-06-13T11:23:11.526 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 4.18 [9,10] 2024-06-13T11:23:11.527 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 4.1a [5,8] 2024-06-13T11:23:11.527 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 4.1c [9,8] 2024-06-13T11:23:11.527 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/315567313 expires 2024-06-14T11:10:25.084617+0000 2024-06-13T11:23:11.527 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/2084201061 expires 2024-06-14T11:10:25.084617+0000 2024-06-13T11:23:11.527 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/3394644803 expires 2024-06-14T11:09:49.418694+0000 2024-06-13T11:23:11.527 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/1821969949 expires 2024-06-14T11:10:25.084617+0000 2024-06-13T11:23:11.527 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/2666864285 expires 2024-06-14T11:09:49.418694+0000 2024-06-13T11:23:11.527 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/2170469985 expires 2024-06-14T11:09:49.418694+0000 2024-06-13T11:23:11.527 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/142516651 expires 2024-06-14T11:10:25.084617+0000 2024-06-13T11:23:11.527 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/2666864285 expires 2024-06-14T11:09:49.418694+0000 2024-06-13T11:23:11.528 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/3220886565 expires 2024-06-14T11:09:49.418694+0000 2024-06-13T11:23:11.528 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/1821969949 expires 2024-06-14T11:10:25.084617+0000 2024-06-13T11:23:11.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.526+0000 7f30a1600700 1 -- 172.21.15.2:0/966417655 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f30800a2ca0 msgr2=0x7f30800a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:11.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.526+0000 7f30a1600700 1 --2- 172.21.15.2:0/966417655 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f30800a2ca0 0x7f30800a5160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f308c005950 tx=0x7f308c009260 comp rx=0 tx=0).stop 2024-06-13T11:23:11.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.526+0000 7f30a1600700 1 -- 172.21.15.2:0/966417655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c10a5c0 msgr2=0x7f309c1a6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:11.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.526+0000 7f30a1600700 1 --2- 172.21.15.2:0/966417655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c10a5c0 0x7f309c1a6150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f309400b0d0 tx=0x7f3094009810 comp rx=0 tx=0).stop 2024-06-13T11:23:11.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.526+0000 7f30a1600700 1 -- 172.21.15.2:0/966417655 shutdown_connections 2024-06-13T11:23:11.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.526+0000 7f30a1600700 1 --2- 172.21.15.2:0/966417655 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f30800a2ca0 0x7f30800a5160 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:11.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.526+0000 7f30a1600700 1 --2- 172.21.15.2:0/966417655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f309c10a5c0 0x7f309c1a6150 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:11.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.526+0000 7f30a1600700 1 --2- 172.21.15.2:0/966417655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f309c108a20 0x7f309c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:11.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.526+0000 7f30a1600700 1 --2- 172.21.15.2:0/966417655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f309c109c20 0x7f309c19f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:11.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.526+0000 7f30a1600700 1 -- 172.21.15.2:0/966417655 >> 172.21.15.2:0/966417655 conn(0x7f309c0779f0 msgr2=0x7f309c10ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:11.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.527+0000 7f30a1600700 1 -- 172.21.15.2:0/966417655 shutdown_connections 2024-06-13T11:23:11.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:11.527+0000 7f30a1600700 1 -- 172.21.15.2:0/966417655 wait complete. 2024-06-13T11:23:12.375 INFO:teuthology.run_tasks:Running task fs.ready... 2024-06-13T11:23:12.386 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:23:12.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:12 smithi002 ceph-mon[32210]: pgmap v472: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:23:12.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:12 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/966417655' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-13T11:23:12.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:12 smithi178 ceph-mon[36913]: pgmap v472: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:23:12.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:12 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/966417655' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-13T11:23:12.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:12 smithi077 ceph-mon[36410]: pgmap v472: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:23:12.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:12 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/966417655' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-13T11:23:12.878 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:23:14.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:14 smithi002 ceph-mon[32210]: pgmap v473: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:23:14.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:14 smithi178 ceph-mon[36913]: pgmap v473: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:23:14.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:14 smithi077 ceph-mon[36410]: pgmap v473: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:23:15.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.220+0000 7f9fb2c00700 1 -- 172.21.15.2:0/2281634427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fac102ea0 msgr2=0x7f9fac10f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:15.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.220+0000 7f9fb2c00700 1 --2- 172.21.15.2:0/2281634427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fac102ea0 0x7f9fac10f380 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400b0a0 tx=0x7f9fa400b3b0 comp rx=0 tx=0).stop 2024-06-13T11:23:15.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.221+0000 7f9fb2c00700 1 -- 172.21.15.2:0/2281634427 shutdown_connections 2024-06-13T11:23:15.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.221+0000 7f9fb2c00700 1 --2- 172.21.15.2:0/2281634427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fac102ea0 0x7f9fac10f380 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:15.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.221+0000 7f9fb2c00700 1 --2- 172.21.15.2:0/2281634427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fac1085f0 0x7f9fac1089d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:15.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.221+0000 7f9fb2c00700 1 --2- 172.21.15.2:0/2281634427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fac1024e0 0x7f9fac102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:15.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.221+0000 7f9fb2c00700 1 -- 172.21.15.2:0/2281634427 >> 172.21.15.2:0/2281634427 conn(0x7f9fac079640 msgr2=0x7f9fac079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:15.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.221+0000 7f9fb2c00700 1 -- 172.21.15.2:0/2281634427 shutdown_connections 2024-06-13T11:23:15.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.221+0000 7f9fb2c00700 1 -- 172.21.15.2:0/2281634427 wait complete. 2024-06-13T11:23:15.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.223+0000 7f9fb2c00700 1 Processor -- start 2024-06-13T11:23:15.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.223+0000 7f9fb2c00700 1 -- start start 2024-06-13T11:23:15.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.224+0000 7f9fb2c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fac1024e0 0x7f9fac074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:15.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.224+0000 7f9fb2c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fac102ea0 0x7f9fac074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:15.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.224+0000 7f9fb2c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fac1085f0 0x7f9fac075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:15.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.224+0000 7f9fb2c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9fac1127e0 con 0x7f9fac102ea0 2024-06-13T11:23:15.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.224+0000 7f9fb2c00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9fac112660 con 0x7f9fac1085f0 2024-06-13T11:23:15.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.224+0000 7f9fb2c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9fac112960 con 0x7f9fac1024e0 2024-06-13T11:23:15.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.224+0000 7f9fabe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fac1024e0 0x7f9fac074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:15.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.224+0000 7f9fabe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fac1024e0 0x7f9fac074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:54994/0 (socket says 172.21.15.2:54994) 2024-06-13T11:23:15.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.224+0000 7f9fabe00700 1 -- 172.21.15.2:0/22624147 learned_addr learned my addr 172.21.15.2:0/22624147 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:15.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.224+0000 7f9fb0c00700 1 --2- 172.21.15.2:0/22624147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fac1085f0 0x7f9fac075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:15.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.224+0000 7f9fab400700 1 --2- 172.21.15.2:0/22624147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fac102ea0 0x7f9fac074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:15.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.225+0000 7f9fabe00700 1 -- 172.21.15.2:0/22624147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fac1085f0 msgr2=0x7f9fac075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:15.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.225+0000 7f9fabe00700 1 --2- 172.21.15.2:0/22624147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fac1085f0 0x7f9fac075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:15.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.225+0000 7f9fabe00700 1 -- 172.21.15.2:0/22624147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fac102ea0 msgr2=0x7f9fac074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:15.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.225+0000 7f9fabe00700 1 --2- 172.21.15.2:0/22624147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fac102ea0 0x7f9fac074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:15.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.225+0000 7f9fabe00700 1 -- 172.21.15.2:0/22624147 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fac1a70d0 con 0x7f9fac1024e0 2024-06-13T11:23:15.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.225+0000 7f9fab400700 1 --2- 172.21.15.2:0/22624147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fac102ea0 0x7f9fac074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:23:15.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.225+0000 7f9fabe00700 1 --2- 172.21.15.2:0/22624147 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fac1024e0 0x7f9fac074790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00e9a0 tx=0x7f9f9c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:15.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.225+0000 7f9fa8c00700 1 -- 172.21.15.2:0/22624147 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00cbd0 con 0x7f9fac1024e0 2024-06-13T11:23:15.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.225+0000 7f9fa8c00700 1 -- 172.21.15.2:0/22624147 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f9c00cd70 con 0x7f9fac1024e0 2024-06-13T11:23:15.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.225+0000 7f9fa8c00700 1 -- 172.21.15.2:0/22624147 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c018750 con 0x7f9fac1024e0 2024-06-13T11:23:15.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.225+0000 7f9fb2c00700 1 -- 172.21.15.2:0/22624147 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fac1a73c0 con 0x7f9fac1024e0 2024-06-13T11:23:15.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.226+0000 7f9fb2c00700 1 -- 172.21.15.2:0/22624147 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fac1a7900 con 0x7f9fac1024e0 2024-06-13T11:23:15.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.227+0000 7f9fb2c00700 1 -- 172.21.15.2:0/22624147 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fac069180 con 0x7f9fac1024e0 2024-06-13T11:23:15.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.229+0000 7f9fa8c00700 1 -- 172.21.15.2:0/22624147 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f9f9c010430 con 0x7f9fac1024e0 2024-06-13T11:23:15.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.230+0000 7f9fa8c00700 1 --2- 172.21.15.2:0/22624147 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9f900a2c20 0x7f9f900a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:15.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.231+0000 7f9fa8c00700 1 -- 172.21.15.2:0/22624147 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f9f9c0cfa10 con 0x7f9fac1024e0 2024-06-13T11:23:15.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.231+0000 7f9fab400700 1 --2- 172.21.15.2:0/22624147 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9f900a2c20 0x7f9f900a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:15.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.232+0000 7f9fab400700 1 --2- 172.21.15.2:0/22624147 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9f900a2c20 0x7f9f900a50e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9fac079ad0 tx=0x7f9f98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:15.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.233+0000 7f9fa8c00700 1 -- 172.21.15.2:0/22624147 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9f9c09c580 con 0x7f9fac1024e0 2024-06-13T11:23:15.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.519+0000 7f9fb2c00700 1 -- 172.21.15.2:0/22624147 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fac02de60 con 0x7f9fac1024e0 2024-06-13T11:23:15.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.521+0000 7f9fa8c00700 1 -- 172.21.15.2:0/22624147 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11853 (secure 0 0 0) 0x7f9f9c09be80 con 0x7f9fac1024e0 2024-06-13T11:23:15.520 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:23:15.521 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:20:14.396526+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24509,24511,24493]},"id":1}]} 2024-06-13T11:23:15.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.524+0000 7f9fb2c00700 1 -- 172.21.15.2:0/22624147 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9f900a2c20 msgr2=0x7f9f900a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:15.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.524+0000 7f9fb2c00700 1 --2- 172.21.15.2:0/22624147 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9f900a2c20 0x7f9f900a50e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9fac079ad0 tx=0x7f9f98009260 comp rx=0 tx=0).stop 2024-06-13T11:23:15.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.524+0000 7f9fb2c00700 1 -- 172.21.15.2:0/22624147 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fac1024e0 msgr2=0x7f9fac074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:15.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.524+0000 7f9fb2c00700 1 --2- 172.21.15.2:0/22624147 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fac1024e0 0x7f9fac074790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00e9a0 tx=0x7f9f9c00ecb0 comp rx=0 tx=0).stop 2024-06-13T11:23:15.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.524+0000 7f9fb2c00700 1 -- 172.21.15.2:0/22624147 shutdown_connections 2024-06-13T11:23:15.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.524+0000 7f9fb2c00700 1 --2- 172.21.15.2:0/22624147 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f9f900a2c20 0x7f9f900a50e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:15.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.524+0000 7f9fb2c00700 1 --2- 172.21.15.2:0/22624147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fac1085f0 0x7f9fac075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:15.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.524+0000 7f9fb2c00700 1 --2- 172.21.15.2:0/22624147 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fac1024e0 0x7f9fac074790 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:15.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.524+0000 7f9fb2c00700 1 --2- 172.21.15.2:0/22624147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fac102ea0 0x7f9fac074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:15.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.524+0000 7f9fb2c00700 1 -- 172.21.15.2:0/22624147 >> 172.21.15.2:0/22624147 conn(0x7f9fac079640 msgr2=0x7f9fac100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:15.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.524+0000 7f9fb2c00700 1 -- 172.21.15.2:0/22624147 shutdown_connections 2024-06-13T11:23:15.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:15.525+0000 7f9fb2c00700 1 -- 172.21.15.2:0/22624147 wait complete. 2024-06-13T11:23:15.526 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-06-13T11:23:16.383 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:23:16.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:16 smithi002 ceph-mon[32210]: pgmap v474: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:16.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:16 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/22624147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:23:16.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:16 smithi077 ceph-mon[36410]: pgmap v474: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:16.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:16 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/22624147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:23:16.864 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:23:16.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:16 smithi178 ceph-mon[36913]: pgmap v474: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:16.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:16 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/22624147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:23:18.732 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:18 smithi002 ceph-mon[32210]: pgmap v475: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:23:18.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:18 smithi077 ceph-mon[36410]: pgmap v475: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:23:18.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:18 smithi178 ceph-mon[36913]: pgmap v475: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.084+0000 7fdd6c600700 1 -- 172.21.15.2:0/1191920782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd64108500 msgr2=0x7fdd641088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.084+0000 7fdd6c600700 1 --2- 172.21.15.2:0/1191920782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd64108500 0x7fdd641088e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800b0a0 tx=0x7fdd5800b3b0 comp rx=0 tx=0).stop 2024-06-13T11:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.084+0000 7fdd6c600700 1 -- 172.21.15.2:0/1191920782 shutdown_connections 2024-06-13T11:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.084+0000 7fdd6c600700 1 --2- 172.21.15.2:0/1191920782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd6406ab30 0x7fdd6410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.084+0000 7fdd6c600700 1 --2- 172.21.15.2:0/1191920782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd64108500 0x7fdd641088e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.084+0000 7fdd6c600700 1 --2- 172.21.15.2:0/1191920782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd6406a170 0x7fdd6406a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.084+0000 7fdd6c600700 1 -- 172.21.15.2:0/1191920782 >> 172.21.15.2:0/1191920782 conn(0x7fdd64078340 msgr2=0x7fdd64078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.084+0000 7fdd6c600700 1 -- 172.21.15.2:0/1191920782 shutdown_connections 2024-06-13T11:23:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.084+0000 7fdd6c600700 1 -- 172.21.15.2:0/1191920782 wait complete. 2024-06-13T11:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.085+0000 7fdd6c600700 1 Processor -- start 2024-06-13T11:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.085+0000 7fdd6c600700 1 -- start start 2024-06-13T11:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.086+0000 7fdd6c600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd6406a170 0x7fdd6419e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.086+0000 7fdd6c600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd6406ab30 0x7fdd6419ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.086+0000 7fdd6c600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd64108500 0x7fdd64198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.086+0000 7fdd6c600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdd641127d0 con 0x7fdd6406a170 2024-06-13T11:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.086+0000 7fdd6c600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd64112650 con 0x7fdd64108500 2024-06-13T11:23:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.086+0000 7fdd6c600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdd64112950 con 0x7fdd6406ab30 2024-06-13T11:23:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.086+0000 7fdd69c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd6406a170 0x7fdd6419e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.086+0000 7fdd6a600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd64108500 0x7fdd64198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.086+0000 7fdd69200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd6406ab30 0x7fdd6419ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.086+0000 7fdd69c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd6406a170 0x7fdd6419e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33134/0 (socket says 172.21.15.2:33134) 2024-06-13T11:23:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.086+0000 7fdd69c00700 1 -- 172.21.15.2:0/4204800352 learned_addr learned my addr 172.21.15.2:0/4204800352 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.086+0000 7fdd69200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd6406ab30 0x7fdd6419ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55434/0 (socket says 172.21.15.2:55434) 2024-06-13T11:23:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.086+0000 7fdd6a600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd64108500 0x7fdd64198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:43126/0 (socket says 172.21.15.2:43126) 2024-06-13T11:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.087+0000 7fdd69200700 1 -- 172.21.15.2:0/4204800352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd64108500 msgr2=0x7fdd64198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.087+0000 7fdd69200700 1 --2- 172.21.15.2:0/4204800352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd64108500 0x7fdd64198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.087+0000 7fdd69200700 1 -- 172.21.15.2:0/4204800352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd6406a170 msgr2=0x7fdd6419e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.087+0000 7fdd69200700 1 --2- 172.21.15.2:0/4204800352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd6406a170 0x7fdd6419e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.087+0000 7fdd69200700 1 -- 172.21.15.2:0/4204800352 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd64199250 con 0x7fdd6406ab30 2024-06-13T11:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.087+0000 7fdd6a600700 1 --2- 172.21.15.2:0/4204800352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd64108500 0x7fdd64198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.087+0000 7fdd69c00700 1 --2- 172.21.15.2:0/4204800352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd6406a170 0x7fdd6419e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.087+0000 7fdd69200700 1 --2- 172.21.15.2:0/4204800352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd6406ab30 0x7fdd6419ee20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000e9f0 tx=0x7fdd5000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.087+0000 7fdd62000700 1 -- 172.21.15.2:0/4204800352 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000cbd0 con 0x7fdd6406ab30 2024-06-13T11:23:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.087+0000 7fdd6c600700 1 -- 172.21.15.2:0/4204800352 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd64199540 con 0x7fdd6406ab30 2024-06-13T11:23:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.087+0000 7fdd62000700 1 -- 172.21.15.2:0/4204800352 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd5000cd70 con 0x7fdd6406ab30 2024-06-13T11:23:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.087+0000 7fdd62000700 1 -- 172.21.15.2:0/4204800352 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd50018710 con 0x7fdd6406ab30 2024-06-13T11:23:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.087+0000 7fdd6c600700 1 -- 172.21.15.2:0/4204800352 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd641a57b0 con 0x7fdd6406ab30 2024-06-13T11:23:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.089+0000 7fdd6c600700 1 -- 172.21.15.2:0/4204800352 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd6410a9e0 con 0x7fdd6406ab30 2024-06-13T11:23:19.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.091+0000 7fdd62000700 1 -- 172.21.15.2:0/4204800352 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fdd50010430 con 0x7fdd6406ab30 2024-06-13T11:23:19.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.092+0000 7fdd62000700 1 --2- 172.21.15.2:0/4204800352 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdd4c0a2c20 0x7fdd4c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:19.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.092+0000 7fdd62000700 1 -- 172.21.15.2:0/4204800352 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fdd500cf650 con 0x7fdd6406ab30 2024-06-13T11:23:19.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.092+0000 7fdd69c00700 1 --2- 172.21.15.2:0/4204800352 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdd4c0a2c20 0x7fdd4c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:19.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.093+0000 7fdd69c00700 1 --2- 172.21.15.2:0/4204800352 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdd4c0a2c20 0x7fdd4c0a50e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800b780 tx=0x7fdd58009c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:19.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.096+0000 7fdd62000700 1 -- 172.21.15.2:0/4204800352 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdd5009c1c0 con 0x7fdd6406ab30 2024-06-13T11:23:19.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.370+0000 7fdd6c600700 1 -- 172.21.15.2:0/4204800352 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd64069180 con 0x7fdd6406ab30 2024-06-13T11:23:19.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.372+0000 7fdd62000700 1 -- 172.21.15.2:0/4204800352 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11853 (secure 0 0 0) 0x7fdd5009bac0 con 0x7fdd6406ab30 2024-06-13T11:23:19.371 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:23:19.371 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:20:14.396526+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24509,24511,24493]},"id":1}]} 2024-06-13T11:23:19.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.375+0000 7fdd6c600700 1 -- 172.21.15.2:0/4204800352 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdd4c0a2c20 msgr2=0x7fdd4c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:19.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.375+0000 7fdd6c600700 1 --2- 172.21.15.2:0/4204800352 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdd4c0a2c20 0x7fdd4c0a50e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800b780 tx=0x7fdd58009c60 comp rx=0 tx=0).stop 2024-06-13T11:23:19.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.375+0000 7fdd6c600700 1 -- 172.21.15.2:0/4204800352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd6406ab30 msgr2=0x7fdd6419ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:19.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.375+0000 7fdd6c600700 1 --2- 172.21.15.2:0/4204800352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd6406ab30 0x7fdd6419ee20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000e9f0 tx=0x7fdd5000ed00 comp rx=0 tx=0).stop 2024-06-13T11:23:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.375+0000 7fdd6c600700 1 -- 172.21.15.2:0/4204800352 shutdown_connections 2024-06-13T11:23:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.375+0000 7fdd6c600700 1 --2- 172.21.15.2:0/4204800352 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fdd4c0a2c20 0x7fdd4c0a50e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.375+0000 7fdd6c600700 1 --2- 172.21.15.2:0/4204800352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd6406a170 0x7fdd6419e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.375+0000 7fdd6c600700 1 --2- 172.21.15.2:0/4204800352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd64108500 0x7fdd64198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.375+0000 7fdd6c600700 1 --2- 172.21.15.2:0/4204800352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd6406ab30 0x7fdd6419ee20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.375+0000 7fdd6c600700 1 -- 172.21.15.2:0/4204800352 >> 172.21.15.2:0/4204800352 conn(0x7fdd64078340 msgr2=0x7fdd64100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.375+0000 7fdd6c600700 1 -- 172.21.15.2:0/4204800352 shutdown_connections 2024-06-13T11:23:19.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:19.375+0000 7fdd6c600700 1 -- 172.21.15.2:0/4204800352 wait complete. 2024-06-13T11:23:19.376 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-06-13T11:23:19.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:19 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/4204800352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:23:19.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:19 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/4204800352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:23:19.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:19 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/4204800352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:23:20.208 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T11:23:20.672 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:23:20.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:20 smithi077 ceph-mon[36410]: pgmap v476: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:20.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:20 smithi002 ceph-mon[32210]: pgmap v476: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:20.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:20 smithi178 ceph-mon[36913]: pgmap v476: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:22.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:22 smithi077 ceph-mon[36410]: pgmap v477: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:23:22.812 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:22 smithi002 ceph-mon[32210]: pgmap v477: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:23:22.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:22 smithi178 ceph-mon[36913]: pgmap v477: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:23:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.991+0000 7f7659000700 1 -- 172.21.15.2:0/4177307449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76541025e0 msgr2=0x7f76541029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.991+0000 7f7659000700 1 --2- 172.21.15.2:0/4177307449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76541025e0 0x7f76541029c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7644009920 tx=0x7f7644009c30 comp rx=0 tx=0).stop 2024-06-13T11:23:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.992+0000 7f7659000700 1 -- 172.21.15.2:0/4177307449 shutdown_connections 2024-06-13T11:23:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.992+0000 7f7659000700 1 --2- 172.21.15.2:0/4177307449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76541076c0 0x7f765410f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.992+0000 7f7659000700 1 --2- 172.21.15.2:0/4177307449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76541025e0 0x7f76541029c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.992+0000 7f7659000700 1 --2- 172.21.15.2:0/4177307449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7654102f90 0x7f7654106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.992+0000 7f7659000700 1 -- 172.21.15.2:0/4177307449 >> 172.21.15.2:0/4177307449 conn(0x7f76540fdeb0 msgr2=0x7f76541002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.992+0000 7f7659000700 1 -- 172.21.15.2:0/4177307449 shutdown_connections 2024-06-13T11:23:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.992+0000 7f7659000700 1 -- 172.21.15.2:0/4177307449 wait complete. 2024-06-13T11:23:22.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.993+0000 7f7659000700 1 Processor -- start 2024-06-13T11:23:22.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.993+0000 7f7659000700 1 -- start start 2024-06-13T11:23:22.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.994+0000 7f7659000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76541025e0 0x7f7654074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:22.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.994+0000 7f7659000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7654102f90 0x7f7654074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:22.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.994+0000 7f7659000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76541076c0 0x7f7654075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:22.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.994+0000 7f7659000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f76541126f0 con 0x7f7654102f90 2024-06-13T11:23:22.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.994+0000 7f7659000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7654112570 con 0x7f76541076c0 2024-06-13T11:23:22.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.994+0000 7f7659000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7654112870 con 0x7f76541025e0 2024-06-13T11:23:22.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.994+0000 7f7653400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76541025e0 0x7f7654074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.994+0000 7f7653400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76541025e0 0x7f7654074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55450/0 (socket says 172.21.15.2:55450) 2024-06-13T11:23:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.994+0000 7f7653400700 1 -- 172.21.15.2:0/3527330734 learned_addr learned my addr 172.21.15.2:0/3527330734 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.994+0000 7f7653e00700 1 --2- 172.21.15.2:0/3527330734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76541076c0 0x7f7654075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.994+0000 7f7652a00700 1 --2- 172.21.15.2:0/3527330734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7654102f90 0x7f7654074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.995+0000 7f7653400700 1 -- 172.21.15.2:0/3527330734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76541076c0 msgr2=0x7f7654075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.995+0000 7f7653400700 1 --2- 172.21.15.2:0/3527330734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76541076c0 0x7f7654075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.995+0000 7f7653400700 1 -- 172.21.15.2:0/3527330734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7654102f90 msgr2=0x7f7654074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.995+0000 7f7653400700 1 --2- 172.21.15.2:0/3527330734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7654102f90 0x7f7654074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.995+0000 7f7653400700 1 -- 172.21.15.2:0/3527330734 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76541a7170 con 0x7f76541025e0 2024-06-13T11:23:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.995+0000 7f7653e00700 1 --2- 172.21.15.2:0/3527330734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76541076c0 0x7f7654075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.995+0000 7f7653400700 1 --2- 172.21.15.2:0/3527330734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76541025e0 0x7f7654074790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7644000c00 tx=0x7f764400fa70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.995+0000 7f764be00700 1 -- 172.21.15.2:0/3527330734 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7644027070 con 0x7f76541025e0 2024-06-13T11:23:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.995+0000 7f764be00700 1 -- 172.21.15.2:0/3527330734 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7644005660 con 0x7f76541025e0 2024-06-13T11:23:22.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.996+0000 7f7659000700 1 -- 172.21.15.2:0/3527330734 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76541a7400 con 0x7f76541025e0 2024-06-13T11:23:22.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.996+0000 7f764be00700 1 -- 172.21.15.2:0/3527330734 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7644004930 con 0x7f76541025e0 2024-06-13T11:23:22.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.996+0000 7f7659000700 1 -- 172.21.15.2:0/3527330734 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76541a7850 con 0x7f76541025e0 2024-06-13T11:23:22.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.997+0000 7f7659000700 1 -- 172.21.15.2:0/3527330734 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7654069180 con 0x7f76541025e0 2024-06-13T11:23:22.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:22.999+0000 7f764be00700 1 -- 172.21.15.2:0/3527330734 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f764402a070 con 0x7f76541025e0 2024-06-13T11:23:22.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.000+0000 7f764be00700 1 --2- 172.21.15.2:0/3527330734 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f76380a2ca0 0x7f76380a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:22.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.001+0000 7f764be00700 1 -- 172.21.15.2:0/3527330734 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f76440d01a0 con 0x7f76541025e0 2024-06-13T11:23:22.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.001+0000 7f7652a00700 1 --2- 172.21.15.2:0/3527330734 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f76380a2ca0 0x7f76380a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:23.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.001+0000 7f7652a00700 1 --2- 172.21.15.2:0/3527330734 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f76380a2ca0 0x7f76380a5160 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7640009750 tx=0x7f7640009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:23.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.003+0000 7f764be00700 1 -- 172.21.15.2:0/3527330734 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7644013030 con 0x7f76541025e0 2024-06-13T11:23:23.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.235+0000 7f7659000700 1 -- 172.21.15.2:0/3527330734 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f765402dca0 con 0x7f76541025e0 2024-06-13T11:23:23.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.237+0000 7f764be00700 1 -- 172.21.15.2:0/3527330734 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24612 (secure 0 0 0) 0x7f764409cda0 con 0x7f76541025e0 2024-06-13T11:23:23.237 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:23:23.237 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":99,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","created":"2024-06-13T11:09:07.839101+0000","modified":"2024-06-13T11:20:27.512678+0000","last_up_change":"2024-06-13T11:17:28.731479+0000","last_in_change":"2024-06-13T11:17:08.849067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:13:13.793461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:18:36.784824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:18:41.824835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:18:55.545870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f5614d91-49a7-4983-a309-0de3b3e6263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6803","nonce":4127571834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6805","nonce":4127571834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6809","nonce":4127571834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6807","nonce":4127571834}]},"public_addr":"172.21.15.2:6803/4127571834","cluster_addr":"172.21.15.2:6805/4127571834","heartbeat_back_addr":"172.21.15.2:6809/4127571834","heartbeat_front_addr":"172.21.15.2:6807/4127571834","state":["exists","up"]},{"osd":1,"uuid":"d9dbe278-309f-4726-828a-da922f486b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6801","nonce":3180360713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6803","nonce":3180360713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6807","nonce":3180360713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6805","nonce":3180360713}]},"public_addr":"172.21.15.77:6801/3180360713","cluster_addr":"172.21.15.77:6803/3180360713","heartbeat_back_addr":"172.21.15.77:6807/3180360713","heartbeat_front_addr":"172.21.15.77:6805/3180360713","state":["exists","up"]},{"osd":2,"uuid":"04c267dc-7454-418f-9965-3ff96ef280ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6801","nonce":3825510575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6803","nonce":3825510575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6807","nonce":3825510575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6805","nonce":3825510575}]},"public_addr":"172.21.15.178:6801/3825510575","cluster_addr":"172.21.15.178:6803/3825510575","heartbeat_back_addr":"172.21.15.178:6807/3825510575","heartbeat_front_addr":"172.21.15.178:6805/3825510575","state":["exists","up"]},{"osd":3,"uuid":"3847bd4f-ca04-41de-9d88-e1523dd7ff8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6811","nonce":1982693353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6813","nonce":1982693353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6817","nonce":1982693353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6815","nonce":1982693353}]},"public_addr":"172.21.15.2:6811/1982693353","cluster_addr":"172.21.15.2:6813/1982693353","heartbeat_back_addr":"172.21.15.2:6817/1982693353","heartbeat_front_addr":"172.21.15.2:6815/1982693353","state":["exists","up"]},{"osd":4,"uuid":"34d7d2e8-3dee-42b9-a6cb-d4162b122b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6809","nonce":3916694904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6811","nonce":3916694904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6815","nonce":3916694904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6813","nonce":3916694904}]},"public_addr":"172.21.15.77:6809/3916694904","cluster_addr":"172.21.15.77:6811/3916694904","heartbeat_back_addr":"172.21.15.77:6815/3916694904","heartbeat_front_addr":"172.21.15.77:6813/3916694904","state":["exists","up"]},{"osd":5,"uuid":"0468aefc-c3c8-4758-9bbf-1225b7a5ae79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6809","nonce":3572805887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6811","nonce":3572805887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6815","nonce":3572805887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6813","nonce":3572805887}]},"public_addr":"172.21.15.178:6809/3572805887","cluster_addr":"172.21.15.178:6811/3572805887","heartbeat_back_addr":"172.21.15.178:6815/3572805887","heartbeat_front_addr":"172.21.15.178:6813/3572805887","state":["exists","up"]},{"osd":6,"uuid":"0a186a4a-0e28-47bd-b5ad-9bf8079f74c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6819","nonce":1592309584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6821","nonce":1592309584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6825","nonce":1592309584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6823","nonce":1592309584}]},"public_addr":"172.21.15.2:6819/1592309584","cluster_addr":"172.21.15.2:6821/1592309584","heartbeat_back_addr":"172.21.15.2:6825/1592309584","heartbeat_front_addr":"172.21.15.2:6823/1592309584","state":["exists","up"]},{"osd":7,"uuid":"646e66f7-1ef8-428d-a842-bf28c8606df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6817","nonce":1580055775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6819","nonce":1580055775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6823","nonce":1580055775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6821","nonce":1580055775}]},"public_addr":"172.21.15.77:6817/1580055775","cluster_addr":"172.21.15.77:6819/1580055775","heartbeat_back_addr":"172.21.15.77:6823/1580055775","heartbeat_front_addr":"172.21.15.77:6821/1580055775","state":["exists","up"]},{"osd":8,"uuid":"bcc971fc-47d7-4289-8a9a-c76996c57370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6817","nonce":4285192591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6819","nonce":4285192591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6823","nonce":4285192591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6821","nonce":4285192591}]},"public_addr":"172.21.15.178:6817/4285192591","cluster_addr":"172.21.15.178:6819/4285192591","heartbeat_back_addr":"172.21.15.178:6823/4285192591","heartbeat_front_addr":"172.21.15.178:6821/4285192591","state":["exists","up"]},{"osd":9,"uuid":"899d7d4f-a24c-4508-b42c-0b363275c459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6827","nonce":4187017478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6829","nonce":4187017478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6833","nonce":4187017478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6831","nonce":4187017478}]},"public_addr":"172.21.15.2:6827/4187017478","cluster_addr":"172.21.15.2:6829/4187017478","heartbeat_back_addr":"172.21.15.2:6833/4187017478","heartbeat_front_addr":"172.21.15.2:6831/4187017478","state":["exists","up"]},{"osd":10,"uuid":"112d2b8e-9673-4d7a-97e9-2089793fdd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6825","nonce":2039538463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6827","nonce":2039538463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6831","nonce":2039538463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6829","nonce":2039538463}]},"public_addr":"172.21.15.77:6825/2039538463","cluster_addr":"172.21.15.77:6827/2039538463","heartbeat_back_addr":"172.21.15.77:6831/2039538463","heartbeat_front_addr":"172.21.15.77:6829/2039538463","state":["exists","up"]},{"osd":11,"uuid":"6b8001f5-9c74-4cc7-8c41-906cb5ac9b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6825","nonce":1915058767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6827","nonce":1915058767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6831","nonce":1915058767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6829","nonce":1915058767}]},"public_addr":"172.21.15.178:6825/1915058767","cluster_addr":"172.21.15.178:6827/1915058767","heartbeat_back_addr":"172.21.15.178:6831/1915058767","heartbeat_front_addr":"172.21.15.178:6829/1915058767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:21.707572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:46.440115+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:10.197217+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:42.853367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:08.880473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:33.605677+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:07.655377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:33.980900+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:59.397529+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:16:33.983411+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:00.932649+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:26.894098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9},{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/315567313":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/2084201061":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/3394644803":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6801/1821969949":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/2170469985":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/142516651":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6801/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/3220886565":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6800/1821969949":"2024-06-14T11:10:25.084617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:23:23.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.241+0000 7f7659000700 1 -- 172.21.15.2:0/3527330734 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f76380a2ca0 msgr2=0x7f76380a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:23.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.241+0000 7f7659000700 1 --2- 172.21.15.2:0/3527330734 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f76380a2ca0 0x7f76380a5160 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7640009750 tx=0x7f7640009310 comp rx=0 tx=0).stop 2024-06-13T11:23:23.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.241+0000 7f7659000700 1 -- 172.21.15.2:0/3527330734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76541025e0 msgr2=0x7f7654074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.241+0000 7f7659000700 1 --2- 172.21.15.2:0/3527330734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76541025e0 0x7f7654074790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7644000c00 tx=0x7f764400fa70 comp rx=0 tx=0).stop 2024-06-13T11:23:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.241+0000 7f7659000700 1 -- 172.21.15.2:0/3527330734 shutdown_connections 2024-06-13T11:23:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.241+0000 7f7659000700 1 --2- 172.21.15.2:0/3527330734 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f76380a2ca0 0x7f76380a5160 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.241+0000 7f7659000700 1 --2- 172.21.15.2:0/3527330734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76541076c0 0x7f7654075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.241+0000 7f7659000700 1 --2- 172.21.15.2:0/3527330734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76541025e0 0x7f7654074790 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.241+0000 7f7659000700 1 --2- 172.21.15.2:0/3527330734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7654102f90 0x7f7654074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.241+0000 7f7659000700 1 -- 172.21.15.2:0/3527330734 >> 172.21.15.2:0/3527330734 conn(0x7f76540fdeb0 msgr2=0x7f76540ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.241+0000 7f7659000700 1 -- 172.21.15.2:0/3527330734 shutdown_connections 2024-06-13T11:23:23.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:23.241+0000 7f7659000700 1 -- 172.21.15.2:0/3527330734 wait complete. 2024-06-13T11:23:23.635 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:23 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3527330734' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:23:23.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:23 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3527330734' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:23:23.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:23 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3527330734' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:23:24.056 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-13T11:18:45.943965+0000', 'modified': '2024-06-13T11:20:14.396526+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24511, 'mds_1': 24509, 'mds_2': 24493}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24455': {'gid': 24455, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.77:6835/4100836585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6834', 'nonce': 4100836585}, {'type': 'v1', 'addr': '172.21.15.77:6835', 'nonce': 4100836585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.77:6837/1628379389', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6836', 'nonce': 1628379389}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 1628379389}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6835/2515486418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 2515486418}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 2515486418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 32, 'addr': '172.21.15.178:6837/2179127321', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6836', 'nonce': 2179127321}, {'type': 'v1', 'addr': '172.21.15.178:6837', 'nonce': 2179127321}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24509': {'gid': 24509, 'name': 'b', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 27, 'addr': '172.21.15.77:6839/45629124', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6838', 'nonce': 45629124}, {'type': 'v1', 'addr': '172.21.15.77:6839', 'nonce': 45629124}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24511': {'gid': 24511, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.178:6839/970862278', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6838', 'nonce': 970862278}, {'type': 'v1', 'addr': '172.21.15.178:6839', 'nonce': 970862278}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24511, 'qdb_cluster': [24509, 24511, 24493]} 2024-06-13T11:23:24.057 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-06-13T11:23:24.057 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.c status 2024-06-13T11:23:24.525 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:23:24.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:24 smithi077 ceph-mon[36410]: pgmap v478: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:23:24.857 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:24 smithi002 ceph-mon[32210]: pgmap v478: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:23:24.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:24 smithi178 ceph-mon[36913]: pgmap v478: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:23:26.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:26 smithi002 ceph-mon[32210]: pgmap v479: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:26.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:26 smithi077 ceph-mon[36410]: pgmap v479: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:26.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.865+0000 7f314b000700 1 -- 172.21.15.2:0/3438279739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3144105070 msgr2=0x7f3144111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:26.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.865+0000 7f314b000700 1 --2- 172.21.15.2:0/3438279739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3144105070 0x7f3144111580 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f313c009f90 tx=0x7f313c00b330 comp rx=0 tx=0).stop 2024-06-13T11:23:26.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.865+0000 7f314b000700 1 -- 172.21.15.2:0/3438279739 shutdown_connections 2024-06-13T11:23:26.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.865+0000 7f314b000700 1 --2- 172.21.15.2:0/3438279739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3144105070 0x7f3144111580 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.865+0000 7f314b000700 1 --2- 172.21.15.2:0/3438279739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f314410a6b0 0x7f314410aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.865+0000 7f314b000700 1 --2- 172.21.15.2:0/3438279739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31441046b0 0x7f3144104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.865+0000 7f314b000700 1 -- 172.21.15.2:0/3438279739 >> 172.21.15.2:0/3438279739 conn(0x7f31441001a0 msgr2=0x7f31441025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:26.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.865+0000 7f314b000700 1 -- 172.21.15.2:0/3438279739 shutdown_connections 2024-06-13T11:23:26.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.865+0000 7f314b000700 1 -- 172.21.15.2:0/3438279739 wait complete. 2024-06-13T11:23:26.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.867+0000 7f314b000700 1 Processor -- start 2024-06-13T11:23:26.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.867+0000 7f314b000700 1 -- start start 2024-06-13T11:23:26.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.868+0000 7f314b000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31441046b0 0x7f314419ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.868+0000 7f314b000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3144105070 0x7f314419b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.868+0000 7f314b000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f314410a6b0 0x7f314419f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.868+0000 7f314b000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3144114a40 con 0x7f3144105070 2024-06-13T11:23:26.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.868+0000 7f314b000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f31441148c0 con 0x7f31441046b0 2024-06-13T11:23:26.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.868+0000 7f314b000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3144114bc0 con 0x7f314410a6b0 2024-06-13T11:23:26.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.868+0000 7f3143400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3144105070 0x7f314419b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.868+0000 7f3143e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31441046b0 0x7f314419ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.868+0000 7f3143400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3144105070 0x7f314419b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58474/0 (socket says 172.21.15.2:58474) 2024-06-13T11:23:26.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.868+0000 7f3143400700 1 -- 172.21.15.2:0/3114104316 learned_addr learned my addr 172.21.15.2:0/3114104316 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:26.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.868+0000 7f3143e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31441046b0 0x7f314419ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:42744/0 (socket says 172.21.15.2:42744) 2024-06-13T11:23:26.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.868+0000 7f3149000700 1 --2- 172.21.15.2:0/3114104316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f314410a6b0 0x7f314419f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.869+0000 7f3143e00700 1 -- 172.21.15.2:0/3114104316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f314410a6b0 msgr2=0x7f314419f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:26.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.869+0000 7f3143e00700 1 --2- 172.21.15.2:0/3114104316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f314410a6b0 0x7f314419f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.869+0000 7f3143e00700 1 -- 172.21.15.2:0/3114104316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3144105070 msgr2=0x7f314419b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:26.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.869+0000 7f3143e00700 1 --2- 172.21.15.2:0/3114104316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3144105070 0x7f314419b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.869+0000 7f3143e00700 1 -- 172.21.15.2:0/3114104316 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314419fda0 con 0x7f31441046b0 2024-06-13T11:23:26.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.869+0000 7f3143e00700 1 --2- 172.21.15.2:0/3114104316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31441046b0 0x7f314419ad90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f313400e9f0 tx=0x7f313400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:26.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.869+0000 7f3140c00700 1 -- 172.21.15.2:0/3114104316 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313400c9c0 con 0x7f31441046b0 2024-06-13T11:23:26.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.870+0000 7f314b000700 1 -- 172.21.15.2:0/3114104316 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31441a0090 con 0x7f31441046b0 2024-06-13T11:23:26.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.870+0000 7f3140c00700 1 -- 172.21.15.2:0/3114104316 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f313400cb60 con 0x7f31441046b0 2024-06-13T11:23:26.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.870+0000 7f3140c00700 1 -- 172.21.15.2:0/3114104316 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134018680 con 0x7f31441046b0 2024-06-13T11:23:26.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.870+0000 7f314b000700 1 -- 172.21.15.2:0/3114104316 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31441a7910 con 0x7f31441046b0 2024-06-13T11:23:26.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.873+0000 7f3140c00700 1 -- 172.21.15.2:0/3114104316 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f3134010430 con 0x7f31441046b0 2024-06-13T11:23:26.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.874+0000 7f3140c00700 1 --2- 172.21.15.2:0/3114104316 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f31280a2ca0 0x7f31280a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.874+0000 7f31559c9b80 1 Processor -- start 2024-06-13T11:23:26.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.874+0000 7f3140c00700 1 -- 172.21.15.2:0/3114104316 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f31340cf420 con 0x7f31441046b0 2024-06-13T11:23:26.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.875+0000 7f31559c9b80 1 -- start start 2024-06-13T11:23:26.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.875+0000 7f3143400700 1 --2- 172.21.15.2:0/3114104316 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f31280a2ca0 0x7f31280a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.875+0000 7f31559c9b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561728075df0 0x5617280f9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.875+0000 7f31559c9b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 0x5617280f99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.875+0000 7f31559c9b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617281042b0 0x5617281066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.875+0000 7f31559c9b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5617280089c0 con 0x5617280f9560 2024-06-13T11:23:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.875+0000 7f31559c9b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56172804bab0 con 0x5617281042b0 2024-06-13T11:23:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.875+0000 7f31559c9b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5617280068a0 con 0x561728075df0 2024-06-13T11:23:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.875+0000 7f3143e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561728075df0 0x5617280f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.875+0000 7f3143e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561728075df0 0x5617280f9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:46006/0 (socket says 172.21.15.2:46006) 2024-06-13T11:23:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.875+0000 7f3143e00700 1 -- 172.21.15.2:0/799805151 learned_addr learned my addr 172.21.15.2:0/799805151 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.876+0000 7f3149000700 1 --2- 172.21.15.2:0/799805151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617281042b0 0x5617281066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.876+0000 7f3143400700 1 --2- 172.21.15.2:0/799805151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 0x5617280f99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.876+0000 7f3143e00700 1 -- 172.21.15.2:0/799805151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617281042b0 msgr2=0x5617281066a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:26.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.876+0000 7f3143e00700 1 --2- 172.21.15.2:0/799805151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617281042b0 0x5617281066a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.876+0000 7f3143e00700 1 -- 172.21.15.2:0/799805151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 msgr2=0x5617280f99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:26.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.876+0000 7f3143e00700 1 --2- 172.21.15.2:0/799805151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 0x5617280f99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.876+0000 7f3143e00700 1 -- 172.21.15.2:0/799805151 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561727ff3f40 con 0x561728075df0 2024-06-13T11:23:26.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.876+0000 7f3143400700 1 --2- 172.21.15.2:0/3114104316 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f31280a2ca0 0x7f31280a5160 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3144109b00 tx=0x7f3130011720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:26.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.876+0000 7f3143e00700 1 --2- 172.21.15.2:0/799805151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561728075df0 0x5617280f9020 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3134097cf0 tx=0x7f3134097c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6da2cf95014af8c6 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:26.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.876+0000 7f3139600700 1 -- 172.21.15.2:0/799805151 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313409fc40 con 0x561728075df0 2024-06-13T11:23:26.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.877+0000 7f3139600700 1 -- 172.21.15.2:0/799805151 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31340a4500 con 0x561728075df0 2024-06-13T11:23:26.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.877+0000 7f3139600700 1 -- 172.21.15.2:0/799805151 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31340a4070 con 0x561728075df0 2024-06-13T11:23:26.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.877+0000 7f31559c9b80 1 -- 172.21.15.2:0/799805151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561728075df0 msgr2=0x5617280f9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:26.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.877+0000 7f31559c9b80 1 --2- 172.21.15.2:0/799805151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561728075df0 0x5617280f9020 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3134097cf0 tx=0x7f3134097c60 comp rx=0 tx=0).stop 2024-06-13T11:23:26.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.877+0000 7f31559c9b80 1 -- 172.21.15.2:0/799805151 shutdown_connections 2024-06-13T11:23:26.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.877+0000 7f31559c9b80 1 --2- 172.21.15.2:0/799805151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617281042b0 0x5617281066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.877+0000 7f31559c9b80 1 --2- 172.21.15.2:0/799805151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561728075df0 0x5617280f9020 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.877+0000 7f31559c9b80 1 --2- 172.21.15.2:0/799805151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 0x5617280f99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.877+0000 7f31559c9b80 1 -- 172.21.15.2:0/799805151 >> 172.21.15.2:0/799805151 conn(0x561728026120 msgr2=0x5617280f5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:26.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.878+0000 7f31559c9b80 1 -- 172.21.15.2:0/799805151 shutdown_connections 2024-06-13T11:23:26.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.878+0000 7f31559c9b80 1 -- 172.21.15.2:0/799805151 wait complete. 2024-06-13T11:23:26.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.878+0000 7f31559c9b80 1 -- start start 2024-06-13T11:23:26.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.878+0000 7f31559c9b80 1 Processor -- start 2024-06-13T11:23:26.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.879+0000 7f31559c9b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561728075df0 0x561728103a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.879+0000 7f31559c9b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 0x561728100d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.879+0000 7f31559c9b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5617281042b0 0x561728101280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.879+0000 7f31559c9b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561727fe7f10 con 0x5617280f9560 2024-06-13T11:23:26.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.879+0000 7f31559c9b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561728047a70 con 0x561728075df0 2024-06-13T11:23:26.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.879+0000 7f31559c9b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561728106f10 con 0x5617281042b0 2024-06-13T11:23:26.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.879+0000 7f31559c9b80 10 client.0 _ll_register_callbacks cb 0x561727fe56d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:23:26.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.879+0000 7f3149000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5617281042b0 0x561728101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.879+0000 7f3143e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561728075df0 0x561728103a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.879+0000 7f3149000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5617281042b0 0x561728101280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:46012/0 (socket says 172.21.15.2:46012) 2024-06-13T11:23:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.879+0000 7f3149000700 1 -- 172.21.15.2:0/3652350814 learned_addr learned my addr 172.21.15.2:0/3652350814 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.879+0000 7f3143e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561728075df0 0x561728103a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:42758/0 (socket says 172.21.15.2:42758) 2024-06-13T11:23:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.879+0000 7f3143400700 1 --2- 172.21.15.2:0/3652350814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 0x561728100d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.880+0000 7f3143e00700 1 -- 172.21.15.2:0/3652350814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5617281042b0 msgr2=0x561728101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.880+0000 7f3143e00700 1 --2- 172.21.15.2:0/3652350814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5617281042b0 0x561728101280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.880+0000 7f3143e00700 1 -- 172.21.15.2:0/3652350814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 msgr2=0x561728100d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.880+0000 7f3143e00700 1 --2- 172.21.15.2:0/3652350814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 0x561728100d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.880+0000 7f3143e00700 1 -- 172.21.15.2:0/3652350814 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561727f9a880 con 0x561728075df0 2024-06-13T11:23:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.880+0000 7f3143400700 1 --2- 172.21.15.2:0/3652350814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 0x561728100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:23:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.880+0000 7f3143e00700 1 --2- 172.21.15.2:0/3652350814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561728075df0 0x561728103a40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f313400c5b0 tx=0x7f313409b950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1387adcb1327735d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.880+0000 7f312e000700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:23:26.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.880+0000 7f312e000700 1 -- 172.21.15.2:0/3652350814 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31340b4060 con 0x561728075df0 2024-06-13T11:23:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.880+0000 7f312e000700 1 -- 172.21.15.2:0/3652350814 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f313409cbc0 con 0x561728075df0 2024-06-13T11:23:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.880+0000 7f31559c9b80 1 -- 172.21.15.2:0/3652350814 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31340a4500 con 0x561728075df0 2024-06-13T11:23:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.881+0000 7f312e000700 1 -- 172.21.15.2:0/3652350814 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f31340b6e60 con 0x561728075df0 2024-06-13T11:23:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.881+0000 7f31559c9b80 10 client.25061 fetch_fsmap learned FSMap version 26 2024-06-13T11:23:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.881+0000 7f31559c9b80 1 -- 172.21.15.2:0/3652350814 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561728111660 con 0x561728075df0 2024-06-13T11:23:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.881+0000 7f312e000700 1 -- 172.21.15.2:0/3652350814 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31340a4500 con 0x561728075df0 2024-06-13T11:23:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.881+0000 7f312e000700 1 -- 172.21.15.2:0/3652350814 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3134010720 con 0x561728075df0 2024-06-13T11:23:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.881+0000 7f31559c9b80 10 client.25061 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T11:23:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.881+0000 7f31559c9b80 10 client.25061 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-13T11:23:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.881+0000 7f31559c9b80 20 client.25061 populate_metadata read hostname 'smithi002' 2024-06-13T11:23:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.881+0000 7f31559c9b80 1 --2- 172.21.15.2:0/3652350814 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5617281137e0 0x561728114c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.881+0000 7f31559c9b80 4 client.25061 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:23:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.881+0000 7f31559c9b80 1 -- 172.21.15.2:0/3652350814 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561728058fb0 con 0x5617281137e0 2024-06-13T11:23:26.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.882+0000 7f3143400700 1 --2- 172.21.15.2:0/3652350814 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5617281137e0 0x561728114c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.882+0000 7f3143400700 1 --2- 172.21.15.2:0/3652350814 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5617281137e0 0x561728114c50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa6246f5aabc3814 server_cookie=2a65ab0e47ec4ad5 in_seq=0 out_seq=0 2024-06-13T11:23:26.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.882+0000 7f312e000700 10 client.25061 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:23:26.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.883+0000 7f312e000700 1 -- 172.21.15.2:0/3652350814 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561728058fb0 con 0x5617281137e0 2024-06-13T11:23:26.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.883+0000 7f312e000700 10 client.25061 handle_command_reply: tid=0 2024-06-13T11:23:26.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.883+0000 7f31559c9b80 1 client.25061 shutdown 2024-06-13T11:23:26.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.883+0000 7f31559c9b80 1 -- 172.21.15.2:0/3652350814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561728075df0 msgr2=0x561728103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:26.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.883+0000 7f31559c9b80 1 --2- 172.21.15.2:0/3652350814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561728075df0 0x561728103a40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f313400c5b0 tx=0x7f313409b950 comp rx=0 tx=0).stop 2024-06-13T11:23:26.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.884+0000 7f31559c9b80 1 -- 172.21.15.2:0/3652350814 shutdown_connections 2024-06-13T11:23:26.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.884+0000 7f31559c9b80 1 --2- 172.21.15.2:0/3652350814 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5617281137e0 0x561728114c50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.884+0000 7f31559c9b80 1 --2- 172.21.15.2:0/3652350814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5617281042b0 0x561728101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.884+0000 7f312e000700 0 client.25061 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:23:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.884+0000 7f31559c9b80 1 --2- 172.21.15.2:0/3652350814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561728075df0 0x561728103a40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.884+0000 7f31559c9b80 1 --2- 172.21.15.2:0/3652350814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 0x561728100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.884+0000 7f31559c9b80 1 -- 172.21.15.2:0/3652350814 >> 172.21.15.2:0/3652350814 conn(0x561728026120 msgr2=0x5617280f46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.884+0000 7f31559c9b80 1 -- 172.21.15.2:0/3652350814 shutdown_connections 2024-06-13T11:23:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.884+0000 7f31559c9b80 1 -- 172.21.15.2:0/3652350814 wait complete. 2024-06-13T11:23:26.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.884+0000 7f31559c9b80 20 client.25061 trim_cache size 0 max 16384 2024-06-13T11:23:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.908+0000 7f31559c9b80 1 Processor -- start 2024-06-13T11:23:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.908+0000 7f31559c9b80 1 -- start start 2024-06-13T11:23:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.909+0000 7f31559c9b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561728075df0 0x5617280f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.909+0000 7f31559c9b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 0x5617280ffec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.909+0000 7f31559c9b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5617281042b0 0x5617280f4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.909+0000 7f31559c9b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561728112f90 con 0x5617280f9560 2024-06-13T11:23:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.909+0000 7f31559c9b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561728113660 con 0x561728075df0 2024-06-13T11:23:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.909+0000 7f31559c9b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561728113d30 con 0x5617281042b0 2024-06-13T11:23:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.909+0000 7f3143400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 0x5617280ffec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.909+0000 7f3143400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 0x5617280ffec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58516/0 (socket says 172.21.15.2:58516) 2024-06-13T11:23:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.909+0000 7f3143400700 1 -- 172.21.15.2:0/55208916 learned_addr learned my addr 172.21.15.2:0/55208916 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.909+0000 7f3149000700 1 --2- 172.21.15.2:0/55208916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5617281042b0 0x5617280f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.909+0000 7f3143e00700 1 --2- 172.21.15.2:0/55208916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561728075df0 0x5617280f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.909+0000 7f3143400700 1 -- 172.21.15.2:0/55208916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5617281042b0 msgr2=0x5617280f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.909+0000 7f3143400700 1 --2- 172.21.15.2:0/55208916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5617281042b0 0x5617280f4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.910+0000 7f3143400700 1 -- 172.21.15.2:0/55208916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561728075df0 msgr2=0x5617280f55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:26.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.910+0000 7f3143400700 1 --2- 172.21.15.2:0/55208916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561728075df0 0x5617280f55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.910+0000 7f3143400700 1 -- 172.21.15.2:0/55208916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561728113eb0 con 0x5617280f9560 2024-06-13T11:23:26.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.910+0000 7f3143400700 1 --2- 172.21.15.2:0/55208916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 0x5617280ffec0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f313001b000 tx=0x7f313001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff18791f432a146 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:26.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.910+0000 7f3138c00700 1 -- 172.21.15.2:0/55208916 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313002f020 con 0x5617280f9560 2024-06-13T11:23:26.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.910+0000 7f3138c00700 1 -- 172.21.15.2:0/55208916 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3130019050 con 0x5617280f9560 2024-06-13T11:23:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.910+0000 7f3138c00700 1 -- 172.21.15.2:0/55208916 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3130017040 con 0x5617280f9560 2024-06-13T11:23:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.911+0000 7f31559c9b80 1 -- 172.21.15.2:0/55208916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 msgr2=0x5617280ffec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.911+0000 7f31559c9b80 1 --2- 172.21.15.2:0/55208916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 0x5617280ffec0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f313001b000 tx=0x7f313001d000 comp rx=0 tx=0).stop 2024-06-13T11:23:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.911+0000 7f31559c9b80 1 -- 172.21.15.2:0/55208916 shutdown_connections 2024-06-13T11:23:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.911+0000 7f31559c9b80 1 --2- 172.21.15.2:0/55208916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5617281042b0 0x5617280f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.911+0000 7f31559c9b80 1 --2- 172.21.15.2:0/55208916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561728075df0 0x5617280f55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.911+0000 7f31559c9b80 1 --2- 172.21.15.2:0/55208916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617280f9560 0x5617280ffec0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.911+0000 7f31559c9b80 1 -- 172.21.15.2:0/55208916 >> 172.21.15.2:0/55208916 conn(0x561728026120 msgr2=0x5617280f3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.911+0000 7f31559c9b80 1 -- 172.21.15.2:0/55208916 shutdown_connections 2024-06-13T11:23:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.911+0000 7f31559c9b80 1 -- 172.21.15.2:0/55208916 wait complete. 2024-06-13T11:23:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.912+0000 7f31559c9b80 1 -- start start 2024-06-13T11:23:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.912+0000 7f31559c9b80 1 Processor -- start 2024-06-13T11:23:26.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.912+0000 7f31559c9b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561728075df0 0x56172811e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.912+0000 7f31559c9b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617280f9560 0x561728100490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.912+0000 7f31559c9b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617281042b0 0x5617281009d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.912+0000 7f31559c9b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561728114ad0 con 0x5617281042b0 2024-06-13T11:23:26.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.912+0000 7f31559c9b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561728114400 con 0x5617280f9560 2024-06-13T11:23:26.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.912+0000 7f31559c9b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5617281151a0 con 0x561728075df0 2024-06-13T11:23:26.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.912+0000 7f31559c9b80 10 client.0 _ll_register_callbacks cb 0x561727fe56d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:23:26.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.913+0000 7f3149000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617281042b0 0x5617281009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.913+0000 7f3143400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617280f9560 0x561728100490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.913+0000 7f3149000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617281042b0 0x5617281009d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58524/0 (socket says 172.21.15.2:58524) 2024-06-13T11:23:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.913+0000 7f3149000700 1 -- 172.21.15.2:0/990499100 learned_addr learned my addr 172.21.15.2:0/990499100 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.913+0000 7f3143400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617280f9560 0x561728100490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:42768/0 (socket says 172.21.15.2:42768) 2024-06-13T11:23:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.913+0000 7f3143e00700 1 --2- 172.21.15.2:0/990499100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561728075df0 0x56172811e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.913+0000 7f3143400700 1 -- 172.21.15.2:0/990499100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561728075df0 msgr2=0x56172811e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.913+0000 7f3143400700 1 --2- 172.21.15.2:0/990499100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561728075df0 0x56172811e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.913+0000 7f3143400700 1 -- 172.21.15.2:0/990499100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617281042b0 msgr2=0x5617281009d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.913+0000 7f3143400700 1 --2- 172.21.15.2:0/990499100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617281042b0 0x5617281009d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.913+0000 7f3143400700 1 -- 172.21.15.2:0/990499100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561728101200 con 0x5617280f9560 2024-06-13T11:23:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.913+0000 7f3149000700 1 --2- 172.21.15.2:0/990499100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617281042b0 0x5617281009d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.913+0000 7f3143e00700 1 --2- 172.21.15.2:0/990499100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561728075df0 0x56172811e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:23:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.914+0000 7f3143400700 1 --2- 172.21.15.2:0/990499100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617280f9560 0x561728100490 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x5617280ff490 tx=0x7f3130005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a62435500dc210bc server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.914+0000 7f312e000700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:23:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.914+0000 7f312e000700 1 -- 172.21.15.2:0/990499100 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313003a020 con 0x5617280f9560 2024-06-13T11:23:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.914+0000 7f31559c9b80 1 -- 172.21.15.2:0/990499100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3130019050 con 0x5617280f9560 2024-06-13T11:23:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.914+0000 7f312e000700 1 -- 172.21.15.2:0/990499100 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f3130005560 con 0x5617280f9560 2024-06-13T11:23:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.914+0000 7f312e000700 1 -- 172.21.15.2:0/990499100 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3130045050 con 0x5617280f9560 2024-06-13T11:23:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.914+0000 7f31559c9b80 10 client.25067 fetch_fsmap learned FSMap version 26 2024-06-13T11:23:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.915+0000 7f31559c9b80 1 -- 172.21.15.2:0/990499100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56172817f070 con 0x5617280f9560 2024-06-13T11:23:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.915+0000 7f312e000700 1 -- 172.21.15.2:0/990499100 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3130019050 con 0x5617280f9560 2024-06-13T11:23:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.915+0000 7f312e000700 1 -- 172.21.15.2:0/990499100 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f313000fa90 con 0x5617280f9560 2024-06-13T11:23:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.915+0000 7f31559c9b80 10 client.25067 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T11:23:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.915+0000 7f31559c9b80 10 client.25067 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-13T11:23:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.915+0000 7f31559c9b80 20 client.25067 populate_metadata read hostname 'smithi002' 2024-06-13T11:23:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.915+0000 7f31559c9b80 1 --2- 172.21.15.2:0/990499100 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x561728183870 0x561728182580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.915+0000 7f31559c9b80 4 client.25067 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T11:23:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.915+0000 7f31559c9b80 1 -- 172.21.15.2:0/990499100 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "status"}) -- 0x561728053530 con 0x561728183870 2024-06-13T11:23:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.916+0000 7f3143e00700 1 --2- 172.21.15.2:0/990499100 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x561728183870 0x561728182580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.916+0000 7f312e000700 10 client.25067 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:23:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.916+0000 7f3143e00700 1 --2- 172.21.15.2:0/990499100 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x561728183870 0x561728182580 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=250acbbd3b6144ed server_cookie=c6de2a972c06f120 in_seq=0 out_seq=0 2024-06-13T11:23:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.917+0000 7f312e000700 1 -- 172.21.15.2:0/990499100 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x561728053530 con 0x561728183870 2024-06-13T11:23:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.917+0000 7f312e000700 10 client.25067 handle_command_reply: tid=0 2024-06-13T11:23:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.917+0000 7f31559c9b80 1 client.25067 shutdown 2024-06-13T11:23:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.917+0000 7f31559c9b80 1 -- 172.21.15.2:0/990499100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617280f9560 msgr2=0x561728100490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.917+0000 7f31559c9b80 1 --2- 172.21.15.2:0/990499100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617280f9560 0x561728100490 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x5617280ff490 tx=0x7f3130005040 comp rx=0 tx=0).stop 2024-06-13T11:23:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.917+0000 7f31559c9b80 1 -- 172.21.15.2:0/990499100 shutdown_connections 2024-06-13T11:23:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.917+0000 7f31559c9b80 1 --2- 172.21.15.2:0/990499100 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x561728183870 0x561728182580 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.917+0000 7f31559c9b80 1 --2- 172.21.15.2:0/990499100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5617281042b0 0x5617281009d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.917+0000 7f31559c9b80 1 --2- 172.21.15.2:0/990499100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561728075df0 0x56172811e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.917+0000 7f312e000700 0 client.25067 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:23:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.917+0000 7f31559c9b80 1 --2- 172.21.15.2:0/990499100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617280f9560 0x561728100490 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.917+0000 7f31559c9b80 1 -- 172.21.15.2:0/990499100 >> 172.21.15.2:0/990499100 conn(0x561728026120 msgr2=0x56172810f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.917+0000 7f31559c9b80 1 -- 172.21.15.2:0/990499100 shutdown_connections 2024-06-13T11:23:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.917+0000 7f31559c9b80 1 -- 172.21.15.2:0/990499100 wait complete. 2024-06-13T11:23:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.917+0000 7f31559c9b80 20 client.25067 trim_cache size 0 max 16384 2024-06-13T11:23:26.920 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:23:26.921 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "3611563c-2975-11ef-bc9c-c7b262605968", 2024-06-13T11:23:26.921 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 2, 2024-06-13T11:23:26.921 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24493, 2024-06-13T11:23:26.921 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-06-13T11:23:26.921 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-06-13T11:23:26.921 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-06-13T11:23:26.921 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 199.52229858699999, 2024-06-13T11:23:26.921 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 26, 2024-06-13T11:23:26.921 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 99, 2024-06-13T11:23:26.922 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 97, 2024-06-13T11:23:26.922 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 321.46307597499998 2024-06-13T11:23:26.922 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:23:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.918+0000 7f314b000700 1 -- 172.21.15.2:0/3114104316 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f31280a2ca0 msgr2=0x7f31280a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.918+0000 7f314b000700 1 --2- 172.21.15.2:0/3114104316 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f31280a2ca0 0x7f31280a5160 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3144109b00 tx=0x7f3130011720 comp rx=0 tx=0).stop 2024-06-13T11:23:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.918+0000 7f314b000700 1 -- 172.21.15.2:0/3114104316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31441046b0 msgr2=0x7f314419ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.918+0000 7f314b000700 1 --2- 172.21.15.2:0/3114104316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31441046b0 0x7f314419ad90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f313400e9f0 tx=0x7f313400ed00 comp rx=0 tx=0).stop 2024-06-13T11:23:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.918+0000 7f314b000700 1 -- 172.21.15.2:0/3114104316 shutdown_connections 2024-06-13T11:23:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.918+0000 7f314b000700 1 --2- 172.21.15.2:0/3114104316 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f31280a2ca0 0x7f31280a5160 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.918+0000 7f314b000700 1 --2- 172.21.15.2:0/3114104316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f314410a6b0 0x7f314419f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.918+0000 7f314b000700 1 --2- 172.21.15.2:0/3114104316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31441046b0 0x7f314419ad90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.918+0000 7f314b000700 1 --2- 172.21.15.2:0/3114104316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3144105070 0x7f314419b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.918+0000 7f314b000700 1 -- 172.21.15.2:0/3114104316 >> 172.21.15.2:0/3114104316 conn(0x7f31441001a0 msgr2=0x7f3144100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:26.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.918+0000 7f314b000700 1 -- 172.21.15.2:0/3114104316 shutdown_connections 2024-06-13T11:23:26.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:26.919+0000 7f314b000700 1 -- 172.21.15.2:0/3114104316 wait complete. 2024-06-13T11:23:26.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:26 smithi178 ceph-mon[36913]: pgmap v479: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:27.826 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.b status 2024-06-13T11:23:28.294 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:23:28.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:28 smithi002 ceph-mon[32210]: pgmap v480: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:23:28.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:28 smithi077 ceph-mon[36410]: pgmap v480: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:23:28.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:28 smithi178 ceph-mon[36913]: pgmap v480: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:23:30.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.557+0000 7f7609000700 1 -- 172.21.15.2:0/2568200303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f760410eac0 msgr2=0x7f760410eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:30.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.557+0000 7f7609000700 1 --2- 172.21.15.2:0/2568200303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f760410eac0 0x7f760410eea0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f75f4009990 tx=0x7f75f4009ca0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.558+0000 7f7609000700 1 -- 172.21.15.2:0/2568200303 shutdown_connections 2024-06-13T11:23:30.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.558+0000 7f7609000700 1 --2- 172.21.15.2:0/2568200303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f760410eac0 0x7f760410eea0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.558+0000 7f7609000700 1 --2- 172.21.15.2:0/2568200303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7604109480 0x7f7604115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.558+0000 7f7609000700 1 --2- 172.21.15.2:0/2568200303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7604108ac0 0x7f7604108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.558+0000 7f7609000700 1 -- 172.21.15.2:0/2568200303 >> 172.21.15.2:0/2568200303 conn(0x7f7604075c60 msgr2=0x7f76041072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:30.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.558+0000 7f7609000700 1 -- 172.21.15.2:0/2568200303 shutdown_connections 2024-06-13T11:23:30.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.558+0000 7f7609000700 1 -- 172.21.15.2:0/2568200303 wait complete. 2024-06-13T11:23:30.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.559+0000 7f7609000700 1 Processor -- start 2024-06-13T11:23:30.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.560+0000 7f7609000700 1 -- start start 2024-06-13T11:23:30.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.560+0000 7f7609000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7604108ac0 0x7f760419f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.560+0000 7f7609000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7604109480 0x7f760419f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.560+0000 7f7609000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f760410eac0 0x7f76041a3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.560+0000 7f7609000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7604118df0 con 0x7f7604109480 2024-06-13T11:23:30.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.560+0000 7f7609000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7604118c70 con 0x7f760410eac0 2024-06-13T11:23:30.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.560+0000 7f7609000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7604118f70 con 0x7f7604108ac0 2024-06-13T11:23:30.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.560+0000 7f7601400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7604109480 0x7f760419f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.561+0000 7f7601e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7604108ac0 0x7f760419f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.561+0000 7f7601e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7604108ac0 0x7f760419f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:46054/0 (socket says 172.21.15.2:46054) 2024-06-13T11:23:30.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.561+0000 7f7601e00700 1 -- 172.21.15.2:0/735369469 learned_addr learned my addr 172.21.15.2:0/735369469 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:30.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.561+0000 7f7601400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7604109480 0x7f760419f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58552/0 (socket says 172.21.15.2:58552) 2024-06-13T11:23:30.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.561+0000 7f7602800700 1 --2- 172.21.15.2:0/735369469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f760410eac0 0x7f76041a3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.561+0000 7f7601e00700 1 -- 172.21.15.2:0/735369469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f760410eac0 msgr2=0x7f76041a3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:30.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.561+0000 7f7601e00700 1 --2- 172.21.15.2:0/735369469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f760410eac0 0x7f76041a3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.561+0000 7f7601e00700 1 -- 172.21.15.2:0/735369469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7604109480 msgr2=0x7f760419f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:30.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.561+0000 7f7601e00700 1 --2- 172.21.15.2:0/735369469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7604109480 0x7f760419f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.561+0000 7f7601e00700 1 -- 172.21.15.2:0/735369469 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76041a4210 con 0x7f7604108ac0 2024-06-13T11:23:30.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.561+0000 7f7602800700 1 --2- 172.21.15.2:0/735369469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f760410eac0 0x7f76041a3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:30.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.562+0000 7f7601e00700 1 --2- 172.21.15.2:0/735369469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7604108ac0 0x7f760419f200 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f75f4000c00 tx=0x7f75f400bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:30.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.562+0000 7f75faa00700 1 -- 172.21.15.2:0/735369469 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4027070 con 0x7f7604108ac0 2024-06-13T11:23:30.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.562+0000 7f7609000700 1 -- 172.21.15.2:0/735369469 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76041a44a0 con 0x7f7604108ac0 2024-06-13T11:23:30.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.562+0000 7f75faa00700 1 -- 172.21.15.2:0/735369469 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75f4003d70 con 0x7f7604108ac0 2024-06-13T11:23:30.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.562+0000 7f75faa00700 1 -- 172.21.15.2:0/735369469 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f400f460 con 0x7f7604108ac0 2024-06-13T11:23:30.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.562+0000 7f7609000700 1 -- 172.21.15.2:0/735369469 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76041abd80 con 0x7f7604108ac0 2024-06-13T11:23:30.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.565+0000 7f75faa00700 1 -- 172.21.15.2:0/735369469 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f75f402a070 con 0x7f7604108ac0 2024-06-13T11:23:30.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.567+0000 7f7613a2bb80 1 Processor -- start 2024-06-13T11:23:30.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.568+0000 7f7613a2bb80 1 -- start start 2024-06-13T11:23:30.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.568+0000 7f75faa00700 1 --2- 172.21.15.2:0/735369469 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f75e80a2ca0 0x7f75e80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.568+0000 7f7613a2bb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab21a8df0 0x563ab222c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.568+0000 7f7613a2bb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab222c560 0x563ab222c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.568+0000 7f7613a2bb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab22372b0 0x563ab22396a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.568+0000 7f7613a2bb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563ab213b9c0 con 0x563ab21a8df0 2024-06-13T11:23:30.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.568+0000 7f7613a2bb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563ab217eab0 con 0x563ab222c560 2024-06-13T11:23:30.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.568+0000 7f7613a2bb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563ab21398a0 con 0x563ab22372b0 2024-06-13T11:23:30.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.568+0000 7f75faa00700 1 -- 172.21.15.2:0/735369469 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f75f40d0150 con 0x7f7604108ac0 2024-06-13T11:23:30.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.568+0000 7f7602800700 1 --2- 172.21.15.2:0/735369469 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f75e80a2ca0 0x7f75e80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.568+0000 7f7601e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab21a8df0 0x563ab222c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.569+0000 7f7602800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab22372b0 0x563ab22396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.569+0000 7f7601e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab21a8df0 0x563ab222c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58554/0 (socket says 172.21.15.2:58554) 2024-06-13T11:23:30.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.569+0000 7f7601e00700 1 -- 172.21.15.2:0/2293453266 learned_addr learned my addr 172.21.15.2:0/2293453266 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:30.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.569+0000 7f7601400700 1 --2- 172.21.15.2:0/2293453266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab222c560 0x563ab222c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.569+0000 7f7601e00700 1 -- 172.21.15.2:0/2293453266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab22372b0 msgr2=0x563ab22396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.569+0000 7f7601e00700 1 --2- 172.21.15.2:0/2293453266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab22372b0 0x563ab22396a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.569+0000 7f7601e00700 1 -- 172.21.15.2:0/2293453266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab222c560 msgr2=0x563ab222c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.569+0000 7f7601e00700 1 --2- 172.21.15.2:0/2293453266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab222c560 0x563ab222c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.569+0000 7f7601e00700 1 -- 172.21.15.2:0/2293453266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ab2126f40 con 0x563ab21a8df0 2024-06-13T11:23:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.569+0000 7f7602800700 1 --2- 172.21.15.2:0/735369469 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f75e80a2ca0 0x7f75e80a5160 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009fd0 tx=0x7f75fc003cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.569+0000 7f7601e00700 1 --2- 172.21.15.2:0/2293453266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab21a8df0 0x563ab222c020 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f75f4098ab0 tx=0x7f75f4009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e425e34dd648190f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.570+0000 7f75f3400700 1 -- 172.21.15.2:0/2293453266 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f409c420 con 0x563ab21a8df0 2024-06-13T11:23:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.570+0000 7f75f3400700 1 -- 172.21.15.2:0/2293453266 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75f40043d0 con 0x563ab21a8df0 2024-06-13T11:23:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.570+0000 7f75f3400700 1 -- 172.21.15.2:0/2293453266 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f409bfb0 con 0x563ab21a8df0 2024-06-13T11:23:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.571+0000 7f7613a2bb80 1 -- 172.21.15.2:0/2293453266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab21a8df0 msgr2=0x563ab222c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.571+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/2293453266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab21a8df0 0x563ab222c020 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f75f4098ab0 tx=0x7f75f4009ca0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.571+0000 7f7613a2bb80 1 -- 172.21.15.2:0/2293453266 shutdown_connections 2024-06-13T11:23:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.571+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/2293453266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab21a8df0 0x563ab222c020 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.571+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/2293453266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab22372b0 0x563ab22396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.571+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/2293453266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab222c560 0x563ab222c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.571+0000 7f7613a2bb80 1 -- 172.21.15.2:0/2293453266 >> 172.21.15.2:0/2293453266 conn(0x563ab2159120 msgr2=0x563ab2228460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.571+0000 7f7613a2bb80 1 -- 172.21.15.2:0/2293453266 shutdown_connections 2024-06-13T11:23:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.571+0000 7f7613a2bb80 1 -- 172.21.15.2:0/2293453266 wait complete. 2024-06-13T11:23:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.571+0000 7f7613a2bb80 1 -- start start 2024-06-13T11:23:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.572+0000 7f7613a2bb80 1 Processor -- start 2024-06-13T11:23:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.572+0000 7f7613a2bb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab21a8df0 0x563ab22369f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.572+0000 7f7613a2bb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab222c560 0x563ab2233cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.572+0000 7f7613a2bb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab22372b0 0x563ab2234230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.572+0000 7f7613a2bb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563ab211af10 con 0x563ab222c560 2024-06-13T11:23:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.572+0000 7f7613a2bb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563ab217aa70 con 0x563ab21a8df0 2024-06-13T11:23:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.572+0000 7f7613a2bb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563ab2239d20 con 0x563ab22372b0 2024-06-13T11:23:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.572+0000 7f7613a2bb80 10 client.0 _ll_register_callbacks cb 0x563ab21186d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:23:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.573+0000 7f7601400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab222c560 0x563ab2233cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.573+0000 7f7601e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab21a8df0 0x563ab22369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.573+0000 7f7601400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab222c560 0x563ab2233cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58568/0 (socket says 172.21.15.2:58568) 2024-06-13T11:23:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.573+0000 7f7601400700 1 -- 172.21.15.2:0/1039318961 learned_addr learned my addr 172.21.15.2:0/1039318961 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.573+0000 7f7602800700 1 --2- 172.21.15.2:0/1039318961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab22372b0 0x563ab2234230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.573+0000 7f7601e00700 1 -- 172.21.15.2:0/1039318961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab22372b0 msgr2=0x563ab2234230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.573+0000 7f7601e00700 1 --2- 172.21.15.2:0/1039318961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab22372b0 0x563ab2234230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.573+0000 7f7601e00700 1 -- 172.21.15.2:0/1039318961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab222c560 msgr2=0x563ab2233cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.573+0000 7f7601e00700 1 --2- 172.21.15.2:0/1039318961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab222c560 0x563ab2233cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.573+0000 7f7601e00700 1 -- 172.21.15.2:0/1039318961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ab20cd880 con 0x563ab21a8df0 2024-06-13T11:23:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.574+0000 7f7601e00700 1 --2- 172.21.15.2:0/1039318961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab21a8df0 0x563ab22369f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f75f4022590 tx=0x7f75f4098a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8b629a8bbfca293 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.574+0000 7f75e7e00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:23:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.574+0000 7f75e7e00700 1 -- 172.21.15.2:0/1039318961 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f409c190 con 0x563ab21a8df0 2024-06-13T11:23:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.574+0000 7f75e7e00700 1 -- 172.21.15.2:0/1039318961 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f75f4085be0 con 0x563ab21a8df0 2024-06-13T11:23:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.574+0000 7f7613a2bb80 1 -- 172.21.15.2:0/1039318961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75f40043d0 con 0x563ab21a8df0 2024-06-13T11:23:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.574+0000 7f75e7e00700 1 -- 172.21.15.2:0/1039318961 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f75f409c420 con 0x563ab21a8df0 2024-06-13T11:23:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.574+0000 7f7613a2bb80 10 client.25079 fetch_fsmap learned FSMap version 26 2024-06-13T11:23:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.574+0000 7f7613a2bb80 1 -- 172.21.15.2:0/1039318961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563ab2244390 con 0x563ab21a8df0 2024-06-13T11:23:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.574+0000 7f75e7e00700 1 -- 172.21.15.2:0/1039318961 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75f40043d0 con 0x563ab21a8df0 2024-06-13T11:23:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.575+0000 7f75e7e00700 1 -- 172.21.15.2:0/1039318961 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f75f40a4da0 con 0x563ab21a8df0 2024-06-13T11:23:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.575+0000 7f7613a2bb80 10 client.25079 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T11:23:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.575+0000 7f7613a2bb80 10 client.25079 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-13T11:23:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.575+0000 7f7613a2bb80 20 client.25079 populate_metadata read hostname 'smithi002' 2024-06-13T11:23:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.575+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/1039318961 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x563ab22467a0 0x563ab2247c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.575+0000 7f7613a2bb80 4 client.25079 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:23:30.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.575+0000 7f7613a2bb80 1 -- 172.21.15.2:0/1039318961 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ab218bfb0 con 0x563ab22467a0 2024-06-13T11:23:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.575+0000 7f7601400700 1 --2- 172.21.15.2:0/1039318961 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x563ab22467a0 0x563ab2247c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.576+0000 7f7601400700 1 --2- 172.21.15.2:0/1039318961 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x563ab22467a0 0x563ab2247c10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aa4debc89a307d56 server_cookie=360b4902e5a05e9a in_seq=0 out_seq=0 2024-06-13T11:23:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.576+0000 7f75e7e00700 10 client.25079 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:23:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.577+0000 7f75e7e00700 1 -- 172.21.15.2:0/1039318961 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563ab218bfb0 con 0x563ab22467a0 2024-06-13T11:23:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.577+0000 7f75e7e00700 10 client.25079 handle_command_reply: tid=0 2024-06-13T11:23:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.577+0000 7f7613a2bb80 1 client.25079 shutdown 2024-06-13T11:23:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.577+0000 7f7613a2bb80 1 -- 172.21.15.2:0/1039318961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab21a8df0 msgr2=0x563ab22369f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.577+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/1039318961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab21a8df0 0x563ab22369f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f75f4022590 tx=0x7f75f4098a20 comp rx=0 tx=0).stop 2024-06-13T11:23:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.577+0000 7f7613a2bb80 1 -- 172.21.15.2:0/1039318961 shutdown_connections 2024-06-13T11:23:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.577+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/1039318961 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x563ab22467a0 0x563ab2247c10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.577+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/1039318961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab22372b0 0x563ab2234230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.577+0000 7f75e7e00700 0 client.25079 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:23:30.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.577+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/1039318961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab21a8df0 0x563ab22369f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.577+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/1039318961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab222c560 0x563ab2233cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.577+0000 7f7613a2bb80 1 -- 172.21.15.2:0/1039318961 >> 172.21.15.2:0/1039318961 conn(0x563ab2159120 msgr2=0x563ab22276f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:30.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.577+0000 7f7613a2bb80 1 -- 172.21.15.2:0/1039318961 shutdown_connections 2024-06-13T11:23:30.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.577+0000 7f7613a2bb80 1 -- 172.21.15.2:0/1039318961 wait complete. 2024-06-13T11:23:30.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.577+0000 7f7613a2bb80 20 client.25079 trim_cache size 0 max 16384 2024-06-13T11:23:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.601+0000 7f7613a2bb80 1 Processor -- start 2024-06-13T11:23:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.601+0000 7f7613a2bb80 1 -- start start 2024-06-13T11:23:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.601+0000 7f7613a2bb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab21a8df0 0x563ab22386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.601+0000 7f7613a2bb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab222c560 0x563ab2238be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.601+0000 7f7613a2bb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab22372b0 0x563ab2242680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.601+0000 7f7613a2bb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563ab2245f50 con 0x563ab21a8df0 2024-06-13T11:23:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.601+0000 7f7613a2bb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563ab2246620 con 0x563ab22372b0 2024-06-13T11:23:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.601+0000 7f7613a2bb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563ab2246cf0 con 0x563ab222c560 2024-06-13T11:23:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.602+0000 7f7601e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab21a8df0 0x563ab22386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.602+0000 7f7601e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab21a8df0 0x563ab22386a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58578/0 (socket says 172.21.15.2:58578) 2024-06-13T11:23:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.602+0000 7f7601e00700 1 -- 172.21.15.2:0/1217500798 learned_addr learned my addr 172.21.15.2:0/1217500798 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.602+0000 7f7601400700 1 --2- 172.21.15.2:0/1217500798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab222c560 0x563ab2238be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.602+0000 7f7602800700 1 --2- 172.21.15.2:0/1217500798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab22372b0 0x563ab2242680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.602+0000 7f7601e00700 1 -- 172.21.15.2:0/1217500798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab222c560 msgr2=0x563ab2238be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.602+0000 7f7601e00700 1 --2- 172.21.15.2:0/1217500798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab222c560 0x563ab2238be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.602+0000 7f7601e00700 1 -- 172.21.15.2:0/1217500798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab22372b0 msgr2=0x563ab2242680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.602+0000 7f7601e00700 1 --2- 172.21.15.2:0/1217500798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab22372b0 0x563ab2242680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.602+0000 7f7601e00700 1 -- 172.21.15.2:0/1217500798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ab221fdc0 con 0x563ab21a8df0 2024-06-13T11:23:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.602+0000 7f7601400700 1 --2- 172.21.15.2:0/1217500798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab222c560 0x563ab2238be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.603+0000 7f7601e00700 1 --2- 172.21.15.2:0/1217500798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab21a8df0 0x563ab22386a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f75f409ccb0 tx=0x7f75f4009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd1e73f6804b3df server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.603+0000 7f75f2a00700 1 -- 172.21.15.2:0/1217500798 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f409bfb0 con 0x563ab21a8df0 2024-06-13T11:23:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.603+0000 7f75f2a00700 1 -- 172.21.15.2:0/1217500798 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75f40095d0 con 0x563ab21a8df0 2024-06-13T11:23:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.603+0000 7f75f2a00700 1 -- 172.21.15.2:0/1217500798 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f40a1b90 con 0x563ab21a8df0 2024-06-13T11:23:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.604+0000 7f7613a2bb80 1 -- 172.21.15.2:0/1217500798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab21a8df0 msgr2=0x563ab22386a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.604+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/1217500798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab21a8df0 0x563ab22386a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f75f409ccb0 tx=0x7f75f4009ca0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.604+0000 7f7613a2bb80 1 -- 172.21.15.2:0/1217500798 shutdown_connections 2024-06-13T11:23:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.604+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/1217500798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab21a8df0 0x563ab22386a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.604+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/1217500798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab22372b0 0x563ab2242680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.604+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/1217500798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab222c560 0x563ab2238be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.604+0000 7f7613a2bb80 1 -- 172.21.15.2:0/1217500798 >> 172.21.15.2:0/1217500798 conn(0x563ab2159120 msgr2=0x563ab2241f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.604+0000 7f7613a2bb80 1 -- 172.21.15.2:0/1217500798 shutdown_connections 2024-06-13T11:23:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.604+0000 7f7613a2bb80 1 -- 172.21.15.2:0/1217500798 wait complete. 2024-06-13T11:23:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.604+0000 7f7613a2bb80 1 -- start start 2024-06-13T11:23:30.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.605+0000 7f7613a2bb80 1 Processor -- start 2024-06-13T11:23:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.605+0000 7f7613a2bb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab21a8df0 0x563ab2251760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.605+0000 7f7613a2bb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab222c560 0x563ab2227590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.605+0000 7f7613a2bb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab22372b0 0x563ab2227ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.605+0000 7f7613a2bb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563ab2247a90 con 0x563ab22372b0 2024-06-13T11:23:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.605+0000 7f7613a2bb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563ab22473c0 con 0x563ab222c560 2024-06-13T11:23:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.605+0000 7f7613a2bb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563ab2248160 con 0x563ab21a8df0 2024-06-13T11:23:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.605+0000 7f7613a2bb80 10 client.0 _ll_register_callbacks cb 0x563ab21186d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:23:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.606+0000 7f7602800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab22372b0 0x563ab2227ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.606+0000 7f7601400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab222c560 0x563ab2227590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.606+0000 7f7602800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab22372b0 0x563ab2227ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58588/0 (socket says 172.21.15.2:58588) 2024-06-13T11:23:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.606+0000 7f7601e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab21a8df0 0x563ab2251760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.606+0000 7f7601400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab222c560 0x563ab2227590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:42810/0 (socket says 172.21.15.2:42810) 2024-06-13T11:23:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.606+0000 7f7602800700 1 -- 172.21.15.2:0/2554317650 learned_addr learned my addr 172.21.15.2:0/2554317650 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.606+0000 7f7601400700 1 -- 172.21.15.2:0/2554317650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab21a8df0 msgr2=0x563ab2251760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.606+0000 7f7601400700 1 --2- 172.21.15.2:0/2554317650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab21a8df0 0x563ab2251760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.606+0000 7f7601400700 1 -- 172.21.15.2:0/2554317650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab22372b0 msgr2=0x563ab2227ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.606+0000 7f7601400700 1 --2- 172.21.15.2:0/2554317650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab22372b0 0x563ab2227ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.606+0000 7f7601400700 1 -- 172.21.15.2:0/2554317650 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ab2228340 con 0x563ab222c560 2024-06-13T11:23:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.606+0000 7f7601e00700 1 --2- 172.21.15.2:0/2554317650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab21a8df0 0x563ab2251760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.606+0000 7f7601400700 1 --2- 172.21.15.2:0/2554317650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab222c560 0x563ab2227590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x563ab22485d0 tx=0x7f75ec0044a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cba8521580ac1c1b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.606+0000 7f75e7e00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:23:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.607+0000 7f75e7e00700 1 -- 172.21.15.2:0/2554317650 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec003df0 con 0x563ab222c560 2024-06-13T11:23:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.607+0000 7f7613a2bb80 1 -- 172.21.15.2:0/2554317650 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75f40095d0 con 0x563ab222c560 2024-06-13T11:23:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.607+0000 7f75e7e00700 1 -- 172.21.15.2:0/2554317650 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f75ec010430 con 0x563ab222c560 2024-06-13T11:23:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.607+0000 7f75e7e00700 1 -- 172.21.15.2:0/2554317650 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f75ec02e050 con 0x563ab222c560 2024-06-13T11:23:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.607+0000 7f7613a2bb80 10 client.25085 fetch_fsmap learned FSMap version 26 2024-06-13T11:23:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.607+0000 7f7613a2bb80 1 -- 172.21.15.2:0/2554317650 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563ab22b2090 con 0x563ab222c560 2024-06-13T11:23:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.607+0000 7f75e7e00700 1 -- 172.21.15.2:0/2554317650 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75f40095d0 con 0x563ab222c560 2024-06-13T11:23:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.608+0000 7f75e7e00700 1 -- 172.21.15.2:0/2554317650 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f75ec025070 con 0x563ab222c560 2024-06-13T11:23:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.608+0000 7f7613a2bb80 10 client.25085 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T11:23:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.608+0000 7f7613a2bb80 10 client.25085 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-13T11:23:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.608+0000 7f7613a2bb80 20 client.25085 populate_metadata read hostname 'smithi002' 2024-06-13T11:23:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.608+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/2554317650 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x563ab22b6b50 0x563ab22b5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.608+0000 7f7613a2bb80 4 client.25085 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T11:23:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.608+0000 7f7613a2bb80 1 -- 172.21.15.2:0/2554317650 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "status"}) -- 0x563ab2186530 con 0x563ab22b6b50 2024-06-13T11:23:30.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.608+0000 7f7601e00700 1 --2- 172.21.15.2:0/2554317650 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x563ab22b6b50 0x563ab22b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:30.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.609+0000 7f7601e00700 1 --2- 172.21.15.2:0/2554317650 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x563ab22b6b50 0x563ab22b5860 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e98b3d25c28d9f08 server_cookie=297bec9de7e7ed86 in_seq=0 out_seq=0 2024-06-13T11:23:30.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.609+0000 7f75e7e00700 10 client.25085 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:23:30.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.609+0000 7f75e7e00700 1 -- 172.21.15.2:0/2554317650 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x563ab2186530 con 0x563ab22b6b50 2024-06-13T11:23:30.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.609+0000 7f75e7e00700 10 client.25085 handle_command_reply: tid=0 2024-06-13T11:23:30.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.609+0000 7f7613a2bb80 1 client.25085 shutdown 2024-06-13T11:23:30.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.609+0000 7f7613a2bb80 1 -- 172.21.15.2:0/2554317650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab222c560 msgr2=0x563ab2227590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:30.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.609+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/2554317650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab222c560 0x563ab2227590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x563ab22485d0 tx=0x7f75ec0044a0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.609+0000 7f7613a2bb80 1 -- 172.21.15.2:0/2554317650 shutdown_connections 2024-06-13T11:23:30.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.609+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/2554317650 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x563ab22b6b50 0x563ab22b5860 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.609+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/2554317650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563ab22372b0 0x563ab2227ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.609+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/2554317650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563ab21a8df0 0x563ab2251760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.609+0000 7f75e7e00700 0 client.25085 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:23:30.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.609+0000 7f7613a2bb80 1 --2- 172.21.15.2:0/2554317650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ab222c560 0x563ab2227590 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.609+0000 7f7613a2bb80 1 -- 172.21.15.2:0/2554317650 >> 172.21.15.2:0/2554317650 conn(0x563ab2159120 msgr2=0x563ab2233dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:30.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.610+0000 7f7613a2bb80 1 -- 172.21.15.2:0/2554317650 shutdown_connections 2024-06-13T11:23:30.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.610+0000 7f7613a2bb80 1 -- 172.21.15.2:0/2554317650 wait complete. 2024-06-13T11:23:30.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.610+0000 7f7613a2bb80 20 client.25085 trim_cache size 0 max 16384 2024-06-13T11:23:30.612 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:23:30.612 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "3611563c-2975-11ef-bc9c-c7b262605968", 2024-06-13T11:23:30.612 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2024-06-13T11:23:30.612 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24509, 2024-06-13T11:23:30.613 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-06-13T11:23:30.613 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-06-13T11:23:30.613 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-06-13T11:23:30.613 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 204.23659412399999, 2024-06-13T11:23:30.613 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 26, 2024-06-13T11:23:30.613 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 99, 2024-06-13T11:23:30.613 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 97, 2024-06-13T11:23:30.613 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 304.45443087899997 2024-06-13T11:23:30.613 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:23:30.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.610+0000 7f7609000700 1 -- 172.21.15.2:0/735369469 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f75e80a2ca0 msgr2=0x7f75e80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:30.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.610+0000 7f7609000700 1 --2- 172.21.15.2:0/735369469 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f75e80a2ca0 0x7f75e80a5160 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009fd0 tx=0x7f75fc003cf0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.610+0000 7f7609000700 1 -- 172.21.15.2:0/735369469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7604108ac0 msgr2=0x7f760419f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:30.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.610+0000 7f7609000700 1 --2- 172.21.15.2:0/735369469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7604108ac0 0x7f760419f200 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f75f4000c00 tx=0x7f75f400bab0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.611+0000 7f7609000700 1 -- 172.21.15.2:0/735369469 shutdown_connections 2024-06-13T11:23:30.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.611+0000 7f7609000700 1 --2- 172.21.15.2:0/735369469 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f75e80a2ca0 0x7f75e80a5160 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.611+0000 7f7609000700 1 --2- 172.21.15.2:0/735369469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f760410eac0 0x7f76041a3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.611+0000 7f7609000700 1 --2- 172.21.15.2:0/735369469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7604108ac0 0x7f760419f200 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.611+0000 7f7609000700 1 --2- 172.21.15.2:0/735369469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7604109480 0x7f760419f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:30.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.611+0000 7f7609000700 1 -- 172.21.15.2:0/735369469 >> 172.21.15.2:0/735369469 conn(0x7f7604075c60 msgr2=0x7f76040761e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:30.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.611+0000 7f7609000700 1 -- 172.21.15.2:0/735369469 shutdown_connections 2024-06-13T11:23:30.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:30.611+0000 7f7609000700 1 -- 172.21.15.2:0/735369469 wait complete. 2024-06-13T11:23:30.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:30 smithi002 ceph-mon[32210]: pgmap v481: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:30.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:30 smithi077 ceph-mon[36410]: pgmap v481: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:30.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:30 smithi178 ceph-mon[36913]: pgmap v481: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:31.711 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.i status 2024-06-13T11:23:32.143 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:23:32.644 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:32 smithi002 ceph-mon[32210]: pgmap v482: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:23:32.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:32 smithi077 ceph-mon[36410]: pgmap v482: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:23:32.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:32 smithi178 ceph-mon[36913]: pgmap v482: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:23:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.344+0000 7f5616000700 1 -- 172.21.15.2:0/3515008281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f561010ed40 msgr2=0x7f5610111130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.344+0000 7f5616000700 1 --2- 172.21.15.2:0/3515008281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f561010ed40 0x7f5610111130 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f560800b0a0 tx=0x7f560800b3b0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.344+0000 7f5616000700 1 -- 172.21.15.2:0/3515008281 shutdown_connections 2024-06-13T11:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.344+0000 7f5616000700 1 --2- 172.21.15.2:0/3515008281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f561010ed40 0x7f5610111130 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.344+0000 7f5616000700 1 --2- 172.21.15.2:0/3515008281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5610101190 0x7f5610101570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.344+0000 7f5616000700 1 --2- 172.21.15.2:0/3515008281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5610101b40 0x7f561010e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.344+0000 7f5616000700 1 -- 172.21.15.2:0/3515008281 >> 172.21.15.2:0/3515008281 conn(0x7f56100fcdb0 msgr2=0x7f56100ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.344+0000 7f5616000700 1 -- 172.21.15.2:0/3515008281 shutdown_connections 2024-06-13T11:23:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.344+0000 7f5616000700 1 -- 172.21.15.2:0/3515008281 wait complete. 2024-06-13T11:23:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.345+0000 7f5616000700 1 Processor -- start 2024-06-13T11:23:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.346+0000 7f5616000700 1 -- start start 2024-06-13T11:23:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.346+0000 7f5616000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5610101190 0x7f561019adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.346+0000 7f5616000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5610101b40 0x7f561019b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.346+0000 7f5616000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f561010ed40 0x7f561019f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.346+0000 7f5616000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5610114930 con 0x7f5610101b40 2024-06-13T11:23:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.346+0000 7f5616000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f56101147b0 con 0x7f561010ed40 2024-06-13T11:23:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.346+0000 7f5616000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5610114ab0 con 0x7f5610101190 2024-06-13T11:23:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.347+0000 7f5614c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5610101190 0x7f561019adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.347+0000 7f5615600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f561010ed40 0x7f561019f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.347+0000 7f560fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5610101b40 0x7f561019b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.347+0000 7f5615600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f561010ed40 0x7f561019f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:42834/0 (socket says 172.21.15.2:42834) 2024-06-13T11:23:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.347+0000 7f5615600700 1 -- 172.21.15.2:0/3760171095 learned_addr learned my addr 172.21.15.2:0/3760171095 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.347+0000 7f5615600700 1 -- 172.21.15.2:0/3760171095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5610101190 msgr2=0x7f561019adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.347+0000 7f5615600700 1 --2- 172.21.15.2:0/3760171095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5610101190 0x7f561019adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.347+0000 7f5615600700 1 -- 172.21.15.2:0/3760171095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5610101b40 msgr2=0x7f561019b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.347+0000 7f5615600700 1 --2- 172.21.15.2:0/3760171095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5610101b40 0x7f561019b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.347+0000 7f5615600700 1 -- 172.21.15.2:0/3760171095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561019fd80 con 0x7f561010ed40 2024-06-13T11:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.348+0000 7f5615600700 1 --2- 172.21.15.2:0/3760171095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f561010ed40 0x7f561019f640 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f560800b070 tx=0x7f5608004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.348+0000 7f560d600700 1 -- 172.21.15.2:0/3760171095 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608021070 con 0x7f561010ed40 2024-06-13T11:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.348+0000 7f5616000700 1 -- 172.21.15.2:0/3760171095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56101a0010 con 0x7f561010ed40 2024-06-13T11:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.348+0000 7f560d600700 1 -- 172.21.15.2:0/3760171095 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5608007b80 con 0x7f561010ed40 2024-06-13T11:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.348+0000 7f560d600700 1 -- 172.21.15.2:0/3760171095 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56080052a0 con 0x7f561010ed40 2024-06-13T11:23:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.348+0000 7f5616000700 1 -- 172.21.15.2:0/3760171095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56101a78f0 con 0x7f561010ed40 2024-06-13T11:23:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.352+0000 7f560d600700 1 -- 172.21.15.2:0/3760171095 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f5608024070 con 0x7f561010ed40 2024-06-13T11:23:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.354+0000 7f5621f31b80 1 Processor -- start 2024-06-13T11:23:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.354+0000 7f5621f31b80 1 -- start start 2024-06-13T11:23:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.354+0000 7f560d600700 1 --2- 172.21.15.2:0/3760171095 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f55f80a2c20 0x7f55f80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.354+0000 7f560d600700 1 -- 172.21.15.2:0/3760171095 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f56080d02f0 con 0x7f561010ed40 2024-06-13T11:23:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.354+0000 7f5621f31b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25ed10 0x55d92f25f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.354+0000 7f5621f31b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25f630 0x55d92f269fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.354+0000 7f5621f31b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 0x55d92f26c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.354+0000 7f560fe00700 1 --2- 172.21.15.2:0/3760171095 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f55f80a2c20 0x7f55f80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.354+0000 7f5621f31b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d92f16e9c0 con 0x55d92f25f630 2024-06-13T11:23:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.354+0000 7f5621f31b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d92f1b1ab0 con 0x55d92f25ed10 2024-06-13T11:23:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.354+0000 7f5621f31b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d92f16c8a0 con 0x55d92f26a4e0 2024-06-13T11:23:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.355+0000 7f560fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25f630 0x55d92f269fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.355+0000 7f5614c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25ed10 0x55d92f25f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.355+0000 7f5614c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25ed10 0x55d92f25f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:42848/0 (socket says 172.21.15.2:42848) 2024-06-13T11:23:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.355+0000 7f5614c00700 1 -- 172.21.15.2:0/4057252317 learned_addr learned my addr 172.21.15.2:0/4057252317 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.355+0000 7f5615600700 1 --2- 172.21.15.2:0/4057252317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 0x55d92f26c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.355+0000 7f5614c00700 1 -- 172.21.15.2:0/4057252317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 msgr2=0x55d92f26c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.355+0000 7f5614c00700 1 --2- 172.21.15.2:0/4057252317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 0x55d92f26c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.355+0000 7f5614c00700 1 -- 172.21.15.2:0/4057252317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25f630 msgr2=0x55d92f269fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.355+0000 7f5614c00700 1 --2- 172.21.15.2:0/4057252317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25f630 0x55d92f269fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.355+0000 7f5614c00700 1 -- 172.21.15.2:0/4057252317 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d92f159f40 con 0x55d92f25ed10 2024-06-13T11:23:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.355+0000 7f5615600700 1 --2- 172.21.15.2:0/4057252317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 0x55d92f26c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:23:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.356+0000 7f5614c00700 1 --2- 172.21.15.2:0/4057252317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25ed10 0x55d92f25f0f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5604009d80 tx=0x7f5604011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cc7ee1980a3353a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.356+0000 7f560fe00700 1 --2- 172.21.15.2:0/3760171095 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f55f80a2c20 0x7f55f80a50e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5610102b30 tx=0x7f55fc009ac0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.356+0000 7f5602000700 1 -- 172.21.15.2:0/4057252317 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560401e070 con 0x55d92f25ed10 2024-06-13T11:23:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.356+0000 7f5602000700 1 -- 172.21.15.2:0/4057252317 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5604019b10 con 0x55d92f25ed10 2024-06-13T11:23:34.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.356+0000 7f5602000700 1 -- 172.21.15.2:0/4057252317 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560400ea70 con 0x55d92f25ed10 2024-06-13T11:23:34.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.357+0000 7f5621f31b80 1 -- 172.21.15.2:0/4057252317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25ed10 msgr2=0x55d92f25f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:34.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.357+0000 7f5621f31b80 1 --2- 172.21.15.2:0/4057252317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25ed10 0x55d92f25f0f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5604009d80 tx=0x7f5604011720 comp rx=0 tx=0).stop 2024-06-13T11:23:34.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.357+0000 7f5621f31b80 1 -- 172.21.15.2:0/4057252317 shutdown_connections 2024-06-13T11:23:34.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.357+0000 7f5621f31b80 1 --2- 172.21.15.2:0/4057252317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 0x55d92f26c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.357+0000 7f5621f31b80 1 --2- 172.21.15.2:0/4057252317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25ed10 0x55d92f25f0f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.357+0000 7f5621f31b80 1 --2- 172.21.15.2:0/4057252317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25f630 0x55d92f269fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.357+0000 7f5621f31b80 1 -- 172.21.15.2:0/4057252317 >> 172.21.15.2:0/4057252317 conn(0x55d92f18c120 msgr2=0x55d92f25b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.357+0000 7f5621f31b80 1 -- 172.21.15.2:0/4057252317 shutdown_connections 2024-06-13T11:23:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.357+0000 7f5621f31b80 1 -- 172.21.15.2:0/4057252317 wait complete. 2024-06-13T11:23:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.358+0000 7f5621f31b80 1 -- start start 2024-06-13T11:23:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.358+0000 7f5621f31b80 1 Processor -- start 2024-06-13T11:23:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.359+0000 7f5621f31b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f25ed10 0x55d92f269c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.359+0000 7f5621f31b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25f630 0x55d92f266f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.359+0000 7f5621f31b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f26a4e0 0x55d92f2674c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.359+0000 7f5621f31b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d92f14df10 con 0x55d92f25f630 2024-06-13T11:23:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.359+0000 7f5621f31b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d92f1ada70 con 0x55d92f26a4e0 2024-06-13T11:23:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.359+0000 7f5621f31b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d92f26cf70 con 0x55d92f25ed10 2024-06-13T11:23:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.359+0000 7f5621f31b80 10 client.0 _ll_register_callbacks cb 0x55d92f147330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:23:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.359+0000 7f560fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25f630 0x55d92f266f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.359+0000 7f5614c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f25ed10 0x55d92f269c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.359+0000 7f5614c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f25ed10 0x55d92f269c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:46106/0 (socket says 172.21.15.2:46106) 2024-06-13T11:23:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.359+0000 7f5614c00700 1 -- 172.21.15.2:0/1888175548 learned_addr learned my addr 172.21.15.2:0/1888175548 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.359+0000 7f560fe00700 1 --2- 172.21.15.2:0/1888175548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25f630 0x55d92f266f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58618/0 (socket says 172.21.15.2:58618) 2024-06-13T11:23:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.359+0000 7f5615600700 1 --2- 172.21.15.2:0/1888175548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f26a4e0 0x55d92f2674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.360+0000 7f5615600700 1 -- 172.21.15.2:0/1888175548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f25ed10 msgr2=0x55d92f269c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.360+0000 7f5615600700 1 --2- 172.21.15.2:0/1888175548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f25ed10 0x55d92f269c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.360+0000 7f5615600700 1 -- 172.21.15.2:0/1888175548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25f630 msgr2=0x55d92f266f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.360+0000 7f5615600700 1 --2- 172.21.15.2:0/1888175548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25f630 0x55d92f266f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.360+0000 7f5615600700 1 -- 172.21.15.2:0/1888175548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d92f100880 con 0x55d92f26a4e0 2024-06-13T11:23:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.360+0000 7f5614c00700 1 --2- 172.21.15.2:0/1888175548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f25ed10 0x55d92f269c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.360+0000 7f5615600700 1 --2- 172.21.15.2:0/1888175548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f26a4e0 0x55d92f2674c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f560809c4f0 tx=0x7f560809c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d91c03921816a4b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.360+0000 7f55f6a00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:23:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.360+0000 7f55f6a00700 1 -- 172.21.15.2:0/1888175548 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560802b030 con 0x55d92f26a4e0 2024-06-13T11:23:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.360+0000 7f55f6a00700 1 -- 172.21.15.2:0/1888175548 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f56080074e0 con 0x55d92f26a4e0 2024-06-13T11:23:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.360+0000 7f5621f31b80 1 -- 172.21.15.2:0/1888175548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5604019b10 con 0x55d92f26a4e0 2024-06-13T11:23:34.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.360+0000 7f55f6a00700 1 -- 172.21.15.2:0/1888175548 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f560809cef0 con 0x55d92f26a4e0 2024-06-13T11:23:34.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.361+0000 7f5621f31b80 10 client.25097 fetch_fsmap learned FSMap version 26 2024-06-13T11:23:34.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.361+0000 7f5621f31b80 1 -- 172.21.15.2:0/1888175548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d92f277680 con 0x55d92f26a4e0 2024-06-13T11:23:34.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.361+0000 7f55f6a00700 1 -- 172.21.15.2:0/1888175548 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5604019b10 con 0x55d92f26a4e0 2024-06-13T11:23:34.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.361+0000 7f55f6a00700 1 -- 172.21.15.2:0/1888175548 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5608011070 con 0x55d92f26a4e0 2024-06-13T11:23:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.361+0000 7f5621f31b80 10 client.25097 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T11:23:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.361+0000 7f5621f31b80 10 client.25097 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-13T11:23:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.361+0000 7f5621f31b80 20 client.25097 populate_metadata read hostname 'smithi002' 2024-06-13T11:23:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.361+0000 7f5621f31b80 1 --2- 172.21.15.2:0/1888175548 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d92f279dd0 0x55d92f27b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.361+0000 7f5621f31b80 4 client.25097 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:23:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.361+0000 7f5621f31b80 1 -- 172.21.15.2:0/1888175548 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d92f1befb0 con 0x55d92f279dd0 2024-06-13T11:23:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.362+0000 7f5614c00700 1 --2- 172.21.15.2:0/1888175548 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d92f279dd0 0x55d92f27b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.362+0000 7f5614c00700 1 --2- 172.21.15.2:0/1888175548 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d92f279dd0 0x55d92f27b240 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e46a4926ea2b950f server_cookie=7d83aa44a8324ff0 in_seq=0 out_seq=0 2024-06-13T11:23:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.362+0000 7f55f6a00700 10 client.25097 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:23:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.364+0000 7f55f6a00700 1 -- 172.21.15.2:0/1888175548 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d92f1befb0 con 0x55d92f279dd0 2024-06-13T11:23:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.364+0000 7f55f6a00700 10 client.25097 handle_command_reply: tid=0 2024-06-13T11:23:34.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.364+0000 7f5621f31b80 1 client.25097 shutdown 2024-06-13T11:23:34.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.364+0000 7f5621f31b80 1 -- 172.21.15.2:0/1888175548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f26a4e0 msgr2=0x55d92f2674c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:34.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.364+0000 7f5621f31b80 1 --2- 172.21.15.2:0/1888175548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f26a4e0 0x55d92f2674c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f560809c4f0 tx=0x7f560809c3b0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.364+0000 7f5621f31b80 1 -- 172.21.15.2:0/1888175548 shutdown_connections 2024-06-13T11:23:34.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.364+0000 7f5621f31b80 1 --2- 172.21.15.2:0/1888175548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f26a4e0 0x55d92f2674c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.364+0000 7f5621f31b80 1 --2- 172.21.15.2:0/1888175548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f25ed10 0x55d92f269c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.364+0000 7f5621f31b80 1 --2- 172.21.15.2:0/1888175548 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d92f279dd0 0x55d92f27b240 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.364+0000 7f5621f31b80 1 --2- 172.21.15.2:0/1888175548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25f630 0x55d92f266f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.364+0000 7f5621f31b80 1 -- 172.21.15.2:0/1888175548 >> 172.21.15.2:0/1888175548 conn(0x55d92f18c120 msgr2=0x55d92f25ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:34.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.364+0000 7f55f6a00700 0 client.25097 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:23:34.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.364+0000 7f5621f31b80 1 -- 172.21.15.2:0/1888175548 shutdown_connections 2024-06-13T11:23:34.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.364+0000 7f5621f31b80 1 -- 172.21.15.2:0/1888175548 wait complete. 2024-06-13T11:23:34.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.364+0000 7f5621f31b80 20 client.25097 trim_cache size 0 max 16384 2024-06-13T11:23:34.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.388+0000 7f5621f31b80 1 Processor -- start 2024-06-13T11:23:34.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.388+0000 7f5621f31b80 1 -- start start 2024-06-13T11:23:34.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.389+0000 7f5621f31b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25ed10 0x55d92f2697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.389+0000 7f5621f31b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25f630 0x55d92f264200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.389+0000 7f5621f31b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 0x55d92f264740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.389+0000 7f5621f31b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d92f279580 con 0x55d92f25ed10 2024-06-13T11:23:34.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.389+0000 7f5621f31b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d92f279c50 con 0x55d92f25f630 2024-06-13T11:23:34.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.389+0000 7f5621f31b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d92f27a320 con 0x55d92f26a4e0 2024-06-13T11:23:34.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.389+0000 7f5614c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25ed10 0x55d92f2697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.389+0000 7f5615600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 0x55d92f264740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.389+0000 7f560fe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25f630 0x55d92f264200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.389+0000 7f5615600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 0x55d92f264740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:46114/0 (socket says 172.21.15.2:46114) 2024-06-13T11:23:34.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.390+0000 7f5615600700 1 -- 172.21.15.2:0/1661489835 learned_addr learned my addr 172.21.15.2:0/1661489835 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:34.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.389+0000 7f5614c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25ed10 0x55d92f2697c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58620/0 (socket says 172.21.15.2:58620) 2024-06-13T11:23:34.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.390+0000 7f5614c00700 1 -- 172.21.15.2:0/1661489835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 msgr2=0x55d92f264740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:34.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.390+0000 7f5614c00700 1 --2- 172.21.15.2:0/1661489835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 0x55d92f264740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.390+0000 7f5614c00700 1 -- 172.21.15.2:0/1661489835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25f630 msgr2=0x55d92f264200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:34.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.390+0000 7f5614c00700 1 --2- 172.21.15.2:0/1661489835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25f630 0x55d92f264200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.390+0000 7f5614c00700 1 -- 172.21.15.2:0/1661489835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d92f25fc80 con 0x55d92f25ed10 2024-06-13T11:23:34.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.390+0000 7f560fe00700 1 --2- 172.21.15.2:0/1661489835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25f630 0x55d92f264200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:34.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.390+0000 7f5614c00700 1 --2- 172.21.15.2:0/1661489835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25ed10 0x55d92f2697c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f560400e6f0 tx=0x7f5604005210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae641dc2242da026 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:34.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.391+0000 7f5601600700 1 -- 172.21.15.2:0/1661489835 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560401e040 con 0x55d92f25ed10 2024-06-13T11:23:34.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.391+0000 7f5601600700 1 -- 172.21.15.2:0/1661489835 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5604031070 con 0x55d92f25ed10 2024-06-13T11:23:34.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.391+0000 7f5601600700 1 -- 172.21.15.2:0/1661489835 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560400ed30 con 0x55d92f25ed10 2024-06-13T11:23:34.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.391+0000 7f5621f31b80 1 -- 172.21.15.2:0/1661489835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25ed10 msgr2=0x55d92f2697c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:34.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.391+0000 7f5621f31b80 1 --2- 172.21.15.2:0/1661489835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25ed10 0x55d92f2697c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f560400e6f0 tx=0x7f5604005210 comp rx=0 tx=0).stop 2024-06-13T11:23:34.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.392+0000 7f5621f31b80 1 -- 172.21.15.2:0/1661489835 shutdown_connections 2024-06-13T11:23:34.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.392+0000 7f5621f31b80 1 --2- 172.21.15.2:0/1661489835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25ed10 0x55d92f2697c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.392+0000 7f5621f31b80 1 --2- 172.21.15.2:0/1661489835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 0x55d92f264740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.392+0000 7f5621f31b80 1 --2- 172.21.15.2:0/1661489835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25f630 0x55d92f264200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.392+0000 7f5621f31b80 1 -- 172.21.15.2:0/1661489835 >> 172.21.15.2:0/1661489835 conn(0x55d92f18c120 msgr2=0x55d92f275a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:34.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.392+0000 7f5621f31b80 1 -- 172.21.15.2:0/1661489835 shutdown_connections 2024-06-13T11:23:34.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.392+0000 7f5621f31b80 1 -- 172.21.15.2:0/1661489835 wait complete. 2024-06-13T11:23:34.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.392+0000 7f5621f31b80 1 -- start start 2024-06-13T11:23:34.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.392+0000 7f5621f31b80 1 Processor -- start 2024-06-13T11:23:34.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.393+0000 7f5621f31b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25ed10 0x55d92f280420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.393+0000 7f5621f31b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25f630 0x55d92f280960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.393+0000 7f5621f31b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 0x55d92f280ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.393+0000 7f5621f31b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d92f27b0c0 con 0x55d92f25f630 2024-06-13T11:23:34.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.393+0000 7f5621f31b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d92f27a9f0 con 0x55d92f25ed10 2024-06-13T11:23:34.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.393+0000 7f5621f31b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d92f27b790 con 0x55d92f26a4e0 2024-06-13T11:23:34.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.393+0000 7f5621f31b80 10 client.0 _ll_register_callbacks cb 0x55d92f147330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:23:34.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.393+0000 7f560fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25f630 0x55d92f280960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.393+0000 7f5615600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 0x55d92f280ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.393+0000 7f5614c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25ed10 0x55d92f280420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.393+0000 7f5615600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 0x55d92f280ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:46128/0 (socket says 172.21.15.2:46128) 2024-06-13T11:23:34.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.393+0000 7f5615600700 1 -- 172.21.15.2:0/2836656214 learned_addr learned my addr 172.21.15.2:0/2836656214 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:34.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.394+0000 7f5615600700 1 -- 172.21.15.2:0/2836656214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25ed10 msgr2=0x55d92f280420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:34.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.394+0000 7f5615600700 1 --2- 172.21.15.2:0/2836656214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25ed10 0x55d92f280420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.394+0000 7f5615600700 1 -- 172.21.15.2:0/2836656214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25f630 msgr2=0x55d92f280960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:23:34.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.394+0000 7f5615600700 1 --2- 172.21.15.2:0/2836656214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25f630 0x55d92f280960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.394+0000 7f5615600700 1 -- 172.21.15.2:0/2836656214 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d92f2e4690 con 0x55d92f26a4e0 2024-06-13T11:23:34.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.394+0000 7f5614c00700 1 --2- 172.21.15.2:0/2836656214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25ed10 0x55d92f280420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:34.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.394+0000 7f5615600700 1 --2- 172.21.15.2:0/2836656214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 0x55d92f280ea0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5608099170 tx=0x7f560809c090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8651b145a15623e9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:34.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.394+0000 7f55f6a00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:23:34.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.394+0000 7f55f6a00700 1 -- 172.21.15.2:0/2836656214 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560802b070 con 0x55d92f26a4e0 2024-06-13T11:23:34.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.394+0000 7f5621f31b80 1 -- 172.21.15.2:0/2836656214 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5604031070 con 0x55d92f26a4e0 2024-06-13T11:23:34.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.394+0000 7f55f6a00700 1 -- 172.21.15.2:0/2836656214 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f560809db20 con 0x55d92f26a4e0 2024-06-13T11:23:34.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.395+0000 7f55f6a00700 1 -- 172.21.15.2:0/2836656214 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f560809c7f0 con 0x55d92f26a4e0 2024-06-13T11:23:34.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.395+0000 7f5621f31b80 10 client.25129 fetch_fsmap learned FSMap version 26 2024-06-13T11:23:34.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.395+0000 7f5621f31b80 1 -- 172.21.15.2:0/2836656214 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d92f2e4690 con 0x55d92f26a4e0 2024-06-13T11:23:34.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.395+0000 7f55f6a00700 1 -- 172.21.15.2:0/2836656214 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5604031070 con 0x55d92f26a4e0 2024-06-13T11:23:34.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.395+0000 7f55f6a00700 1 -- 172.21.15.2:0/2836656214 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5608011040 con 0x55d92f26a4e0 2024-06-13T11:23:34.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.395+0000 7f5621f31b80 10 client.25129 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T11:23:34.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.396+0000 7f5621f31b80 10 client.25129 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-13T11:23:34.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.396+0000 7f5621f31b80 20 client.25129 populate_metadata read hostname 'smithi002' 2024-06-13T11:23:34.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.396+0000 7f5621f31b80 1 --2- 172.21.15.2:0/2836656214 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d92f2ea640 0x55d92f2e9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:34.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.396+0000 7f5621f31b80 4 client.25129 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T11:23:34.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.396+0000 7f5621f31b80 1 -- 172.21.15.2:0/2836656214 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "status"}) -- 0x55d92f1b9530 con 0x55d92f2ea640 2024-06-13T11:23:34.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.396+0000 7f5614c00700 1 --2- 172.21.15.2:0/2836656214 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d92f2ea640 0x55d92f2e9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:34.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.396+0000 7f5614c00700 1 --2- 172.21.15.2:0/2836656214 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d92f2ea640 0x55d92f2e9380 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8e2d128e29c31df server_cookie=82f6bc089d8d05d6 in_seq=0 out_seq=0 2024-06-13T11:23:34.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.396+0000 7f55f6a00700 10 client.25129 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:23:34.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.397+0000 7f55f6a00700 1 -- 172.21.15.2:0/2836656214 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d92f1b9530 con 0x55d92f2ea640 2024-06-13T11:23:34.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.397+0000 7f55f6a00700 10 client.25129 handle_command_reply: tid=0 2024-06-13T11:23:34.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.397+0000 7f5621f31b80 1 client.25129 shutdown 2024-06-13T11:23:34.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.397+0000 7f5621f31b80 1 -- 172.21.15.2:0/2836656214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 msgr2=0x55d92f280ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:34.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.397+0000 7f5621f31b80 1 --2- 172.21.15.2:0/2836656214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 0x55d92f280ea0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5608099170 tx=0x7f560809c090 comp rx=0 tx=0).stop 2024-06-13T11:23:34.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.397+0000 7f5621f31b80 1 -- 172.21.15.2:0/2836656214 shutdown_connections 2024-06-13T11:23:34.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.397+0000 7f5621f31b80 1 --2- 172.21.15.2:0/2836656214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d92f26a4e0 0x55d92f280ea0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.397+0000 7f5621f31b80 1 --2- 172.21.15.2:0/2836656214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d92f25ed10 0x55d92f280420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.397+0000 7f5621f31b80 1 --2- 172.21.15.2:0/2836656214 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d92f2ea640 0x55d92f2e9380 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.397+0000 7f5621f31b80 1 --2- 172.21.15.2:0/2836656214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d92f25f630 0x55d92f280960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.397+0000 7f5621f31b80 1 -- 172.21.15.2:0/2836656214 >> 172.21.15.2:0/2836656214 conn(0x55d92f18c120 msgr2=0x55d92f25a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:34.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.397+0000 7f55f6a00700 0 client.25129 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:23:34.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.397+0000 7f5621f31b80 1 -- 172.21.15.2:0/2836656214 shutdown_connections 2024-06-13T11:23:34.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.397+0000 7f5621f31b80 1 -- 172.21.15.2:0/2836656214 wait complete. 2024-06-13T11:23:34.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.397+0000 7f5621f31b80 20 client.25129 trim_cache size 0 max 16384 2024-06-13T11:23:34.401 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:23:34.402 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "3611563c-2975-11ef-bc9c-c7b262605968", 2024-06-13T11:23:34.402 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-06-13T11:23:34.402 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24511, 2024-06-13T11:23:34.402 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-06-13T11:23:34.402 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-06-13T11:23:34.402 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-06-13T11:23:34.402 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 287.50108753699999, 2024-06-13T11:23:34.402 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 26, 2024-06-13T11:23:34.402 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 99, 2024-06-13T11:23:34.402 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 97, 2024-06-13T11:23:34.402 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 323.108533937 2024-06-13T11:23:34.403 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:23:34.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.398+0000 7f5616000700 1 -- 172.21.15.2:0/3760171095 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f55f80a2c20 msgr2=0x7f55f80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:34.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.398+0000 7f5616000700 1 --2- 172.21.15.2:0/3760171095 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f55f80a2c20 0x7f55f80a50e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5610102b30 tx=0x7f55fc009ac0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.398+0000 7f5616000700 1 -- 172.21.15.2:0/3760171095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f561010ed40 msgr2=0x7f561019f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:34.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.398+0000 7f5616000700 1 --2- 172.21.15.2:0/3760171095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f561010ed40 0x7f561019f640 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f560800b070 tx=0x7f5608004c80 comp rx=0 tx=0).stop 2024-06-13T11:23:34.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.398+0000 7f5616000700 1 -- 172.21.15.2:0/3760171095 shutdown_connections 2024-06-13T11:23:34.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.398+0000 7f5616000700 1 --2- 172.21.15.2:0/3760171095 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f55f80a2c20 0x7f55f80a50e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.398+0000 7f5616000700 1 --2- 172.21.15.2:0/3760171095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f561010ed40 0x7f561019f640 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.398+0000 7f5616000700 1 --2- 172.21.15.2:0/3760171095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5610101190 0x7f561019adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.398+0000 7f5616000700 1 --2- 172.21.15.2:0/3760171095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5610101b40 0x7f561019b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:34.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.398+0000 7f5616000700 1 -- 172.21.15.2:0/3760171095 >> 172.21.15.2:0/3760171095 conn(0x7f56100fcdb0 msgr2=0x7f561010fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:34.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.398+0000 7f5616000700 1 -- 172.21.15.2:0/3760171095 shutdown_connections 2024-06-13T11:23:34.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:34.398+0000 7f5616000700 1 -- 172.21.15.2:0/3760171095 wait complete. 2024-06-13T11:23:34.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:34 smithi077 ceph-mon[36410]: pgmap v483: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:23:34.825 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:34 smithi002 ceph-mon[32210]: pgmap v483: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:23:34.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:34 smithi178 ceph-mon[36913]: pgmap v483: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:23:35.349 INFO:teuthology.run_tasks:Running task sequential... 2024-06-13T11:23:35.358 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-06-13T11:23:35.358 INFO:teuthology.task.sequential:In sequential, running task print... 2024-06-13T11:23:35.358 INFO:teuthology.task.print:Enabling mgr modules 2024-06-13T11:23:35.358 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-06-13T11:23:35.359 INFO:teuthology.task.exec:Executing custom commands... 2024-06-13T11:23:35.359 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T11:23:35.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-06-13T11:23:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.586+0000 7f30e0000640 1 -- 172.21.15.2:0/473589058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d8103c30 msgr2=0x7f30d8104050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.586+0000 7f30e0000640 1 --2- 172.21.15.2:0/473589058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d8103c30 0x7f30d8104050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009860 tx=0x7f30cc02a340 comp rx=0 tx=0).stop 2024-06-13T11:23:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.586+0000 7f30e0000640 1 -- 172.21.15.2:0/473589058 shutdown_connections 2024-06-13T11:23:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.586+0000 7f30e0000640 1 --2- 172.21.15.2:0/473589058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30d81057e0 0x7f30d810c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.586+0000 7f30e0000640 1 --2- 172.21.15.2:0/473589058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d8104e20 0x7f30d81052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.586+0000 7f30e0000640 1 --2- 172.21.15.2:0/473589058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d8103c30 0x7f30d8104050 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.586+0000 7f30e0000640 1 -- 172.21.15.2:0/473589058 >> 172.21.15.2:0/473589058 conn(0x7f30d80ff1c0 msgr2=0x7f30d81015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.586+0000 7f30e0000640 1 -- 172.21.15.2:0/473589058 shutdown_connections 2024-06-13T11:23:35.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.586+0000 7f30e0000640 1 -- 172.21.15.2:0/473589058 wait complete. 2024-06-13T11:23:35.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.587+0000 7f30e0000640 1 Processor -- start 2024-06-13T11:23:35.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.587+0000 7f30e0000640 1 -- start start 2024-06-13T11:23:35.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.588+0000 7f30e0000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d8103c30 0x7f30d8199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.588+0000 7f30e0000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d8104e20 0x7f30d819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.588+0000 7f30e0000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30d81057e0 0x7f30d81a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.588+0000 7f30e0000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30d810f880 con 0x7f30d8104e20 2024-06-13T11:23:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.588+0000 7f30e0000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f30d810f700 con 0x7f30d8103c30 2024-06-13T11:23:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.588+0000 7f30e0000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f30d810fa00 con 0x7f30d81057e0 2024-06-13T11:23:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.588+0000 7f30dcc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d8104e20 0x7f30d819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.588+0000 7f30dcc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d8104e20 0x7f30d819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58650/0 (socket says 172.21.15.2:58650) 2024-06-13T11:23:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.588+0000 7f30dcc00640 1 -- 172.21.15.2:0/2629594478 learned_addr learned my addr 172.21.15.2:0/2629594478 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.588+0000 7f30de000640 1 --2- 172.21.15.2:0/2629594478 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30d81057e0 0x7f30d81a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.588+0000 7f30dd600640 1 --2- 172.21.15.2:0/2629594478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d8103c30 0x7f30d8199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.589+0000 7f30de000640 1 -- 172.21.15.2:0/2629594478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d8103c30 msgr2=0x7f30d8199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.589+0000 7f30de000640 1 --2- 172.21.15.2:0/2629594478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d8103c30 0x7f30d8199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:35.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.589+0000 7f30de000640 1 -- 172.21.15.2:0/2629594478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d8104e20 msgr2=0x7f30d819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.589+0000 7f30de000640 1 --2- 172.21.15.2:0/2629594478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d8104e20 0x7f30d819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.589+0000 7f30de000640 1 -- 172.21.15.2:0/2629594478 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d81a1ba0 con 0x7f30d81057e0 2024-06-13T11:23:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.589+0000 7f30dcc00640 1 --2- 172.21.15.2:0/2629594478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d8104e20 0x7f30d819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:35.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.589+0000 7f30de000640 1 --2- 172.21.15.2:0/2629594478 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30d81057e0 0x7f30d81a1530 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f30d000ec50 tx=0x7f30d000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.589+0000 7f30d6000640 1 -- 172.21.15.2:0/2629594478 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d0003b70 con 0x7f30d81057e0 2024-06-13T11:23:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.589+0000 7f30d6000640 1 -- 172.21.15.2:0/2629594478 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30d0003d10 con 0x7f30d81057e0 2024-06-13T11:23:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.589+0000 7f30e0000640 1 -- 172.21.15.2:0/2629594478 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d81a1e90 con 0x7f30d81057e0 2024-06-13T11:23:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.589+0000 7f30d6000640 1 -- 172.21.15.2:0/2629594478 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d0010890 con 0x7f30d81057e0 2024-06-13T11:23:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.589+0000 7f30e0000640 1 -- 172.21.15.2:0/2629594478 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d81a2350 con 0x7f30d81057e0 2024-06-13T11:23:35.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.590+0000 7f30e0000640 1 -- 172.21.15.2:0/2629594478 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30d810afd0 con 0x7f30d81057e0 2024-06-13T11:23:35.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.593+0000 7f30d6000640 1 -- 172.21.15.2:0/2629594478 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f30d0003fc0 con 0x7f30d81057e0 2024-06-13T11:23:35.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.594+0000 7f30d6000640 1 --2- 172.21.15.2:0/2629594478 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f30c00a2c00 0x7f30c00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:35.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.594+0000 7f30d6000640 1 -- 172.21.15.2:0/2629594478 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f30d00cf960 con 0x7f30d81057e0 2024-06-13T11:23:35.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.594+0000 7f30dd600640 1 --2- 172.21.15.2:0/2629594478 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f30c00a2c00 0x7f30c00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:35.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.595+0000 7f30dd600640 1 --2- 172.21.15.2:0/2629594478 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f30c00a2c00 0x7f30c00a50c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009830 tx=0x7f30cc030570 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:35.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.599+0000 7f30d6000640 1 -- 172.21.15.2:0/2629594478 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f30d009c4d0 con 0x7f30d81057e0 2024-06-13T11:23:35.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:35.857+0000 7f30e0000640 1 -- 172.21.15.2:0/2629594478 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f30d8062640 con 0x7f30d81057e0 2024-06-13T11:23:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:36.542+0000 7f30d6000640 1 -- 172.21.15.2:0/2629594478 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mgrmap(e 19) ==== 137849+0+0 (secure 0 0 0) 0x7f30d0098440 con 0x7f30d81057e0 2024-06-13T11:23:36.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:36.545+0000 7f30d6000640 1 -- 172.21.15.2:0/2629594478 <== mon.1 v2:172.21.15.178:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f30d0046c20 con 0x7f30d81057e0 2024-06-13T11:23:36.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:36.550+0000 7f30e0000640 1 -- 172.21.15.2:0/2629594478 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f30c00a2c00 msgr2=0x7f30c00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:36.550+0000 7f30e0000640 1 --2- 172.21.15.2:0/2629594478 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f30c00a2c00 0x7f30c00a50c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009830 tx=0x7f30cc030570 comp rx=0 tx=0).stop 2024-06-13T11:23:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:36.550+0000 7f30e0000640 1 -- 172.21.15.2:0/2629594478 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30d81057e0 msgr2=0x7f30d81a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:36.550+0000 7f30e0000640 1 --2- 172.21.15.2:0/2629594478 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30d81057e0 0x7f30d81a1530 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f30d000ec50 tx=0x7f30d000c6a0 comp rx=0 tx=0).stop 2024-06-13T11:23:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:36.550+0000 7f30e0000640 1 -- 172.21.15.2:0/2629594478 shutdown_connections 2024-06-13T11:23:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:36.550+0000 7f30e0000640 1 --2- 172.21.15.2:0/2629594478 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f30c00a2c00 0x7f30c00a50c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:36.550+0000 7f30e0000640 1 --2- 172.21.15.2:0/2629594478 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30d81057e0 0x7f30d81a1530 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:36.550+0000 7f30e0000640 1 --2- 172.21.15.2:0/2629594478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30d8104e20 0x7f30d819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:36.550+0000 7f30e0000640 1 --2- 172.21.15.2:0/2629594478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d8103c30 0x7f30d8199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:36.550+0000 7f30e0000640 1 -- 172.21.15.2:0/2629594478 >> 172.21.15.2:0/2629594478 conn(0x7f30d80ff1c0 msgr2=0x7f30d81081a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:36.551+0000 7f30e0000640 1 -- 172.21.15.2:0/2629594478 shutdown_connections 2024-06-13T11:23:36.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:36.551+0000 7f30e0000640 1 -- 172.21.15.2:0/2629594478 wait complete. 2024-06-13T11:23:36.570 INFO:teuthology.run_tasks:Running task kclient... 2024-06-13T11:23:36.584 INFO:tasks.kclient:Mounting kernel clients... 2024-06-13T11:23:36.584 INFO:tasks.kclient:config is {'client.0': {}} 2024-06-13T11:23:36.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:23:36.584 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-06-13T11:23:36.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-06-13T11:23:36.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:23:36.627 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T11:23:36.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:36 smithi002 ceph-mon[32210]: pgmap v484: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:36.722 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:36 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2629594478' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-06-13T11:23:36.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:36 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-06-13T11:23:36.723 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:36 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: ignoring --setuser ceph since I am not root 2024-06-13T11:23:36.723 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:36 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: ignoring --setgroup ceph since I am not root 2024-06-13T11:23:36.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:23:36.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-06-13T11:23:36.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:36 smithi077 ceph-mon[36410]: pgmap v484: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:36.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:36 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2629594478' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-06-13T11:23:36.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:36 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-06-13T11:23:36.790 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:36 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: ignoring --setuser ceph since I am not root 2024-06-13T11:23:36.790 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:36 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: ignoring --setgroup ceph since I am not root 2024-06-13T11:23:36.790 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:36 smithi077 ceph-mgr[37785]: -- 172.21.15.77:0/3979093051 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dc700905a0 con 0x55dc70064800 2024-06-13T11:23:36.790 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:36 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:36.711+0000 7f93063e0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T11:23:36.846 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-06-13T11:23:36.847 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-13T11:23:36.847 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-13T11:23:36.847 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs ls 2024-06-13T11:23:36.898 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:36 smithi178 ceph-mon[36913]: pgmap v484: 129 pgs: 129 active+clean; 644 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:23:36.898 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:36 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2629594478' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-06-13T11:23:36.898 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:36 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-06-13T11:23:36.898 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:36 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: ignoring --setuser ceph since I am not root 2024-06-13T11:23:36.899 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:36 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: ignoring --setgroup ceph since I am not root 2024-06-13T11:23:36.899 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:36 smithi178 ceph-mgr[38736]: -- 172.21.15.178:0/3623202130 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d32ec2a5a0 con 0x55d32ebfe800 2024-06-13T11:23:36.899 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:36 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:36.714+0000 7f03e177e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T11:23:36.899 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:36 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:36.900+0000 7f03e177e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:23:37.145 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:36 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:36.896+0000 7fd157619200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T11:23:37.196 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:37 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:37.004+0000 7f03e177e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T11:23:37.278 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:23:37.289 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:36 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:36.894+0000 7f93063e0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:23:37.289 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:36 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:36.995+0000 7f93063e0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T11:23:37.423 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:37 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:37.167+0000 7fd157619200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:23:37.423 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:37 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:37.311+0000 7fd157619200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T11:23:37.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:37 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-06-13T11:23:37.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:37 smithi178 ceph-mon[36913]: mgrmap e19: x(active, since 13m), standbys: z, y 2024-06-13T11:23:37.696 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:37 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:37.316+0000 7f03e177e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T11:23:37.697 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:37 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:37.402+0000 7f03e177e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T11:23:37.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:37 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-06-13T11:23:37.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:37 smithi002 ceph-mon[32210]: mgrmap e19: x(active, since 13m), standbys: z, y 2024-06-13T11:23:37.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:37 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-06-13T11:23:37.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:37 smithi077 ceph-mon[36410]: mgrmap e19: x(active, since 13m), standbys: z, y 2024-06-13T11:23:37.790 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:37 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:37.308+0000 7f93063e0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T11:23:37.790 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:37 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:37.394+0000 7f93063e0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T11:23:38.145 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:37 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:37.735+0000 7fd157619200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T11:23:38.145 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:37 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:37.856+0000 7fd157619200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T11:23:38.915 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:38 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:38.573+0000 7f93063e0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T11:23:38.915 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:38 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:38.744+0000 7f93063e0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T11:23:38.915 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:38 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:38.916+0000 7f93063e0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T11:23:38.923 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:38 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:38.583+0000 7f03e177e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T11:23:38.923 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:38 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:38.752+0000 7f03e177e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T11:23:38.923 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:38 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:38.925+0000 7f03e177e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T11:23:39.504 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:39 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:39.211+0000 7f93063e0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T11:23:39.504 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:39 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:39.302+0000 7f93063e0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T11:23:39.509 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:39 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:39.215+0000 7f03e177e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T11:23:39.509 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:39 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:39.307+0000 7f03e177e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T11:23:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.580+0000 7f2dbc800700 1 -- 172.21.15.2:0/3031589110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2db40746c0 msgr2=0x7f2db4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.580+0000 7f2dbc800700 1 --2- 172.21.15.2:0/3031589110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2db40746c0 0x7f2db4074aa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009990 tx=0x7f2da8009ca0 comp rx=0 tx=0).stop 2024-06-13T11:23:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.580+0000 7f2dbc800700 1 -- 172.21.15.2:0/3031589110 shutdown_connections 2024-06-13T11:23:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.580+0000 7f2dbc800700 1 --2- 172.21.15.2:0/3031589110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2db410ee90 0x7f2db4111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.580+0000 7f2dbc800700 1 --2- 172.21.15.2:0/3031589110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2db40746c0 0x7f2db4074aa0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.580+0000 7f2dbc800700 1 --2- 172.21.15.2:0/3031589110 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2db4074fe0 0x7f2db410e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.580+0000 7f2dbc800700 1 -- 172.21.15.2:0/3031589110 >> 172.21.15.2:0/3031589110 conn(0x7f2db40795f0 msgr2=0x7f2db4079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:39.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.580+0000 7f2dbc800700 1 -- 172.21.15.2:0/3031589110 shutdown_connections 2024-06-13T11:23:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.581+0000 7f2dbc800700 1 -- 172.21.15.2:0/3031589110 wait complete. 2024-06-13T11:23:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.582+0000 7f2dbc800700 1 Processor -- start 2024-06-13T11:23:39.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.583+0000 7f2dbc800700 1 -- start start 2024-06-13T11:23:39.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.583+0000 7f2dbc800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2db40746c0 0x7f2db419ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.583+0000 7f2dbc800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2db4074fe0 0x7f2db419b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.583+0000 7f2dbc800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2db410ee90 0x7f2db419f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.583+0000 7f2dbc800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2db4114a50 con 0x7f2db410ee90 2024-06-13T11:23:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.583+0000 7f2dbc800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2db41148d0 con 0x7f2db4074fe0 2024-06-13T11:23:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.583+0000 7f2dbc800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2db4114bd0 con 0x7f2db40746c0 2024-06-13T11:23:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.584+0000 7f2db9e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2db40746c0 0x7f2db419ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.584+0000 7f2db9e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2db40746c0 0x7f2db419ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:33142/0 (socket says 172.21.15.2:33142) 2024-06-13T11:23:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.584+0000 7f2db9e00700 1 -- 172.21.15.2:0/3391394217 learned_addr learned my addr 172.21.15.2:0/3391394217 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:39.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.584+0000 7f2db9400700 1 --2- 172.21.15.2:0/3391394217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2db4074fe0 0x7f2db419b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:39.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.584+0000 7f2dba800700 1 --2- 172.21.15.2:0/3391394217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2db410ee90 0x7f2db419f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:39.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.584+0000 7f2db9e00700 1 -- 172.21.15.2:0/3391394217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2db4074fe0 msgr2=0x7f2db419b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:39.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.584+0000 7f2db9e00700 1 --2- 172.21.15.2:0/3391394217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2db4074fe0 0x7f2db419b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:39.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.584+0000 7f2db9e00700 1 -- 172.21.15.2:0/3391394217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2db410ee90 msgr2=0x7f2db419f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:39.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.584+0000 7f2db9e00700 1 --2- 172.21.15.2:0/3391394217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2db410ee90 0x7f2db419f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:39.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.584+0000 7f2db9e00700 1 -- 172.21.15.2:0/3391394217 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db419fe40 con 0x7f2db40746c0 2024-06-13T11:23:39.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.584+0000 7f2db9400700 1 --2- 172.21.15.2:0/3391394217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2db4074fe0 0x7f2db419b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:39.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.585+0000 7f2db9e00700 1 --2- 172.21.15.2:0/3391394217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2db40746c0 0x7f2db419ae80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2da800bae0 tx=0x7f2da800bb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:39.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.585+0000 7f2daea00700 1 -- 172.21.15.2:0/3391394217 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8026070 con 0x7f2db40746c0 2024-06-13T11:23:39.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.585+0000 7f2daea00700 1 -- 172.21.15.2:0/3391394217 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2da8003d70 con 0x7f2db40746c0 2024-06-13T11:23:39.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.585+0000 7f2daea00700 1 -- 172.21.15.2:0/3391394217 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8021410 con 0x7f2db40746c0 2024-06-13T11:23:39.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.585+0000 7f2dbc800700 1 -- 172.21.15.2:0/3391394217 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db41a00d0 con 0x7f2db40746c0 2024-06-13T11:23:39.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.585+0000 7f2dbc800700 1 -- 172.21.15.2:0/3391394217 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db41a79b0 con 0x7f2db40746c0 2024-06-13T11:23:39.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.587+0000 7f2dbc800700 1 -- 172.21.15.2:0/3391394217 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db4075df0 con 0x7f2db40746c0 2024-06-13T11:23:39.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.588+0000 7f2daea00700 1 -- 172.21.15.2:0/3391394217 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 19) ==== 137849+0+0 (secure 0 0 0) 0x7f2da8029070 con 0x7f2db40746c0 2024-06-13T11:23:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.590+0000 7f2daea00700 1 --2- 172.21.15.2:0/3391394217 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2d9c0a2c70 0x7f2d9c0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.590+0000 7f2daea00700 1 -- 172.21.15.2:0/3391394217 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f2da80d01d0 con 0x7f2db40746c0 2024-06-13T11:23:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.590+0000 7f2db9400700 1 -- 172.21.15.2:0/3391394217 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2d9c0a2c70 msgr2=0x7f2d9c0a5130 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3387272091 2024-06-13T11:23:39.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.590+0000 7f2db9400700 1 --2- 172.21.15.2:0/3391394217 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2d9c0a2c70 0x7f2d9c0a5130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:23:39.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.594+0000 7f2daea00700 1 -- 172.21.15.2:0/3391394217 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2da805d850 con 0x7f2db40746c0 2024-06-13T11:23:39.732 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:39 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:39.491+0000 7fd157619200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T11:23:39.789 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:39 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:39.505+0000 7f93063e0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T11:23:39.789 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:39 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:39.702+0000 7f93063e0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:23:39.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.791+0000 7f2db9400700 1 -- 172.21.15.2:0/3391394217 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2d9c0a2c70 msgr2=0x7f2d9c0a5130 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3387272091 2024-06-13T11:23:39.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.791+0000 7f2db9400700 1 --2- 172.21.15.2:0/3391394217 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2d9c0a2c70 0x7f2d9c0a5130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T11:23:39.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.867+0000 7f2dbc800700 1 -- 172.21.15.2:0/3391394217 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2db419c190 con 0x7f2db40746c0 2024-06-13T11:23:39.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.868+0000 7f2daea00700 1 -- 172.21.15.2:0/3391394217 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+88 (secure 0 0 0) 0x7f2da8013070 con 0x7f2db40746c0 2024-06-13T11:23:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-13T11:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.871+0000 7f2dbc800700 1 -- 172.21.15.2:0/3391394217 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2d9c0a2c70 msgr2=0x7f2d9c0a5130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.871+0000 7f2dbc800700 1 --2- 172.21.15.2:0/3391394217 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2d9c0a2c70 0x7f2d9c0a5130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.871+0000 7f2dbc800700 1 -- 172.21.15.2:0/3391394217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2db40746c0 msgr2=0x7f2db419ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.871+0000 7f2dbc800700 1 --2- 172.21.15.2:0/3391394217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2db40746c0 0x7f2db419ae80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2da800bae0 tx=0x7f2da800bb10 comp rx=0 tx=0).stop 2024-06-13T11:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.871+0000 7f2dbc800700 1 -- 172.21.15.2:0/3391394217 shutdown_connections 2024-06-13T11:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.871+0000 7f2dbc800700 1 --2- 172.21.15.2:0/3391394217 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2d9c0a2c70 0x7f2d9c0a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.871+0000 7f2dbc800700 1 --2- 172.21.15.2:0/3391394217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2db410ee90 0x7f2db419f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.871+0000 7f2dbc800700 1 --2- 172.21.15.2:0/3391394217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2db40746c0 0x7f2db419ae80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:39.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.871+0000 7f2dbc800700 1 --2- 172.21.15.2:0/3391394217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2db4074fe0 0x7f2db419b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:39.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.871+0000 7f2dbc800700 1 -- 172.21.15.2:0/3391394217 >> 172.21.15.2:0/3391394217 conn(0x7f2db40795f0 msgr2=0x7f2db40ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:39.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.871+0000 7f2dbc800700 1 -- 172.21.15.2:0/3391394217 shutdown_connections 2024-06-13T11:23:39.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:39.871+0000 7f2dbc800700 1 -- 172.21.15.2:0/3391394217 wait complete. 2024-06-13T11:23:39.919 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:39 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:39.511+0000 7f03e177e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T11:23:39.919 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:39 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:39.706+0000 7f03e177e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:23:40.145 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:39 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:39.733+0000 7fd157619200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T11:23:40.145 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:39 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:39.959+0000 7fd157619200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T11:23:40.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:39 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3391394217' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-13T11:23:40.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:39 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3391394217' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-13T11:23:40.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:39 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3391394217' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-13T11:23:40.645 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:40 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:40.360+0000 7fd157619200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T11:23:40.645 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:40 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:40.488+0000 7fd157619200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T11:23:40.696 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:40 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:40.313+0000 7f03e177e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T11:23:40.725 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:40 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:40.303+0000 7f93063e0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T11:23:40.812 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-13T11:23:40.812 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-13T11:23:40.812 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-06-13T11:23:40.812 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-13T11:23:40.812 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-13T11:23:40.812 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-13T11:23:40.812 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-13T11:23:40.812 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-13T11:23:40.812 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-13T11:23:40.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:23:40.813 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-06-13T11:23:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-13T11:23:40.866 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-13T11:23:40.866 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-06-13T11:23:40.866 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:23:40.866 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-06-13T11:23:40.867 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:23:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:23:40.867 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:23:40.867 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-06-13T11:23:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:23:40.867 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:23:40.867 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-06-13T11:23:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-13T11:23:40.867 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:23:40.867 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-06-13T11:23:40.867 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-06-13T11:23:40.867 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 41721sec preferred_lft 41721sec 2024-06-13T11:23:40.868 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2024-06-13T11:23:40.868 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-06-13T11:23:40.868 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T11:23:40.868 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-06-13T11:23:40.868 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-06-13T11:23:40.869 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-13T11:23:40.869 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:23:40.869 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T11:23:40.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-06-13T11:23:40.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-06-13T11:23:40.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-06-13T11:23:40.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-13T11:23:40.869 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T11:23:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:23:40.993 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:40 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:40.754+0000 7fd157619200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T11:23:41.025 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:40 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:40.726+0000 7f93063e0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T11:23:41.025 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:40 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:40.823+0000 7f93063e0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T11:23:41.025 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:41.026+0000 7f93063e0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T11:23:41.036 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:40 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:40.737+0000 7f03e177e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T11:23:41.036 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:40 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:40.834+0000 7f03e177e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T11:23:41.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:23:41.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:23:41.103 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-13T11:23:41.162 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-06-13T11:23:41.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:23:41.167 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-06-13T11:23:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-06-13T11:23:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-13T11:23:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-13T11:23:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-13T11:23:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-13T11:23:41.205 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:23:41.205 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T11:23:41.205 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-13T11:23:41.205 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-13T11:23:41.205 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-13T11:23:41.205 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T11:23:41.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:23:41.362 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:41 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:41.042+0000 7fd157619200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T11:23:41.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:23:41.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:23:41.434 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-06-13T11:23:41.446 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:41.038+0000 7f03e177e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T11:23:41.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:23:41.476 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-06-13T11:23:41.567 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:23:41.567 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T11:23:41.567 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-13T11:23:41.567 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-06-13T11:23:41.567 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T11:23:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:23:41.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:23:41.746 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-06-13T11:23:41.747 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:23:41.747 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T11:23:41.747 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-06-13T11:23:41.747 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-13T11:23:41.747 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-06-13T11:23:41.747 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-06-13T11:23:41.747 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-06-13T11:23:41.747 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T11:23:41.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:23:41.879 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:41.544+0000 7f93063e0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T11:23:41.879 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:41.636+0000 7f93063e0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T11:23:41.901 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:41.564+0000 7f03e177e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T11:23:41.902 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:41.658+0000 7f03e177e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T11:23:41.942 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:41 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:41.896+0000 7fd157619200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T11:23:42.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:23:42.009 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T11:23:42.009 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T11:23:42.009 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-06-13T11:23:42.010 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-06-13T11:23:42.010 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T11:23:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:23:42.196 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:41.903+0000 7f03e177e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T11:23:42.196 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:42 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:42.038+0000 7f03e177e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T11:23:42.196 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:42 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:42.135+0000 7f03e177e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T11:23:42.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:23:42.211 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T11:23:42.212 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-13T11:23:42.225 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:41.880+0000 7f93063e0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T11:23:42.225 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:42 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:42.014+0000 7f93063e0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T11:23:42.225 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:42 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:42.109+0000 7f93063e0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T11:23:42.225 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:42 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:42.226+0000 7f93063e0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T11:23:42.252 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-13T11:23:42.253 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T11:23:42.253 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-13T11:23:42.340 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-06-13T11:23:42.340 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-06-13T11:23:42.340 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/9e273771-c2ec-44e8-bad9-d56daaf6a806 2024-06-13T11:23:42.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:23:42.341 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/9e273771-c2ec-44e8-bad9-d56daaf6a806 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-06-13T11:23:42.502 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-06-13T11:23:42.502 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-06-13T11:23:42.555 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:42 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:42.252+0000 7f03e177e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T11:23:42.780 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:42 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:42.495+0000 7fd157619200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T11:23:42.780 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:42 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:42.636+0000 7fd157619200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T11:23:42.789 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:42 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:42.523+0000 7f93063e0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T11:23:42.946 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:42 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:42.556+0000 7f03e177e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T11:23:43.145 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:42 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:42.922+0000 7fd157619200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T11:23:43.264 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-06-13T11:23:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-06-13T11:23:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.77:3300,172.21.15.178:3300" 2024-06-13T11:23:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with new device syntax: 0@3611563c-2975-11ef-bc9c-c7b262605968.cephfs=/volumes/qa/sv_1/9e273771-c2ec-44e8-bad9-d56daaf6a806 2024-06-13T11:23:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.2:3300/172.21.15.77:3300/172.21.15.178:3300" will pass to kernel 2024-06-13T11:23:43.269 INFO:teuthology.orchestra.run.smithi002.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-06-13T11:23:43.269 INFO:teuthology.orchestra.run.smithi002.stdout: You just mounted a file system that supports labels which does not 2024-06-13T11:23:43.269 INFO:teuthology.orchestra.run.smithi002.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-06-13T11:23:43.269 INFO:teuthology.orchestra.run.smithi002.stdout: applications will generate AVC messages and not be allowed access to 2024-06-13T11:23:43.269 INFO:teuthology.orchestra.run.smithi002.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-06-13T11:23:43.273 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-13T11:23:43.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:23:43.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-13T11:23:43.344 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T11:23:43.415 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:43 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:43.161+0000 7f03e177e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T11:23:43.415 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:23:43 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z[38698]: 2024-06-13T11:23:43.379+0000 7f03e177e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T11:23:43.416 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:43 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:43.126+0000 7f93063e0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T11:23:43.416 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:23:43 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y[37781]: 2024-06-13T11:23:43.346+0000 7f93063e0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T11:23:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:23:43.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:23:43.462 INFO:teuthology.orchestra.run.smithi002.stdout:client25133 2024-06-13T11:23:43.462 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:23:43.462 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:23:43.504 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T11:23:43.620 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:43 smithi002 ceph-mon[32210]: Standby manager daemon y restarted 2024-06-13T11:23:43.620 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:43 smithi002 ceph-mon[32210]: Standby manager daemon y started 2024-06-13T11:23:43.620 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:43 smithi002 ceph-mon[32210]: from='mgr.? 172.21.15.77:0/3244403154' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-13T11:23:43.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:43 smithi002 ceph-mon[32210]: from='mgr.? 172.21.15.77:0/3244403154' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T11:23:43.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:43 smithi002 ceph-mon[32210]: from='mgr.? 172.21.15.77:0/3244403154' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-13T11:23:43.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:43 smithi002 ceph-mon[32210]: from='mgr.? 172.21.15.77:0/3244403154' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T11:23:43.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:43 smithi002 ceph-mon[32210]: Standby manager daemon z restarted 2024-06-13T11:23:43.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:43 smithi002 ceph-mon[32210]: Standby manager daemon z started 2024-06-13T11:23:43.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:43 smithi002 ceph-mon[32210]: from='mgr.? 172.21.15.178:0/3231366158' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-13T11:23:43.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:43 smithi002 ceph-mon[32210]: from='mgr.? 172.21.15.178:0/3231366158' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T11:23:43.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:43 smithi002 ceph-mon[32210]: from='mgr.? 172.21.15.178:0/3231366158' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-13T11:23:43.621 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:43 smithi002 ceph-mon[32210]: from='mgr.? 172.21.15.178:0/3231366158' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T11:23:43.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:23:43.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:23:43.666 INFO:teuthology.orchestra.run.smithi002.stdout:client25133 2024-06-13T11:23:43.667 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T11:23:43.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:43 smithi178 ceph-mon[36913]: Standby manager daemon y restarted 2024-06-13T11:23:43.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:43 smithi178 ceph-mon[36913]: Standby manager daemon y started 2024-06-13T11:23:43.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:43 smithi178 ceph-mon[36913]: from='mgr.? 172.21.15.77:0/3244403154' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-13T11:23:43.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:43 smithi178 ceph-mon[36913]: from='mgr.? 172.21.15.77:0/3244403154' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T11:23:43.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:43 smithi178 ceph-mon[36913]: from='mgr.? 172.21.15.77:0/3244403154' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-13T11:23:43.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:43 smithi178 ceph-mon[36913]: from='mgr.? 172.21.15.77:0/3244403154' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T11:23:43.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:43 smithi178 ceph-mon[36913]: Standby manager daemon z restarted 2024-06-13T11:23:43.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:43 smithi178 ceph-mon[36913]: Standby manager daemon z started 2024-06-13T11:23:43.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:43 smithi178 ceph-mon[36913]: from='mgr.? 172.21.15.178:0/3231366158' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-13T11:23:43.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:43 smithi178 ceph-mon[36913]: from='mgr.? 172.21.15.178:0/3231366158' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T11:23:43.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:43 smithi178 ceph-mon[36913]: from='mgr.? 172.21.15.178:0/3231366158' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-13T11:23:43.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:43 smithi178 ceph-mon[36913]: from='mgr.? 172.21.15.178:0/3231366158' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T11:23:43.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T11:23:43.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:23:43.789 INFO:teuthology.orchestra.run.smithi002.stdout:client25133 2024-06-13T11:23:43.790 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3611563c-2975-11ef-bc9c-c7b262605968.client25133/status') 2024-06-13T11:23:43.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:43 smithi077 ceph-mon[36410]: Standby manager daemon y restarted 2024-06-13T11:23:43.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:43 smithi077 ceph-mon[36410]: Standby manager daemon y started 2024-06-13T11:23:43.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:43 smithi077 ceph-mon[36410]: from='mgr.? 172.21.15.77:0/3244403154' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-13T11:23:43.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:43 smithi077 ceph-mon[36410]: from='mgr.? 172.21.15.77:0/3244403154' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T11:23:43.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:43 smithi077 ceph-mon[36410]: from='mgr.? 172.21.15.77:0/3244403154' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-13T11:23:43.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:43 smithi077 ceph-mon[36410]: from='mgr.? 172.21.15.77:0/3244403154' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T11:23:43.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:43 smithi077 ceph-mon[36410]: Standby manager daemon z restarted 2024-06-13T11:23:43.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:43 smithi077 ceph-mon[36410]: Standby manager daemon z started 2024-06-13T11:23:43.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:43 smithi077 ceph-mon[36410]: from='mgr.? 172.21.15.178:0/3231366158' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-13T11:23:43.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:43 smithi077 ceph-mon[36410]: from='mgr.? 172.21.15.178:0/3231366158' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T11:23:43.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:43 smithi077 ceph-mon[36410]: from='mgr.? 172.21.15.178:0/3231366158' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-13T11:23:43.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:43 smithi077 ceph-mon[36410]: from='mgr.? 172.21.15.178:0/3231366158' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T11:23:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T11:23:43.895 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:43 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:43.621+0000 7fd157619200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T11:23:43.895 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:43 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:43.753+0000 7fd157619200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T11:23:43.917 INFO:teuthology.orchestra.run.smithi002.stdout:instance: client.25133 (3)172.21.15.2:0/2119105781 2024-06-13T11:23:43.917 INFO:teuthology.orchestra.run.smithi002.stdout:blocklisted: false 2024-06-13T11:23:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records in 2024-06-13T11:23:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records out 2024-06-13T11:23:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:70 bytes copied, 6.4746e-05 s, 1.1 MB/s 2024-06-13T11:23:43.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T11:23:43.930 INFO:teuthology.run_tasks:Running task exec... 2024-06-13T11:23:43.942 INFO:teuthology.task.exec:Executing custom commands... 2024-06-13T11:23:43.942 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T11:23:43.942 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-06-13T11:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.130+0000 7fae14400640 1 -- 172.21.15.2:0/4062651450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae0c1035c0 msgr2=0x7fae0c109e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.130+0000 7fae14400640 1 --2- 172.21.15.2:0/4062651450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae0c1035c0 0x7fae0c109e50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fae04009ca0 tx=0x7fae0402a8c0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.131+0000 7fae14400640 1 -- 172.21.15.2:0/4062651450 shutdown_connections 2024-06-13T11:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.131+0000 7fae14400640 1 --2- 172.21.15.2:0/4062651450 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae0c102c00 0x7fae0c103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.131+0000 7fae14400640 1 --2- 172.21.15.2:0/4062651450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae0c1035c0 0x7fae0c109e50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.131+0000 7fae14400640 1 --2- 172.21.15.2:0/4062651450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101a10 0x7fae0c101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.131+0000 7fae14400640 1 -- 172.21.15.2:0/4062651450 >> 172.21.15.2:0/4062651450 conn(0x7fae0c0fcf80 msgr2=0x7fae0c0ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:44.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.131+0000 7fae14400640 1 -- 172.21.15.2:0/4062651450 shutdown_connections 2024-06-13T11:23:44.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.131+0000 7fae14400640 1 -- 172.21.15.2:0/4062651450 wait complete. 2024-06-13T11:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.132+0000 7fae14400640 1 Processor -- start 2024-06-13T11:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.132+0000 7fae14400640 1 -- start start 2024-06-13T11:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.132+0000 7fae14400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101a10 0x7fae0c199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.132+0000 7fae14400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae0c102c00 0x7fae0c19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.133+0000 7fae14400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae0c1035c0 0x7fae0c1a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.133+0000 7fae14400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c10d690 con 0x7fae0c101a10 2024-06-13T11:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.133+0000 7fae14400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c10d510 con 0x7fae0c102c00 2024-06-13T11:23:44.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.133+0000 7fae14400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c10d810 con 0x7fae0c1035c0 2024-06-13T11:23:44.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.133+0000 7fae11a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101a10 0x7fae0c199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:44.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.133+0000 7fae11a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101a10 0x7fae0c199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37376/0 (socket says 172.21.15.2:37376) 2024-06-13T11:23:44.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.133+0000 7fae11a00640 1 -- 172.21.15.2:0/2860788135 learned_addr learned my addr 172.21.15.2:0/2860788135 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:44.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.133+0000 7fae11000640 1 --2- 172.21.15.2:0/2860788135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae0c102c00 0x7fae0c19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:44.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.133+0000 7fae12400640 1 --2- 172.21.15.2:0/2860788135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae0c1035c0 0x7fae0c1a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:44.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.133+0000 7fae11a00640 1 -- 172.21.15.2:0/2860788135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae0c1035c0 msgr2=0x7fae0c1a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:44.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.133+0000 7fae11a00640 1 --2- 172.21.15.2:0/2860788135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae0c1035c0 0x7fae0c1a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.133+0000 7fae11a00640 1 -- 172.21.15.2:0/2860788135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae0c102c00 msgr2=0x7fae0c19a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:44.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.133+0000 7fae11a00640 1 --2- 172.21.15.2:0/2860788135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae0c102c00 0x7fae0c19a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.133+0000 7fae11a00640 1 -- 172.21.15.2:0/2860788135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0c1a1b20 con 0x7fae0c101a10 2024-06-13T11:23:44.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.133+0000 7fae11000640 1 --2- 172.21.15.2:0/2860788135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae0c102c00 0x7fae0c19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:44.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.134+0000 7fae11a00640 1 --2- 172.21.15.2:0/2860788135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101a10 0x7fae0c199f00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fae0000e9c0 tx=0x7fae0000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:44.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.134+0000 7fae0a000640 1 -- 172.21.15.2:0/2860788135 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0000cde0 con 0x7fae0c101a10 2024-06-13T11:23:44.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.134+0000 7fae14400640 1 -- 172.21.15.2:0/2860788135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae0c1a1e10 con 0x7fae0c101a10 2024-06-13T11:23:44.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.134+0000 7fae0a000640 1 -- 172.21.15.2:0/2860788135 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae00010910 con 0x7fae0c101a10 2024-06-13T11:23:44.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.134+0000 7fae0a000640 1 -- 172.21.15.2:0/2860788135 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00018a10 con 0x7fae0c101a10 2024-06-13T11:23:44.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.134+0000 7fae14400640 1 -- 172.21.15.2:0/2860788135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae0c1a22d0 con 0x7fae0c101a10 2024-06-13T11:23:44.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.135+0000 7fae14400640 1 -- 172.21.15.2:0/2860788135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae0c1a2530 con 0x7fae0c101a10 2024-06-13T11:23:44.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.137+0000 7fae0a000640 1 -- 172.21.15.2:0/2860788135 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) ==== 137849+0+0 (secure 0 0 0) 0x7fae0001f020 con 0x7fae0c101a10 2024-06-13T11:23:44.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.140+0000 7fae0a000640 1 --2- 172.21.15.2:0/2860788135 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fadf40a2bd0 0x7fadf40a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:44.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.140+0000 7fae11000640 1 -- 172.21.15.2:0/2860788135 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fadf40a2bd0 msgr2=0x7fadf40a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3387272091 2024-06-13T11:23:44.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.140+0000 7fae0a000640 1 -- 172.21.15.2:0/2860788135 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fae000cf6a0 con 0x7fae0c101a10 2024-06-13T11:23:44.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.140+0000 7fae11000640 1 --2- 172.21.15.2:0/2860788135 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fadf40a2bd0 0x7fadf40a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:23:44.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.145+0000 7fae0a000640 1 -- 172.21.15.2:0/2860788135 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fae0009c210 con 0x7fae0c101a10 2024-06-13T11:23:44.298 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:44 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:44.101+0000 7fd157619200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T11:23:44.299 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:44 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:44.299+0000 7fd157619200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T11:23:44.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.341+0000 7fae11000640 1 -- 172.21.15.2:0/2860788135 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fadf40a2bd0 msgr2=0x7fadf40a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3387272091 2024-06-13T11:23:44.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.341+0000 7fae11000640 1 --2- 172.21.15.2:0/2860788135 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fadf40a2bd0 0x7fadf40a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T11:23:44.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.391+0000 7fae14400640 1 -- 172.21.15.2:0/2860788135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fae0c1a2880 con 0x7fae0c101a10 2024-06-13T11:23:44.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.418+0000 7fae0a000640 1 -- 172.21.15.2:0/2860788135 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v27) ==== 117+0+0 (secure 0 0 0) 0x7fae0009bb10 con 0x7fae0c101a10 2024-06-13T11:23:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.421+0000 7fae14400640 1 -- 172.21.15.2:0/2860788135 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fadf40a2bd0 msgr2=0x7fadf40a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:23:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.421+0000 7fae14400640 1 --2- 172.21.15.2:0/2860788135 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fadf40a2bd0 0x7fadf40a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.421+0000 7fae14400640 1 -- 172.21.15.2:0/2860788135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101a10 msgr2=0x7fae0c199f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.421+0000 7fae14400640 1 --2- 172.21.15.2:0/2860788135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101a10 0x7fae0c199f00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fae0000e9c0 tx=0x7fae0000ee80 comp rx=0 tx=0).stop 2024-06-13T11:23:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.421+0000 7fae14400640 1 -- 172.21.15.2:0/2860788135 shutdown_connections 2024-06-13T11:23:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.421+0000 7fae14400640 1 --2- 172.21.15.2:0/2860788135 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fadf40a2bd0 0x7fadf40a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.421+0000 7fae14400640 1 --2- 172.21.15.2:0/2860788135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae0c1035c0 0x7fae0c1a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.421+0000 7fae14400640 1 --2- 172.21.15.2:0/2860788135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae0c102c00 0x7fae0c19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.421+0000 7fae14400640 1 --2- 172.21.15.2:0/2860788135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae0c101a10 0x7fae0c199f00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.421+0000 7fae14400640 1 -- 172.21.15.2:0/2860788135 >> 172.21.15.2:0/2860788135 conn(0x7fae0c0fcf80 msgr2=0x7fae0c073bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.421+0000 7fae14400640 1 -- 172.21.15.2:0/2860788135 shutdown_connections 2024-06-13T11:23:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.421+0000 7fae14400640 1 -- 172.21.15.2:0/2860788135 wait complete. 2024-06-13T11:23:44.441 INFO:teuthology.run_tasks:Running task check-counter... 2024-06-13T11:23:44.452 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-06-13T11:23:44.504 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:23:44.566 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:44 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:44.440+0000 7fd157619200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T11:23:44.567 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:44 smithi002 ceph-mon[32210]: mgrmap e20: x(active, since 13m), standbys: y, z 2024-06-13T11:23:44.567 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:44 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2860788135' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-13T11:23:44.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.693+0000 7f95a4a00640 1 -- 172.21.15.2:0/3220576064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a01018f0 msgr2=0x7f95a0101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:44.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.693+0000 7f95a4a00640 1 --2- 172.21.15.2:0/3220576064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a01018f0 0x7f95a0101d10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9590009860 tx=0x7f959002a340 comp rx=0 tx=0).stop 2024-06-13T11:23:44.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.693+0000 7f95a4a00640 1 -- 172.21.15.2:0/3220576064 shutdown_connections 2024-06-13T11:23:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.693+0000 7f95a4a00640 1 --2- 172.21.15.2:0/3220576064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95a01034a0 0x7f95a0109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.693+0000 7f95a4a00640 1 --2- 172.21.15.2:0/3220576064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a0102ae0 0x7f95a0102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.693+0000 7f95a4a00640 1 --2- 172.21.15.2:0/3220576064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a01018f0 0x7f95a0101d10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.693+0000 7f95a4a00640 1 -- 172.21.15.2:0/3220576064 >> 172.21.15.2:0/3220576064 conn(0x7f95a00fce60 msgr2=0x7f95a00ff2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.693+0000 7f95a4a00640 1 -- 172.21.15.2:0/3220576064 shutdown_connections 2024-06-13T11:23:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.693+0000 7f95a4a00640 1 -- 172.21.15.2:0/3220576064 wait complete. 2024-06-13T11:23:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.694+0000 7f95a4a00640 1 Processor -- start 2024-06-13T11:23:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.694+0000 7f95a4a00640 1 -- start start 2024-06-13T11:23:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.695+0000 7f95a4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a01018f0 0x7f95a0075750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.695+0000 7f95a4a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95a0102ae0 0x7f95a0073d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.695+0000 7f95a4a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a01034a0 0x7f95a00742d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.695+0000 7f95a4a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f95a010d570 con 0x7f95a01018f0 2024-06-13T11:23:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.695+0000 7f95a4a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f95a010d3f0 con 0x7f95a01034a0 2024-06-13T11:23:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.695+0000 7f95a4a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f95a010d6f0 con 0x7f95a0102ae0 2024-06-13T11:23:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.695+0000 7f959e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a01018f0 0x7f95a0075750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.695+0000 7f9597e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95a0102ae0 0x7f95a0073d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.695+0000 7f959e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a01018f0 0x7f95a0075750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37390/0 (socket says 172.21.15.2:37390) 2024-06-13T11:23:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.695+0000 7f959e800640 1 -- 172.21.15.2:0/484291891 learned_addr learned my addr 172.21.15.2:0/484291891 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.695+0000 7f959f200640 1 --2- 172.21.15.2:0/484291891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a01034a0 0x7f95a00742d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.696+0000 7f9597e00640 1 -- 172.21.15.2:0/484291891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a01034a0 msgr2=0x7f95a00742d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.696+0000 7f9597e00640 1 --2- 172.21.15.2:0/484291891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a01034a0 0x7f95a00742d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.696+0000 7f9597e00640 1 -- 172.21.15.2:0/484291891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a01018f0 msgr2=0x7f95a0075750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.696+0000 7f9597e00640 1 --2- 172.21.15.2:0/484291891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a01018f0 0x7f95a0075750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.696+0000 7f9597e00640 1 -- 172.21.15.2:0/484291891 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a0074b60 con 0x7f95a0102ae0 2024-06-13T11:23:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.696+0000 7f9597e00640 1 --2- 172.21.15.2:0/484291891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95a0102ae0 0x7f95a0073d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9588005fd0 tx=0x7f958800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.696+0000 7f9597400640 1 -- 172.21.15.2:0/484291891 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958800cd00 con 0x7f95a0102ae0 2024-06-13T11:23:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.696+0000 7f95a4a00640 1 -- 172.21.15.2:0/484291891 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a01a1d00 con 0x7f95a0102ae0 2024-06-13T11:23:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.696+0000 7f9597400640 1 -- 172.21.15.2:0/484291891 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95880035f0 con 0x7f95a0102ae0 2024-06-13T11:23:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.696+0000 7f9597400640 1 -- 172.21.15.2:0/484291891 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9588010690 con 0x7f95a0102ae0 2024-06-13T11:23:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.696+0000 7f95a4a00640 1 -- 172.21.15.2:0/484291891 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a01a21e0 con 0x7f95a0102ae0 2024-06-13T11:23:44.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:44 smithi178 ceph-mon[36913]: mgrmap e20: x(active, since 13m), standbys: y, z 2024-06-13T11:23:44.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:44 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2860788135' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-13T11:23:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.697+0000 7f95a4a00640 1 -- 172.21.15.2:0/484291891 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a0108c60 con 0x7f95a0102ae0 2024-06-13T11:23:44.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.699+0000 7f9597400640 1 -- 172.21.15.2:0/484291891 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137849+0+0 (secure 0 0 0) 0x7f95880037a0 con 0x7f95a0102ae0 2024-06-13T11:23:44.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.701+0000 7f9597400640 1 --2- 172.21.15.2:0/484291891 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f95840a2bd0 0x7f95840a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:44.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.701+0000 7f9597400640 1 -- 172.21.15.2:0/484291891 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f95880cf690 con 0x7f95a0102ae0 2024-06-13T11:23:44.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.701+0000 7f959e800640 1 -- 172.21.15.2:0/484291891 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f95840a2bd0 msgr2=0x7f95840a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3387272091 2024-06-13T11:23:44.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.701+0000 7f959e800640 1 --2- 172.21.15.2:0/484291891 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f95840a2bd0 0x7f95840a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:23:44.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.703+0000 7f9597400640 1 -- 172.21.15.2:0/484291891 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f958809c260 con 0x7f95a0102ae0 2024-06-13T11:23:44.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:44 smithi077 ceph-mon[36410]: mgrmap e20: x(active, since 13m), standbys: y, z 2024-06-13T11:23:44.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:44 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2860788135' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-06-13T11:23:44.895 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:44 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:44.601+0000 7fd157619200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T11:23:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.902+0000 7f959e800640 1 -- 172.21.15.2:0/484291891 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f95840a2bd0 msgr2=0x7f95840a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3387272091 2024-06-13T11:23:44.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.902+0000 7f959e800640 1 --2- 172.21.15.2:0/484291891 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f95840a2bd0 0x7f95840a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T11:23:44.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.907+0000 7f95a4a00640 1 -- 172.21.15.2:0/484291891 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95a002d530 con 0x7f95a0102ae0 2024-06-13T11:23:44.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.909+0000 7f9597400640 1 -- 172.21.15.2:0/484291891 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24612 (secure 0 0 0) 0x7f958809bb60 con 0x7f95a0102ae0 2024-06-13T11:23:44.908 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:23:44.909 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":99,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","created":"2024-06-13T11:09:07.839101+0000","modified":"2024-06-13T11:20:27.512678+0000","last_up_change":"2024-06-13T11:17:28.731479+0000","last_in_change":"2024-06-13T11:17:08.849067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:13:13.793461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:18:36.784824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:18:41.824835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:18:55.545870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f5614d91-49a7-4983-a309-0de3b3e6263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6803","nonce":4127571834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6805","nonce":4127571834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6809","nonce":4127571834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6807","nonce":4127571834}]},"public_addr":"172.21.15.2:6803/4127571834","cluster_addr":"172.21.15.2:6805/4127571834","heartbeat_back_addr":"172.21.15.2:6809/4127571834","heartbeat_front_addr":"172.21.15.2:6807/4127571834","state":["exists","up"]},{"osd":1,"uuid":"d9dbe278-309f-4726-828a-da922f486b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6801","nonce":3180360713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6803","nonce":3180360713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6807","nonce":3180360713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6805","nonce":3180360713}]},"public_addr":"172.21.15.77:6801/3180360713","cluster_addr":"172.21.15.77:6803/3180360713","heartbeat_back_addr":"172.21.15.77:6807/3180360713","heartbeat_front_addr":"172.21.15.77:6805/3180360713","state":["exists","up"]},{"osd":2,"uuid":"04c267dc-7454-418f-9965-3ff96ef280ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6801","nonce":3825510575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6803","nonce":3825510575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6807","nonce":3825510575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6805","nonce":3825510575}]},"public_addr":"172.21.15.178:6801/3825510575","cluster_addr":"172.21.15.178:6803/3825510575","heartbeat_back_addr":"172.21.15.178:6807/3825510575","heartbeat_front_addr":"172.21.15.178:6805/3825510575","state":["exists","up"]},{"osd":3,"uuid":"3847bd4f-ca04-41de-9d88-e1523dd7ff8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6811","nonce":1982693353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6813","nonce":1982693353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6817","nonce":1982693353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6815","nonce":1982693353}]},"public_addr":"172.21.15.2:6811/1982693353","cluster_addr":"172.21.15.2:6813/1982693353","heartbeat_back_addr":"172.21.15.2:6817/1982693353","heartbeat_front_addr":"172.21.15.2:6815/1982693353","state":["exists","up"]},{"osd":4,"uuid":"34d7d2e8-3dee-42b9-a6cb-d4162b122b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6809","nonce":3916694904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6811","nonce":3916694904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6815","nonce":3916694904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6813","nonce":3916694904}]},"public_addr":"172.21.15.77:6809/3916694904","cluster_addr":"172.21.15.77:6811/3916694904","heartbeat_back_addr":"172.21.15.77:6815/3916694904","heartbeat_front_addr":"172.21.15.77:6813/3916694904","state":["exists","up"]},{"osd":5,"uuid":"0468aefc-c3c8-4758-9bbf-1225b7a5ae79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6809","nonce":3572805887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6811","nonce":3572805887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6815","nonce":3572805887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6813","nonce":3572805887}]},"public_addr":"172.21.15.178:6809/3572805887","cluster_addr":"172.21.15.178:6811/3572805887","heartbeat_back_addr":"172.21.15.178:6815/3572805887","heartbeat_front_addr":"172.21.15.178:6813/3572805887","state":["exists","up"]},{"osd":6,"uuid":"0a186a4a-0e28-47bd-b5ad-9bf8079f74c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6819","nonce":1592309584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6821","nonce":1592309584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6825","nonce":1592309584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6823","nonce":1592309584}]},"public_addr":"172.21.15.2:6819/1592309584","cluster_addr":"172.21.15.2:6821/1592309584","heartbeat_back_addr":"172.21.15.2:6825/1592309584","heartbeat_front_addr":"172.21.15.2:6823/1592309584","state":["exists","up"]},{"osd":7,"uuid":"646e66f7-1ef8-428d-a842-bf28c8606df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6817","nonce":1580055775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6819","nonce":1580055775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6823","nonce":1580055775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6821","nonce":1580055775}]},"public_addr":"172.21.15.77:6817/1580055775","cluster_addr":"172.21.15.77:6819/1580055775","heartbeat_back_addr":"172.21.15.77:6823/1580055775","heartbeat_front_addr":"172.21.15.77:6821/1580055775","state":["exists","up"]},{"osd":8,"uuid":"bcc971fc-47d7-4289-8a9a-c76996c57370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6817","nonce":4285192591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6819","nonce":4285192591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6823","nonce":4285192591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6821","nonce":4285192591}]},"public_addr":"172.21.15.178:6817/4285192591","cluster_addr":"172.21.15.178:6819/4285192591","heartbeat_back_addr":"172.21.15.178:6823/4285192591","heartbeat_front_addr":"172.21.15.178:6821/4285192591","state":["exists","up"]},{"osd":9,"uuid":"899d7d4f-a24c-4508-b42c-0b363275c459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6827","nonce":4187017478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6829","nonce":4187017478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6833","nonce":4187017478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6831","nonce":4187017478}]},"public_addr":"172.21.15.2:6827/4187017478","cluster_addr":"172.21.15.2:6829/4187017478","heartbeat_back_addr":"172.21.15.2:6833/4187017478","heartbeat_front_addr":"172.21.15.2:6831/4187017478","state":["exists","up"]},{"osd":10,"uuid":"112d2b8e-9673-4d7a-97e9-2089793fdd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6825","nonce":2039538463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6827","nonce":2039538463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6831","nonce":2039538463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6829","nonce":2039538463}]},"public_addr":"172.21.15.77:6825/2039538463","cluster_addr":"172.21.15.77:6827/2039538463","heartbeat_back_addr":"172.21.15.77:6831/2039538463","heartbeat_front_addr":"172.21.15.77:6829/2039538463","state":["exists","up"]},{"osd":11,"uuid":"6b8001f5-9c74-4cc7-8c41-906cb5ac9b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6825","nonce":1915058767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6827","nonce":1915058767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6831","nonce":1915058767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6829","nonce":1915058767}]},"public_addr":"172.21.15.178:6825/1915058767","cluster_addr":"172.21.15.178:6827/1915058767","heartbeat_back_addr":"172.21.15.178:6831/1915058767","heartbeat_front_addr":"172.21.15.178:6829/1915058767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:21.707572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:46.440115+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:10.197217+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:42.853367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:08.880473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:33.605677+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:07.655377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:33.980900+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:59.397529+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:16:33.983411+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:00.932649+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:26.894098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9},{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/315567313":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/2084201061":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/3394644803":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6801/1821969949":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/2170469985":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/142516651":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6801/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/3220886565":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6800/1821969949":"2024-06-14T11:10:25.084617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:23:44.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.912+0000 7f95a4a00640 1 -- 172.21.15.2:0/484291891 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f95840a2bd0 msgr2=0x7f95840a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:23:44.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.912+0000 7f95a4a00640 1 --2- 172.21.15.2:0/484291891 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f95840a2bd0 0x7f95840a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.912+0000 7f95a4a00640 1 -- 172.21.15.2:0/484291891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95a0102ae0 msgr2=0x7f95a0073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:44.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.912+0000 7f95a4a00640 1 --2- 172.21.15.2:0/484291891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95a0102ae0 0x7f95a0073d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9588005fd0 tx=0x7f958800ee50 comp rx=0 tx=0).stop 2024-06-13T11:23:44.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.912+0000 7f95a4a00640 1 -- 172.21.15.2:0/484291891 shutdown_connections 2024-06-13T11:23:44.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.912+0000 7f95a4a00640 1 --2- 172.21.15.2:0/484291891 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f95840a2bd0 0x7f95840a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.912+0000 7f95a4a00640 1 --2- 172.21.15.2:0/484291891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95a0102ae0 0x7f95a0073d90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.912+0000 7f95a4a00640 1 --2- 172.21.15.2:0/484291891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a01034a0 0x7f95a00742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.912+0000 7f95a4a00640 1 --2- 172.21.15.2:0/484291891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a01018f0 0x7f95a0075750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:44.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.912+0000 7f95a4a00640 1 -- 172.21.15.2:0/484291891 >> 172.21.15.2:0/484291891 conn(0x7f95a00fce60 msgr2=0x7f95a0105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:44.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.912+0000 7f95a4a00640 1 -- 172.21.15.2:0/484291891 shutdown_connections 2024-06-13T11:23:44.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:44.912+0000 7f95a4a00640 1 -- 172.21.15.2:0/484291891 wait complete. 2024-06-13T11:23:44.929 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-13T11:13:13.793461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-13T11:18:36.784824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-13T11:18:41.824835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-13T11:18:55.545870+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-13T11:23:44.929 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-13T11:23:45.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.128+0000 7f2eea400640 1 -- 172.21.15.2:0/4094804490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee41098b0 msgr2=0x7f2ee410bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.128+0000 7f2eea400640 1 --2- 172.21.15.2:0/4094804490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee41098b0 0x7f2ee410bd40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009be0 tx=0x7f2edc02a6c0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.128+0000 7f2eea400640 1 -- 172.21.15.2:0/4094804490 shutdown_connections 2024-06-13T11:23:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.128+0000 7f2eea400640 1 --2- 172.21.15.2:0/4094804490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4074400 0x7f2ee4074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.128+0000 7f2eea400640 1 --2- 172.21.15.2:0/4094804490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee41098b0 0x7f2ee410bd40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.128+0000 7f2eea400640 1 --2- 172.21.15.2:0/4094804490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ee40759e0 0x7f2ee4073e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.128+0000 7f2eea400640 1 -- 172.21.15.2:0/4094804490 >> 172.21.15.2:0/4094804490 conn(0x7f2ee40fcf60 msgr2=0x7f2ee40ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.129+0000 7f2eea400640 1 -- 172.21.15.2:0/4094804490 shutdown_connections 2024-06-13T11:23:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.129+0000 7f2eea400640 1 -- 172.21.15.2:0/4094804490 wait complete. 2024-06-13T11:23:45.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.130+0000 7f2eea400640 1 Processor -- start 2024-06-13T11:23:45.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.130+0000 7f2eea400640 1 -- start start 2024-06-13T11:23:45.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.130+0000 7f2eea400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4074400 0x7f2ee4199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:45.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.130+0000 7f2eea400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ee40759e0 0x7f2ee419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:45.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.130+0000 7f2eea400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee41098b0 0x7f2ee41a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.130+0000 7f2eea400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee410f830 con 0x7f2ee40759e0 2024-06-13T11:23:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.130+0000 7f2eea400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee410f6b0 con 0x7f2ee41098b0 2024-06-13T11:23:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.130+0000 7f2eea400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee410f9b0 con 0x7f2ee4074400 2024-06-13T11:23:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.131+0000 7f2ee3400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4074400 0x7f2ee4199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.131+0000 7f2ee3e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee41098b0 0x7f2ee41a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.131+0000 7f2ee3400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4074400 0x7f2ee4199e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:33188/0 (socket says 172.21.15.2:33188) 2024-06-13T11:23:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.131+0000 7f2edaa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ee40759e0 0x7f2ee419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.131+0000 7f2ee3400640 1 -- 172.21.15.2:0/1509426452 learned_addr learned my addr 172.21.15.2:0/1509426452 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:45.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.131+0000 7f2ee3400640 1 -- 172.21.15.2:0/1509426452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee41098b0 msgr2=0x7f2ee41a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:45.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.131+0000 7f2ee3400640 1 --2- 172.21.15.2:0/1509426452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee41098b0 0x7f2ee41a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.131+0000 7f2ee3400640 1 -- 172.21.15.2:0/1509426452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ee40759e0 msgr2=0x7f2ee419a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:45.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.131+0000 7f2ee3400640 1 --2- 172.21.15.2:0/1509426452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ee40759e0 0x7f2ee419a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.131+0000 7f2ee3400640 1 -- 172.21.15.2:0/1509426452 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee41a1aa0 con 0x7f2ee4074400 2024-06-13T11:23:45.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.131+0000 7f2ee3400640 1 --2- 172.21.15.2:0/1509426452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4074400 0x7f2ee4199e80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400e9c0 tx=0x7f2ed400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:45.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.132+0000 7f2ee0c00640 1 -- 172.21.15.2:0/1509426452 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed400ccc0 con 0x7f2ee4074400 2024-06-13T11:23:45.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.132+0000 7f2eea400640 1 -- 172.21.15.2:0/1509426452 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee41a1d90 con 0x7f2ee4074400 2024-06-13T11:23:45.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.132+0000 7f2ee0c00640 1 -- 172.21.15.2:0/1509426452 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ed4005500 con 0x7f2ee4074400 2024-06-13T11:23:45.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.132+0000 7f2ee0c00640 1 -- 172.21.15.2:0/1509426452 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4010430 con 0x7f2ee4074400 2024-06-13T11:23:45.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.132+0000 7f2eea400640 1 -- 172.21.15.2:0/1509426452 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee41a2220 con 0x7f2ee4074400 2024-06-13T11:23:45.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.133+0000 7f2eea400640 1 -- 172.21.15.2:0/1509426452 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee41085e0 con 0x7f2ee4074400 2024-06-13T11:23:45.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.135+0000 7f2ee0c00640 1 -- 172.21.15.2:0/1509426452 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137849+0+0 (secure 0 0 0) 0x7f2ed40046c0 con 0x7f2ee4074400 2024-06-13T11:23:45.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.136+0000 7f2ee0c00640 1 --2- 172.21.15.2:0/1509426452 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2ec80a2be0 0x7f2ec80a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:45.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.136+0000 7f2edaa00640 1 -- 172.21.15.2:0/1509426452 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2ec80a2be0 msgr2=0x7f2ec80a50a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3387272091 2024-06-13T11:23:45.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.136+0000 7f2ee0c00640 1 -- 172.21.15.2:0/1509426452 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f2ed40cf760 con 0x7f2ee4074400 2024-06-13T11:23:45.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.136+0000 7f2edaa00640 1 --2- 172.21.15.2:0/1509426452 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2ec80a2be0 0x7f2ec80a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:23:45.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.140+0000 7f2ee0c00640 1 -- 172.21.15.2:0/1509426452 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2ed409c2d0 con 0x7f2ee4074400 2024-06-13T11:23:45.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.337+0000 7f2edaa00640 1 -- 172.21.15.2:0/1509426452 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2ec80a2be0 msgr2=0x7f2ec80a50a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3387272091 2024-06-13T11:23:45.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.337+0000 7f2edaa00640 1 --2- 172.21.15.2:0/1509426452 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2ec80a2be0 0x7f2ec80a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T11:23:45.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.342+0000 7f2eea400640 1 -- 172.21.15.2:0/1509426452 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2ee40626a0 con 0x7f2ee4074400 2024-06-13T11:23:45.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.342+0000 7f2ee0c00640 1 -- 172.21.15.2:0/1509426452 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) ==== 93+0+10 (secure 0 0 0) 0x7f2ed409bbd0 con 0x7f2ee4074400 2024-06-13T11:23:45.341 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-06-13T11:23:45.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.345+0000 7f2eea400640 1 -- 172.21.15.2:0/1509426452 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2ec80a2be0 msgr2=0x7f2ec80a50a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:23:45.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.345+0000 7f2eea400640 1 --2- 172.21.15.2:0/1509426452 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2ec80a2be0 0x7f2ec80a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.345+0000 7f2eea400640 1 -- 172.21.15.2:0/1509426452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4074400 msgr2=0x7f2ee4199e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:45.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.345+0000 7f2eea400640 1 --2- 172.21.15.2:0/1509426452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4074400 0x7f2ee4199e80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400e9c0 tx=0x7f2ed400ee80 comp rx=0 tx=0).stop 2024-06-13T11:23:45.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.345+0000 7f2eea400640 1 -- 172.21.15.2:0/1509426452 shutdown_connections 2024-06-13T11:23:45.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.345+0000 7f2eea400640 1 --2- 172.21.15.2:0/1509426452 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f2ec80a2be0 0x7f2ec80a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.345+0000 7f2eea400640 1 --2- 172.21.15.2:0/1509426452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee41098b0 0x7f2ee41a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.345+0000 7f2eea400640 1 --2- 172.21.15.2:0/1509426452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ee40759e0 0x7f2ee419a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.345+0000 7f2eea400640 1 --2- 172.21.15.2:0/1509426452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4074400 0x7f2ee4199e80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.345+0000 7f2eea400640 1 -- 172.21.15.2:0/1509426452 >> 172.21.15.2:0/1509426452 conn(0x7f2ee40fcf60 msgr2=0x7f2ee41057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:45.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.345+0000 7f2eea400640 1 -- 172.21.15.2:0/1509426452 shutdown_connections 2024-06-13T11:23:45.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.345+0000 7f2eea400640 1 -- 172.21.15.2:0/1509426452 wait complete. 2024-06-13T11:23:45.360 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:44 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:44.993+0000 7fd157619200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T11:23:45.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-13T11:23:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.552+0000 7fcb50a00640 1 -- 172.21.15.2:0/1261098961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb4c104df0 msgr2=0x7fcb4c105270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.552+0000 7fcb50a00640 1 --2- 172.21.15.2:0/1261098961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb4c104df0 0x7fcb4c105270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009900 tx=0x7fcb3802a3f0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.552+0000 7fcb50a00640 1 -- 172.21.15.2:0/1261098961 shutdown_connections 2024-06-13T11:23:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.552+0000 7fcb50a00640 1 --2- 172.21.15.2:0/1261098961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb4c1057b0 0x7fcb4c10c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.552+0000 7fcb50a00640 1 --2- 172.21.15.2:0/1261098961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb4c104df0 0x7fcb4c105270 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.552+0000 7fcb50a00640 1 --2- 172.21.15.2:0/1261098961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb4c103c00 0x7fcb4c104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.552+0000 7fcb50a00640 1 -- 172.21.15.2:0/1261098961 >> 172.21.15.2:0/1261098961 conn(0x7fcb4c0ff190 msgr2=0x7fcb4c1015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.552+0000 7fcb50a00640 1 -- 172.21.15.2:0/1261098961 shutdown_connections 2024-06-13T11:23:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.552+0000 7fcb50a00640 1 -- 172.21.15.2:0/1261098961 wait complete. 2024-06-13T11:23:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.553+0000 7fcb50a00640 1 Processor -- start 2024-06-13T11:23:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.553+0000 7fcb50a00640 1 -- start start 2024-06-13T11:23:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb50a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb4c103c00 0x7fcb4c199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb50a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb4c104df0 0x7fcb4c19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb50a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb4c1057b0 0x7fcb4c1a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb50a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c10f8b0 con 0x7fcb4c1057b0 2024-06-13T11:23:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb50a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c10f730 con 0x7fcb4c104df0 2024-06-13T11:23:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb50a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c10fa30 con 0x7fcb4c103c00 2024-06-13T11:23:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb4a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb4c1057b0 0x7fcb4c1a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb49400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb4c104df0 0x7fcb4c19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb4a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb4c1057b0 0x7fcb4c1a14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37428/0 (socket says 172.21.15.2:37428) 2024-06-13T11:23:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb4a800640 1 -- 172.21.15.2:0/408394323 learned_addr learned my addr 172.21.15.2:0/408394323 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb49e00640 1 --2- 172.21.15.2:0/408394323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb4c103c00 0x7fcb4c199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb49400640 1 -- 172.21.15.2:0/408394323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb4c103c00 msgr2=0x7fcb4c199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb49400640 1 --2- 172.21.15.2:0/408394323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb4c103c00 0x7fcb4c199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb49400640 1 -- 172.21.15.2:0/408394323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb4c1057b0 msgr2=0x7fcb4c1a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb49400640 1 --2- 172.21.15.2:0/408394323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb4c1057b0 0x7fcb4c1a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb49400640 1 -- 172.21.15.2:0/408394323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c1a1b40 con 0x7fcb4c104df0 2024-06-13T11:23:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.554+0000 7fcb4a800640 1 --2- 172.21.15.2:0/408394323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb4c1057b0 0x7fcb4c1a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.555+0000 7fcb49400640 1 --2- 172.21.15.2:0/408394323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb4c104df0 0x7fcb4c19a460 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcb3802a910 tx=0x7fcb38032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:45.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.555+0000 7fcb42a00640 1 -- 172.21.15.2:0/408394323 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3803f030 con 0x7fcb4c104df0 2024-06-13T11:23:45.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.555+0000 7fcb50a00640 1 -- 172.21.15.2:0/408394323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4c1a1dd0 con 0x7fcb4c104df0 2024-06-13T11:23:45.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.555+0000 7fcb42a00640 1 -- 172.21.15.2:0/408394323 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb38003ce0 con 0x7fcb4c104df0 2024-06-13T11:23:45.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.555+0000 7fcb42a00640 1 -- 172.21.15.2:0/408394323 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38035070 con 0x7fcb4c104df0 2024-06-13T11:23:45.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.555+0000 7fcb50a00640 1 -- 172.21.15.2:0/408394323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4c1a2280 con 0x7fcb4c104df0 2024-06-13T11:23:45.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.556+0000 7fcb50a00640 1 -- 172.21.15.2:0/408394323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb4c10af20 con 0x7fcb4c104df0 2024-06-13T11:23:45.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.558+0000 7fcb42a00640 1 -- 172.21.15.2:0/408394323 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 20) ==== 137849+0+0 (secure 0 0 0) 0x7fcb38042030 con 0x7fcb4c104df0 2024-06-13T11:23:45.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.560+0000 7fcb42a00640 1 --2- 172.21.15.2:0/408394323 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fcb300a2c60 0x7fcb300a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:45.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.560+0000 7fcb49e00640 1 -- 172.21.15.2:0/408394323 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fcb300a2c60 msgr2=0x7fcb300a5120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3387272091 2024-06-13T11:23:45.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.560+0000 7fcb42a00640 1 -- 172.21.15.2:0/408394323 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7fcb380ef790 con 0x7fcb4c104df0 2024-06-13T11:23:45.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.560+0000 7fcb49e00640 1 --2- 172.21.15.2:0/408394323 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fcb300a2c60 0x7fcb300a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:23:45.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.564+0000 7fcb42a00640 1 -- 172.21.15.2:0/408394323 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcb380bbcb0 con 0x7fcb4c104df0 2024-06-13T11:23:45.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:45 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2860788135' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-06-13T11:23:45.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:45 smithi002 ceph-mon[32210]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:23:45.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:45 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/484291891' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:23:45.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:45 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1509426452' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-13T11:23:45.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:45 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2860788135' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-06-13T11:23:45.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:45 smithi178 ceph-mon[36913]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:23:45.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:45 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/484291891' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:23:45.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:45 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1509426452' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-13T11:23:45.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.761+0000 7fcb49e00640 1 -- 172.21.15.2:0/408394323 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fcb300a2c60 msgr2=0x7fcb300a5120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3387272091 2024-06-13T11:23:45.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.761+0000 7fcb49e00640 1 --2- 172.21.15.2:0/408394323 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fcb300a2c60 0x7fcb300a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T11:23:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.764+0000 7fcb50a00640 1 -- 172.21.15.2:0/408394323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcb4c062640 con 0x7fcb4c104df0 2024-06-13T11:23:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.765+0000 7fcb42a00640 1 -- 172.21.15.2:0/408394323 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) ==== 104+0+11 (secure 0 0 0) 0x7fcb380bffb0 con 0x7fcb4c104df0 2024-06-13T11:23:45.764 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-06-13T11:23:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.767+0000 7fcb50a00640 1 -- 172.21.15.2:0/408394323 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fcb300a2c60 msgr2=0x7fcb300a5120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:23:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.767+0000 7fcb50a00640 1 --2- 172.21.15.2:0/408394323 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fcb300a2c60 0x7fcb300a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.768+0000 7fcb50a00640 1 -- 172.21.15.2:0/408394323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb4c104df0 msgr2=0x7fcb4c19a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.768+0000 7fcb50a00640 1 --2- 172.21.15.2:0/408394323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb4c104df0 0x7fcb4c19a460 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcb3802a910 tx=0x7fcb38032ce0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.768+0000 7fcb50a00640 1 -- 172.21.15.2:0/408394323 shutdown_connections 2024-06-13T11:23:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.768+0000 7fcb50a00640 1 --2- 172.21.15.2:0/408394323 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7fcb300a2c60 0x7fcb300a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.768+0000 7fcb50a00640 1 --2- 172.21.15.2:0/408394323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb4c1057b0 0x7fcb4c1a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.768+0000 7fcb50a00640 1 --2- 172.21.15.2:0/408394323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb4c104df0 0x7fcb4c19a460 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.768+0000 7fcb50a00640 1 --2- 172.21.15.2:0/408394323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb4c103c00 0x7fcb4c199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.768+0000 7fcb50a00640 1 -- 172.21.15.2:0/408394323 >> 172.21.15.2:0/408394323 conn(0x7fcb4c0ff190 msgr2=0x7fcb4c1080f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:45.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.768+0000 7fcb50a00640 1 -- 172.21.15.2:0/408394323 shutdown_connections 2024-06-13T11:23:45.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.768+0000 7fcb50a00640 1 -- 172.21.15.2:0/408394323 wait complete. 2024-06-13T11:23:45.784 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-13T11:23:45.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:45 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2860788135' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-06-13T11:23:45.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:45 smithi077 ceph-mon[36410]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:23:45.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:45 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/484291891' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:23:45.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:45 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1509426452' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-13T11:23:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.979+0000 7f23c6800640 1 -- 172.21.15.2:0/1160247362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c0100a60 msgr2=0x7f23c0100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.979+0000 7f23c6800640 1 --2- 172.21.15.2:0/1160247362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c0100a60 0x7f23c0100ec0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009860 tx=0x7f23ac02a3d0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.979+0000 7f23c6800640 1 -- 172.21.15.2:0/1160247362 shutdown_connections 2024-06-13T11:23:45.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.979+0000 7f23c6800640 1 --2- 172.21.15.2:0/1160247362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0101400 0x7f23c0101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.979+0000 7f23c6800640 1 --2- 172.21.15.2:0/1160247362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c0100a60 0x7f23c0100ec0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.979+0000 7f23c6800640 1 --2- 172.21.15.2:0/1160247362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c0100100 0x7f23c0100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.979+0000 7f23c6800640 1 -- 172.21.15.2:0/1160247362 >> 172.21.15.2:0/1160247362 conn(0x7f23c00fbc80 msgr2=0x7f23c00fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:45.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.979+0000 7f23c6800640 1 -- 172.21.15.2:0/1160247362 shutdown_connections 2024-06-13T11:23:45.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.979+0000 7f23c6800640 1 -- 172.21.15.2:0/1160247362 wait complete. 2024-06-13T11:23:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.980+0000 7f23c6800640 1 Processor -- start 2024-06-13T11:23:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.980+0000 7f23c6800640 1 -- start start 2024-06-13T11:23:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.980+0000 7f23c6800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c0100100 0x7f23c0199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.981+0000 7f23c6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c0100a60 0x7f23c019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.981+0000 7f23c6800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0101400 0x7f23c01a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.981+0000 7f23c6800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23c010f6c0 con 0x7f23c0100a60 2024-06-13T11:23:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.981+0000 7f23c6800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f23c010f540 con 0x7f23c0100100 2024-06-13T11:23:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.981+0000 7f23c6800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f23c010f840 con 0x7f23c0101400 2024-06-13T11:23:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.981+0000 7f23c4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c0100a60 0x7f23c019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.981+0000 7f23c5400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c0100100 0x7f23c0199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.981+0000 7f23c4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c0100a60 0x7f23c019a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34326/0 (socket says 172.21.15.2:34326) 2024-06-13T11:23:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.981+0000 7f23c4a00640 1 -- 172.21.15.2:0/2746066173 learned_addr learned my addr 172.21.15.2:0/2746066173 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.981+0000 7f23c5e00640 1 --2- 172.21.15.2:0/2746066173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0101400 0x7f23c01a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.981+0000 7f23c5400640 1 -- 172.21.15.2:0/2746066173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0101400 msgr2=0x7f23c01a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.981+0000 7f23c5400640 1 --2- 172.21.15.2:0/2746066173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0101400 0x7f23c01a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.981+0000 7f23c5400640 1 -- 172.21.15.2:0/2746066173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c0100a60 msgr2=0x7f23c019a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.981+0000 7f23c5400640 1 --2- 172.21.15.2:0/2746066173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c0100a60 0x7f23c019a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.981+0000 7f23c5400640 1 -- 172.21.15.2:0/2746066173 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c01a1940 con 0x7f23c0100100 2024-06-13T11:23:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.982+0000 7f23c5400640 1 --2- 172.21.15.2:0/2746066173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c0100100 0x7f23c0199d30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f23b4005fd0 tx=0x7f23b400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.982+0000 7f23be000640 1 -- 172.21.15.2:0/2746066173 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b400cd00 con 0x7f23c0100100 2024-06-13T11:23:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.982+0000 7f23be000640 1 -- 172.21.15.2:0/2746066173 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23b40035f0 con 0x7f23c0100100 2024-06-13T11:23:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.982+0000 7f23c6800640 1 -- 172.21.15.2:0/2746066173 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c01a1c30 con 0x7f23c0100100 2024-06-13T11:23:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.982+0000 7f23be000640 1 -- 172.21.15.2:0/2746066173 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4010690 con 0x7f23c0100100 2024-06-13T11:23:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.982+0000 7f23c6800640 1 -- 172.21.15.2:0/2746066173 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c01a2180 con 0x7f23c0100100 2024-06-13T11:23:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.983+0000 7f23c6800640 1 -- 172.21.15.2:0/2746066173 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c010ae50 con 0x7f23c0100100 2024-06-13T11:23:45.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.985+0000 7f23be000640 1 -- 172.21.15.2:0/2746066173 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 20) ==== 137849+0+0 (secure 0 0 0) 0x7f23b40037a0 con 0x7f23c0100100 2024-06-13T11:23:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.987+0000 7f23be000640 1 --2- 172.21.15.2:0/2746066173 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f23a80a2be0 0x7f23a80a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.987+0000 7f23c4a00640 1 -- 172.21.15.2:0/2746066173 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f23a80a2be0 msgr2=0x7f23a80a50a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3387272091 2024-06-13T11:23:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.987+0000 7f23be000640 1 -- 172.21.15.2:0/2746066173 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9137+0+0 (secure 0 0 0) 0x7f23b40cf820 con 0x7f23c0100100 2024-06-13T11:23:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.987+0000 7f23c4a00640 1 --2- 172.21.15.2:0/2746066173 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f23a80a2be0 0x7f23a80a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T11:23:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:45.989+0000 7f23be000640 1 -- 172.21.15.2:0/2746066173 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f23b4009510 con 0x7f23c0100100 2024-06-13T11:23:46.128 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:45 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:45.818+0000 7fd157619200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T11:23:46.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.152+0000 7f23be000640 1 -- 172.21.15.2:0/2746066173 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 21) ==== 137518+0+0 (secure 0 0 0) 0x7f23b4098300 con 0x7f23c0100100 2024-06-13T11:23:46.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.153+0000 7f23be000640 1 -- 172.21.15.2:0/2746066173 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f23a80a2be0 msgr2=0x7f23a80a50a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T11:23:46.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.153+0000 7f23be000640 1 --2- 172.21.15.2:0/2746066173 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f23a80a2be0 0x7f23a80a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.214+0000 7f23c6800640 1 -- 172.21.15.2:0/2746066173 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f23c002d550 con 0x7f23c0100100 2024-06-13T11:23:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.215+0000 7f23be000640 1 -- 172.21.15.2:0/2746066173 <== mon.2 v2:172.21.15.77:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v100) ==== 100+0+11 (secure 0 0 0) 0x7f23b409c390 con 0x7f23c0100100 2024-06-13T11:23:46.214 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-06-13T11:23:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.217+0000 7f23c6800640 1 -- 172.21.15.2:0/2746066173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c0100100 msgr2=0x7f23c0199d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.217+0000 7f23c6800640 1 --2- 172.21.15.2:0/2746066173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c0100100 0x7f23c0199d30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f23b4005fd0 tx=0x7f23b400ee50 comp rx=0 tx=0).stop 2024-06-13T11:23:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.217+0000 7f23c6800640 1 -- 172.21.15.2:0/2746066173 shutdown_connections 2024-06-13T11:23:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.217+0000 7f23c6800640 1 --2- 172.21.15.2:0/2746066173 >> [v2:172.21.15.2:6800/3387272091,v1:172.21.15.2:6801/3387272091] conn(0x7f23a80a2be0 0x7f23a80a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.217+0000 7f23c6800640 1 --2- 172.21.15.2:0/2746066173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0101400 0x7f23c01a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.217+0000 7f23c6800640 1 --2- 172.21.15.2:0/2746066173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c0100a60 0x7f23c019a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.217+0000 7f23c6800640 1 --2- 172.21.15.2:0/2746066173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c0100100 0x7f23c0199d30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.217+0000 7f23c6800640 1 -- 172.21.15.2:0/2746066173 >> 172.21.15.2:0/2746066173 conn(0x7f23c00fbc80 msgr2=0x7f23c00fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.217+0000 7f23c6800640 1 -- 172.21.15.2:0/2746066173 shutdown_connections 2024-06-13T11:23:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.218+0000 7f23c6800640 1 -- 172.21.15.2:0/2746066173 wait complete. 2024-06-13T11:23:46.234 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-13T11:23:46.395 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:46.128+0000 7fd157619200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T11:23:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.462+0000 7fdbcf200640 1 -- 172.21.15.2:0/2197550347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbd00775a0 msgr2=0x7fdbd0077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.462+0000 7fdbcf200640 1 --2- 172.21.15.2:0/2197550347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbd00775a0 0x7fdbd0077a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc009860 tx=0x7fdbbc02a340 comp rx=0 tx=0).stop 2024-06-13T11:23:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.462+0000 7fdbcf200640 1 -- 172.21.15.2:0/2197550347 shutdown_connections 2024-06-13T11:23:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.462+0000 7fdbcf200640 1 --2- 172.21.15.2:0/2197550347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbd00775a0 0x7fdbd0077a00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.462+0000 7fdbcf200640 1 --2- 172.21.15.2:0/2197550347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd0077f40 0x7fdbd00787e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.462+0000 7fdbcf200640 1 --2- 172.21.15.2:0/2197550347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbd0076360 0x7fdbd0076780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.462+0000 7fdbcf200640 1 -- 172.21.15.2:0/2197550347 >> 172.21.15.2:0/2197550347 conn(0x7fdbd00fefb0 msgr2=0x7fdbd01013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.462+0000 7fdbcf200640 1 -- 172.21.15.2:0/2197550347 shutdown_connections 2024-06-13T11:23:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.462+0000 7fdbcf200640 1 -- 172.21.15.2:0/2197550347 wait complete. 2024-06-13T11:23:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.464+0000 7fdbcf200640 1 Processor -- start 2024-06-13T11:23:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.464+0000 7fdbcf200640 1 -- start start 2024-06-13T11:23:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbcf200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbd0076360 0x7fdbd019e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbcf200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd00775a0 0x7fdbd019e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbcf200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbd0077f40 0x7fdbd01a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbcf200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd0113a90 con 0x7fdbd00775a0 2024-06-13T11:23:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbcf200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd0113910 con 0x7fdbd0077f40 2024-06-13T11:23:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbcf200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd0113c10 con 0x7fdbd0076360 2024-06-13T11:23:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbcde00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbd0076360 0x7fdbd019e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbce800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbd0077f40 0x7fdbd01a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbcde00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbd0076360 0x7fdbd019e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:37414/0 (socket says 172.21.15.2:37414) 2024-06-13T11:23:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbcde00640 1 -- 172.21.15.2:0/1397286516 learned_addr learned my addr 172.21.15.2:0/1397286516 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbce800640 1 --2- 172.21.15.2:0/1397286516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbd0077f40 0x7fdbd01a5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:33840/0 (socket says 172.21.15.2:33840) 2024-06-13T11:23:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbcd400640 1 --2- 172.21.15.2:0/1397286516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd00775a0 0x7fdbd019e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbce800640 1 -- 172.21.15.2:0/1397286516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbd0076360 msgr2=0x7fdbd019e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbce800640 1 --2- 172.21.15.2:0/1397286516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbd0076360 0x7fdbd019e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbce800640 1 -- 172.21.15.2:0/1397286516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd00775a0 msgr2=0x7fdbd019e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbce800640 1 --2- 172.21.15.2:0/1397286516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd00775a0 0x7fdbd019e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.465+0000 7fdbce800640 1 -- 172.21.15.2:0/1397286516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd01a5da0 con 0x7fdbd0077f40 2024-06-13T11:23:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.466+0000 7fdbce800640 1 --2- 172.21.15.2:0/1397286516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbd0077f40 0x7fdbd01a5730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009fd0 tx=0x7fdbc800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.466+0000 7fdbcde00640 1 --2- 172.21.15.2:0/1397286516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbd0076360 0x7fdbd019e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.466+0000 7fdbc6a00640 1 -- 172.21.15.2:0/1397286516 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc800ce20 con 0x7fdbd0077f40 2024-06-13T11:23:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.466+0000 7fdbcf200640 1 -- 172.21.15.2:0/1397286516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd01a6090 con 0x7fdbd0077f40 2024-06-13T11:23:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.466+0000 7fdbc6a00640 1 -- 172.21.15.2:0/1397286516 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbc8005020 con 0x7fdbd0077f40 2024-06-13T11:23:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.466+0000 7fdbcf200640 1 -- 172.21.15.2:0/1397286516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd01a6600 con 0x7fdbd0077f40 2024-06-13T11:23:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.467+0000 7fdbc6a00640 1 -- 172.21.15.2:0/1397286516 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc80106b0 con 0x7fdbd0077f40 2024-06-13T11:23:46.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.468+0000 7fdbcf200640 1 -- 172.21.15.2:0/1397286516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb0005290 con 0x7fdbd0077f40 2024-06-13T11:23:46.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.470+0000 7fdbc6a00640 1 -- 172.21.15.2:0/1397286516 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 21) ==== 137518+0+0 (secure 0 0 0) 0x7fdbc8004a40 con 0x7fdbd0077f40 2024-06-13T11:23:46.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.472+0000 7fdbc6a00640 1 -- 172.21.15.2:0/1397286516 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fdbc80cf3c0 con 0x7fdbd0077f40 2024-06-13T11:23:46.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.476+0000 7fdbc6a00640 1 -- 172.21.15.2:0/1397286516 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdbc809c230 con 0x7fdbd0077f40 2024-06-13T11:23:46.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/408394323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-13T11:23:46.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: Active manager daemon x restarted 2024-06-13T11:23:46.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: Activating manager daemon x 2024-06-13T11:23:46.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: osdmap e100: 12 total, 12 up, 12 in 2024-06-13T11:23:46.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: mgrmap e21: x(active, starting, since 0.0133505s), standbys: y, z 2024-06-13T11:23:46.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:23:46.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:23:46.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:23:46.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-13T11:23:46.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-13T11:23:46.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-13T11:23:46.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-13T11:23:46.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-13T11:23:46.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-13T11:23:46.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T11:23:46.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T11:23:46.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-13T11:23:46.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T11:23:46.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T11:23:46.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T11:23:46.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-13T11:23:46.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-13T11:23:46.699 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-13T11:23:46.699 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:23:46.699 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:23:46.699 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:23:46.699 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:23:46.699 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:23:46.699 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T11:23:46.699 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:23:46.699 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:23:46.699 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T11:23:46.699 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:23:46.699 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:23:46.699 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:23:46.699 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-13T11:23:46.700 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-13T11:23:46.700 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-13T11:23:46.700 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: Manager daemon x is now available 2024-06-13T11:23:46.700 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2746066173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-13T11:23:46.700 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:23:46.700 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T11:23:46.700 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T11:23:46.700 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T11:23:46.700 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:46 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T11:23:46.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.714+0000 7fdbcf200640 1 -- 172.21.15.2:0/1397286516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fdbb0005d90 con 0x7fdbd0077f40 2024-06-13T11:23:46.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.715+0000 7fdbc6a00640 1 -- 172.21.15.2:0/1397286516 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v100) ==== 103+0+11 (secure 0 0 0) 0x7fdbc809bb30 con 0x7fdbd0077f40 2024-06-13T11:23:46.714 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-06-13T11:23:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.717+0000 7fdbcf200640 1 -- 172.21.15.2:0/1397286516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbd0077f40 msgr2=0x7fdbd01a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.717+0000 7fdbcf200640 1 --2- 172.21.15.2:0/1397286516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbd0077f40 0x7fdbd01a5730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009fd0 tx=0x7fdbc800ef10 comp rx=0 tx=0).stop 2024-06-13T11:23:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.717+0000 7fdbcf200640 1 -- 172.21.15.2:0/1397286516 shutdown_connections 2024-06-13T11:23:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.717+0000 7fdbcf200640 1 --2- 172.21.15.2:0/1397286516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbd0077f40 0x7fdbd01a5730 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.717+0000 7fdbcf200640 1 --2- 172.21.15.2:0/1397286516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbd00775a0 0x7fdbd019e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.717+0000 7fdbcf200640 1 --2- 172.21.15.2:0/1397286516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbd0076360 0x7fdbd019e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.717+0000 7fdbcf200640 1 -- 172.21.15.2:0/1397286516 >> 172.21.15.2:0/1397286516 conn(0x7fdbd00fefb0 msgr2=0x7fdbd0100ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.718+0000 7fdbcf200640 1 -- 172.21.15.2:0/1397286516 shutdown_connections 2024-06-13T11:23:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:46.718+0000 7fdbcf200640 1 -- 172.21.15.2:0/1397286516 wait complete. 2024-06-13T11:23:46.732 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:46.493+0000 7fd0a8a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:23:46.732 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:46.493+0000 7fd0a8a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:23:46.732 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:46.493+0000 7fd0a8a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:23:46.732 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:46.493+0000 7fd0a8a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:23:46.732 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:46.493+0000 7fd0a8a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:23:46.733 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:46.497+0000 7fd0ada00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:23:46.733 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:46.497+0000 7fd0ada00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:23:46.733 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:46.497+0000 7fd0ada00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:23:46.733 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:46.497+0000 7fd0ada00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:23:46.733 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:23:46.497+0000 7fd0ada00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:23:46.734 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/408394323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-13T11:23:46.734 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: Active manager daemon x restarted 2024-06-13T11:23:46.734 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: Activating manager daemon x 2024-06-13T11:23:46.734 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: osdmap e100: 12 total, 12 up, 12 in 2024-06-13T11:23:46.734 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: mgrmap e21: x(active, starting, since 0.0133505s), standbys: y, z 2024-06-13T11:23:46.734 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:23:46.734 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:23:46.734 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:23:46.734 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-13T11:23:46.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-13T11:23:46.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-13T11:23:46.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-13T11:23:46.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-13T11:23:46.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-13T11:23:46.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T11:23:46.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T11:23:46.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-13T11:23:46.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T11:23:46.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T11:23:46.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T11:23:46.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-13T11:23:46.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-13T11:23:46.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-13T11:23:46.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:23:46.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:23:46.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:23:46.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:23:46.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:23:46.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T11:23:46.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:23:46.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:23:46.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T11:23:46.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:23:46.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:23:46.736 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:23:46.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-13T11:23:46.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-13T11:23:46.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-13T11:23:46.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: Manager daemon x is now available 2024-06-13T11:23:46.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2746066173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-13T11:23:46.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:23:46.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T11:23:46.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T11:23:46.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T11:23:46.737 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:46 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T11:23:46.738 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-06-13T11:23:46.738 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:23:46.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/408394323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-13T11:23:46.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: Active manager daemon x restarted 2024-06-13T11:23:46.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: Activating manager daemon x 2024-06-13T11:23:46.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: osdmap e100: 12 total, 12 up, 12 in 2024-06-13T11:23:46.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: mgrmap e21: x(active, starting, since 0.0133505s), standbys: y, z 2024-06-13T11:23:46.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T11:23:46.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T11:23:46.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T11:23:46.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-13T11:23:46.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-13T11:23:46.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-13T11:23:46.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-13T11:23:46.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-13T11:23:46.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-13T11:23:46.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T11:23:46.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T11:23:46.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-13T11:23:46.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T11:23:46.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T11:23:46.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T11:23:46.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-13T11:23:46.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-13T11:23:46.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-13T11:23:46.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T11:23:46.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T11:23:46.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T11:23:46.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T11:23:46.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T11:23:46.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T11:23:46.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T11:23:46.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T11:23:46.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T11:23:46.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T11:23:46.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T11:23:46.793 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T11:23:46.793 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-13T11:23:46.793 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-13T11:23:46.793 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-13T11:23:46.793 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: Manager daemon x is now available 2024-06-13T11:23:46.793 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2746066173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-13T11:23:46.793 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:23:46.793 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T11:23:46.793 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T11:23:46.794 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T11:23:46.794 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:46 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T11:23:47.182 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:23:47.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:47 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1397286516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-13T11:23:47.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:47 smithi002 ceph-mon[32210]: mgrmap e22: x(active, since 1.02495s), standbys: y, z 2024-06-13T11:23:47.686 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:47 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1397286516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-13T11:23:47.687 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:47 smithi178 ceph-mon[36913]: mgrmap e22: x(active, since 1.02495s), standbys: y, z 2024-06-13T11:23:47.710 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:47 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1397286516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-13T11:23:47.711 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:47 smithi077 ceph-mon[36410]: mgrmap e22: x(active, since 1.02495s), standbys: y, z 2024-06-13T11:23:48.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:48 smithi077 ceph-mon[36410]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:23:48.883 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:48 smithi002 ceph-mon[32210]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:23:48.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:48 smithi178 ceph-mon[36913]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:23:49.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:49 smithi002 ceph-mon[32210]: [13/Jun/2024:11:23:47] ENGINE Bus STARTING 2024-06-13T11:23:49.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:49 smithi002 ceph-mon[32210]: [13/Jun/2024:11:23:48] ENGINE Serving on https://172.21.15.2:7150 2024-06-13T11:23:49.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:49 smithi002 ceph-mon[32210]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:23:49.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:49 smithi002 ceph-mon[32210]: [13/Jun/2024:11:23:48] ENGINE Serving on http://172.21.15.2:8765 2024-06-13T11:23:49.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:49 smithi002 ceph-mon[32210]: [13/Jun/2024:11:23:48] ENGINE Bus STARTED 2024-06-13T11:23:49.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:49 smithi002 ceph-mon[32210]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-06-13T11:23:49.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:49 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:49.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:49 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:49.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:49 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:49.628 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:49 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:49.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:49 smithi077 ceph-mon[36410]: [13/Jun/2024:11:23:47] ENGINE Bus STARTING 2024-06-13T11:23:49.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:49 smithi077 ceph-mon[36410]: [13/Jun/2024:11:23:48] ENGINE Serving on https://172.21.15.2:7150 2024-06-13T11:23:49.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:49 smithi077 ceph-mon[36410]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:23:49.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:49 smithi077 ceph-mon[36410]: [13/Jun/2024:11:23:48] ENGINE Serving on http://172.21.15.2:8765 2024-06-13T11:23:49.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:49 smithi077 ceph-mon[36410]: [13/Jun/2024:11:23:48] ENGINE Bus STARTED 2024-06-13T11:23:49.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:49 smithi077 ceph-mon[36410]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-06-13T11:23:49.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:49 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:49.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:49 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:49.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:49 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:49.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:49 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:49.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.809+0000 7fe12e800700 1 -- 172.21.15.2:0/1809363161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe128102ea0 msgr2=0x7fe12810f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:49.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.809+0000 7fe12e800700 1 --2- 172.21.15.2:0/1809363161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe128102ea0 0x7fe12810f380 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe120009f90 tx=0x7fe12000b330 comp rx=0 tx=0).stop 2024-06-13T11:23:49.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.809+0000 7fe12e800700 1 -- 172.21.15.2:0/1809363161 shutdown_connections 2024-06-13T11:23:49.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.809+0000 7fe12e800700 1 --2- 172.21.15.2:0/1809363161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1281085f0 0x7fe1281089d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:49.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.809+0000 7fe12e800700 1 --2- 172.21.15.2:0/1809363161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe128102ea0 0x7fe12810f380 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:49.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.809+0000 7fe12e800700 1 --2- 172.21.15.2:0/1809363161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1281024e0 0x7fe128102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:49.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.809+0000 7fe12e800700 1 -- 172.21.15.2:0/1809363161 >> 172.21.15.2:0/1809363161 conn(0x7fe128079640 msgr2=0x7fe128079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:49.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.809+0000 7fe12e800700 1 -- 172.21.15.2:0/1809363161 shutdown_connections 2024-06-13T11:23:49.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.809+0000 7fe12e800700 1 -- 172.21.15.2:0/1809363161 wait complete. 2024-06-13T11:23:49.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.811+0000 7fe12e800700 1 Processor -- start 2024-06-13T11:23:49.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.811+0000 7fe12e800700 1 -- start start 2024-06-13T11:23:49.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.811+0000 7fe12e800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1281024e0 0x7fe128074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:49.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.812+0000 7fe12e800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe128102ea0 0x7fe128074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:49.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.812+0000 7fe12e800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1281085f0 0x7fe128075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:49.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.812+0000 7fe12e800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe128112800 con 0x7fe1281024e0 2024-06-13T11:23:49.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.812+0000 7fe12e800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe128112680 con 0x7fe1281085f0 2024-06-13T11:23:49.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.812+0000 7fe12e800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe128112980 con 0x7fe128102ea0 2024-06-13T11:23:49.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.812+0000 7fe127e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1281085f0 0x7fe128075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:49.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.812+0000 7fe127400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1281024e0 0x7fe128074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:49.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.812+0000 7fe126a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe128102ea0 0x7fe128074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.812+0000 7fe127e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1281085f0 0x7fe128075210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:33904/0 (socket says 172.21.15.2:33904) 2024-06-13T11:23:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.812+0000 7fe127e00700 1 -- 172.21.15.2:0/3557852703 learned_addr learned my addr 172.21.15.2:0/3557852703 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.812+0000 7fe127e00700 1 -- 172.21.15.2:0/3557852703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe128102ea0 msgr2=0x7fe128074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.813+0000 7fe127e00700 1 --2- 172.21.15.2:0/3557852703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe128102ea0 0x7fe128074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.813+0000 7fe127e00700 1 -- 172.21.15.2:0/3557852703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1281024e0 msgr2=0x7fe128074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.813+0000 7fe127e00700 1 --2- 172.21.15.2:0/3557852703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1281024e0 0x7fe128074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.813+0000 7fe127e00700 1 -- 172.21.15.2:0/3557852703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1281a7120 con 0x7fe1281085f0 2024-06-13T11:23:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.813+0000 7fe126a00700 1 --2- 172.21.15.2:0/3557852703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe128102ea0 0x7fe128074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:49.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.813+0000 7fe127e00700 1 --2- 172.21.15.2:0/3557852703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1281085f0 0x7fe128075210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe120009550 tx=0x7fe12000cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.813+0000 7fe11fe00700 1 -- 172.21.15.2:0/3557852703 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe120021070 con 0x7fe1281085f0 2024-06-13T11:23:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.813+0000 7fe12e800700 1 -- 172.21.15.2:0/3557852703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1281a73b0 con 0x7fe1281085f0 2024-06-13T11:23:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.813+0000 7fe11fe00700 1 -- 172.21.15.2:0/3557852703 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe120007ac0 con 0x7fe1281085f0 2024-06-13T11:23:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.813+0000 7fe11fe00700 1 -- 172.21.15.2:0/3557852703 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe120005040 con 0x7fe1281085f0 2024-06-13T11:23:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.813+0000 7fe12e800700 1 -- 172.21.15.2:0/3557852703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1281a7860 con 0x7fe1281085f0 2024-06-13T11:23:49.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.815+0000 7fe12e800700 1 -- 172.21.15.2:0/3557852703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe128069180 con 0x7fe1281085f0 2024-06-13T11:23:49.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.816+0000 7fe11fe00700 1 -- 172.21.15.2:0/3557852703 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 23) ==== 137952+0+0 (secure 0 0 0) 0x7fe120024070 con 0x7fe1281085f0 2024-06-13T11:23:49.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.817+0000 7fe11fe00700 1 --2- 172.21.15.2:0/3557852703 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe10c0a2d90 0x7fe10c0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:49.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.818+0000 7fe11fe00700 1 -- 172.21.15.2:0/3557852703 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fe1200d05f0 con 0x7fe1281085f0 2024-06-13T11:23:49.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.818+0000 7fe127400700 1 --2- 172.21.15.2:0/3557852703 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe10c0a2d90 0x7fe10c0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:49.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.819+0000 7fe127400700 1 --2- 172.21.15.2:0/3557852703 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe10c0a2d90 0x7fe10c0a5250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe118009be0 tx=0x7fe118009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:49.821+0000 7fe11fe00700 1 -- 172.21.15.2:0/3557852703 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe120007c70 con 0x7fe1281085f0 2024-06-13T11:23:49.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:49 smithi178 ceph-mon[36913]: [13/Jun/2024:11:23:47] ENGINE Bus STARTING 2024-06-13T11:23:49.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:49 smithi178 ceph-mon[36913]: [13/Jun/2024:11:23:48] ENGINE Serving on https://172.21.15.2:7150 2024-06-13T11:23:49.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:49 smithi178 ceph-mon[36913]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:23:49.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:49 smithi178 ceph-mon[36913]: [13/Jun/2024:11:23:48] ENGINE Serving on http://172.21.15.2:8765 2024-06-13T11:23:49.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:49 smithi178 ceph-mon[36913]: [13/Jun/2024:11:23:48] ENGINE Bus STARTED 2024-06-13T11:23:49.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:49 smithi178 ceph-mon[36913]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-06-13T11:23:49.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:49 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:49.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:49 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:49.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:49 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:49.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:49 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:50.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:50.122+0000 7fe12e800700 1 -- 172.21.15.2:0/3557852703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1281a7b80 con 0x7fe1281085f0 2024-06-13T11:23:50.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:50.123+0000 7fe11fe00700 1 -- 172.21.15.2:0/3557852703 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11853 (secure 0 0 0) 0x7fe12009ced0 con 0x7fe1281085f0 2024-06-13T11:23:50.122 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:23:50.122 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:23:44.392864+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24493,24509,24511]},"id":1}]} 2024-06-13T11:23:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:50.126+0000 7fe12e800700 1 -- 172.21.15.2:0/3557852703 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe10c0a2d90 msgr2=0x7fe10c0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:50.126+0000 7fe12e800700 1 --2- 172.21.15.2:0/3557852703 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe10c0a2d90 0x7fe10c0a5250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe118009be0 tx=0x7fe118009260 comp rx=0 tx=0).stop 2024-06-13T11:23:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:50.126+0000 7fe12e800700 1 -- 172.21.15.2:0/3557852703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1281085f0 msgr2=0x7fe128075210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:50.126+0000 7fe12e800700 1 --2- 172.21.15.2:0/3557852703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1281085f0 0x7fe128075210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe120009550 tx=0x7fe12000cef0 comp rx=0 tx=0).stop 2024-06-13T11:23:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:50.126+0000 7fe12e800700 1 -- 172.21.15.2:0/3557852703 shutdown_connections 2024-06-13T11:23:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:50.126+0000 7fe12e800700 1 --2- 172.21.15.2:0/3557852703 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe10c0a2d90 0x7fe10c0a5250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:50.126+0000 7fe12e800700 1 --2- 172.21.15.2:0/3557852703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1281024e0 0x7fe128074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:50.126+0000 7fe12e800700 1 --2- 172.21.15.2:0/3557852703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1281085f0 0x7fe128075210 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:50.126+0000 7fe12e800700 1 --2- 172.21.15.2:0/3557852703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe128102ea0 0x7fe128074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:50.126+0000 7fe12e800700 1 -- 172.21.15.2:0/3557852703 >> 172.21.15.2:0/3557852703 conn(0x7fe128079640 msgr2=0x7fe128100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:50.126+0000 7fe12e800700 1 -- 172.21.15.2:0/3557852703 shutdown_connections 2024-06-13T11:23:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:50.126+0000 7fe12e800700 1 -- 172.21.15.2:0/3557852703 wait complete. 2024-06-13T11:23:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-06-13T11:23:50.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:50.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:50.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:50.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:50.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:50.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:50.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:50.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:50.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:50.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:50.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:50.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:50.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:50.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:50.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:50.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:50.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:50.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:50.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:50.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:50.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:50 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3557852703' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:23:51.018 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:51.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:51.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.019 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:51.020 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:51.020 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.020 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.020 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.020 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.020 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.020 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.020 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.020 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.020 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:50 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3557852703' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:23:51.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:51.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:51.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:50 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3557852703' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:23:51.088 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-06-13T11:23:51.088 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-06-13T11:23:51.089 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-13T11:23:51.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.295+0000 7f24a2400640 1 -- 172.21.15.2:0/2735693947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c104e90 msgr2=0x7f249c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:51.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.295+0000 7f24a2400640 1 --2- 172.21.15.2:0/2735693947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c104e90 0x7f249c107280 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2488009900 tx=0x7f248802a3f0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.295+0000 7f24a2400640 1 -- 172.21.15.2:0/2735693947 shutdown_connections 2024-06-13T11:23:51.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.295+0000 7f24a2400640 1 --2- 172.21.15.2:0/2735693947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f249c1077c0 0x7f249c109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.295+0000 7f24a2400640 1 --2- 172.21.15.2:0/2735693947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c104e90 0x7f249c107280 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.295+0000 7f24a2400640 1 --2- 172.21.15.2:0/2735693947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f249c102560 0x7f249c104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.295+0000 7f24a2400640 1 -- 172.21.15.2:0/2735693947 >> 172.21.15.2:0/2735693947 conn(0x7f249c0fbf70 msgr2=0x7f249c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:51.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.295+0000 7f24a2400640 1 -- 172.21.15.2:0/2735693947 shutdown_connections 2024-06-13T11:23:51.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.295+0000 7f24a2400640 1 -- 172.21.15.2:0/2735693947 wait complete. 2024-06-13T11:23:51.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.296+0000 7f24a2400640 1 Processor -- start 2024-06-13T11:23:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.296+0000 7f24a2400640 1 -- start start 2024-06-13T11:23:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.296+0000 7f24a2400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c102560 0x7f249c101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.296+0000 7f24a2400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f249c104e90 0x7f249c100510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.296+0000 7f24a2400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f249c1077c0 0x7f249c100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.296+0000 7f24a2400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f249c10d6e0 con 0x7f249c102560 2024-06-13T11:23:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.296+0000 7f24a2400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f249c10d560 con 0x7f249c104e90 2024-06-13T11:23:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.296+0000 7f24a2400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f249c10d860 con 0x7f249c1077c0 2024-06-13T11:23:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.297+0000 7f249be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f249c1077c0 0x7f249c100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.297+0000 7f249aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f249c104e90 0x7f249c100510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.297+0000 7f249b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c102560 0x7f249c101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.297+0000 7f249aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f249c104e90 0x7f249c100510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:33928/0 (socket says 172.21.15.2:33928) 2024-06-13T11:23:51.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.297+0000 7f249aa00640 1 -- 172.21.15.2:0/2487394065 learned_addr learned my addr 172.21.15.2:0/2487394065 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:51.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.297+0000 7f249be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f249c1077c0 0x7f249c100a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:37488/0 (socket says 172.21.15.2:37488) 2024-06-13T11:23:51.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.297+0000 7f249aa00640 1 -- 172.21.15.2:0/2487394065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f249c1077c0 msgr2=0x7f249c100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:51.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.297+0000 7f249aa00640 1 --2- 172.21.15.2:0/2487394065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f249c1077c0 0x7f249c100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.297+0000 7f249aa00640 1 -- 172.21.15.2:0/2487394065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c102560 msgr2=0x7f249c101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:51.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.297+0000 7f249aa00640 1 --2- 172.21.15.2:0/2487394065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c102560 0x7f249c101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.298+0000 7f249aa00640 1 -- 172.21.15.2:0/2487394065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249c1012e0 con 0x7f249c104e90 2024-06-13T11:23:51.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.298+0000 7f249be00640 1 --2- 172.21.15.2:0/2487394065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f249c1077c0 0x7f249c100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:51.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.298+0000 7f249b400640 1 --2- 172.21.15.2:0/2487394065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c102560 0x7f249c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:51.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.298+0000 7f249aa00640 1 --2- 172.21.15.2:0/2487394065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f249c104e90 0x7f249c100510 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2488031440 tx=0x7f2488032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:51.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.298+0000 7f2493e00640 1 -- 172.21.15.2:0/2487394065 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248803f030 con 0x7f249c104e90 2024-06-13T11:23:51.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.298+0000 7f2493e00640 1 -- 172.21.15.2:0/2487394065 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2488003ce0 con 0x7f249c104e90 2024-06-13T11:23:51.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.298+0000 7f24a2400640 1 -- 172.21.15.2:0/2487394065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f249c1a1de0 con 0x7f249c104e90 2024-06-13T11:23:51.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.298+0000 7f2493e00640 1 -- 172.21.15.2:0/2487394065 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488035070 con 0x7f249c104e90 2024-06-13T11:23:51.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.298+0000 7f24a2400640 1 -- 172.21.15.2:0/2487394065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f249c1a2250 con 0x7f249c104e90 2024-06-13T11:23:51.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.300+0000 7f24a2400640 1 -- 172.21.15.2:0/2487394065 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f249c0fda60 con 0x7f249c104e90 2024-06-13T11:23:51.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.303+0000 7f2493e00640 1 -- 172.21.15.2:0/2487394065 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7f2488042030 con 0x7f249c104e90 2024-06-13T11:23:51.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.305+0000 7f2493e00640 1 --2- 172.21.15.2:0/2487394065 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f24800a2e10 0x7f24800a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:51.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.305+0000 7f2493e00640 1 -- 172.21.15.2:0/2487394065 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f24880f0010 con 0x7f249c104e90 2024-06-13T11:23:51.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.305+0000 7f249b400640 1 --2- 172.21.15.2:0/2487394065 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f24800a2e10 0x7f24800a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:51.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.306+0000 7f249b400640 1 --2- 172.21.15.2:0/2487394065 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f24800a2e10 0x7f24800a52d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f248c009fc0 tx=0x7f248c005f90 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:51.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.309+0000 7f2493e00640 1 -- 172.21.15.2:0/2487394065 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f24880bc750 con 0x7f249c104e90 2024-06-13T11:23:51.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.521+0000 7f24a2400640 1 -- 172.21.15.2:0/2487394065 --> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f249c061de0 con 0x7f24800a2e10 2024-06-13T11:23:51.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.536+0000 7f2493e00640 1 -- 172.21.15.2:0/2487394065 <== mgr.25150 v2:172.21.15.2:6800/606530635 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339849 (secure 0 0 0) 0x7f249c061de0 con 0x7f24800a2e10 2024-06-13T11:23:51.540 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:23:51.542 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-06-13T11:23:51.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.543+0000 7f24a2400640 1 -- 172.21.15.2:0/2487394065 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f24800a2e10 msgr2=0x7f24800a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:51.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.543+0000 7f24a2400640 1 --2- 172.21.15.2:0/2487394065 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f24800a2e10 0x7f24800a52d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f248c009fc0 tx=0x7f248c005f90 comp rx=0 tx=0).stop 2024-06-13T11:23:51.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.543+0000 7f24a2400640 1 -- 172.21.15.2:0/2487394065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f249c104e90 msgr2=0x7f249c100510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:51.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.543+0000 7f24a2400640 1 --2- 172.21.15.2:0/2487394065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f249c104e90 0x7f249c100510 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2488031440 tx=0x7f2488032ce0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.543+0000 7f24a2400640 1 -- 172.21.15.2:0/2487394065 shutdown_connections 2024-06-13T11:23:51.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.543+0000 7f24a2400640 1 --2- 172.21.15.2:0/2487394065 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f24800a2e10 0x7f24800a52d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.543+0000 7f24a2400640 1 --2- 172.21.15.2:0/2487394065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f249c1077c0 0x7f249c100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.543+0000 7f24a2400640 1 --2- 172.21.15.2:0/2487394065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f249c104e90 0x7f249c100510 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.543+0000 7f24a2400640 1 --2- 172.21.15.2:0/2487394065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f249c102560 0x7f249c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.543+0000 7f24a2400640 1 -- 172.21.15.2:0/2487394065 >> 172.21.15.2:0/2487394065 conn(0x7f249c0fbf70 msgr2=0x7f249c102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:51.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.543+0000 7f24a2400640 1 -- 172.21.15.2:0/2487394065 shutdown_connections 2024-06-13T11:23:51.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.543+0000 7f24a2400640 1 -- 172.21.15.2:0/2487394065 wait complete. 2024-06-13T11:23:51.561 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-06-13T11:23:50.166214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1190737,"num_objects":66,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1566,"num_read_kb":947,"num_write":480,"num_write_kb":4386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":873,"ondisk_log_size":873,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391908,"kb_used_data":13604,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124549916,"statfs":{"total":1151940427776,"available":1151539113984,"internally_reserved":0,"allocated":13930496,"data_stored":10501691,"data_compressed":610878,"data_compressed_allocated":823296,"data_compressed_original":4497408,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.985821"},"pg_stats":[{"pgid":"3.3f","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315200+0000","last_change":"2024-06-13T11:18:42.925351+0000","last_active":"2024-06-13T11:23:46.315200+0000","last_peered":"2024-06-13T11:23:46.315200+0000","last_clean":"2024-06-13T11:23:46.315200+0000","last_became_active":"2024-06-13T11:18:42.924971+0000","last_became_peered":"2024-06-13T11:18:42.924971+0000","last_unstale":"2024-06-13T11:23:46.315200+0000","last_undegraded":"2024-06-13T11:23:46.315200+0000","last_fullsized":"2024-06-13T11:23:46.315200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:33:49.563311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"99'4","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.316155+0000","last_change":"2024-06-13T11:18:42.923771+0000","last_active":"2024-06-13T11:23:46.316155+0000","last_peered":"2024-06-13T11:23:46.316155+0000","last_clean":"2024-06-13T11:23:46.316155+0000","last_became_active":"2024-06-13T11:18:42.918410+0000","last_became_peered":"2024-06-13T11:18:42.918410+0000","last_unstale":"2024-06-13T11:23:46.316155+0000","last_undegraded":"2024-06-13T11:23:46.316155+0000","last_fullsized":"2024-06-13T11:23:46.316155+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:11:28.256622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315856+0000","last_change":"2024-06-13T11:18:42.919502+0000","last_active":"2024-06-13T11:23:46.315856+0000","last_peered":"2024-06-13T11:23:46.315856+0000","last_clean":"2024-06-13T11:23:46.315856+0000","last_became_active":"2024-06-13T11:18:42.915747+0000","last_became_peered":"2024-06-13T11:18:42.915747+0000","last_unstale":"2024-06-13T11:23:46.315856+0000","last_undegraded":"2024-06-13T11:23:46.315856+0000","last_fullsized":"2024-06-13T11:23:46.315856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:39:23.555604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315264+0000","last_change":"2024-06-13T11:18:42.905944+0000","last_active":"2024-06-13T11:23:46.315264+0000","last_peered":"2024-06-13T11:23:46.315264+0000","last_clean":"2024-06-13T11:23:46.315264+0000","last_became_active":"2024-06-13T11:18:42.905494+0000","last_became_peered":"2024-06-13T11:18:42.905494+0000","last_unstale":"2024-06-13T11:23:46.315264+0000","last_undegraded":"2024-06-13T11:23:46.315264+0000","last_fullsized":"2024-06-13T11:23:46.315264+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:26:44.396593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"99'4","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283230+0000","last_change":"2024-06-13T11:18:42.924212+0000","last_active":"2024-06-13T11:23:46.283230+0000","last_peered":"2024-06-13T11:23:46.283230+0000","last_clean":"2024-06-13T11:23:46.283230+0000","last_became_active":"2024-06-13T11:18:42.923848+0000","last_became_peered":"2024-06-13T11:18:42.923848+0000","last_unstale":"2024-06-13T11:23:46.283230+0000","last_undegraded":"2024-06-13T11:23:46.283230+0000","last_fullsized":"2024-06-13T11:23:46.283230+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:01.754609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.298058+0000","last_change":"2024-06-13T11:18:42.915283+0000","last_active":"2024-06-13T11:23:46.298058+0000","last_peered":"2024-06-13T11:23:46.298058+0000","last_clean":"2024-06-13T11:23:46.298058+0000","last_became_active":"2024-06-13T11:18:42.914921+0000","last_became_peered":"2024-06-13T11:18:42.914921+0000","last_unstale":"2024-06-13T11:23:46.298058+0000","last_undegraded":"2024-06-13T11:23:46.298058+0000","last_fullsized":"2024-06-13T11:23:46.298058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:48:42.116314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"99'5","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315332+0000","last_change":"2024-06-13T11:18:42.911614+0000","last_active":"2024-06-13T11:23:46.315332+0000","last_peered":"2024-06-13T11:23:46.315332+0000","last_clean":"2024-06-13T11:23:46.315332+0000","last_became_active":"2024-06-13T11:18:42.911360+0000","last_became_peered":"2024-06-13T11:18:42.911360+0000","last_unstale":"2024-06-13T11:23:46.315332+0000","last_undegraded":"2024-06-13T11:23:46.315332+0000","last_fullsized":"2024-06-13T11:23:46.315332+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:23:55.161725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"99'9","reported_seq":27,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.150483+0000","last_change":"2024-06-13T11:19:27.074801+0000","last_active":"2024-06-13T11:23:46.150483+0000","last_peered":"2024-06-13T11:23:46.150483+0000","last_clean":"2024-06-13T11:23:46.150483+0000","last_became_active":"2024-06-13T11:19:27.072783+0000","last_became_peered":"2024-06-13T11:19:27.072783+0000","last_unstale":"2024-06-13T11:23:46.150483+0000","last_undegraded":"2024-06-13T11:23:46.150483+0000","last_fullsized":"2024-06-13T11:23:46.150483+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:34.658008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"99'11","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300678+0000","last_change":"2024-06-13T11:18:42.913482+0000","last_active":"2024-06-13T11:23:46.300678+0000","last_peered":"2024-06-13T11:23:46.300678+0000","last_clean":"2024-06-13T11:23:46.300678+0000","last_became_active":"2024-06-13T11:18:42.912700+0000","last_became_peered":"2024-06-13T11:18:42.912700+0000","last_unstale":"2024-06-13T11:23:46.300678+0000","last_undegraded":"2024-06-13T11:23:46.300678+0000","last_fullsized":"2024-06-13T11:23:46.300678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:38:42.053801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"99'16","reported_seq":58,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.298539+0000","last_change":"2024-06-13T11:18:42.905824+0000","last_active":"2024-06-13T11:23:46.298539+0000","last_peered":"2024-06-13T11:23:46.298539+0000","last_clean":"2024-06-13T11:23:46.298539+0000","last_became_active":"2024-06-13T11:18:42.905443+0000","last_became_peered":"2024-06-13T11:18:42.905443+0000","last_unstale":"2024-06-13T11:23:46.298539+0000","last_undegraded":"2024-06-13T11:23:46.298539+0000","last_fullsized":"2024-06-13T11:23:46.298539+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:51:46.957656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315564+0000","last_change":"2024-06-13T11:18:42.901987+0000","last_active":"2024-06-13T11:23:46.315564+0000","last_peered":"2024-06-13T11:23:46.315564+0000","last_clean":"2024-06-13T11:23:46.315564+0000","last_became_active":"2024-06-13T11:18:42.901641+0000","last_became_peered":"2024-06-13T11:18:42.901641+0000","last_unstale":"2024-06-13T11:23:46.315564+0000","last_undegraded":"2024-06-13T11:23:46.315564+0000","last_fullsized":"2024-06-13T11:23:46.315564+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:52:29.036172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315230+0000","last_change":"2024-06-13T11:18:42.899161+0000","last_active":"2024-06-13T11:23:46.315230+0000","last_peered":"2024-06-13T11:23:46.315230+0000","last_clean":"2024-06-13T11:23:46.315230+0000","last_became_active":"2024-06-13T11:18:42.898823+0000","last_became_peered":"2024-06-13T11:18:42.898823+0000","last_unstale":"2024-06-13T11:23:46.315230+0000","last_undegraded":"2024-06-13T11:23:46.315230+0000","last_fullsized":"2024-06-13T11:23:46.315230+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:21:20.968759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"99'10","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146793+0000","last_change":"2024-06-13T11:18:42.908954+0000","last_active":"2024-06-13T11:23:46.146793+0000","last_peered":"2024-06-13T11:23:46.146793+0000","last_clean":"2024-06-13T11:23:46.146793+0000","last_became_active":"2024-06-13T11:18:42.908604+0000","last_became_peered":"2024-06-13T11:18:42.908604+0000","last_unstale":"2024-06-13T11:23:46.146793+0000","last_undegraded":"2024-06-13T11:23:46.146793+0000","last_fullsized":"2024-06-13T11:23:46.146793+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:00:30.662233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315379+0000","last_change":"2024-06-13T11:18:42.925374+0000","last_active":"2024-06-13T11:23:46.315379+0000","last_peered":"2024-06-13T11:23:46.315379+0000","last_clean":"2024-06-13T11:23:46.315379+0000","last_became_active":"2024-06-13T11:18:42.924624+0000","last_became_peered":"2024-06-13T11:18:42.924624+0000","last_unstale":"2024-06-13T11:23:46.315379+0000","last_undegraded":"2024-06-13T11:23:46.315379+0000","last_fullsized":"2024-06-13T11:23:46.315379+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:07.989887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315538+0000","last_change":"2024-06-13T11:18:42.924457+0000","last_active":"2024-06-13T11:23:46.315538+0000","last_peered":"2024-06-13T11:23:46.315538+0000","last_clean":"2024-06-13T11:23:46.315538+0000","last_became_active":"2024-06-13T11:18:42.922641+0000","last_became_peered":"2024-06-13T11:18:42.922641+0000","last_unstale":"2024-06-13T11:23:46.315538+0000","last_undegraded":"2024-06-13T11:23:46.315538+0000","last_fullsized":"2024-06-13T11:23:46.315538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:52:56.769565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.299922+0000","last_change":"2024-06-13T11:18:42.925333+0000","last_active":"2024-06-13T11:23:46.299922+0000","last_peered":"2024-06-13T11:23:46.299922+0000","last_clean":"2024-06-13T11:23:46.299922+0000","last_became_active":"2024-06-13T11:18:42.924854+0000","last_became_peered":"2024-06-13T11:18:42.924854+0000","last_unstale":"2024-06-13T11:23:46.299922+0000","last_undegraded":"2024-06-13T11:23:46.299922+0000","last_fullsized":"2024-06-13T11:23:46.299922+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:30:38.554616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314964+0000","last_change":"2024-06-13T11:18:42.926652+0000","last_active":"2024-06-13T11:23:46.314964+0000","last_peered":"2024-06-13T11:23:46.314964+0000","last_clean":"2024-06-13T11:23:46.314964+0000","last_became_active":"2024-06-13T11:18:42.926281+0000","last_became_peered":"2024-06-13T11:18:42.926281+0000","last_unstale":"2024-06-13T11:23:46.314964+0000","last_undegraded":"2024-06-13T11:23:46.314964+0000","last_fullsized":"2024-06-13T11:23:46.314964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:50:50.483047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"99'10","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151530+0000","last_change":"2024-06-13T11:18:42.917743+0000","last_active":"2024-06-13T11:23:46.151530+0000","last_peered":"2024-06-13T11:23:46.151530+0000","last_clean":"2024-06-13T11:23:46.151530+0000","last_became_active":"2024-06-13T11:18:42.916473+0000","last_became_peered":"2024-06-13T11:18:42.916473+0000","last_unstale":"2024-06-13T11:23:46.151530+0000","last_undegraded":"2024-06-13T11:23:46.151530+0000","last_fullsized":"2024-06-13T11:23:46.151530+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:20:12.909524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144409+0000","last_change":"2024-06-13T11:18:42.930712+0000","last_active":"2024-06-13T11:23:46.144409+0000","last_peered":"2024-06-13T11:23:46.144409+0000","last_clean":"2024-06-13T11:23:46.144409+0000","last_became_active":"2024-06-13T11:18:42.930446+0000","last_became_peered":"2024-06-13T11:18:42.930446+0000","last_unstale":"2024-06-13T11:23:46.144409+0000","last_undegraded":"2024-06-13T11:23:46.144409+0000","last_fullsized":"2024-06-13T11:23:46.144409+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:08:28.729916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":31,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.143940+0000","last_change":"2024-06-13T11:18:57.027006+0000","last_active":"2024-06-13T11:23:46.143940+0000","last_peered":"2024-06-13T11:23:46.143940+0000","last_clean":"2024-06-13T11:23:46.143940+0000","last_became_active":"2024-06-13T11:18:57.026562+0000","last_became_peered":"2024-06-13T11:18:57.026562+0000","last_unstale":"2024-06-13T11:23:46.143940+0000","last_undegraded":"2024-06-13T11:23:46.143940+0000","last_fullsized":"2024-06-13T11:23:46.143940+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:17:32.180729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"97'9","reported_seq":58,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151833+0000","last_change":"2024-06-13T11:18:38.172704+0000","last_active":"2024-06-13T11:23:46.151833+0000","last_peered":"2024-06-13T11:23:46.151833+0000","last_clean":"2024-06-13T11:23:46.151833+0000","last_became_active":"2024-06-13T11:18:38.172125+0000","last_became_peered":"2024-06-13T11:18:38.172125+0000","last_unstale":"2024-06-13T11:23:46.151833+0000","last_undegraded":"2024-06-13T11:23:46.151833+0000","last_fullsized":"2024-06-13T11:23:46.151833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:40:52.578805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"99'5","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.286600+0000","last_change":"2024-06-13T11:18:42.922864+0000","last_active":"2024-06-13T11:23:46.286600+0000","last_peered":"2024-06-13T11:23:46.286600+0000","last_clean":"2024-06-13T11:23:46.286600+0000","last_became_active":"2024-06-13T11:18:42.921283+0000","last_became_peered":"2024-06-13T11:18:42.921283+0000","last_unstale":"2024-06-13T11:23:46.286600+0000","last_undegraded":"2024-06-13T11:23:46.286600+0000","last_fullsized":"2024-06-13T11:23:46.286600+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:44.421502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314841+0000","last_change":"2024-06-13T11:20:27.904814+0000","last_active":"2024-06-13T11:23:46.314841+0000","last_peered":"2024-06-13T11:23:46.314841+0000","last_clean":"2024-06-13T11:23:46.314841+0000","last_became_active":"2024-06-13T11:20:27.904342+0000","last_became_peered":"2024-06-13T11:20:27.904342+0000","last_unstale":"2024-06-13T11:23:46.314841+0000","last_undegraded":"2024-06-13T11:23:46.314841+0000","last_fullsized":"2024-06-13T11:23:46.314841+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:45:59.215429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,10,3],"acting":[4,6,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.286095+0000","last_change":"2024-06-13T11:18:38.483021+0000","last_active":"2024-06-13T11:23:46.286095+0000","last_peered":"2024-06-13T11:23:46.286095+0000","last_clean":"2024-06-13T11:23:46.286095+0000","last_became_active":"2024-06-13T11:18:38.482594+0000","last_became_peered":"2024-06-13T11:18:38.482594+0000","last_unstale":"2024-06-13T11:23:46.286095+0000","last_undegraded":"2024-06-13T11:23:46.286095+0000","last_fullsized":"2024-06-13T11:23:46.286095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:27:07.660961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315949+0000","last_change":"2024-06-13T11:18:42.926272+0000","last_active":"2024-06-13T11:23:46.315949+0000","last_peered":"2024-06-13T11:23:46.315949+0000","last_clean":"2024-06-13T11:23:46.315949+0000","last_became_active":"2024-06-13T11:18:42.925864+0000","last_became_peered":"2024-06-13T11:18:42.925864+0000","last_unstale":"2024-06-13T11:23:46.315949+0000","last_undegraded":"2024-06-13T11:23:46.315949+0000","last_fullsized":"2024-06-13T11:23:46.315949+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:51:59.562266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":31,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314909+0000","last_change":"2024-06-13T11:18:57.033152+0000","last_active":"2024-06-13T11:23:46.314909+0000","last_peered":"2024-06-13T11:23:46.314909+0000","last_clean":"2024-06-13T11:23:46.314909+0000","last_became_active":"2024-06-13T11:18:57.032696+0000","last_became_peered":"2024-06-13T11:18:57.032696+0000","last_unstale":"2024-06-13T11:23:46.314909+0000","last_undegraded":"2024-06-13T11:23:46.314909+0000","last_fullsized":"2024-06-13T11:23:46.314909+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:59:20.584476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'4","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283684+0000","last_change":"2024-06-13T11:18:38.168246+0000","last_active":"2024-06-13T11:23:46.283684+0000","last_peered":"2024-06-13T11:23:46.283684+0000","last_clean":"2024-06-13T11:23:46.283684+0000","last_became_active":"2024-06-13T11:18:38.167918+0000","last_became_peered":"2024-06-13T11:18:38.167918+0000","last_unstale":"2024-06-13T11:23:46.283684+0000","last_undegraded":"2024-06-13T11:23:46.283684+0000","last_fullsized":"2024-06-13T11:23:46.283684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:23:39.079356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300375+0000","last_change":"2024-06-13T11:18:42.901291+0000","last_active":"2024-06-13T11:23:46.300375+0000","last_peered":"2024-06-13T11:23:46.300375+0000","last_clean":"2024-06-13T11:23:46.300375+0000","last_became_active":"2024-06-13T11:18:42.900990+0000","last_became_peered":"2024-06-13T11:18:42.900990+0000","last_unstale":"2024-06-13T11:23:46.300375+0000","last_undegraded":"2024-06-13T11:23:46.300375+0000","last_fullsized":"2024-06-13T11:23:46.300375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:59:03.521767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314782+0000","last_change":"2024-06-13T11:20:27.905640+0000","last_active":"2024-06-13T11:23:46.314782+0000","last_peered":"2024-06-13T11:23:46.314782+0000","last_clean":"2024-06-13T11:23:46.314782+0000","last_became_active":"2024-06-13T11:20:27.905149+0000","last_became_peered":"2024-06-13T11:20:27.905149+0000","last_unstale":"2024-06-13T11:23:46.314782+0000","last_undegraded":"2024-06-13T11:23:46.314782+0000","last_fullsized":"2024-06-13T11:23:46.314782+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:24:14.702582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283529+0000","last_change":"2024-06-13T11:18:38.170301+0000","last_active":"2024-06-13T11:23:46.283529+0000","last_peered":"2024-06-13T11:23:46.283529+0000","last_clean":"2024-06-13T11:23:46.283529+0000","last_became_active":"2024-06-13T11:18:38.169926+0000","last_became_peered":"2024-06-13T11:18:38.169926+0000","last_unstale":"2024-06-13T11:23:46.283529+0000","last_undegraded":"2024-06-13T11:23:46.283529+0000","last_fullsized":"2024-06-13T11:23:46.283529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:02:02.877638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"99'15","reported_seq":57,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294616+0000","last_change":"2024-06-13T11:18:42.907869+0000","last_active":"2024-06-13T11:23:46.294616+0000","last_peered":"2024-06-13T11:23:46.294616+0000","last_clean":"2024-06-13T11:23:46.294616+0000","last_became_active":"2024-06-13T11:18:42.907349+0000","last_became_peered":"2024-06-13T11:18:42.907349+0000","last_unstale":"2024-06-13T11:23:46.294616+0000","last_undegraded":"2024-06-13T11:23:46.294616+0000","last_fullsized":"2024-06-13T11:23:46.294616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:54:33.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":31,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144114+0000","last_change":"2024-06-13T11:18:57.009598+0000","last_active":"2024-06-13T11:23:46.144114+0000","last_peered":"2024-06-13T11:23:46.144114+0000","last_clean":"2024-06-13T11:23:46.144114+0000","last_became_active":"2024-06-13T11:18:57.009186+0000","last_became_peered":"2024-06-13T11:18:57.009186+0000","last_unstale":"2024-06-13T11:23:46.144114+0000","last_undegraded":"2024-06-13T11:23:46.144114+0000","last_fullsized":"2024-06-13T11:23:46.144114+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:41:46.784749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"100'8","reported_seq":278,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.753339+0000","last_change":"2024-06-13T11:18:38.167060+0000","last_active":"2024-06-13T11:23:46.753339+0000","last_peered":"2024-06-13T11:23:46.753339+0000","last_clean":"2024-06-13T11:23:46.753339+0000","last_became_active":"2024-06-13T11:18:38.166704+0000","last_became_peered":"2024-06-13T11:18:38.166704+0000","last_unstale":"2024-06-13T11:23:46.753339+0000","last_undegraded":"2024-06-13T11:23:46.753339+0000","last_fullsized":"2024-06-13T11:23:46.753339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:30:51.754276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1543,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":222,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283148+0000","last_change":"2024-06-13T11:18:42.915361+0000","last_active":"2024-06-13T11:23:46.283148+0000","last_peered":"2024-06-13T11:23:46.283148+0000","last_clean":"2024-06-13T11:23:46.283148+0000","last_became_active":"2024-06-13T11:18:42.914977+0000","last_became_peered":"2024-06-13T11:18:42.914977+0000","last_unstale":"2024-06-13T11:23:46.283148+0000","last_undegraded":"2024-06-13T11:23:46.283148+0000","last_fullsized":"2024-06-13T11:23:46.283148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:04:30.677548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144095+0000","last_change":"2024-06-13T11:20:27.603953+0000","last_active":"2024-06-13T11:23:46.144095+0000","last_peered":"2024-06-13T11:23:46.144095+0000","last_clean":"2024-06-13T11:23:46.144095+0000","last_became_active":"2024-06-13T11:20:27.603306+0000","last_became_peered":"2024-06-13T11:20:27.603306+0000","last_unstale":"2024-06-13T11:23:46.144095+0000","last_undegraded":"2024-06-13T11:23:46.144095+0000","last_fullsized":"2024-06-13T11:23:46.144095+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:02:01.228984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'3","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.297963+0000","last_change":"2024-06-13T11:18:38.170126+0000","last_active":"2024-06-13T11:23:46.297963+0000","last_peered":"2024-06-13T11:23:46.297963+0000","last_clean":"2024-06-13T11:23:46.297963+0000","last_became_active":"2024-06-13T11:18:38.169736+0000","last_became_peered":"2024-06-13T11:18:38.169736+0000","last_unstale":"2024-06-13T11:23:46.297963+0000","last_undegraded":"2024-06-13T11:23:46.297963+0000","last_fullsized":"2024-06-13T11:23:46.297963+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:07:22.778093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294559+0000","last_change":"2024-06-13T11:18:42.929004+0000","last_active":"2024-06-13T11:23:46.294559+0000","last_peered":"2024-06-13T11:23:46.294559+0000","last_clean":"2024-06-13T11:23:46.294559+0000","last_became_active":"2024-06-13T11:18:42.928579+0000","last_became_peered":"2024-06-13T11:18:42.928579+0000","last_unstale":"2024-06-13T11:23:46.294559+0000","last_undegraded":"2024-06-13T11:23:46.294559+0000","last_fullsized":"2024-06-13T11:23:46.294559+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:31:15.703033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315006+0000","last_change":"2024-06-13T11:18:57.031059+0000","last_active":"2024-06-13T11:23:46.315006+0000","last_peered":"2024-06-13T11:23:46.315006+0000","last_clean":"2024-06-13T11:23:46.315006+0000","last_became_active":"2024-06-13T11:18:57.030723+0000","last_became_peered":"2024-06-13T11:18:57.030723+0000","last_unstale":"2024-06-13T11:23:46.315006+0000","last_undegraded":"2024-06-13T11:23:46.315006+0000","last_fullsized":"2024-06-13T11:23:46.315006+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:19:36.883790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'2","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146807+0000","last_change":"2024-06-13T11:18:38.175189+0000","last_active":"2024-06-13T11:23:46.146807+0000","last_peered":"2024-06-13T11:23:46.146807+0000","last_clean":"2024-06-13T11:23:46.146807+0000","last_became_active":"2024-06-13T11:18:38.173817+0000","last_became_peered":"2024-06-13T11:18:38.173817+0000","last_unstale":"2024-06-13T11:23:46.146807+0000","last_undegraded":"2024-06-13T11:23:46.146807+0000","last_fullsized":"2024-06-13T11:23:46.146807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:02:18.422449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.284009+0000","last_change":"2024-06-13T11:18:42.920665+0000","last_active":"2024-06-13T11:23:46.284009+0000","last_peered":"2024-06-13T11:23:46.284009+0000","last_clean":"2024-06-13T11:23:46.284009+0000","last_became_active":"2024-06-13T11:18:42.919461+0000","last_became_peered":"2024-06-13T11:18:42.919461+0000","last_unstale":"2024-06-13T11:23:46.284009+0000","last_undegraded":"2024-06-13T11:23:46.284009+0000","last_fullsized":"2024-06-13T11:23:46.284009+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:56:23.042481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.316348+0000","last_change":"2024-06-13T11:18:57.025822+0000","last_active":"2024-06-13T11:23:46.316348+0000","last_peered":"2024-06-13T11:23:46.316348+0000","last_clean":"2024-06-13T11:23:46.316348+0000","last_became_active":"2024-06-13T11:18:57.025408+0000","last_became_peered":"2024-06-13T11:18:57.025408+0000","last_unstale":"2024-06-13T11:23:46.316348+0000","last_undegraded":"2024-06-13T11:23:46.316348+0000","last_fullsized":"2024-06-13T11:23:46.316348+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:39:28.295433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'1","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.293898+0000","last_change":"2024-06-13T11:18:38.168097+0000","last_active":"2024-06-13T11:23:46.293898+0000","last_peered":"2024-06-13T11:23:46.293898+0000","last_clean":"2024-06-13T11:23:46.293898+0000","last_became_active":"2024-06-13T11:18:38.167812+0000","last_became_peered":"2024-06-13T11:18:38.167812+0000","last_unstale":"2024-06-13T11:23:46.293898+0000","last_undegraded":"2024-06-13T11:23:46.293898+0000","last_fullsized":"2024-06-13T11:23:46.293898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:24:20.247579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"99'11","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.150942+0000","last_change":"2024-06-13T11:18:42.932941+0000","last_active":"2024-06-13T11:23:46.150942+0000","last_peered":"2024-06-13T11:23:46.150942+0000","last_clean":"2024-06-13T11:23:46.150942+0000","last_became_active":"2024-06-13T11:18:42.931942+0000","last_became_peered":"2024-06-13T11:18:42.931942+0000","last_unstale":"2024-06-13T11:23:46.150942+0000","last_undegraded":"2024-06-13T11:23:46.150942+0000","last_fullsized":"2024-06-13T11:23:46.150942+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:12:38.625753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.284213+0000","last_change":"2024-06-13T11:18:57.026834+0000","last_active":"2024-06-13T11:23:46.284213+0000","last_peered":"2024-06-13T11:23:46.284213+0000","last_clean":"2024-06-13T11:23:46.284213+0000","last_became_active":"2024-06-13T11:18:57.026401+0000","last_became_peered":"2024-06-13T11:18:57.026401+0000","last_unstale":"2024-06-13T11:23:46.284213+0000","last_undegraded":"2024-06-13T11:23:46.284213+0000","last_fullsized":"2024-06-13T11:23:46.284213+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:11:19.993946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"100'5","reported_seq":270,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.509969+0000","last_change":"2024-06-13T11:18:38.172648+0000","last_active":"2024-06-13T11:23:46.509969+0000","last_peered":"2024-06-13T11:23:46.509969+0000","last_clean":"2024-06-13T11:23:46.509969+0000","last_became_active":"2024-06-13T11:18:38.172311+0000","last_became_peered":"2024-06-13T11:18:38.172311+0000","last_unstale":"2024-06-13T11:23:46.509969+0000","last_undegraded":"2024-06-13T11:23:46.509969+0000","last_fullsized":"2024-06-13T11:23:46.509969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:59:10.620378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":217,"num_read_kb":217,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"99'10","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300652+0000","last_change":"2024-06-13T11:18:42.920352+0000","last_active":"2024-06-13T11:23:46.300652+0000","last_peered":"2024-06-13T11:23:46.300652+0000","last_clean":"2024-06-13T11:23:46.300652+0000","last_became_active":"2024-06-13T11:18:42.919969+0000","last_became_peered":"2024-06-13T11:18:42.919969+0000","last_unstale":"2024-06-13T11:23:46.300652+0000","last_undegraded":"2024-06-13T11:23:46.300652+0000","last_fullsized":"2024-06-13T11:23:46.300652+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:10:59.832735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.150793+0000","last_change":"2024-06-13T11:18:57.034774+0000","last_active":"2024-06-13T11:23:46.150793+0000","last_peered":"2024-06-13T11:23:46.150793+0000","last_clean":"2024-06-13T11:23:46.150793+0000","last_became_active":"2024-06-13T11:18:57.031812+0000","last_became_peered":"2024-06-13T11:18:57.031812+0000","last_unstale":"2024-06-13T11:23:46.150793+0000","last_undegraded":"2024-06-13T11:23:46.150793+0000","last_fullsized":"2024-06-13T11:23:46.150793+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:26.195958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'2","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315391+0000","last_change":"2024-06-13T11:18:38.168169+0000","last_active":"2024-06-13T11:23:46.315391+0000","last_peered":"2024-06-13T11:23:46.315391+0000","last_clean":"2024-06-13T11:23:46.315391+0000","last_became_active":"2024-06-13T11:18:38.167791+0000","last_became_peered":"2024-06-13T11:18:38.167791+0000","last_unstale":"2024-06-13T11:23:46.315391+0000","last_undegraded":"2024-06-13T11:23:46.315391+0000","last_fullsized":"2024-06-13T11:23:46.315391+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:04.879468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"99'9","reported_seq":57,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315768+0000","last_change":"2024-06-13T11:19:27.077888+0000","last_active":"2024-06-13T11:23:46.315768+0000","last_peered":"2024-06-13T11:23:46.315768+0000","last_clean":"2024-06-13T11:23:46.315768+0000","last_became_active":"2024-06-13T11:19:27.075904+0000","last_became_peered":"2024-06-13T11:19:27.075904+0000","last_unstale":"2024-06-13T11:23:46.315768+0000","last_undegraded":"2024-06-13T11:23:46.315768+0000","last_fullsized":"2024-06-13T11:23:46.315768+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:59.920163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.316039+0000","last_change":"2024-06-13T11:19:27.073568+0000","last_active":"2024-06-13T11:23:46.316039+0000","last_peered":"2024-06-13T11:23:46.316039+0000","last_clean":"2024-06-13T11:23:46.316039+0000","last_became_active":"2024-06-13T11:19:27.072954+0000","last_became_peered":"2024-06-13T11:19:27.072954+0000","last_unstale":"2024-06-13T11:23:46.316039+0000","last_undegraded":"2024-06-13T11:23:46.316039+0000","last_fullsized":"2024-06-13T11:23:46.316039+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:10:25.492093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'4","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294413+0000","last_change":"2024-06-13T11:18:38.482021+0000","last_active":"2024-06-13T11:23:46.294413+0000","last_peered":"2024-06-13T11:23:46.294413+0000","last_clean":"2024-06-13T11:23:46.294413+0000","last_became_active":"2024-06-13T11:18:38.481574+0000","last_became_peered":"2024-06-13T11:18:38.481574+0000","last_unstale":"2024-06-13T11:23:46.294413+0000","last_undegraded":"2024-06-13T11:23:46.294413+0000","last_fullsized":"2024-06-13T11:23:46.294413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:50:54.297559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"99'11","reported_seq":59,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300642+0000","last_change":"2024-06-13T11:19:27.072380+0000","last_active":"2024-06-13T11:23:46.300642+0000","last_peered":"2024-06-13T11:23:46.300642+0000","last_clean":"2024-06-13T11:23:46.300642+0000","last_became_active":"2024-06-13T11:19:27.072027+0000","last_became_peered":"2024-06-13T11:19:27.072027+0000","last_unstale":"2024-06-13T11:23:46.300642+0000","last_undegraded":"2024-06-13T11:23:46.300642+0000","last_fullsized":"2024-06-13T11:23:46.300642+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:37:10.455890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151029+0000","last_change":"2024-06-13T11:18:57.028370+0000","last_active":"2024-06-13T11:23:46.151029+0000","last_peered":"2024-06-13T11:23:46.151029+0000","last_clean":"2024-06-13T11:23:46.151029+0000","last_became_active":"2024-06-13T11:18:57.023478+0000","last_became_peered":"2024-06-13T11:18:57.023478+0000","last_unstale":"2024-06-13T11:23:46.151029+0000","last_undegraded":"2024-06-13T11:23:46.151029+0000","last_fullsized":"2024-06-13T11:23:46.151029+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:25:01.237698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"100'41","reported_seq":535,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.752687+0000","last_change":"2024-06-13T11:18:38.169179+0000","last_active":"2024-06-13T11:23:46.752687+0000","last_peered":"2024-06-13T11:23:46.752687+0000","last_clean":"2024-06-13T11:23:46.752687+0000","last_became_active":"2024-06-13T11:18:38.168775+0000","last_became_peered":"2024-06-13T11:18:38.168775+0000","last_unstale":"2024-06-13T11:23:46.752687+0000","last_undegraded":"2024-06-13T11:23:46.752687+0000","last_fullsized":"2024-06-13T11:23:46.752687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:53:39.290755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69867,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":291,"num_write":42,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283436+0000","last_change":"2024-06-13T11:18:42.903744+0000","last_active":"2024-06-13T11:23:46.283436+0000","last_peered":"2024-06-13T11:23:46.283436+0000","last_clean":"2024-06-13T11:23:46.283436+0000","last_became_active":"2024-06-13T11:18:42.903410+0000","last_became_peered":"2024-06-13T11:18:42.903410+0000","last_unstale":"2024-06-13T11:23:46.283436+0000","last_undegraded":"2024-06-13T11:23:46.283436+0000","last_fullsized":"2024-06-13T11:23:46.283436+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:17:55.975517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294901+0000","last_change":"2024-06-13T11:18:57.026052+0000","last_active":"2024-06-13T11:23:46.294901+0000","last_peered":"2024-06-13T11:23:46.294901+0000","last_clean":"2024-06-13T11:23:46.294901+0000","last_became_active":"2024-06-13T11:18:57.025677+0000","last_became_peered":"2024-06-13T11:18:57.025677+0000","last_unstale":"2024-06-13T11:23:46.294901+0000","last_undegraded":"2024-06-13T11:23:46.294901+0000","last_fullsized":"2024-06-13T11:23:46.294901+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:41.061675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'6","reported_seq":55,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144372+0000","last_change":"2024-06-13T11:18:38.166672+0000","last_active":"2024-06-13T11:23:46.144372+0000","last_peered":"2024-06-13T11:23:46.144372+0000","last_clean":"2024-06-13T11:23:46.144372+0000","last_became_active":"2024-06-13T11:18:38.165923+0000","last_became_peered":"2024-06-13T11:18:38.165923+0000","last_unstale":"2024-06-13T11:23:46.144372+0000","last_undegraded":"2024-06-13T11:23:46.144372+0000","last_fullsized":"2024-06-13T11:23:46.144372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:54:00.989462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146908+0000","last_change":"2024-06-13T11:18:42.919280+0000","last_active":"2024-06-13T11:23:46.146908+0000","last_peered":"2024-06-13T11:23:46.146908+0000","last_clean":"2024-06-13T11:23:46.146908+0000","last_became_active":"2024-06-13T11:18:42.917421+0000","last_became_peered":"2024-06-13T11:18:42.917421+0000","last_unstale":"2024-06-13T11:23:46.146908+0000","last_undegraded":"2024-06-13T11:23:46.146908+0000","last_fullsized":"2024-06-13T11:23:46.146908+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:52:23.765290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314791+0000","last_change":"2024-06-13T11:18:57.031244+0000","last_active":"2024-06-13T11:23:46.314791+0000","last_peered":"2024-06-13T11:23:46.314791+0000","last_clean":"2024-06-13T11:23:46.314791+0000","last_became_active":"2024-06-13T11:18:57.030781+0000","last_became_peered":"2024-06-13T11:18:57.030781+0000","last_unstale":"2024-06-13T11:23:46.314791+0000","last_undegraded":"2024-06-13T11:23:46.314791+0000","last_fullsized":"2024-06-13T11:23:46.314791+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:19:51.722256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'3","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294215+0000","last_change":"2024-06-13T11:18:38.171060+0000","last_active":"2024-06-13T11:23:46.294215+0000","last_peered":"2024-06-13T11:23:46.294215+0000","last_clean":"2024-06-13T11:23:46.294215+0000","last_became_active":"2024-06-13T11:18:38.170682+0000","last_became_peered":"2024-06-13T11:18:38.170682+0000","last_unstale":"2024-06-13T11:23:46.294215+0000","last_undegraded":"2024-06-13T11:23:46.294215+0000","last_fullsized":"2024-06-13T11:23:46.294215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:05:53.157074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"99'15","reported_seq":57,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315877+0000","last_change":"2024-06-13T11:18:42.902700+0000","last_active":"2024-06-13T11:23:46.315877+0000","last_peered":"2024-06-13T11:23:46.315877+0000","last_clean":"2024-06-13T11:23:46.315877+0000","last_became_active":"2024-06-13T11:18:42.902351+0000","last_became_peered":"2024-06-13T11:18:42.902351+0000","last_unstale":"2024-06-13T11:23:46.315877+0000","last_undegraded":"2024-06-13T11:23:46.315877+0000","last_fullsized":"2024-06-13T11:23:46.315877+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:55:16.769324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151561+0000","last_change":"2024-06-13T11:18:57.034840+0000","last_active":"2024-06-13T11:23:46.151561+0000","last_peered":"2024-06-13T11:23:46.151561+0000","last_clean":"2024-06-13T11:23:46.151561+0000","last_became_active":"2024-06-13T11:18:57.033552+0000","last_became_peered":"2024-06-13T11:18:57.033552+0000","last_unstale":"2024-06-13T11:23:46.151561+0000","last_undegraded":"2024-06-13T11:23:46.151561+0000","last_fullsized":"2024-06-13T11:23:46.151561+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:44:25.463043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"100'6","reported_seq":276,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.903842+0000","last_change":"2024-06-13T11:18:38.170644+0000","last_active":"2024-06-13T11:23:46.903842+0000","last_peered":"2024-06-13T11:23:46.903842+0000","last_clean":"2024-06-13T11:23:46.903842+0000","last_became_active":"2024-06-13T11:18:38.169986+0000","last_became_peered":"2024-06-13T11:18:38.169986+0000","last_unstale":"2024-06-13T11:23:46.903842+0000","last_undegraded":"2024-06-13T11:23:46.903842+0000","last_fullsized":"2024-06-13T11:23:46.903842+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:45:48.817898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1509,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315721+0000","last_change":"2024-06-13T11:18:42.903465+0000","last_active":"2024-06-13T11:23:46.315721+0000","last_peered":"2024-06-13T11:23:46.315721+0000","last_clean":"2024-06-13T11:23:46.315721+0000","last_became_active":"2024-06-13T11:18:42.903001+0000","last_became_peered":"2024-06-13T11:18:42.903001+0000","last_unstale":"2024-06-13T11:23:46.315721+0000","last_undegraded":"2024-06-13T11:23:46.315721+0000","last_fullsized":"2024-06-13T11:23:46.315721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:25:24.331890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":31,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.147052+0000","last_change":"2024-06-13T11:18:57.033966+0000","last_active":"2024-06-13T11:23:46.147052+0000","last_peered":"2024-06-13T11:23:46.147052+0000","last_clean":"2024-06-13T11:23:46.147052+0000","last_became_active":"2024-06-13T11:18:57.032448+0000","last_became_peered":"2024-06-13T11:18:57.032448+0000","last_unstale":"2024-06-13T11:23:46.147052+0000","last_undegraded":"2024-06-13T11:23:46.147052+0000","last_fullsized":"2024-06-13T11:23:46.147052+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:51:40.473020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'15","reported_seq":64,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.282957+0000","last_change":"2024-06-13T11:18:38.483204+0000","last_active":"2024-06-13T11:23:46.282957+0000","last_peered":"2024-06-13T11:23:46.282957+0000","last_clean":"2024-06-13T11:23:46.282957+0000","last_became_active":"2024-06-13T11:18:38.482800+0000","last_became_peered":"2024-06-13T11:18:38.482800+0000","last_unstale":"2024-06-13T11:23:46.282957+0000","last_undegraded":"2024-06-13T11:23:46.282957+0000","last_fullsized":"2024-06-13T11:23:46.282957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:28:44.636201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294236+0000","last_change":"2024-06-13T11:18:42.899944+0000","last_active":"2024-06-13T11:23:46.294236+0000","last_peered":"2024-06-13T11:23:46.294236+0000","last_clean":"2024-06-13T11:23:46.294236+0000","last_became_active":"2024-06-13T11:18:42.899551+0000","last_became_peered":"2024-06-13T11:18:42.899551+0000","last_unstale":"2024-06-13T11:23:46.294236+0000","last_undegraded":"2024-06-13T11:23:46.294236+0000","last_fullsized":"2024-06-13T11:23:46.294236+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:18:21.109043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294120+0000","last_change":"2024-06-13T11:18:57.028817+0000","last_active":"2024-06-13T11:23:46.294120+0000","last_peered":"2024-06-13T11:23:46.294120+0000","last_clean":"2024-06-13T11:23:46.294120+0000","last_became_active":"2024-06-13T11:18:57.028433+0000","last_became_peered":"2024-06-13T11:18:57.028433+0000","last_unstale":"2024-06-13T11:23:46.294120+0000","last_undegraded":"2024-06-13T11:23:46.294120+0000","last_fullsized":"2024-06-13T11:23:46.294120+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:56:24.180096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283522+0000","last_change":"2024-06-13T11:18:38.165907+0000","last_active":"2024-06-13T11:23:46.283522+0000","last_peered":"2024-06-13T11:23:46.283522+0000","last_clean":"2024-06-13T11:23:46.283522+0000","last_became_active":"2024-06-13T11:18:38.165516+0000","last_became_peered":"2024-06-13T11:18:38.165516+0000","last_unstale":"2024-06-13T11:23:46.283522+0000","last_undegraded":"2024-06-13T11:23:46.283522+0000","last_fullsized":"2024-06-13T11:23:46.283522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:51:15.774967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"99'5","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314951+0000","last_change":"2024-06-13T11:19:27.004377+0000","last_active":"2024-06-13T11:23:46.314951+0000","last_peered":"2024-06-13T11:23:46.314951+0000","last_clean":"2024-06-13T11:23:46.314951+0000","last_became_active":"2024-06-13T11:19:27.003954+0000","last_became_peered":"2024-06-13T11:19:27.003954+0000","last_unstale":"2024-06-13T11:23:46.314951+0000","last_undegraded":"2024-06-13T11:23:46.314951+0000","last_fullsized":"2024-06-13T11:23:46.314951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:53:25.967036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.282972+0000","last_change":"2024-06-13T11:18:57.184912+0000","last_active":"2024-06-13T11:23:46.282972+0000","last_peered":"2024-06-13T11:23:46.282972+0000","last_clean":"2024-06-13T11:23:46.282972+0000","last_became_active":"2024-06-13T11:18:57.184442+0000","last_became_peered":"2024-06-13T11:18:57.184442+0000","last_unstale":"2024-06-13T11:23:46.282972+0000","last_undegraded":"2024-06-13T11:23:46.282972+0000","last_fullsized":"2024-06-13T11:23:46.282972+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:47:17.961086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151270+0000","last_change":"2024-06-13T11:18:38.484487+0000","last_active":"2024-06-13T11:23:46.151270+0000","last_peered":"2024-06-13T11:23:46.151270+0000","last_clean":"2024-06-13T11:23:46.151270+0000","last_became_active":"2024-06-13T11:18:38.483587+0000","last_became_peered":"2024-06-13T11:18:38.483587+0000","last_unstale":"2024-06-13T11:23:46.151270+0000","last_undegraded":"2024-06-13T11:23:46.151270+0000","last_fullsized":"2024-06-13T11:23:46.151270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:50:19.773340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"99'4","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.298226+0000","last_change":"2024-06-13T11:18:42.913275+0000","last_active":"2024-06-13T11:23:46.298226+0000","last_peered":"2024-06-13T11:23:46.298226+0000","last_clean":"2024-06-13T11:23:46.298226+0000","last_became_active":"2024-06-13T11:18:42.912880+0000","last_became_peered":"2024-06-13T11:18:42.912880+0000","last_unstale":"2024-06-13T11:23:46.298226+0000","last_undegraded":"2024-06-13T11:23:46.298226+0000","last_fullsized":"2024-06-13T11:23:46.298226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:01:55.261976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146430+0000","last_change":"2024-06-13T11:18:57.027893+0000","last_active":"2024-06-13T11:23:46.146430+0000","last_peered":"2024-06-13T11:23:46.146430+0000","last_clean":"2024-06-13T11:23:46.146430+0000","last_became_active":"2024-06-13T11:18:57.025683+0000","last_became_peered":"2024-06-13T11:18:57.025683+0000","last_unstale":"2024-06-13T11:23:46.146430+0000","last_undegraded":"2024-06-13T11:23:46.146430+0000","last_fullsized":"2024-06-13T11:23:46.146430+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:25:59.348570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"97'1","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315392+0000","last_change":"2024-06-13T11:18:38.167932+0000","last_active":"2024-06-13T11:23:46.315392+0000","last_peered":"2024-06-13T11:23:46.315392+0000","last_clean":"2024-06-13T11:23:46.315392+0000","last_became_active":"2024-06-13T11:18:38.167520+0000","last_became_peered":"2024-06-13T11:18:38.167520+0000","last_unstale":"2024-06-13T11:23:46.315392+0000","last_undegraded":"2024-06-13T11:23:46.315392+0000","last_fullsized":"2024-06-13T11:23:46.315392+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:00:04.537091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.297918+0000","last_change":"2024-06-13T11:18:42.923211+0000","last_active":"2024-06-13T11:23:46.297918+0000","last_peered":"2024-06-13T11:23:46.297918+0000","last_clean":"2024-06-13T11:23:46.297918+0000","last_became_active":"2024-06-13T11:18:42.922858+0000","last_became_peered":"2024-06-13T11:18:42.922858+0000","last_unstale":"2024-06-13T11:23:46.297918+0000","last_undegraded":"2024-06-13T11:23:46.297918+0000","last_fullsized":"2024-06-13T11:23:46.297918+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:56:18.163502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.147614+0000","last_change":"2024-06-13T11:18:57.185071+0000","last_active":"2024-06-13T11:23:46.147614+0000","last_peered":"2024-06-13T11:23:46.147614+0000","last_clean":"2024-06-13T11:23:46.147614+0000","last_became_active":"2024-06-13T11:18:57.184526+0000","last_became_peered":"2024-06-13T11:18:57.184526+0000","last_unstale":"2024-06-13T11:23:46.147614+0000","last_undegraded":"2024-06-13T11:23:46.147614+0000","last_fullsized":"2024-06-13T11:23:46.147614+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:51:37.715832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294188+0000","last_change":"2024-06-13T11:18:42.912483+0000","last_active":"2024-06-13T11:23:46.294188+0000","last_peered":"2024-06-13T11:23:46.294188+0000","last_clean":"2024-06-13T11:23:46.294188+0000","last_became_active":"2024-06-13T11:18:42.912117+0000","last_became_peered":"2024-06-13T11:18:42.912117+0000","last_unstale":"2024-06-13T11:23:46.294188+0000","last_undegraded":"2024-06-13T11:23:46.294188+0000","last_fullsized":"2024-06-13T11:23:46.294188+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:23.769097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"100'6","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.504386+0000","last_change":"2024-06-13T11:18:38.483334+0000","last_active":"2024-06-13T11:23:46.504386+0000","last_peered":"2024-06-13T11:23:46.504386+0000","last_clean":"2024-06-13T11:23:46.504386+0000","last_became_active":"2024-06-13T11:18:38.482885+0000","last_became_peered":"2024-06-13T11:18:38.482885+0000","last_unstale":"2024-06-13T11:23:46.504386+0000","last_undegraded":"2024-06-13T11:23:46.504386+0000","last_fullsized":"2024-06-13T11:23:46.504386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:55:19.986526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":217,"num_read_kb":217,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"97'1","reported_seq":33,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315368+0000","last_change":"2024-06-13T11:18:57.016960+0000","last_active":"2024-06-13T11:23:46.315368+0000","last_peered":"2024-06-13T11:23:46.315368+0000","last_clean":"2024-06-13T11:23:46.315368+0000","last_became_active":"2024-06-13T11:18:57.016490+0000","last_became_peered":"2024-06-13T11:18:57.016490+0000","last_unstale":"2024-06-13T11:23:46.315368+0000","last_undegraded":"2024-06-13T11:23:46.315368+0000","last_fullsized":"2024-06-13T11:23:46.315368+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:40:19.796594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.284675+0000","last_change":"2024-06-13T11:18:42.921581+0000","last_active":"2024-06-13T11:23:46.284675+0000","last_peered":"2024-06-13T11:23:46.284675+0000","last_clean":"2024-06-13T11:23:46.284675+0000","last_became_active":"2024-06-13T11:18:42.917820+0000","last_became_peered":"2024-06-13T11:18:42.917820+0000","last_unstale":"2024-06-13T11:23:46.284675+0000","last_undegraded":"2024-06-13T11:23:46.284675+0000","last_fullsized":"2024-06-13T11:23:46.284675+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:59:28.460363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'3","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314983+0000","last_change":"2024-06-13T11:18:38.168111+0000","last_active":"2024-06-13T11:23:46.314983+0000","last_peered":"2024-06-13T11:23:46.314983+0000","last_clean":"2024-06-13T11:23:46.314983+0000","last_became_active":"2024-06-13T11:18:38.167732+0000","last_became_peered":"2024-06-13T11:18:38.167732+0000","last_unstale":"2024-06-13T11:23:46.314983+0000","last_undegraded":"2024-06-13T11:23:46.314983+0000","last_fullsized":"2024-06-13T11:23:46.314983+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:36:55.993553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":381,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315089+0000","last_change":"2024-06-13T11:17:06.317849+0000","last_active":"2024-06-13T11:23:46.315089+0000","last_peered":"2024-06-13T11:23:46.315089+0000","last_clean":"2024-06-13T11:23:46.315089+0000","last_became_active":"2024-06-13T11:17:06.317293+0000","last_became_peered":"2024-06-13T11:17:06.317293+0000","last_unstale":"2024-06-13T11:23:46.315089+0000","last_undegraded":"2024-06-13T11:23:46.315089+0000","last_fullsized":"2024-06-13T11:23:46.315089+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:13:14.002581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:13:14.002581+0000","last_clean_scrub_stamp":"2024-06-13T11:13:14.002581+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:54:32.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294618+0000","last_change":"2024-06-13T11:18:57.185880+0000","last_active":"2024-06-13T11:23:46.294618+0000","last_peered":"2024-06-13T11:23:46.294618+0000","last_clean":"2024-06-13T11:23:46.294618+0000","last_became_active":"2024-06-13T11:18:57.185140+0000","last_became_peered":"2024-06-13T11:18:57.185140+0000","last_unstale":"2024-06-13T11:23:46.294618+0000","last_undegraded":"2024-06-13T11:23:46.294618+0000","last_fullsized":"2024-06-13T11:23:46.294618+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:43:40.195809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"99'5","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.145829+0000","last_change":"2024-06-13T11:19:27.006408+0000","last_active":"2024-06-13T11:23:46.145829+0000","last_peered":"2024-06-13T11:23:46.145829+0000","last_clean":"2024-06-13T11:23:46.145829+0000","last_became_active":"2024-06-13T11:19:27.005525+0000","last_became_peered":"2024-06-13T11:19:27.005525+0000","last_unstale":"2024-06-13T11:23:46.145829+0000","last_undegraded":"2024-06-13T11:23:46.145829+0000","last_fullsized":"2024-06-13T11:23:46.145829+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:09:39.891543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'3","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315242+0000","last_change":"2024-06-13T11:18:38.171089+0000","last_active":"2024-06-13T11:23:46.315242+0000","last_peered":"2024-06-13T11:23:46.315242+0000","last_clean":"2024-06-13T11:23:46.315242+0000","last_became_active":"2024-06-13T11:18:38.170769+0000","last_became_peered":"2024-06-13T11:18:38.170769+0000","last_unstale":"2024-06-13T11:23:46.315242+0000","last_undegraded":"2024-06-13T11:23:46.315242+0000","last_fullsized":"2024-06-13T11:23:46.315242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:07:46.355159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314717+0000","last_change":"2024-06-13T11:18:57.015609+0000","last_active":"2024-06-13T11:23:46.314717+0000","last_peered":"2024-06-13T11:23:46.314717+0000","last_clean":"2024-06-13T11:23:46.314717+0000","last_became_active":"2024-06-13T11:18:57.015164+0000","last_became_peered":"2024-06-13T11:18:57.015164+0000","last_unstale":"2024-06-13T11:23:46.314717+0000","last_undegraded":"2024-06-13T11:23:46.314717+0000","last_fullsized":"2024-06-13T11:23:46.314717+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:32:15.725778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'1","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283442+0000","last_change":"2024-06-13T11:18:38.483215+0000","last_active":"2024-06-13T11:23:46.283442+0000","last_peered":"2024-06-13T11:23:46.283442+0000","last_clean":"2024-06-13T11:23:46.283442+0000","last_became_active":"2024-06-13T11:18:38.482789+0000","last_became_peered":"2024-06-13T11:18:38.482789+0000","last_unstale":"2024-06-13T11:23:46.283442+0000","last_undegraded":"2024-06-13T11:23:46.283442+0000","last_fullsized":"2024-06-13T11:23:46.283442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:01:58.020310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146040+0000","last_change":"2024-06-13T11:18:42.914846+0000","last_active":"2024-06-13T11:23:46.146040+0000","last_peered":"2024-06-13T11:23:46.146040+0000","last_clean":"2024-06-13T11:23:46.146040+0000","last_became_active":"2024-06-13T11:18:42.912614+0000","last_became_peered":"2024-06-13T11:18:42.912614+0000","last_unstale":"2024-06-13T11:23:46.146040+0000","last_undegraded":"2024-06-13T11:23:46.146040+0000","last_fullsized":"2024-06-13T11:23:46.146040+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:00:13.066079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283969+0000","last_change":"2024-06-13T11:18:57.185117+0000","last_active":"2024-06-13T11:23:46.283969+0000","last_peered":"2024-06-13T11:23:46.283969+0000","last_clean":"2024-06-13T11:23:46.283969+0000","last_became_active":"2024-06-13T11:18:57.184498+0000","last_became_peered":"2024-06-13T11:18:57.184498+0000","last_unstale":"2024-06-13T11:23:46.283969+0000","last_undegraded":"2024-06-13T11:23:46.283969+0000","last_fullsized":"2024-06-13T11:23:46.283969+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:04:28.800984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"100'47","reported_seq":118,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.439881+0000","last_change":"2024-06-13T11:18:38.176918+0000","last_active":"2024-06-13T11:23:46.439881+0000","last_peered":"2024-06-13T11:23:46.439881+0000","last_clean":"2024-06-13T11:23:46.439881+0000","last_became_active":"2024-06-13T11:18:38.176236+0000","last_became_peered":"2024-06-13T11:18:38.176236+0000","last_unstale":"2024-06-13T11:23:46.439881+0000","last_undegraded":"2024-06-13T11:23:46.439881+0000","last_fullsized":"2024-06-13T11:23:46.439881+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:10:20.684891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":85,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"99'5","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.286262+0000","last_change":"2024-06-13T11:18:42.920930+0000","last_active":"2024-06-13T11:23:46.286262+0000","last_peered":"2024-06-13T11:23:46.286262+0000","last_clean":"2024-06-13T11:23:46.286262+0000","last_became_active":"2024-06-13T11:18:42.915838+0000","last_became_peered":"2024-06-13T11:18:42.915838+0000","last_unstale":"2024-06-13T11:23:46.286262+0000","last_undegraded":"2024-06-13T11:23:46.286262+0000","last_fullsized":"2024-06-13T11:23:46.286262+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:07:43.483317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.143782+0000","last_change":"2024-06-13T11:18:57.009043+0000","last_active":"2024-06-13T11:23:46.143782+0000","last_peered":"2024-06-13T11:23:46.143782+0000","last_clean":"2024-06-13T11:23:46.143782+0000","last_became_active":"2024-06-13T11:18:57.008533+0000","last_became_peered":"2024-06-13T11:18:57.008533+0000","last_unstale":"2024-06-13T11:23:46.143782+0000","last_undegraded":"2024-06-13T11:23:46.143782+0000","last_fullsized":"2024-06-13T11:23:46.143782+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:30:29.614810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'4","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315871+0000","last_change":"2024-06-13T11:18:38.523042+0000","last_active":"2024-06-13T11:23:46.315871+0000","last_peered":"2024-06-13T11:23:46.315871+0000","last_clean":"2024-06-13T11:23:46.315871+0000","last_became_active":"2024-06-13T11:18:38.522673+0000","last_became_peered":"2024-06-13T11:18:38.522673+0000","last_unstale":"2024-06-13T11:23:46.315871+0000","last_undegraded":"2024-06-13T11:23:46.315871+0000","last_fullsized":"2024-06-13T11:23:46.315871+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:25:50.725281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.316292+0000","last_change":"2024-06-13T11:18:42.934090+0000","last_active":"2024-06-13T11:23:46.316292+0000","last_peered":"2024-06-13T11:23:46.316292+0000","last_clean":"2024-06-13T11:23:46.316292+0000","last_became_active":"2024-06-13T11:18:42.933680+0000","last_became_peered":"2024-06-13T11:18:42.933680+0000","last_unstale":"2024-06-13T11:23:46.316292+0000","last_undegraded":"2024-06-13T11:23:46.316292+0000","last_fullsized":"2024-06-13T11:23:46.316292+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:39:30.214272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315368+0000","last_change":"2024-06-13T11:18:57.185186+0000","last_active":"2024-06-13T11:23:46.315368+0000","last_peered":"2024-06-13T11:23:46.315368+0000","last_clean":"2024-06-13T11:23:46.315368+0000","last_became_active":"2024-06-13T11:18:57.184448+0000","last_became_peered":"2024-06-13T11:18:57.184448+0000","last_unstale":"2024-06-13T11:23:46.315368+0000","last_undegraded":"2024-06-13T11:23:46.315368+0000","last_fullsized":"2024-06-13T11:23:46.315368+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:18:32.514993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":56,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300041+0000","last_change":"2024-06-13T11:19:26.999451+0000","last_active":"2024-06-13T11:23:46.300041+0000","last_peered":"2024-06-13T11:23:46.300041+0000","last_clean":"2024-06-13T11:23:46.300041+0000","last_became_active":"2024-06-13T11:19:26.999153+0000","last_became_peered":"2024-06-13T11:19:26.999153+0000","last_unstale":"2024-06-13T11:23:46.300041+0000","last_undegraded":"2024-06-13T11:23:46.300041+0000","last_fullsized":"2024-06-13T11:23:46.300041+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:42:34.755569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"99'2","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.282968+0000","last_change":"2024-06-13T11:18:42.903741+0000","last_active":"2024-06-13T11:23:46.282968+0000","last_peered":"2024-06-13T11:23:46.282968+0000","last_clean":"2024-06-13T11:23:46.282968+0000","last_became_active":"2024-06-13T11:18:42.903351+0000","last_became_peered":"2024-06-13T11:18:42.903351+0000","last_unstale":"2024-06-13T11:23:46.282968+0000","last_undegraded":"2024-06-13T11:23:46.282968+0000","last_fullsized":"2024-06-13T11:23:46.282968+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:47:21.206540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151718+0000","last_change":"2024-06-13T11:18:57.035149+0000","last_active":"2024-06-13T11:23:46.151718+0000","last_peered":"2024-06-13T11:23:46.151718+0000","last_clean":"2024-06-13T11:23:46.151718+0000","last_became_active":"2024-06-13T11:18:57.033208+0000","last_became_peered":"2024-06-13T11:18:57.033208+0000","last_unstale":"2024-06-13T11:23:46.151718+0000","last_undegraded":"2024-06-13T11:23:46.151718+0000","last_fullsized":"2024-06-13T11:23:46.151718+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:19:01.353814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'3","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.284275+0000","last_change":"2024-06-13T11:18:38.170464+0000","last_active":"2024-06-13T11:23:46.284275+0000","last_peered":"2024-06-13T11:23:46.284275+0000","last_clean":"2024-06-13T11:23:46.284275+0000","last_became_active":"2024-06-13T11:18:38.169945+0000","last_became_peered":"2024-06-13T11:18:38.169945+0000","last_unstale":"2024-06-13T11:23:46.284275+0000","last_undegraded":"2024-06-13T11:23:46.284275+0000","last_fullsized":"2024-06-13T11:23:46.284275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:53:20.112176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314661+0000","last_change":"2024-06-13T11:18:42.925391+0000","last_active":"2024-06-13T11:23:46.314661+0000","last_peered":"2024-06-13T11:23:46.314661+0000","last_clean":"2024-06-13T11:23:46.314661+0000","last_became_active":"2024-06-13T11:18:42.924900+0000","last_became_peered":"2024-06-13T11:18:42.924900+0000","last_unstale":"2024-06-13T11:23:46.314661+0000","last_undegraded":"2024-06-13T11:23:46.314661+0000","last_fullsized":"2024-06-13T11:23:46.314661+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:10.954502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"99'1","reported_seq":33,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315126+0000","last_change":"2024-06-13T11:18:57.029448+0000","last_active":"2024-06-13T11:23:46.315126+0000","last_peered":"2024-06-13T11:23:46.315126+0000","last_clean":"2024-06-13T11:23:46.315126+0000","last_became_active":"2024-06-13T11:18:57.028918+0000","last_became_peered":"2024-06-13T11:18:57.028918+0000","last_unstale":"2024-06-13T11:23:46.315126+0000","last_undegraded":"2024-06-13T11:23:46.315126+0000","last_fullsized":"2024-06-13T11:23:46.315126+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:53:06.206458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"97'1","reported_seq":19,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314634+0000","last_change":"2024-06-13T11:19:27.078724+0000","last_active":"2024-06-13T11:23:46.314634+0000","last_peered":"2024-06-13T11:23:46.314634+0000","last_clean":"2024-06-13T11:23:46.314634+0000","last_became_active":"2024-06-13T11:19:27.078329+0000","last_became_peered":"2024-06-13T11:19:27.078329+0000","last_unstale":"2024-06-13T11:23:46.314634+0000","last_undegraded":"2024-06-13T11:23:46.314634+0000","last_fullsized":"2024-06-13T11:23:46.314634+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:25:38.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.285410+0000","last_change":"2024-06-13T11:18:42.930769+0000","last_active":"2024-06-13T11:23:46.285410+0000","last_peered":"2024-06-13T11:23:46.285410+0000","last_clean":"2024-06-13T11:23:46.285410+0000","last_became_active":"2024-06-13T11:18:42.928727+0000","last_became_peered":"2024-06-13T11:18:42.928727+0000","last_unstale":"2024-06-13T11:23:46.285410+0000","last_undegraded":"2024-06-13T11:23:46.285410+0000","last_fullsized":"2024-06-13T11:23:46.285410+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:14:55.202237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315132+0000","last_change":"2024-06-13T11:18:57.185071+0000","last_active":"2024-06-13T11:23:46.315132+0000","last_peered":"2024-06-13T11:23:46.315132+0000","last_clean":"2024-06-13T11:23:46.315132+0000","last_became_active":"2024-06-13T11:18:57.184534+0000","last_became_peered":"2024-06-13T11:18:57.184534+0000","last_unstale":"2024-06-13T11:23:46.315132+0000","last_undegraded":"2024-06-13T11:23:46.315132+0000","last_fullsized":"2024-06-13T11:23:46.315132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:55:11.146525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283058+0000","last_change":"2024-06-13T11:18:38.167734+0000","last_active":"2024-06-13T11:23:46.283058+0000","last_peered":"2024-06-13T11:23:46.283058+0000","last_clean":"2024-06-13T11:23:46.283058+0000","last_became_active":"2024-06-13T11:18:38.167345+0000","last_became_peered":"2024-06-13T11:18:38.167345+0000","last_unstale":"2024-06-13T11:23:46.283058+0000","last_undegraded":"2024-06-13T11:23:46.283058+0000","last_fullsized":"2024-06-13T11:23:46.283058+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:55:43.155928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"99'5","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315715+0000","last_change":"2024-06-13T11:18:42.900884+0000","last_active":"2024-06-13T11:23:46.315715+0000","last_peered":"2024-06-13T11:23:46.315715+0000","last_clean":"2024-06-13T11:23:46.315715+0000","last_became_active":"2024-06-13T11:18:42.900562+0000","last_became_peered":"2024-06-13T11:18:42.900562+0000","last_unstale":"2024-06-13T11:23:46.315715+0000","last_undegraded":"2024-06-13T11:23:46.315715+0000","last_fullsized":"2024-06-13T11:23:46.315715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:38:59.480693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300071+0000","last_change":"2024-06-13T11:18:57.015496+0000","last_active":"2024-06-13T11:23:46.300071+0000","last_peered":"2024-06-13T11:23:46.300071+0000","last_clean":"2024-06-13T11:23:46.300071+0000","last_became_active":"2024-06-13T11:18:57.015079+0000","last_became_peered":"2024-06-13T11:18:57.015079+0000","last_unstale":"2024-06-13T11:23:46.300071+0000","last_undegraded":"2024-06-13T11:23:46.300071+0000","last_fullsized":"2024-06-13T11:23:46.300071+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:31:40.130018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"97'3","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144270+0000","last_change":"2024-06-13T11:18:38.523097+0000","last_active":"2024-06-13T11:23:46.144270+0000","last_peered":"2024-06-13T11:23:46.144270+0000","last_clean":"2024-06-13T11:23:46.144270+0000","last_became_active":"2024-06-13T11:18:38.522638+0000","last_became_peered":"2024-06-13T11:18:38.522638+0000","last_unstale":"2024-06-13T11:23:46.144270+0000","last_undegraded":"2024-06-13T11:23:46.144270+0000","last_fullsized":"2024-06-13T11:23:46.144270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:35:36.843246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315685+0000","last_change":"2024-06-13T11:18:42.899281+0000","last_active":"2024-06-13T11:23:46.315685+0000","last_peered":"2024-06-13T11:23:46.315685+0000","last_clean":"2024-06-13T11:23:46.315685+0000","last_became_active":"2024-06-13T11:18:42.898924+0000","last_became_peered":"2024-06-13T11:18:42.898924+0000","last_unstale":"2024-06-13T11:23:46.315685+0000","last_undegraded":"2024-06-13T11:23:46.315685+0000","last_fullsized":"2024-06-13T11:23:46.315685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:18:10.324425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315538+0000","last_change":"2024-06-13T11:18:57.037070+0000","last_active":"2024-06-13T11:23:46.315538+0000","last_peered":"2024-06-13T11:23:46.315538+0000","last_clean":"2024-06-13T11:23:46.315538+0000","last_became_active":"2024-06-13T11:18:57.036632+0000","last_became_peered":"2024-06-13T11:18:57.036632+0000","last_unstale":"2024-06-13T11:23:46.315538+0000","last_undegraded":"2024-06-13T11:23:46.315538+0000","last_fullsized":"2024-06-13T11:23:46.315538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:19:35.433902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"100'39","reported_seq":95,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.436022+0000","last_change":"2024-06-13T11:18:38.170790+0000","last_active":"2024-06-13T11:23:46.436022+0000","last_peered":"2024-06-13T11:23:46.436022+0000","last_clean":"2024-06-13T11:23:46.436022+0000","last_became_active":"2024-06-13T11:18:38.170260+0000","last_became_peered":"2024-06-13T11:18:38.170260+0000","last_unstale":"2024-06-13T11:23:46.436022+0000","last_undegraded":"2024-06-13T11:23:46.436022+0000","last_fullsized":"2024-06-13T11:23:46.436022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:11:44.070550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315378+0000","last_change":"2024-06-13T11:18:42.906969+0000","last_active":"2024-06-13T11:23:46.315378+0000","last_peered":"2024-06-13T11:23:46.315378+0000","last_clean":"2024-06-13T11:23:46.315378+0000","last_became_active":"2024-06-13T11:18:42.906657+0000","last_became_peered":"2024-06-13T11:18:42.906657+0000","last_unstale":"2024-06-13T11:23:46.315378+0000","last_undegraded":"2024-06-13T11:23:46.315378+0000","last_fullsized":"2024-06-13T11:23:46.315378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:30:36.414377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.293882+0000","last_change":"2024-06-13T11:18:57.007226+0000","last_active":"2024-06-13T11:23:46.293882+0000","last_peered":"2024-06-13T11:23:46.293882+0000","last_clean":"2024-06-13T11:23:46.293882+0000","last_became_active":"2024-06-13T11:18:57.006803+0000","last_became_peered":"2024-06-13T11:18:57.006803+0000","last_unstale":"2024-06-13T11:23:46.293882+0000","last_undegraded":"2024-06-13T11:23:46.293882+0000","last_fullsized":"2024-06-13T11:23:46.293882+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:08:28.913145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.147156+0000","last_change":"2024-06-13T11:18:38.173327+0000","last_active":"2024-06-13T11:23:46.147156+0000","last_peered":"2024-06-13T11:23:46.147156+0000","last_clean":"2024-06-13T11:23:46.147156+0000","last_became_active":"2024-06-13T11:18:38.172786+0000","last_became_peered":"2024-06-13T11:18:38.172786+0000","last_unstale":"2024-06-13T11:23:46.147156+0000","last_undegraded":"2024-06-13T11:23:46.147156+0000","last_fullsized":"2024-06-13T11:23:46.147156+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:40:30.330272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315687+0000","last_change":"2024-06-13T11:18:42.899816+0000","last_active":"2024-06-13T11:23:46.315687+0000","last_peered":"2024-06-13T11:23:46.315687+0000","last_clean":"2024-06-13T11:23:46.315687+0000","last_became_active":"2024-06-13T11:18:42.899495+0000","last_became_peered":"2024-06-13T11:18:42.899495+0000","last_unstale":"2024-06-13T11:23:46.315687+0000","last_undegraded":"2024-06-13T11:23:46.315687+0000","last_fullsized":"2024-06-13T11:23:46.315687+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:16:08.303616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314711+0000","last_change":"2024-06-13T11:18:42.909944+0000","last_active":"2024-06-13T11:23:46.314711+0000","last_peered":"2024-06-13T11:23:46.314711+0000","last_clean":"2024-06-13T11:23:46.314711+0000","last_became_active":"2024-06-13T11:18:42.909557+0000","last_became_peered":"2024-06-13T11:18:42.909557+0000","last_unstale":"2024-06-13T11:23:46.314711+0000","last_undegraded":"2024-06-13T11:23:46.314711+0000","last_fullsized":"2024-06-13T11:23:46.314711+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:22:07.093462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"99'12","reported_seq":54,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144039+0000","last_change":"2024-06-13T11:18:42.912462+0000","last_active":"2024-06-13T11:23:46.144039+0000","last_peered":"2024-06-13T11:23:46.144039+0000","last_clean":"2024-06-13T11:23:46.144039+0000","last_became_active":"2024-06-13T11:18:42.912110+0000","last_became_peered":"2024-06-13T11:18:42.912110+0000","last_unstale":"2024-06-13T11:23:46.144039+0000","last_undegraded":"2024-06-13T11:23:46.144039+0000","last_fullsized":"2024-06-13T11:23:46.144039+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:11:33.123305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.143829+0000","last_change":"2024-06-13T11:18:42.924224+0000","last_active":"2024-06-13T11:23:46.143829+0000","last_peered":"2024-06-13T11:23:46.143829+0000","last_clean":"2024-06-13T11:23:46.143829+0000","last_became_active":"2024-06-13T11:18:42.923858+0000","last_became_peered":"2024-06-13T11:18:42.923858+0000","last_unstale":"2024-06-13T11:23:46.143829+0000","last_undegraded":"2024-06-13T11:23:46.143829+0000","last_fullsized":"2024-06-13T11:23:46.143829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:36:11.602930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315807+0000","last_change":"2024-06-13T11:18:42.921160+0000","last_active":"2024-06-13T11:23:46.315807+0000","last_peered":"2024-06-13T11:23:46.315807+0000","last_clean":"2024-06-13T11:23:46.315807+0000","last_became_active":"2024-06-13T11:18:42.920704+0000","last_became_peered":"2024-06-13T11:18:42.920704+0000","last_unstale":"2024-06-13T11:23:46.315807+0000","last_undegraded":"2024-06-13T11:23:46.315807+0000","last_fullsized":"2024-06-13T11:23:46.315807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:07:17.023390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"99'4","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146212+0000","last_change":"2024-06-13T11:18:42.923637+0000","last_active":"2024-06-13T11:23:46.146212+0000","last_peered":"2024-06-13T11:23:46.146212+0000","last_clean":"2024-06-13T11:23:46.146212+0000","last_became_active":"2024-06-13T11:18:42.923234+0000","last_became_peered":"2024-06-13T11:18:42.923234+0000","last_unstale":"2024-06-13T11:23:46.146212+0000","last_undegraded":"2024-06-13T11:23:46.146212+0000","last_fullsized":"2024-06-13T11:23:46.146212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:51:19.676747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314932+0000","last_change":"2024-06-13T11:18:42.910300+0000","last_active":"2024-06-13T11:23:46.314932+0000","last_peered":"2024-06-13T11:23:46.314932+0000","last_clean":"2024-06-13T11:23:46.314932+0000","last_became_active":"2024-06-13T11:18:42.909937+0000","last_became_peered":"2024-06-13T11:18:42.909937+0000","last_unstale":"2024-06-13T11:23:46.314932+0000","last_undegraded":"2024-06-13T11:23:46.314932+0000","last_fullsized":"2024-06-13T11:23:46.314932+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:24:51.407238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"99'15","reported_seq":57,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144370+0000","last_change":"2024-06-13T11:18:42.907066+0000","last_active":"2024-06-13T11:23:46.144370+0000","last_peered":"2024-06-13T11:23:46.144370+0000","last_clean":"2024-06-13T11:23:46.144370+0000","last_became_active":"2024-06-13T11:18:42.906582+0000","last_became_peered":"2024-06-13T11:18:42.906582+0000","last_unstale":"2024-06-13T11:23:46.144370+0000","last_undegraded":"2024-06-13T11:23:46.144370+0000","last_fullsized":"2024-06-13T11:23:46.144370+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:40:02.549931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"99'2","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.286447+0000","last_change":"2024-06-13T11:18:42.910290+0000","last_active":"2024-06-13T11:23:46.286447+0000","last_peered":"2024-06-13T11:23:46.286447+0000","last_clean":"2024-06-13T11:23:46.286447+0000","last_became_active":"2024-06-13T11:18:42.909772+0000","last_became_peered":"2024-06-13T11:18:42.909772+0000","last_unstale":"2024-06-13T11:23:46.286447+0000","last_undegraded":"2024-06-13T11:23:46.286447+0000","last_fullsized":"2024-06-13T11:23:46.286447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:05:56.008087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294008+0000","last_change":"2024-06-13T11:18:42.928792+0000","last_active":"2024-06-13T11:23:46.294008+0000","last_peered":"2024-06-13T11:23:46.294008+0000","last_clean":"2024-06-13T11:23:46.294008+0000","last_became_active":"2024-06-13T11:18:42.928464+0000","last_became_peered":"2024-06-13T11:18:42.928464+0000","last_unstale":"2024-06-13T11:23:46.294008+0000","last_undegraded":"2024-06-13T11:23:46.294008+0000","last_fullsized":"2024-06-13T11:23:46.294008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:01:58.686124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.284295+0000","last_change":"2024-06-13T11:18:42.920719+0000","last_active":"2024-06-13T11:23:46.284295+0000","last_peered":"2024-06-13T11:23:46.284295+0000","last_clean":"2024-06-13T11:23:46.284295+0000","last_became_active":"2024-06-13T11:18:42.913355+0000","last_became_peered":"2024-06-13T11:18:42.913355+0000","last_unstale":"2024-06-13T11:23:46.284295+0000","last_undegraded":"2024-06-13T11:23:46.284295+0000","last_fullsized":"2024-06-13T11:23:46.284295+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:25:00.020936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"99'10","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300352+0000","last_change":"2024-06-13T11:18:42.906709+0000","last_active":"2024-06-13T11:23:46.300352+0000","last_peered":"2024-06-13T11:23:46.300352+0000","last_clean":"2024-06-13T11:23:46.300352+0000","last_became_active":"2024-06-13T11:18:42.906309+0000","last_became_peered":"2024-06-13T11:18:42.906309+0000","last_unstale":"2024-06-13T11:23:46.300352+0000","last_undegraded":"2024-06-13T11:23:46.300352+0000","last_fullsized":"2024-06-13T11:23:46.300352+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:09.255670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"99'11","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.147337+0000","last_change":"2024-06-13T11:18:42.926939+0000","last_active":"2024-06-13T11:23:46.147337+0000","last_peered":"2024-06-13T11:23:46.147337+0000","last_clean":"2024-06-13T11:23:46.147337+0000","last_became_active":"2024-06-13T11:18:42.926616+0000","last_became_peered":"2024-06-13T11:18:42.926616+0000","last_unstale":"2024-06-13T11:23:46.147337+0000","last_undegraded":"2024-06-13T11:23:46.147337+0000","last_fullsized":"2024-06-13T11:23:46.147337+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:52:46.468479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314868+0000","last_change":"2024-06-13T11:18:42.901103+0000","last_active":"2024-06-13T11:23:46.314868+0000","last_peered":"2024-06-13T11:23:46.314868+0000","last_clean":"2024-06-13T11:23:46.314868+0000","last_became_active":"2024-06-13T11:18:42.900726+0000","last_became_peered":"2024-06-13T11:18:42.900726+0000","last_unstale":"2024-06-13T11:23:46.314868+0000","last_undegraded":"2024-06-13T11:23:46.314868+0000","last_fullsized":"2024-06-13T11:23:46.314868+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:55.895451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108816,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600135,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1430,"num_read_kb":828,"num_write":297,"num_write_kb":1446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":1800405,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383758,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1105920,"data_stored":579495,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645393,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36584,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708568,"statfs":{"total":95995035648,"available":95957573632,"internally_reserved":0,"allocated":1277952,"data_stored":1369151,"data_compressed":77941,"data_compressed_allocated":102400,"data_compressed_original":811008,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808919,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1150976,"data_stored":977043,"data_compressed":54659,"data_compressed_allocated":73728,"data_compressed_original":491520,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070558,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1146880,"data_stored":972867,"data_compressed":54659,"data_compressed_allocated":73728,"data_compressed_original":491520,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332195,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1171456,"data_stored":1177011,"data_compressed":71785,"data_compressed_allocated":94208,"data_compressed_original":688128,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495722,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32256,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712896,"statfs":{"total":95995035648,"available":95962005504,"internally_reserved":0,"allocated":1101824,"data_stored":574907,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32328,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712824,"statfs":{"total":95995035648,"available":95961931776,"internally_reserved":0,"allocated":1175552,"data_stored":644294,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738507,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1126400,"data_stored":576295,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36512,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708640,"statfs":{"total":95995035648,"available":95957647360,"internally_reserved":0,"allocated":1200128,"data_stored":646955,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182521,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1159168,"data_stored":1099917,"data_compressed":60815,"data_compressed_allocated":81920,"data_compressed_original":614400,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920884,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1114112,"data_stored":580478,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757360,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36508,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708644,"statfs":{"total":95995035648,"available":95957651456,"internally_reserved":0,"allocated":1200128,"data_stored":1303278,"data_compressed":77941,"data_compressed_allocated":102400,"data_compressed_original":811008,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":72138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":133997,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":393954,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":203966,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T11:23:51.567 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-13T11:23:51.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.807+0000 7fc6ba800640 1 -- 172.21.15.2:0/1449539377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b4102360 msgr2=0x7fc6b4104750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:51.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.807+0000 7fc6ba800640 1 --2- 172.21.15.2:0/1449539377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b4102360 0x7fc6b4104750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009900 tx=0x7fc6a802a3f0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.807+0000 7fc6ba800640 1 -- 172.21.15.2:0/1449539377 shutdown_connections 2024-06-13T11:23:51.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.807+0000 7fc6ba800640 1 --2- 172.21.15.2:0/1449539377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6b4104c90 0x7fc6b4107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.807+0000 7fc6ba800640 1 --2- 172.21.15.2:0/1449539377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6b41075c0 0x7fc6b4109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.807+0000 7fc6ba800640 1 --2- 172.21.15.2:0/1449539377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b4102360 0x7fc6b4104750 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.807+0000 7fc6ba800640 1 -- 172.21.15.2:0/1449539377 >> 172.21.15.2:0/1449539377 conn(0x7fc6b40fbd70 msgr2=0x7fc6b40fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:51.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.807+0000 7fc6ba800640 1 -- 172.21.15.2:0/1449539377 shutdown_connections 2024-06-13T11:23:51.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.807+0000 7fc6ba800640 1 -- 172.21.15.2:0/1449539377 wait complete. 2024-06-13T11:23:51.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.808+0000 7fc6ba800640 1 Processor -- start 2024-06-13T11:23:51.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.808+0000 7fc6ba800640 1 -- start start 2024-06-13T11:23:51.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.808+0000 7fc6ba800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6b4102360 0x7fc6b4101cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:51.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.808+0000 7fc6ba800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b4104c90 0x7fc6b4100310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:51.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.808+0000 7fc6ba800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6b41075c0 0x7fc6b4100850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.808+0000 7fc6ba800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b410d5b0 con 0x7fc6b41075c0 2024-06-13T11:23:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.808+0000 7fc6ba800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b410d430 con 0x7fc6b4104c90 2024-06-13T11:23:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.808+0000 7fc6ba800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b410d730 con 0x7fc6b4102360 2024-06-13T11:23:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.809+0000 7fc6b9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6b41075c0 0x7fc6b4100850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.809+0000 7fc6b9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6b41075c0 0x7fc6b4100850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34514/0 (socket says 172.21.15.2:34514) 2024-06-13T11:23:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.809+0000 7fc6b9e00640 1 -- 172.21.15.2:0/1558336061 learned_addr learned my addr 172.21.15.2:0/1558336061 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.809+0000 7fc6b9400640 1 --2- 172.21.15.2:0/1558336061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6b4102360 0x7fc6b4101cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.809+0000 7fc6b8a00640 1 --2- 172.21.15.2:0/1558336061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b4104c90 0x7fc6b4100310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.809+0000 7fc6b9e00640 1 -- 172.21.15.2:0/1558336061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6b4102360 msgr2=0x7fc6b4101cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.809+0000 7fc6b9e00640 1 --2- 172.21.15.2:0/1558336061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6b4102360 0x7fc6b4101cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.809+0000 7fc6b9e00640 1 -- 172.21.15.2:0/1558336061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b4104c90 msgr2=0x7fc6b4100310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.809+0000 7fc6b9e00640 1 --2- 172.21.15.2:0/1558336061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b4104c90 0x7fc6b4100310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:51.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.809+0000 7fc6b9e00640 1 -- 172.21.15.2:0/1558336061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b41010e0 con 0x7fc6b41075c0 2024-06-13T11:23:51.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.810+0000 7fc6b9e00640 1 --2- 172.21.15.2:0/1558336061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6b41075c0 0x7fc6b4100850 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00eb10 tx=0x7fc6ac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:51.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.810+0000 7fc6b2000640 1 -- 172.21.15.2:0/1558336061 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac004b20 con 0x7fc6b41075c0 2024-06-13T11:23:51.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.810+0000 7fc6b2000640 1 -- 172.21.15.2:0/1558336061 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6ac004cc0 con 0x7fc6b41075c0 2024-06-13T11:23:51.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.810+0000 7fc6b2000640 1 -- 172.21.15.2:0/1558336061 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac010760 con 0x7fc6b41075c0 2024-06-13T11:23:51.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.811+0000 7fc6ba800640 1 -- 172.21.15.2:0/1558336061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b41a1d70 con 0x7fc6b41075c0 2024-06-13T11:23:51.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.811+0000 7fc6ba800640 1 -- 172.21.15.2:0/1558336061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b41a21b0 con 0x7fc6b41075c0 2024-06-13T11:23:51.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.812+0000 7fc6ba800640 1 -- 172.21.15.2:0/1558336061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b40fd860 con 0x7fc6b41075c0 2024-06-13T11:23:51.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.814+0000 7fc6b2000640 1 -- 172.21.15.2:0/1558336061 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7fc6ac005020 con 0x7fc6b41075c0 2024-06-13T11:23:51.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.815+0000 7fc6b2000640 1 --2- 172.21.15.2:0/1558336061 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc69c0a2d80 0x7fc69c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:51.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.815+0000 7fc6b2000640 1 -- 172.21.15.2:0/1558336061 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fc6ac0cffb0 con 0x7fc6b41075c0 2024-06-13T11:23:51.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.816+0000 7fc6b9400640 1 --2- 172.21.15.2:0/1558336061 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc69c0a2d80 0x7fc69c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:51.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.817+0000 7fc6b9400640 1 --2- 172.21.15.2:0/1558336061 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc69c0a2d80 0x7fc69c0a5240 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8031440 tx=0x7fc6a80315b0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:51.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:51.821+0000 7fc6b2000640 1 -- 172.21.15.2:0/1558336061 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc6ac09c690 con 0x7fc6b41075c0 2024-06-13T11:23:51.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:51 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi178 to 176.1M 2024-06-13T11:23:51.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:51 smithi002 ceph-mon[32210]: Unable to set osd_memory_target on smithi178 to 184755200: error parsing value: Value '184755200' is below minimum 939524096 2024-06-13T11:23:51.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:51 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-06-13T11:23:51.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:51 smithi002 ceph-mon[32210]: Unable to set osd_memory_target on smithi077 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-06-13T11:23:51.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:51 smithi002 ceph-mon[32210]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:23:51.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:51 smithi002 ceph-mon[32210]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-06-13T11:23:51.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:51 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:51.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:51 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:51.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:51 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi178 to 176.1M 2024-06-13T11:23:51.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:51 smithi178 ceph-mon[36913]: Unable to set osd_memory_target on smithi178 to 184755200: error parsing value: Value '184755200' is below minimum 939524096 2024-06-13T11:23:51.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:51 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-06-13T11:23:51.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:51 smithi178 ceph-mon[36913]: Unable to set osd_memory_target on smithi077 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-06-13T11:23:51.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:51 smithi178 ceph-mon[36913]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:23:51.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:51 smithi178 ceph-mon[36913]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-06-13T11:23:51.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:51 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:51.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:51 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:52.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.024+0000 7fc6ba800640 1 -- 172.21.15.2:0/1558336061 --> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6b4061de0 con 0x7fc69c0a2d80 2024-06-13T11:23:52.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.035+0000 7fc6b2000640 1 -- 172.21.15.2:0/1558336061 <== mgr.25150 v2:172.21.15.2:6800/606530635 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339849 (secure 0 0 0) 0x7fc6b4061de0 con 0x7fc69c0a2d80 2024-06-13T11:23:52.036 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:23:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:51 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi178 to 176.1M 2024-06-13T11:23:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:51 smithi077 ceph-mon[36410]: Unable to set osd_memory_target on smithi178 to 184755200: error parsing value: Value '184755200' is below minimum 939524096 2024-06-13T11:23:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:51 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-06-13T11:23:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:51 smithi077 ceph-mon[36410]: Unable to set osd_memory_target on smithi077 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-06-13T11:23:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:51 smithi077 ceph-mon[36410]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:23:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:51 smithi077 ceph-mon[36410]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-06-13T11:23:52.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:51 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:52.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:51 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:52.043 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-06-13T11:23:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.044+0000 7fc6ba800640 1 -- 172.21.15.2:0/1558336061 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc69c0a2d80 msgr2=0x7fc69c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.044+0000 7fc6ba800640 1 --2- 172.21.15.2:0/1558336061 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc69c0a2d80 0x7fc69c0a5240 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8031440 tx=0x7fc6a80315b0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.044+0000 7fc6ba800640 1 -- 172.21.15.2:0/1558336061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6b41075c0 msgr2=0x7fc6b4100850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.044+0000 7fc6ba800640 1 --2- 172.21.15.2:0/1558336061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6b41075c0 0x7fc6b4100850 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00eb10 tx=0x7fc6ac00c2d0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.045+0000 7fc6ba800640 1 -- 172.21.15.2:0/1558336061 shutdown_connections 2024-06-13T11:23:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.045+0000 7fc6ba800640 1 --2- 172.21.15.2:0/1558336061 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc69c0a2d80 0x7fc69c0a5240 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.045+0000 7fc6ba800640 1 --2- 172.21.15.2:0/1558336061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6b41075c0 0x7fc6b4100850 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.045+0000 7fc6ba800640 1 --2- 172.21.15.2:0/1558336061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6b4104c90 0x7fc6b4100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.045+0000 7fc6ba800640 1 --2- 172.21.15.2:0/1558336061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6b4102360 0x7fc6b4101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.045+0000 7fc6ba800640 1 -- 172.21.15.2:0/1558336061 >> 172.21.15.2:0/1558336061 conn(0x7fc6b40fbd70 msgr2=0x7fc6b4102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.045+0000 7fc6ba800640 1 -- 172.21.15.2:0/1558336061 shutdown_connections 2024-06-13T11:23:52.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.045+0000 7fc6ba800640 1 -- 172.21.15.2:0/1558336061 wait complete. 2024-06-13T11:23:52.064 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-06-13T11:23:50.166214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1190737,"num_objects":66,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1566,"num_read_kb":947,"num_write":480,"num_write_kb":4386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":873,"ondisk_log_size":873,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391908,"kb_used_data":13604,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124549916,"statfs":{"total":1151940427776,"available":1151539113984,"internally_reserved":0,"allocated":13930496,"data_stored":10501691,"data_compressed":610878,"data_compressed_allocated":823296,"data_compressed_original":4497408,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.985821"},"pg_stats":[{"pgid":"3.3f","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315200+0000","last_change":"2024-06-13T11:18:42.925351+0000","last_active":"2024-06-13T11:23:46.315200+0000","last_peered":"2024-06-13T11:23:46.315200+0000","last_clean":"2024-06-13T11:23:46.315200+0000","last_became_active":"2024-06-13T11:18:42.924971+0000","last_became_peered":"2024-06-13T11:18:42.924971+0000","last_unstale":"2024-06-13T11:23:46.315200+0000","last_undegraded":"2024-06-13T11:23:46.315200+0000","last_fullsized":"2024-06-13T11:23:46.315200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:33:49.563311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"99'4","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.316155+0000","last_change":"2024-06-13T11:18:42.923771+0000","last_active":"2024-06-13T11:23:46.316155+0000","last_peered":"2024-06-13T11:23:46.316155+0000","last_clean":"2024-06-13T11:23:46.316155+0000","last_became_active":"2024-06-13T11:18:42.918410+0000","last_became_peered":"2024-06-13T11:18:42.918410+0000","last_unstale":"2024-06-13T11:23:46.316155+0000","last_undegraded":"2024-06-13T11:23:46.316155+0000","last_fullsized":"2024-06-13T11:23:46.316155+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:11:28.256622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315856+0000","last_change":"2024-06-13T11:18:42.919502+0000","last_active":"2024-06-13T11:23:46.315856+0000","last_peered":"2024-06-13T11:23:46.315856+0000","last_clean":"2024-06-13T11:23:46.315856+0000","last_became_active":"2024-06-13T11:18:42.915747+0000","last_became_peered":"2024-06-13T11:18:42.915747+0000","last_unstale":"2024-06-13T11:23:46.315856+0000","last_undegraded":"2024-06-13T11:23:46.315856+0000","last_fullsized":"2024-06-13T11:23:46.315856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:39:23.555604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315264+0000","last_change":"2024-06-13T11:18:42.905944+0000","last_active":"2024-06-13T11:23:46.315264+0000","last_peered":"2024-06-13T11:23:46.315264+0000","last_clean":"2024-06-13T11:23:46.315264+0000","last_became_active":"2024-06-13T11:18:42.905494+0000","last_became_peered":"2024-06-13T11:18:42.905494+0000","last_unstale":"2024-06-13T11:23:46.315264+0000","last_undegraded":"2024-06-13T11:23:46.315264+0000","last_fullsized":"2024-06-13T11:23:46.315264+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:26:44.396593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"99'4","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283230+0000","last_change":"2024-06-13T11:18:42.924212+0000","last_active":"2024-06-13T11:23:46.283230+0000","last_peered":"2024-06-13T11:23:46.283230+0000","last_clean":"2024-06-13T11:23:46.283230+0000","last_became_active":"2024-06-13T11:18:42.923848+0000","last_became_peered":"2024-06-13T11:18:42.923848+0000","last_unstale":"2024-06-13T11:23:46.283230+0000","last_undegraded":"2024-06-13T11:23:46.283230+0000","last_fullsized":"2024-06-13T11:23:46.283230+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:01.754609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.298058+0000","last_change":"2024-06-13T11:18:42.915283+0000","last_active":"2024-06-13T11:23:46.298058+0000","last_peered":"2024-06-13T11:23:46.298058+0000","last_clean":"2024-06-13T11:23:46.298058+0000","last_became_active":"2024-06-13T11:18:42.914921+0000","last_became_peered":"2024-06-13T11:18:42.914921+0000","last_unstale":"2024-06-13T11:23:46.298058+0000","last_undegraded":"2024-06-13T11:23:46.298058+0000","last_fullsized":"2024-06-13T11:23:46.298058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:48:42.116314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"99'5","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315332+0000","last_change":"2024-06-13T11:18:42.911614+0000","last_active":"2024-06-13T11:23:46.315332+0000","last_peered":"2024-06-13T11:23:46.315332+0000","last_clean":"2024-06-13T11:23:46.315332+0000","last_became_active":"2024-06-13T11:18:42.911360+0000","last_became_peered":"2024-06-13T11:18:42.911360+0000","last_unstale":"2024-06-13T11:23:46.315332+0000","last_undegraded":"2024-06-13T11:23:46.315332+0000","last_fullsized":"2024-06-13T11:23:46.315332+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:23:55.161725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"99'9","reported_seq":27,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.150483+0000","last_change":"2024-06-13T11:19:27.074801+0000","last_active":"2024-06-13T11:23:46.150483+0000","last_peered":"2024-06-13T11:23:46.150483+0000","last_clean":"2024-06-13T11:23:46.150483+0000","last_became_active":"2024-06-13T11:19:27.072783+0000","last_became_peered":"2024-06-13T11:19:27.072783+0000","last_unstale":"2024-06-13T11:23:46.150483+0000","last_undegraded":"2024-06-13T11:23:46.150483+0000","last_fullsized":"2024-06-13T11:23:46.150483+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:34.658008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"99'11","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300678+0000","last_change":"2024-06-13T11:18:42.913482+0000","last_active":"2024-06-13T11:23:46.300678+0000","last_peered":"2024-06-13T11:23:46.300678+0000","last_clean":"2024-06-13T11:23:46.300678+0000","last_became_active":"2024-06-13T11:18:42.912700+0000","last_became_peered":"2024-06-13T11:18:42.912700+0000","last_unstale":"2024-06-13T11:23:46.300678+0000","last_undegraded":"2024-06-13T11:23:46.300678+0000","last_fullsized":"2024-06-13T11:23:46.300678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:38:42.053801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"99'16","reported_seq":58,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.298539+0000","last_change":"2024-06-13T11:18:42.905824+0000","last_active":"2024-06-13T11:23:46.298539+0000","last_peered":"2024-06-13T11:23:46.298539+0000","last_clean":"2024-06-13T11:23:46.298539+0000","last_became_active":"2024-06-13T11:18:42.905443+0000","last_became_peered":"2024-06-13T11:18:42.905443+0000","last_unstale":"2024-06-13T11:23:46.298539+0000","last_undegraded":"2024-06-13T11:23:46.298539+0000","last_fullsized":"2024-06-13T11:23:46.298539+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:51:46.957656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315564+0000","last_change":"2024-06-13T11:18:42.901987+0000","last_active":"2024-06-13T11:23:46.315564+0000","last_peered":"2024-06-13T11:23:46.315564+0000","last_clean":"2024-06-13T11:23:46.315564+0000","last_became_active":"2024-06-13T11:18:42.901641+0000","last_became_peered":"2024-06-13T11:18:42.901641+0000","last_unstale":"2024-06-13T11:23:46.315564+0000","last_undegraded":"2024-06-13T11:23:46.315564+0000","last_fullsized":"2024-06-13T11:23:46.315564+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:52:29.036172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315230+0000","last_change":"2024-06-13T11:18:42.899161+0000","last_active":"2024-06-13T11:23:46.315230+0000","last_peered":"2024-06-13T11:23:46.315230+0000","last_clean":"2024-06-13T11:23:46.315230+0000","last_became_active":"2024-06-13T11:18:42.898823+0000","last_became_peered":"2024-06-13T11:18:42.898823+0000","last_unstale":"2024-06-13T11:23:46.315230+0000","last_undegraded":"2024-06-13T11:23:46.315230+0000","last_fullsized":"2024-06-13T11:23:46.315230+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:21:20.968759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"99'10","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146793+0000","last_change":"2024-06-13T11:18:42.908954+0000","last_active":"2024-06-13T11:23:46.146793+0000","last_peered":"2024-06-13T11:23:46.146793+0000","last_clean":"2024-06-13T11:23:46.146793+0000","last_became_active":"2024-06-13T11:18:42.908604+0000","last_became_peered":"2024-06-13T11:18:42.908604+0000","last_unstale":"2024-06-13T11:23:46.146793+0000","last_undegraded":"2024-06-13T11:23:46.146793+0000","last_fullsized":"2024-06-13T11:23:46.146793+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:00:30.662233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315379+0000","last_change":"2024-06-13T11:18:42.925374+0000","last_active":"2024-06-13T11:23:46.315379+0000","last_peered":"2024-06-13T11:23:46.315379+0000","last_clean":"2024-06-13T11:23:46.315379+0000","last_became_active":"2024-06-13T11:18:42.924624+0000","last_became_peered":"2024-06-13T11:18:42.924624+0000","last_unstale":"2024-06-13T11:23:46.315379+0000","last_undegraded":"2024-06-13T11:23:46.315379+0000","last_fullsized":"2024-06-13T11:23:46.315379+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:07.989887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315538+0000","last_change":"2024-06-13T11:18:42.924457+0000","last_active":"2024-06-13T11:23:46.315538+0000","last_peered":"2024-06-13T11:23:46.315538+0000","last_clean":"2024-06-13T11:23:46.315538+0000","last_became_active":"2024-06-13T11:18:42.922641+0000","last_became_peered":"2024-06-13T11:18:42.922641+0000","last_unstale":"2024-06-13T11:23:46.315538+0000","last_undegraded":"2024-06-13T11:23:46.315538+0000","last_fullsized":"2024-06-13T11:23:46.315538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:52:56.769565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.299922+0000","last_change":"2024-06-13T11:18:42.925333+0000","last_active":"2024-06-13T11:23:46.299922+0000","last_peered":"2024-06-13T11:23:46.299922+0000","last_clean":"2024-06-13T11:23:46.299922+0000","last_became_active":"2024-06-13T11:18:42.924854+0000","last_became_peered":"2024-06-13T11:18:42.924854+0000","last_unstale":"2024-06-13T11:23:46.299922+0000","last_undegraded":"2024-06-13T11:23:46.299922+0000","last_fullsized":"2024-06-13T11:23:46.299922+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:30:38.554616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314964+0000","last_change":"2024-06-13T11:18:42.926652+0000","last_active":"2024-06-13T11:23:46.314964+0000","last_peered":"2024-06-13T11:23:46.314964+0000","last_clean":"2024-06-13T11:23:46.314964+0000","last_became_active":"2024-06-13T11:18:42.926281+0000","last_became_peered":"2024-06-13T11:18:42.926281+0000","last_unstale":"2024-06-13T11:23:46.314964+0000","last_undegraded":"2024-06-13T11:23:46.314964+0000","last_fullsized":"2024-06-13T11:23:46.314964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:50:50.483047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"99'10","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151530+0000","last_change":"2024-06-13T11:18:42.917743+0000","last_active":"2024-06-13T11:23:46.151530+0000","last_peered":"2024-06-13T11:23:46.151530+0000","last_clean":"2024-06-13T11:23:46.151530+0000","last_became_active":"2024-06-13T11:18:42.916473+0000","last_became_peered":"2024-06-13T11:18:42.916473+0000","last_unstale":"2024-06-13T11:23:46.151530+0000","last_undegraded":"2024-06-13T11:23:46.151530+0000","last_fullsized":"2024-06-13T11:23:46.151530+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:20:12.909524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144409+0000","last_change":"2024-06-13T11:18:42.930712+0000","last_active":"2024-06-13T11:23:46.144409+0000","last_peered":"2024-06-13T11:23:46.144409+0000","last_clean":"2024-06-13T11:23:46.144409+0000","last_became_active":"2024-06-13T11:18:42.930446+0000","last_became_peered":"2024-06-13T11:18:42.930446+0000","last_unstale":"2024-06-13T11:23:46.144409+0000","last_undegraded":"2024-06-13T11:23:46.144409+0000","last_fullsized":"2024-06-13T11:23:46.144409+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:08:28.729916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":31,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.143940+0000","last_change":"2024-06-13T11:18:57.027006+0000","last_active":"2024-06-13T11:23:46.143940+0000","last_peered":"2024-06-13T11:23:46.143940+0000","last_clean":"2024-06-13T11:23:46.143940+0000","last_became_active":"2024-06-13T11:18:57.026562+0000","last_became_peered":"2024-06-13T11:18:57.026562+0000","last_unstale":"2024-06-13T11:23:46.143940+0000","last_undegraded":"2024-06-13T11:23:46.143940+0000","last_fullsized":"2024-06-13T11:23:46.143940+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:17:32.180729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"97'9","reported_seq":58,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151833+0000","last_change":"2024-06-13T11:18:38.172704+0000","last_active":"2024-06-13T11:23:46.151833+0000","last_peered":"2024-06-13T11:23:46.151833+0000","last_clean":"2024-06-13T11:23:46.151833+0000","last_became_active":"2024-06-13T11:18:38.172125+0000","last_became_peered":"2024-06-13T11:18:38.172125+0000","last_unstale":"2024-06-13T11:23:46.151833+0000","last_undegraded":"2024-06-13T11:23:46.151833+0000","last_fullsized":"2024-06-13T11:23:46.151833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:40:52.578805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"99'5","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.286600+0000","last_change":"2024-06-13T11:18:42.922864+0000","last_active":"2024-06-13T11:23:46.286600+0000","last_peered":"2024-06-13T11:23:46.286600+0000","last_clean":"2024-06-13T11:23:46.286600+0000","last_became_active":"2024-06-13T11:18:42.921283+0000","last_became_peered":"2024-06-13T11:18:42.921283+0000","last_unstale":"2024-06-13T11:23:46.286600+0000","last_undegraded":"2024-06-13T11:23:46.286600+0000","last_fullsized":"2024-06-13T11:23:46.286600+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:44.421502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314841+0000","last_change":"2024-06-13T11:20:27.904814+0000","last_active":"2024-06-13T11:23:46.314841+0000","last_peered":"2024-06-13T11:23:46.314841+0000","last_clean":"2024-06-13T11:23:46.314841+0000","last_became_active":"2024-06-13T11:20:27.904342+0000","last_became_peered":"2024-06-13T11:20:27.904342+0000","last_unstale":"2024-06-13T11:23:46.314841+0000","last_undegraded":"2024-06-13T11:23:46.314841+0000","last_fullsized":"2024-06-13T11:23:46.314841+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:45:59.215429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,10,3],"acting":[4,6,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.286095+0000","last_change":"2024-06-13T11:18:38.483021+0000","last_active":"2024-06-13T11:23:46.286095+0000","last_peered":"2024-06-13T11:23:46.286095+0000","last_clean":"2024-06-13T11:23:46.286095+0000","last_became_active":"2024-06-13T11:18:38.482594+0000","last_became_peered":"2024-06-13T11:18:38.482594+0000","last_unstale":"2024-06-13T11:23:46.286095+0000","last_undegraded":"2024-06-13T11:23:46.286095+0000","last_fullsized":"2024-06-13T11:23:46.286095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:27:07.660961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315949+0000","last_change":"2024-06-13T11:18:42.926272+0000","last_active":"2024-06-13T11:23:46.315949+0000","last_peered":"2024-06-13T11:23:46.315949+0000","last_clean":"2024-06-13T11:23:46.315949+0000","last_became_active":"2024-06-13T11:18:42.925864+0000","last_became_peered":"2024-06-13T11:18:42.925864+0000","last_unstale":"2024-06-13T11:23:46.315949+0000","last_undegraded":"2024-06-13T11:23:46.315949+0000","last_fullsized":"2024-06-13T11:23:46.315949+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:51:59.562266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":31,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314909+0000","last_change":"2024-06-13T11:18:57.033152+0000","last_active":"2024-06-13T11:23:46.314909+0000","last_peered":"2024-06-13T11:23:46.314909+0000","last_clean":"2024-06-13T11:23:46.314909+0000","last_became_active":"2024-06-13T11:18:57.032696+0000","last_became_peered":"2024-06-13T11:18:57.032696+0000","last_unstale":"2024-06-13T11:23:46.314909+0000","last_undegraded":"2024-06-13T11:23:46.314909+0000","last_fullsized":"2024-06-13T11:23:46.314909+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:59:20.584476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'4","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283684+0000","last_change":"2024-06-13T11:18:38.168246+0000","last_active":"2024-06-13T11:23:46.283684+0000","last_peered":"2024-06-13T11:23:46.283684+0000","last_clean":"2024-06-13T11:23:46.283684+0000","last_became_active":"2024-06-13T11:18:38.167918+0000","last_became_peered":"2024-06-13T11:18:38.167918+0000","last_unstale":"2024-06-13T11:23:46.283684+0000","last_undegraded":"2024-06-13T11:23:46.283684+0000","last_fullsized":"2024-06-13T11:23:46.283684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:23:39.079356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300375+0000","last_change":"2024-06-13T11:18:42.901291+0000","last_active":"2024-06-13T11:23:46.300375+0000","last_peered":"2024-06-13T11:23:46.300375+0000","last_clean":"2024-06-13T11:23:46.300375+0000","last_became_active":"2024-06-13T11:18:42.900990+0000","last_became_peered":"2024-06-13T11:18:42.900990+0000","last_unstale":"2024-06-13T11:23:46.300375+0000","last_undegraded":"2024-06-13T11:23:46.300375+0000","last_fullsized":"2024-06-13T11:23:46.300375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:59:03.521767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314782+0000","last_change":"2024-06-13T11:20:27.905640+0000","last_active":"2024-06-13T11:23:46.314782+0000","last_peered":"2024-06-13T11:23:46.314782+0000","last_clean":"2024-06-13T11:23:46.314782+0000","last_became_active":"2024-06-13T11:20:27.905149+0000","last_became_peered":"2024-06-13T11:20:27.905149+0000","last_unstale":"2024-06-13T11:23:46.314782+0000","last_undegraded":"2024-06-13T11:23:46.314782+0000","last_fullsized":"2024-06-13T11:23:46.314782+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:24:14.702582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283529+0000","last_change":"2024-06-13T11:18:38.170301+0000","last_active":"2024-06-13T11:23:46.283529+0000","last_peered":"2024-06-13T11:23:46.283529+0000","last_clean":"2024-06-13T11:23:46.283529+0000","last_became_active":"2024-06-13T11:18:38.169926+0000","last_became_peered":"2024-06-13T11:18:38.169926+0000","last_unstale":"2024-06-13T11:23:46.283529+0000","last_undegraded":"2024-06-13T11:23:46.283529+0000","last_fullsized":"2024-06-13T11:23:46.283529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:02:02.877638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"99'15","reported_seq":57,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294616+0000","last_change":"2024-06-13T11:18:42.907869+0000","last_active":"2024-06-13T11:23:46.294616+0000","last_peered":"2024-06-13T11:23:46.294616+0000","last_clean":"2024-06-13T11:23:46.294616+0000","last_became_active":"2024-06-13T11:18:42.907349+0000","last_became_peered":"2024-06-13T11:18:42.907349+0000","last_unstale":"2024-06-13T11:23:46.294616+0000","last_undegraded":"2024-06-13T11:23:46.294616+0000","last_fullsized":"2024-06-13T11:23:46.294616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:54:33.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":31,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144114+0000","last_change":"2024-06-13T11:18:57.009598+0000","last_active":"2024-06-13T11:23:46.144114+0000","last_peered":"2024-06-13T11:23:46.144114+0000","last_clean":"2024-06-13T11:23:46.144114+0000","last_became_active":"2024-06-13T11:18:57.009186+0000","last_became_peered":"2024-06-13T11:18:57.009186+0000","last_unstale":"2024-06-13T11:23:46.144114+0000","last_undegraded":"2024-06-13T11:23:46.144114+0000","last_fullsized":"2024-06-13T11:23:46.144114+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:41:46.784749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"100'8","reported_seq":278,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.753339+0000","last_change":"2024-06-13T11:18:38.167060+0000","last_active":"2024-06-13T11:23:46.753339+0000","last_peered":"2024-06-13T11:23:46.753339+0000","last_clean":"2024-06-13T11:23:46.753339+0000","last_became_active":"2024-06-13T11:18:38.166704+0000","last_became_peered":"2024-06-13T11:18:38.166704+0000","last_unstale":"2024-06-13T11:23:46.753339+0000","last_undegraded":"2024-06-13T11:23:46.753339+0000","last_fullsized":"2024-06-13T11:23:46.753339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:30:51.754276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1543,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":222,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283148+0000","last_change":"2024-06-13T11:18:42.915361+0000","last_active":"2024-06-13T11:23:46.283148+0000","last_peered":"2024-06-13T11:23:46.283148+0000","last_clean":"2024-06-13T11:23:46.283148+0000","last_became_active":"2024-06-13T11:18:42.914977+0000","last_became_peered":"2024-06-13T11:18:42.914977+0000","last_unstale":"2024-06-13T11:23:46.283148+0000","last_undegraded":"2024-06-13T11:23:46.283148+0000","last_fullsized":"2024-06-13T11:23:46.283148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:04:30.677548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144095+0000","last_change":"2024-06-13T11:20:27.603953+0000","last_active":"2024-06-13T11:23:46.144095+0000","last_peered":"2024-06-13T11:23:46.144095+0000","last_clean":"2024-06-13T11:23:46.144095+0000","last_became_active":"2024-06-13T11:20:27.603306+0000","last_became_peered":"2024-06-13T11:20:27.603306+0000","last_unstale":"2024-06-13T11:23:46.144095+0000","last_undegraded":"2024-06-13T11:23:46.144095+0000","last_fullsized":"2024-06-13T11:23:46.144095+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:02:01.228984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'3","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.297963+0000","last_change":"2024-06-13T11:18:38.170126+0000","last_active":"2024-06-13T11:23:46.297963+0000","last_peered":"2024-06-13T11:23:46.297963+0000","last_clean":"2024-06-13T11:23:46.297963+0000","last_became_active":"2024-06-13T11:18:38.169736+0000","last_became_peered":"2024-06-13T11:18:38.169736+0000","last_unstale":"2024-06-13T11:23:46.297963+0000","last_undegraded":"2024-06-13T11:23:46.297963+0000","last_fullsized":"2024-06-13T11:23:46.297963+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:07:22.778093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294559+0000","last_change":"2024-06-13T11:18:42.929004+0000","last_active":"2024-06-13T11:23:46.294559+0000","last_peered":"2024-06-13T11:23:46.294559+0000","last_clean":"2024-06-13T11:23:46.294559+0000","last_became_active":"2024-06-13T11:18:42.928579+0000","last_became_peered":"2024-06-13T11:18:42.928579+0000","last_unstale":"2024-06-13T11:23:46.294559+0000","last_undegraded":"2024-06-13T11:23:46.294559+0000","last_fullsized":"2024-06-13T11:23:46.294559+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:31:15.703033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315006+0000","last_change":"2024-06-13T11:18:57.031059+0000","last_active":"2024-06-13T11:23:46.315006+0000","last_peered":"2024-06-13T11:23:46.315006+0000","last_clean":"2024-06-13T11:23:46.315006+0000","last_became_active":"2024-06-13T11:18:57.030723+0000","last_became_peered":"2024-06-13T11:18:57.030723+0000","last_unstale":"2024-06-13T11:23:46.315006+0000","last_undegraded":"2024-06-13T11:23:46.315006+0000","last_fullsized":"2024-06-13T11:23:46.315006+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:19:36.883790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'2","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146807+0000","last_change":"2024-06-13T11:18:38.175189+0000","last_active":"2024-06-13T11:23:46.146807+0000","last_peered":"2024-06-13T11:23:46.146807+0000","last_clean":"2024-06-13T11:23:46.146807+0000","last_became_active":"2024-06-13T11:18:38.173817+0000","last_became_peered":"2024-06-13T11:18:38.173817+0000","last_unstale":"2024-06-13T11:23:46.146807+0000","last_undegraded":"2024-06-13T11:23:46.146807+0000","last_fullsized":"2024-06-13T11:23:46.146807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:02:18.422449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.284009+0000","last_change":"2024-06-13T11:18:42.920665+0000","last_active":"2024-06-13T11:23:46.284009+0000","last_peered":"2024-06-13T11:23:46.284009+0000","last_clean":"2024-06-13T11:23:46.284009+0000","last_became_active":"2024-06-13T11:18:42.919461+0000","last_became_peered":"2024-06-13T11:18:42.919461+0000","last_unstale":"2024-06-13T11:23:46.284009+0000","last_undegraded":"2024-06-13T11:23:46.284009+0000","last_fullsized":"2024-06-13T11:23:46.284009+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:56:23.042481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.316348+0000","last_change":"2024-06-13T11:18:57.025822+0000","last_active":"2024-06-13T11:23:46.316348+0000","last_peered":"2024-06-13T11:23:46.316348+0000","last_clean":"2024-06-13T11:23:46.316348+0000","last_became_active":"2024-06-13T11:18:57.025408+0000","last_became_peered":"2024-06-13T11:18:57.025408+0000","last_unstale":"2024-06-13T11:23:46.316348+0000","last_undegraded":"2024-06-13T11:23:46.316348+0000","last_fullsized":"2024-06-13T11:23:46.316348+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:39:28.295433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'1","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.293898+0000","last_change":"2024-06-13T11:18:38.168097+0000","last_active":"2024-06-13T11:23:46.293898+0000","last_peered":"2024-06-13T11:23:46.293898+0000","last_clean":"2024-06-13T11:23:46.293898+0000","last_became_active":"2024-06-13T11:18:38.167812+0000","last_became_peered":"2024-06-13T11:18:38.167812+0000","last_unstale":"2024-06-13T11:23:46.293898+0000","last_undegraded":"2024-06-13T11:23:46.293898+0000","last_fullsized":"2024-06-13T11:23:46.293898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:24:20.247579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"99'11","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.150942+0000","last_change":"2024-06-13T11:18:42.932941+0000","last_active":"2024-06-13T11:23:46.150942+0000","last_peered":"2024-06-13T11:23:46.150942+0000","last_clean":"2024-06-13T11:23:46.150942+0000","last_became_active":"2024-06-13T11:18:42.931942+0000","last_became_peered":"2024-06-13T11:18:42.931942+0000","last_unstale":"2024-06-13T11:23:46.150942+0000","last_undegraded":"2024-06-13T11:23:46.150942+0000","last_fullsized":"2024-06-13T11:23:46.150942+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:12:38.625753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.284213+0000","last_change":"2024-06-13T11:18:57.026834+0000","last_active":"2024-06-13T11:23:46.284213+0000","last_peered":"2024-06-13T11:23:46.284213+0000","last_clean":"2024-06-13T11:23:46.284213+0000","last_became_active":"2024-06-13T11:18:57.026401+0000","last_became_peered":"2024-06-13T11:18:57.026401+0000","last_unstale":"2024-06-13T11:23:46.284213+0000","last_undegraded":"2024-06-13T11:23:46.284213+0000","last_fullsized":"2024-06-13T11:23:46.284213+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:11:19.993946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"100'5","reported_seq":270,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.509969+0000","last_change":"2024-06-13T11:18:38.172648+0000","last_active":"2024-06-13T11:23:46.509969+0000","last_peered":"2024-06-13T11:23:46.509969+0000","last_clean":"2024-06-13T11:23:46.509969+0000","last_became_active":"2024-06-13T11:18:38.172311+0000","last_became_peered":"2024-06-13T11:18:38.172311+0000","last_unstale":"2024-06-13T11:23:46.509969+0000","last_undegraded":"2024-06-13T11:23:46.509969+0000","last_fullsized":"2024-06-13T11:23:46.509969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:59:10.620378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":217,"num_read_kb":217,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"99'10","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300652+0000","last_change":"2024-06-13T11:18:42.920352+0000","last_active":"2024-06-13T11:23:46.300652+0000","last_peered":"2024-06-13T11:23:46.300652+0000","last_clean":"2024-06-13T11:23:46.300652+0000","last_became_active":"2024-06-13T11:18:42.919969+0000","last_became_peered":"2024-06-13T11:18:42.919969+0000","last_unstale":"2024-06-13T11:23:46.300652+0000","last_undegraded":"2024-06-13T11:23:46.300652+0000","last_fullsized":"2024-06-13T11:23:46.300652+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:10:59.832735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.150793+0000","last_change":"2024-06-13T11:18:57.034774+0000","last_active":"2024-06-13T11:23:46.150793+0000","last_peered":"2024-06-13T11:23:46.150793+0000","last_clean":"2024-06-13T11:23:46.150793+0000","last_became_active":"2024-06-13T11:18:57.031812+0000","last_became_peered":"2024-06-13T11:18:57.031812+0000","last_unstale":"2024-06-13T11:23:46.150793+0000","last_undegraded":"2024-06-13T11:23:46.150793+0000","last_fullsized":"2024-06-13T11:23:46.150793+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:26.195958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'2","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315391+0000","last_change":"2024-06-13T11:18:38.168169+0000","last_active":"2024-06-13T11:23:46.315391+0000","last_peered":"2024-06-13T11:23:46.315391+0000","last_clean":"2024-06-13T11:23:46.315391+0000","last_became_active":"2024-06-13T11:18:38.167791+0000","last_became_peered":"2024-06-13T11:18:38.167791+0000","last_unstale":"2024-06-13T11:23:46.315391+0000","last_undegraded":"2024-06-13T11:23:46.315391+0000","last_fullsized":"2024-06-13T11:23:46.315391+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:04.879468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"99'9","reported_seq":57,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315768+0000","last_change":"2024-06-13T11:19:27.077888+0000","last_active":"2024-06-13T11:23:46.315768+0000","last_peered":"2024-06-13T11:23:46.315768+0000","last_clean":"2024-06-13T11:23:46.315768+0000","last_became_active":"2024-06-13T11:19:27.075904+0000","last_became_peered":"2024-06-13T11:19:27.075904+0000","last_unstale":"2024-06-13T11:23:46.315768+0000","last_undegraded":"2024-06-13T11:23:46.315768+0000","last_fullsized":"2024-06-13T11:23:46.315768+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:59.920163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.316039+0000","last_change":"2024-06-13T11:19:27.073568+0000","last_active":"2024-06-13T11:23:46.316039+0000","last_peered":"2024-06-13T11:23:46.316039+0000","last_clean":"2024-06-13T11:23:46.316039+0000","last_became_active":"2024-06-13T11:19:27.072954+0000","last_became_peered":"2024-06-13T11:19:27.072954+0000","last_unstale":"2024-06-13T11:23:46.316039+0000","last_undegraded":"2024-06-13T11:23:46.316039+0000","last_fullsized":"2024-06-13T11:23:46.316039+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:10:25.492093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'4","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294413+0000","last_change":"2024-06-13T11:18:38.482021+0000","last_active":"2024-06-13T11:23:46.294413+0000","last_peered":"2024-06-13T11:23:46.294413+0000","last_clean":"2024-06-13T11:23:46.294413+0000","last_became_active":"2024-06-13T11:18:38.481574+0000","last_became_peered":"2024-06-13T11:18:38.481574+0000","last_unstale":"2024-06-13T11:23:46.294413+0000","last_undegraded":"2024-06-13T11:23:46.294413+0000","last_fullsized":"2024-06-13T11:23:46.294413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:50:54.297559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"99'11","reported_seq":59,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300642+0000","last_change":"2024-06-13T11:19:27.072380+0000","last_active":"2024-06-13T11:23:46.300642+0000","last_peered":"2024-06-13T11:23:46.300642+0000","last_clean":"2024-06-13T11:23:46.300642+0000","last_became_active":"2024-06-13T11:19:27.072027+0000","last_became_peered":"2024-06-13T11:19:27.072027+0000","last_unstale":"2024-06-13T11:23:46.300642+0000","last_undegraded":"2024-06-13T11:23:46.300642+0000","last_fullsized":"2024-06-13T11:23:46.300642+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:37:10.455890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151029+0000","last_change":"2024-06-13T11:18:57.028370+0000","last_active":"2024-06-13T11:23:46.151029+0000","last_peered":"2024-06-13T11:23:46.151029+0000","last_clean":"2024-06-13T11:23:46.151029+0000","last_became_active":"2024-06-13T11:18:57.023478+0000","last_became_peered":"2024-06-13T11:18:57.023478+0000","last_unstale":"2024-06-13T11:23:46.151029+0000","last_undegraded":"2024-06-13T11:23:46.151029+0000","last_fullsized":"2024-06-13T11:23:46.151029+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:25:01.237698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"100'41","reported_seq":535,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.752687+0000","last_change":"2024-06-13T11:18:38.169179+0000","last_active":"2024-06-13T11:23:46.752687+0000","last_peered":"2024-06-13T11:23:46.752687+0000","last_clean":"2024-06-13T11:23:46.752687+0000","last_became_active":"2024-06-13T11:18:38.168775+0000","last_became_peered":"2024-06-13T11:18:38.168775+0000","last_unstale":"2024-06-13T11:23:46.752687+0000","last_undegraded":"2024-06-13T11:23:46.752687+0000","last_fullsized":"2024-06-13T11:23:46.752687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:53:39.290755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69867,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":291,"num_write":42,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283436+0000","last_change":"2024-06-13T11:18:42.903744+0000","last_active":"2024-06-13T11:23:46.283436+0000","last_peered":"2024-06-13T11:23:46.283436+0000","last_clean":"2024-06-13T11:23:46.283436+0000","last_became_active":"2024-06-13T11:18:42.903410+0000","last_became_peered":"2024-06-13T11:18:42.903410+0000","last_unstale":"2024-06-13T11:23:46.283436+0000","last_undegraded":"2024-06-13T11:23:46.283436+0000","last_fullsized":"2024-06-13T11:23:46.283436+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:17:55.975517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294901+0000","last_change":"2024-06-13T11:18:57.026052+0000","last_active":"2024-06-13T11:23:46.294901+0000","last_peered":"2024-06-13T11:23:46.294901+0000","last_clean":"2024-06-13T11:23:46.294901+0000","last_became_active":"2024-06-13T11:18:57.025677+0000","last_became_peered":"2024-06-13T11:18:57.025677+0000","last_unstale":"2024-06-13T11:23:46.294901+0000","last_undegraded":"2024-06-13T11:23:46.294901+0000","last_fullsized":"2024-06-13T11:23:46.294901+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:41.061675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'6","reported_seq":55,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144372+0000","last_change":"2024-06-13T11:18:38.166672+0000","last_active":"2024-06-13T11:23:46.144372+0000","last_peered":"2024-06-13T11:23:46.144372+0000","last_clean":"2024-06-13T11:23:46.144372+0000","last_became_active":"2024-06-13T11:18:38.165923+0000","last_became_peered":"2024-06-13T11:18:38.165923+0000","last_unstale":"2024-06-13T11:23:46.144372+0000","last_undegraded":"2024-06-13T11:23:46.144372+0000","last_fullsized":"2024-06-13T11:23:46.144372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:54:00.989462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146908+0000","last_change":"2024-06-13T11:18:42.919280+0000","last_active":"2024-06-13T11:23:46.146908+0000","last_peered":"2024-06-13T11:23:46.146908+0000","last_clean":"2024-06-13T11:23:46.146908+0000","last_became_active":"2024-06-13T11:18:42.917421+0000","last_became_peered":"2024-06-13T11:18:42.917421+0000","last_unstale":"2024-06-13T11:23:46.146908+0000","last_undegraded":"2024-06-13T11:23:46.146908+0000","last_fullsized":"2024-06-13T11:23:46.146908+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:52:23.765290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314791+0000","last_change":"2024-06-13T11:18:57.031244+0000","last_active":"2024-06-13T11:23:46.314791+0000","last_peered":"2024-06-13T11:23:46.314791+0000","last_clean":"2024-06-13T11:23:46.314791+0000","last_became_active":"2024-06-13T11:18:57.030781+0000","last_became_peered":"2024-06-13T11:18:57.030781+0000","last_unstale":"2024-06-13T11:23:46.314791+0000","last_undegraded":"2024-06-13T11:23:46.314791+0000","last_fullsized":"2024-06-13T11:23:46.314791+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:19:51.722256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'3","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294215+0000","last_change":"2024-06-13T11:18:38.171060+0000","last_active":"2024-06-13T11:23:46.294215+0000","last_peered":"2024-06-13T11:23:46.294215+0000","last_clean":"2024-06-13T11:23:46.294215+0000","last_became_active":"2024-06-13T11:18:38.170682+0000","last_became_peered":"2024-06-13T11:18:38.170682+0000","last_unstale":"2024-06-13T11:23:46.294215+0000","last_undegraded":"2024-06-13T11:23:46.294215+0000","last_fullsized":"2024-06-13T11:23:46.294215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:05:53.157074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"99'15","reported_seq":57,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315877+0000","last_change":"2024-06-13T11:18:42.902700+0000","last_active":"2024-06-13T11:23:46.315877+0000","last_peered":"2024-06-13T11:23:46.315877+0000","last_clean":"2024-06-13T11:23:46.315877+0000","last_became_active":"2024-06-13T11:18:42.902351+0000","last_became_peered":"2024-06-13T11:18:42.902351+0000","last_unstale":"2024-06-13T11:23:46.315877+0000","last_undegraded":"2024-06-13T11:23:46.315877+0000","last_fullsized":"2024-06-13T11:23:46.315877+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:55:16.769324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151561+0000","last_change":"2024-06-13T11:18:57.034840+0000","last_active":"2024-06-13T11:23:46.151561+0000","last_peered":"2024-06-13T11:23:46.151561+0000","last_clean":"2024-06-13T11:23:46.151561+0000","last_became_active":"2024-06-13T11:18:57.033552+0000","last_became_peered":"2024-06-13T11:18:57.033552+0000","last_unstale":"2024-06-13T11:23:46.151561+0000","last_undegraded":"2024-06-13T11:23:46.151561+0000","last_fullsized":"2024-06-13T11:23:46.151561+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:44:25.463043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"100'6","reported_seq":276,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.903842+0000","last_change":"2024-06-13T11:18:38.170644+0000","last_active":"2024-06-13T11:23:46.903842+0000","last_peered":"2024-06-13T11:23:46.903842+0000","last_clean":"2024-06-13T11:23:46.903842+0000","last_became_active":"2024-06-13T11:18:38.169986+0000","last_became_peered":"2024-06-13T11:18:38.169986+0000","last_unstale":"2024-06-13T11:23:46.903842+0000","last_undegraded":"2024-06-13T11:23:46.903842+0000","last_fullsized":"2024-06-13T11:23:46.903842+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:45:48.817898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1509,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315721+0000","last_change":"2024-06-13T11:18:42.903465+0000","last_active":"2024-06-13T11:23:46.315721+0000","last_peered":"2024-06-13T11:23:46.315721+0000","last_clean":"2024-06-13T11:23:46.315721+0000","last_became_active":"2024-06-13T11:18:42.903001+0000","last_became_peered":"2024-06-13T11:18:42.903001+0000","last_unstale":"2024-06-13T11:23:46.315721+0000","last_undegraded":"2024-06-13T11:23:46.315721+0000","last_fullsized":"2024-06-13T11:23:46.315721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:25:24.331890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":31,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.147052+0000","last_change":"2024-06-13T11:18:57.033966+0000","last_active":"2024-06-13T11:23:46.147052+0000","last_peered":"2024-06-13T11:23:46.147052+0000","last_clean":"2024-06-13T11:23:46.147052+0000","last_became_active":"2024-06-13T11:18:57.032448+0000","last_became_peered":"2024-06-13T11:18:57.032448+0000","last_unstale":"2024-06-13T11:23:46.147052+0000","last_undegraded":"2024-06-13T11:23:46.147052+0000","last_fullsized":"2024-06-13T11:23:46.147052+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:51:40.473020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'15","reported_seq":64,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.282957+0000","last_change":"2024-06-13T11:18:38.483204+0000","last_active":"2024-06-13T11:23:46.282957+0000","last_peered":"2024-06-13T11:23:46.282957+0000","last_clean":"2024-06-13T11:23:46.282957+0000","last_became_active":"2024-06-13T11:18:38.482800+0000","last_became_peered":"2024-06-13T11:18:38.482800+0000","last_unstale":"2024-06-13T11:23:46.282957+0000","last_undegraded":"2024-06-13T11:23:46.282957+0000","last_fullsized":"2024-06-13T11:23:46.282957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:28:44.636201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294236+0000","last_change":"2024-06-13T11:18:42.899944+0000","last_active":"2024-06-13T11:23:46.294236+0000","last_peered":"2024-06-13T11:23:46.294236+0000","last_clean":"2024-06-13T11:23:46.294236+0000","last_became_active":"2024-06-13T11:18:42.899551+0000","last_became_peered":"2024-06-13T11:18:42.899551+0000","last_unstale":"2024-06-13T11:23:46.294236+0000","last_undegraded":"2024-06-13T11:23:46.294236+0000","last_fullsized":"2024-06-13T11:23:46.294236+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:18:21.109043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294120+0000","last_change":"2024-06-13T11:18:57.028817+0000","last_active":"2024-06-13T11:23:46.294120+0000","last_peered":"2024-06-13T11:23:46.294120+0000","last_clean":"2024-06-13T11:23:46.294120+0000","last_became_active":"2024-06-13T11:18:57.028433+0000","last_became_peered":"2024-06-13T11:18:57.028433+0000","last_unstale":"2024-06-13T11:23:46.294120+0000","last_undegraded":"2024-06-13T11:23:46.294120+0000","last_fullsized":"2024-06-13T11:23:46.294120+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:56:24.180096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283522+0000","last_change":"2024-06-13T11:18:38.165907+0000","last_active":"2024-06-13T11:23:46.283522+0000","last_peered":"2024-06-13T11:23:46.283522+0000","last_clean":"2024-06-13T11:23:46.283522+0000","last_became_active":"2024-06-13T11:18:38.165516+0000","last_became_peered":"2024-06-13T11:18:38.165516+0000","last_unstale":"2024-06-13T11:23:46.283522+0000","last_undegraded":"2024-06-13T11:23:46.283522+0000","last_fullsized":"2024-06-13T11:23:46.283522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:51:15.774967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"99'5","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314951+0000","last_change":"2024-06-13T11:19:27.004377+0000","last_active":"2024-06-13T11:23:46.314951+0000","last_peered":"2024-06-13T11:23:46.314951+0000","last_clean":"2024-06-13T11:23:46.314951+0000","last_became_active":"2024-06-13T11:19:27.003954+0000","last_became_peered":"2024-06-13T11:19:27.003954+0000","last_unstale":"2024-06-13T11:23:46.314951+0000","last_undegraded":"2024-06-13T11:23:46.314951+0000","last_fullsized":"2024-06-13T11:23:46.314951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:53:25.967036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.282972+0000","last_change":"2024-06-13T11:18:57.184912+0000","last_active":"2024-06-13T11:23:46.282972+0000","last_peered":"2024-06-13T11:23:46.282972+0000","last_clean":"2024-06-13T11:23:46.282972+0000","last_became_active":"2024-06-13T11:18:57.184442+0000","last_became_peered":"2024-06-13T11:18:57.184442+0000","last_unstale":"2024-06-13T11:23:46.282972+0000","last_undegraded":"2024-06-13T11:23:46.282972+0000","last_fullsized":"2024-06-13T11:23:46.282972+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:47:17.961086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151270+0000","last_change":"2024-06-13T11:18:38.484487+0000","last_active":"2024-06-13T11:23:46.151270+0000","last_peered":"2024-06-13T11:23:46.151270+0000","last_clean":"2024-06-13T11:23:46.151270+0000","last_became_active":"2024-06-13T11:18:38.483587+0000","last_became_peered":"2024-06-13T11:18:38.483587+0000","last_unstale":"2024-06-13T11:23:46.151270+0000","last_undegraded":"2024-06-13T11:23:46.151270+0000","last_fullsized":"2024-06-13T11:23:46.151270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:50:19.773340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"99'4","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.298226+0000","last_change":"2024-06-13T11:18:42.913275+0000","last_active":"2024-06-13T11:23:46.298226+0000","last_peered":"2024-06-13T11:23:46.298226+0000","last_clean":"2024-06-13T11:23:46.298226+0000","last_became_active":"2024-06-13T11:18:42.912880+0000","last_became_peered":"2024-06-13T11:18:42.912880+0000","last_unstale":"2024-06-13T11:23:46.298226+0000","last_undegraded":"2024-06-13T11:23:46.298226+0000","last_fullsized":"2024-06-13T11:23:46.298226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:01:55.261976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146430+0000","last_change":"2024-06-13T11:18:57.027893+0000","last_active":"2024-06-13T11:23:46.146430+0000","last_peered":"2024-06-13T11:23:46.146430+0000","last_clean":"2024-06-13T11:23:46.146430+0000","last_became_active":"2024-06-13T11:18:57.025683+0000","last_became_peered":"2024-06-13T11:18:57.025683+0000","last_unstale":"2024-06-13T11:23:46.146430+0000","last_undegraded":"2024-06-13T11:23:46.146430+0000","last_fullsized":"2024-06-13T11:23:46.146430+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:25:59.348570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"97'1","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315392+0000","last_change":"2024-06-13T11:18:38.167932+0000","last_active":"2024-06-13T11:23:46.315392+0000","last_peered":"2024-06-13T11:23:46.315392+0000","last_clean":"2024-06-13T11:23:46.315392+0000","last_became_active":"2024-06-13T11:18:38.167520+0000","last_became_peered":"2024-06-13T11:18:38.167520+0000","last_unstale":"2024-06-13T11:23:46.315392+0000","last_undegraded":"2024-06-13T11:23:46.315392+0000","last_fullsized":"2024-06-13T11:23:46.315392+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:00:04.537091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.297918+0000","last_change":"2024-06-13T11:18:42.923211+0000","last_active":"2024-06-13T11:23:46.297918+0000","last_peered":"2024-06-13T11:23:46.297918+0000","last_clean":"2024-06-13T11:23:46.297918+0000","last_became_active":"2024-06-13T11:18:42.922858+0000","last_became_peered":"2024-06-13T11:18:42.922858+0000","last_unstale":"2024-06-13T11:23:46.297918+0000","last_undegraded":"2024-06-13T11:23:46.297918+0000","last_fullsized":"2024-06-13T11:23:46.297918+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:56:18.163502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.147614+0000","last_change":"2024-06-13T11:18:57.185071+0000","last_active":"2024-06-13T11:23:46.147614+0000","last_peered":"2024-06-13T11:23:46.147614+0000","last_clean":"2024-06-13T11:23:46.147614+0000","last_became_active":"2024-06-13T11:18:57.184526+0000","last_became_peered":"2024-06-13T11:18:57.184526+0000","last_unstale":"2024-06-13T11:23:46.147614+0000","last_undegraded":"2024-06-13T11:23:46.147614+0000","last_fullsized":"2024-06-13T11:23:46.147614+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:51:37.715832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294188+0000","last_change":"2024-06-13T11:18:42.912483+0000","last_active":"2024-06-13T11:23:46.294188+0000","last_peered":"2024-06-13T11:23:46.294188+0000","last_clean":"2024-06-13T11:23:46.294188+0000","last_became_active":"2024-06-13T11:18:42.912117+0000","last_became_peered":"2024-06-13T11:18:42.912117+0000","last_unstale":"2024-06-13T11:23:46.294188+0000","last_undegraded":"2024-06-13T11:23:46.294188+0000","last_fullsized":"2024-06-13T11:23:46.294188+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:23.769097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"100'6","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.504386+0000","last_change":"2024-06-13T11:18:38.483334+0000","last_active":"2024-06-13T11:23:46.504386+0000","last_peered":"2024-06-13T11:23:46.504386+0000","last_clean":"2024-06-13T11:23:46.504386+0000","last_became_active":"2024-06-13T11:18:38.482885+0000","last_became_peered":"2024-06-13T11:18:38.482885+0000","last_unstale":"2024-06-13T11:23:46.504386+0000","last_undegraded":"2024-06-13T11:23:46.504386+0000","last_fullsized":"2024-06-13T11:23:46.504386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:55:19.986526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":217,"num_read_kb":217,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"97'1","reported_seq":33,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315368+0000","last_change":"2024-06-13T11:18:57.016960+0000","last_active":"2024-06-13T11:23:46.315368+0000","last_peered":"2024-06-13T11:23:46.315368+0000","last_clean":"2024-06-13T11:23:46.315368+0000","last_became_active":"2024-06-13T11:18:57.016490+0000","last_became_peered":"2024-06-13T11:18:57.016490+0000","last_unstale":"2024-06-13T11:23:46.315368+0000","last_undegraded":"2024-06-13T11:23:46.315368+0000","last_fullsized":"2024-06-13T11:23:46.315368+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:40:19.796594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.284675+0000","last_change":"2024-06-13T11:18:42.921581+0000","last_active":"2024-06-13T11:23:46.284675+0000","last_peered":"2024-06-13T11:23:46.284675+0000","last_clean":"2024-06-13T11:23:46.284675+0000","last_became_active":"2024-06-13T11:18:42.917820+0000","last_became_peered":"2024-06-13T11:18:42.917820+0000","last_unstale":"2024-06-13T11:23:46.284675+0000","last_undegraded":"2024-06-13T11:23:46.284675+0000","last_fullsized":"2024-06-13T11:23:46.284675+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:59:28.460363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'3","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314983+0000","last_change":"2024-06-13T11:18:38.168111+0000","last_active":"2024-06-13T11:23:46.314983+0000","last_peered":"2024-06-13T11:23:46.314983+0000","last_clean":"2024-06-13T11:23:46.314983+0000","last_became_active":"2024-06-13T11:18:38.167732+0000","last_became_peered":"2024-06-13T11:18:38.167732+0000","last_unstale":"2024-06-13T11:23:46.314983+0000","last_undegraded":"2024-06-13T11:23:46.314983+0000","last_fullsized":"2024-06-13T11:23:46.314983+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:36:55.993553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":381,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315089+0000","last_change":"2024-06-13T11:17:06.317849+0000","last_active":"2024-06-13T11:23:46.315089+0000","last_peered":"2024-06-13T11:23:46.315089+0000","last_clean":"2024-06-13T11:23:46.315089+0000","last_became_active":"2024-06-13T11:17:06.317293+0000","last_became_peered":"2024-06-13T11:17:06.317293+0000","last_unstale":"2024-06-13T11:23:46.315089+0000","last_undegraded":"2024-06-13T11:23:46.315089+0000","last_fullsized":"2024-06-13T11:23:46.315089+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:13:14.002581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:13:14.002581+0000","last_clean_scrub_stamp":"2024-06-13T11:13:14.002581+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:54:32.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294618+0000","last_change":"2024-06-13T11:18:57.185880+0000","last_active":"2024-06-13T11:23:46.294618+0000","last_peered":"2024-06-13T11:23:46.294618+0000","last_clean":"2024-06-13T11:23:46.294618+0000","last_became_active":"2024-06-13T11:18:57.185140+0000","last_became_peered":"2024-06-13T11:18:57.185140+0000","last_unstale":"2024-06-13T11:23:46.294618+0000","last_undegraded":"2024-06-13T11:23:46.294618+0000","last_fullsized":"2024-06-13T11:23:46.294618+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:43:40.195809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"99'5","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.145829+0000","last_change":"2024-06-13T11:19:27.006408+0000","last_active":"2024-06-13T11:23:46.145829+0000","last_peered":"2024-06-13T11:23:46.145829+0000","last_clean":"2024-06-13T11:23:46.145829+0000","last_became_active":"2024-06-13T11:19:27.005525+0000","last_became_peered":"2024-06-13T11:19:27.005525+0000","last_unstale":"2024-06-13T11:23:46.145829+0000","last_undegraded":"2024-06-13T11:23:46.145829+0000","last_fullsized":"2024-06-13T11:23:46.145829+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:09:39.891543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'3","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315242+0000","last_change":"2024-06-13T11:18:38.171089+0000","last_active":"2024-06-13T11:23:46.315242+0000","last_peered":"2024-06-13T11:23:46.315242+0000","last_clean":"2024-06-13T11:23:46.315242+0000","last_became_active":"2024-06-13T11:18:38.170769+0000","last_became_peered":"2024-06-13T11:18:38.170769+0000","last_unstale":"2024-06-13T11:23:46.315242+0000","last_undegraded":"2024-06-13T11:23:46.315242+0000","last_fullsized":"2024-06-13T11:23:46.315242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:07:46.355159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314717+0000","last_change":"2024-06-13T11:18:57.015609+0000","last_active":"2024-06-13T11:23:46.314717+0000","last_peered":"2024-06-13T11:23:46.314717+0000","last_clean":"2024-06-13T11:23:46.314717+0000","last_became_active":"2024-06-13T11:18:57.015164+0000","last_became_peered":"2024-06-13T11:18:57.015164+0000","last_unstale":"2024-06-13T11:23:46.314717+0000","last_undegraded":"2024-06-13T11:23:46.314717+0000","last_fullsized":"2024-06-13T11:23:46.314717+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:32:15.725778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'1","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283442+0000","last_change":"2024-06-13T11:18:38.483215+0000","last_active":"2024-06-13T11:23:46.283442+0000","last_peered":"2024-06-13T11:23:46.283442+0000","last_clean":"2024-06-13T11:23:46.283442+0000","last_became_active":"2024-06-13T11:18:38.482789+0000","last_became_peered":"2024-06-13T11:18:38.482789+0000","last_unstale":"2024-06-13T11:23:46.283442+0000","last_undegraded":"2024-06-13T11:23:46.283442+0000","last_fullsized":"2024-06-13T11:23:46.283442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:01:58.020310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146040+0000","last_change":"2024-06-13T11:18:42.914846+0000","last_active":"2024-06-13T11:23:46.146040+0000","last_peered":"2024-06-13T11:23:46.146040+0000","last_clean":"2024-06-13T11:23:46.146040+0000","last_became_active":"2024-06-13T11:18:42.912614+0000","last_became_peered":"2024-06-13T11:18:42.912614+0000","last_unstale":"2024-06-13T11:23:46.146040+0000","last_undegraded":"2024-06-13T11:23:46.146040+0000","last_fullsized":"2024-06-13T11:23:46.146040+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:00:13.066079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283969+0000","last_change":"2024-06-13T11:18:57.185117+0000","last_active":"2024-06-13T11:23:46.283969+0000","last_peered":"2024-06-13T11:23:46.283969+0000","last_clean":"2024-06-13T11:23:46.283969+0000","last_became_active":"2024-06-13T11:18:57.184498+0000","last_became_peered":"2024-06-13T11:18:57.184498+0000","last_unstale":"2024-06-13T11:23:46.283969+0000","last_undegraded":"2024-06-13T11:23:46.283969+0000","last_fullsized":"2024-06-13T11:23:46.283969+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:04:28.800984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"100'47","reported_seq":118,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.439881+0000","last_change":"2024-06-13T11:18:38.176918+0000","last_active":"2024-06-13T11:23:46.439881+0000","last_peered":"2024-06-13T11:23:46.439881+0000","last_clean":"2024-06-13T11:23:46.439881+0000","last_became_active":"2024-06-13T11:18:38.176236+0000","last_became_peered":"2024-06-13T11:18:38.176236+0000","last_unstale":"2024-06-13T11:23:46.439881+0000","last_undegraded":"2024-06-13T11:23:46.439881+0000","last_fullsized":"2024-06-13T11:23:46.439881+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:10:20.684891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":85,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"99'5","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.286262+0000","last_change":"2024-06-13T11:18:42.920930+0000","last_active":"2024-06-13T11:23:46.286262+0000","last_peered":"2024-06-13T11:23:46.286262+0000","last_clean":"2024-06-13T11:23:46.286262+0000","last_became_active":"2024-06-13T11:18:42.915838+0000","last_became_peered":"2024-06-13T11:18:42.915838+0000","last_unstale":"2024-06-13T11:23:46.286262+0000","last_undegraded":"2024-06-13T11:23:46.286262+0000","last_fullsized":"2024-06-13T11:23:46.286262+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:07:43.483317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.143782+0000","last_change":"2024-06-13T11:18:57.009043+0000","last_active":"2024-06-13T11:23:46.143782+0000","last_peered":"2024-06-13T11:23:46.143782+0000","last_clean":"2024-06-13T11:23:46.143782+0000","last_became_active":"2024-06-13T11:18:57.008533+0000","last_became_peered":"2024-06-13T11:18:57.008533+0000","last_unstale":"2024-06-13T11:23:46.143782+0000","last_undegraded":"2024-06-13T11:23:46.143782+0000","last_fullsized":"2024-06-13T11:23:46.143782+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:30:29.614810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'4","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315871+0000","last_change":"2024-06-13T11:18:38.523042+0000","last_active":"2024-06-13T11:23:46.315871+0000","last_peered":"2024-06-13T11:23:46.315871+0000","last_clean":"2024-06-13T11:23:46.315871+0000","last_became_active":"2024-06-13T11:18:38.522673+0000","last_became_peered":"2024-06-13T11:18:38.522673+0000","last_unstale":"2024-06-13T11:23:46.315871+0000","last_undegraded":"2024-06-13T11:23:46.315871+0000","last_fullsized":"2024-06-13T11:23:46.315871+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:25:50.725281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.316292+0000","last_change":"2024-06-13T11:18:42.934090+0000","last_active":"2024-06-13T11:23:46.316292+0000","last_peered":"2024-06-13T11:23:46.316292+0000","last_clean":"2024-06-13T11:23:46.316292+0000","last_became_active":"2024-06-13T11:18:42.933680+0000","last_became_peered":"2024-06-13T11:18:42.933680+0000","last_unstale":"2024-06-13T11:23:46.316292+0000","last_undegraded":"2024-06-13T11:23:46.316292+0000","last_fullsized":"2024-06-13T11:23:46.316292+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:39:30.214272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315368+0000","last_change":"2024-06-13T11:18:57.185186+0000","last_active":"2024-06-13T11:23:46.315368+0000","last_peered":"2024-06-13T11:23:46.315368+0000","last_clean":"2024-06-13T11:23:46.315368+0000","last_became_active":"2024-06-13T11:18:57.184448+0000","last_became_peered":"2024-06-13T11:18:57.184448+0000","last_unstale":"2024-06-13T11:23:46.315368+0000","last_undegraded":"2024-06-13T11:23:46.315368+0000","last_fullsized":"2024-06-13T11:23:46.315368+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:18:32.514993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":56,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300041+0000","last_change":"2024-06-13T11:19:26.999451+0000","last_active":"2024-06-13T11:23:46.300041+0000","last_peered":"2024-06-13T11:23:46.300041+0000","last_clean":"2024-06-13T11:23:46.300041+0000","last_became_active":"2024-06-13T11:19:26.999153+0000","last_became_peered":"2024-06-13T11:19:26.999153+0000","last_unstale":"2024-06-13T11:23:46.300041+0000","last_undegraded":"2024-06-13T11:23:46.300041+0000","last_fullsized":"2024-06-13T11:23:46.300041+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:42:34.755569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"99'2","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.282968+0000","last_change":"2024-06-13T11:18:42.903741+0000","last_active":"2024-06-13T11:23:46.282968+0000","last_peered":"2024-06-13T11:23:46.282968+0000","last_clean":"2024-06-13T11:23:46.282968+0000","last_became_active":"2024-06-13T11:18:42.903351+0000","last_became_peered":"2024-06-13T11:18:42.903351+0000","last_unstale":"2024-06-13T11:23:46.282968+0000","last_undegraded":"2024-06-13T11:23:46.282968+0000","last_fullsized":"2024-06-13T11:23:46.282968+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:47:21.206540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151718+0000","last_change":"2024-06-13T11:18:57.035149+0000","last_active":"2024-06-13T11:23:46.151718+0000","last_peered":"2024-06-13T11:23:46.151718+0000","last_clean":"2024-06-13T11:23:46.151718+0000","last_became_active":"2024-06-13T11:18:57.033208+0000","last_became_peered":"2024-06-13T11:18:57.033208+0000","last_unstale":"2024-06-13T11:23:46.151718+0000","last_undegraded":"2024-06-13T11:23:46.151718+0000","last_fullsized":"2024-06-13T11:23:46.151718+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:19:01.353814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'3","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.284275+0000","last_change":"2024-06-13T11:18:38.170464+0000","last_active":"2024-06-13T11:23:46.284275+0000","last_peered":"2024-06-13T11:23:46.284275+0000","last_clean":"2024-06-13T11:23:46.284275+0000","last_became_active":"2024-06-13T11:18:38.169945+0000","last_became_peered":"2024-06-13T11:18:38.169945+0000","last_unstale":"2024-06-13T11:23:46.284275+0000","last_undegraded":"2024-06-13T11:23:46.284275+0000","last_fullsized":"2024-06-13T11:23:46.284275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:53:20.112176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314661+0000","last_change":"2024-06-13T11:18:42.925391+0000","last_active":"2024-06-13T11:23:46.314661+0000","last_peered":"2024-06-13T11:23:46.314661+0000","last_clean":"2024-06-13T11:23:46.314661+0000","last_became_active":"2024-06-13T11:18:42.924900+0000","last_became_peered":"2024-06-13T11:18:42.924900+0000","last_unstale":"2024-06-13T11:23:46.314661+0000","last_undegraded":"2024-06-13T11:23:46.314661+0000","last_fullsized":"2024-06-13T11:23:46.314661+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:10.954502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"99'1","reported_seq":33,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315126+0000","last_change":"2024-06-13T11:18:57.029448+0000","last_active":"2024-06-13T11:23:46.315126+0000","last_peered":"2024-06-13T11:23:46.315126+0000","last_clean":"2024-06-13T11:23:46.315126+0000","last_became_active":"2024-06-13T11:18:57.028918+0000","last_became_peered":"2024-06-13T11:18:57.028918+0000","last_unstale":"2024-06-13T11:23:46.315126+0000","last_undegraded":"2024-06-13T11:23:46.315126+0000","last_fullsized":"2024-06-13T11:23:46.315126+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:53:06.206458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"97'1","reported_seq":19,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314634+0000","last_change":"2024-06-13T11:19:27.078724+0000","last_active":"2024-06-13T11:23:46.314634+0000","last_peered":"2024-06-13T11:23:46.314634+0000","last_clean":"2024-06-13T11:23:46.314634+0000","last_became_active":"2024-06-13T11:19:27.078329+0000","last_became_peered":"2024-06-13T11:19:27.078329+0000","last_unstale":"2024-06-13T11:23:46.314634+0000","last_undegraded":"2024-06-13T11:23:46.314634+0000","last_fullsized":"2024-06-13T11:23:46.314634+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:25:38.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.285410+0000","last_change":"2024-06-13T11:18:42.930769+0000","last_active":"2024-06-13T11:23:46.285410+0000","last_peered":"2024-06-13T11:23:46.285410+0000","last_clean":"2024-06-13T11:23:46.285410+0000","last_became_active":"2024-06-13T11:18:42.928727+0000","last_became_peered":"2024-06-13T11:18:42.928727+0000","last_unstale":"2024-06-13T11:23:46.285410+0000","last_undegraded":"2024-06-13T11:23:46.285410+0000","last_fullsized":"2024-06-13T11:23:46.285410+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:14:55.202237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315132+0000","last_change":"2024-06-13T11:18:57.185071+0000","last_active":"2024-06-13T11:23:46.315132+0000","last_peered":"2024-06-13T11:23:46.315132+0000","last_clean":"2024-06-13T11:23:46.315132+0000","last_became_active":"2024-06-13T11:18:57.184534+0000","last_became_peered":"2024-06-13T11:18:57.184534+0000","last_unstale":"2024-06-13T11:23:46.315132+0000","last_undegraded":"2024-06-13T11:23:46.315132+0000","last_fullsized":"2024-06-13T11:23:46.315132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:55:11.146525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283058+0000","last_change":"2024-06-13T11:18:38.167734+0000","last_active":"2024-06-13T11:23:46.283058+0000","last_peered":"2024-06-13T11:23:46.283058+0000","last_clean":"2024-06-13T11:23:46.283058+0000","last_became_active":"2024-06-13T11:18:38.167345+0000","last_became_peered":"2024-06-13T11:18:38.167345+0000","last_unstale":"2024-06-13T11:23:46.283058+0000","last_undegraded":"2024-06-13T11:23:46.283058+0000","last_fullsized":"2024-06-13T11:23:46.283058+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:55:43.155928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"99'5","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315715+0000","last_change":"2024-06-13T11:18:42.900884+0000","last_active":"2024-06-13T11:23:46.315715+0000","last_peered":"2024-06-13T11:23:46.315715+0000","last_clean":"2024-06-13T11:23:46.315715+0000","last_became_active":"2024-06-13T11:18:42.900562+0000","last_became_peered":"2024-06-13T11:18:42.900562+0000","last_unstale":"2024-06-13T11:23:46.315715+0000","last_undegraded":"2024-06-13T11:23:46.315715+0000","last_fullsized":"2024-06-13T11:23:46.315715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:38:59.480693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300071+0000","last_change":"2024-06-13T11:18:57.015496+0000","last_active":"2024-06-13T11:23:46.300071+0000","last_peered":"2024-06-13T11:23:46.300071+0000","last_clean":"2024-06-13T11:23:46.300071+0000","last_became_active":"2024-06-13T11:18:57.015079+0000","last_became_peered":"2024-06-13T11:18:57.015079+0000","last_unstale":"2024-06-13T11:23:46.300071+0000","last_undegraded":"2024-06-13T11:23:46.300071+0000","last_fullsized":"2024-06-13T11:23:46.300071+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:31:40.130018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"97'3","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144270+0000","last_change":"2024-06-13T11:18:38.523097+0000","last_active":"2024-06-13T11:23:46.144270+0000","last_peered":"2024-06-13T11:23:46.144270+0000","last_clean":"2024-06-13T11:23:46.144270+0000","last_became_active":"2024-06-13T11:18:38.522638+0000","last_became_peered":"2024-06-13T11:18:38.522638+0000","last_unstale":"2024-06-13T11:23:46.144270+0000","last_undegraded":"2024-06-13T11:23:46.144270+0000","last_fullsized":"2024-06-13T11:23:46.144270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:35:36.843246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315685+0000","last_change":"2024-06-13T11:18:42.899281+0000","last_active":"2024-06-13T11:23:46.315685+0000","last_peered":"2024-06-13T11:23:46.315685+0000","last_clean":"2024-06-13T11:23:46.315685+0000","last_became_active":"2024-06-13T11:18:42.898924+0000","last_became_peered":"2024-06-13T11:18:42.898924+0000","last_unstale":"2024-06-13T11:23:46.315685+0000","last_undegraded":"2024-06-13T11:23:46.315685+0000","last_fullsized":"2024-06-13T11:23:46.315685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:18:10.324425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315538+0000","last_change":"2024-06-13T11:18:57.037070+0000","last_active":"2024-06-13T11:23:46.315538+0000","last_peered":"2024-06-13T11:23:46.315538+0000","last_clean":"2024-06-13T11:23:46.315538+0000","last_became_active":"2024-06-13T11:18:57.036632+0000","last_became_peered":"2024-06-13T11:18:57.036632+0000","last_unstale":"2024-06-13T11:23:46.315538+0000","last_undegraded":"2024-06-13T11:23:46.315538+0000","last_fullsized":"2024-06-13T11:23:46.315538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:19:35.433902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"100'39","reported_seq":95,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.436022+0000","last_change":"2024-06-13T11:18:38.170790+0000","last_active":"2024-06-13T11:23:46.436022+0000","last_peered":"2024-06-13T11:23:46.436022+0000","last_clean":"2024-06-13T11:23:46.436022+0000","last_became_active":"2024-06-13T11:18:38.170260+0000","last_became_peered":"2024-06-13T11:18:38.170260+0000","last_unstale":"2024-06-13T11:23:46.436022+0000","last_undegraded":"2024-06-13T11:23:46.436022+0000","last_fullsized":"2024-06-13T11:23:46.436022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:11:44.070550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315378+0000","last_change":"2024-06-13T11:18:42.906969+0000","last_active":"2024-06-13T11:23:46.315378+0000","last_peered":"2024-06-13T11:23:46.315378+0000","last_clean":"2024-06-13T11:23:46.315378+0000","last_became_active":"2024-06-13T11:18:42.906657+0000","last_became_peered":"2024-06-13T11:18:42.906657+0000","last_unstale":"2024-06-13T11:23:46.315378+0000","last_undegraded":"2024-06-13T11:23:46.315378+0000","last_fullsized":"2024-06-13T11:23:46.315378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:30:36.414377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.293882+0000","last_change":"2024-06-13T11:18:57.007226+0000","last_active":"2024-06-13T11:23:46.293882+0000","last_peered":"2024-06-13T11:23:46.293882+0000","last_clean":"2024-06-13T11:23:46.293882+0000","last_became_active":"2024-06-13T11:18:57.006803+0000","last_became_peered":"2024-06-13T11:18:57.006803+0000","last_unstale":"2024-06-13T11:23:46.293882+0000","last_undegraded":"2024-06-13T11:23:46.293882+0000","last_fullsized":"2024-06-13T11:23:46.293882+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:08:28.913145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.147156+0000","last_change":"2024-06-13T11:18:38.173327+0000","last_active":"2024-06-13T11:23:46.147156+0000","last_peered":"2024-06-13T11:23:46.147156+0000","last_clean":"2024-06-13T11:23:46.147156+0000","last_became_active":"2024-06-13T11:18:38.172786+0000","last_became_peered":"2024-06-13T11:18:38.172786+0000","last_unstale":"2024-06-13T11:23:46.147156+0000","last_undegraded":"2024-06-13T11:23:46.147156+0000","last_fullsized":"2024-06-13T11:23:46.147156+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:40:30.330272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315687+0000","last_change":"2024-06-13T11:18:42.899816+0000","last_active":"2024-06-13T11:23:46.315687+0000","last_peered":"2024-06-13T11:23:46.315687+0000","last_clean":"2024-06-13T11:23:46.315687+0000","last_became_active":"2024-06-13T11:18:42.899495+0000","last_became_peered":"2024-06-13T11:18:42.899495+0000","last_unstale":"2024-06-13T11:23:46.315687+0000","last_undegraded":"2024-06-13T11:23:46.315687+0000","last_fullsized":"2024-06-13T11:23:46.315687+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:16:08.303616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314711+0000","last_change":"2024-06-13T11:18:42.909944+0000","last_active":"2024-06-13T11:23:46.314711+0000","last_peered":"2024-06-13T11:23:46.314711+0000","last_clean":"2024-06-13T11:23:46.314711+0000","last_became_active":"2024-06-13T11:18:42.909557+0000","last_became_peered":"2024-06-13T11:18:42.909557+0000","last_unstale":"2024-06-13T11:23:46.314711+0000","last_undegraded":"2024-06-13T11:23:46.314711+0000","last_fullsized":"2024-06-13T11:23:46.314711+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:22:07.093462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"99'12","reported_seq":54,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144039+0000","last_change":"2024-06-13T11:18:42.912462+0000","last_active":"2024-06-13T11:23:46.144039+0000","last_peered":"2024-06-13T11:23:46.144039+0000","last_clean":"2024-06-13T11:23:46.144039+0000","last_became_active":"2024-06-13T11:18:42.912110+0000","last_became_peered":"2024-06-13T11:18:42.912110+0000","last_unstale":"2024-06-13T11:23:46.144039+0000","last_undegraded":"2024-06-13T11:23:46.144039+0000","last_fullsized":"2024-06-13T11:23:46.144039+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:11:33.123305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.143829+0000","last_change":"2024-06-13T11:18:42.924224+0000","last_active":"2024-06-13T11:23:46.143829+0000","last_peered":"2024-06-13T11:23:46.143829+0000","last_clean":"2024-06-13T11:23:46.143829+0000","last_became_active":"2024-06-13T11:18:42.923858+0000","last_became_peered":"2024-06-13T11:18:42.923858+0000","last_unstale":"2024-06-13T11:23:46.143829+0000","last_undegraded":"2024-06-13T11:23:46.143829+0000","last_fullsized":"2024-06-13T11:23:46.143829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:36:11.602930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315807+0000","last_change":"2024-06-13T11:18:42.921160+0000","last_active":"2024-06-13T11:23:46.315807+0000","last_peered":"2024-06-13T11:23:46.315807+0000","last_clean":"2024-06-13T11:23:46.315807+0000","last_became_active":"2024-06-13T11:18:42.920704+0000","last_became_peered":"2024-06-13T11:18:42.920704+0000","last_unstale":"2024-06-13T11:23:46.315807+0000","last_undegraded":"2024-06-13T11:23:46.315807+0000","last_fullsized":"2024-06-13T11:23:46.315807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:07:17.023390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"99'4","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146212+0000","last_change":"2024-06-13T11:18:42.923637+0000","last_active":"2024-06-13T11:23:46.146212+0000","last_peered":"2024-06-13T11:23:46.146212+0000","last_clean":"2024-06-13T11:23:46.146212+0000","last_became_active":"2024-06-13T11:18:42.923234+0000","last_became_peered":"2024-06-13T11:18:42.923234+0000","last_unstale":"2024-06-13T11:23:46.146212+0000","last_undegraded":"2024-06-13T11:23:46.146212+0000","last_fullsized":"2024-06-13T11:23:46.146212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:51:19.676747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314932+0000","last_change":"2024-06-13T11:18:42.910300+0000","last_active":"2024-06-13T11:23:46.314932+0000","last_peered":"2024-06-13T11:23:46.314932+0000","last_clean":"2024-06-13T11:23:46.314932+0000","last_became_active":"2024-06-13T11:18:42.909937+0000","last_became_peered":"2024-06-13T11:18:42.909937+0000","last_unstale":"2024-06-13T11:23:46.314932+0000","last_undegraded":"2024-06-13T11:23:46.314932+0000","last_fullsized":"2024-06-13T11:23:46.314932+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:24:51.407238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"99'15","reported_seq":57,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144370+0000","last_change":"2024-06-13T11:18:42.907066+0000","last_active":"2024-06-13T11:23:46.144370+0000","last_peered":"2024-06-13T11:23:46.144370+0000","last_clean":"2024-06-13T11:23:46.144370+0000","last_became_active":"2024-06-13T11:18:42.906582+0000","last_became_peered":"2024-06-13T11:18:42.906582+0000","last_unstale":"2024-06-13T11:23:46.144370+0000","last_undegraded":"2024-06-13T11:23:46.144370+0000","last_fullsized":"2024-06-13T11:23:46.144370+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:40:02.549931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"99'2","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.286447+0000","last_change":"2024-06-13T11:18:42.910290+0000","last_active":"2024-06-13T11:23:46.286447+0000","last_peered":"2024-06-13T11:23:46.286447+0000","last_clean":"2024-06-13T11:23:46.286447+0000","last_became_active":"2024-06-13T11:18:42.909772+0000","last_became_peered":"2024-06-13T11:18:42.909772+0000","last_unstale":"2024-06-13T11:23:46.286447+0000","last_undegraded":"2024-06-13T11:23:46.286447+0000","last_fullsized":"2024-06-13T11:23:46.286447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:05:56.008087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294008+0000","last_change":"2024-06-13T11:18:42.928792+0000","last_active":"2024-06-13T11:23:46.294008+0000","last_peered":"2024-06-13T11:23:46.294008+0000","last_clean":"2024-06-13T11:23:46.294008+0000","last_became_active":"2024-06-13T11:18:42.928464+0000","last_became_peered":"2024-06-13T11:18:42.928464+0000","last_unstale":"2024-06-13T11:23:46.294008+0000","last_undegraded":"2024-06-13T11:23:46.294008+0000","last_fullsized":"2024-06-13T11:23:46.294008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:01:58.686124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.284295+0000","last_change":"2024-06-13T11:18:42.920719+0000","last_active":"2024-06-13T11:23:46.284295+0000","last_peered":"2024-06-13T11:23:46.284295+0000","last_clean":"2024-06-13T11:23:46.284295+0000","last_became_active":"2024-06-13T11:18:42.913355+0000","last_became_peered":"2024-06-13T11:18:42.913355+0000","last_unstale":"2024-06-13T11:23:46.284295+0000","last_undegraded":"2024-06-13T11:23:46.284295+0000","last_fullsized":"2024-06-13T11:23:46.284295+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:25:00.020936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"99'10","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300352+0000","last_change":"2024-06-13T11:18:42.906709+0000","last_active":"2024-06-13T11:23:46.300352+0000","last_peered":"2024-06-13T11:23:46.300352+0000","last_clean":"2024-06-13T11:23:46.300352+0000","last_became_active":"2024-06-13T11:18:42.906309+0000","last_became_peered":"2024-06-13T11:18:42.906309+0000","last_unstale":"2024-06-13T11:23:46.300352+0000","last_undegraded":"2024-06-13T11:23:46.300352+0000","last_fullsized":"2024-06-13T11:23:46.300352+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:09.255670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"99'11","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.147337+0000","last_change":"2024-06-13T11:18:42.926939+0000","last_active":"2024-06-13T11:23:46.147337+0000","last_peered":"2024-06-13T11:23:46.147337+0000","last_clean":"2024-06-13T11:23:46.147337+0000","last_became_active":"2024-06-13T11:18:42.926616+0000","last_became_peered":"2024-06-13T11:18:42.926616+0000","last_unstale":"2024-06-13T11:23:46.147337+0000","last_undegraded":"2024-06-13T11:23:46.147337+0000","last_fullsized":"2024-06-13T11:23:46.147337+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:52:46.468479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314868+0000","last_change":"2024-06-13T11:18:42.901103+0000","last_active":"2024-06-13T11:23:46.314868+0000","last_peered":"2024-06-13T11:23:46.314868+0000","last_clean":"2024-06-13T11:23:46.314868+0000","last_became_active":"2024-06-13T11:18:42.900726+0000","last_became_peered":"2024-06-13T11:18:42.900726+0000","last_unstale":"2024-06-13T11:23:46.314868+0000","last_undegraded":"2024-06-13T11:23:46.314868+0000","last_fullsized":"2024-06-13T11:23:46.314868+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:55.895451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108816,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600135,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1430,"num_read_kb":828,"num_write":297,"num_write_kb":1446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":1800405,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383758,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1105920,"data_stored":579495,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645393,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36584,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708568,"statfs":{"total":95995035648,"available":95957573632,"internally_reserved":0,"allocated":1277952,"data_stored":1369151,"data_compressed":77941,"data_compressed_allocated":102400,"data_compressed_original":811008,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808919,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1150976,"data_stored":977043,"data_compressed":54659,"data_compressed_allocated":73728,"data_compressed_original":491520,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070558,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1146880,"data_stored":972867,"data_compressed":54659,"data_compressed_allocated":73728,"data_compressed_original":491520,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332195,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1171456,"data_stored":1177011,"data_compressed":71785,"data_compressed_allocated":94208,"data_compressed_original":688128,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495722,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32256,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712896,"statfs":{"total":95995035648,"available":95962005504,"internally_reserved":0,"allocated":1101824,"data_stored":574907,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32328,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712824,"statfs":{"total":95995035648,"available":95961931776,"internally_reserved":0,"allocated":1175552,"data_stored":644294,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738507,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1126400,"data_stored":576295,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36512,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708640,"statfs":{"total":95995035648,"available":95957647360,"internally_reserved":0,"allocated":1200128,"data_stored":646955,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182521,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1159168,"data_stored":1099917,"data_compressed":60815,"data_compressed_allocated":81920,"data_compressed_original":614400,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920884,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1114112,"data_stored":580478,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757360,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36508,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708644,"statfs":{"total":95995035648,"available":95957651456,"internally_reserved":0,"allocated":1200128,"data_stored":1303278,"data_compressed":77941,"data_compressed_allocated":102400,"data_compressed_original":811008,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":72138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":133997,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":393954,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":203966,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T11:23:52.069 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-06-13T11:23:52.069 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-13T11:23:52.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.301+0000 7f2547600640 1 -- 172.21.15.2:0/3254425652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25401002f0 msgr2=0x7f2540100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:52.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.301+0000 7f2547600640 1 --2- 172.21.15.2:0/3254425652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25401002f0 0x7f2540100710 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2534009900 tx=0x7f253402a480 comp rx=0 tx=0).stop 2024-06-13T11:23:52.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.301+0000 7f2547600640 1 -- 172.21.15.2:0/3254425652 shutdown_connections 2024-06-13T11:23:52.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.301+0000 7f2547600640 1 --2- 172.21.15.2:0/3254425652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25401015f0 0x7f2540101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.301+0000 7f2547600640 1 --2- 172.21.15.2:0/3254425652 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2540100c50 0x7f25401010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.301+0000 7f2547600640 1 --2- 172.21.15.2:0/3254425652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25401002f0 0x7f2540100710 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.301+0000 7f2547600640 1 -- 172.21.15.2:0/3254425652 >> 172.21.15.2:0/3254425652 conn(0x7f25400fbe70 msgr2=0x7f25400fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:52.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.301+0000 7f2547600640 1 -- 172.21.15.2:0/3254425652 shutdown_connections 2024-06-13T11:23:52.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.301+0000 7f2547600640 1 -- 172.21.15.2:0/3254425652 wait complete. 2024-06-13T11:23:52.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.302+0000 7f2547600640 1 Processor -- start 2024-06-13T11:23:52.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.302+0000 7f2547600640 1 -- start start 2024-06-13T11:23:52.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.303+0000 7f2547600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25401002f0 0x7f2540199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:52.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.303+0000 7f2547600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2540100c50 0x7f254019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:52.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.303+0000 7f2547600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25401015f0 0x7f25401a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:52.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.303+0000 7f2547600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f254010f8c0 con 0x7f25401015f0 2024-06-13T11:23:52.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.303+0000 7f2547600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f254010f740 con 0x7f25401002f0 2024-06-13T11:23:52.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.303+0000 7f2547600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f254010fa40 con 0x7f2540100c50 2024-06-13T11:23:52.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.303+0000 7f253fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2540100c50 0x7f254019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:52.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.303+0000 7f2544c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25401002f0 0x7f2540199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:52.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.303+0000 7f253fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2540100c50 0x7f254019a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:37540/0 (socket says 172.21.15.2:37540) 2024-06-13T11:23:52.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.303+0000 7f253fe00640 1 -- 172.21.15.2:0/3877516126 learned_addr learned my addr 172.21.15.2:0/3877516126 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:52.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.303+0000 7f2545600640 1 --2- 172.21.15.2:0/3877516126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25401015f0 0x7f25401a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:52.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.304+0000 7f253fe00640 1 -- 172.21.15.2:0/3877516126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25401002f0 msgr2=0x7f2540199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:52.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.304+0000 7f253fe00640 1 --2- 172.21.15.2:0/3877516126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25401002f0 0x7f2540199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.304+0000 7f253fe00640 1 -- 172.21.15.2:0/3877516126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25401015f0 msgr2=0x7f25401a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:52.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.304+0000 7f253fe00640 1 --2- 172.21.15.2:0/3877516126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25401015f0 0x7f25401a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.304+0000 7f253fe00640 1 -- 172.21.15.2:0/3877516126 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25401a1ae0 con 0x7f2540100c50 2024-06-13T11:23:52.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.304+0000 7f253fe00640 1 --2- 172.21.15.2:0/3877516126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2540100c50 0x7f254019a400 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f252c00e9f0 tx=0x7f252c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:52.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.304+0000 7f253d600640 1 -- 172.21.15.2:0/3877516126 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c00cd80 con 0x7f2540100c50 2024-06-13T11:23:52.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.304+0000 7f253d600640 1 -- 172.21.15.2:0/3877516126 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f252c010910 con 0x7f2540100c50 2024-06-13T11:23:52.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.304+0000 7f2547600640 1 -- 172.21.15.2:0/3877516126 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25401a1dd0 con 0x7f2540100c50 2024-06-13T11:23:52.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.305+0000 7f253d600640 1 -- 172.21.15.2:0/3877516126 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c018990 con 0x7f2540100c50 2024-06-13T11:23:52.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.305+0000 7f2547600640 1 -- 172.21.15.2:0/3877516126 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25401a22e0 con 0x7f2540100c50 2024-06-13T11:23:52.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.306+0000 7f2547600640 1 -- 172.21.15.2:0/3877516126 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f254010b040 con 0x7f2540100c50 2024-06-13T11:23:52.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.311+0000 7f253d600640 1 -- 172.21.15.2:0/3877516126 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7f252c010ac0 con 0x7f2540100c50 2024-06-13T11:23:52.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.312+0000 7f253d600640 1 --2- 172.21.15.2:0/3877516126 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f25280a2e10 0x7f25280a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:52.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.312+0000 7f253d600640 1 -- 172.21.15.2:0/3877516126 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f252c0cfcf0 con 0x7f2540100c50 2024-06-13T11:23:52.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.313+0000 7f2544c00640 1 --2- 172.21.15.2:0/3877516126 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f25280a2e10 0x7f25280a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:52.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.313+0000 7f2544c00640 1 --2- 172.21.15.2:0/3877516126 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f25280a2e10 0x7f25280a52d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2534031440 tx=0x7f25340315b0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:52.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.317+0000 7f253d600640 1 -- 172.21.15.2:0/3877516126 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f252c09c3d0 con 0x7f2540100c50 2024-06-13T11:23:52.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.512+0000 7f2547600640 1 -- 172.21.15.2:0/3877516126 --> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2540061de0 con 0x7f25280a2e10 2024-06-13T11:23:52.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.539+0000 7f253d600640 1 -- 172.21.15.2:0/3877516126 <== mgr.25150 v2:172.21.15.2:6800/606530635 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339849 (secure 0 0 0) 0x7f2540061de0 con 0x7f25280a2e10 2024-06-13T11:23:52.543 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:23:52.546 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-06-13T11:23:52.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.547+0000 7f2547600640 1 -- 172.21.15.2:0/3877516126 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f25280a2e10 msgr2=0x7f25280a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:52.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.547+0000 7f2547600640 1 --2- 172.21.15.2:0/3877516126 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f25280a2e10 0x7f25280a52d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2534031440 tx=0x7f25340315b0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.547+0000 7f2547600640 1 -- 172.21.15.2:0/3877516126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2540100c50 msgr2=0x7f254019a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:52.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.547+0000 7f2547600640 1 --2- 172.21.15.2:0/3877516126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2540100c50 0x7f254019a400 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f252c00e9f0 tx=0x7f252c00eeb0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.547+0000 7f2547600640 1 -- 172.21.15.2:0/3877516126 shutdown_connections 2024-06-13T11:23:52.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.547+0000 7f2547600640 1 --2- 172.21.15.2:0/3877516126 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f25280a2e10 0x7f25280a52d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.547+0000 7f2547600640 1 --2- 172.21.15.2:0/3877516126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2540100c50 0x7f254019a400 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.547+0000 7f2547600640 1 --2- 172.21.15.2:0/3877516126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25401015f0 0x7f25401a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.547+0000 7f2547600640 1 --2- 172.21.15.2:0/3877516126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25401002f0 0x7f2540199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:52.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.547+0000 7f2547600640 1 -- 172.21.15.2:0/3877516126 >> 172.21.15.2:0/3877516126 conn(0x7f25400fbe70 msgr2=0x7f25400fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:52.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.548+0000 7f2547600640 1 -- 172.21.15.2:0/3877516126 shutdown_connections 2024-06-13T11:23:52.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:52.548+0000 7f2547600640 1 -- 172.21.15.2:0/3877516126 wait complete. 2024-06-13T11:23:52.568 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-06-13T11:23:52.166678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1190737,"num_objects":66,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1571,"num_read_kb":947,"num_write":480,"num_write_kb":4386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":873,"ondisk_log_size":873,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391908,"kb_used_data":13604,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124549916,"statfs":{"total":1151940427776,"available":1151539113984,"internally_reserved":0,"allocated":13930496,"data_stored":10501691,"data_compressed":610878,"data_compressed_allocated":823296,"data_compressed_original":4497408,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.986284"},"pg_stats":[{"pgid":"3.3f","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315200+0000","last_change":"2024-06-13T11:18:42.925351+0000","last_active":"2024-06-13T11:23:46.315200+0000","last_peered":"2024-06-13T11:23:46.315200+0000","last_clean":"2024-06-13T11:23:46.315200+0000","last_became_active":"2024-06-13T11:18:42.924971+0000","last_became_peered":"2024-06-13T11:18:42.924971+0000","last_unstale":"2024-06-13T11:23:46.315200+0000","last_undegraded":"2024-06-13T11:23:46.315200+0000","last_fullsized":"2024-06-13T11:23:46.315200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:33:49.563311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"99'4","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.316155+0000","last_change":"2024-06-13T11:18:42.923771+0000","last_active":"2024-06-13T11:23:46.316155+0000","last_peered":"2024-06-13T11:23:46.316155+0000","last_clean":"2024-06-13T11:23:46.316155+0000","last_became_active":"2024-06-13T11:18:42.918410+0000","last_became_peered":"2024-06-13T11:18:42.918410+0000","last_unstale":"2024-06-13T11:23:46.316155+0000","last_undegraded":"2024-06-13T11:23:46.316155+0000","last_fullsized":"2024-06-13T11:23:46.316155+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:11:28.256622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315856+0000","last_change":"2024-06-13T11:18:42.919502+0000","last_active":"2024-06-13T11:23:46.315856+0000","last_peered":"2024-06-13T11:23:46.315856+0000","last_clean":"2024-06-13T11:23:46.315856+0000","last_became_active":"2024-06-13T11:18:42.915747+0000","last_became_peered":"2024-06-13T11:18:42.915747+0000","last_unstale":"2024-06-13T11:23:46.315856+0000","last_undegraded":"2024-06-13T11:23:46.315856+0000","last_fullsized":"2024-06-13T11:23:46.315856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:39:23.555604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315264+0000","last_change":"2024-06-13T11:18:42.905944+0000","last_active":"2024-06-13T11:23:46.315264+0000","last_peered":"2024-06-13T11:23:46.315264+0000","last_clean":"2024-06-13T11:23:46.315264+0000","last_became_active":"2024-06-13T11:18:42.905494+0000","last_became_peered":"2024-06-13T11:18:42.905494+0000","last_unstale":"2024-06-13T11:23:46.315264+0000","last_undegraded":"2024-06-13T11:23:46.315264+0000","last_fullsized":"2024-06-13T11:23:46.315264+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:26:44.396593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"99'4","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283230+0000","last_change":"2024-06-13T11:18:42.924212+0000","last_active":"2024-06-13T11:23:46.283230+0000","last_peered":"2024-06-13T11:23:46.283230+0000","last_clean":"2024-06-13T11:23:46.283230+0000","last_became_active":"2024-06-13T11:18:42.923848+0000","last_became_peered":"2024-06-13T11:18:42.923848+0000","last_unstale":"2024-06-13T11:23:46.283230+0000","last_undegraded":"2024-06-13T11:23:46.283230+0000","last_fullsized":"2024-06-13T11:23:46.283230+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:24:01.754609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.298058+0000","last_change":"2024-06-13T11:18:42.915283+0000","last_active":"2024-06-13T11:23:46.298058+0000","last_peered":"2024-06-13T11:23:46.298058+0000","last_clean":"2024-06-13T11:23:46.298058+0000","last_became_active":"2024-06-13T11:18:42.914921+0000","last_became_peered":"2024-06-13T11:18:42.914921+0000","last_unstale":"2024-06-13T11:23:46.298058+0000","last_undegraded":"2024-06-13T11:23:46.298058+0000","last_fullsized":"2024-06-13T11:23:46.298058+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:48:42.116314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"99'5","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315332+0000","last_change":"2024-06-13T11:18:42.911614+0000","last_active":"2024-06-13T11:23:46.315332+0000","last_peered":"2024-06-13T11:23:46.315332+0000","last_clean":"2024-06-13T11:23:46.315332+0000","last_became_active":"2024-06-13T11:18:42.911360+0000","last_became_peered":"2024-06-13T11:18:42.911360+0000","last_unstale":"2024-06-13T11:23:46.315332+0000","last_undegraded":"2024-06-13T11:23:46.315332+0000","last_fullsized":"2024-06-13T11:23:46.315332+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:23:55.161725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"99'9","reported_seq":27,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.150483+0000","last_change":"2024-06-13T11:19:27.074801+0000","last_active":"2024-06-13T11:23:46.150483+0000","last_peered":"2024-06-13T11:23:46.150483+0000","last_clean":"2024-06-13T11:23:46.150483+0000","last_became_active":"2024-06-13T11:19:27.072783+0000","last_became_peered":"2024-06-13T11:19:27.072783+0000","last_unstale":"2024-06-13T11:23:46.150483+0000","last_undegraded":"2024-06-13T11:23:46.150483+0000","last_fullsized":"2024-06-13T11:23:46.150483+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:06:34.658008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"99'11","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300678+0000","last_change":"2024-06-13T11:18:42.913482+0000","last_active":"2024-06-13T11:23:46.300678+0000","last_peered":"2024-06-13T11:23:46.300678+0000","last_clean":"2024-06-13T11:23:46.300678+0000","last_became_active":"2024-06-13T11:18:42.912700+0000","last_became_peered":"2024-06-13T11:18:42.912700+0000","last_unstale":"2024-06-13T11:23:46.300678+0000","last_undegraded":"2024-06-13T11:23:46.300678+0000","last_fullsized":"2024-06-13T11:23:46.300678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:38:42.053801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"99'16","reported_seq":58,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.298539+0000","last_change":"2024-06-13T11:18:42.905824+0000","last_active":"2024-06-13T11:23:46.298539+0000","last_peered":"2024-06-13T11:23:46.298539+0000","last_clean":"2024-06-13T11:23:46.298539+0000","last_became_active":"2024-06-13T11:18:42.905443+0000","last_became_peered":"2024-06-13T11:18:42.905443+0000","last_unstale":"2024-06-13T11:23:46.298539+0000","last_undegraded":"2024-06-13T11:23:46.298539+0000","last_fullsized":"2024-06-13T11:23:46.298539+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:51:46.957656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315564+0000","last_change":"2024-06-13T11:18:42.901987+0000","last_active":"2024-06-13T11:23:46.315564+0000","last_peered":"2024-06-13T11:23:46.315564+0000","last_clean":"2024-06-13T11:23:46.315564+0000","last_became_active":"2024-06-13T11:18:42.901641+0000","last_became_peered":"2024-06-13T11:18:42.901641+0000","last_unstale":"2024-06-13T11:23:46.315564+0000","last_undegraded":"2024-06-13T11:23:46.315564+0000","last_fullsized":"2024-06-13T11:23:46.315564+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:52:29.036172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315230+0000","last_change":"2024-06-13T11:18:42.899161+0000","last_active":"2024-06-13T11:23:46.315230+0000","last_peered":"2024-06-13T11:23:46.315230+0000","last_clean":"2024-06-13T11:23:46.315230+0000","last_became_active":"2024-06-13T11:18:42.898823+0000","last_became_peered":"2024-06-13T11:18:42.898823+0000","last_unstale":"2024-06-13T11:23:46.315230+0000","last_undegraded":"2024-06-13T11:23:46.315230+0000","last_fullsized":"2024-06-13T11:23:46.315230+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:21:20.968759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"99'10","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146793+0000","last_change":"2024-06-13T11:18:42.908954+0000","last_active":"2024-06-13T11:23:46.146793+0000","last_peered":"2024-06-13T11:23:46.146793+0000","last_clean":"2024-06-13T11:23:46.146793+0000","last_became_active":"2024-06-13T11:18:42.908604+0000","last_became_peered":"2024-06-13T11:18:42.908604+0000","last_unstale":"2024-06-13T11:23:46.146793+0000","last_undegraded":"2024-06-13T11:23:46.146793+0000","last_fullsized":"2024-06-13T11:23:46.146793+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:00:30.662233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315379+0000","last_change":"2024-06-13T11:18:42.925374+0000","last_active":"2024-06-13T11:23:46.315379+0000","last_peered":"2024-06-13T11:23:46.315379+0000","last_clean":"2024-06-13T11:23:46.315379+0000","last_became_active":"2024-06-13T11:18:42.924624+0000","last_became_peered":"2024-06-13T11:18:42.924624+0000","last_unstale":"2024-06-13T11:23:46.315379+0000","last_undegraded":"2024-06-13T11:23:46.315379+0000","last_fullsized":"2024-06-13T11:23:46.315379+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:07.989887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315538+0000","last_change":"2024-06-13T11:18:42.924457+0000","last_active":"2024-06-13T11:23:46.315538+0000","last_peered":"2024-06-13T11:23:46.315538+0000","last_clean":"2024-06-13T11:23:46.315538+0000","last_became_active":"2024-06-13T11:18:42.922641+0000","last_became_peered":"2024-06-13T11:18:42.922641+0000","last_unstale":"2024-06-13T11:23:46.315538+0000","last_undegraded":"2024-06-13T11:23:46.315538+0000","last_fullsized":"2024-06-13T11:23:46.315538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:52:56.769565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.299922+0000","last_change":"2024-06-13T11:18:42.925333+0000","last_active":"2024-06-13T11:23:46.299922+0000","last_peered":"2024-06-13T11:23:46.299922+0000","last_clean":"2024-06-13T11:23:46.299922+0000","last_became_active":"2024-06-13T11:18:42.924854+0000","last_became_peered":"2024-06-13T11:18:42.924854+0000","last_unstale":"2024-06-13T11:23:46.299922+0000","last_undegraded":"2024-06-13T11:23:46.299922+0000","last_fullsized":"2024-06-13T11:23:46.299922+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:30:38.554616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314964+0000","last_change":"2024-06-13T11:18:42.926652+0000","last_active":"2024-06-13T11:23:46.314964+0000","last_peered":"2024-06-13T11:23:46.314964+0000","last_clean":"2024-06-13T11:23:46.314964+0000","last_became_active":"2024-06-13T11:18:42.926281+0000","last_became_peered":"2024-06-13T11:18:42.926281+0000","last_unstale":"2024-06-13T11:23:46.314964+0000","last_undegraded":"2024-06-13T11:23:46.314964+0000","last_fullsized":"2024-06-13T11:23:46.314964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:50:50.483047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"99'10","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151530+0000","last_change":"2024-06-13T11:18:42.917743+0000","last_active":"2024-06-13T11:23:46.151530+0000","last_peered":"2024-06-13T11:23:46.151530+0000","last_clean":"2024-06-13T11:23:46.151530+0000","last_became_active":"2024-06-13T11:18:42.916473+0000","last_became_peered":"2024-06-13T11:18:42.916473+0000","last_unstale":"2024-06-13T11:23:46.151530+0000","last_undegraded":"2024-06-13T11:23:46.151530+0000","last_fullsized":"2024-06-13T11:23:46.151530+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:20:12.909524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144409+0000","last_change":"2024-06-13T11:18:42.930712+0000","last_active":"2024-06-13T11:23:46.144409+0000","last_peered":"2024-06-13T11:23:46.144409+0000","last_clean":"2024-06-13T11:23:46.144409+0000","last_became_active":"2024-06-13T11:18:42.930446+0000","last_became_peered":"2024-06-13T11:18:42.930446+0000","last_unstale":"2024-06-13T11:23:46.144409+0000","last_undegraded":"2024-06-13T11:23:46.144409+0000","last_fullsized":"2024-06-13T11:23:46.144409+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:08:28.729916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.143999+0000","last_change":"2024-06-13T11:18:57.027006+0000","last_active":"2024-06-13T11:23:46.143999+0000","last_peered":"2024-06-13T11:23:46.143999+0000","last_clean":"2024-06-13T11:23:46.143999+0000","last_became_active":"2024-06-13T11:18:57.026562+0000","last_became_peered":"2024-06-13T11:18:57.026562+0000","last_unstale":"2024-06-13T11:23:46.143999+0000","last_undegraded":"2024-06-13T11:23:46.143999+0000","last_fullsized":"2024-06-13T11:23:46.143999+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:17:32.180729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"97'9","reported_seq":58,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151833+0000","last_change":"2024-06-13T11:18:38.172704+0000","last_active":"2024-06-13T11:23:46.151833+0000","last_peered":"2024-06-13T11:23:46.151833+0000","last_clean":"2024-06-13T11:23:46.151833+0000","last_became_active":"2024-06-13T11:18:38.172125+0000","last_became_peered":"2024-06-13T11:18:38.172125+0000","last_unstale":"2024-06-13T11:23:46.151833+0000","last_undegraded":"2024-06-13T11:23:46.151833+0000","last_fullsized":"2024-06-13T11:23:46.151833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:40:52.578805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"99'5","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.286600+0000","last_change":"2024-06-13T11:18:42.922864+0000","last_active":"2024-06-13T11:23:46.286600+0000","last_peered":"2024-06-13T11:23:46.286600+0000","last_clean":"2024-06-13T11:23:46.286600+0000","last_became_active":"2024-06-13T11:18:42.921283+0000","last_became_peered":"2024-06-13T11:18:42.921283+0000","last_unstale":"2024-06-13T11:23:46.286600+0000","last_undegraded":"2024-06-13T11:23:46.286600+0000","last_fullsized":"2024-06-13T11:23:46.286600+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:44.421502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314841+0000","last_change":"2024-06-13T11:20:27.904814+0000","last_active":"2024-06-13T11:23:46.314841+0000","last_peered":"2024-06-13T11:23:46.314841+0000","last_clean":"2024-06-13T11:23:46.314841+0000","last_became_active":"2024-06-13T11:20:27.904342+0000","last_became_peered":"2024-06-13T11:20:27.904342+0000","last_unstale":"2024-06-13T11:23:46.314841+0000","last_undegraded":"2024-06-13T11:23:46.314841+0000","last_fullsized":"2024-06-13T11:23:46.314841+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:45:59.215429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,10,3],"acting":[4,6,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.286095+0000","last_change":"2024-06-13T11:18:38.483021+0000","last_active":"2024-06-13T11:23:46.286095+0000","last_peered":"2024-06-13T11:23:46.286095+0000","last_clean":"2024-06-13T11:23:46.286095+0000","last_became_active":"2024-06-13T11:18:38.482594+0000","last_became_peered":"2024-06-13T11:18:38.482594+0000","last_unstale":"2024-06-13T11:23:46.286095+0000","last_undegraded":"2024-06-13T11:23:46.286095+0000","last_fullsized":"2024-06-13T11:23:46.286095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:27:07.660961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315949+0000","last_change":"2024-06-13T11:18:42.926272+0000","last_active":"2024-06-13T11:23:46.315949+0000","last_peered":"2024-06-13T11:23:46.315949+0000","last_clean":"2024-06-13T11:23:46.315949+0000","last_became_active":"2024-06-13T11:18:42.925864+0000","last_became_peered":"2024-06-13T11:18:42.925864+0000","last_unstale":"2024-06-13T11:23:46.315949+0000","last_undegraded":"2024-06-13T11:23:46.315949+0000","last_fullsized":"2024-06-13T11:23:46.315949+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:51:59.562266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":31,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314909+0000","last_change":"2024-06-13T11:18:57.033152+0000","last_active":"2024-06-13T11:23:46.314909+0000","last_peered":"2024-06-13T11:23:46.314909+0000","last_clean":"2024-06-13T11:23:46.314909+0000","last_became_active":"2024-06-13T11:18:57.032696+0000","last_became_peered":"2024-06-13T11:18:57.032696+0000","last_unstale":"2024-06-13T11:23:46.314909+0000","last_undegraded":"2024-06-13T11:23:46.314909+0000","last_fullsized":"2024-06-13T11:23:46.314909+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:59:20.584476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'4","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283684+0000","last_change":"2024-06-13T11:18:38.168246+0000","last_active":"2024-06-13T11:23:46.283684+0000","last_peered":"2024-06-13T11:23:46.283684+0000","last_clean":"2024-06-13T11:23:46.283684+0000","last_became_active":"2024-06-13T11:18:38.167918+0000","last_became_peered":"2024-06-13T11:18:38.167918+0000","last_unstale":"2024-06-13T11:23:46.283684+0000","last_undegraded":"2024-06-13T11:23:46.283684+0000","last_fullsized":"2024-06-13T11:23:46.283684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:23:39.079356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300375+0000","last_change":"2024-06-13T11:18:42.901291+0000","last_active":"2024-06-13T11:23:46.300375+0000","last_peered":"2024-06-13T11:23:46.300375+0000","last_clean":"2024-06-13T11:23:46.300375+0000","last_became_active":"2024-06-13T11:18:42.900990+0000","last_became_peered":"2024-06-13T11:18:42.900990+0000","last_unstale":"2024-06-13T11:23:46.300375+0000","last_undegraded":"2024-06-13T11:23:46.300375+0000","last_fullsized":"2024-06-13T11:23:46.300375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:59:03.521767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314782+0000","last_change":"2024-06-13T11:20:27.905640+0000","last_active":"2024-06-13T11:23:46.314782+0000","last_peered":"2024-06-13T11:23:46.314782+0000","last_clean":"2024-06-13T11:23:46.314782+0000","last_became_active":"2024-06-13T11:20:27.905149+0000","last_became_peered":"2024-06-13T11:20:27.905149+0000","last_unstale":"2024-06-13T11:23:46.314782+0000","last_undegraded":"2024-06-13T11:23:46.314782+0000","last_fullsized":"2024-06-13T11:23:46.314782+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:24:14.702582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283529+0000","last_change":"2024-06-13T11:18:38.170301+0000","last_active":"2024-06-13T11:23:46.283529+0000","last_peered":"2024-06-13T11:23:46.283529+0000","last_clean":"2024-06-13T11:23:46.283529+0000","last_became_active":"2024-06-13T11:18:38.169926+0000","last_became_peered":"2024-06-13T11:18:38.169926+0000","last_unstale":"2024-06-13T11:23:46.283529+0000","last_undegraded":"2024-06-13T11:23:46.283529+0000","last_fullsized":"2024-06-13T11:23:46.283529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:02:02.877638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"99'15","reported_seq":57,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294616+0000","last_change":"2024-06-13T11:18:42.907869+0000","last_active":"2024-06-13T11:23:46.294616+0000","last_peered":"2024-06-13T11:23:46.294616+0000","last_clean":"2024-06-13T11:23:46.294616+0000","last_became_active":"2024-06-13T11:18:42.907349+0000","last_became_peered":"2024-06-13T11:18:42.907349+0000","last_unstale":"2024-06-13T11:23:46.294616+0000","last_undegraded":"2024-06-13T11:23:46.294616+0000","last_fullsized":"2024-06-13T11:23:46.294616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:54:33.745326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":31,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144114+0000","last_change":"2024-06-13T11:18:57.009598+0000","last_active":"2024-06-13T11:23:46.144114+0000","last_peered":"2024-06-13T11:23:46.144114+0000","last_clean":"2024-06-13T11:23:46.144114+0000","last_became_active":"2024-06-13T11:18:57.009186+0000","last_became_peered":"2024-06-13T11:18:57.009186+0000","last_unstale":"2024-06-13T11:23:46.144114+0000","last_undegraded":"2024-06-13T11:23:46.144114+0000","last_fullsized":"2024-06-13T11:23:46.144114+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:41:46.784749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"100'8","reported_seq":278,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.753339+0000","last_change":"2024-06-13T11:18:38.167060+0000","last_active":"2024-06-13T11:23:46.753339+0000","last_peered":"2024-06-13T11:23:46.753339+0000","last_clean":"2024-06-13T11:23:46.753339+0000","last_became_active":"2024-06-13T11:18:38.166704+0000","last_became_peered":"2024-06-13T11:18:38.166704+0000","last_unstale":"2024-06-13T11:23:46.753339+0000","last_undegraded":"2024-06-13T11:23:46.753339+0000","last_fullsized":"2024-06-13T11:23:46.753339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:30:51.754276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1543,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":222,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283148+0000","last_change":"2024-06-13T11:18:42.915361+0000","last_active":"2024-06-13T11:23:46.283148+0000","last_peered":"2024-06-13T11:23:46.283148+0000","last_clean":"2024-06-13T11:23:46.283148+0000","last_became_active":"2024-06-13T11:18:42.914977+0000","last_became_peered":"2024-06-13T11:18:42.914977+0000","last_unstale":"2024-06-13T11:23:46.283148+0000","last_undegraded":"2024-06-13T11:23:46.283148+0000","last_fullsized":"2024-06-13T11:23:46.283148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:04:30.677548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144095+0000","last_change":"2024-06-13T11:20:27.603953+0000","last_active":"2024-06-13T11:23:46.144095+0000","last_peered":"2024-06-13T11:23:46.144095+0000","last_clean":"2024-06-13T11:23:46.144095+0000","last_became_active":"2024-06-13T11:20:27.603306+0000","last_became_peered":"2024-06-13T11:20:27.603306+0000","last_unstale":"2024-06-13T11:23:46.144095+0000","last_undegraded":"2024-06-13T11:23:46.144095+0000","last_fullsized":"2024-06-13T11:23:46.144095+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:02:01.228984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'3","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.297963+0000","last_change":"2024-06-13T11:18:38.170126+0000","last_active":"2024-06-13T11:23:46.297963+0000","last_peered":"2024-06-13T11:23:46.297963+0000","last_clean":"2024-06-13T11:23:46.297963+0000","last_became_active":"2024-06-13T11:18:38.169736+0000","last_became_peered":"2024-06-13T11:18:38.169736+0000","last_unstale":"2024-06-13T11:23:46.297963+0000","last_undegraded":"2024-06-13T11:23:46.297963+0000","last_fullsized":"2024-06-13T11:23:46.297963+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:07:22.778093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294559+0000","last_change":"2024-06-13T11:18:42.929004+0000","last_active":"2024-06-13T11:23:46.294559+0000","last_peered":"2024-06-13T11:23:46.294559+0000","last_clean":"2024-06-13T11:23:46.294559+0000","last_became_active":"2024-06-13T11:18:42.928579+0000","last_became_peered":"2024-06-13T11:18:42.928579+0000","last_unstale":"2024-06-13T11:23:46.294559+0000","last_undegraded":"2024-06-13T11:23:46.294559+0000","last_fullsized":"2024-06-13T11:23:46.294559+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:31:15.703033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315006+0000","last_change":"2024-06-13T11:18:57.031059+0000","last_active":"2024-06-13T11:23:46.315006+0000","last_peered":"2024-06-13T11:23:46.315006+0000","last_clean":"2024-06-13T11:23:46.315006+0000","last_became_active":"2024-06-13T11:18:57.030723+0000","last_became_peered":"2024-06-13T11:18:57.030723+0000","last_unstale":"2024-06-13T11:23:46.315006+0000","last_undegraded":"2024-06-13T11:23:46.315006+0000","last_fullsized":"2024-06-13T11:23:46.315006+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:19:36.883790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'2","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146807+0000","last_change":"2024-06-13T11:18:38.175189+0000","last_active":"2024-06-13T11:23:46.146807+0000","last_peered":"2024-06-13T11:23:46.146807+0000","last_clean":"2024-06-13T11:23:46.146807+0000","last_became_active":"2024-06-13T11:18:38.173817+0000","last_became_peered":"2024-06-13T11:18:38.173817+0000","last_unstale":"2024-06-13T11:23:46.146807+0000","last_undegraded":"2024-06-13T11:23:46.146807+0000","last_fullsized":"2024-06-13T11:23:46.146807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:02:18.422449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.284009+0000","last_change":"2024-06-13T11:18:42.920665+0000","last_active":"2024-06-13T11:23:46.284009+0000","last_peered":"2024-06-13T11:23:46.284009+0000","last_clean":"2024-06-13T11:23:46.284009+0000","last_became_active":"2024-06-13T11:18:42.919461+0000","last_became_peered":"2024-06-13T11:18:42.919461+0000","last_unstale":"2024-06-13T11:23:46.284009+0000","last_undegraded":"2024-06-13T11:23:46.284009+0000","last_fullsized":"2024-06-13T11:23:46.284009+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:56:23.042481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.316348+0000","last_change":"2024-06-13T11:18:57.025822+0000","last_active":"2024-06-13T11:23:46.316348+0000","last_peered":"2024-06-13T11:23:46.316348+0000","last_clean":"2024-06-13T11:23:46.316348+0000","last_became_active":"2024-06-13T11:18:57.025408+0000","last_became_peered":"2024-06-13T11:18:57.025408+0000","last_unstale":"2024-06-13T11:23:46.316348+0000","last_undegraded":"2024-06-13T11:23:46.316348+0000","last_fullsized":"2024-06-13T11:23:46.316348+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:39:28.295433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'1","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.293898+0000","last_change":"2024-06-13T11:18:38.168097+0000","last_active":"2024-06-13T11:23:46.293898+0000","last_peered":"2024-06-13T11:23:46.293898+0000","last_clean":"2024-06-13T11:23:46.293898+0000","last_became_active":"2024-06-13T11:18:38.167812+0000","last_became_peered":"2024-06-13T11:18:38.167812+0000","last_unstale":"2024-06-13T11:23:46.293898+0000","last_undegraded":"2024-06-13T11:23:46.293898+0000","last_fullsized":"2024-06-13T11:23:46.293898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:24:20.247579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"99'11","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.150942+0000","last_change":"2024-06-13T11:18:42.932941+0000","last_active":"2024-06-13T11:23:46.150942+0000","last_peered":"2024-06-13T11:23:46.150942+0000","last_clean":"2024-06-13T11:23:46.150942+0000","last_became_active":"2024-06-13T11:18:42.931942+0000","last_became_peered":"2024-06-13T11:18:42.931942+0000","last_unstale":"2024-06-13T11:23:46.150942+0000","last_undegraded":"2024-06-13T11:23:46.150942+0000","last_fullsized":"2024-06-13T11:23:46.150942+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:12:38.625753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.284213+0000","last_change":"2024-06-13T11:18:57.026834+0000","last_active":"2024-06-13T11:23:46.284213+0000","last_peered":"2024-06-13T11:23:46.284213+0000","last_clean":"2024-06-13T11:23:46.284213+0000","last_became_active":"2024-06-13T11:18:57.026401+0000","last_became_peered":"2024-06-13T11:18:57.026401+0000","last_unstale":"2024-06-13T11:23:46.284213+0000","last_undegraded":"2024-06-13T11:23:46.284213+0000","last_fullsized":"2024-06-13T11:23:46.284213+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:11:19.993946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"100'5","reported_seq":270,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.509969+0000","last_change":"2024-06-13T11:18:38.172648+0000","last_active":"2024-06-13T11:23:46.509969+0000","last_peered":"2024-06-13T11:23:46.509969+0000","last_clean":"2024-06-13T11:23:46.509969+0000","last_became_active":"2024-06-13T11:18:38.172311+0000","last_became_peered":"2024-06-13T11:18:38.172311+0000","last_unstale":"2024-06-13T11:23:46.509969+0000","last_undegraded":"2024-06-13T11:23:46.509969+0000","last_fullsized":"2024-06-13T11:23:46.509969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:59:10.620378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":217,"num_read_kb":217,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"99'10","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300652+0000","last_change":"2024-06-13T11:18:42.920352+0000","last_active":"2024-06-13T11:23:46.300652+0000","last_peered":"2024-06-13T11:23:46.300652+0000","last_clean":"2024-06-13T11:23:46.300652+0000","last_became_active":"2024-06-13T11:18:42.919969+0000","last_became_peered":"2024-06-13T11:18:42.919969+0000","last_unstale":"2024-06-13T11:23:46.300652+0000","last_undegraded":"2024-06-13T11:23:46.300652+0000","last_fullsized":"2024-06-13T11:23:46.300652+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:10:59.832735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.150793+0000","last_change":"2024-06-13T11:18:57.034774+0000","last_active":"2024-06-13T11:23:46.150793+0000","last_peered":"2024-06-13T11:23:46.150793+0000","last_clean":"2024-06-13T11:23:46.150793+0000","last_became_active":"2024-06-13T11:18:57.031812+0000","last_became_peered":"2024-06-13T11:18:57.031812+0000","last_unstale":"2024-06-13T11:23:46.150793+0000","last_undegraded":"2024-06-13T11:23:46.150793+0000","last_fullsized":"2024-06-13T11:23:46.150793+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:20:26.195958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'2","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315391+0000","last_change":"2024-06-13T11:18:38.168169+0000","last_active":"2024-06-13T11:23:46.315391+0000","last_peered":"2024-06-13T11:23:46.315391+0000","last_clean":"2024-06-13T11:23:46.315391+0000","last_became_active":"2024-06-13T11:18:38.167791+0000","last_became_peered":"2024-06-13T11:18:38.167791+0000","last_unstale":"2024-06-13T11:23:46.315391+0000","last_undegraded":"2024-06-13T11:23:46.315391+0000","last_fullsized":"2024-06-13T11:23:46.315391+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:04.879468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"99'9","reported_seq":57,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315768+0000","last_change":"2024-06-13T11:19:27.077888+0000","last_active":"2024-06-13T11:23:46.315768+0000","last_peered":"2024-06-13T11:23:46.315768+0000","last_clean":"2024-06-13T11:23:46.315768+0000","last_became_active":"2024-06-13T11:19:27.075904+0000","last_became_peered":"2024-06-13T11:19:27.075904+0000","last_unstale":"2024-06-13T11:23:46.315768+0000","last_undegraded":"2024-06-13T11:23:46.315768+0000","last_fullsized":"2024-06-13T11:23:46.315768+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:54:59.920163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.316039+0000","last_change":"2024-06-13T11:19:27.073568+0000","last_active":"2024-06-13T11:23:46.316039+0000","last_peered":"2024-06-13T11:23:46.316039+0000","last_clean":"2024-06-13T11:23:46.316039+0000","last_became_active":"2024-06-13T11:19:27.072954+0000","last_became_peered":"2024-06-13T11:19:27.072954+0000","last_unstale":"2024-06-13T11:23:46.316039+0000","last_undegraded":"2024-06-13T11:23:46.316039+0000","last_fullsized":"2024-06-13T11:23:46.316039+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:10:25.492093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'4","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294413+0000","last_change":"2024-06-13T11:18:38.482021+0000","last_active":"2024-06-13T11:23:46.294413+0000","last_peered":"2024-06-13T11:23:46.294413+0000","last_clean":"2024-06-13T11:23:46.294413+0000","last_became_active":"2024-06-13T11:18:38.481574+0000","last_became_peered":"2024-06-13T11:18:38.481574+0000","last_unstale":"2024-06-13T11:23:46.294413+0000","last_undegraded":"2024-06-13T11:23:46.294413+0000","last_fullsized":"2024-06-13T11:23:46.294413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:50:54.297559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"99'11","reported_seq":59,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300642+0000","last_change":"2024-06-13T11:19:27.072380+0000","last_active":"2024-06-13T11:23:46.300642+0000","last_peered":"2024-06-13T11:23:46.300642+0000","last_clean":"2024-06-13T11:23:46.300642+0000","last_became_active":"2024-06-13T11:19:27.072027+0000","last_became_peered":"2024-06-13T11:19:27.072027+0000","last_unstale":"2024-06-13T11:23:46.300642+0000","last_undegraded":"2024-06-13T11:23:46.300642+0000","last_fullsized":"2024-06-13T11:23:46.300642+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:37:10.455890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151029+0000","last_change":"2024-06-13T11:18:57.028370+0000","last_active":"2024-06-13T11:23:46.151029+0000","last_peered":"2024-06-13T11:23:46.151029+0000","last_clean":"2024-06-13T11:23:46.151029+0000","last_became_active":"2024-06-13T11:18:57.023478+0000","last_became_peered":"2024-06-13T11:18:57.023478+0000","last_unstale":"2024-06-13T11:23:46.151029+0000","last_undegraded":"2024-06-13T11:23:46.151029+0000","last_fullsized":"2024-06-13T11:23:46.151029+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:25:01.237698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"100'41","reported_seq":535,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.752687+0000","last_change":"2024-06-13T11:18:38.169179+0000","last_active":"2024-06-13T11:23:46.752687+0000","last_peered":"2024-06-13T11:23:46.752687+0000","last_clean":"2024-06-13T11:23:46.752687+0000","last_became_active":"2024-06-13T11:18:38.168775+0000","last_became_peered":"2024-06-13T11:18:38.168775+0000","last_unstale":"2024-06-13T11:23:46.752687+0000","last_undegraded":"2024-06-13T11:23:46.752687+0000","last_fullsized":"2024-06-13T11:23:46.752687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:53:39.290755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69867,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":291,"num_write":42,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283436+0000","last_change":"2024-06-13T11:18:42.903744+0000","last_active":"2024-06-13T11:23:46.283436+0000","last_peered":"2024-06-13T11:23:46.283436+0000","last_clean":"2024-06-13T11:23:46.283436+0000","last_became_active":"2024-06-13T11:18:42.903410+0000","last_became_peered":"2024-06-13T11:18:42.903410+0000","last_unstale":"2024-06-13T11:23:46.283436+0000","last_undegraded":"2024-06-13T11:23:46.283436+0000","last_fullsized":"2024-06-13T11:23:46.283436+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:17:55.975517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294901+0000","last_change":"2024-06-13T11:18:57.026052+0000","last_active":"2024-06-13T11:23:46.294901+0000","last_peered":"2024-06-13T11:23:46.294901+0000","last_clean":"2024-06-13T11:23:46.294901+0000","last_became_active":"2024-06-13T11:18:57.025677+0000","last_became_peered":"2024-06-13T11:18:57.025677+0000","last_unstale":"2024-06-13T11:23:46.294901+0000","last_undegraded":"2024-06-13T11:23:46.294901+0000","last_fullsized":"2024-06-13T11:23:46.294901+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:47:41.061675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'6","reported_seq":55,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144372+0000","last_change":"2024-06-13T11:18:38.166672+0000","last_active":"2024-06-13T11:23:46.144372+0000","last_peered":"2024-06-13T11:23:46.144372+0000","last_clean":"2024-06-13T11:23:46.144372+0000","last_became_active":"2024-06-13T11:18:38.165923+0000","last_became_peered":"2024-06-13T11:18:38.165923+0000","last_unstale":"2024-06-13T11:23:46.144372+0000","last_undegraded":"2024-06-13T11:23:46.144372+0000","last_fullsized":"2024-06-13T11:23:46.144372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:54:00.989462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146908+0000","last_change":"2024-06-13T11:18:42.919280+0000","last_active":"2024-06-13T11:23:46.146908+0000","last_peered":"2024-06-13T11:23:46.146908+0000","last_clean":"2024-06-13T11:23:46.146908+0000","last_became_active":"2024-06-13T11:18:42.917421+0000","last_became_peered":"2024-06-13T11:18:42.917421+0000","last_unstale":"2024-06-13T11:23:46.146908+0000","last_undegraded":"2024-06-13T11:23:46.146908+0000","last_fullsized":"2024-06-13T11:23:46.146908+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:52:23.765290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314791+0000","last_change":"2024-06-13T11:18:57.031244+0000","last_active":"2024-06-13T11:23:46.314791+0000","last_peered":"2024-06-13T11:23:46.314791+0000","last_clean":"2024-06-13T11:23:46.314791+0000","last_became_active":"2024-06-13T11:18:57.030781+0000","last_became_peered":"2024-06-13T11:18:57.030781+0000","last_unstale":"2024-06-13T11:23:46.314791+0000","last_undegraded":"2024-06-13T11:23:46.314791+0000","last_fullsized":"2024-06-13T11:23:46.314791+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:19:51.722256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'3","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294215+0000","last_change":"2024-06-13T11:18:38.171060+0000","last_active":"2024-06-13T11:23:46.294215+0000","last_peered":"2024-06-13T11:23:46.294215+0000","last_clean":"2024-06-13T11:23:46.294215+0000","last_became_active":"2024-06-13T11:18:38.170682+0000","last_became_peered":"2024-06-13T11:18:38.170682+0000","last_unstale":"2024-06-13T11:23:46.294215+0000","last_undegraded":"2024-06-13T11:23:46.294215+0000","last_fullsized":"2024-06-13T11:23:46.294215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:05:53.157074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"99'15","reported_seq":57,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315877+0000","last_change":"2024-06-13T11:18:42.902700+0000","last_active":"2024-06-13T11:23:46.315877+0000","last_peered":"2024-06-13T11:23:46.315877+0000","last_clean":"2024-06-13T11:23:46.315877+0000","last_became_active":"2024-06-13T11:18:42.902351+0000","last_became_peered":"2024-06-13T11:18:42.902351+0000","last_unstale":"2024-06-13T11:23:46.315877+0000","last_undegraded":"2024-06-13T11:23:46.315877+0000","last_fullsized":"2024-06-13T11:23:46.315877+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:55:16.769324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151561+0000","last_change":"2024-06-13T11:18:57.034840+0000","last_active":"2024-06-13T11:23:46.151561+0000","last_peered":"2024-06-13T11:23:46.151561+0000","last_clean":"2024-06-13T11:23:46.151561+0000","last_became_active":"2024-06-13T11:18:57.033552+0000","last_became_peered":"2024-06-13T11:18:57.033552+0000","last_unstale":"2024-06-13T11:23:46.151561+0000","last_undegraded":"2024-06-13T11:23:46.151561+0000","last_fullsized":"2024-06-13T11:23:46.151561+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:44:25.463043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"100'6","reported_seq":281,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:50.911720+0000","last_change":"2024-06-13T11:18:38.170644+0000","last_active":"2024-06-13T11:23:50.911720+0000","last_peered":"2024-06-13T11:23:50.911720+0000","last_clean":"2024-06-13T11:23:50.911720+0000","last_became_active":"2024-06-13T11:18:38.169986+0000","last_became_peered":"2024-06-13T11:18:38.169986+0000","last_unstale":"2024-06-13T11:23:50.911720+0000","last_undegraded":"2024-06-13T11:23:50.911720+0000","last_fullsized":"2024-06-13T11:23:50.911720+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:45:48.817898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1509,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315721+0000","last_change":"2024-06-13T11:18:42.903465+0000","last_active":"2024-06-13T11:23:46.315721+0000","last_peered":"2024-06-13T11:23:46.315721+0000","last_clean":"2024-06-13T11:23:46.315721+0000","last_became_active":"2024-06-13T11:18:42.903001+0000","last_became_peered":"2024-06-13T11:18:42.903001+0000","last_unstale":"2024-06-13T11:23:46.315721+0000","last_undegraded":"2024-06-13T11:23:46.315721+0000","last_fullsized":"2024-06-13T11:23:46.315721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:25:24.331890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":31,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.147052+0000","last_change":"2024-06-13T11:18:57.033966+0000","last_active":"2024-06-13T11:23:46.147052+0000","last_peered":"2024-06-13T11:23:46.147052+0000","last_clean":"2024-06-13T11:23:46.147052+0000","last_became_active":"2024-06-13T11:18:57.032448+0000","last_became_peered":"2024-06-13T11:18:57.032448+0000","last_unstale":"2024-06-13T11:23:46.147052+0000","last_undegraded":"2024-06-13T11:23:46.147052+0000","last_fullsized":"2024-06-13T11:23:46.147052+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:51:40.473020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'15","reported_seq":64,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.282957+0000","last_change":"2024-06-13T11:18:38.483204+0000","last_active":"2024-06-13T11:23:46.282957+0000","last_peered":"2024-06-13T11:23:46.282957+0000","last_clean":"2024-06-13T11:23:46.282957+0000","last_became_active":"2024-06-13T11:18:38.482800+0000","last_became_peered":"2024-06-13T11:18:38.482800+0000","last_unstale":"2024-06-13T11:23:46.282957+0000","last_undegraded":"2024-06-13T11:23:46.282957+0000","last_fullsized":"2024-06-13T11:23:46.282957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:28:44.636201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294236+0000","last_change":"2024-06-13T11:18:42.899944+0000","last_active":"2024-06-13T11:23:46.294236+0000","last_peered":"2024-06-13T11:23:46.294236+0000","last_clean":"2024-06-13T11:23:46.294236+0000","last_became_active":"2024-06-13T11:18:42.899551+0000","last_became_peered":"2024-06-13T11:18:42.899551+0000","last_unstale":"2024-06-13T11:23:46.294236+0000","last_undegraded":"2024-06-13T11:23:46.294236+0000","last_fullsized":"2024-06-13T11:23:46.294236+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:18:21.109043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294120+0000","last_change":"2024-06-13T11:18:57.028817+0000","last_active":"2024-06-13T11:23:46.294120+0000","last_peered":"2024-06-13T11:23:46.294120+0000","last_clean":"2024-06-13T11:23:46.294120+0000","last_became_active":"2024-06-13T11:18:57.028433+0000","last_became_peered":"2024-06-13T11:18:57.028433+0000","last_unstale":"2024-06-13T11:23:46.294120+0000","last_undegraded":"2024-06-13T11:23:46.294120+0000","last_fullsized":"2024-06-13T11:23:46.294120+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:56:24.180096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283522+0000","last_change":"2024-06-13T11:18:38.165907+0000","last_active":"2024-06-13T11:23:46.283522+0000","last_peered":"2024-06-13T11:23:46.283522+0000","last_clean":"2024-06-13T11:23:46.283522+0000","last_became_active":"2024-06-13T11:18:38.165516+0000","last_became_peered":"2024-06-13T11:18:38.165516+0000","last_unstale":"2024-06-13T11:23:46.283522+0000","last_undegraded":"2024-06-13T11:23:46.283522+0000","last_fullsized":"2024-06-13T11:23:46.283522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:51:15.774967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"99'5","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314951+0000","last_change":"2024-06-13T11:19:27.004377+0000","last_active":"2024-06-13T11:23:46.314951+0000","last_peered":"2024-06-13T11:23:46.314951+0000","last_clean":"2024-06-13T11:23:46.314951+0000","last_became_active":"2024-06-13T11:19:27.003954+0000","last_became_peered":"2024-06-13T11:19:27.003954+0000","last_unstale":"2024-06-13T11:23:46.314951+0000","last_undegraded":"2024-06-13T11:23:46.314951+0000","last_fullsized":"2024-06-13T11:23:46.314951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:53:25.967036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.282972+0000","last_change":"2024-06-13T11:18:57.184912+0000","last_active":"2024-06-13T11:23:46.282972+0000","last_peered":"2024-06-13T11:23:46.282972+0000","last_clean":"2024-06-13T11:23:46.282972+0000","last_became_active":"2024-06-13T11:18:57.184442+0000","last_became_peered":"2024-06-13T11:18:57.184442+0000","last_unstale":"2024-06-13T11:23:46.282972+0000","last_undegraded":"2024-06-13T11:23:46.282972+0000","last_fullsized":"2024-06-13T11:23:46.282972+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:47:17.961086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151270+0000","last_change":"2024-06-13T11:18:38.484487+0000","last_active":"2024-06-13T11:23:46.151270+0000","last_peered":"2024-06-13T11:23:46.151270+0000","last_clean":"2024-06-13T11:23:46.151270+0000","last_became_active":"2024-06-13T11:18:38.483587+0000","last_became_peered":"2024-06-13T11:18:38.483587+0000","last_unstale":"2024-06-13T11:23:46.151270+0000","last_undegraded":"2024-06-13T11:23:46.151270+0000","last_fullsized":"2024-06-13T11:23:46.151270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:50:19.773340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"99'4","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.298226+0000","last_change":"2024-06-13T11:18:42.913275+0000","last_active":"2024-06-13T11:23:46.298226+0000","last_peered":"2024-06-13T11:23:46.298226+0000","last_clean":"2024-06-13T11:23:46.298226+0000","last_became_active":"2024-06-13T11:18:42.912880+0000","last_became_peered":"2024-06-13T11:18:42.912880+0000","last_unstale":"2024-06-13T11:23:46.298226+0000","last_undegraded":"2024-06-13T11:23:46.298226+0000","last_fullsized":"2024-06-13T11:23:46.298226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:01:55.261976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146430+0000","last_change":"2024-06-13T11:18:57.027893+0000","last_active":"2024-06-13T11:23:46.146430+0000","last_peered":"2024-06-13T11:23:46.146430+0000","last_clean":"2024-06-13T11:23:46.146430+0000","last_became_active":"2024-06-13T11:18:57.025683+0000","last_became_peered":"2024-06-13T11:18:57.025683+0000","last_unstale":"2024-06-13T11:23:46.146430+0000","last_undegraded":"2024-06-13T11:23:46.146430+0000","last_fullsized":"2024-06-13T11:23:46.146430+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:25:59.348570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"97'1","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315392+0000","last_change":"2024-06-13T11:18:38.167932+0000","last_active":"2024-06-13T11:23:46.315392+0000","last_peered":"2024-06-13T11:23:46.315392+0000","last_clean":"2024-06-13T11:23:46.315392+0000","last_became_active":"2024-06-13T11:18:38.167520+0000","last_became_peered":"2024-06-13T11:18:38.167520+0000","last_unstale":"2024-06-13T11:23:46.315392+0000","last_undegraded":"2024-06-13T11:23:46.315392+0000","last_fullsized":"2024-06-13T11:23:46.315392+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:00:04.537091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.297918+0000","last_change":"2024-06-13T11:18:42.923211+0000","last_active":"2024-06-13T11:23:46.297918+0000","last_peered":"2024-06-13T11:23:46.297918+0000","last_clean":"2024-06-13T11:23:46.297918+0000","last_became_active":"2024-06-13T11:18:42.922858+0000","last_became_peered":"2024-06-13T11:18:42.922858+0000","last_unstale":"2024-06-13T11:23:46.297918+0000","last_undegraded":"2024-06-13T11:23:46.297918+0000","last_fullsized":"2024-06-13T11:23:46.297918+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:56:18.163502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.147614+0000","last_change":"2024-06-13T11:18:57.185071+0000","last_active":"2024-06-13T11:23:46.147614+0000","last_peered":"2024-06-13T11:23:46.147614+0000","last_clean":"2024-06-13T11:23:46.147614+0000","last_became_active":"2024-06-13T11:18:57.184526+0000","last_became_peered":"2024-06-13T11:18:57.184526+0000","last_unstale":"2024-06-13T11:23:46.147614+0000","last_undegraded":"2024-06-13T11:23:46.147614+0000","last_fullsized":"2024-06-13T11:23:46.147614+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:51:37.715832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294188+0000","last_change":"2024-06-13T11:18:42.912483+0000","last_active":"2024-06-13T11:23:46.294188+0000","last_peered":"2024-06-13T11:23:46.294188+0000","last_clean":"2024-06-13T11:23:46.294188+0000","last_became_active":"2024-06-13T11:18:42.912117+0000","last_became_peered":"2024-06-13T11:18:42.912117+0000","last_unstale":"2024-06-13T11:23:46.294188+0000","last_undegraded":"2024-06-13T11:23:46.294188+0000","last_fullsized":"2024-06-13T11:23:46.294188+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:41:23.769097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"100'6","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.504386+0000","last_change":"2024-06-13T11:18:38.483334+0000","last_active":"2024-06-13T11:23:46.504386+0000","last_peered":"2024-06-13T11:23:46.504386+0000","last_clean":"2024-06-13T11:23:46.504386+0000","last_became_active":"2024-06-13T11:18:38.482885+0000","last_became_peered":"2024-06-13T11:18:38.482885+0000","last_unstale":"2024-06-13T11:23:46.504386+0000","last_undegraded":"2024-06-13T11:23:46.504386+0000","last_fullsized":"2024-06-13T11:23:46.504386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:55:19.986526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":217,"num_read_kb":217,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"97'1","reported_seq":33,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315368+0000","last_change":"2024-06-13T11:18:57.016960+0000","last_active":"2024-06-13T11:23:46.315368+0000","last_peered":"2024-06-13T11:23:46.315368+0000","last_clean":"2024-06-13T11:23:46.315368+0000","last_became_active":"2024-06-13T11:18:57.016490+0000","last_became_peered":"2024-06-13T11:18:57.016490+0000","last_unstale":"2024-06-13T11:23:46.315368+0000","last_undegraded":"2024-06-13T11:23:46.315368+0000","last_fullsized":"2024-06-13T11:23:46.315368+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:40:19.796594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.284675+0000","last_change":"2024-06-13T11:18:42.921581+0000","last_active":"2024-06-13T11:23:46.284675+0000","last_peered":"2024-06-13T11:23:46.284675+0000","last_clean":"2024-06-13T11:23:46.284675+0000","last_became_active":"2024-06-13T11:18:42.917820+0000","last_became_peered":"2024-06-13T11:18:42.917820+0000","last_unstale":"2024-06-13T11:23:46.284675+0000","last_undegraded":"2024-06-13T11:23:46.284675+0000","last_fullsized":"2024-06-13T11:23:46.284675+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:59:28.460363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'3","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314983+0000","last_change":"2024-06-13T11:18:38.168111+0000","last_active":"2024-06-13T11:23:46.314983+0000","last_peered":"2024-06-13T11:23:46.314983+0000","last_clean":"2024-06-13T11:23:46.314983+0000","last_became_active":"2024-06-13T11:18:38.167732+0000","last_became_peered":"2024-06-13T11:18:38.167732+0000","last_unstale":"2024-06-13T11:23:46.314983+0000","last_undegraded":"2024-06-13T11:23:46.314983+0000","last_fullsized":"2024-06-13T11:23:46.314983+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:36:55.993553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":381,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315089+0000","last_change":"2024-06-13T11:17:06.317849+0000","last_active":"2024-06-13T11:23:46.315089+0000","last_peered":"2024-06-13T11:23:46.315089+0000","last_clean":"2024-06-13T11:23:46.315089+0000","last_became_active":"2024-06-13T11:17:06.317293+0000","last_became_peered":"2024-06-13T11:17:06.317293+0000","last_unstale":"2024-06-13T11:23:46.315089+0000","last_undegraded":"2024-06-13T11:23:46.315089+0000","last_fullsized":"2024-06-13T11:23:46.315089+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:13:14.002581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:13:14.002581+0000","last_clean_scrub_stamp":"2024-06-13T11:13:14.002581+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:54:32.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294618+0000","last_change":"2024-06-13T11:18:57.185880+0000","last_active":"2024-06-13T11:23:46.294618+0000","last_peered":"2024-06-13T11:23:46.294618+0000","last_clean":"2024-06-13T11:23:46.294618+0000","last_became_active":"2024-06-13T11:18:57.185140+0000","last_became_peered":"2024-06-13T11:18:57.185140+0000","last_unstale":"2024-06-13T11:23:46.294618+0000","last_undegraded":"2024-06-13T11:23:46.294618+0000","last_fullsized":"2024-06-13T11:23:46.294618+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:43:40.195809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"99'5","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.145829+0000","last_change":"2024-06-13T11:19:27.006408+0000","last_active":"2024-06-13T11:23:46.145829+0000","last_peered":"2024-06-13T11:23:46.145829+0000","last_clean":"2024-06-13T11:23:46.145829+0000","last_became_active":"2024-06-13T11:19:27.005525+0000","last_became_peered":"2024-06-13T11:19:27.005525+0000","last_unstale":"2024-06-13T11:23:46.145829+0000","last_undegraded":"2024-06-13T11:23:46.145829+0000","last_fullsized":"2024-06-13T11:23:46.145829+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:09:39.891543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'3","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315242+0000","last_change":"2024-06-13T11:18:38.171089+0000","last_active":"2024-06-13T11:23:46.315242+0000","last_peered":"2024-06-13T11:23:46.315242+0000","last_clean":"2024-06-13T11:23:46.315242+0000","last_became_active":"2024-06-13T11:18:38.170769+0000","last_became_peered":"2024-06-13T11:18:38.170769+0000","last_unstale":"2024-06-13T11:23:46.315242+0000","last_undegraded":"2024-06-13T11:23:46.315242+0000","last_fullsized":"2024-06-13T11:23:46.315242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:07:46.355159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314717+0000","last_change":"2024-06-13T11:18:57.015609+0000","last_active":"2024-06-13T11:23:46.314717+0000","last_peered":"2024-06-13T11:23:46.314717+0000","last_clean":"2024-06-13T11:23:46.314717+0000","last_became_active":"2024-06-13T11:18:57.015164+0000","last_became_peered":"2024-06-13T11:18:57.015164+0000","last_unstale":"2024-06-13T11:23:46.314717+0000","last_undegraded":"2024-06-13T11:23:46.314717+0000","last_fullsized":"2024-06-13T11:23:46.314717+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:32:15.725778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'1","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283442+0000","last_change":"2024-06-13T11:18:38.483215+0000","last_active":"2024-06-13T11:23:46.283442+0000","last_peered":"2024-06-13T11:23:46.283442+0000","last_clean":"2024-06-13T11:23:46.283442+0000","last_became_active":"2024-06-13T11:18:38.482789+0000","last_became_peered":"2024-06-13T11:18:38.482789+0000","last_unstale":"2024-06-13T11:23:46.283442+0000","last_undegraded":"2024-06-13T11:23:46.283442+0000","last_fullsized":"2024-06-13T11:23:46.283442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:01:58.020310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146040+0000","last_change":"2024-06-13T11:18:42.914846+0000","last_active":"2024-06-13T11:23:46.146040+0000","last_peered":"2024-06-13T11:23:46.146040+0000","last_clean":"2024-06-13T11:23:46.146040+0000","last_became_active":"2024-06-13T11:18:42.912614+0000","last_became_peered":"2024-06-13T11:18:42.912614+0000","last_unstale":"2024-06-13T11:23:46.146040+0000","last_undegraded":"2024-06-13T11:23:46.146040+0000","last_fullsized":"2024-06-13T11:23:46.146040+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:00:13.066079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283969+0000","last_change":"2024-06-13T11:18:57.185117+0000","last_active":"2024-06-13T11:23:46.283969+0000","last_peered":"2024-06-13T11:23:46.283969+0000","last_clean":"2024-06-13T11:23:46.283969+0000","last_became_active":"2024-06-13T11:18:57.184498+0000","last_became_peered":"2024-06-13T11:18:57.184498+0000","last_unstale":"2024-06-13T11:23:46.283969+0000","last_undegraded":"2024-06-13T11:23:46.283969+0000","last_fullsized":"2024-06-13T11:23:46.283969+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:04:28.800984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"100'47","reported_seq":118,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.439881+0000","last_change":"2024-06-13T11:18:38.176918+0000","last_active":"2024-06-13T11:23:46.439881+0000","last_peered":"2024-06-13T11:23:46.439881+0000","last_clean":"2024-06-13T11:23:46.439881+0000","last_became_active":"2024-06-13T11:18:38.176236+0000","last_became_peered":"2024-06-13T11:18:38.176236+0000","last_unstale":"2024-06-13T11:23:46.439881+0000","last_undegraded":"2024-06-13T11:23:46.439881+0000","last_fullsized":"2024-06-13T11:23:46.439881+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T23:10:20.684891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":85,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"99'5","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.286262+0000","last_change":"2024-06-13T11:18:42.920930+0000","last_active":"2024-06-13T11:23:46.286262+0000","last_peered":"2024-06-13T11:23:46.286262+0000","last_clean":"2024-06-13T11:23:46.286262+0000","last_became_active":"2024-06-13T11:18:42.915838+0000","last_became_peered":"2024-06-13T11:18:42.915838+0000","last_unstale":"2024-06-13T11:23:46.286262+0000","last_undegraded":"2024-06-13T11:23:46.286262+0000","last_fullsized":"2024-06-13T11:23:46.286262+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:07:43.483317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.143782+0000","last_change":"2024-06-13T11:18:57.009043+0000","last_active":"2024-06-13T11:23:46.143782+0000","last_peered":"2024-06-13T11:23:46.143782+0000","last_clean":"2024-06-13T11:23:46.143782+0000","last_became_active":"2024-06-13T11:18:57.008533+0000","last_became_peered":"2024-06-13T11:18:57.008533+0000","last_unstale":"2024-06-13T11:23:46.143782+0000","last_undegraded":"2024-06-13T11:23:46.143782+0000","last_fullsized":"2024-06-13T11:23:46.143782+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:30:29.614810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'4","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315871+0000","last_change":"2024-06-13T11:18:38.523042+0000","last_active":"2024-06-13T11:23:46.315871+0000","last_peered":"2024-06-13T11:23:46.315871+0000","last_clean":"2024-06-13T11:23:46.315871+0000","last_became_active":"2024-06-13T11:18:38.522673+0000","last_became_peered":"2024-06-13T11:18:38.522673+0000","last_unstale":"2024-06-13T11:23:46.315871+0000","last_undegraded":"2024-06-13T11:23:46.315871+0000","last_fullsized":"2024-06-13T11:23:46.315871+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:25:50.725281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.316292+0000","last_change":"2024-06-13T11:18:42.934090+0000","last_active":"2024-06-13T11:23:46.316292+0000","last_peered":"2024-06-13T11:23:46.316292+0000","last_clean":"2024-06-13T11:23:46.316292+0000","last_became_active":"2024-06-13T11:18:42.933680+0000","last_became_peered":"2024-06-13T11:18:42.933680+0000","last_unstale":"2024-06-13T11:23:46.316292+0000","last_undegraded":"2024-06-13T11:23:46.316292+0000","last_fullsized":"2024-06-13T11:23:46.316292+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:39:30.214272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315368+0000","last_change":"2024-06-13T11:18:57.185186+0000","last_active":"2024-06-13T11:23:46.315368+0000","last_peered":"2024-06-13T11:23:46.315368+0000","last_clean":"2024-06-13T11:23:46.315368+0000","last_became_active":"2024-06-13T11:18:57.184448+0000","last_became_peered":"2024-06-13T11:18:57.184448+0000","last_unstale":"2024-06-13T11:23:46.315368+0000","last_undegraded":"2024-06-13T11:23:46.315368+0000","last_fullsized":"2024-06-13T11:23:46.315368+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:18:32.514993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":56,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300041+0000","last_change":"2024-06-13T11:19:26.999451+0000","last_active":"2024-06-13T11:23:46.300041+0000","last_peered":"2024-06-13T11:23:46.300041+0000","last_clean":"2024-06-13T11:23:46.300041+0000","last_became_active":"2024-06-13T11:19:26.999153+0000","last_became_peered":"2024-06-13T11:19:26.999153+0000","last_unstale":"2024-06-13T11:23:46.300041+0000","last_undegraded":"2024-06-13T11:23:46.300041+0000","last_fullsized":"2024-06-13T11:23:46.300041+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:42:34.755569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"99'2","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.282968+0000","last_change":"2024-06-13T11:18:42.903741+0000","last_active":"2024-06-13T11:23:46.282968+0000","last_peered":"2024-06-13T11:23:46.282968+0000","last_clean":"2024-06-13T11:23:46.282968+0000","last_became_active":"2024-06-13T11:18:42.903351+0000","last_became_peered":"2024-06-13T11:18:42.903351+0000","last_unstale":"2024-06-13T11:23:46.282968+0000","last_undegraded":"2024-06-13T11:23:46.282968+0000","last_fullsized":"2024-06-13T11:23:46.282968+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:47:21.206540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.151718+0000","last_change":"2024-06-13T11:18:57.035149+0000","last_active":"2024-06-13T11:23:46.151718+0000","last_peered":"2024-06-13T11:23:46.151718+0000","last_clean":"2024-06-13T11:23:46.151718+0000","last_became_active":"2024-06-13T11:18:57.033208+0000","last_became_peered":"2024-06-13T11:18:57.033208+0000","last_unstale":"2024-06-13T11:23:46.151718+0000","last_undegraded":"2024-06-13T11:23:46.151718+0000","last_fullsized":"2024-06-13T11:23:46.151718+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:19:01.353814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'3","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.284275+0000","last_change":"2024-06-13T11:18:38.170464+0000","last_active":"2024-06-13T11:23:46.284275+0000","last_peered":"2024-06-13T11:23:46.284275+0000","last_clean":"2024-06-13T11:23:46.284275+0000","last_became_active":"2024-06-13T11:18:38.169945+0000","last_became_peered":"2024-06-13T11:18:38.169945+0000","last_unstale":"2024-06-13T11:23:46.284275+0000","last_undegraded":"2024-06-13T11:23:46.284275+0000","last_fullsized":"2024-06-13T11:23:46.284275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:53:20.112176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314661+0000","last_change":"2024-06-13T11:18:42.925391+0000","last_active":"2024-06-13T11:23:46.314661+0000","last_peered":"2024-06-13T11:23:46.314661+0000","last_clean":"2024-06-13T11:23:46.314661+0000","last_became_active":"2024-06-13T11:18:42.924900+0000","last_became_peered":"2024-06-13T11:18:42.924900+0000","last_unstale":"2024-06-13T11:23:46.314661+0000","last_undegraded":"2024-06-13T11:23:46.314661+0000","last_fullsized":"2024-06-13T11:23:46.314661+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:21:10.954502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"99'1","reported_seq":33,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315126+0000","last_change":"2024-06-13T11:18:57.029448+0000","last_active":"2024-06-13T11:23:46.315126+0000","last_peered":"2024-06-13T11:23:46.315126+0000","last_clean":"2024-06-13T11:23:46.315126+0000","last_became_active":"2024-06-13T11:18:57.028918+0000","last_became_peered":"2024-06-13T11:18:57.028918+0000","last_unstale":"2024-06-13T11:23:46.315126+0000","last_undegraded":"2024-06-13T11:23:46.315126+0000","last_fullsized":"2024-06-13T11:23:46.315126+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T21:53:06.206458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"97'1","reported_seq":19,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314634+0000","last_change":"2024-06-13T11:19:27.078724+0000","last_active":"2024-06-13T11:23:46.314634+0000","last_peered":"2024-06-13T11:23:46.314634+0000","last_clean":"2024-06-13T11:23:46.314634+0000","last_became_active":"2024-06-13T11:19:27.078329+0000","last_became_peered":"2024-06-13T11:19:27.078329+0000","last_unstale":"2024-06-13T11:23:46.314634+0000","last_undegraded":"2024-06-13T11:23:46.314634+0000","last_fullsized":"2024-06-13T11:23:46.314634+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:25:38.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.285410+0000","last_change":"2024-06-13T11:18:42.930769+0000","last_active":"2024-06-13T11:23:46.285410+0000","last_peered":"2024-06-13T11:23:46.285410+0000","last_clean":"2024-06-13T11:23:46.285410+0000","last_became_active":"2024-06-13T11:18:42.928727+0000","last_became_peered":"2024-06-13T11:18:42.928727+0000","last_unstale":"2024-06-13T11:23:46.285410+0000","last_undegraded":"2024-06-13T11:23:46.285410+0000","last_fullsized":"2024-06-13T11:23:46.285410+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:14:55.202237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315132+0000","last_change":"2024-06-13T11:18:57.185071+0000","last_active":"2024-06-13T11:23:46.315132+0000","last_peered":"2024-06-13T11:23:46.315132+0000","last_clean":"2024-06-13T11:23:46.315132+0000","last_became_active":"2024-06-13T11:18:57.184534+0000","last_became_peered":"2024-06-13T11:18:57.184534+0000","last_unstale":"2024-06-13T11:23:46.315132+0000","last_undegraded":"2024-06-13T11:23:46.315132+0000","last_fullsized":"2024-06-13T11:23:46.315132+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:55:11.146525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.283058+0000","last_change":"2024-06-13T11:18:38.167734+0000","last_active":"2024-06-13T11:23:46.283058+0000","last_peered":"2024-06-13T11:23:46.283058+0000","last_clean":"2024-06-13T11:23:46.283058+0000","last_became_active":"2024-06-13T11:18:38.167345+0000","last_became_peered":"2024-06-13T11:18:38.167345+0000","last_unstale":"2024-06-13T11:23:46.283058+0000","last_undegraded":"2024-06-13T11:23:46.283058+0000","last_fullsized":"2024-06-13T11:23:46.283058+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:55:43.155928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"99'5","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315715+0000","last_change":"2024-06-13T11:18:42.900884+0000","last_active":"2024-06-13T11:23:46.315715+0000","last_peered":"2024-06-13T11:23:46.315715+0000","last_clean":"2024-06-13T11:23:46.315715+0000","last_became_active":"2024-06-13T11:18:42.900562+0000","last_became_peered":"2024-06-13T11:18:42.900562+0000","last_unstale":"2024-06-13T11:23:46.315715+0000","last_undegraded":"2024-06-13T11:23:46.315715+0000","last_fullsized":"2024-06-13T11:23:46.315715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:38:59.480693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300071+0000","last_change":"2024-06-13T11:18:57.015496+0000","last_active":"2024-06-13T11:23:46.300071+0000","last_peered":"2024-06-13T11:23:46.300071+0000","last_clean":"2024-06-13T11:23:46.300071+0000","last_became_active":"2024-06-13T11:18:57.015079+0000","last_became_peered":"2024-06-13T11:18:57.015079+0000","last_unstale":"2024-06-13T11:23:46.300071+0000","last_undegraded":"2024-06-13T11:23:46.300071+0000","last_fullsized":"2024-06-13T11:23:46.300071+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:31:40.130018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"97'3","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144270+0000","last_change":"2024-06-13T11:18:38.523097+0000","last_active":"2024-06-13T11:23:46.144270+0000","last_peered":"2024-06-13T11:23:46.144270+0000","last_clean":"2024-06-13T11:23:46.144270+0000","last_became_active":"2024-06-13T11:18:38.522638+0000","last_became_peered":"2024-06-13T11:18:38.522638+0000","last_unstale":"2024-06-13T11:23:46.144270+0000","last_undegraded":"2024-06-13T11:23:46.144270+0000","last_fullsized":"2024-06-13T11:23:46.144270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:35:36.843246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315685+0000","last_change":"2024-06-13T11:18:42.899281+0000","last_active":"2024-06-13T11:23:46.315685+0000","last_peered":"2024-06-13T11:23:46.315685+0000","last_clean":"2024-06-13T11:23:46.315685+0000","last_became_active":"2024-06-13T11:18:42.898924+0000","last_became_peered":"2024-06-13T11:18:42.898924+0000","last_unstale":"2024-06-13T11:23:46.315685+0000","last_undegraded":"2024-06-13T11:23:46.315685+0000","last_fullsized":"2024-06-13T11:23:46.315685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:18:10.324425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315538+0000","last_change":"2024-06-13T11:18:57.037070+0000","last_active":"2024-06-13T11:23:46.315538+0000","last_peered":"2024-06-13T11:23:46.315538+0000","last_clean":"2024-06-13T11:23:46.315538+0000","last_became_active":"2024-06-13T11:18:57.036632+0000","last_became_peered":"2024-06-13T11:18:57.036632+0000","last_unstale":"2024-06-13T11:23:46.315538+0000","last_undegraded":"2024-06-13T11:23:46.315538+0000","last_fullsized":"2024-06-13T11:23:46.315538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:19:35.433902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"100'39","reported_seq":95,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.436022+0000","last_change":"2024-06-13T11:18:38.170790+0000","last_active":"2024-06-13T11:23:46.436022+0000","last_peered":"2024-06-13T11:23:46.436022+0000","last_clean":"2024-06-13T11:23:46.436022+0000","last_became_active":"2024-06-13T11:18:38.170260+0000","last_became_peered":"2024-06-13T11:18:38.170260+0000","last_unstale":"2024-06-13T11:23:46.436022+0000","last_undegraded":"2024-06-13T11:23:46.436022+0000","last_fullsized":"2024-06-13T11:23:46.436022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T22:11:44.070550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315378+0000","last_change":"2024-06-13T11:18:42.906969+0000","last_active":"2024-06-13T11:23:46.315378+0000","last_peered":"2024-06-13T11:23:46.315378+0000","last_clean":"2024-06-13T11:23:46.315378+0000","last_became_active":"2024-06-13T11:18:42.906657+0000","last_became_peered":"2024-06-13T11:18:42.906657+0000","last_unstale":"2024-06-13T11:23:46.315378+0000","last_undegraded":"2024-06-13T11:23:46.315378+0000","last_fullsized":"2024-06-13T11:23:46.315378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:30:36.414377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.293882+0000","last_change":"2024-06-13T11:18:57.007226+0000","last_active":"2024-06-13T11:23:46.293882+0000","last_peered":"2024-06-13T11:23:46.293882+0000","last_clean":"2024-06-13T11:23:46.293882+0000","last_became_active":"2024-06-13T11:18:57.006803+0000","last_became_peered":"2024-06-13T11:18:57.006803+0000","last_unstale":"2024-06-13T11:23:46.293882+0000","last_undegraded":"2024-06-13T11:23:46.293882+0000","last_fullsized":"2024-06-13T11:23:46.293882+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:55.973620+0000","last_clean_scrub_stamp":"2024-06-13T11:18:55.973620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:08:28.913145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.147156+0000","last_change":"2024-06-13T11:18:38.173327+0000","last_active":"2024-06-13T11:23:46.147156+0000","last_peered":"2024-06-13T11:23:46.147156+0000","last_clean":"2024-06-13T11:23:46.147156+0000","last_became_active":"2024-06-13T11:18:38.172786+0000","last_became_peered":"2024-06-13T11:18:38.172786+0000","last_unstale":"2024-06-13T11:23:46.147156+0000","last_undegraded":"2024-06-13T11:23:46.147156+0000","last_fullsized":"2024-06-13T11:23:46.147156+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:37.141362+0000","last_clean_scrub_stamp":"2024-06-13T11:18:37.141362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T20:40:30.330272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315687+0000","last_change":"2024-06-13T11:18:42.899816+0000","last_active":"2024-06-13T11:23:46.315687+0000","last_peered":"2024-06-13T11:23:46.315687+0000","last_clean":"2024-06-13T11:23:46.315687+0000","last_became_active":"2024-06-13T11:18:42.899495+0000","last_became_peered":"2024-06-13T11:18:42.899495+0000","last_unstale":"2024-06-13T11:23:46.315687+0000","last_undegraded":"2024-06-13T11:23:46.315687+0000","last_fullsized":"2024-06-13T11:23:46.315687+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:16:08.303616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"99'9","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314711+0000","last_change":"2024-06-13T11:18:42.909944+0000","last_active":"2024-06-13T11:23:46.314711+0000","last_peered":"2024-06-13T11:23:46.314711+0000","last_clean":"2024-06-13T11:23:46.314711+0000","last_became_active":"2024-06-13T11:18:42.909557+0000","last_became_peered":"2024-06-13T11:18:42.909557+0000","last_unstale":"2024-06-13T11:23:46.314711+0000","last_undegraded":"2024-06-13T11:23:46.314711+0000","last_fullsized":"2024-06-13T11:23:46.314711+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:22:07.093462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"99'12","reported_seq":54,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144039+0000","last_change":"2024-06-13T11:18:42.912462+0000","last_active":"2024-06-13T11:23:46.144039+0000","last_peered":"2024-06-13T11:23:46.144039+0000","last_clean":"2024-06-13T11:23:46.144039+0000","last_became_active":"2024-06-13T11:18:42.912110+0000","last_became_peered":"2024-06-13T11:18:42.912110+0000","last_unstale":"2024-06-13T11:23:46.144039+0000","last_undegraded":"2024-06-13T11:23:46.144039+0000","last_fullsized":"2024-06-13T11:23:46.144039+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:11:33.123305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.143829+0000","last_change":"2024-06-13T11:18:42.924224+0000","last_active":"2024-06-13T11:23:46.143829+0000","last_peered":"2024-06-13T11:23:46.143829+0000","last_clean":"2024-06-13T11:23:46.143829+0000","last_became_active":"2024-06-13T11:18:42.923858+0000","last_became_peered":"2024-06-13T11:18:42.923858+0000","last_unstale":"2024-06-13T11:23:46.143829+0000","last_undegraded":"2024-06-13T11:23:46.143829+0000","last_fullsized":"2024-06-13T11:23:46.143829+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:36:11.602930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"99'7","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.315807+0000","last_change":"2024-06-13T11:18:42.921160+0000","last_active":"2024-06-13T11:23:46.315807+0000","last_peered":"2024-06-13T11:23:46.315807+0000","last_clean":"2024-06-13T11:23:46.315807+0000","last_became_active":"2024-06-13T11:18:42.920704+0000","last_became_peered":"2024-06-13T11:18:42.920704+0000","last_unstale":"2024-06-13T11:23:46.315807+0000","last_undegraded":"2024-06-13T11:23:46.315807+0000","last_fullsized":"2024-06-13T11:23:46.315807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T15:07:17.023390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"99'4","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.146212+0000","last_change":"2024-06-13T11:18:42.923637+0000","last_active":"2024-06-13T11:23:46.146212+0000","last_peered":"2024-06-13T11:23:46.146212+0000","last_clean":"2024-06-13T11:23:46.146212+0000","last_became_active":"2024-06-13T11:18:42.923234+0000","last_became_peered":"2024-06-13T11:18:42.923234+0000","last_unstale":"2024-06-13T11:23:46.146212+0000","last_undegraded":"2024-06-13T11:23:46.146212+0000","last_fullsized":"2024-06-13T11:23:46.146212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T17:51:19.676747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314932+0000","last_change":"2024-06-13T11:18:42.910300+0000","last_active":"2024-06-13T11:23:46.314932+0000","last_peered":"2024-06-13T11:23:46.314932+0000","last_clean":"2024-06-13T11:23:46.314932+0000","last_became_active":"2024-06-13T11:18:42.909937+0000","last_became_peered":"2024-06-13T11:18:42.909937+0000","last_unstale":"2024-06-13T11:23:46.314932+0000","last_undegraded":"2024-06-13T11:23:46.314932+0000","last_fullsized":"2024-06-13T11:23:46.314932+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:24:51.407238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"99'15","reported_seq":57,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.144370+0000","last_change":"2024-06-13T11:18:42.907066+0000","last_active":"2024-06-13T11:23:46.144370+0000","last_peered":"2024-06-13T11:23:46.144370+0000","last_clean":"2024-06-13T11:23:46.144370+0000","last_became_active":"2024-06-13T11:18:42.906582+0000","last_became_peered":"2024-06-13T11:18:42.906582+0000","last_unstale":"2024-06-13T11:23:46.144370+0000","last_undegraded":"2024-06-13T11:23:46.144370+0000","last_fullsized":"2024-06-13T11:23:46.144370+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:40:02.549931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"99'2","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.286447+0000","last_change":"2024-06-13T11:18:42.910290+0000","last_active":"2024-06-13T11:23:46.286447+0000","last_peered":"2024-06-13T11:23:46.286447+0000","last_clean":"2024-06-13T11:23:46.286447+0000","last_became_active":"2024-06-13T11:18:42.909772+0000","last_became_peered":"2024-06-13T11:18:42.909772+0000","last_unstale":"2024-06-13T11:23:46.286447+0000","last_undegraded":"2024-06-13T11:23:46.286447+0000","last_fullsized":"2024-06-13T11:23:46.286447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T16:05:56.008087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"99'6","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.294008+0000","last_change":"2024-06-13T11:18:42.928792+0000","last_active":"2024-06-13T11:23:46.294008+0000","last_peered":"2024-06-13T11:23:46.294008+0000","last_clean":"2024-06-13T11:23:46.294008+0000","last_became_active":"2024-06-13T11:18:42.928464+0000","last_became_peered":"2024-06-13T11:18:42.928464+0000","last_unstale":"2024-06-13T11:23:46.294008+0000","last_undegraded":"2024-06-13T11:23:46.294008+0000","last_fullsized":"2024-06-13T11:23:46.294008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T19:01:58.686124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.284295+0000","last_change":"2024-06-13T11:18:42.920719+0000","last_active":"2024-06-13T11:23:46.284295+0000","last_peered":"2024-06-13T11:23:46.284295+0000","last_clean":"2024-06-13T11:23:46.284295+0000","last_became_active":"2024-06-13T11:18:42.913355+0000","last_became_peered":"2024-06-13T11:18:42.913355+0000","last_unstale":"2024-06-13T11:23:46.284295+0000","last_undegraded":"2024-06-13T11:23:46.284295+0000","last_fullsized":"2024-06-13T11:23:46.284295+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:25:00.020936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"99'10","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.300352+0000","last_change":"2024-06-13T11:18:42.906709+0000","last_active":"2024-06-13T11:23:46.300352+0000","last_peered":"2024-06-13T11:23:46.300352+0000","last_clean":"2024-06-13T11:23:46.300352+0000","last_became_active":"2024-06-13T11:18:42.906309+0000","last_became_peered":"2024-06-13T11:18:42.906309+0000","last_unstale":"2024-06-13T11:23:46.300352+0000","last_undegraded":"2024-06-13T11:23:46.300352+0000","last_fullsized":"2024-06-13T11:23:46.300352+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:14:09.255670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"99'11","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.147337+0000","last_change":"2024-06-13T11:18:42.926939+0000","last_active":"2024-06-13T11:23:46.147337+0000","last_peered":"2024-06-13T11:23:46.147337+0000","last_clean":"2024-06-13T11:23:46.147337+0000","last_became_active":"2024-06-13T11:18:42.926616+0000","last_became_peered":"2024-06-13T11:18:42.926616+0000","last_unstale":"2024-06-13T11:23:46.147337+0000","last_undegraded":"2024-06-13T11:23:46.147337+0000","last_fullsized":"2024-06-13T11:23:46.147337+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T18:52:46.468479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"99'8","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T11:23:46.314868+0000","last_change":"2024-06-13T11:18:42.901103+0000","last_active":"2024-06-13T11:23:46.314868+0000","last_peered":"2024-06-13T11:23:46.314868+0000","last_clean":"2024-06-13T11:23:46.314868+0000","last_became_active":"2024-06-13T11:18:42.900726+0000","last_became_peered":"2024-06-13T11:18:42.900726+0000","last_unstale":"2024-06-13T11:23:46.314868+0000","last_undegraded":"2024-06-13T11:23:46.314868+0000","last_fullsized":"2024-06-13T11:23:46.314868+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T11:18:41.875064+0000","last_clean_scrub_stamp":"2024-06-13T11:18:41.875064+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:19:55.895451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108816,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600135,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1435,"num_read_kb":828,"num_write":297,"num_write_kb":1446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":1800405,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383758,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1105920,"data_stored":579495,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645393,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36584,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708568,"statfs":{"total":95995035648,"available":95957573632,"internally_reserved":0,"allocated":1277952,"data_stored":1369151,"data_compressed":77941,"data_compressed_allocated":102400,"data_compressed_original":811008,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808919,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1150976,"data_stored":977043,"data_compressed":54659,"data_compressed_allocated":73728,"data_compressed_original":491520,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070558,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1146880,"data_stored":972867,"data_compressed":54659,"data_compressed_allocated":73728,"data_compressed_original":491520,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332195,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1171456,"data_stored":1177011,"data_compressed":71785,"data_compressed_allocated":94208,"data_compressed_original":688128,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495722,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32256,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712896,"statfs":{"total":95995035648,"available":95962005504,"internally_reserved":0,"allocated":1101824,"data_stored":574907,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32328,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712824,"statfs":{"total":95995035648,"available":95961931776,"internally_reserved":0,"allocated":1175552,"data_stored":644294,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738507,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1126400,"data_stored":576295,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36512,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708640,"statfs":{"total":95995035648,"available":95957647360,"internally_reserved":0,"allocated":1200128,"data_stored":646955,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182521,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1159168,"data_stored":1099917,"data_compressed":60815,"data_compressed_allocated":81920,"data_compressed_original":614400,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920885,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1114112,"data_stored":580478,"data_compressed":35513,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757360,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36508,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708644,"statfs":{"total":95995035648,"available":95957651456,"internally_reserved":0,"allocated":1200128,"data_stored":1303278,"data_compressed":77941,"data_compressed_allocated":102400,"data_compressed_original":811008,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36272,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":72138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":133997,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":393954,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":203966,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T11:23:52.574 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:23:52.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:52 smithi002 ceph-mon[32210]: from='client.25217 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:23:52.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:52 smithi178 ceph-mon[36913]: from='client.25217 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:23:53.021 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:23:53.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:52 smithi077 ceph-mon[36410]: from='client.25217 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:23:53.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:53 smithi002 ceph-mon[32210]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:23:53.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:53 smithi002 ceph-mon[32210]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 1 op/s 2024-06-13T11:23:53.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:53 smithi002 ceph-mon[32210]: from='client.25255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:23:53.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:53 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:53.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:53 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:53.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:53 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:53.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:53 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:53.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:53 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:53.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:53 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:53.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:53 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:53.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:53 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:53.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:53 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:53.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:53 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:53.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:53 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:23:53.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:53 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:23:53.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:53 smithi178 ceph-mon[36913]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:23:53.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:53 smithi178 ceph-mon[36913]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 1 op/s 2024-06-13T11:23:53.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:53 smithi178 ceph-mon[36913]: from='client.25255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:23:53.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:53 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:53.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:53 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:53.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:53 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:53.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:53 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:53.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:53 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:53.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:53 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:53.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:53 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:53.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:53 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:53.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:53 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:53.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:53 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:53.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:53 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:23:53.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:53 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:23:54.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:53 smithi077 ceph-mon[36410]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:23:54.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:53 smithi077 ceph-mon[36410]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 1 op/s 2024-06-13T11:23:54.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:53 smithi077 ceph-mon[36410]: from='client.25255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T11:23:54.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:53 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:54.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:53 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:54.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:53 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:54.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:53 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:54.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:53 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:54.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:53 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:54.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:53 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:54.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:53 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:54.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:53 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:54.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:53 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:23:54.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:53 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:23:54.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:53 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:23:54.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:54 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi002 to 177.5M 2024-06-13T11:23:54.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:54 smithi002 ceph-mon[32210]: Unable to set osd_memory_target on smithi002 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-13T11:23:54.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:54 smithi002 ceph-mon[32210]: Updating smithi002:/etc/ceph/ceph.conf 2024-06-13T11:23:54.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:54 smithi002 ceph-mon[32210]: Updating smithi077:/etc/ceph/ceph.conf 2024-06-13T11:23:54.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:54 smithi002 ceph-mon[32210]: Updating smithi178:/etc/ceph/ceph.conf 2024-06-13T11:23:54.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:54 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi002 to 177.5M 2024-06-13T11:23:54.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:54 smithi178 ceph-mon[36913]: Unable to set osd_memory_target on smithi002 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-13T11:23:54.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:54 smithi178 ceph-mon[36913]: Updating smithi002:/etc/ceph/ceph.conf 2024-06-13T11:23:54.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:54 smithi178 ceph-mon[36913]: Updating smithi077:/etc/ceph/ceph.conf 2024-06-13T11:23:54.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:54 smithi178 ceph-mon[36913]: Updating smithi178:/etc/ceph/ceph.conf 2024-06-13T11:23:55.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:54 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi002 to 177.5M 2024-06-13T11:23:55.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:54 smithi077 ceph-mon[36410]: Unable to set osd_memory_target on smithi002 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-13T11:23:55.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:54 smithi077 ceph-mon[36410]: Updating smithi002:/etc/ceph/ceph.conf 2024-06-13T11:23:55.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:54 smithi077 ceph-mon[36410]: Updating smithi077:/etc/ceph/ceph.conf 2024-06-13T11:23:55.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:54 smithi077 ceph-mon[36410]: Updating smithi178:/etc/ceph/ceph.conf 2024-06-13T11:23:55.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.429+0000 7f7cbcc00700 1 -- 172.21.15.2:0/3879285238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cb810a6a0 msgr2=0x7f7cb810aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:55.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.429+0000 7f7cbcc00700 1 --2- 172.21.15.2:0/3879285238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cb810a6a0 0x7f7cb810aa80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009990 tx=0x7f7ca8009ca0 comp rx=0 tx=0).stop 2024-06-13T11:23:55.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.429+0000 7f7cbcc00700 1 -- 172.21.15.2:0/3879285238 shutdown_connections 2024-06-13T11:23:55.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.429+0000 7f7cbcc00700 1 --2- 172.21.15.2:0/3879285238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cb8105060 0x7f7cb8111570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:55.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.429+0000 7f7cbcc00700 1 --2- 172.21.15.2:0/3879285238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cb810a6a0 0x7f7cb810aa80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:55.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.429+0000 7f7cbcc00700 1 --2- 172.21.15.2:0/3879285238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cb81046a0 0x7f7cb8104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:55.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.429+0000 7f7cbcc00700 1 -- 172.21.15.2:0/3879285238 >> 172.21.15.2:0/3879285238 conn(0x7f7cb8100190 msgr2=0x7f7cb81025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:55.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.429+0000 7f7cbcc00700 1 -- 172.21.15.2:0/3879285238 shutdown_connections 2024-06-13T11:23:55.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.429+0000 7f7cbcc00700 1 -- 172.21.15.2:0/3879285238 wait complete. 2024-06-13T11:23:55.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.430+0000 7f7cbcc00700 1 Processor -- start 2024-06-13T11:23:55.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.430+0000 7f7cbcc00700 1 -- start start 2024-06-13T11:23:55.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.431+0000 7f7cbcc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cb81046a0 0x7f7cb819ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:55.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.431+0000 7f7cbcc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cb8105060 0x7f7cb819b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:55.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.431+0000 7f7cbcc00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cb810a6a0 0x7f7cb819f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:55.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.431+0000 7f7cbcc00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb8114a40 con 0x7f7cb8105060 2024-06-13T11:23:55.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.431+0000 7f7cbcc00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb81148c0 con 0x7f7cb810a6a0 2024-06-13T11:23:55.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.431+0000 7f7cbcc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb8114bc0 con 0x7f7cb81046a0 2024-06-13T11:23:55.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.431+0000 7f7cb5e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cb81046a0 0x7f7cb819ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:55.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.431+0000 7f7cb5e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cb81046a0 0x7f7cb819ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:37552/0 (socket says 172.21.15.2:37552) 2024-06-13T11:23:55.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.431+0000 7f7cb5e00700 1 -- 172.21.15.2:0/3991728824 learned_addr learned my addr 172.21.15.2:0/3991728824 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:55.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.431+0000 7f7cb5400700 1 --2- 172.21.15.2:0/3991728824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cb8105060 0x7f7cb819b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:55.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.431+0000 7f7cb6800700 1 --2- 172.21.15.2:0/3991728824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cb810a6a0 0x7f7cb819f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:55.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.432+0000 7f7cb5e00700 1 -- 172.21.15.2:0/3991728824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cb810a6a0 msgr2=0x7f7cb819f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:55.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.432+0000 7f7cb5e00700 1 --2- 172.21.15.2:0/3991728824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cb810a6a0 0x7f7cb819f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:55.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.432+0000 7f7cb5e00700 1 -- 172.21.15.2:0/3991728824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cb8105060 msgr2=0x7f7cb819b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:55.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.432+0000 7f7cb5e00700 1 --2- 172.21.15.2:0/3991728824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cb8105060 0x7f7cb819b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:55.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.432+0000 7f7cb5e00700 1 -- 172.21.15.2:0/3991728824 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb819fe50 con 0x7f7cb81046a0 2024-06-13T11:23:55.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.432+0000 7f7cb6800700 1 --2- 172.21.15.2:0/3991728824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cb810a6a0 0x7f7cb819f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:23:55.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.432+0000 7f7cb5e00700 1 --2- 172.21.15.2:0/3991728824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cb81046a0 0x7f7cb819ae90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8000c00 tx=0x7f7ca800bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:55.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.432+0000 7f7caea00700 1 -- 172.21.15.2:0/3991728824 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8027070 con 0x7f7cb81046a0 2024-06-13T11:23:55.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.433+0000 7f7cbcc00700 1 -- 172.21.15.2:0/3991728824 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb81a00e0 con 0x7f7cb81046a0 2024-06-13T11:23:55.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.433+0000 7f7caea00700 1 -- 172.21.15.2:0/3991728824 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca8003d70 con 0x7f7cb81046a0 2024-06-13T11:23:55.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.433+0000 7f7caea00700 1 -- 172.21.15.2:0/3991728824 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800f460 con 0x7f7cb81046a0 2024-06-13T11:23:55.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.433+0000 7f7cbcc00700 1 -- 172.21.15.2:0/3991728824 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb81a79c0 con 0x7f7cb81046a0 2024-06-13T11:23:55.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.434+0000 7f7cbcc00700 1 -- 172.21.15.2:0/3991728824 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb8069180 con 0x7f7cb81046a0 2024-06-13T11:23:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.436+0000 7f7caea00700 1 -- 172.21.15.2:0/3991728824 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7f7ca802a070 con 0x7f7cb81046a0 2024-06-13T11:23:55.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.437+0000 7f7caea00700 1 --2- 172.21.15.2:0/3991728824 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7c9c0a2ea0 0x7f7c9c0a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:55.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.437+0000 7f7caea00700 1 -- 172.21.15.2:0/3991728824 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f7ca80d0640 con 0x7f7cb81046a0 2024-06-13T11:23:55.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.438+0000 7f7cb5400700 1 --2- 172.21.15.2:0/3991728824 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7c9c0a2ea0 0x7f7c9c0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:55.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.438+0000 7f7cb5400700 1 --2- 172.21.15.2:0/3991728824 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7c9c0a2ea0 0x7f7c9c0a5360 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7cb81027f0 tx=0x7f7ca4009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:55.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.441+0000 7f7caea00700 1 -- 172.21.15.2:0/3991728824 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7ca8013070 con 0x7f7cb81046a0 2024-06-13T11:23:55.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.738+0000 7f7cbcc00700 1 -- 172.21.15.2:0/3991728824 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cb802dca0 con 0x7f7cb81046a0 2024-06-13T11:23:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.739+0000 7f7caea00700 1 -- 172.21.15.2:0/3991728824 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11853 (secure 0 0 0) 0x7f7ca809cdb0 con 0x7f7cb81046a0 2024-06-13T11:23:55.739 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:23:55.739 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:23:44.392864+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24493,24509,24511]},"id":1}]} 2024-06-13T11:23:55.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.743+0000 7f7cbcc00700 1 -- 172.21.15.2:0/3991728824 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7c9c0a2ea0 msgr2=0x7f7c9c0a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.743+0000 7f7cbcc00700 1 --2- 172.21.15.2:0/3991728824 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7c9c0a2ea0 0x7f7c9c0a5360 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7cb81027f0 tx=0x7f7ca4009260 comp rx=0 tx=0).stop 2024-06-13T11:23:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.743+0000 7f7cbcc00700 1 -- 172.21.15.2:0/3991728824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cb81046a0 msgr2=0x7f7cb819ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.743+0000 7f7cbcc00700 1 --2- 172.21.15.2:0/3991728824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cb81046a0 0x7f7cb819ae90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8000c00 tx=0x7f7ca800bab0 comp rx=0 tx=0).stop 2024-06-13T11:23:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.743+0000 7f7cbcc00700 1 -- 172.21.15.2:0/3991728824 shutdown_connections 2024-06-13T11:23:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.743+0000 7f7cbcc00700 1 --2- 172.21.15.2:0/3991728824 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7c9c0a2ea0 0x7f7c9c0a5360 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.743+0000 7f7cbcc00700 1 --2- 172.21.15.2:0/3991728824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7cb810a6a0 0x7f7cb819f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.743+0000 7f7cbcc00700 1 --2- 172.21.15.2:0/3991728824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cb81046a0 0x7f7cb819ae90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.743+0000 7f7cbcc00700 1 --2- 172.21.15.2:0/3991728824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cb8105060 0x7f7cb819b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.743+0000 7f7cbcc00700 1 -- 172.21.15.2:0/3991728824 >> 172.21.15.2:0/3991728824 conn(0x7f7cb8100190 msgr2=0x7f7cb8100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.743+0000 7f7cbcc00700 1 -- 172.21.15.2:0/3991728824 shutdown_connections 2024-06-13T11:23:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:55.743+0000 7f7cbcc00700 1 -- 172.21.15.2:0/3991728824 wait complete. 2024-06-13T11:23:55.743 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-06-13T11:23:55.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:55 smithi178 ceph-mon[36913]: Updating smithi178:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:23:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:55 smithi178 ceph-mon[36913]: Updating smithi077:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:23:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:55 smithi178 ceph-mon[36913]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:23:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:55 smithi178 ceph-mon[36913]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:23:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:55 smithi178 ceph-mon[36913]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 293 B/s wr, 22 op/s 2024-06-13T11:23:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:55 smithi178 ceph-mon[36913]: Updating smithi002:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:23:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:55 smithi178 ceph-mon[36913]: Updating smithi077:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T11:23:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:55 smithi178 ceph-mon[36913]: Updating smithi178:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T11:23:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:55 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:55 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:55 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:55.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:55 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:56.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:55 smithi077 ceph-mon[36410]: Updating smithi178:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:23:56.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:55 smithi077 ceph-mon[36410]: Updating smithi077:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:23:56.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:55 smithi077 ceph-mon[36410]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:23:56.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:55 smithi077 ceph-mon[36410]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:23:56.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:55 smithi077 ceph-mon[36410]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 293 B/s wr, 22 op/s 2024-06-13T11:23:56.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:55 smithi077 ceph-mon[36410]: Updating smithi002:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:23:56.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:55 smithi077 ceph-mon[36410]: Updating smithi077:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T11:23:56.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:55 smithi077 ceph-mon[36410]: Updating smithi178:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T11:23:56.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:55 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:56.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:55 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:56.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:55 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:56.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:55 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:56.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:55 smithi002 ceph-mon[32210]: Updating smithi178:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:23:56.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:55 smithi002 ceph-mon[32210]: Updating smithi077:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:23:56.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:55 smithi002 ceph-mon[32210]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:23:56.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:55 smithi002 ceph-mon[32210]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:23:56.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:55 smithi002 ceph-mon[32210]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 293 B/s wr, 22 op/s 2024-06-13T11:23:56.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:55 smithi002 ceph-mon[32210]: Updating smithi002:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T11:23:56.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:55 smithi002 ceph-mon[32210]: Updating smithi077:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T11:23:56.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:55 smithi002 ceph-mon[32210]: Updating smithi178:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T11:23:56.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:55 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:56.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:55 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:56.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:55 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:56.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:55 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:56.674 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T11:23:56.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:56 smithi002 ceph-mon[32210]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:23:56.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:56 smithi002 ceph-mon[32210]: Updating smithi002:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T11:23:56.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:56 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3991728824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:23:56.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:56 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:56.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:56 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:56.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:56 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:56.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:56 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:23:56.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:56 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:23:56.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:56 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:23:56.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:56 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:57.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:56 smithi077 ceph-mon[36410]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:23:57.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:56 smithi077 ceph-mon[36410]: Updating smithi002:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T11:23:57.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:56 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3991728824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:23:57.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:56 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:57.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:56 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:57.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:56 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:57.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:56 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:23:57.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:56 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:23:57.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:56 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:23:57.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:56 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:57.130 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:23:57.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:56 smithi178 ceph-mon[36913]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-06-13T11:23:57.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:56 smithi178 ceph-mon[36913]: Updating smithi002:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T11:23:57.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:56 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3991728824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:23:57.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:56 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:57.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:56 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:57.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:56 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:57.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:56 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:23:57.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:56 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:23:57.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:56 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:23:57.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:56 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:23:58.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:57 smithi077 ceph-mon[36410]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 227 B/s wr, 17 op/s 2024-06-13T11:23:58.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:57 smithi002 ceph-mon[32210]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 227 B/s wr, 17 op/s 2024-06-13T11:23:58.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:57 smithi178 ceph-mon[36913]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 227 B/s wr, 17 op/s 2024-06-13T11:23:59.011 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:58 smithi002 ceph-mon[32210]: pgmap v9: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 186 B/s wr, 16 op/s 2024-06-13T11:23:59.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:58 smithi077 ceph-mon[36410]: pgmap v9: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 186 B/s wr, 16 op/s 2024-06-13T11:23:59.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:58 smithi178 ceph-mon[36913]: pgmap v9: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 186 B/s wr, 16 op/s 2024-06-13T11:23:59.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.565+0000 7f375a400700 1 -- 172.21.15.2:0/4261341303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37541068a0 msgr2=0x7f3754111530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:59.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.565+0000 7f375a400700 1 --2- 172.21.15.2:0/4261341303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37541068a0 0x7f3754111530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f374c009f90 tx=0x7f374c00b330 comp rx=0 tx=0).stop 2024-06-13T11:23:59.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.565+0000 7f375a400700 1 -- 172.21.15.2:0/4261341303 shutdown_connections 2024-06-13T11:23:59.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.565+0000 7f375a400700 1 --2- 172.21.15.2:0/4261341303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37541048d0 0x7f3754104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:59.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.565+0000 7f375a400700 1 --2- 172.21.15.2:0/4261341303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37541068a0 0x7f3754111530 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:59.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.565+0000 7f375a400700 1 --2- 172.21.15.2:0/4261341303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37541051f0 0x7f3754106170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:59.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.565+0000 7f375a400700 1 -- 172.21.15.2:0/4261341303 >> 172.21.15.2:0/4261341303 conn(0x7f3754100040 msgr2=0x7f3754102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:59.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.565+0000 7f375a400700 1 -- 172.21.15.2:0/4261341303 shutdown_connections 2024-06-13T11:23:59.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.565+0000 7f375a400700 1 -- 172.21.15.2:0/4261341303 wait complete. 2024-06-13T11:23:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.567+0000 7f375a400700 1 Processor -- start 2024-06-13T11:23:59.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.567+0000 7f375a400700 1 -- start start 2024-06-13T11:23:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.567+0000 7f375a400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37541048d0 0x7f375419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.567+0000 7f375a400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37541051f0 0x7f375419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.567+0000 7f375a400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37541068a0 0x7f375419f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.568+0000 7f375a400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f37541149c0 con 0x7f37541068a0 2024-06-13T11:23:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.568+0000 7f375a400700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3754114840 con 0x7f37541051f0 2024-06-13T11:23:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.568+0000 7f375a400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3754114b40 con 0x7f37541048d0 2024-06-13T11:23:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.568+0000 7f3753e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37541051f0 0x7f375419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.568+0000 7f3759a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37541068a0 0x7f375419f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:59.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.568+0000 7f3759000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37541048d0 0x7f375419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.568+0000 7f3753e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37541051f0 0x7f375419b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:53066/0 (socket says 172.21.15.2:53066) 2024-06-13T11:23:59.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.568+0000 7f3753e00700 1 -- 172.21.15.2:0/314891024 learned_addr learned my addr 172.21.15.2:0/314891024 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:23:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.568+0000 7f3753e00700 1 -- 172.21.15.2:0/314891024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37541048d0 msgr2=0x7f375419ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.568+0000 7f3753e00700 1 --2- 172.21.15.2:0/314891024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37541048d0 0x7f375419ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.569+0000 7f3753e00700 1 -- 172.21.15.2:0/314891024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37541068a0 msgr2=0x7f375419f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.569+0000 7f3753e00700 1 --2- 172.21.15.2:0/314891024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37541068a0 0x7f375419f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.569+0000 7f3753e00700 1 -- 172.21.15.2:0/314891024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375419fe20 con 0x7f37541051f0 2024-06-13T11:23:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.569+0000 7f3759000700 1 --2- 172.21.15.2:0/314891024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37541048d0 0x7f375419ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:23:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.569+0000 7f3753e00700 1 --2- 172.21.15.2:0/314891024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37541051f0 0x7f375419b350 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f374000e9c0 tx=0x7f374000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.569+0000 7f3751600700 1 -- 172.21.15.2:0/314891024 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740004a30 con 0x7f37541051f0 2024-06-13T11:23:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.569+0000 7f3751600700 1 -- 172.21.15.2:0/314891024 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f374000cca0 con 0x7f37541051f0 2024-06-13T11:23:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.569+0000 7f375a400700 1 -- 172.21.15.2:0/314891024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37541a0110 con 0x7f37541051f0 2024-06-13T11:23:59.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.569+0000 7f3751600700 1 -- 172.21.15.2:0/314891024 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740005660 con 0x7f37541051f0 2024-06-13T11:23:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.570+0000 7f375a400700 1 -- 172.21.15.2:0/314891024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37541a7990 con 0x7f37541051f0 2024-06-13T11:23:59.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.571+0000 7f375a400700 1 -- 172.21.15.2:0/314891024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3754069180 con 0x7f37541051f0 2024-06-13T11:23:59.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.573+0000 7f3751600700 1 -- 172.21.15.2:0/314891024 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7f374000c7c0 con 0x7f37541051f0 2024-06-13T11:23:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.574+0000 7f3751600700 1 --2- 172.21.15.2:0/314891024 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f373c0a2e20 0x7f373c0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:23:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.574+0000 7f3751600700 1 -- 172.21.15.2:0/314891024 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f37400cfaf0 con 0x7f37541051f0 2024-06-13T11:23:59.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.574+0000 7f3759000700 1 --2- 172.21.15.2:0/314891024 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f373c0a2e20 0x7f373c0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:23:59.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.575+0000 7f3759000700 1 --2- 172.21.15.2:0/314891024 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f373c0a2e20 0x7f373c0a52e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3748011490 tx=0x7f3748009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:23:59.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.578+0000 7f3751600700 1 -- 172.21.15.2:0/314891024 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f374000b2c0 con 0x7f37541051f0 2024-06-13T11:23:59.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.810+0000 7f375a400700 1 -- 172.21.15.2:0/314891024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f375419c170 con 0x7f37541051f0 2024-06-13T11:23:59.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.813+0000 7f3751600700 1 -- 172.21.15.2:0/314891024 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+24981 (secure 0 0 0) 0x7f374009c1d0 con 0x7f37541051f0 2024-06-13T11:23:59.812 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:23:59.813 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":100,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","created":"2024-06-13T11:09:07.839101+0000","modified":"2024-06-13T11:23:46.133416+0000","last_up_change":"2024-06-13T11:17:28.731479+0000","last_in_change":"2024-06-13T11:17:08.849067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:13:13.793461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:18:36.784824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:18:41.824835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:18:55.545870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f5614d91-49a7-4983-a309-0de3b3e6263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6803","nonce":4127571834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6805","nonce":4127571834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6809","nonce":4127571834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6807","nonce":4127571834}]},"public_addr":"172.21.15.2:6803/4127571834","cluster_addr":"172.21.15.2:6805/4127571834","heartbeat_back_addr":"172.21.15.2:6809/4127571834","heartbeat_front_addr":"172.21.15.2:6807/4127571834","state":["exists","up"]},{"osd":1,"uuid":"d9dbe278-309f-4726-828a-da922f486b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6801","nonce":3180360713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6803","nonce":3180360713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6807","nonce":3180360713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6805","nonce":3180360713}]},"public_addr":"172.21.15.77:6801/3180360713","cluster_addr":"172.21.15.77:6803/3180360713","heartbeat_back_addr":"172.21.15.77:6807/3180360713","heartbeat_front_addr":"172.21.15.77:6805/3180360713","state":["exists","up"]},{"osd":2,"uuid":"04c267dc-7454-418f-9965-3ff96ef280ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6801","nonce":3825510575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6803","nonce":3825510575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6807","nonce":3825510575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6805","nonce":3825510575}]},"public_addr":"172.21.15.178:6801/3825510575","cluster_addr":"172.21.15.178:6803/3825510575","heartbeat_back_addr":"172.21.15.178:6807/3825510575","heartbeat_front_addr":"172.21.15.178:6805/3825510575","state":["exists","up"]},{"osd":3,"uuid":"3847bd4f-ca04-41de-9d88-e1523dd7ff8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6811","nonce":1982693353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6813","nonce":1982693353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6817","nonce":1982693353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6815","nonce":1982693353}]},"public_addr":"172.21.15.2:6811/1982693353","cluster_addr":"172.21.15.2:6813/1982693353","heartbeat_back_addr":"172.21.15.2:6817/1982693353","heartbeat_front_addr":"172.21.15.2:6815/1982693353","state":["exists","up"]},{"osd":4,"uuid":"34d7d2e8-3dee-42b9-a6cb-d4162b122b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6809","nonce":3916694904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6811","nonce":3916694904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6815","nonce":3916694904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6813","nonce":3916694904}]},"public_addr":"172.21.15.77:6809/3916694904","cluster_addr":"172.21.15.77:6811/3916694904","heartbeat_back_addr":"172.21.15.77:6815/3916694904","heartbeat_front_addr":"172.21.15.77:6813/3916694904","state":["exists","up"]},{"osd":5,"uuid":"0468aefc-c3c8-4758-9bbf-1225b7a5ae79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6809","nonce":3572805887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6811","nonce":3572805887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6815","nonce":3572805887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6813","nonce":3572805887}]},"public_addr":"172.21.15.178:6809/3572805887","cluster_addr":"172.21.15.178:6811/3572805887","heartbeat_back_addr":"172.21.15.178:6815/3572805887","heartbeat_front_addr":"172.21.15.178:6813/3572805887","state":["exists","up"]},{"osd":6,"uuid":"0a186a4a-0e28-47bd-b5ad-9bf8079f74c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6819","nonce":1592309584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6821","nonce":1592309584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6825","nonce":1592309584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6823","nonce":1592309584}]},"public_addr":"172.21.15.2:6819/1592309584","cluster_addr":"172.21.15.2:6821/1592309584","heartbeat_back_addr":"172.21.15.2:6825/1592309584","heartbeat_front_addr":"172.21.15.2:6823/1592309584","state":["exists","up"]},{"osd":7,"uuid":"646e66f7-1ef8-428d-a842-bf28c8606df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6817","nonce":1580055775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6819","nonce":1580055775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6823","nonce":1580055775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6821","nonce":1580055775}]},"public_addr":"172.21.15.77:6817/1580055775","cluster_addr":"172.21.15.77:6819/1580055775","heartbeat_back_addr":"172.21.15.77:6823/1580055775","heartbeat_front_addr":"172.21.15.77:6821/1580055775","state":["exists","up"]},{"osd":8,"uuid":"bcc971fc-47d7-4289-8a9a-c76996c57370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6817","nonce":4285192591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6819","nonce":4285192591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6823","nonce":4285192591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6821","nonce":4285192591}]},"public_addr":"172.21.15.178:6817/4285192591","cluster_addr":"172.21.15.178:6819/4285192591","heartbeat_back_addr":"172.21.15.178:6823/4285192591","heartbeat_front_addr":"172.21.15.178:6821/4285192591","state":["exists","up"]},{"osd":9,"uuid":"899d7d4f-a24c-4508-b42c-0b363275c459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6827","nonce":4187017478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6829","nonce":4187017478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6833","nonce":4187017478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6831","nonce":4187017478}]},"public_addr":"172.21.15.2:6827/4187017478","cluster_addr":"172.21.15.2:6829/4187017478","heartbeat_back_addr":"172.21.15.2:6833/4187017478","heartbeat_front_addr":"172.21.15.2:6831/4187017478","state":["exists","up"]},{"osd":10,"uuid":"112d2b8e-9673-4d7a-97e9-2089793fdd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6825","nonce":2039538463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6827","nonce":2039538463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6831","nonce":2039538463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6829","nonce":2039538463}]},"public_addr":"172.21.15.77:6825/2039538463","cluster_addr":"172.21.15.77:6827/2039538463","heartbeat_back_addr":"172.21.15.77:6831/2039538463","heartbeat_front_addr":"172.21.15.77:6829/2039538463","state":["exists","up"]},{"osd":11,"uuid":"6b8001f5-9c74-4cc7-8c41-906cb5ac9b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6825","nonce":1915058767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6827","nonce":1915058767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6831","nonce":1915058767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6829","nonce":1915058767}]},"public_addr":"172.21.15.178:6825/1915058767","cluster_addr":"172.21.15.178:6827/1915058767","heartbeat_back_addr":"172.21.15.178:6831/1915058767","heartbeat_front_addr":"172.21.15.178:6829/1915058767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:21.707572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:46.440115+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:10.197217+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:42.853367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:08.880473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:33.605677+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:07.655377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:33.980900+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:59.397529+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:16:33.983411+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:00.932649+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:26.894098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9},{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/682201811":"2024-06-14T11:23:46.133309+0000","172.21.15.2:6801/3387272091":"2024-06-14T11:23:46.133309+0000","172.21.15.2:0/778891449":"2024-06-14T11:23:46.133309+0000","172.21.15.2:0/88846693":"2024-06-14T11:23:46.133309+0000","172.21.15.2:0/315567313":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/2084201061":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/3387272091":"2024-06-14T11:23:46.133309+0000","172.21.15.2:0/3394644803":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6801/1821969949":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/2170469985":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/1640275700":"2024-06-14T11:23:46.133309+0000","172.21.15.2:0/142516651":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6801/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/3220886565":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6800/1821969949":"2024-06-14T11:10:25.084617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:23:59.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.816+0000 7f375a400700 1 -- 172.21.15.2:0/314891024 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f373c0a2e20 msgr2=0x7f373c0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:59.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.816+0000 7f375a400700 1 --2- 172.21.15.2:0/314891024 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f373c0a2e20 0x7f373c0a52e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3748011490 tx=0x7f3748009260 comp rx=0 tx=0).stop 2024-06-13T11:23:59.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.816+0000 7f375a400700 1 -- 172.21.15.2:0/314891024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37541051f0 msgr2=0x7f375419b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:23:59.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.816+0000 7f375a400700 1 --2- 172.21.15.2:0/314891024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37541051f0 0x7f375419b350 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f374000e9c0 tx=0x7f374000ecd0 comp rx=0 tx=0).stop 2024-06-13T11:23:59.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.817+0000 7f375a400700 1 -- 172.21.15.2:0/314891024 shutdown_connections 2024-06-13T11:23:59.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.817+0000 7f375a400700 1 --2- 172.21.15.2:0/314891024 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f373c0a2e20 0x7f373c0a52e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:59.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.817+0000 7f375a400700 1 --2- 172.21.15.2:0/314891024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37541068a0 0x7f375419f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:59.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.817+0000 7f375a400700 1 --2- 172.21.15.2:0/314891024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37541048d0 0x7f375419ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:59.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.817+0000 7f375a400700 1 --2- 172.21.15.2:0/314891024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37541051f0 0x7f375419b350 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:23:59.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.817+0000 7f375a400700 1 -- 172.21.15.2:0/314891024 >> 172.21.15.2:0/314891024 conn(0x7f3754100040 msgr2=0x7f3754101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:23:59.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.817+0000 7f375a400700 1 -- 172.21.15.2:0/314891024 shutdown_connections 2024-06-13T11:23:59.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:23:59.817+0000 7f375a400700 1 -- 172.21.15.2:0/314891024 wait complete. 2024-06-13T11:24:00.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:23:59 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/314891024' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:24:00.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:23:59 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/314891024' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:24:00.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:23:59 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/314891024' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:24:00.801 DEBUG:tasks.fwd_scrub:Yielding 2024-06-13T11:24:00.801 INFO:teuthology.run_tasks:Running task exec... 2024-06-13T11:24:00.810 INFO:teuthology.task.exec:Executing custom commands... 2024-06-13T11:24:00.810 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T11:24:00.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-06-13T11:24:00.811 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-06-13T11:24:00.811 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-13T11:24:00.811 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-13T11:24:01.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.015+0000 7fd576a00640 1 -- 172.21.15.2:0/3978921878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd570101990 msgr2=0x7fd570101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:01.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.015+0000 7fd576a00640 1 --2- 172.21.15.2:0/3978921878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd570101990 0x7fd570101e10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd558009860 tx=0x7fd55802a340 comp rx=0 tx=0).stop 2024-06-13T11:24:01.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.015+0000 7fd576a00640 1 -- 172.21.15.2:0/3978921878 shutdown_connections 2024-06-13T11:24:01.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.015+0000 7fd576a00640 1 --2- 172.21.15.2:0/3978921878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd570102350 0x7fd57010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.015+0000 7fd576a00640 1 --2- 172.21.15.2:0/3978921878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd570101990 0x7fd570101e10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.015+0000 7fd576a00640 1 --2- 172.21.15.2:0/3978921878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5701079a0 0x7fd570107d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.015+0000 7fd576a00640 1 -- 172.21.15.2:0/3978921878 >> 172.21.15.2:0/3978921878 conn(0x7fd5700fd460 msgr2=0x7fd5700ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:01.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.015+0000 7fd576a00640 1 -- 172.21.15.2:0/3978921878 shutdown_connections 2024-06-13T11:24:01.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.015+0000 7fd576a00640 1 -- 172.21.15.2:0/3978921878 wait complete. 2024-06-13T11:24:01.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.017+0000 7fd576a00640 1 Processor -- start 2024-06-13T11:24:01.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.017+0000 7fd576a00640 1 -- start start 2024-06-13T11:24:01.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.018+0000 7fd576a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd570101990 0x7fd57019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:01.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.018+0000 7fd576a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd570102350 0x7fd57019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:01.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.018+0000 7fd576a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5701079a0 0x7fd57019ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:01.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.018+0000 7fd576a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd570111db0 con 0x7fd570102350 2024-06-13T11:24:01.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.018+0000 7fd576a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd570111c30 con 0x7fd5701079a0 2024-06-13T11:24:01.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.018+0000 7fd576a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd570111f30 con 0x7fd570101990 2024-06-13T11:24:01.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.018+0000 7fd56fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd570101990 0x7fd57019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:01.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.018+0000 7fd567e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd570102350 0x7fd57019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:01.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.018+0000 7fd56fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd570101990 0x7fd57019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56496/0 (socket says 172.21.15.2:56496) 2024-06-13T11:24:01.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.018+0000 7fd574a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5701079a0 0x7fd57019ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:01.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.018+0000 7fd56fe00640 1 -- 172.21.15.2:0/2750876856 learned_addr learned my addr 172.21.15.2:0/2750876856 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:01.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.019+0000 7fd567e00640 1 -- 172.21.15.2:0/2750876856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd570101990 msgr2=0x7fd57019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:01.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.019+0000 7fd567e00640 1 --2- 172.21.15.2:0/2750876856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd570101990 0x7fd57019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.019+0000 7fd567e00640 1 -- 172.21.15.2:0/2750876856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5701079a0 msgr2=0x7fd57019ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:01.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.019+0000 7fd567e00640 1 --2- 172.21.15.2:0/2750876856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5701079a0 0x7fd57019ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.019+0000 7fd567e00640 1 -- 172.21.15.2:0/2750876856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57019f460 con 0x7fd570102350 2024-06-13T11:24:01.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.019+0000 7fd56fe00640 1 --2- 172.21.15.2:0/2750876856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd570101990 0x7fd57019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:24:01.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.019+0000 7fd574a00640 1 --2- 172.21.15.2:0/2750876856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5701079a0 0x7fd57019ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:24:01.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.019+0000 7fd567e00640 1 --2- 172.21.15.2:0/2750876856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd570102350 0x7fd57019a9b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd55802a860 tx=0x7fd558033b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:01.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.019+0000 7fd56d600640 1 -- 172.21.15.2:0/2750876856 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558037040 con 0x7fd570102350 2024-06-13T11:24:01.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.019+0000 7fd56d600640 1 -- 172.21.15.2:0/2750876856 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd558033d50 con 0x7fd570102350 2024-06-13T11:24:01.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.019+0000 7fd56d600640 1 -- 172.21.15.2:0/2750876856 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5580039e0 con 0x7fd570102350 2024-06-13T11:24:01.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.019+0000 7fd576a00640 1 -- 172.21.15.2:0/2750876856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd57019f6f0 con 0x7fd570102350 2024-06-13T11:24:01.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.020+0000 7fd576a00640 1 -- 172.21.15.2:0/2750876856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5701a6fe0 con 0x7fd570102350 2024-06-13T11:24:01.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.021+0000 7fd576a00640 1 -- 172.21.15.2:0/2750876856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd57004ffb0 con 0x7fd570102350 2024-06-13T11:24:01.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.024+0000 7fd56d600640 1 -- 172.21.15.2:0/2750876856 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7fd558042020 con 0x7fd570102350 2024-06-13T11:24:01.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.027+0000 7fd56d600640 1 --2- 172.21.15.2:0/2750876856 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd5540a2d80 0x7fd5540a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:01.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.027+0000 7fd56d600640 1 -- 172.21.15.2:0/2750876856 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fd5580eee00 con 0x7fd570102350 2024-06-13T11:24:01.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.027+0000 7fd56fe00640 1 --2- 172.21.15.2:0/2750876856 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd5540a2d80 0x7fd5540a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:01.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.028+0000 7fd56fe00640 1 --2- 172.21.15.2:0/2750876856 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd5540a2d80 0x7fd5540a5240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd560011490 tx=0x7fd560005f90 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:01.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.032+0000 7fd56d600640 1 -- 172.21.15.2:0/2750876856 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd558049020 con 0x7fd570102350 2024-06-13T11:24:01.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:00 smithi002 ceph-mon[32210]: pgmap v10: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 170 B/s wr, 15 op/s 2024-06-13T11:24:01.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:00 smithi178 ceph-mon[36913]: pgmap v10: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 170 B/s wr, 15 op/s 2024-06-13T11:24:01.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.250+0000 7fd576a00640 1 -- 172.21.15.2:0/2750876856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fd5701a7240 con 0x7fd570102350 2024-06-13T11:24:01.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.255+0000 7fd56d600640 1 -- 172.21.15.2:0/2750876856 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v31)=0 v31) ==== 129+0+0 (secure 0 0 0) 0x7fd5580bb5f0 con 0x7fd570102350 2024-06-13T11:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.259+0000 7fd576a00640 1 -- 172.21.15.2:0/2750876856 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd5540a2d80 msgr2=0x7fd5540a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.259+0000 7fd576a00640 1 --2- 172.21.15.2:0/2750876856 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd5540a2d80 0x7fd5540a5240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd560011490 tx=0x7fd560005f90 comp rx=0 tx=0).stop 2024-06-13T11:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.259+0000 7fd576a00640 1 -- 172.21.15.2:0/2750876856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd570102350 msgr2=0x7fd57019a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.259+0000 7fd576a00640 1 --2- 172.21.15.2:0/2750876856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd570102350 0x7fd57019a9b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd55802a860 tx=0x7fd558033b60 comp rx=0 tx=0).stop 2024-06-13T11:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.259+0000 7fd576a00640 1 -- 172.21.15.2:0/2750876856 shutdown_connections 2024-06-13T11:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.259+0000 7fd576a00640 1 --2- 172.21.15.2:0/2750876856 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd5540a2d80 0x7fd5540a5240 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.259+0000 7fd576a00640 1 --2- 172.21.15.2:0/2750876856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5701079a0 0x7fd57019ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.259+0000 7fd576a00640 1 --2- 172.21.15.2:0/2750876856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd570102350 0x7fd57019a9b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.259+0000 7fd576a00640 1 --2- 172.21.15.2:0/2750876856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd570101990 0x7fd57019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.259+0000 7fd576a00640 1 -- 172.21.15.2:0/2750876856 >> 172.21.15.2:0/2750876856 conn(0x7fd5700fd460 msgr2=0x7fd57010d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:01.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.259+0000 7fd576a00640 1 -- 172.21.15.2:0/2750876856 shutdown_connections 2024-06-13T11:24:01.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.259+0000 7fd576a00640 1 -- 172.21.15.2:0/2750876856 wait complete. 2024-06-13T11:24:01.271 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:24:01.278 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-06-13T11:24:01.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:00 smithi077 ceph-mon[36410]: pgmap v10: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 170 B/s wr, 15 op/s 2024-06-13T11:24:01.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.477+0000 7f7a53200640 1 -- 172.21.15.2:0/2290408501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a541017c0 msgr2=0x7f7a54101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:01.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.477+0000 7f7a53200640 1 --2- 172.21.15.2:0/2290408501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a541017c0 0x7f7a54101c40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009930 tx=0x7f7a4002a420 comp rx=0 tx=0).stop 2024-06-13T11:24:01.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.478+0000 7f7a53200640 1 -- 172.21.15.2:0/2290408501 shutdown_connections 2024-06-13T11:24:01.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.478+0000 7f7a53200640 1 --2- 172.21.15.2:0/2290408501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a541017c0 0x7f7a54101c40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.478+0000 7f7a53200640 1 --2- 172.21.15.2:0/2290408501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a54102180 0x7f7a5410e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.478+0000 7f7a53200640 1 --2- 172.21.15.2:0/2290408501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a541077d0 0x7f7a54107bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.478+0000 7f7a53200640 1 -- 172.21.15.2:0/2290408501 >> 172.21.15.2:0/2290408501 conn(0x7f7a540fd2b0 msgr2=0x7f7a540ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:01.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.478+0000 7f7a53200640 1 -- 172.21.15.2:0/2290408501 shutdown_connections 2024-06-13T11:24:01.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.478+0000 7f7a53200640 1 -- 172.21.15.2:0/2290408501 wait complete. 2024-06-13T11:24:01.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.479+0000 7f7a53200640 1 Processor -- start 2024-06-13T11:24:01.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.479+0000 7f7a53200640 1 -- start start 2024-06-13T11:24:01.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.480+0000 7f7a53200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a541017c0 0x7f7a5419a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:01.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.480+0000 7f7a53200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a54102180 0x7f7a5419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:01.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.480+0000 7f7a53200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a541077d0 0x7f7a5419ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:01.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.480+0000 7f7a53200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7a54111c30 con 0x7f7a541017c0 2024-06-13T11:24:01.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.480+0000 7f7a53200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7a54111ab0 con 0x7f7a541077d0 2024-06-13T11:24:01.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.480+0000 7f7a53200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7a54111db0 con 0x7f7a54102180 2024-06-13T11:24:01.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.480+0000 7f7a51e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a541017c0 0x7f7a5419a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:01.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.480+0000 7f7a51e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a541017c0 0x7f7a5419a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36382/0 (socket says 172.21.15.2:36382) 2024-06-13T11:24:01.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.480+0000 7f7a51e00640 1 -- 172.21.15.2:0/1766769494 learned_addr learned my addr 172.21.15.2:0/1766769494 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:01.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.480+0000 7f7a52800640 1 --2- 172.21.15.2:0/1766769494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a541077d0 0x7f7a5419ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:01.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.480+0000 7f7a51400640 1 --2- 172.21.15.2:0/1766769494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a54102180 0x7f7a5419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:01.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.481+0000 7f7a51e00640 1 -- 172.21.15.2:0/1766769494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a54102180 msgr2=0x7f7a5419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:01.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.481+0000 7f7a51e00640 1 --2- 172.21.15.2:0/1766769494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a54102180 0x7f7a5419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.481+0000 7f7a51e00640 1 -- 172.21.15.2:0/1766769494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a541077d0 msgr2=0x7f7a5419ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:01.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.481+0000 7f7a51e00640 1 --2- 172.21.15.2:0/1766769494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a541077d0 0x7f7a5419ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.481+0000 7f7a51e00640 1 -- 172.21.15.2:0/1766769494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5419f1c0 con 0x7f7a541017c0 2024-06-13T11:24:01.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.481+0000 7f7a51e00640 1 --2- 172.21.15.2:0/1766769494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a541017c0 0x7f7a5419a1d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400e9f0 tx=0x7f7a4400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:01.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.482+0000 7f7a4aa00640 1 -- 172.21.15.2:0/1766769494 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4400cd80 con 0x7f7a541017c0 2024-06-13T11:24:01.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.482+0000 7f7a53200640 1 -- 172.21.15.2:0/1766769494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a5419f4b0 con 0x7f7a541017c0 2024-06-13T11:24:01.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.482+0000 7f7a4aa00640 1 -- 172.21.15.2:0/1766769494 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a44005500 con 0x7f7a541017c0 2024-06-13T11:24:01.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.482+0000 7f7a4aa00640 1 -- 172.21.15.2:0/1766769494 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a44010690 con 0x7f7a541017c0 2024-06-13T11:24:01.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.482+0000 7f7a53200640 1 -- 172.21.15.2:0/1766769494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a541a6d40 con 0x7f7a541017c0 2024-06-13T11:24:01.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.483+0000 7f7a53200640 1 -- 172.21.15.2:0/1766769494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a54068240 con 0x7f7a541017c0 2024-06-13T11:24:01.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.487+0000 7f7a4aa00640 1 -- 172.21.15.2:0/1766769494 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7f7a440046c0 con 0x7f7a541017c0 2024-06-13T11:24:01.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.488+0000 7f7a4aa00640 1 --2- 172.21.15.2:0/1766769494 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7a380a2d70 0x7f7a380a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:01.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.489+0000 7f7a4aa00640 1 -- 172.21.15.2:0/1766769494 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f7a440cfe20 con 0x7f7a541017c0 2024-06-13T11:24:01.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.489+0000 7f7a51400640 1 --2- 172.21.15.2:0/1766769494 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7a380a2d70 0x7f7a380a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:01.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.490+0000 7f7a51400640 1 --2- 172.21.15.2:0/1766769494 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7a380a2d70 0x7f7a380a5230 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a40006010 tx=0x7f7a40005a20 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:01.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.497+0000 7f7a4aa00640 1 -- 172.21.15.2:0/1766769494 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7a4409c500 con 0x7f7a541017c0 2024-06-13T11:24:01.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.709+0000 7f7a53200640 1 -- 172.21.15.2:0/1766769494 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f7a541a6f40 con 0x7f7a541017c0 2024-06-13T11:24:01.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.714+0000 7f7a4aa00640 1 -- 172.21.15.2:0/1766769494 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v32)=0 v32) ==== 138+0+0 (secure 0 0 0) 0x7f7a4409be00 con 0x7f7a541017c0 2024-06-13T11:24:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.717+0000 7f7a53200640 1 -- 172.21.15.2:0/1766769494 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7a380a2d70 msgr2=0x7f7a380a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.717+0000 7f7a53200640 1 --2- 172.21.15.2:0/1766769494 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7a380a2d70 0x7f7a380a5230 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a40006010 tx=0x7f7a40005a20 comp rx=0 tx=0).stop 2024-06-13T11:24:01.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.717+0000 7f7a53200640 1 -- 172.21.15.2:0/1766769494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a541017c0 msgr2=0x7f7a5419a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.717+0000 7f7a53200640 1 --2- 172.21.15.2:0/1766769494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a541017c0 0x7f7a5419a1d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400e9f0 tx=0x7f7a4400edf0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.717+0000 7f7a53200640 1 -- 172.21.15.2:0/1766769494 shutdown_connections 2024-06-13T11:24:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.717+0000 7f7a53200640 1 --2- 172.21.15.2:0/1766769494 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7a380a2d70 0x7f7a380a5230 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.717+0000 7f7a53200640 1 --2- 172.21.15.2:0/1766769494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a54102180 0x7f7a5419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.717+0000 7f7a53200640 1 --2- 172.21.15.2:0/1766769494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a541077d0 0x7f7a5419ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.717+0000 7f7a53200640 1 --2- 172.21.15.2:0/1766769494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a541017c0 0x7f7a5419a1d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.717+0000 7f7a53200640 1 -- 172.21.15.2:0/1766769494 >> 172.21.15.2:0/1766769494 conn(0x7f7a540fd2b0 msgr2=0x7f7a5410cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.718+0000 7f7a53200640 1 -- 172.21.15.2:0/1766769494 shutdown_connections 2024-06-13T11:24:01.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.718+0000 7f7a53200640 1 -- 172.21.15.2:0/1766769494 wait complete. 2024-06-13T11:24:01.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-06-13T11:24:01.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.925+0000 7f1c4d000640 1 -- 172.21.15.2:0/890957023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c481077d0 msgr2=0x7f1c48107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:01.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.925+0000 7f1c4d000640 1 --2- 172.21.15.2:0/890957023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c481077d0 0x7f1c48107bb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1c38009900 tx=0x7f1c3802a3f0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.925+0000 7f1c4d000640 1 -- 172.21.15.2:0/890957023 shutdown_connections 2024-06-13T11:24:01.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.925+0000 7f1c4d000640 1 --2- 172.21.15.2:0/890957023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c48102180 0x7f1c4810e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.925+0000 7f1c4d000640 1 --2- 172.21.15.2:0/890957023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c481017c0 0x7f1c48101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.925+0000 7f1c4d000640 1 --2- 172.21.15.2:0/890957023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c481077d0 0x7f1c48107bb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.925+0000 7f1c4d000640 1 -- 172.21.15.2:0/890957023 >> 172.21.15.2:0/890957023 conn(0x7f1c480fd2b0 msgr2=0x7f1c480ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:01.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.925+0000 7f1c4d000640 1 -- 172.21.15.2:0/890957023 shutdown_connections 2024-06-13T11:24:01.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.925+0000 7f1c4d000640 1 -- 172.21.15.2:0/890957023 wait complete. 2024-06-13T11:24:01.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.926+0000 7f1c4d000640 1 Processor -- start 2024-06-13T11:24:01.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.926+0000 7f1c4d000640 1 -- start start 2024-06-13T11:24:01.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.926+0000 7f1c4d000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c481017c0 0x7f1c4819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:01.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.926+0000 7f1c4d000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c48102180 0x7f1c4819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:01.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.926+0000 7f1c4d000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c481077d0 0x7f1c4819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:01.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.926+0000 7f1c4d000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1c48111bf0 con 0x7f1c481077d0 2024-06-13T11:24:01.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.926+0000 7f1c4d000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1c48111a70 con 0x7f1c48102180 2024-06-13T11:24:01.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.926+0000 7f1c4d000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1c48111d70 con 0x7f1c481017c0 2024-06-13T11:24:01.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.927+0000 7f1c46a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c48102180 0x7f1c4819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:01.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.927+0000 7f1c47e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c481077d0 0x7f1c4819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:01.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.927+0000 7f1c46a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c48102180 0x7f1c4819a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:53144/0 (socket says 172.21.15.2:53144) 2024-06-13T11:24:01.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.927+0000 7f1c46a00640 1 -- 172.21.15.2:0/1007187311 learned_addr learned my addr 172.21.15.2:0/1007187311 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:01.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.927+0000 7f1c47400640 1 --2- 172.21.15.2:0/1007187311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c481017c0 0x7f1c4819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:01.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.927+0000 7f1c46a00640 1 -- 172.21.15.2:0/1007187311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c481017c0 msgr2=0x7f1c4819a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:01.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.927+0000 7f1c46a00640 1 --2- 172.21.15.2:0/1007187311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c481017c0 0x7f1c4819a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.927+0000 7f1c46a00640 1 -- 172.21.15.2:0/1007187311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c481077d0 msgr2=0x7f1c4819eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.927+0000 7f1c46a00640 1 --2- 172.21.15.2:0/1007187311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c481077d0 0x7f1c4819eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.927+0000 7f1c46a00640 1 -- 172.21.15.2:0/1007187311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4819f260 con 0x7f1c48102180 2024-06-13T11:24:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.927+0000 7f1c46a00640 1 --2- 172.21.15.2:0/1007187311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c48102180 0x7f1c4819a7b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400e9f0 tx=0x7f1c3400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.928+0000 7f1c3fe00640 1 -- 172.21.15.2:0/1007187311 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3400cd80 con 0x7f1c48102180 2024-06-13T11:24:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.928+0000 7f1c3fe00640 1 -- 172.21.15.2:0/1007187311 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c34010910 con 0x7f1c48102180 2024-06-13T11:24:01.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.928+0000 7f1c3fe00640 1 -- 172.21.15.2:0/1007187311 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c34018990 con 0x7f1c48102180 2024-06-13T11:24:01.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.928+0000 7f1c4d000640 1 -- 172.21.15.2:0/1007187311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c4819f550 con 0x7f1c48102180 2024-06-13T11:24:01.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.928+0000 7f1c4d000640 1 -- 172.21.15.2:0/1007187311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c481a6de0 con 0x7f1c48102180 2024-06-13T11:24:01.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.929+0000 7f1c4d000640 1 -- 172.21.15.2:0/1007187311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c48068240 con 0x7f1c48102180 2024-06-13T11:24:01.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.932+0000 7f1c3fe00640 1 -- 172.21.15.2:0/1007187311 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7f1c34010ac0 con 0x7f1c48102180 2024-06-13T11:24:01.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.933+0000 7f1c3fe00640 1 --2- 172.21.15.2:0/1007187311 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f1c2c0a2d70 0x7f1c2c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:01.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.934+0000 7f1c3fe00640 1 -- 172.21.15.2:0/1007187311 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f1c340cfcb0 con 0x7f1c48102180 2024-06-13T11:24:01.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.934+0000 7f1c47400640 1 --2- 172.21.15.2:0/1007187311 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f1c2c0a2d70 0x7f1c2c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:01.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.934+0000 7f1c47400640 1 --2- 172.21.15.2:0/1007187311 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f1c2c0a2d70 0x7f1c2c0a5230 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1c38000c00 tx=0x7f1c38005b50 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:01.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:01.938+0000 7f1c3fe00640 1 -- 172.21.15.2:0/1007187311 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1c3409bd40 con 0x7f1c48102180 2024-06-13T11:24:02.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.146+0000 7f1c4d000640 1 -- 172.21.15.2:0/1007187311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f1c481a70a0 con 0x7f1c48102180 2024-06-13T11:24:02.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.155+0000 7f1c3fe00640 1 -- 172.21.15.2:0/1007187311 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v33)=0 v33) ==== 133+0+0 (secure 0 0 0) 0x7f1c340a0040 con 0x7f1c48102180 2024-06-13T11:24:02.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.158+0000 7f1c4d000640 1 -- 172.21.15.2:0/1007187311 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f1c2c0a2d70 msgr2=0x7f1c2c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:02.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.158+0000 7f1c4d000640 1 --2- 172.21.15.2:0/1007187311 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f1c2c0a2d70 0x7f1c2c0a5230 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1c38000c00 tx=0x7f1c38005b50 comp rx=0 tx=0).stop 2024-06-13T11:24:02.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.158+0000 7f1c4d000640 1 -- 172.21.15.2:0/1007187311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c48102180 msgr2=0x7f1c4819a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:02.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.158+0000 7f1c4d000640 1 --2- 172.21.15.2:0/1007187311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c48102180 0x7f1c4819a7b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400e9f0 tx=0x7f1c3400eeb0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.159+0000 7f1c4d000640 1 -- 172.21.15.2:0/1007187311 shutdown_connections 2024-06-13T11:24:02.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.159+0000 7f1c4d000640 1 --2- 172.21.15.2:0/1007187311 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f1c2c0a2d70 0x7f1c2c0a5230 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.159+0000 7f1c4d000640 1 --2- 172.21.15.2:0/1007187311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c481077d0 0x7f1c4819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.159+0000 7f1c4d000640 1 --2- 172.21.15.2:0/1007187311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c48102180 0x7f1c4819a7b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.159+0000 7f1c4d000640 1 --2- 172.21.15.2:0/1007187311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c481017c0 0x7f1c4819a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.159+0000 7f1c4d000640 1 -- 172.21.15.2:0/1007187311 >> 172.21.15.2:0/1007187311 conn(0x7f1c480fd2b0 msgr2=0x7f1c4810ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:02.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.159+0000 7f1c4d000640 1 -- 172.21.15.2:0/1007187311 shutdown_connections 2024-06-13T11:24:02.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.159+0000 7f1c4d000640 1 -- 172.21.15.2:0/1007187311 wait complete. 2024-06-13T11:24:02.177 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-06-13T11:24:02.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.360+0000 7fb9c4a00640 1 -- 172.21.15.2:0/4252623014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9c010bda0 msgr2=0x7fb9c010e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:02.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.360+0000 7fb9c4a00640 1 --2- 172.21.15.2:0/4252623014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9c010bda0 0x7fb9c010e240 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8009be0 tx=0x7fb9b802a750 comp rx=0 tx=0).stop 2024-06-13T11:24:02.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.360+0000 7fb9c4a00640 1 -- 172.21.15.2:0/4252623014 shutdown_connections 2024-06-13T11:24:02.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.360+0000 7fb9c4a00640 1 --2- 172.21.15.2:0/4252623014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9c01032a0 0x7fb9c010b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.360+0000 7fb9c4a00640 1 --2- 172.21.15.2:0/4252623014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9c010bda0 0x7fb9c010e240 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.360+0000 7fb9c4a00640 1 --2- 172.21.15.2:0/4252623014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9c0102980 0x7fb9c0102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.360+0000 7fb9c4a00640 1 -- 172.21.15.2:0/4252623014 >> 172.21.15.2:0/4252623014 conn(0x7fb9c00fc180 msgr2=0x7fb9c00fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:02.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.361+0000 7fb9c4a00640 1 -- 172.21.15.2:0/4252623014 shutdown_connections 2024-06-13T11:24:02.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.361+0000 7fb9c4a00640 1 -- 172.21.15.2:0/4252623014 wait complete. 2024-06-13T11:24:02.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.361+0000 7fb9c4a00640 1 Processor -- start 2024-06-13T11:24:02.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.362+0000 7fb9c4a00640 1 -- start start 2024-06-13T11:24:02.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.362+0000 7fb9c4a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9c0102980 0x7fb9c019a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:02.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.362+0000 7fb9c4a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9c01032a0 0x7fb9c019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:02.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.362+0000 7fb9c4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9c010bda0 0x7fb9c019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.362+0000 7fb9c4a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c0111b50 con 0x7fb9c010bda0 2024-06-13T11:24:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.362+0000 7fb9c4a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c01119d0 con 0x7fb9c01032a0 2024-06-13T11:24:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.362+0000 7fb9c4a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c0111cd0 con 0x7fb9c0102980 2024-06-13T11:24:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.362+0000 7fb9be800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9c0102980 0x7fb9c019a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.362+0000 7fb9be800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9c0102980 0x7fb9c019a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56544/0 (socket says 172.21.15.2:56544) 2024-06-13T11:24:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.362+0000 7fb9be800640 1 -- 172.21.15.2:0/3436445065 learned_addr learned my addr 172.21.15.2:0/3436445065 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.362+0000 7fb9bde00640 1 --2- 172.21.15.2:0/3436445065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9c01032a0 0x7fb9c019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.362+0000 7fb9bf200640 1 --2- 172.21.15.2:0/3436445065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9c010bda0 0x7fb9c019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.363+0000 7fb9be800640 1 -- 172.21.15.2:0/3436445065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9c01032a0 msgr2=0x7fb9c019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.363+0000 7fb9be800640 1 --2- 172.21.15.2:0/3436445065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9c01032a0 0x7fb9c019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.363+0000 7fb9be800640 1 -- 172.21.15.2:0/3436445065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9c010bda0 msgr2=0x7fb9c019eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.363+0000 7fb9be800640 1 --2- 172.21.15.2:0/3436445065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9c010bda0 0x7fb9c019eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.363+0000 7fb9be800640 1 -- 172.21.15.2:0/3436445065 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c019f210 con 0x7fb9c0102980 2024-06-13T11:24:02.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.363+0000 7fb9bde00640 1 --2- 172.21.15.2:0/3436445065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9c01032a0 0x7fb9c019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:24:02.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.363+0000 7fb9be800640 1 --2- 172.21.15.2:0/3436445065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9c0102980 0x7fb9c019a220 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000e9c0 tx=0x7fb9b000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:02.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.363+0000 7fb9b7400640 1 -- 172.21.15.2:0/3436445065 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b000ccc0 con 0x7fb9c0102980 2024-06-13T11:24:02.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.363+0000 7fb9c4a00640 1 -- 172.21.15.2:0/3436445065 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c019f500 con 0x7fb9c0102980 2024-06-13T11:24:02.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.364+0000 7fb9b7400640 1 -- 172.21.15.2:0/3436445065 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9b0005500 con 0x7fb9c0102980 2024-06-13T11:24:02.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.364+0000 7fb9b7400640 1 -- 172.21.15.2:0/3436445065 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0010430 con 0x7fb9c0102980 2024-06-13T11:24:02.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.364+0000 7fb9c4a00640 1 -- 172.21.15.2:0/3436445065 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c01a6d90 con 0x7fb9c0102980 2024-06-13T11:24:02.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.365+0000 7fb9c4a00640 1 -- 172.21.15.2:0/3436445065 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c0068240 con 0x7fb9c0102980 2024-06-13T11:24:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.368+0000 7fb9b7400640 1 -- 172.21.15.2:0/3436445065 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7fb9b00046c0 con 0x7fb9c0102980 2024-06-13T11:24:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.369+0000 7fb9b7400640 1 --2- 172.21.15.2:0/3436445065 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb9a40a2df0 0x7fb9a40a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.370+0000 7fb9b7400640 1 -- 172.21.15.2:0/3436445065 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fb9b00cfc20 con 0x7fb9c0102980 2024-06-13T11:24:02.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.370+0000 7fb9bde00640 1 --2- 172.21.15.2:0/3436445065 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb9a40a2df0 0x7fb9a40a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:02.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.370+0000 7fb9bde00640 1 --2- 172.21.15.2:0/3436445065 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb9a40a2df0 0x7fb9a40a52b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00fe5c0 tx=0x7fb9ac005f90 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:02.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.374+0000 7fb9b7400640 1 -- 172.21.15.2:0/3436445065 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb9b009c300 con 0x7fb9c0102980 2024-06-13T11:24:02.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:02 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2750876856' entity='client.admin' 2024-06-13T11:24:02.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:02 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:24:02.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:02 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:24:02.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:02 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:24:02.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:02 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:24:02.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:02 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1766769494' entity='client.admin' 2024-06-13T11:24:02.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:02 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:24:02.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:02 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:24:02.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:02 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:24:02.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:02 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:24:02.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:02 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' 2024-06-13T11:24:02.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:02 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:24:02.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:02 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:24:02.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:02 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:24:02.541 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:02 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:24:02.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.597+0000 7fb9c4a00640 1 -- 172.21.15.2:0/3436445065 --> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fb9c0101c20 con 0x7fb9a40a2df0 2024-06-13T11:24:02.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:02 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2750876856' entity='client.admin' 2024-06-13T11:24:02.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:02 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:24:02.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:02 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:24:02.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:02 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:24:02.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:02 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:24:02.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:02 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1766769494' entity='client.admin' 2024-06-13T11:24:02.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:02 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:24:02.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:02 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:24:02.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:02 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:24:02.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:02 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:24:02.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:02 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' 2024-06-13T11:24:02.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:02 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:24:02.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:02 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:24:02.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:02 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:24:02.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:02 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:24:02.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:02 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2750876856' entity='client.admin' 2024-06-13T11:24:02.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:02 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:24:02.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:02 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:24:02.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:02 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:24:02.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:02 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:24:02.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:02 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1766769494' entity='client.admin' 2024-06-13T11:24:02.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:02 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:24:02.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:02 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:24:02.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:02 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:24:02.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:02 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:24:02.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:02 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' 2024-06-13T11:24:02.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:02 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:24:02.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:02 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:24:02.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:02 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:24:02.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:02 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:24:02.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.705+0000 7fb9b7400640 1 -- 172.21.15.2:0/3436445065 <== mgr.25150 v2:172.21.15.2:6800/606530635 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb9c0101c20 con 0x7fb9a40a2df0 2024-06-13T11:24:02.704 INFO:teuthology.orchestra.run.smithi002.stdout:Schedule set for path / 2024-06-13T11:24:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.707+0000 7fb9c4a00640 1 -- 172.21.15.2:0/3436445065 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb9a40a2df0 msgr2=0x7fb9a40a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.707+0000 7fb9c4a00640 1 --2- 172.21.15.2:0/3436445065 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb9a40a2df0 0x7fb9a40a52b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00fe5c0 tx=0x7fb9ac005f90 comp rx=0 tx=0).stop 2024-06-13T11:24:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.707+0000 7fb9c4a00640 1 -- 172.21.15.2:0/3436445065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9c0102980 msgr2=0x7fb9c019a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:02.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.707+0000 7fb9c4a00640 1 --2- 172.21.15.2:0/3436445065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9c0102980 0x7fb9c019a220 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000e9c0 tx=0x7fb9b000ee80 comp rx=0 tx=0).stop 2024-06-13T11:24:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.707+0000 7fb9c4a00640 1 -- 172.21.15.2:0/3436445065 shutdown_connections 2024-06-13T11:24:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.707+0000 7fb9c4a00640 1 --2- 172.21.15.2:0/3436445065 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb9a40a2df0 0x7fb9a40a52b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.707+0000 7fb9c4a00640 1 --2- 172.21.15.2:0/3436445065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9c010bda0 0x7fb9c019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.707+0000 7fb9c4a00640 1 --2- 172.21.15.2:0/3436445065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9c01032a0 0x7fb9c019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.707+0000 7fb9c4a00640 1 --2- 172.21.15.2:0/3436445065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9c0102980 0x7fb9c019a220 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.707+0000 7fb9c4a00640 1 -- 172.21.15.2:0/3436445065 >> 172.21.15.2:0/3436445065 conn(0x7fb9c00fc180 msgr2=0x7fb9c0100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.708+0000 7fb9c4a00640 1 -- 172.21.15.2:0/3436445065 shutdown_connections 2024-06-13T11:24:02.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.708+0000 7fb9c4a00640 1 -- 172.21.15.2:0/3436445065 wait complete. 2024-06-13T11:24:02.724 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-06-13T11:24:02.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.904+0000 7f5c05400640 1 -- 172.21.15.2:0/1540257574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c001017c0 msgr2=0x7f5c00101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:02.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.904+0000 7f5c05400640 1 --2- 172.21.15.2:0/1540257574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c001017c0 0x7f5c00101c40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009930 tx=0x7f5bec02a420 comp rx=0 tx=0).stop 2024-06-13T11:24:02.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.905+0000 7f5c05400640 1 -- 172.21.15.2:0/1540257574 shutdown_connections 2024-06-13T11:24:02.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.905+0000 7f5c05400640 1 --2- 172.21.15.2:0/1540257574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c001017c0 0x7f5c00101c40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.905+0000 7f5c05400640 1 --2- 172.21.15.2:0/1540257574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c00102180 0x7f5c0010e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.905+0000 7f5c05400640 1 --2- 172.21.15.2:0/1540257574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c001077d0 0x7f5c00107bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.905+0000 7f5c05400640 1 -- 172.21.15.2:0/1540257574 >> 172.21.15.2:0/1540257574 conn(0x7f5c000fd2b0 msgr2=0x7f5c000ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:02.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.905+0000 7f5c05400640 1 -- 172.21.15.2:0/1540257574 shutdown_connections 2024-06-13T11:24:02.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.905+0000 7f5c05400640 1 -- 172.21.15.2:0/1540257574 wait complete. 2024-06-13T11:24:02.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.906+0000 7f5c05400640 1 Processor -- start 2024-06-13T11:24:02.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.906+0000 7f5c05400640 1 -- start start 2024-06-13T11:24:02.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.906+0000 7f5c05400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c001017c0 0x7f5c0019a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:02.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.906+0000 7f5c05400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c00102180 0x7f5c0019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:02.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.906+0000 7f5c05400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c001077d0 0x7f5c0019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:02.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.906+0000 7f5c05400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5c00111c30 con 0x7f5c001077d0 2024-06-13T11:24:02.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.906+0000 7f5c05400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5c00111ab0 con 0x7f5c001017c0 2024-06-13T11:24:02.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.906+0000 7f5c05400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5c00111db0 con 0x7f5c00102180 2024-06-13T11:24:02.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.906+0000 7f5c04a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c001077d0 0x7f5c0019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:02.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.907+0000 7f5bffe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c001017c0 0x7f5c0019a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:02.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.907+0000 7f5c04a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c001077d0 0x7f5c0019eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36444/0 (socket says 172.21.15.2:36444) 2024-06-13T11:24:02.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.907+0000 7f5c04a00640 1 -- 172.21.15.2:0/1476574596 learned_addr learned my addr 172.21.15.2:0/1476574596 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:02.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.907+0000 7f5bff400640 1 --2- 172.21.15.2:0/1476574596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c00102180 0x7f5c0019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:02.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.907+0000 7f5bffe00640 1 -- 172.21.15.2:0/1476574596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c00102180 msgr2=0x7f5c0019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:02.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.907+0000 7f5bffe00640 1 --2- 172.21.15.2:0/1476574596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c00102180 0x7f5c0019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.907+0000 7f5bffe00640 1 -- 172.21.15.2:0/1476574596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c001077d0 msgr2=0x7f5c0019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:02.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.907+0000 7f5bffe00640 1 --2- 172.21.15.2:0/1476574596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c001077d0 0x7f5c0019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:02.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.907+0000 7f5bffe00640 1 -- 172.21.15.2:0/1476574596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0019f2c0 con 0x7f5c001017c0 2024-06-13T11:24:02.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.907+0000 7f5bffe00640 1 --2- 172.21.15.2:0/1476574596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c001017c0 0x7f5c0019a2d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000e9f0 tx=0x7f5bf000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:02.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.908+0000 7f5bfcc00640 1 -- 172.21.15.2:0/1476574596 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf000cd80 con 0x7f5c001017c0 2024-06-13T11:24:02.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.908+0000 7f5c05400640 1 -- 172.21.15.2:0/1476574596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c0019f5b0 con 0x7f5c001017c0 2024-06-13T11:24:02.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.908+0000 7f5bfcc00640 1 -- 172.21.15.2:0/1476574596 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bf00035f0 con 0x7f5c001017c0 2024-06-13T11:24:02.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.908+0000 7f5bfcc00640 1 -- 172.21.15.2:0/1476574596 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0018690 con 0x7f5c001017c0 2024-06-13T11:24:02.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.908+0000 7f5c05400640 1 -- 172.21.15.2:0/1476574596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c001a6e40 con 0x7f5c001017c0 2024-06-13T11:24:02.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.909+0000 7f5c05400640 1 -- 172.21.15.2:0/1476574596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c00068240 con 0x7f5c001017c0 2024-06-13T11:24:02.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.911+0000 7f5bfcc00640 1 -- 172.21.15.2:0/1476574596 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7f5bf0004020 con 0x7f5c001017c0 2024-06-13T11:24:02.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.912+0000 7f5bfcc00640 1 --2- 172.21.15.2:0/1476574596 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f5be40a2df0 0x7f5be40a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:02.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.913+0000 7f5bfcc00640 1 -- 172.21.15.2:0/1476574596 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f5bf00cfb20 con 0x7f5c001017c0 2024-06-13T11:24:02.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.913+0000 7f5bff400640 1 --2- 172.21.15.2:0/1476574596 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f5be40a2df0 0x7f5be40a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:02.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.913+0000 7f5bff400640 1 --2- 172.21.15.2:0/1476574596 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f5be40a2df0 0x7f5be40a52b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5bec006010 tx=0x7f5bec000bc0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:02.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:02.916+0000 7f5bfcc00640 1 -- 172.21.15.2:0/1476574596 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5bf009c2f0 con 0x7f5c001017c0 2024-06-13T11:24:03.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.157+0000 7f5c05400640 1 -- 172.21.15.2:0/1476574596 --> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f5c000fe6a0 con 0x7f5be40a2df0 2024-06-13T11:24:03.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.293+0000 7f5bfcc00640 1 -- 172.21.15.2:0/1476574596 <== mgr.25150 v2:172.21.15.2:6800/606530635 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f5c000fe6a0 con 0x7f5be40a2df0 2024-06-13T11:24:03.292 INFO:teuthology.orchestra.run.smithi002.stdout:Retention added to path / 2024-06-13T11:24:03.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.296+0000 7f5c05400640 1 -- 172.21.15.2:0/1476574596 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f5be40a2df0 msgr2=0x7f5be40a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:03.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.296+0000 7f5c05400640 1 --2- 172.21.15.2:0/1476574596 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f5be40a2df0 0x7f5be40a52b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5bec006010 tx=0x7f5bec000bc0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.296+0000 7f5c05400640 1 -- 172.21.15.2:0/1476574596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c001017c0 msgr2=0x7f5c0019a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:03.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.296+0000 7f5c05400640 1 --2- 172.21.15.2:0/1476574596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c001017c0 0x7f5c0019a2d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000e9f0 tx=0x7f5bf000eeb0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.296+0000 7f5c05400640 1 -- 172.21.15.2:0/1476574596 shutdown_connections 2024-06-13T11:24:03.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.296+0000 7f5c05400640 1 --2- 172.21.15.2:0/1476574596 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f5be40a2df0 0x7f5be40a52b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.296+0000 7f5c05400640 1 --2- 172.21.15.2:0/1476574596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c00102180 0x7f5c0019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.296+0000 7f5c05400640 1 --2- 172.21.15.2:0/1476574596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c001077d0 0x7f5c0019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.296+0000 7f5c05400640 1 --2- 172.21.15.2:0/1476574596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c001017c0 0x7f5c0019a2d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.296+0000 7f5c05400640 1 -- 172.21.15.2:0/1476574596 >> 172.21.15.2:0/1476574596 conn(0x7f5c000fd2b0 msgr2=0x7f5c0010cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:03.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.296+0000 7f5c05400640 1 -- 172.21.15.2:0/1476574596 shutdown_connections 2024-06-13T11:24:03.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.296+0000 7f5c05400640 1 -- 172.21.15.2:0/1476574596 wait complete. 2024-06-13T11:24:03.317 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-06-13T11:24:03.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:03 smithi002 ceph-mon[32210]: pgmap v11: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 170 B/s wr, 16 op/s 2024-06-13T11:24:03.360 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:03 smithi002 ceph-mon[32210]: from='client.25291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:24:03.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.508+0000 7fe168c00640 1 -- 172.21.15.2:0/3249301715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1641079c0 msgr2=0x7fe164107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:03.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.508+0000 7fe168c00640 1 --2- 172.21.15.2:0/3249301715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1641079c0 0x7fe164107da0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe154009cd0 tx=0x7fe15402a8f0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.508+0000 7fe168c00640 1 -- 172.21.15.2:0/3249301715 shutdown_connections 2024-06-13T11:24:03.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.508+0000 7fe168c00640 1 --2- 172.21.15.2:0/3249301715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe164102370 0x7fe16410e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.508+0000 7fe168c00640 1 --2- 172.21.15.2:0/3249301715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1641019b0 0x7fe164101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.508+0000 7fe168c00640 1 --2- 172.21.15.2:0/3249301715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1641079c0 0x7fe164107da0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.508+0000 7fe168c00640 1 -- 172.21.15.2:0/3249301715 >> 172.21.15.2:0/3249301715 conn(0x7fe1640fd460 msgr2=0x7fe1640ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:03.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.509+0000 7fe168c00640 1 -- 172.21.15.2:0/3249301715 shutdown_connections 2024-06-13T11:24:03.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.509+0000 7fe168c00640 1 -- 172.21.15.2:0/3249301715 wait complete. 2024-06-13T11:24:03.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.510+0000 7fe168c00640 1 Processor -- start 2024-06-13T11:24:03.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.510+0000 7fe168c00640 1 -- start start 2024-06-13T11:24:03.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.510+0000 7fe168c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1641019b0 0x7fe16419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.510+0000 7fe168c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe164102370 0x7fe16419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.510+0000 7fe168c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1641079c0 0x7fe16419ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.510+0000 7fe168c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe164111dd0 con 0x7fe164102370 2024-06-13T11:24:03.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.510+0000 7fe168c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe164111c50 con 0x7fe1641079c0 2024-06-13T11:24:03.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.510+0000 7fe168c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe164111f50 con 0x7fe1641019b0 2024-06-13T11:24:03.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.511+0000 7fe161e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1641019b0 0x7fe16419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.511+0000 7fe159400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe164102370 0x7fe16419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.511+0000 7fe161e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1641019b0 0x7fe16419a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56576/0 (socket says 172.21.15.2:56576) 2024-06-13T11:24:03.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.511+0000 7fe161e00640 1 -- 172.21.15.2:0/2055218553 learned_addr learned my addr 172.21.15.2:0/2055218553 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:03.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.511+0000 7fe162800640 1 --2- 172.21.15.2:0/2055218553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1641079c0 0x7fe16419ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.511+0000 7fe162800640 1 -- 172.21.15.2:0/2055218553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1641019b0 msgr2=0x7fe16419a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:03.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.511+0000 7fe162800640 1 --2- 172.21.15.2:0/2055218553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1641019b0 0x7fe16419a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.511+0000 7fe162800640 1 -- 172.21.15.2:0/2055218553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe164102370 msgr2=0x7fe16419a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:03.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.511+0000 7fe162800640 1 --2- 172.21.15.2:0/2055218553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe164102370 0x7fe16419a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.511+0000 7fe162800640 1 -- 172.21.15.2:0/2055218553 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16419f460 con 0x7fe1641079c0 2024-06-13T11:24:03.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.512+0000 7fe162800640 1 --2- 172.21.15.2:0/2055218553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1641079c0 0x7fe16419ed30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe15c00e970 tx=0x7fe15c00ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:03.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.512+0000 7fe15b400640 1 -- 172.21.15.2:0/2055218553 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c00ccc0 con 0x7fe1641079c0 2024-06-13T11:24:03.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.512+0000 7fe168c00640 1 -- 172.21.15.2:0/2055218553 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16419f750 con 0x7fe1641079c0 2024-06-13T11:24:03.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.512+0000 7fe15b400640 1 -- 172.21.15.2:0/2055218553 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe15c005020 con 0x7fe1641079c0 2024-06-13T11:24:03.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.512+0000 7fe15b400640 1 -- 172.21.15.2:0/2055218553 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c004a00 con 0x7fe1641079c0 2024-06-13T11:24:03.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.512+0000 7fe168c00640 1 -- 172.21.15.2:0/2055218553 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1641a6fe0 con 0x7fe1641079c0 2024-06-13T11:24:03.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.513+0000 7fe168c00640 1 -- 172.21.15.2:0/2055218553 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe16404ffb0 con 0x7fe1641079c0 2024-06-13T11:24:03.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.515+0000 7fe15b400640 1 -- 172.21.15.2:0/2055218553 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7fe15c0051d0 con 0x7fe1641079c0 2024-06-13T11:24:03.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.517+0000 7fe15b400640 1 --2- 172.21.15.2:0/2055218553 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe1480a2d80 0x7fe1480a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.517+0000 7fe15b400640 1 -- 172.21.15.2:0/2055218553 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fe15c0cf890 con 0x7fe1641079c0 2024-06-13T11:24:03.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.517+0000 7fe161e00640 1 --2- 172.21.15.2:0/2055218553 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe1480a2d80 0x7fe1480a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.518+0000 7fe161e00640 1 --2- 172.21.15.2:0/2055218553 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe1480a2d80 0x7fe1480a5240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe154005e10 tx=0x7fe154005da0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:03.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.519+0000 7fe15b400640 1 -- 172.21.15.2:0/2055218553 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe15c09bf70 con 0x7fe1641079c0 2024-06-13T11:24:03.539 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:03 smithi077 ceph-mon[36410]: pgmap v11: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 170 B/s wr, 16 op/s 2024-06-13T11:24:03.539 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:03 smithi077 ceph-mon[36410]: from='client.25291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:24:03.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.636+0000 7f31cae00700 1 -- 172.21.15.2:0/2295930674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31c4074fe0 msgr2=0x7f31c410e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:03.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.636+0000 7f31cae00700 1 --2- 172.21.15.2:0/2295930674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31c4074fe0 0x7f31c410e950 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009990 tx=0x7f31ac009ca0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.636+0000 7f31cae00700 1 -- 172.21.15.2:0/2295930674 shutdown_connections 2024-06-13T11:24:03.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.636+0000 7f31cae00700 1 --2- 172.21.15.2:0/2295930674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c410ee90 0x7f31c4111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.636+0000 7f31cae00700 1 --2- 172.21.15.2:0/2295930674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c40746c0 0x7f31c4074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.636+0000 7f31cae00700 1 --2- 172.21.15.2:0/2295930674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31c4074fe0 0x7f31c410e950 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.636+0000 7f31cae00700 1 -- 172.21.15.2:0/2295930674 >> 172.21.15.2:0/2295930674 conn(0x7f31c40795f0 msgr2=0x7f31c4079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:03.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.636+0000 7f31cae00700 1 -- 172.21.15.2:0/2295930674 shutdown_connections 2024-06-13T11:24:03.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.636+0000 7f31cae00700 1 -- 172.21.15.2:0/2295930674 wait complete. 2024-06-13T11:24:03.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.637+0000 7f31cae00700 1 Processor -- start 2024-06-13T11:24:03.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.637+0000 7f31cae00700 1 -- start start 2024-06-13T11:24:03.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.638+0000 7f31cae00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c40746c0 0x7f31c419aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.638+0000 7f31cae00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c4074fe0 0x7f31c419b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.638+0000 7f31cae00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31c410ee90 0x7f31c419f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.638+0000 7f31cae00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31c4114a00 con 0x7f31c4074fe0 2024-06-13T11:24:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.638+0000 7f31cae00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f31c4114880 con 0x7f31c410ee90 2024-06-13T11:24:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.638+0000 7f31cae00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f31c4114b80 con 0x7f31c40746c0 2024-06-13T11:24:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.638+0000 7f31c3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c40746c0 0x7f31c419aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.638+0000 7f31c3400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c4074fe0 0x7f31c419b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.638+0000 7f31c3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c40746c0 0x7f31c419aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56604/0 (socket says 172.21.15.2:56604) 2024-06-13T11:24:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.638+0000 7f31c3e00700 1 -- 172.21.15.2:0/2906772145 learned_addr learned my addr 172.21.15.2:0/2906772145 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.639+0000 7f31c8e00700 1 --2- 172.21.15.2:0/2906772145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31c410ee90 0x7f31c419f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.639+0000 7f31c3400700 1 -- 172.21.15.2:0/2906772145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c40746c0 msgr2=0x7f31c419aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:03.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.639+0000 7f31c3400700 1 --2- 172.21.15.2:0/2906772145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c40746c0 0x7f31c419aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.639+0000 7f31c3400700 1 -- 172.21.15.2:0/2906772145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31c410ee90 msgr2=0x7f31c419f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.639+0000 7f31c3400700 1 --2- 172.21.15.2:0/2906772145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31c410ee90 0x7f31c419f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.639+0000 7f31c3400700 1 -- 172.21.15.2:0/2906772145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c419fe90 con 0x7f31c4074fe0 2024-06-13T11:24:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.639+0000 7f31c3e00700 1 --2- 172.21.15.2:0/2906772145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c40746c0 0x7f31c419aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:24:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.639+0000 7f31c3400700 1 --2- 172.21.15.2:0/2906772145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c4074fe0 0x7f31c419b410 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0098e0 tx=0x7f31ac00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.640+0000 7f31c0c00700 1 -- 172.21.15.2:0/2906772145 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac027070 con 0x7f31c4074fe0 2024-06-13T11:24:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.640+0000 7f31cae00700 1 -- 172.21.15.2:0/2906772145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c41a0120 con 0x7f31c4074fe0 2024-06-13T11:24:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.640+0000 7f31c0c00700 1 -- 172.21.15.2:0/2906772145 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31ac003b60 con 0x7f31c4074fe0 2024-06-13T11:24:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.640+0000 7f31c0c00700 1 -- 172.21.15.2:0/2906772145 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac022d50 con 0x7f31c4074fe0 2024-06-13T11:24:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.640+0000 7f31cae00700 1 -- 172.21.15.2:0/2906772145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c41a7a00 con 0x7f31c4074fe0 2024-06-13T11:24:03.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.643+0000 7f31c0c00700 1 -- 172.21.15.2:0/2906772145 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7f31ac02a070 con 0x7f31c4074fe0 2024-06-13T11:24:03.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.644+0000 7f31d575ab80 1 Processor -- start 2024-06-13T11:24:03.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.645+0000 7f31d575ab80 1 -- start start 2024-06-13T11:24:03.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.645+0000 7f31c0c00700 1 --2- 172.21.15.2:0/2906772145 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f31a80a2ea0 0x7f31a80a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.645+0000 7f31d575ab80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098cfc10 0x5590098cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.645+0000 7f31d575ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098d0530 0x5590098c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.645+0000 7f31d575ab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098ca2c0 0x5590098ca700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.645+0000 7f31d575ab80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5590097d8a90 con 0x5590098cfc10 2024-06-13T11:24:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.645+0000 7f31d575ab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55900981bb80 con 0x5590098ca2c0 2024-06-13T11:24:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.645+0000 7f31d575ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5590097d6970 con 0x5590098d0530 2024-06-13T11:24:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.645+0000 7f31c0c00700 1 -- 172.21.15.2:0/2906772145 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f31ac0d0600 con 0x7f31c4074fe0 2024-06-13T11:24:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.646+0000 7f31c3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098cfc10 0x5590098cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.646+0000 7f31c8e00700 1 --2- 172.21.15.2:0/2906772145 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f31a80a2ea0 0x7f31a80a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.646+0000 7f31c3400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098d0530 0x5590098c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.646+0000 7f31c3400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098d0530 0x5590098c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56616/0 (socket says 172.21.15.2:56616) 2024-06-13T11:24:03.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.646+0000 7f31c3400700 1 -- 172.21.15.2:0/1771530041 learned_addr learned my addr 172.21.15.2:0/1771530041 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:03.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.646+0000 7f31c8e00700 1 --2- 172.21.15.2:0/1771530041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098ca2c0 0x5590098ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.646+0000 7f31c3400700 1 -- 172.21.15.2:0/1771530041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098ca2c0 msgr2=0x5590098ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:03.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.646+0000 7f31c3400700 1 --2- 172.21.15.2:0/1771530041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098ca2c0 0x5590098ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.646+0000 7f31c3400700 1 -- 172.21.15.2:0/1771530041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098cfc10 msgr2=0x5590098cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:03.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.646+0000 7f31c3400700 1 --2- 172.21.15.2:0/1771530041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098cfc10 0x5590098cfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.646+0000 7f31c3400700 1 -- 172.21.15.2:0/1771530041 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590097c4010 con 0x5590098d0530 2024-06-13T11:24:03.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.646+0000 7f31c3e00700 1 --2- 172.21.15.2:0/1771530041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098cfc10 0x5590098cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:24:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.647+0000 7f31c8e00700 1 --2- 172.21.15.2:0/2906772145 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f31a80a2ea0 0x7f31a80a5360 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009ec0 tx=0x7f31bc0092f0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.647+0000 7f31c3400700 1 --2- 172.21.15.2:0/1771530041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098d0530 0x5590098c9d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009990 tx=0x7f31ac09c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5960e5486b57c2bc server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.647+0000 7f31b9600700 1 -- 172.21.15.2:0/1771530041 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac09cd70 con 0x5590098d0530 2024-06-13T11:24:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.647+0000 7f31b9600700 1 -- 172.21.15.2:0/1771530041 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31ac09c670 con 0x5590098d0530 2024-06-13T11:24:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.647+0000 7f31b9600700 1 -- 172.21.15.2:0/1771530041 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0d01d0 con 0x5590098d0530 2024-06-13T11:24:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.648+0000 7f31d575ab80 1 -- 172.21.15.2:0/1771530041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098d0530 msgr2=0x5590098c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.648+0000 7f31d575ab80 1 --2- 172.21.15.2:0/1771530041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098d0530 0x5590098c9d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009990 tx=0x7f31ac09c560 comp rx=0 tx=0).stop 2024-06-13T11:24:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.648+0000 7f31d575ab80 1 -- 172.21.15.2:0/1771530041 shutdown_connections 2024-06-13T11:24:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.648+0000 7f31d575ab80 1 --2- 172.21.15.2:0/1771530041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098cfc10 0x5590098cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.648+0000 7f31d575ab80 1 --2- 172.21.15.2:0/1771530041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098ca2c0 0x5590098ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.648+0000 7f31d575ab80 1 --2- 172.21.15.2:0/1771530041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098d0530 0x5590098c9d80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.648+0000 7f31d575ab80 1 -- 172.21.15.2:0/1771530041 >> 172.21.15.2:0/1771530041 conn(0x5590097f61f0 msgr2=0x5590098c5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.648+0000 7f31d575ab80 1 -- 172.21.15.2:0/1771530041 shutdown_connections 2024-06-13T11:24:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.648+0000 7f31d575ab80 1 -- 172.21.15.2:0/1771530041 wait complete. 2024-06-13T11:24:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.649+0000 7f31d575ab80 1 -- start start 2024-06-13T11:24:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.649+0000 7f31d575ab80 1 Processor -- start 2024-06-13T11:24:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31d575ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098ca2c0 0x5590098d6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31d575ab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098cfc10 0x5590098d3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31d575ab80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098d0530 0x5590098d3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31d575ab80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5590097b7fe0 con 0x5590098d0530 2024-06-13T11:24:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31d575ab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559009817b40 con 0x5590098cfc10 2024-06-13T11:24:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31d575ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5590098d6cc0 con 0x5590098ca2c0 2024-06-13T11:24:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31d575ab80 10 client.0 _ll_register_callbacks cb 0x5590097b1400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:24:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31c3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098ca2c0 0x5590098d6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31c3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098ca2c0 0x5590098d6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56626/0 (socket says 172.21.15.2:56626) 2024-06-13T11:24:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31c3e00700 1 -- 172.21.15.2:0/2310257029 learned_addr learned my addr 172.21.15.2:0/2310257029 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31c3400700 1 --2- 172.21.15.2:0/2310257029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098cfc10 0x5590098d3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31c8e00700 1 --2- 172.21.15.2:0/2310257029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098d0530 0x5590098d3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31c3400700 1 -- 172.21.15.2:0/2310257029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098ca2c0 msgr2=0x5590098d6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31c3400700 1 --2- 172.21.15.2:0/2310257029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098ca2c0 0x5590098d6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31c3400700 1 -- 172.21.15.2:0/2310257029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098d0530 msgr2=0x5590098d3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:03.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31c3400700 1 --2- 172.21.15.2:0/2310257029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098d0530 0x5590098d3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.650+0000 7f31c3400700 1 -- 172.21.15.2:0/2310257029 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55900976a950 con 0x5590098cfc10 2024-06-13T11:24:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.651+0000 7f31c3400700 1 --2- 172.21.15.2:0/2310257029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098cfc10 0x5590098d3650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f31ac029000 tx=0x7f31ac005fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f584a6c659b396db server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.651+0000 7f31b2000700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:24:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.651+0000 7f31b2000700 1 -- 172.21.15.2:0/2310257029 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0a5250 con 0x5590098cfc10 2024-06-13T11:24:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.651+0000 7f31b2000700 1 -- 172.21.15.2:0/2310257029 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f31ac0d01d0 con 0x5590098cfc10 2024-06-13T11:24:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.651+0000 7f31d575ab80 1 -- 172.21.15.2:0/2310257029 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31ac09c670 con 0x5590098cfc10 2024-06-13T11:24:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.651+0000 7f31b2000700 1 -- 172.21.15.2:0/2310257029 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f31ac084050 con 0x5590098cfc10 2024-06-13T11:24:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.651+0000 7f31d575ab80 10 client.25289 fetch_fsmap learned FSMap version 27 2024-06-13T11:24:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.651+0000 7f31d575ab80 1 -- 172.21.15.2:0/2310257029 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5590098e1470 con 0x5590098cfc10 2024-06-13T11:24:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.651+0000 7f31b2000700 1 -- 172.21.15.2:0/2310257029 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31ac09c670 con 0x5590098cfc10 2024-06-13T11:24:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.652+0000 7f31b2000700 1 -- 172.21.15.2:0/2310257029 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f31ac09c8d0 con 0x5590098cfc10 2024-06-13T11:24:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.652+0000 7f31d575ab80 10 client.25289 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:24:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.652+0000 7f31d575ab80 10 client.25289 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:24:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.652+0000 7f31d575ab80 20 client.25289 populate_metadata read hostname 'smithi002' 2024-06-13T11:24:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.652+0000 7f31d575ab80 1 --2- 172.21.15.2:0/2310257029 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5590098e3940 0x5590098e5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.652+0000 7f31d575ab80 4 client.25289 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:24:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.652+0000 7f31d575ab80 1 -- 172.21.15.2:0/2310257029 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559009829080 con 0x5590098e3940 2024-06-13T11:24:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.652+0000 7f31c3e00700 1 --2- 172.21.15.2:0/2310257029 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5590098e3940 0x5590098e5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.653+0000 7f31c3e00700 1 --2- 172.21.15.2:0/2310257029 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5590098e3940 0x5590098e5d30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a6e82a950ceeeac server_cookie=3a5e8982bfb2880a in_seq=0 out_seq=0 2024-06-13T11:24:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.653+0000 7f31b2000700 10 client.25289 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:24:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.653+0000 7f31b2000700 1 -- 172.21.15.2:0/2310257029 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559009829080 con 0x5590098e3940 2024-06-13T11:24:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.653+0000 7f31b2000700 10 client.25289 handle_command_reply: tid=0 2024-06-13T11:24:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.654+0000 7f31d575ab80 1 client.25289 shutdown 2024-06-13T11:24:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.654+0000 7f31d575ab80 1 -- 172.21.15.2:0/2310257029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098cfc10 msgr2=0x5590098d3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.654+0000 7f31d575ab80 1 --2- 172.21.15.2:0/2310257029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098cfc10 0x5590098d3650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f31ac029000 tx=0x7f31ac005fb0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.654+0000 7f31d575ab80 1 -- 172.21.15.2:0/2310257029 shutdown_connections 2024-06-13T11:24:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.654+0000 7f31d575ab80 1 --2- 172.21.15.2:0/2310257029 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5590098e3940 0x5590098e5d30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.654+0000 7f31d575ab80 1 --2- 172.21.15.2:0/2310257029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098d0530 0x5590098d3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.654+0000 7f31d575ab80 1 --2- 172.21.15.2:0/2310257029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098ca2c0 0x5590098d6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.654+0000 7f31d575ab80 1 --2- 172.21.15.2:0/2310257029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098cfc10 0x5590098d3650 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.654+0000 7f31b2000700 0 client.25289 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:24:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.654+0000 7f31d575ab80 1 -- 172.21.15.2:0/2310257029 >> 172.21.15.2:0/2310257029 conn(0x5590097f61f0 msgr2=0x5590098be810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.654+0000 7f31d575ab80 1 -- 172.21.15.2:0/2310257029 shutdown_connections 2024-06-13T11:24:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.654+0000 7f31d575ab80 1 -- 172.21.15.2:0/2310257029 wait complete. 2024-06-13T11:24:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.654+0000 7f31d575ab80 20 client.25289 trim_cache size 0 max 16384 2024-06-13T11:24:03.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.677+0000 7f31d575ab80 1 Processor -- start 2024-06-13T11:24:03.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.677+0000 7f31d575ab80 1 -- start start 2024-06-13T11:24:03.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.677+0000 7f31d575ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098ca2c0 0x5590098c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.677+0000 7f31d575ab80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098cfc10 0x5590098bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.677+0000 7f31d575ab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098d0530 0x5590098d5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.677+0000 7f31d575ab80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31c41b2e30 con 0x5590098cfc10 2024-06-13T11:24:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.677+0000 7f31d575ab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f31c41b06c0 con 0x5590098d0530 2024-06-13T11:24:03.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.677+0000 7f31d575ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f31c41ae510 con 0x5590098ca2c0 2024-06-13T11:24:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.678+0000 7f31c3400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098cfc10 0x5590098bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.678+0000 7f31c8e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098d0530 0x5590098d5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.678+0000 7f31c3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098ca2c0 0x5590098c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.678+0000 7f31c8e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098d0530 0x5590098d5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:53220/0 (socket says 172.21.15.2:53220) 2024-06-13T11:24:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.678+0000 7f31c8e00700 1 -- 172.21.15.2:0/2662180898 learned_addr learned my addr 172.21.15.2:0/2662180898 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.678+0000 7f31c3e00700 1 -- 172.21.15.2:0/2662180898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098d0530 msgr2=0x5590098d5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.678+0000 7f31c3e00700 1 --2- 172.21.15.2:0/2662180898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098d0530 0x5590098d5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.678+0000 7f31c3e00700 1 -- 172.21.15.2:0/2662180898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098cfc10 msgr2=0x5590098bf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.678+0000 7f31c3e00700 1 --2- 172.21.15.2:0/2662180898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098cfc10 0x5590098bf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.678+0000 7f31c3e00700 1 -- 172.21.15.2:0/2662180898 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590098d1bc0 con 0x5590098ca2c0 2024-06-13T11:24:03.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.678+0000 7f31c8e00700 1 --2- 172.21.15.2:0/2662180898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098d0530 0x5590098d5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:24:03.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.678+0000 7f31c3e00700 1 --2- 172.21.15.2:0/2662180898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098ca2c0 0x5590098c9d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0cdf00 tx=0x7f31b4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32e14b187e8df612 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:03.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.679+0000 7f31b8c00700 1 -- 172.21.15.2:0/2662180898 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b401e6f0 con 0x5590098ca2c0 2024-06-13T11:24:03.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.679+0000 7f31b8c00700 1 -- 172.21.15.2:0/2662180898 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31b401c440 con 0x5590098ca2c0 2024-06-13T11:24:03.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.679+0000 7f31b8c00700 1 -- 172.21.15.2:0/2662180898 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b400f680 con 0x5590098ca2c0 2024-06-13T11:24:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.680+0000 7f31d575ab80 1 -- 172.21.15.2:0/2662180898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098ca2c0 msgr2=0x5590098c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.680+0000 7f31d575ab80 1 --2- 172.21.15.2:0/2662180898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098ca2c0 0x5590098c9d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0cdf00 tx=0x7f31b4009260 comp rx=0 tx=0).stop 2024-06-13T11:24:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.680+0000 7f31d575ab80 1 -- 172.21.15.2:0/2662180898 shutdown_connections 2024-06-13T11:24:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.680+0000 7f31d575ab80 1 --2- 172.21.15.2:0/2662180898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098d0530 0x5590098d5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.680+0000 7f31d575ab80 1 --2- 172.21.15.2:0/2662180898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098ca2c0 0x5590098c9d80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.680+0000 7f31d575ab80 1 --2- 172.21.15.2:0/2662180898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098cfc10 0x5590098bf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.680+0000 7f31d575ab80 1 -- 172.21.15.2:0/2662180898 >> 172.21.15.2:0/2662180898 conn(0x5590097f61f0 msgr2=0x5590098cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.680+0000 7f31d575ab80 1 -- 172.21.15.2:0/2662180898 shutdown_connections 2024-06-13T11:24:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.680+0000 7f31d575ab80 1 -- 172.21.15.2:0/2662180898 wait complete. 2024-06-13T11:24:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.680+0000 7f31d575ab80 1 -- start start 2024-06-13T11:24:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.681+0000 7f31d575ab80 1 Processor -- start 2024-06-13T11:24:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.681+0000 7f31d575ab80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098ca2c0 0x5590098dc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.681+0000 7f31d575ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098cfc10 0x5590098d8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.681+0000 7f31d575ab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098d0530 0x5590098d9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.681+0000 7f31d575ab80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31c41aeb80 con 0x5590098ca2c0 2024-06-13T11:24:03.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.681+0000 7f31d575ab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f31c41afff0 con 0x5590098d0530 2024-06-13T11:24:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.681+0000 7f31d575ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f31c41af250 con 0x5590098cfc10 2024-06-13T11:24:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.681+0000 7f31d575ab80 10 client.0 _ll_register_callbacks cb 0x5590097b1400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:24:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.681+0000 7f31c3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098ca2c0 0x5590098dc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.681+0000 7f31c3400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098cfc10 0x5590098d8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.681+0000 7f31c3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098ca2c0 0x5590098dc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36514/0 (socket says 172.21.15.2:36514) 2024-06-13T11:24:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.681+0000 7f31c3e00700 1 -- 172.21.15.2:0/3952815297 learned_addr learned my addr 172.21.15.2:0/3952815297 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.682+0000 7f31c8e00700 1 --2- 172.21.15.2:0/3952815297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098d0530 0x5590098d9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.682+0000 7f31c3400700 1 -- 172.21.15.2:0/3952815297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098d0530 msgr2=0x5590098d9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.682+0000 7f31c3400700 1 --2- 172.21.15.2:0/3952815297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098d0530 0x5590098d9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.682+0000 7f31c3400700 1 -- 172.21.15.2:0/3952815297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098ca2c0 msgr2=0x5590098dc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.682+0000 7f31c3400700 1 --2- 172.21.15.2:0/3952815297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098ca2c0 0x5590098dc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.682+0000 7f31c3400700 1 -- 172.21.15.2:0/3952815297 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590098d9960 con 0x5590098cfc10 2024-06-13T11:24:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.682+0000 7f31c3400700 1 --2- 172.21.15.2:0/3952815297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098cfc10 0x5590098d8ee0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f31ac098ad0 tx=0x7f31ac09c230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7055c53d5cbb37c0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.682+0000 7f31b2000700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:24:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.682+0000 7f31b2000700 1 -- 172.21.15.2:0/3952815297 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac09cad0 con 0x5590098cfc10 2024-06-13T11:24:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.682+0000 7f31d575ab80 1 -- 172.21.15.2:0/3952815297 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31b401c440 con 0x5590098cfc10 2024-06-13T11:24:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.682+0000 7f31b2000700 1 -- 172.21.15.2:0/3952815297 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f31ac0a1bb0 con 0x5590098cfc10 2024-06-13T11:24:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.683+0000 7f31b2000700 1 -- 172.21.15.2:0/3952815297 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f31ac09cd70 con 0x5590098cfc10 2024-06-13T11:24:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.683+0000 7f31d575ab80 10 client.25321 fetch_fsmap learned FSMap version 27 2024-06-13T11:24:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.683+0000 7f31d575ab80 1 -- 172.21.15.2:0/3952815297 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5590098d9960 con 0x5590098cfc10 2024-06-13T11:24:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.683+0000 7f31b2000700 1 -- 172.21.15.2:0/3952815297 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31ac0a9080 con 0x5590098cfc10 2024-06-13T11:24:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.683+0000 7f31b2000700 1 -- 172.21.15.2:0/3952815297 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f31ac09bac0 con 0x5590098cfc10 2024-06-13T11:24:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.683+0000 7f31d575ab80 10 client.25321 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:24:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.683+0000 7f31d575ab80 10 client.25321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:24:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.683+0000 7f31d575ab80 20 client.25321 populate_metadata read hostname 'smithi002' 2024-06-13T11:24:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.683+0000 7f31d575ab80 1 --2- 172.21.15.2:0/3952815297 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55900994f400 0x5590099517f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.683+0000 7f31d575ab80 4 client.25321 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-13T11:24:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.683+0000 7f31d575ab80 1 -- 172.21.15.2:0/3952815297 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559009823600 con 0x55900994f400 2024-06-13T11:24:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.684+0000 7f31c3e00700 1 --2- 172.21.15.2:0/3952815297 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55900994f400 0x5590099517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.684+0000 7f31c3e00700 1 --2- 172.21.15.2:0/3952815297 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55900994f400 0x5590099517f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1b364db2a79fbc5 server_cookie=b7fde9fc9e24a268 in_seq=0 out_seq=0 2024-06-13T11:24:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.684+0000 7f31b2000700 10 client.25321 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:24:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.685+0000 7f31b2000700 1 -- 172.21.15.2:0/3952815297 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559009823600 con 0x55900994f400 2024-06-13T11:24:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.685+0000 7f31b2000700 10 client.25321 handle_command_reply: tid=0 2024-06-13T11:24:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.685+0000 7f31d575ab80 1 client.25321 shutdown 2024-06-13T11:24:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.686+0000 7f31d575ab80 1 -- 172.21.15.2:0/3952815297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098cfc10 msgr2=0x5590098d8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.686+0000 7f31d575ab80 1 --2- 172.21.15.2:0/3952815297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098cfc10 0x5590098d8ee0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f31ac098ad0 tx=0x7f31ac09c230 comp rx=0 tx=0).stop 2024-06-13T11:24:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.686+0000 7f31d575ab80 1 -- 172.21.15.2:0/3952815297 shutdown_connections 2024-06-13T11:24:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.686+0000 7f31d575ab80 1 --2- 172.21.15.2:0/3952815297 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55900994f400 0x5590099517f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.686+0000 7f31d575ab80 1 --2- 172.21.15.2:0/3952815297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590098ca2c0 0x5590098dc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.686+0000 7f31d575ab80 1 --2- 172.21.15.2:0/3952815297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590098d0530 0x5590098d9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.686+0000 7f31d575ab80 1 --2- 172.21.15.2:0/3952815297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590098cfc10 0x5590098d8ee0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.686+0000 7f31d575ab80 1 -- 172.21.15.2:0/3952815297 >> 172.21.15.2:0/3952815297 conn(0x5590097f61f0 msgr2=0x5590098ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.686+0000 7f31b2000700 0 client.25321 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:24:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.686+0000 7f31d575ab80 1 -- 172.21.15.2:0/3952815297 shutdown_connections 2024-06-13T11:24:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.686+0000 7f31d575ab80 1 -- 172.21.15.2:0/3952815297 wait complete. 2024-06-13T11:24:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.686+0000 7f31d575ab80 20 client.25321 trim_cache size 0 max 16384 2024-06-13T11:24:03.689 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:24:03.689 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-06-13T11:24:03.689 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "11207b73-a04c-4da0-aab7-2a9f6abae922", 2024-06-13T11:24:03.689 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-06-13T11:24:03.689 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:24:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.687+0000 7f31cae00700 1 -- 172.21.15.2:0/2906772145 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f31a80a2ea0 msgr2=0x7f31a80a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.687+0000 7f31cae00700 1 --2- 172.21.15.2:0/2906772145 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f31a80a2ea0 0x7f31a80a5360 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009ec0 tx=0x7f31bc0092f0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.687+0000 7f31cae00700 1 -- 172.21.15.2:0/2906772145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c4074fe0 msgr2=0x7f31c419b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.687+0000 7f31cae00700 1 --2- 172.21.15.2:0/2906772145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c4074fe0 0x7f31c419b410 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0098e0 tx=0x7f31ac00b8a0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.687+0000 7f31cae00700 1 -- 172.21.15.2:0/2906772145 shutdown_connections 2024-06-13T11:24:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.687+0000 7f31cae00700 1 --2- 172.21.15.2:0/2906772145 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f31a80a2ea0 0x7f31a80a5360 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.687+0000 7f31cae00700 1 --2- 172.21.15.2:0/2906772145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31c410ee90 0x7f31c419f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.687+0000 7f31cae00700 1 --2- 172.21.15.2:0/2906772145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c40746c0 0x7f31c419aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.687+0000 7f31cae00700 1 --2- 172.21.15.2:0/2906772145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31c4074fe0 0x7f31c419b410 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.687+0000 7f31cae00700 1 -- 172.21.15.2:0/2906772145 >> 172.21.15.2:0/2906772145 conn(0x7f31c40795f0 msgr2=0x7f31c40ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:03.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.687+0000 7f31cae00700 1 -- 172.21.15.2:0/2906772145 shutdown_connections 2024-06-13T11:24:03.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.687+0000 7f31cae00700 1 -- 172.21.15.2:0/2906772145 wait complete. 2024-06-13T11:24:03.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:03 smithi178 ceph-mon[36913]: pgmap v11: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 170 B/s wr, 16 op/s 2024-06-13T11:24:03.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:03 smithi178 ceph-mon[36913]: from='client.25291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:24:03.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.759+0000 7fe168c00640 1 -- 172.21.15.2:0/2055218553 --> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fe16410d330 con 0x7fe1480a2d80 2024-06-13T11:24:03.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.769+0000 7fe15b400640 1 -- 172.21.15.2:0/2055218553 <== mgr.25150 v2:172.21.15.2:6800/606530635 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fe16410d330 con 0x7fe1480a2d80 2024-06-13T11:24:03.768 INFO:teuthology.orchestra.run.smithi002.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-06-13T00:00:00", "created": "2024-06-13T11:24:02", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-06-13T11:24:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.771+0000 7fe168c00640 1 -- 172.21.15.2:0/2055218553 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe1480a2d80 msgr2=0x7fe1480a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.771+0000 7fe168c00640 1 --2- 172.21.15.2:0/2055218553 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe1480a2d80 0x7fe1480a5240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe154005e10 tx=0x7fe154005da0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.771+0000 7fe168c00640 1 -- 172.21.15.2:0/2055218553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1641079c0 msgr2=0x7fe16419ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.772+0000 7fe168c00640 1 --2- 172.21.15.2:0/2055218553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1641079c0 0x7fe16419ed30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe15c00e970 tx=0x7fe15c00ee30 comp rx=0 tx=0).stop 2024-06-13T11:24:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.772+0000 7fe168c00640 1 -- 172.21.15.2:0/2055218553 shutdown_connections 2024-06-13T11:24:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.772+0000 7fe168c00640 1 --2- 172.21.15.2:0/2055218553 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe1480a2d80 0x7fe1480a5240 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.772+0000 7fe168c00640 1 --2- 172.21.15.2:0/2055218553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1641079c0 0x7fe16419ed30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.772+0000 7fe168c00640 1 --2- 172.21.15.2:0/2055218553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe164102370 0x7fe16419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.772+0000 7fe168c00640 1 --2- 172.21.15.2:0/2055218553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1641019b0 0x7fe16419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.772+0000 7fe168c00640 1 -- 172.21.15.2:0/2055218553 >> 172.21.15.2:0/2055218553 conn(0x7fe1640fd460 msgr2=0x7fe16410cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:03.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.772+0000 7fe168c00640 1 -- 172.21.15.2:0/2055218553 shutdown_connections 2024-06-13T11:24:03.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:03.772+0000 7fe168c00640 1 -- 172.21.15.2:0/2055218553 wait complete. 2024-06-13T11:24:03.789 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-06-13T11:24:04.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.036+0000 7f5654200640 1 -- 172.21.15.2:0/4011509399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f564c1047c0 msgr2=0x7f564c108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:04.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.036+0000 7f5654200640 1 --2- 172.21.15.2:0/4011509399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f564c1047c0 0x7f564c108800 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5638009900 tx=0x7f563802a3f0 comp rx=0 tx=0).stop 2024-06-13T11:24:04.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.036+0000 7f5654200640 1 -- 172.21.15.2:0/4011509399 shutdown_connections 2024-06-13T11:24:04.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.036+0000 7f5654200640 1 --2- 172.21.15.2:0/4011509399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f564c108ee0 0x7f564c110ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:04.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.036+0000 7f5654200640 1 --2- 172.21.15.2:0/4011509399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f564c1047c0 0x7f564c108800 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:04.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.036+0000 7f5654200640 1 --2- 172.21.15.2:0/4011509399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f564c103e10 0x7f564c1041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:04.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.036+0000 7f5654200640 1 -- 172.21.15.2:0/4011509399 >> 172.21.15.2:0/4011509399 conn(0x7f564c0ff690 msgr2=0x7f564c101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:04.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.036+0000 7f5654200640 1 -- 172.21.15.2:0/4011509399 shutdown_connections 2024-06-13T11:24:04.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.036+0000 7f5654200640 1 -- 172.21.15.2:0/4011509399 wait complete. 2024-06-13T11:24:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.037+0000 7f5654200640 1 Processor -- start 2024-06-13T11:24:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.038+0000 7f5654200640 1 -- start start 2024-06-13T11:24:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.038+0000 7f5654200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f564c103e10 0x7f564c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.038+0000 7f5654200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f564c108ee0 0x7f564c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.038+0000 7f5654200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f564c19edd0 0x7f564c19f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.038+0000 7f5654200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f564c113fe0 con 0x7f564c108ee0 2024-06-13T11:24:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.038+0000 7f5654200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f564c113e60 con 0x7f564c19edd0 2024-06-13T11:24:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.038+0000 7f5654200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f564c114160 con 0x7f564c103e10 2024-06-13T11:24:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.038+0000 7f5651800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f564c103e10 0x7f564c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:04.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.038+0000 7f5650e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f564c108ee0 0x7f564c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.038+0000 7f5651800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f564c103e10 0x7f564c19a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56660/0 (socket says 172.21.15.2:56660) 2024-06-13T11:24:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.038+0000 7f5651800640 1 -- 172.21.15.2:0/3930139781 learned_addr learned my addr 172.21.15.2:0/3930139781 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.038+0000 7f5652200640 1 --2- 172.21.15.2:0/3930139781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f564c19edd0 0x7f564c19f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.039+0000 7f5651800640 1 -- 172.21.15.2:0/3930139781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f564c19edd0 msgr2=0x7f564c19f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.039+0000 7f5651800640 1 --2- 172.21.15.2:0/3930139781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f564c19edd0 0x7f564c19f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.039+0000 7f5651800640 1 -- 172.21.15.2:0/3930139781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f564c108ee0 msgr2=0x7f564c19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.039+0000 7f5651800640 1 --2- 172.21.15.2:0/3930139781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f564c108ee0 0x7f564c19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:04.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.039+0000 7f5651800640 1 -- 172.21.15.2:0/3930139781 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564c19f8c0 con 0x7f564c103e10 2024-06-13T11:24:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.039+0000 7f5651800640 1 --2- 172.21.15.2:0/3930139781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f564c103e10 0x7f564c19a560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f564000eb90 tx=0x7f564000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.039+0000 7f564a000640 1 -- 172.21.15.2:0/3930139781 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5640004d20 con 0x7f564c103e10 2024-06-13T11:24:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.039+0000 7f564a000640 1 -- 172.21.15.2:0/3930139781 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f564000ee90 con 0x7f564c103e10 2024-06-13T11:24:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.039+0000 7f564a000640 1 -- 172.21.15.2:0/3930139781 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5640010830 con 0x7f564c103e10 2024-06-13T11:24:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.039+0000 7f5654200640 1 -- 172.21.15.2:0/3930139781 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f564c19fbb0 con 0x7f564c103e10 2024-06-13T11:24:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.040+0000 7f5654200640 1 -- 172.21.15.2:0/3930139781 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f564c1a7320 con 0x7f564c103e10 2024-06-13T11:24:04.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.041+0000 7f5654200640 1 -- 172.21.15.2:0/3930139781 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f564c04ffb0 con 0x7f564c103e10 2024-06-13T11:24:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.043+0000 7f564a000640 1 -- 172.21.15.2:0/3930139781 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7f5640005000 con 0x7f564c103e10 2024-06-13T11:24:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.044+0000 7f564a000640 1 --2- 172.21.15.2:0/3930139781 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f56340a2d80 0x7f56340a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.044+0000 7f564a000640 1 -- 172.21.15.2:0/3930139781 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f56400d01f0 con 0x7f564c103e10 2024-06-13T11:24:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.044+0000 7f5650e00640 1 --2- 172.21.15.2:0/3930139781 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f56340a2d80 0x7f56340a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:04.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.045+0000 7f5650e00640 1 --2- 172.21.15.2:0/3930139781 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f56340a2d80 0x7f56340a5240 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5638006010 tx=0x7f5638000bc0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.046+0000 7f564a000640 1 -- 172.21.15.2:0/3930139781 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5640053850 con 0x7f564c103e10 2024-06-13T11:24:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.299+0000 7f5654200640 1 -- 172.21.15.2:0/3930139781 --> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f564c1047c0 con 0x7f56340a2d80 2024-06-13T11:24:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.312+0000 7f564a000640 1 -- 172.21.15.2:0/3930139781 <== mgr.25150 v2:172.21.15.2:6800/606530635 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f564c1047c0 con 0x7f56340a2d80 2024-06-13T11:24:04.311 INFO:teuthology.orchestra.run.smithi002.stdout:/ 1m 6m3h 2024-06-13T11:24:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.315+0000 7f5654200640 1 -- 172.21.15.2:0/3930139781 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f56340a2d80 msgr2=0x7f56340a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.315+0000 7f5654200640 1 --2- 172.21.15.2:0/3930139781 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f56340a2d80 0x7f56340a5240 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5638006010 tx=0x7f5638000bc0 comp rx=0 tx=0).stop 2024-06-13T11:24:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.315+0000 7f5654200640 1 -- 172.21.15.2:0/3930139781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f564c103e10 msgr2=0x7f564c19a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.315+0000 7f5654200640 1 --2- 172.21.15.2:0/3930139781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f564c103e10 0x7f564c19a560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f564000eb90 tx=0x7f564000c6a0 comp rx=0 tx=0).stop 2024-06-13T11:24:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.315+0000 7f5654200640 1 -- 172.21.15.2:0/3930139781 shutdown_connections 2024-06-13T11:24:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.315+0000 7f5654200640 1 --2- 172.21.15.2:0/3930139781 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f56340a2d80 0x7f56340a5240 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:04.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.315+0000 7f5654200640 1 --2- 172.21.15.2:0/3930139781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f564c19edd0 0x7f564c19f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.315+0000 7f5654200640 1 --2- 172.21.15.2:0/3930139781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f564c108ee0 0x7f564c19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.315+0000 7f5654200640 1 --2- 172.21.15.2:0/3930139781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f564c103e10 0x7f564c19a560 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.315+0000 7f5654200640 1 -- 172.21.15.2:0/3930139781 >> 172.21.15.2:0/3930139781 conn(0x7f564c0ff690 msgr2=0x7f564c1019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.315+0000 7f5654200640 1 -- 172.21.15.2:0/3930139781 shutdown_connections 2024-06-13T11:24:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:04.315+0000 7f5654200640 1 -- 172.21.15.2:0/3930139781 wait complete. 2024-06-13T11:24:04.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-06-13T11:24:04.426 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-06-13T11:24:04.436 INFO:teuthology.run_tasks:Running task workunit... 2024-06-13T11:24:04.608 INFO:tasks.workunit:Pulling workunits from ref 1373963c202323287783ccb099bbae1ec8f14a5d 2024-06-13T11:24:04.609 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-06-13T11:24:04.609 INFO:tasks.workunit:timeout=3h 2024-06-13T11:24:04.609 INFO:tasks.workunit:cleanup=True 2024-06-13T11:24:04.609 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2024-06-13T11:24:04.610 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:04 smithi077 ceph-mon[36410]: from='client.25271 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:24:04.618 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:04 smithi002 ceph-mon[32210]: from='client.25271 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:24:04.668 INFO:teuthology.orchestra.run.smithi002.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-06-13T11:24:04.668 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-06-13T11:24:04.668 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 77h/119d Inode: 1099511628283 Links: 2 2024-06-13T11:24:04.668 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T11:24:04.669 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-06-13T11:24:04.669 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-06-13 11:20:29.987496651 +0000 2024-06-13T11:24:04.669 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-06-13 11:20:29.987496651 +0000 2024-06-13T11:24:04.669 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-06-13 11:23:43.340720366 +0000 2024-06-13T11:24:04.669 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-06-13 11:20:29.987496651 +0000 2024-06-13T11:24:04.669 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-06-13T11:24:04.669 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-06-13T11:24:04.671 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:24:04.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:04 smithi178 ceph-mon[36913]: from='client.25271 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:24:04.804 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1373963c202323287783ccb099bbae1ec8f14a5d 2024-06-13T11:24:04.903 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-06-13T11:24:05.185 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:24:05.539 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:05 smithi077 ceph-mon[36410]: scrub queued for path: / 2024-06-13T11:24:05.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:05 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:24:05.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:05 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:24:05.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:05 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:24:05.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:05 smithi077 ceph-mon[36410]: from='client.25277 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:24:05.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:05 smithi077 ceph-mon[36410]: pgmap v12: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 170 B/s wr, 17 op/s 2024-06-13T11:24:05.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:05 smithi077 ceph-mon[36410]: from='client.25327 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:24:05.549 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:05 smithi002 ceph-mon[32210]: scrub queued for path: / 2024-06-13T11:24:05.549 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:05 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:24:05.549 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:05 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:24:05.549 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:05 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:24:05.549 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:05 smithi002 ceph-mon[32210]: from='client.25277 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:24:05.549 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:05 smithi002 ceph-mon[32210]: pgmap v12: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 170 B/s wr, 17 op/s 2024-06-13T11:24:05.549 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:05 smithi002 ceph-mon[32210]: from='client.25327 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:24:05.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:05 smithi178 ceph-mon[36913]: scrub queued for path: / 2024-06-13T11:24:05.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:05 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:24:05.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:05 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:24:05.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:05 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:24:05.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:05 smithi178 ceph-mon[36913]: from='client.25277 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:24:05.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:05 smithi178 ceph-mon[36913]: pgmap v12: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 170 B/s wr, 17 op/s 2024-06-13T11:24:05.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:05 smithi178 ceph-mon[36913]: from='client.25327 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:24:07.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:07 smithi077 ceph-mon[36410]: pgmap v13: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:07.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.553+0000 7fd206e00700 1 -- 172.21.15.2:0/1292430166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20010a680 msgr2=0x7fd20010aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:07.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.553+0000 7fd206e00700 1 --2- 172.21.15.2:0/1292430166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20010a680 0x7fd20010aa60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000b0a0 tx=0x7fd1f000b3b0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.553 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:07 smithi002 ceph-mon[32210]: pgmap v13: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:07.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.553+0000 7fd206e00700 1 -- 172.21.15.2:0/1292430166 shutdown_connections 2024-06-13T11:24:07.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.553+0000 7fd206e00700 1 --2- 172.21.15.2:0/1292430166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd200105040 0x7fd200111550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.553+0000 7fd206e00700 1 --2- 172.21.15.2:0/1292430166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20010a680 0x7fd20010aa60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.553+0000 7fd206e00700 1 --2- 172.21.15.2:0/1292430166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd200104680 0x7fd200104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.553+0000 7fd206e00700 1 -- 172.21.15.2:0/1292430166 >> 172.21.15.2:0/1292430166 conn(0x7fd200100170 msgr2=0x7fd200102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:07.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.553+0000 7fd206e00700 1 -- 172.21.15.2:0/1292430166 shutdown_connections 2024-06-13T11:24:07.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.553+0000 7fd206e00700 1 -- 172.21.15.2:0/1292430166 wait complete. 2024-06-13T11:24:07.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.555+0000 7fd206e00700 1 Processor -- start 2024-06-13T11:24:07.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.555+0000 7fd206e00700 1 -- start start 2024-06-13T11:24:07.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.556+0000 7fd206e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd200104680 0x7fd20019ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.556+0000 7fd206e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd200105040 0x7fd20019b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.556+0000 7fd206e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd20010a680 0x7fd20019f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.556+0000 7fd206e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd2001149b0 con 0x7fd200105040 2024-06-13T11:24:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.556+0000 7fd206e00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd200114830 con 0x7fd20010a680 2024-06-13T11:24:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.556+0000 7fd206e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd200114b30 con 0x7fd200104680 2024-06-13T11:24:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.556+0000 7fd1f7400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd200105040 0x7fd20019b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.556+0000 7fd1f7400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd200105040 0x7fd20019b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52264/0 (socket says 172.21.15.2:52264) 2024-06-13T11:24:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.556+0000 7fd1ffe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd200104680 0x7fd20019ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.556+0000 7fd1f7400700 1 -- 172.21.15.2:0/942653106 learned_addr learned my addr 172.21.15.2:0/942653106 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.556+0000 7fd204e00700 1 --2- 172.21.15.2:0/942653106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd20010a680 0x7fd20019f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.557+0000 7fd204e00700 1 -- 172.21.15.2:0/942653106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd200104680 msgr2=0x7fd20019ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.557+0000 7fd204e00700 1 --2- 172.21.15.2:0/942653106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd200104680 0x7fd20019ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.557+0000 7fd204e00700 1 -- 172.21.15.2:0/942653106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd200105040 msgr2=0x7fd20019b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.557+0000 7fd204e00700 1 --2- 172.21.15.2:0/942653106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd200105040 0x7fd20019b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.557+0000 7fd204e00700 1 -- 172.21.15.2:0/942653106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20019fe10 con 0x7fd20010a680 2024-06-13T11:24:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.557+0000 7fd204e00700 1 --2- 172.21.15.2:0/942653106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd20010a680 0x7fd20019f6d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800e970 tx=0x7fd1f800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:07.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.557+0000 7fd1fd600700 1 -- 172.21.15.2:0/942653106 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8004220 con 0x7fd20010a680 2024-06-13T11:24:07.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.557+0000 7fd206e00700 1 -- 172.21.15.2:0/942653106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2001a0100 con 0x7fd20010a680 2024-06-13T11:24:07.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.557+0000 7fd1fd600700 1 -- 172.21.15.2:0/942653106 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1f8004d10 con 0x7fd20010a680 2024-06-13T11:24:07.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.557+0000 7fd1fd600700 1 -- 172.21.15.2:0/942653106 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8010700 con 0x7fd20010a680 2024-06-13T11:24:07.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.558+0000 7fd206e00700 1 -- 172.21.15.2:0/942653106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2001a7980 con 0x7fd20010a680 2024-06-13T11:24:07.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.561+0000 7fd1fd600700 1 -- 172.21.15.2:0/942653106 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7fd1f8004750 con 0x7fd20010a680 2024-06-13T11:24:07.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.563+0000 7fd1fd600700 1 --2- 172.21.15.2:0/942653106 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd1e40a2e20 0x7fd1e40a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.563+0000 7fd211836b80 1 Processor -- start 2024-06-13T11:24:07.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.563+0000 7fd1fd600700 1 -- 172.21.15.2:0/942653106 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fd1f80cf720 con 0x7fd20010a680 2024-06-13T11:24:07.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.563+0000 7fd211836b80 1 -- start start 2024-06-13T11:24:07.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.563+0000 7fd1ffe00700 1 --2- 172.21.15.2:0/942653106 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd1e40a2e20 0x7fd1e40a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.564+0000 7fd211836b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4d55e40 0x560dd4dd9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.564+0000 7fd211836b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4dd95b0 0x560dd4dd9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.564+0000 7fd211836b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4de4300 0x560dd4de66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.564+0000 7fd211836b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560dd4ce8a10 con 0x560dd4d55e40 2024-06-13T11:24:07.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.564+0000 7fd211836b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560dd4d2bb00 con 0x560dd4dd95b0 2024-06-13T11:24:07.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.564+0000 7fd211836b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560dd4ce68f0 con 0x560dd4de4300 2024-06-13T11:24:07.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.564+0000 7fd204e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4de4300 0x560dd4de66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.564+0000 7fd204e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4de4300 0x560dd4de66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:60820/0 (socket says 172.21.15.2:60820) 2024-06-13T11:24:07.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.564+0000 7fd1ffe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4d55e40 0x560dd4dd9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.564+0000 7fd204e00700 1 -- 172.21.15.2:0/1084202112 learned_addr learned my addr 172.21.15.2:0/1084202112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:07.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.564+0000 7fd1f7400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4dd95b0 0x560dd4dd9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.565+0000 7fd204e00700 1 -- 172.21.15.2:0/1084202112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4dd95b0 msgr2=0x560dd4dd9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:07.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.565+0000 7fd204e00700 1 --2- 172.21.15.2:0/1084202112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4dd95b0 0x560dd4dd9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.565+0000 7fd204e00700 1 -- 172.21.15.2:0/1084202112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4d55e40 msgr2=0x560dd4dd9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:07.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.565+0000 7fd204e00700 1 --2- 172.21.15.2:0/1084202112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4d55e40 0x560dd4dd9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.565+0000 7fd1ffe00700 1 --2- 172.21.15.2:0/942653106 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd1e40a2e20 0x7fd1e40a52e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0009e60 tx=0x7fd1f00093c0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:07.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.565+0000 7fd204e00700 1 -- 172.21.15.2:0/1084202112 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dd4cd3f90 con 0x560dd4de4300 2024-06-13T11:24:07.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.565+0000 7fd204e00700 1 --2- 172.21.15.2:0/1084202112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4de4300 0x560dd4de66f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd1f809b400 tx=0x7fd1f809b4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94f80380f97e6aa3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:07.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.565+0000 7fd1f5600700 1 -- 172.21.15.2:0/1084202112 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f801c070 con 0x560dd4de4300 2024-06-13T11:24:07.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.565+0000 7fd1f5600700 1 -- 172.21.15.2:0/1084202112 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1f801e300 con 0x560dd4de4300 2024-06-13T11:24:07.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.565+0000 7fd1f5600700 1 -- 172.21.15.2:0/1084202112 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f80a4370 con 0x560dd4de4300 2024-06-13T11:24:07.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.566+0000 7fd211836b80 1 -- 172.21.15.2:0/1084202112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4de4300 msgr2=0x560dd4de66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:07.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.566+0000 7fd211836b80 1 --2- 172.21.15.2:0/1084202112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4de4300 0x560dd4de66f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd1f809b400 tx=0x7fd1f809b4d0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.566+0000 7fd211836b80 1 -- 172.21.15.2:0/1084202112 shutdown_connections 2024-06-13T11:24:07.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.566+0000 7fd211836b80 1 --2- 172.21.15.2:0/1084202112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4d55e40 0x560dd4dd9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.566+0000 7fd211836b80 1 --2- 172.21.15.2:0/1084202112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4de4300 0x560dd4de66f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.566+0000 7fd211836b80 1 --2- 172.21.15.2:0/1084202112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4dd95b0 0x560dd4dd9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.566+0000 7fd211836b80 1 -- 172.21.15.2:0/1084202112 >> 172.21.15.2:0/1084202112 conn(0x560dd4d06170 msgr2=0x560dd4dd54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:07.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.566+0000 7fd211836b80 1 -- 172.21.15.2:0/1084202112 shutdown_connections 2024-06-13T11:24:07.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.566+0000 7fd211836b80 1 -- 172.21.15.2:0/1084202112 wait complete. 2024-06-13T11:24:07.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.567+0000 7fd211836b80 1 -- start start 2024-06-13T11:24:07.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.567+0000 7fd211836b80 1 Processor -- start 2024-06-13T11:24:07.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.568+0000 7fd211836b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4d55e40 0x560dd4de3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.568+0000 7fd211836b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4dd95b0 0x560dd4de0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.568+0000 7fd211836b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4de4300 0x560dd4de12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.568+0000 7fd211836b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560dd4cc7f60 con 0x560dd4dd95b0 2024-06-13T11:24:07.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.568+0000 7fd211836b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560dd4d27ac0 con 0x560dd4de4300 2024-06-13T11:24:07.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.568+0000 7fd211836b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560dd4de6fc0 con 0x560dd4d55e40 2024-06-13T11:24:07.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.568+0000 7fd211836b80 10 client.0 _ll_register_callbacks cb 0x560dd4cc5720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:24:07.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.568+0000 7fd1ffe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4d55e40 0x560dd4de3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.568+0000 7fd1f7400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4dd95b0 0x560dd4de0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.568+0000 7fd1ffe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4d55e40 0x560dd4de3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:60832/0 (socket says 172.21.15.2:60832) 2024-06-13T11:24:07.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.568+0000 7fd1ffe00700 1 -- 172.21.15.2:0/1778579617 learned_addr learned my addr 172.21.15.2:0/1778579617 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:07.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.568+0000 7fd204e00700 1 --2- 172.21.15.2:0/1778579617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4de4300 0x560dd4de12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.568+0000 7fd1ffe00700 1 -- 172.21.15.2:0/1778579617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4de4300 msgr2=0x560dd4de12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:07.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.569+0000 7fd1ffe00700 1 --2- 172.21.15.2:0/1778579617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4de4300 0x560dd4de12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.569+0000 7fd1ffe00700 1 -- 172.21.15.2:0/1778579617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4dd95b0 msgr2=0x560dd4de0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:07.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.569+0000 7fd1ffe00700 1 --2- 172.21.15.2:0/1778579617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4dd95b0 0x560dd4de0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.569+0000 7fd1ffe00700 1 -- 172.21.15.2:0/1778579617 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dd4c7a8d0 con 0x560dd4d55e40 2024-06-13T11:24:07.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.569+0000 7fd1ffe00700 1 --2- 172.21.15.2:0/1778579617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4d55e40 0x560dd4de3a90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000b0a0 tx=0x7fd1f000b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2241d6ac97e2f9cd server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:07.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.569+0000 7fd1ee000700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:24:07.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.569+0000 7fd1ee000700 1 -- 172.21.15.2:0/1778579617 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0007d50 con 0x560dd4d55e40 2024-06-13T11:24:07.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.569+0000 7fd1ee000700 1 -- 172.21.15.2:0/1778579617 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fd1f00050c0 con 0x560dd4d55e40 2024-06-13T11:24:07.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.569+0000 7fd211836b80 1 -- 172.21.15.2:0/1778579617 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1f801e300 con 0x560dd4d55e40 2024-06-13T11:24:07.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.570+0000 7fd1ee000700 1 -- 172.21.15.2:0/1778579617 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd1f003a050 con 0x560dd4d55e40 2024-06-13T11:24:07.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.570+0000 7fd211836b80 10 client.25339 fetch_fsmap learned FSMap version 27 2024-06-13T11:24:07.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.570+0000 7fd211836b80 1 -- 172.21.15.2:0/1778579617 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560dd4df1710 con 0x560dd4d55e40 2024-06-13T11:24:07.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.570+0000 7fd1ee000700 1 -- 172.21.15.2:0/1778579617 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1f801e300 con 0x560dd4d55e40 2024-06-13T11:24:07.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.570+0000 7fd1ee000700 1 -- 172.21.15.2:0/1778579617 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd1f0011070 con 0x560dd4d55e40 2024-06-13T11:24:07.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.570+0000 7fd211836b80 10 client.25339 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:24:07.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.570+0000 7fd211836b80 10 client.25339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:24:07.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.570+0000 7fd211836b80 20 client.25339 populate_metadata read hostname 'smithi002' 2024-06-13T11:24:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.570+0000 7fd211836b80 1 --2- 172.21.15.2:0/1778579617 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x560dd4df3da0 0x560dd4df6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.570+0000 7fd211836b80 4 client.25339 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:24:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.570+0000 7fd211836b80 1 -- 172.21.15.2:0/1778579617 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560dd4d39000 con 0x560dd4df3da0 2024-06-13T11:24:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.571+0000 7fd1f7400700 1 --2- 172.21.15.2:0/1778579617 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x560dd4df3da0 0x560dd4df6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.571+0000 7fd1f7400700 1 --2- 172.21.15.2:0/1778579617 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x560dd4df3da0 0x560dd4df6210 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e88d14b6ea656293 server_cookie=f3b41b9c1c349b35 in_seq=0 out_seq=0 2024-06-13T11:24:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.571+0000 7fd1ee000700 10 client.25339 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:24:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.572+0000 7fd1ee000700 1 -- 172.21.15.2:0/1778579617 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560dd4d39000 con 0x560dd4df3da0 2024-06-13T11:24:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.572+0000 7fd1ee000700 10 client.25339 handle_command_reply: tid=0 2024-06-13T11:24:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.572+0000 7fd211836b80 1 client.25339 shutdown 2024-06-13T11:24:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.572+0000 7fd211836b80 1 -- 172.21.15.2:0/1778579617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4d55e40 msgr2=0x560dd4de3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.572+0000 7fd211836b80 1 --2- 172.21.15.2:0/1778579617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4d55e40 0x560dd4de3a90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000b0a0 tx=0x7fd1f000b3b0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.572+0000 7fd211836b80 1 -- 172.21.15.2:0/1778579617 shutdown_connections 2024-06-13T11:24:07.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.572+0000 7fd211836b80 1 --2- 172.21.15.2:0/1778579617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4de4300 0x560dd4de12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.572+0000 7fd211836b80 1 --2- 172.21.15.2:0/1778579617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4d55e40 0x560dd4de3a90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.572+0000 7fd211836b80 1 --2- 172.21.15.2:0/1778579617 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x560dd4df3da0 0x560dd4df6210 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.572+0000 7fd211836b80 1 --2- 172.21.15.2:0/1778579617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4dd95b0 0x560dd4de0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.572+0000 7fd1ee000700 0 client.25339 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:24:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.572+0000 7fd211836b80 1 -- 172.21.15.2:0/1778579617 >> 172.21.15.2:0/1778579617 conn(0x560dd4d06170 msgr2=0x560dd4dd4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.573+0000 7fd211836b80 1 -- 172.21.15.2:0/1778579617 shutdown_connections 2024-06-13T11:24:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.573+0000 7fd211836b80 1 -- 172.21.15.2:0/1778579617 wait complete. 2024-06-13T11:24:07.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.573+0000 7fd211836b80 20 client.25339 trim_cache size 0 max 16384 2024-06-13T11:24:07.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.596+0000 7fd211836b80 1 Processor -- start 2024-06-13T11:24:07.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.596+0000 7fd211836b80 1 -- start start 2024-06-13T11:24:07.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.596+0000 7fd211836b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4d55e40 0x560dd4dd5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.596+0000 7fd211836b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4dd95b0 0x560dd4de35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.596+0000 7fd211836b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4de4300 0x560dd4de56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.596+0000 7fd211836b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd2001b2ed0 con 0x560dd4dd95b0 2024-06-13T11:24:07.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.597+0000 7fd211836b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2001b0760 con 0x560dd4de4300 2024-06-13T11:24:07.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.597+0000 7fd211836b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd2001ae5b0 con 0x560dd4d55e40 2024-06-13T11:24:07.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.597+0000 7fd1f7400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4dd95b0 0x560dd4de35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.597+0000 7fd1ffe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4d55e40 0x560dd4dd5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.597+0000 7fd204e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4de4300 0x560dd4de56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.597+0000 7fd1f7400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4dd95b0 0x560dd4de35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52300/0 (socket says 172.21.15.2:52300) 2024-06-13T11:24:07.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.597+0000 7fd1f7400700 1 -- 172.21.15.2:0/4239839870 learned_addr learned my addr 172.21.15.2:0/4239839870 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.597+0000 7fd204e00700 1 -- 172.21.15.2:0/4239839870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4d55e40 msgr2=0x560dd4dd5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.597+0000 7fd204e00700 1 --2- 172.21.15.2:0/4239839870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4d55e40 0x560dd4dd5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.597+0000 7fd204e00700 1 -- 172.21.15.2:0/4239839870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4dd95b0 msgr2=0x560dd4de35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.597+0000 7fd204e00700 1 --2- 172.21.15.2:0/4239839870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4dd95b0 0x560dd4de35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.597+0000 7fd204e00700 1 -- 172.21.15.2:0/4239839870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dd4df6890 con 0x560dd4de4300 2024-06-13T11:24:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.597+0000 7fd1f7400700 1 --2- 172.21.15.2:0/4239839870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4dd95b0 0x560dd4de35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:24:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.597+0000 7fd1ffe00700 1 --2- 172.21.15.2:0/4239839870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4d55e40 0x560dd4dd5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:24:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.598+0000 7fd204e00700 1 --2- 172.21.15.2:0/4239839870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4de4300 0x560dd4de56f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x560dd4de6c80 tx=0x7fd1f8005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=124696e5e79fa4e2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.598+0000 7fd1f4c00700 1 -- 172.21.15.2:0/4239839870 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f80b9070 con 0x560dd4de4300 2024-06-13T11:24:07.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.598+0000 7fd1f4c00700 1 -- 172.21.15.2:0/4239839870 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1f801e300 con 0x560dd4de4300 2024-06-13T11:24:07.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.598+0000 7fd1f4c00700 1 -- 172.21.15.2:0/4239839870 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f801c040 con 0x560dd4de4300 2024-06-13T11:24:07.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.599+0000 7fd211836b80 1 -- 172.21.15.2:0/4239839870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4de4300 msgr2=0x560dd4de56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:07.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.599+0000 7fd211836b80 1 --2- 172.21.15.2:0/4239839870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4de4300 0x560dd4de56f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x560dd4de6c80 tx=0x7fd1f8005800 comp rx=0 tx=0).stop 2024-06-13T11:24:07.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.599+0000 7fd211836b80 1 -- 172.21.15.2:0/4239839870 shutdown_connections 2024-06-13T11:24:07.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.599+0000 7fd211836b80 1 --2- 172.21.15.2:0/4239839870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4de4300 0x560dd4de56f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.599+0000 7fd211836b80 1 --2- 172.21.15.2:0/4239839870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4d55e40 0x560dd4dd5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.599+0000 7fd211836b80 1 --2- 172.21.15.2:0/4239839870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4dd95b0 0x560dd4de35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.599+0000 7fd211836b80 1 -- 172.21.15.2:0/4239839870 >> 172.21.15.2:0/4239839870 conn(0x560dd4d06170 msgr2=0x560dd4dd4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:07.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.599+0000 7fd211836b80 1 -- 172.21.15.2:0/4239839870 shutdown_connections 2024-06-13T11:24:07.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.599+0000 7fd211836b80 1 -- 172.21.15.2:0/4239839870 wait complete. 2024-06-13T11:24:07.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.600+0000 7fd211836b80 1 -- start start 2024-06-13T11:24:07.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.600+0000 7fd211836b80 1 Processor -- start 2024-06-13T11:24:07.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.600+0000 7fd211836b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4d55e40 0x560dd4dec790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.600+0000 7fd211836b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4dd95b0 0x560dd4dfb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.600+0000 7fd211836b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4de4300 0x560dd4dfb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.600+0000 7fd211836b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd2001aec20 con 0x560dd4de4300 2024-06-13T11:24:07.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.600+0000 7fd211836b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2001b0090 con 0x560dd4d55e40 2024-06-13T11:24:07.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.600+0000 7fd211836b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd2001af2f0 con 0x560dd4dd95b0 2024-06-13T11:24:07.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.601+0000 7fd211836b80 10 client.0 _ll_register_callbacks cb 0x560dd4cc5720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:24:07.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.601+0000 7fd1ffe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4d55e40 0x560dd4dec790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.601+0000 7fd1ffe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4d55e40 0x560dd4dec790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:40744/0 (socket says 172.21.15.2:40744) 2024-06-13T11:24:07.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.601+0000 7fd1ffe00700 1 -- 172.21.15.2:0/1324577579 learned_addr learned my addr 172.21.15.2:0/1324577579 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:07.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.601+0000 7fd204e00700 1 --2- 172.21.15.2:0/1324577579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4de4300 0x560dd4dfb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.601+0000 7fd1f7400700 1 --2- 172.21.15.2:0/1324577579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4dd95b0 0x560dd4dfb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.601+0000 7fd1ffe00700 1 -- 172.21.15.2:0/1324577579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4dd95b0 msgr2=0x560dd4dfb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:07.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.601+0000 7fd1ffe00700 1 --2- 172.21.15.2:0/1324577579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4dd95b0 0x560dd4dfb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.601+0000 7fd1ffe00700 1 -- 172.21.15.2:0/1324577579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4de4300 msgr2=0x560dd4dfb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:07.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.601+0000 7fd1ffe00700 1 --2- 172.21.15.2:0/1324577579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4de4300 0x560dd4dfb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.601+0000 7fd1ffe00700 1 -- 172.21.15.2:0/1324577579 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dd4dfbd50 con 0x560dd4d55e40 2024-06-13T11:24:07.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.602+0000 7fd1ffe00700 1 --2- 172.21.15.2:0/1324577579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4d55e40 0x560dd4dec790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0000f80 tx=0x7fd1f00099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a41abb551d995b17 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:07.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.602+0000 7fd1ee000700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:24:07.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.602+0000 7fd1ee000700 1 -- 172.21.15.2:0/1324577579 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f001e9c0 con 0x560dd4d55e40 2024-06-13T11:24:07.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.602+0000 7fd211836b80 1 -- 172.21.15.2:0/1324577579 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1f801e300 con 0x560dd4d55e40 2024-06-13T11:24:07.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.602+0000 7fd1ee000700 1 -- 172.21.15.2:0/1324577579 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fd1f001eb60 con 0x560dd4d55e40 2024-06-13T11:24:07.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.602+0000 7fd1ee000700 1 -- 172.21.15.2:0/1324577579 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd1f0046050 con 0x560dd4d55e40 2024-06-13T11:24:07.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.602+0000 7fd211836b80 10 client.25319 fetch_fsmap learned FSMap version 27 2024-06-13T11:24:07.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.602+0000 7fd211836b80 1 -- 172.21.15.2:0/1324577579 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560dd4deb0c0 con 0x560dd4d55e40 2024-06-13T11:24:07.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.602+0000 7fd1ee000700 1 -- 172.21.15.2:0/1324577579 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1f801e300 con 0x560dd4d55e40 2024-06-13T11:24:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.603+0000 7fd1ee000700 1 -- 172.21.15.2:0/1324577579 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd1f003d070 con 0x560dd4d55e40 2024-06-13T11:24:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.603+0000 7fd211836b80 10 client.25319 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:24:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.603+0000 7fd211836b80 10 client.25319 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:24:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.603+0000 7fd211836b80 20 client.25319 populate_metadata read hostname 'smithi002' 2024-06-13T11:24:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.603+0000 7fd211836b80 1 --2- 172.21.15.2:0/1324577579 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x560dd4e5ef40 0x560dd4e61360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.603+0000 7fd211836b80 4 client.25319 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:24:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.603+0000 7fd211836b80 1 -- 172.21.15.2:0/1324577579 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560dd4d33580 con 0x560dd4e5ef40 2024-06-13T11:24:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.603+0000 7fd1f7400700 1 --2- 172.21.15.2:0/1324577579 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x560dd4e5ef40 0x560dd4e61360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.604+0000 7fd1f7400700 1 --2- 172.21.15.2:0/1324577579 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x560dd4e5ef40 0x560dd4e61360 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdf64b5191bfddd0 server_cookie=1ed33735fe4ef8e1 in_seq=0 out_seq=0 2024-06-13T11:24:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.604+0000 7fd1ee000700 10 client.25319 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:24:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.604+0000 7fd1ee000700 1 -- 172.21.15.2:0/1324577579 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x560dd4d33580 con 0x560dd4e5ef40 2024-06-13T11:24:07.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.604+0000 7fd1ee000700 10 client.25319 handle_command_reply: tid=0 2024-06-13T11:24:07.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.604+0000 7fd211836b80 1 client.25319 shutdown 2024-06-13T11:24:07.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.604+0000 7fd211836b80 1 -- 172.21.15.2:0/1324577579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4d55e40 msgr2=0x560dd4dec790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:07.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.604+0000 7fd211836b80 1 --2- 172.21.15.2:0/1324577579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4d55e40 0x560dd4dec790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0000f80 tx=0x7fd1f00099e0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.604+0000 7fd211836b80 1 -- 172.21.15.2:0/1324577579 shutdown_connections 2024-06-13T11:24:07.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.604+0000 7fd211836b80 1 --2- 172.21.15.2:0/1324577579 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x560dd4e5ef40 0x560dd4e61360 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.604+0000 7fd1ee000700 0 client.25319 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:24:07.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.604+0000 7fd211836b80 1 --2- 172.21.15.2:0/1324577579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560dd4de4300 0x560dd4dfb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.604+0000 7fd211836b80 1 --2- 172.21.15.2:0/1324577579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560dd4d55e40 0x560dd4dec790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.604+0000 7fd211836b80 1 --2- 172.21.15.2:0/1324577579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560dd4dd95b0 0x560dd4dfb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.604+0000 7fd211836b80 1 -- 172.21.15.2:0/1324577579 >> 172.21.15.2:0/1324577579 conn(0x560dd4d06170 msgr2=0x560dd4de0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:07.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.604+0000 7fd211836b80 1 -- 172.21.15.2:0/1324577579 shutdown_connections 2024-06-13T11:24:07.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.604+0000 7fd211836b80 1 -- 172.21.15.2:0/1324577579 wait complete. 2024-06-13T11:24:07.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.605+0000 7fd211836b80 20 client.25319 trim_cache size 0 max 16384 2024-06-13T11:24:07.609 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:24:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-13T11:24:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-06-13T11:24:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "11207b73-a04c-4da0-aab7-2a9f6abae922": { 2024-06-13T11:24:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-06-13T11:24:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "11207b73-a04c-4da0-aab7-2a9f6abae922", 2024-06-13T11:24:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-06-13T11:24:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:24:07.609 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:24:07.609 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:24:07.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.605+0000 7fd206e00700 1 -- 172.21.15.2:0/942653106 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd1e40a2e20 msgr2=0x7fd1e40a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:07.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.605+0000 7fd206e00700 1 --2- 172.21.15.2:0/942653106 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd1e40a2e20 0x7fd1e40a52e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0009e60 tx=0x7fd1f00093c0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.605+0000 7fd206e00700 1 -- 172.21.15.2:0/942653106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd20010a680 msgr2=0x7fd20019f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:07.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.605+0000 7fd206e00700 1 --2- 172.21.15.2:0/942653106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd20010a680 0x7fd20019f6d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800e970 tx=0x7fd1f800ec80 comp rx=0 tx=0).stop 2024-06-13T11:24:07.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.605+0000 7fd206e00700 1 -- 172.21.15.2:0/942653106 shutdown_connections 2024-06-13T11:24:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.605+0000 7fd206e00700 1 --2- 172.21.15.2:0/942653106 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd1e40a2e20 0x7fd1e40a52e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.605+0000 7fd206e00700 1 --2- 172.21.15.2:0/942653106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd20010a680 0x7fd20019f6d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.605+0000 7fd206e00700 1 --2- 172.21.15.2:0/942653106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd200104680 0x7fd20019ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.605+0000 7fd206e00700 1 --2- 172.21.15.2:0/942653106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd200105040 0x7fd20019b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.605+0000 7fd206e00700 1 -- 172.21.15.2:0/942653106 >> 172.21.15.2:0/942653106 conn(0x7fd200100170 msgr2=0x7fd200100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.606+0000 7fd206e00700 1 -- 172.21.15.2:0/942653106 shutdown_connections 2024-06-13T11:24:07.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:07.606+0000 7fd206e00700 1 -- 172.21.15.2:0/942653106 wait complete. 2024-06-13T11:24:07.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:07 smithi178 ceph-mon[36913]: pgmap v13: 129 pgs: 129 active+clean; 1.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:08.576 INFO:tasks.cephfs.filesystem:scrub status for tag:11207b73-a04c-4da0-aab7-2a9f6abae922 - {'path': '/', 'tag': '11207b73-a04c-4da0-aab7-2a9f6abae922', 'options': 'recursive,force'} 2024-06-13T11:24:09.539 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:09 smithi077 ceph-mon[36410]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 39 op/s 2024-06-13T11:24:09.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:09 smithi002 ceph-mon[32210]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 39 op/s 2024-06-13T11:24:09.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:09 smithi178 ceph-mon[36913]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 39 op/s 2024-06-13T11:24:11.539 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:11 smithi077 ceph-mon[36410]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-06-13T11:24:11.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:11 smithi002 ceph-mon[32210]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-06-13T11:24:11.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:11 smithi178 ceph-mon[36913]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-06-13T11:24:13.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:13 smithi002 ceph-mon[32210]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 77 KiB/s wr, 38 op/s 2024-06-13T11:24:13.685 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:13 smithi178 ceph-mon[36913]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 77 KiB/s wr, 38 op/s 2024-06-13T11:24:13.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:13 smithi077 ceph-mon[36410]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 77 KiB/s wr, 38 op/s 2024-06-13T11:24:15.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:15 smithi002 ceph-mon[32210]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 77 KiB/s wr, 38 op/s 2024-06-13T11:24:15.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:15 smithi178 ceph-mon[36913]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 77 KiB/s wr, 38 op/s 2024-06-13T11:24:15.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:15 smithi077 ceph-mon[36410]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 77 KiB/s wr, 38 op/s 2024-06-13T11:24:17.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:17 smithi002 ceph-mon[32210]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-06-13T11:24:17.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:17 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:24:17.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:17 smithi178 ceph-mon[36913]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-06-13T11:24:17.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:17 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:24:17.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:17 smithi077 ceph-mon[36410]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-06-13T11:24:17.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:17 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:24:19.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:19 smithi002 ceph-mon[32210]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 39 op/s 2024-06-13T11:24:19.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:19 smithi178 ceph-mon[36913]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 39 op/s 2024-06-13T11:24:19.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:19 smithi077 ceph-mon[36410]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 39 op/s 2024-06-13T11:24:21.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:21 smithi002 ceph-mon[32210]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:21.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:21 smithi178 ceph-mon[36913]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:21.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:21 smithi077 ceph-mon[36410]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:23.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:23 smithi178 ceph-mon[36913]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:24:23.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:23 smithi002 ceph-mon[32210]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:24:23.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:23 smithi077 ceph-mon[36410]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-13T11:24:25.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:25 smithi002 ceph-mon[32210]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:24:25.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:25 smithi178 ceph-mon[36913]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:24:25.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:25 smithi077 ceph-mon[36410]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:24:27.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:27 smithi002 ceph-mon[32210]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:27.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:27 smithi178 ceph-mon[36913]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:27.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:27 smithi077 ceph-mon[36410]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:29.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:29 smithi002 ceph-mon[32210]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:24:29.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:29 smithi178 ceph-mon[36913]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:24:29.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:29 smithi077 ceph-mon[36410]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:24:31.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:31 smithi002 ceph-mon[32210]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:31.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:31 smithi178 ceph-mon[36913]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:31.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:31 smithi077 ceph-mon[36410]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:33.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:33 smithi002 ceph-mon[32210]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:24:33.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:33 smithi178 ceph-mon[36913]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:24:33.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:33 smithi077 ceph-mon[36410]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:24:35.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:35 smithi002 ceph-mon[32210]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:24:35.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:35 smithi178 ceph-mon[36913]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:24:35.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:35 smithi077 ceph-mon[36410]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T11:24:37.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:37 smithi002 ceph-mon[32210]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:37.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:37 smithi178 ceph-mon[36913]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:37.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:37 smithi077 ceph-mon[36410]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:38.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:24:39.123 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:24:39.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:39 smithi002 ceph-mon[32210]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:24:39.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:39 smithi178 ceph-mon[36913]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:24:39.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:39 smithi077 ceph-mon[36410]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:24:41.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.571+0000 7f80f3600700 1 -- 172.21.15.2:0/2566512216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80ec06aac0 msgr2=0x7f80ec10ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:41.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.571+0000 7f80f3600700 1 --2- 172.21.15.2:0/2566512216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80ec06aac0 0x7f80ec10ea00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009990 tx=0x7f80d8009ca0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.571+0000 7f80f3600700 1 -- 172.21.15.2:0/2566512216 shutdown_connections 2024-06-13T11:24:41.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.571+0000 7f80f3600700 1 --2- 172.21.15.2:0/2566512216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ec10ef40 0x7f80ec111330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.571+0000 7f80f3600700 1 --2- 172.21.15.2:0/2566512216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80ec06a1a0 0x7f80ec06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.571+0000 7f80f3600700 1 --2- 172.21.15.2:0/2566512216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80ec06aac0 0x7f80ec10ea00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.571+0000 7f80f3600700 1 -- 172.21.15.2:0/2566512216 >> 172.21.15.2:0/2566512216 conn(0x7f80ec078340 msgr2=0x7f80ec078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:41.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.571+0000 7f80f3600700 1 -- 172.21.15.2:0/2566512216 shutdown_connections 2024-06-13T11:24:41.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.571+0000 7f80f3600700 1 -- 172.21.15.2:0/2566512216 wait complete. 2024-06-13T11:24:41.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.572+0000 7f80f3600700 1 Processor -- start 2024-06-13T11:24:41.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.572+0000 7f80f3600700 1 -- start start 2024-06-13T11:24:41.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.573+0000 7f80f3600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ec06a1a0 0x7f80ec108430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.573+0000 7f80f3600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80ec06aac0 0x7f80ec108970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.573+0000 7f80f3600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80ec10ef40 0x7f80ec10e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.573+0000 7f80f3600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec1149f0 con 0x7f80ec06a1a0 2024-06-13T11:24:41.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.573+0000 7f80f3600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec114870 con 0x7f80ec10ef40 2024-06-13T11:24:41.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.573+0000 7f80f3600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec114b70 con 0x7f80ec06aac0 2024-06-13T11:24:41.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.573+0000 7f80ebe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80ec06aac0 0x7f80ec108970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.573+0000 7f80ebe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80ec06aac0 0x7f80ec108970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:59928/0 (socket says 172.21.15.2:59928) 2024-06-13T11:24:41.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.573+0000 7f80ebe00700 1 -- 172.21.15.2:0/802157887 learned_addr learned my addr 172.21.15.2:0/802157887 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:41.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.573+0000 7f80f1600700 1 --2- 172.21.15.2:0/802157887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80ec10ef40 0x7f80ec10e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.574+0000 7f80ebe00700 1 -- 172.21.15.2:0/802157887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80ec10ef40 msgr2=0x7f80ec10e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:41.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.574+0000 7f80ebe00700 1 --2- 172.21.15.2:0/802157887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80ec10ef40 0x7f80ec10e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.574+0000 7f80ebe00700 1 -- 172.21.15.2:0/802157887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ec06a1a0 msgr2=0x7f80ec108430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:41.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.574+0000 7f80ebe00700 1 --2- 172.21.15.2:0/802157887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ec06a1a0 0x7f80ec108430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.574+0000 7f80ebe00700 1 -- 172.21.15.2:0/802157887 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ec10eab0 con 0x7f80ec06aac0 2024-06-13T11:24:41.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.574+0000 7f80ebe00700 1 --2- 172.21.15.2:0/802157887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80ec06aac0 0x7f80ec108970 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f80d8005f50 tx=0x7f80d800bf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:41.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.574+0000 7f80e9600700 1 -- 172.21.15.2:0/802157887 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8027070 con 0x7f80ec06aac0 2024-06-13T11:24:41.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.575+0000 7f80e9600700 1 -- 172.21.15.2:0/802157887 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80d8022470 con 0x7f80ec06aac0 2024-06-13T11:24:41.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.575+0000 7f80f3600700 1 -- 172.21.15.2:0/802157887 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80ec10ed40 con 0x7f80ec06aac0 2024-06-13T11:24:41.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.575+0000 7f80f3600700 1 -- 172.21.15.2:0/802157887 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80ec103880 con 0x7f80ec06aac0 2024-06-13T11:24:41.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.575+0000 7f80e9600700 1 -- 172.21.15.2:0/802157887 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8017650 con 0x7f80ec06aac0 2024-06-13T11:24:41.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.580+0000 7f80e9600700 1 -- 172.21.15.2:0/802157887 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7f80d802a070 con 0x7f80ec06aac0 2024-06-13T11:24:41.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.582+0000 7f80e9600700 1 --2- 172.21.15.2:0/802157887 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f80d40a2f20 0x7f80d40a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.582+0000 7f80fdffbb80 1 Processor -- start 2024-06-13T11:24:41.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.582+0000 7f80e9600700 1 -- 172.21.15.2:0/802157887 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f80d80d0710 con 0x7f80ec06aac0 2024-06-13T11:24:41.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.583+0000 7f80fdffbb80 1 -- start start 2024-06-13T11:24:41.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.583+0000 7f80fdffbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917ec4e40 0x557917f48070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.583+0000 7f80f0c00700 1 --2- 172.21.15.2:0/802157887 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f80d40a2f20 0x7f80d40a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.583+0000 7f80fdffbb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917f485b0 0x557917f48a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.583+0000 7f80fdffbb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f53300 0x557917f556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.583+0000 7f80fdffbb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557917e57a10 con 0x557917f485b0 2024-06-13T11:24:41.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.583+0000 7f80fdffbb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557917e9ab00 con 0x557917f53300 2024-06-13T11:24:41.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.583+0000 7f80fdffbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x557917e558f0 con 0x557917ec4e40 2024-06-13T11:24:41.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.584+0000 7f80ebe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917f485b0 0x557917f48a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.584+0000 7f80ebe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917f485b0 0x557917f48a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44630/0 (socket says 172.21.15.2:44630) 2024-06-13T11:24:41.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.584+0000 7f80ebe00700 1 -- 172.21.15.2:0/3418061152 learned_addr learned my addr 172.21.15.2:0/3418061152 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:41.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.584+0000 7f80f0c00700 1 --2- 172.21.15.2:0/3418061152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917ec4e40 0x557917f48070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.584+0000 7f80f1600700 1 --2- 172.21.15.2:0/3418061152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f53300 0x557917f556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.585+0000 7f80ebe00700 1 -- 172.21.15.2:0/3418061152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917ec4e40 msgr2=0x557917f48070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:41.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.585+0000 7f80ebe00700 1 --2- 172.21.15.2:0/3418061152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917ec4e40 0x557917f48070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.585+0000 7f80ebe00700 1 -- 172.21.15.2:0/3418061152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f53300 msgr2=0x557917f556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:41.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.585+0000 7f80ebe00700 1 --2- 172.21.15.2:0/3418061152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f53300 0x557917f556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.585+0000 7f80ebe00700 1 -- 172.21.15.2:0/3418061152 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557917e42f90 con 0x557917f485b0 2024-06-13T11:24:41.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.586+0000 7f80ebe00700 1 --2- 172.21.15.2:0/3418061152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917f485b0 0x557917f48a30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f80d80a4e30 tx=0x7f80d809c0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c301cfe0cbe950e9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:41.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.586+0000 7f80f0c00700 1 --2- 172.21.15.2:0/802157887 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f80d40a2f20 0x7f80d40a53e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f80e0005950 tx=0x7f80e0009a30 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:41.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.586+0000 7f80de000700 1 -- 172.21.15.2:0/3418061152 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80a3070 con 0x557917f485b0 2024-06-13T11:24:41.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.587+0000 7f80de000700 1 -- 172.21.15.2:0/3418061152 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80d80a0b30 con 0x557917f485b0 2024-06-13T11:24:41.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.587+0000 7f80de000700 1 -- 172.21.15.2:0/3418061152 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80095d0 con 0x557917f485b0 2024-06-13T11:24:41.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.588+0000 7f80fdffbb80 1 -- 172.21.15.2:0/3418061152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917f485b0 msgr2=0x557917f48a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:41.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.588+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/3418061152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917f485b0 0x557917f48a30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f80d80a4e30 tx=0x7f80d809c0e0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.588+0000 7f80fdffbb80 1 -- 172.21.15.2:0/3418061152 shutdown_connections 2024-06-13T11:24:41.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.588+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/3418061152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f53300 0x557917f556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.588+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/3418061152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917ec4e40 0x557917f48070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.588+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/3418061152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917f485b0 0x557917f48a30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.588+0000 7f80fdffbb80 1 -- 172.21.15.2:0/3418061152 >> 172.21.15.2:0/3418061152 conn(0x557917e75170 msgr2=0x557917f444b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:41.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.588+0000 7f80fdffbb80 1 -- 172.21.15.2:0/3418061152 shutdown_connections 2024-06-13T11:24:41.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.589+0000 7f80fdffbb80 1 -- 172.21.15.2:0/3418061152 wait complete. 2024-06-13T11:24:41.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.589+0000 7f80fdffbb80 1 -- start start 2024-06-13T11:24:41.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.590+0000 7f80fdffbb80 1 Processor -- start 2024-06-13T11:24:41.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.590+0000 7f80fdffbb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917ec4e40 0x557917f52ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.590+0000 7f80fdffbb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f485b0 0x557917f4fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.590+0000 7f80fdffbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f53300 0x557917f50310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.590+0000 7f80fdffbb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557917e36f60 con 0x557917ec4e40 2024-06-13T11:24:41.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.590+0000 7f80fdffbb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557917e96ac0 con 0x557917f485b0 2024-06-13T11:24:41.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.590+0000 7f80fdffbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x557917f55d70 con 0x557917f53300 2024-06-13T11:24:41.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.591+0000 7f80fdffbb80 10 client.0 _ll_register_callbacks cb 0x557917e34720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:24:41.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.591+0000 7f80f0c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917ec4e40 0x557917f52ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.591+0000 7f80f0c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917ec4e40 0x557917f52ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44644/0 (socket says 172.21.15.2:44644) 2024-06-13T11:24:41.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.591+0000 7f80f0c00700 1 -- 172.21.15.2:0/3137069747 learned_addr learned my addr 172.21.15.2:0/3137069747 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:41.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.591+0000 7f80ebe00700 1 --2- 172.21.15.2:0/3137069747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f485b0 0x557917f4fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.592+0000 7f80f1600700 1 --2- 172.21.15.2:0/3137069747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f53300 0x557917f50310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.592+0000 7f80ebe00700 1 -- 172.21.15.2:0/3137069747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f53300 msgr2=0x557917f50310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:41.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.592+0000 7f80ebe00700 1 --2- 172.21.15.2:0/3137069747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f53300 0x557917f50310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.593+0000 7f80ebe00700 1 -- 172.21.15.2:0/3137069747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917ec4e40 msgr2=0x557917f52ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:41.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.593+0000 7f80ebe00700 1 --2- 172.21.15.2:0/3137069747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917ec4e40 0x557917f52ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.593+0000 7f80ebe00700 1 -- 172.21.15.2:0/3137069747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557917de98d0 con 0x557917f485b0 2024-06-13T11:24:41.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.593+0000 7f80f0c00700 1 --2- 172.21.15.2:0/3137069747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917ec4e40 0x557917f52ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:24:41.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.593+0000 7f80ebe00700 1 --2- 172.21.15.2:0/3137069747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f485b0 0x557917f4fdd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f80d80a4e30 tx=0x7f80d809c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21c8ff5a1ec583f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:41.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.593+0000 7f80d2a00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:24:41.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.593+0000 7f80d2a00700 1 -- 172.21.15.2:0/3137069747 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80a5360 con 0x557917f485b0 2024-06-13T11:24:41.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.594+0000 7f80d2a00700 1 -- 172.21.15.2:0/3137069747 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f80d80094b0 con 0x557917f485b0 2024-06-13T11:24:41.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.594+0000 7f80fdffbb80 1 -- 172.21.15.2:0/3137069747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80d80a0b30 con 0x557917f485b0 2024-06-13T11:24:41.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.594+0000 7f80d2a00700 1 -- 172.21.15.2:0/3137069747 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f80d80d02e0 con 0x557917f485b0 2024-06-13T11:24:41.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.594+0000 7f80fdffbb80 10 client.25331 fetch_fsmap learned FSMap version 27 2024-06-13T11:24:41.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.594+0000 7f80fdffbb80 1 -- 172.21.15.2:0/3137069747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557917f60470 con 0x557917f485b0 2024-06-13T11:24:41.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.595+0000 7f80d2a00700 1 -- 172.21.15.2:0/3137069747 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80d80a0b30 con 0x557917f485b0 2024-06-13T11:24:41.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.595+0000 7f80d2a00700 1 -- 172.21.15.2:0/3137069747 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f80d8098040 con 0x557917f485b0 2024-06-13T11:24:41.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.596+0000 7f80fdffbb80 10 client.25331 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:24:41.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.596+0000 7f80fdffbb80 10 client.25331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:24:41.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.596+0000 7f80fdffbb80 20 client.25331 populate_metadata read hostname 'smithi002' 2024-06-13T11:24:41.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.596+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/3137069747 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x557917f62940 0x557917f64d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.596+0000 7f80fdffbb80 4 client.25331 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:24:41.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.596+0000 7f80fdffbb80 1 -- 172.21.15.2:0/3137069747 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557917ea8000 con 0x557917f62940 2024-06-13T11:24:41.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.596+0000 7f80f0c00700 1 --2- 172.21.15.2:0/3137069747 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x557917f62940 0x557917f64d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.598+0000 7f80f0c00700 1 --2- 172.21.15.2:0/3137069747 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x557917f62940 0x557917f64d30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=143223887ead7553 server_cookie=c962902e2648965b in_seq=0 out_seq=0 2024-06-13T11:24:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.598+0000 7f80d2a00700 10 client.25331 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:24:41.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.599+0000 7f80d2a00700 1 -- 172.21.15.2:0/3137069747 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557917ea8000 con 0x557917f62940 2024-06-13T11:24:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.599+0000 7f80d2a00700 10 client.25331 handle_command_reply: tid=0 2024-06-13T11:24:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.599+0000 7f80fdffbb80 1 client.25331 shutdown 2024-06-13T11:24:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.599+0000 7f80fdffbb80 1 -- 172.21.15.2:0/3137069747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f485b0 msgr2=0x557917f4fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.599+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/3137069747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f485b0 0x557917f4fdd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f80d80a4e30 tx=0x7f80d809c900 comp rx=0 tx=0).stop 2024-06-13T11:24:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.599+0000 7f80fdffbb80 1 -- 172.21.15.2:0/3137069747 shutdown_connections 2024-06-13T11:24:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.599+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/3137069747 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x557917f62940 0x557917f64d30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.599+0000 7f80d2a00700 0 client.25331 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:24:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.599+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/3137069747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917ec4e40 0x557917f52ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.599+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/3137069747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f53300 0x557917f50310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.599+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/3137069747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f485b0 0x557917f4fdd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.599+0000 7f80fdffbb80 1 -- 172.21.15.2:0/3137069747 >> 172.21.15.2:0/3137069747 conn(0x557917e75170 msgr2=0x557917f43740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.600+0000 7f80fdffbb80 1 -- 172.21.15.2:0/3137069747 shutdown_connections 2024-06-13T11:24:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.600+0000 7f80fdffbb80 1 -- 172.21.15.2:0/3137069747 wait complete. 2024-06-13T11:24:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.600+0000 7f80fdffbb80 20 client.25331 trim_cache size 0 max 16384 2024-06-13T11:24:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.624+0000 7f80fdffbb80 1 Processor -- start 2024-06-13T11:24:41.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.624+0000 7f80fdffbb80 1 -- start start 2024-06-13T11:24:41.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:41 smithi002 ceph-mon[32210]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.625+0000 7f80fdffbb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917ec4e40 0x557917f546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.625+0000 7f80fdffbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f485b0 0x557917f54c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.625+0000 7f80fdffbb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917f53300 0x557917f4a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.625+0000 7f80fdffbb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec1aeb70 con 0x557917f53300 2024-06-13T11:24:41.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.625+0000 7f80fdffbb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec1ac400 con 0x557917ec4e40 2024-06-13T11:24:41.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.625+0000 7f80fdffbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec1aa250 con 0x557917f485b0 2024-06-13T11:24:41.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.626+0000 7f80f1600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917f53300 0x557917f4a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.626+0000 7f80ebe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f485b0 0x557917f54c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.626+0000 7f80f1600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917f53300 0x557917f4a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44648/0 (socket says 172.21.15.2:44648) 2024-06-13T11:24:41.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.627+0000 7f80f1600700 1 -- 172.21.15.2:0/1280214951 learned_addr learned my addr 172.21.15.2:0/1280214951 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.627+0000 7f80f0c00700 1 --2- 172.21.15.2:0/1280214951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917ec4e40 0x557917f546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.627+0000 7f80f1600700 1 -- 172.21.15.2:0/1280214951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f485b0 msgr2=0x557917f54c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.627+0000 7f80f1600700 1 --2- 172.21.15.2:0/1280214951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f485b0 0x557917f54c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.627+0000 7f80f1600700 1 -- 172.21.15.2:0/1280214951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917ec4e40 msgr2=0x557917f546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.627+0000 7f80f1600700 1 --2- 172.21.15.2:0/1280214951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917ec4e40 0x557917f546f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.627+0000 7f80f1600700 1 -- 172.21.15.2:0/1280214951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557917f3be10 con 0x557917f53300 2024-06-13T11:24:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.628+0000 7f80f1600700 1 --2- 172.21.15.2:0/1280214951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917f53300 0x557917f4a6d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f80e4015ab0 tx=0x7f80e4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9103bcfad4cb71d9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.629+0000 7f80dd600700 1 -- 172.21.15.2:0/1280214951 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e4004db0 con 0x557917f53300 2024-06-13T11:24:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.629+0000 7f80dd600700 1 -- 172.21.15.2:0/1280214951 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80e40090d0 con 0x557917f53300 2024-06-13T11:24:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.630+0000 7f80fdffbb80 1 -- 172.21.15.2:0/1280214951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917f53300 msgr2=0x557917f4a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.630+0000 7f80dd600700 1 -- 172.21.15.2:0/1280214951 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e4004db0 con 0x557917f53300 2024-06-13T11:24:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.630+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/1280214951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917f53300 0x557917f4a6d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f80e4015ab0 tx=0x7f80e4009920 comp rx=0 tx=0).stop 2024-06-13T11:24:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.630+0000 7f80fdffbb80 1 -- 172.21.15.2:0/1280214951 shutdown_connections 2024-06-13T11:24:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.630+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/1280214951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917f53300 0x557917f4a6d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.630+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/1280214951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917ec4e40 0x557917f546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.630+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/1280214951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f485b0 0x557917f54c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.630+0000 7f80fdffbb80 1 -- 172.21.15.2:0/1280214951 >> 172.21.15.2:0/1280214951 conn(0x557917e75170 msgr2=0x557917f49fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:41.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.631+0000 7f80fdffbb80 1 -- 172.21.15.2:0/1280214951 shutdown_connections 2024-06-13T11:24:41.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.631+0000 7f80fdffbb80 1 -- 172.21.15.2:0/1280214951 wait complete. 2024-06-13T11:24:41.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.631+0000 7f80fdffbb80 1 -- start start 2024-06-13T11:24:41.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.632+0000 7f80fdffbb80 1 Processor -- start 2024-06-13T11:24:41.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.633+0000 7f80fdffbb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917ec4e40 0x557917f5b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.633+0000 7f80fdffbb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f485b0 0x557917f5b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.633+0000 7f80fdffbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f538b0 0x557917f53d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.634+0000 7f80fdffbb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec1aa8c0 con 0x557917ec4e40 2024-06-13T11:24:41.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.634+0000 7f80f1600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f538b0 0x557917f53d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.634+0000 7f80f1600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f538b0 0x557917f53d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:59952/0 (socket says 172.21.15.2:59952) 2024-06-13T11:24:41.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.634+0000 7f80f1600700 1 -- 172.21.15.2:0/4237415709 learned_addr learned my addr 172.21.15.2:0/4237415709 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:41.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.634+0000 7f80fdffbb80 1 -- 172.21.15.2:0/4237415709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec1abd30 con 0x557917f485b0 2024-06-13T11:24:41.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.634+0000 7f80fdffbb80 1 -- 172.21.15.2:0/4237415709 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec1aaf90 con 0x557917f538b0 2024-06-13T11:24:41.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.634+0000 7f80ebe00700 1 --2- 172.21.15.2:0/4237415709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f485b0 0x557917f5b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.634+0000 7f80f1600700 1 -- 172.21.15.2:0/4237415709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f485b0 msgr2=0x557917f5b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:41.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.635+0000 7f80fdffbb80 10 client.0 _ll_register_callbacks cb 0x557917e34720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:24:41.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.635+0000 7f80f0c00700 1 --2- 172.21.15.2:0/4237415709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917ec4e40 0x557917f5b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.635+0000 7f80f1600700 1 --2- 172.21.15.2:0/4237415709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f485b0 0x557917f5b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.635+0000 7f80f1600700 1 -- 172.21.15.2:0/4237415709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917ec4e40 msgr2=0x557917f5b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:41.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.635+0000 7f80f1600700 1 --2- 172.21.15.2:0/4237415709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917ec4e40 0x557917f5b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.635+0000 7f80f1600700 1 -- 172.21.15.2:0/4237415709 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557917f54510 con 0x557917f538b0 2024-06-13T11:24:41.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.635+0000 7f80fdffbb80 1 -- 172.21.15.2:0/4237415709 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80e40090d0 con 0x557917f538b0 2024-06-13T11:24:41.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.635+0000 7f80ebe00700 1 --2- 172.21.15.2:0/4237415709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f485b0 0x557917f5b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:24:41.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.635+0000 7f80f0c00700 1 --2- 172.21.15.2:0/4237415709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917ec4e40 0x557917f5b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:24:41.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.636+0000 7f80f1600700 1 --2- 172.21.15.2:0/4237415709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f538b0 0x557917f53d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f80e401f000 tx=0x7f80e4015f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d93f530c33f6058 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:41.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.636+0000 7f80d2a00700 10 client.25363 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:24:41.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.637+0000 7f80d2a00700 1 -- 172.21.15.2:0/4237415709 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e402c060 con 0x557917f538b0 2024-06-13T11:24:41.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.638+0000 7f80d2a00700 1 -- 172.21.15.2:0/4237415709 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f80e4004200 con 0x557917f538b0 2024-06-13T11:24:41.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.638+0000 7f80d2a00700 1 -- 172.21.15.2:0/4237415709 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f80e4004480 con 0x557917f538b0 2024-06-13T11:24:41.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.638+0000 7f80fdffbb80 10 client.25363 fetch_fsmap learned FSMap version 27 2024-06-13T11:24:41.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.638+0000 7f80fdffbb80 1 -- 172.21.15.2:0/4237415709 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({fsmap=27}) -- 0x557917fcd3b0 con 0x557917f538b0 2024-06-13T11:24:41.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.639+0000 7f80d2a00700 1 -- 172.21.15.2:0/4237415709 <== mon.1 v2:172.21.15.178:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f80e4026030 con 0x557917f538b0 2024-06-13T11:24:41.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.639+0000 7f80fdffbb80 10 client.25363 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:24:41.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.639+0000 7f80fdffbb80 10 client.25363 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:24:41.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.639+0000 7f80fdffbb80 20 client.25363 populate_metadata read hostname 'smithi002' 2024-06-13T11:24:41.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.639+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/4237415709 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x557917fcd7b0 0x557917fcfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:41.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.639+0000 7f80fdffbb80 4 client.25363 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:24:41.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.639+0000 7f80fdffbb80 1 -- 172.21.15.2:0/4237415709 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557917ea2580 con 0x557917fcd7b0 2024-06-13T11:24:41.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.640+0000 7f80f0c00700 1 --2- 172.21.15.2:0/4237415709 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x557917fcd7b0 0x557917fcfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:41.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.641+0000 7f80d2a00700 10 client.25363 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:24:41.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.641+0000 7f80f0c00700 1 --2- 172.21.15.2:0/4237415709 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x557917fcd7b0 0x557917fcfba0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e491c0b527c20fe9 server_cookie=a2f43f4216fcca1 in_seq=0 out_seq=0 2024-06-13T11:24:41.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.641+0000 7f80d2a00700 1 -- 172.21.15.2:0/4237415709 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557917ea2580 con 0x557917fcd7b0 2024-06-13T11:24:41.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.641+0000 7f80d2a00700 10 client.25363 handle_command_reply: tid=0 2024-06-13T11:24:41.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.641+0000 7f80fdffbb80 1 client.25363 shutdown 2024-06-13T11:24:41.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.642+0000 7f80fdffbb80 1 -- 172.21.15.2:0/4237415709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f538b0 msgr2=0x557917f53d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:41.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.642+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/4237415709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f538b0 0x557917f53d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f80e401f000 tx=0x7f80e4015f90 comp rx=0 tx=0).stop 2024-06-13T11:24:41.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.642+0000 7f80fdffbb80 1 -- 172.21.15.2:0/4237415709 shutdown_connections 2024-06-13T11:24:41.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.642+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/4237415709 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x557917fcd7b0 0x557917fcfba0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.642+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/4237415709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557917ec4e40 0x557917f5b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.642+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/4237415709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557917f538b0 0x557917f53d10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.642+0000 7f80fdffbb80 1 --2- 172.21.15.2:0/4237415709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557917f485b0 0x557917f5b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.642+0000 7f80d2a00700 0 client.25363 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:24:41.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.642+0000 7f80fdffbb80 1 -- 172.21.15.2:0/4237415709 >> 172.21.15.2:0/4237415709 conn(0x557917e75170 msgr2=0x557917f4a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:41.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.643+0000 7f80fdffbb80 1 -- 172.21.15.2:0/4237415709 shutdown_connections 2024-06-13T11:24:41.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.643+0000 7f80fdffbb80 1 -- 172.21.15.2:0/4237415709 wait complete. 2024-06-13T11:24:41.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.644+0000 7f80fdffbb80 20 client.25363 trim_cache size 0 max 16384 2024-06-13T11:24:41.643 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:24:41.643 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-06-13T11:24:41.643 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-06-13T11:24:41.643 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:24:41.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.645+0000 7f80f3600700 1 -- 172.21.15.2:0/802157887 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f80d40a2f20 msgr2=0x7f80d40a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.645+0000 7f80f3600700 1 --2- 172.21.15.2:0/802157887 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f80d40a2f20 0x7f80d40a53e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f80e0005950 tx=0x7f80e0009a30 comp rx=0 tx=0).stop 2024-06-13T11:24:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.645+0000 7f80f3600700 1 -- 172.21.15.2:0/802157887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80ec06aac0 msgr2=0x7f80ec108970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.645+0000 7f80f3600700 1 --2- 172.21.15.2:0/802157887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80ec06aac0 0x7f80ec108970 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f80d8005f50 tx=0x7f80d800bf20 comp rx=0 tx=0).stop 2024-06-13T11:24:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.646+0000 7f80f3600700 1 -- 172.21.15.2:0/802157887 shutdown_connections 2024-06-13T11:24:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.646+0000 7f80f3600700 1 --2- 172.21.15.2:0/802157887 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f80d40a2f20 0x7f80d40a53e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.646+0000 7f80f3600700 1 --2- 172.21.15.2:0/802157887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ec06a1a0 0x7f80ec108430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.646+0000 7f80f3600700 1 --2- 172.21.15.2:0/802157887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80ec10ef40 0x7f80ec10e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.646+0000 7f80f3600700 1 --2- 172.21.15.2:0/802157887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80ec06aac0 0x7f80ec108970 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.646+0000 7f80f3600700 1 -- 172.21.15.2:0/802157887 >> 172.21.15.2:0/802157887 conn(0x7f80ec078340 msgr2=0x7f80ec110390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:41.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.647+0000 7f80f3600700 1 -- 172.21.15.2:0/802157887 shutdown_connections 2024-06-13T11:24:41.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:41.647+0000 7f80f3600700 1 -- 172.21.15.2:0/802157887 wait complete. 2024-06-13T11:24:41.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:41 smithi178 ceph-mon[36913]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:41.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:41 smithi077 ceph-mon[36410]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:42.563 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-13T11:24:42.563 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:24:43.053 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:24:43.370 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:43 smithi002 ceph-mon[32210]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-13T11:24:43.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:43 smithi178 ceph-mon[36913]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-13T11:24:43.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:43 smithi077 ceph-mon[36410]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-13T11:24:45.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.476+0000 7fc67e400700 1 -- 172.21.15.2:0/3837048320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc678103580 msgr2=0x7fc678103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.476+0000 7fc67e400700 1 --2- 172.21.15.2:0/3837048320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc678103580 0x7fc678103960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc66c009990 tx=0x7fc66c009ca0 comp rx=0 tx=0).stop 2024-06-13T11:24:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.476+0000 7fc67e400700 1 -- 172.21.15.2:0/3837048320 shutdown_connections 2024-06-13T11:24:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.476+0000 7fc67e400700 1 --2- 172.21.15.2:0/3837048320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc67810c9b0 0x7fc67810ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.476+0000 7fc67e400700 1 --2- 172.21.15.2:0/3837048320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc678103580 0x7fc678103960 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.476+0000 7fc67e400700 1 --2- 172.21.15.2:0/3837048320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc678103ea0 0x7fc67810c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.476+0000 7fc67e400700 1 -- 172.21.15.2:0/3837048320 >> 172.21.15.2:0/3837048320 conn(0x7fc6780fcdb0 msgr2=0x7fc6780ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.476+0000 7fc67e400700 1 -- 172.21.15.2:0/3837048320 shutdown_connections 2024-06-13T11:24:45.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.477+0000 7fc67e400700 1 -- 172.21.15.2:0/3837048320 wait complete. 2024-06-13T11:24:45.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.478+0000 7fc67e400700 1 Processor -- start 2024-06-13T11:24:45.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.479+0000 7fc67e400700 1 -- start start 2024-06-13T11:24:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.479+0000 7fc67e400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc678103580 0x7fc67819e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.479+0000 7fc67e400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc678103ea0 0x7fc67819ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.479+0000 7fc67e400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc67810c9b0 0x7fc678198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.479+0000 7fc67e400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc678112760 con 0x7fc678103ea0 2024-06-13T11:24:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.479+0000 7fc67e400700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6781125e0 con 0x7fc67810c9b0 2024-06-13T11:24:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.479+0000 7fc67e400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc6781128e0 con 0x7fc678103580 2024-06-13T11:24:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.480+0000 7fc677e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc678103ea0 0x7fc67819ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.480+0000 7fc677e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc678103ea0 0x7fc67819ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44672/0 (socket says 172.21.15.2:44672) 2024-06-13T11:24:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.480+0000 7fc677e00700 1 -- 172.21.15.2:0/2338802267 learned_addr learned my addr 172.21.15.2:0/2338802267 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.480+0000 7fc67da00700 1 --2- 172.21.15.2:0/2338802267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc67810c9b0 0x7fc678198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.480+0000 7fc67d000700 1 --2- 172.21.15.2:0/2338802267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc678103580 0x7fc67819e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.480+0000 7fc67da00700 1 -- 172.21.15.2:0/2338802267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc678103580 msgr2=0x7fc67819e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.480+0000 7fc67da00700 1 --2- 172.21.15.2:0/2338802267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc678103580 0x7fc67819e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.480+0000 7fc67da00700 1 -- 172.21.15.2:0/2338802267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc678103ea0 msgr2=0x7fc67819ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.480+0000 7fc67da00700 1 --2- 172.21.15.2:0/2338802267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc678103ea0 0x7fc67819ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.480+0000 7fc67da00700 1 -- 172.21.15.2:0/2338802267 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc678199180 con 0x7fc67810c9b0 2024-06-13T11:24:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.480+0000 7fc677e00700 1 --2- 172.21.15.2:0/2338802267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc678103ea0 0x7fc67819ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:24:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.481+0000 7fc67da00700 1 --2- 172.21.15.2:0/2338802267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc67810c9b0 0x7fc678198a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc67000efc0 tx=0x7fc67000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:45.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.481+0000 7fc675600700 1 -- 172.21.15.2:0/2338802267 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6700092e0 con 0x7fc67810c9b0 2024-06-13T11:24:45.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.481+0000 7fc675600700 1 -- 172.21.15.2:0/2338802267 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc670004bb0 con 0x7fc67810c9b0 2024-06-13T11:24:45.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.481+0000 7fc675600700 1 -- 172.21.15.2:0/2338802267 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc670004280 con 0x7fc67810c9b0 2024-06-13T11:24:45.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.481+0000 7fc67e400700 1 -- 172.21.15.2:0/2338802267 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc678199410 con 0x7fc67810c9b0 2024-06-13T11:24:45.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.481+0000 7fc67e400700 1 -- 172.21.15.2:0/2338802267 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc678101110 con 0x7fc67810c9b0 2024-06-13T11:24:45.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.483+0000 7fc67e400700 1 -- 172.21.15.2:0/2338802267 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc67806aa50 con 0x7fc67810c9b0 2024-06-13T11:24:45.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.486+0000 7fc675600700 1 -- 172.21.15.2:0/2338802267 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7fc67001b030 con 0x7fc67810c9b0 2024-06-13T11:24:45.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.488+0000 7fc675600700 1 --2- 172.21.15.2:0/2338802267 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6600a2e20 0x7fc6600a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:45.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.488+0000 7fc675600700 1 -- 172.21.15.2:0/2338802267 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fc6700cf4b0 con 0x7fc67810c9b0 2024-06-13T11:24:45.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.489+0000 7fc67d000700 1 --2- 172.21.15.2:0/2338802267 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6600a2e20 0x7fc6600a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:45.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.490+0000 7fc67d000700 1 --2- 172.21.15.2:0/2338802267 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6600a2e20 0x7fc6600a52e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc66c00b2e0 tx=0x7fc66c01a040 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:45.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.492+0000 7fc675600700 1 -- 172.21.15.2:0/2338802267 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc670022020 con 0x7fc67810c9b0 2024-06-13T11:24:45.491 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:45 smithi002 ceph-mon[32210]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-06-13T11:24:45.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:45 smithi178 ceph-mon[36913]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-06-13T11:24:45.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:45 smithi077 ceph-mon[36410]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-06-13T11:24:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.855+0000 7fc67e400700 1 -- 172.21.15.2:0/2338802267 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc678199f00 con 0x7fc67810c9b0 2024-06-13T11:24:45.856 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:24:45.856 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:23:44.392864+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24493,24509,24511]},"id":1}]} 2024-06-13T11:24:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.856+0000 7fc675600700 1 -- 172.21.15.2:0/2338802267 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11853 (secure 0 0 0) 0x7fc670010040 con 0x7fc67810c9b0 2024-06-13T11:24:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.859+0000 7fc67e400700 1 -- 172.21.15.2:0/2338802267 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6600a2e20 msgr2=0x7fc6600a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.859+0000 7fc67e400700 1 --2- 172.21.15.2:0/2338802267 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6600a2e20 0x7fc6600a52e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc66c00b2e0 tx=0x7fc66c01a040 comp rx=0 tx=0).stop 2024-06-13T11:24:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.859+0000 7fc67e400700 1 -- 172.21.15.2:0/2338802267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc67810c9b0 msgr2=0x7fc678198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.859+0000 7fc67e400700 1 --2- 172.21.15.2:0/2338802267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc67810c9b0 0x7fc678198a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc67000efc0 tx=0x7fc67000c3a0 comp rx=0 tx=0).stop 2024-06-13T11:24:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.859+0000 7fc67e400700 1 -- 172.21.15.2:0/2338802267 shutdown_connections 2024-06-13T11:24:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.859+0000 7fc67e400700 1 --2- 172.21.15.2:0/2338802267 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6600a2e20 0x7fc6600a52e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.859+0000 7fc67e400700 1 --2- 172.21.15.2:0/2338802267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc67810c9b0 0x7fc678198a20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.859+0000 7fc67e400700 1 --2- 172.21.15.2:0/2338802267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc678103580 0x7fc67819e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.859+0000 7fc67e400700 1 --2- 172.21.15.2:0/2338802267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc678103ea0 0x7fc67819ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.859+0000 7fc67e400700 1 -- 172.21.15.2:0/2338802267 >> 172.21.15.2:0/2338802267 conn(0x7fc6780fcdb0 msgr2=0x7fc6780fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.860+0000 7fc67e400700 1 -- 172.21.15.2:0/2338802267 shutdown_connections 2024-06-13T11:24:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:45.860+0000 7fc67e400700 1 -- 172.21.15.2:0/2338802267 wait complete. 2024-06-13T11:24:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-06-13T11:24:46.594 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:46 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2338802267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:24:46.654 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-13T11:24:46.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:46 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2338802267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:24:46.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:46 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2338802267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:24:47.211 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:24:47.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:47 smithi002 ceph-mon[32210]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-06-13T11:24:47.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:47 smithi178 ceph-mon[36913]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-06-13T11:24:47.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:47 smithi077 ceph-mon[36410]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-06-13T11:24:49.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.514+0000 7fd6bb200700 1 -- 172.21.15.2:0/1801787900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6b4108ac0 msgr2=0x7fd6b410f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:49.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.514+0000 7fd6bb200700 1 --2- 172.21.15.2:0/1801787900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6b4108ac0 0x7fd6b410f440 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000b0d0 tx=0x7fd6b000b3e0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.515+0000 7fd6bb200700 1 -- 172.21.15.2:0/1801787900 shutdown_connections 2024-06-13T11:24:49.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.515+0000 7fd6bb200700 1 --2- 172.21.15.2:0/1801787900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6b4108ac0 0x7fd6b410f440 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.515+0000 7fd6bb200700 1 --2- 172.21.15.2:0/1801787900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6b41035a0 0x7fd6b4103980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.515+0000 7fd6bb200700 1 --2- 172.21.15.2:0/1801787900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6b4103f50 0x7fd6b4108390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.515+0000 7fd6bb200700 1 -- 172.21.15.2:0/1801787900 >> 172.21.15.2:0/1801787900 conn(0x7fd6b40fcd70 msgr2=0x7fd6b40ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:49.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.515+0000 7fd6bb200700 1 -- 172.21.15.2:0/1801787900 shutdown_connections 2024-06-13T11:24:49.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.515+0000 7fd6bb200700 1 -- 172.21.15.2:0/1801787900 wait complete. 2024-06-13T11:24:49.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.517+0000 7fd6bb200700 1 Processor -- start 2024-06-13T11:24:49.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.517+0000 7fd6bb200700 1 -- start start 2024-06-13T11:24:49.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.517+0000 7fd6bb200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6b41035a0 0x7fd6b4101200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.518+0000 7fd6bb200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6b4103f50 0x7fd6b4101740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.518+0000 7fd6bb200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6b4108ac0 0x7fd6b4101c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.518+0000 7fd6bb200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b4112830 con 0x7fd6b41035a0 2024-06-13T11:24:49.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.518+0000 7fd6bb200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b41126b0 con 0x7fd6b4108ac0 2024-06-13T11:24:49.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.518+0000 7fd6bb200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b41129b0 con 0x7fd6b4103f50 2024-06-13T11:24:49.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.518+0000 7fd6ba800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6b4108ac0 0x7fd6b4101c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.518+0000 7fd6ba800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6b4108ac0 0x7fd6b4101c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:44380/0 (socket says 172.21.15.2:44380) 2024-06-13T11:24:49.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.518+0000 7fd6ba800700 1 -- 172.21.15.2:0/419621884 learned_addr learned my addr 172.21.15.2:0/419621884 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:49.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.518+0000 7fd6b9e00700 1 --2- 172.21.15.2:0/419621884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6b41035a0 0x7fd6b4101200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.518+0000 7fd6b9400700 1 --2- 172.21.15.2:0/419621884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6b4103f50 0x7fd6b4101740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.519+0000 7fd6ba800700 1 -- 172.21.15.2:0/419621884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6b4103f50 msgr2=0x7fd6b4101740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:49.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.519+0000 7fd6ba800700 1 --2- 172.21.15.2:0/419621884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6b4103f50 0x7fd6b4101740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.519+0000 7fd6ba800700 1 -- 172.21.15.2:0/419621884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6b41035a0 msgr2=0x7fd6b4101200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:49.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.519+0000 7fd6ba800700 1 --2- 172.21.15.2:0/419621884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6b41035a0 0x7fd6b4101200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.519+0000 7fd6ba800700 1 -- 172.21.15.2:0/419621884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b41a7130 con 0x7fd6b4108ac0 2024-06-13T11:24:49.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.519+0000 7fd6b9e00700 1 --2- 172.21.15.2:0/419621884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6b41035a0 0x7fd6b4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:24:49.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.519+0000 7fd6ba800700 1 --2- 172.21.15.2:0/419621884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6b4108ac0 0x7fd6b4101c80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000d010 tx=0x7fd6b0007a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:49.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.520+0000 7fd6aea00700 1 -- 172.21.15.2:0/419621884 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0003c00 con 0x7fd6b4108ac0 2024-06-13T11:24:49.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.520+0000 7fd6aea00700 1 -- 172.21.15.2:0/419621884 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6b0022070 con 0x7fd6b4108ac0 2024-06-13T11:24:49.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.520+0000 7fd6aea00700 1 -- 172.21.15.2:0/419621884 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b001b7d0 con 0x7fd6b4108ac0 2024-06-13T11:24:49.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.521+0000 7fd6bb200700 1 -- 172.21.15.2:0/419621884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b41a73c0 con 0x7fd6b4108ac0 2024-06-13T11:24:49.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.521+0000 7fd6bb200700 1 -- 172.21.15.2:0/419621884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b41a77c0 con 0x7fd6b4108ac0 2024-06-13T11:24:49.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.526+0000 7fd6aea00700 1 -- 172.21.15.2:0/419621884 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7fd6b0009ba0 con 0x7fd6b4108ac0 2024-06-13T11:24:49.526 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:49 smithi002 ceph-mon[32210]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-13T11:24:49.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.527+0000 7fd6c7252b80 1 Processor -- start 2024-06-13T11:24:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.528+0000 7fd6aea00700 1 --2- 172.21.15.2:0/419621884 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd69c0a2e20 0x7fd69c0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.528+0000 7fd6c7252b80 1 -- start start 2024-06-13T11:24:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.528+0000 7fd6aea00700 1 -- 172.21.15.2:0/419621884 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fd6b000f020 con 0x7fd6b4108ac0 2024-06-13T11:24:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.529+0000 7fd6b9400700 1 --2- 172.21.15.2:0/419621884 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd69c0a2e20 0x7fd69c0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.529+0000 7fd6c7252b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8570 0x560b5c2b8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.529+0000 7fd6c7252b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2b8e90 0x560b5c2c3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.530+0000 7fd6b9400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2b8e90 0x560b5c2c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.530+0000 7fd6c7252b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2c3d40 0x560b5c2c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.530+0000 7fd6c7252b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560b5c1bfa10 con 0x560b5c2c3d40 2024-06-13T11:24:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.530+0000 7fd6c7252b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560b5c202b00 con 0x560b5c2b8e90 2024-06-13T11:24:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.530+0000 7fd6b9e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8570 0x560b5c2b8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.530+0000 7fd6b9e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8570 0x560b5c2b8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55098/0 (socket says 172.21.15.2:55098) 2024-06-13T11:24:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.530+0000 7fd6b9e00700 1 -- 172.21.15.2:0/1123807602 learned_addr learned my addr 172.21.15.2:0/1123807602 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.530+0000 7fd6ba800700 1 --2- 172.21.15.2:0/1123807602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2c3d40 0x560b5c2c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.530+0000 7fd6c7252b80 1 -- 172.21.15.2:0/1123807602 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560b5c1bd8f0 con 0x560b5c2b8570 2024-06-13T11:24:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.531+0000 7fd6ba800700 1 -- 172.21.15.2:0/1123807602 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8570 msgr2=0x560b5c2b8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.531+0000 7fd6ba800700 1 --2- 172.21.15.2:0/1123807602 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8570 0x560b5c2b8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.531+0000 7fd6ba800700 1 -- 172.21.15.2:0/1123807602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2b8e90 msgr2=0x560b5c2c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.531+0000 7fd6ba800700 1 --2- 172.21.15.2:0/1123807602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2b8e90 0x560b5c2c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.531+0000 7fd6ba800700 1 -- 172.21.15.2:0/1123807602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b5c1aaf90 con 0x560b5c2c3d40 2024-06-13T11:24:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.531+0000 7fd6ba800700 1 --2- 172.21.15.2:0/1123807602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2c3d40 0x560b5c2c6130 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd6b00cd3b0 tx=0x7fd6b001dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d26c8a345e20951 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.532+0000 7fd6b9400700 1 --2- 172.21.15.2:0/419621884 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd69c0a2e20 0x7fd69c0a52e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40fe120 tx=0x7fd6a4013790 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:49.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.532+0000 7fd6a3400700 1 -- 172.21.15.2:0/1123807602 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b009c160 con 0x560b5c2c3d40 2024-06-13T11:24:49.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.532+0000 7fd6a3400700 1 -- 172.21.15.2:0/1123807602 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6b00a0510 con 0x560b5c2c3d40 2024-06-13T11:24:49.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.532+0000 7fd6a3400700 1 -- 172.21.15.2:0/1123807602 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b00cd660 con 0x560b5c2c3d40 2024-06-13T11:24:49.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.533+0000 7fd6c7252b80 1 -- 172.21.15.2:0/1123807602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2c3d40 msgr2=0x560b5c2c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:49.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.533+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/1123807602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2c3d40 0x560b5c2c6130 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd6b00cd3b0 tx=0x7fd6b001dd60 comp rx=0 tx=0).stop 2024-06-13T11:24:49.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.533+0000 7fd6c7252b80 1 -- 172.21.15.2:0/1123807602 shutdown_connections 2024-06-13T11:24:49.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.533+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/1123807602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2c3d40 0x560b5c2c6130 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.533+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/1123807602 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8570 0x560b5c2b8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.533+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/1123807602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2b8e90 0x560b5c2c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.533+0000 7fd6c7252b80 1 -- 172.21.15.2:0/1123807602 >> 172.21.15.2:0/1123807602 conn(0x560b5c1dd170 msgr2=0x560b5c2ac190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:49.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.533+0000 7fd6c7252b80 1 -- 172.21.15.2:0/1123807602 shutdown_connections 2024-06-13T11:24:49.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.534+0000 7fd6c7252b80 1 -- 172.21.15.2:0/1123807602 wait complete. 2024-06-13T11:24:49.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.534+0000 7fd6c7252b80 1 -- start start 2024-06-13T11:24:49.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.535+0000 7fd6c7252b80 1 Processor -- start 2024-06-13T11:24:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.535+0000 7fd6c7252b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2b8570 0x560b5c2c3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.535+0000 7fd6c7252b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8e90 0x560b5c2c0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.535+0000 7fd6c7252b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2c3d40 0x560b5c2c0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.535+0000 7fd6c7252b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560b5c19ef60 con 0x560b5c2b8e90 2024-06-13T11:24:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.535+0000 7fd6c7252b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560b5c1feac0 con 0x560b5c2b8570 2024-06-13T11:24:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.535+0000 7fd6c7252b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560b5c1bfa10 con 0x560b5c2c3d40 2024-06-13T11:24:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.535+0000 7fd6c7252b80 10 client.0 _ll_register_callbacks cb 0x560b5c198380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:24:49.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.536+0000 7fd6b9e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2b8570 0x560b5c2c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.536+0000 7fd6b9e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2b8570 0x560b5c2c3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:44406/0 (socket says 172.21.15.2:44406) 2024-06-13T11:24:49.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.536+0000 7fd6b9e00700 1 -- 172.21.15.2:0/3518403807 learned_addr learned my addr 172.21.15.2:0/3518403807 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:49.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.536+0000 7fd6ba800700 1 --2- 172.21.15.2:0/3518403807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2c3d40 0x560b5c2c0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.536+0000 7fd6b9400700 1 --2- 172.21.15.2:0/3518403807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8e90 0x560b5c2c0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.537+0000 7fd6b9e00700 1 -- 172.21.15.2:0/3518403807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2c3d40 msgr2=0x560b5c2c0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:49.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.537+0000 7fd6b9e00700 1 --2- 172.21.15.2:0/3518403807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2c3d40 0x560b5c2c0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.537+0000 7fd6b9e00700 1 -- 172.21.15.2:0/3518403807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8e90 msgr2=0x560b5c2c0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:49.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.537+0000 7fd6b9e00700 1 --2- 172.21.15.2:0/3518403807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8e90 0x560b5c2c0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.537+0000 7fd6b9e00700 1 -- 172.21.15.2:0/3518403807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b5c1518d0 con 0x560b5c2b8570 2024-06-13T11:24:49.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.537+0000 7fd6b9400700 1 --2- 172.21.15.2:0/3518403807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8e90 0x560b5c2c0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:24:49.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.538+0000 7fd6b9e00700 1 --2- 172.21.15.2:0/3518403807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2b8570 0x560b5c2c3530 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8013790 tx=0x7fd6a8009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a437d07c07d46d7b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:49.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.538+0000 7fd697e00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:24:49.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.538+0000 7fd697e00700 1 -- 172.21.15.2:0/3518403807 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8011970 con 0x560b5c2b8570 2024-06-13T11:24:49.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.538+0000 7fd697e00700 1 -- 172.21.15.2:0/3518403807 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fd6a8011b10 con 0x560b5c2b8570 2024-06-13T11:24:49.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.538+0000 7fd6c7252b80 1 -- 172.21.15.2:0/3518403807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6b00a0510 con 0x560b5c2b8570 2024-06-13T11:24:49.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.539+0000 7fd697e00700 1 -- 172.21.15.2:0/3518403807 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd6a8011d10 con 0x560b5c2b8570 2024-06-13T11:24:49.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.539+0000 7fd6c7252b80 10 client.25349 fetch_fsmap learned FSMap version 27 2024-06-13T11:24:49.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.539+0000 7fd6c7252b80 1 -- 172.21.15.2:0/3518403807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560b5c2d0d00 con 0x560b5c2b8570 2024-06-13T11:24:49.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.539+0000 7fd697e00700 1 -- 172.21.15.2:0/3518403807 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6b00a0510 con 0x560b5c2b8570 2024-06-13T11:24:49.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.540+0000 7fd697e00700 1 -- 172.21.15.2:0/3518403807 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd6a800f4c0 con 0x560b5c2b8570 2024-06-13T11:24:49.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.540+0000 7fd6c7252b80 10 client.25349 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:24:49.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.540+0000 7fd6c7252b80 10 client.25349 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:24:49.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.540+0000 7fd6c7252b80 20 client.25349 populate_metadata read hostname 'smithi002' 2024-06-13T11:24:49.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.540+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/3518403807 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x560b5c2d3390 0x560b5c2d57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.540+0000 7fd6c7252b80 4 client.25349 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:24:49.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.540+0000 7fd6c7252b80 1 -- 172.21.15.2:0/3518403807 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b5c210000 con 0x560b5c2d3390 2024-06-13T11:24:49.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.540+0000 7fd6b9400700 1 --2- 172.21.15.2:0/3518403807 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x560b5c2d3390 0x560b5c2d57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.541+0000 7fd6b9400700 1 --2- 172.21.15.2:0/3518403807 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x560b5c2d3390 0x560b5c2d57e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c34a6ab0881e8154 server_cookie=ea9a34ebb9ab915a in_seq=0 out_seq=0 2024-06-13T11:24:49.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.541+0000 7fd697e00700 10 client.25349 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:24:49.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.542+0000 7fd697e00700 1 -- 172.21.15.2:0/3518403807 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560b5c210000 con 0x560b5c2d3390 2024-06-13T11:24:49.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.542+0000 7fd697e00700 10 client.25349 handle_command_reply: tid=0 2024-06-13T11:24:49.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.542+0000 7fd6c7252b80 1 client.25349 shutdown 2024-06-13T11:24:49.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.543+0000 7fd6c7252b80 1 -- 172.21.15.2:0/3518403807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2b8570 msgr2=0x560b5c2c3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:49.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.543+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/3518403807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2b8570 0x560b5c2c3530 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8013790 tx=0x7fd6a8009f90 comp rx=0 tx=0).stop 2024-06-13T11:24:49.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.543+0000 7fd6c7252b80 1 -- 172.21.15.2:0/3518403807 shutdown_connections 2024-06-13T11:24:49.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.543+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/3518403807 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x560b5c2d3390 0x560b5c2d57e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.543+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/3518403807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2c3d40 0x560b5c2c0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.543+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/3518403807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2b8570 0x560b5c2c3530 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.543+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/3518403807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8e90 0x560b5c2c0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.543+0000 7fd6c7252b80 1 -- 172.21.15.2:0/3518403807 >> 172.21.15.2:0/3518403807 conn(0x560b5c1dd170 msgr2=0x560b5c2abd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:49.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.543+0000 7fd697e00700 0 client.25349 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:24:49.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.544+0000 7fd6c7252b80 1 -- 172.21.15.2:0/3518403807 shutdown_connections 2024-06-13T11:24:49.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.544+0000 7fd6c7252b80 1 -- 172.21.15.2:0/3518403807 wait complete. 2024-06-13T11:24:49.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.544+0000 7fd6c7252b80 20 client.25349 trim_cache size 0 max 16384 2024-06-13T11:24:49.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.575+0000 7fd6c7252b80 1 Processor -- start 2024-06-13T11:24:49.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.575+0000 7fd6c7252b80 1 -- start start 2024-06-13T11:24:49.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.576+0000 7fd6c7252b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8570 0x560b5c2bf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.576+0000 7fd6c7252b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8e90 0x560b5c2c3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.576+0000 7fd6c7252b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2c3d40 0x560b5c2db0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.576+0000 7fd6c7252b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b41ae910 con 0x560b5c2b8570 2024-06-13T11:24:49.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.576+0000 7fd6c7252b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b41ac1a0 con 0x560b5c2c3d40 2024-06-13T11:24:49.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.576+0000 7fd6c7252b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b41a9ff0 con 0x560b5c2b8e90 2024-06-13T11:24:49.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.576+0000 7fd6b9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8570 0x560b5c2bf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.576+0000 7fd6b9400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8e90 0x560b5c2c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.576+0000 7fd6b9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8570 0x560b5c2bf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45124/0 (socket says 172.21.15.2:45124) 2024-06-13T11:24:49.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.576+0000 7fd6b9e00700 1 -- 172.21.15.2:0/3536407506 learned_addr learned my addr 172.21.15.2:0/3536407506 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:49.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.576+0000 7fd6ba800700 1 --2- 172.21.15.2:0/3536407506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2c3d40 0x560b5c2db0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.577+0000 7fd6b9400700 1 -- 172.21.15.2:0/3536407506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2c3d40 msgr2=0x560b5c2db0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:49.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.577+0000 7fd6b9400700 1 --2- 172.21.15.2:0/3536407506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2c3d40 0x560b5c2db0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.577+0000 7fd6b9400700 1 -- 172.21.15.2:0/3536407506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8570 msgr2=0x560b5c2bf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:49.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.577+0000 7fd6b9400700 1 --2- 172.21.15.2:0/3536407506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8570 0x560b5c2bf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.577+0000 7fd6b9400700 1 -- 172.21.15.2:0/3536407506 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b5c2b8cc0 con 0x560b5c2b8e90 2024-06-13T11:24:49.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.577+0000 7fd6b9400700 1 --2- 172.21.15.2:0/3536407506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8e90 0x560b5c2c3070 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x560b5c2a8a00 tx=0x7fd6a401d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f605a9658355b655 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:49.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.577+0000 7fd6a2a00700 1 -- 172.21.15.2:0/3536407506 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4004220 con 0x560b5c2b8e90 2024-06-13T11:24:49.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.577+0000 7fd6a2a00700 1 -- 172.21.15.2:0/3536407506 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6a4021530 con 0x560b5c2b8e90 2024-06-13T11:24:49.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.578+0000 7fd6a2a00700 1 -- 172.21.15.2:0/3536407506 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4020c10 con 0x560b5c2b8e90 2024-06-13T11:24:49.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.578+0000 7fd6c7252b80 1 -- 172.21.15.2:0/3536407506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8e90 msgr2=0x560b5c2c3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:49.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.578+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/3536407506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8e90 0x560b5c2c3070 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x560b5c2a8a00 tx=0x7fd6a401d000 comp rx=0 tx=0).stop 2024-06-13T11:24:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.578+0000 7fd6c7252b80 1 -- 172.21.15.2:0/3536407506 shutdown_connections 2024-06-13T11:24:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.578+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/3536407506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8570 0x560b5c2bf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.578+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/3536407506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2c3d40 0x560b5c2db0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.578+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/3536407506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8e90 0x560b5c2c3070 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.578+0000 7fd6c7252b80 1 -- 172.21.15.2:0/3536407506 >> 172.21.15.2:0/3536407506 conn(0x560b5c1dd170 msgr2=0x560b5c2c0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.579+0000 7fd6c7252b80 1 -- 172.21.15.2:0/3536407506 shutdown_connections 2024-06-13T11:24:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.579+0000 7fd6c7252b80 1 -- 172.21.15.2:0/3536407506 wait complete. 2024-06-13T11:24:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.579+0000 7fd6c7252b80 1 -- start start 2024-06-13T11:24:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.579+0000 7fd6c7252b80 1 Processor -- start 2024-06-13T11:24:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.580+0000 7fd6c7252b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8570 0x560b5c2c8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.580+0000 7fd6c7252b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8e90 0x560b5c2c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.580+0000 7fd6c7252b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2c3d40 0x560b5c33c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.580+0000 7fd6c7252b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b41aa660 con 0x560b5c2b8570 2024-06-13T11:24:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.580+0000 7fd6c7252b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b41abad0 con 0x560b5c2c3d40 2024-06-13T11:24:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.580+0000 7fd6c7252b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b41aad30 con 0x560b5c2b8e90 2024-06-13T11:24:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.581+0000 7fd6c7252b80 10 client.0 _ll_register_callbacks cb 0x560b5c198380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:24:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.581+0000 7fd6b9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8570 0x560b5c2c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.581+0000 7fd6b9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8570 0x560b5c2c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45134/0 (socket says 172.21.15.2:45134) 2024-06-13T11:24:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.581+0000 7fd6b9e00700 1 -- 172.21.15.2:0/2885725585 learned_addr learned my addr 172.21.15.2:0/2885725585 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.581+0000 7fd6ba800700 1 --2- 172.21.15.2:0/2885725585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2c3d40 0x560b5c33c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.581+0000 7fd6b9400700 1 --2- 172.21.15.2:0/2885725585 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8e90 0x560b5c2c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.581+0000 7fd6b9e00700 1 -- 172.21.15.2:0/2885725585 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8e90 msgr2=0x560b5c2c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.582+0000 7fd6b9e00700 1 --2- 172.21.15.2:0/2885725585 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8e90 0x560b5c2c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.582+0000 7fd6b9e00700 1 -- 172.21.15.2:0/2885725585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2c3d40 msgr2=0x560b5c33c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.582+0000 7fd6b9e00700 1 --2- 172.21.15.2:0/2885725585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2c3d40 0x560b5c33c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.582+0000 7fd6b9e00700 1 -- 172.21.15.2:0/2885725585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b5c33c5c0 con 0x560b5c2b8570 2024-06-13T11:24:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.582+0000 7fd6ba800700 1 --2- 172.21.15.2:0/2885725585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2c3d40 0x560b5c33c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:24:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.582+0000 7fd6b9e00700 1 --2- 172.21.15.2:0/2885725585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8570 0x560b5c2c8930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8009e20 tx=0x7fd6a800fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1ce4e8d57dc2ca server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:49.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.582+0000 7fd697e00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:24:49.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.582+0000 7fd697e00700 1 -- 172.21.15.2:0/2885725585 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8034060 con 0x560b5c2b8570 2024-06-13T11:24:49.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.583+0000 7fd697e00700 1 -- 172.21.15.2:0/2885725585 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fd6a8011980 con 0x560b5c2b8570 2024-06-13T11:24:49.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.583+0000 7fd6c7252b80 1 -- 172.21.15.2:0/2885725585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6a4021530 con 0x560b5c2b8570 2024-06-13T11:24:49.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.583+0000 7fd697e00700 1 -- 172.21.15.2:0/2885725585 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd6a80095c0 con 0x560b5c2b8570 2024-06-13T11:24:49.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.583+0000 7fd6c7252b80 10 client.15249 fetch_fsmap learned FSMap version 27 2024-06-13T11:24:49.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.583+0000 7fd6c7252b80 1 -- 172.21.15.2:0/2885725585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560b5c33d700 con 0x560b5c2b8570 2024-06-13T11:24:49.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.584+0000 7fd697e00700 1 -- 172.21.15.2:0/2885725585 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6a4021530 con 0x560b5c2b8570 2024-06-13T11:24:49.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.584+0000 7fd697e00700 1 -- 172.21.15.2:0/2885725585 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd6a8003a70 con 0x560b5c2b8570 2024-06-13T11:24:49.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.584+0000 7fd6c7252b80 10 client.15249 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:24:49.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.584+0000 7fd6c7252b80 10 client.15249 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:24:49.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.584+0000 7fd6c7252b80 20 client.15249 populate_metadata read hostname 'smithi002' 2024-06-13T11:24:49.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.585+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/2885725585 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x560b5c33ddb0 0x560b5c3401d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:49.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.585+0000 7fd6c7252b80 4 client.15249 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:24:49.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.585+0000 7fd6c7252b80 1 -- 172.21.15.2:0/2885725585 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560b5c20a580 con 0x560b5c33ddb0 2024-06-13T11:24:49.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.585+0000 7fd6b9400700 1 --2- 172.21.15.2:0/2885725585 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x560b5c33ddb0 0x560b5c3401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.586+0000 7fd6b9400700 1 --2- 172.21.15.2:0/2885725585 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x560b5c33ddb0 0x560b5c3401d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4e02c712f8ad9b1c server_cookie=c14534dbc810f0af in_seq=0 out_seq=0 2024-06-13T11:24:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.586+0000 7fd697e00700 10 client.15249 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:24:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.586+0000 7fd697e00700 1 -- 172.21.15.2:0/2885725585 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560b5c20a580 con 0x560b5c33ddb0 2024-06-13T11:24:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.586+0000 7fd697e00700 10 client.15249 handle_command_reply: tid=0 2024-06-13T11:24:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.586+0000 7fd6c7252b80 1 client.15249 shutdown 2024-06-13T11:24:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.586+0000 7fd6c7252b80 1 -- 172.21.15.2:0/2885725585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8570 msgr2=0x560b5c2c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.586+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/2885725585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8570 0x560b5c2c8930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8009e20 tx=0x7fd6a800fea0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.587+0000 7fd6c7252b80 1 -- 172.21.15.2:0/2885725585 shutdown_connections 2024-06-13T11:24:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.587+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/2885725585 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x560b5c33ddb0 0x560b5c3401d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.587+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/2885725585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560b5c2b8570 0x560b5c2c8930 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.587+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/2885725585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560b5c2c3d40 0x560b5c33c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.587+0000 7fd697e00700 0 client.15249 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:24:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.587+0000 7fd6c7252b80 1 --2- 172.21.15.2:0/2885725585 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560b5c2b8e90 0x560b5c2c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.587+0000 7fd6c7252b80 1 -- 172.21.15.2:0/2885725585 >> 172.21.15.2:0/2885725585 conn(0x560b5c1dd170 msgr2=0x560b5c2ab3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.588+0000 7fd6c7252b80 1 -- 172.21.15.2:0/2885725585 shutdown_connections 2024-06-13T11:24:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.588+0000 7fd6c7252b80 1 -- 172.21.15.2:0/2885725585 wait complete. 2024-06-13T11:24:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.588+0000 7fd6c7252b80 20 client.15249 trim_cache size 0 max 16384 2024-06-13T11:24:49.588 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:24:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.590+0000 7fd6bb200700 1 -- 172.21.15.2:0/419621884 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd69c0a2e20 msgr2=0x7fd69c0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.590+0000 7fd6bb200700 1 --2- 172.21.15.2:0/419621884 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd69c0a2e20 0x7fd69c0a52e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40fe120 tx=0x7fd6a4013790 comp rx=0 tx=0).stop 2024-06-13T11:24:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.590+0000 7fd6bb200700 1 -- 172.21.15.2:0/419621884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6b4108ac0 msgr2=0x7fd6b4101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.590+0000 7fd6bb200700 1 --2- 172.21.15.2:0/419621884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6b4108ac0 0x7fd6b4101c80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000d010 tx=0x7fd6b0007a50 comp rx=0 tx=0).stop 2024-06-13T11:24:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.590+0000 7fd6bb200700 1 -- 172.21.15.2:0/419621884 shutdown_connections 2024-06-13T11:24:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.590+0000 7fd6bb200700 1 --2- 172.21.15.2:0/419621884 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd69c0a2e20 0x7fd69c0a52e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.590+0000 7fd6bb200700 1 --2- 172.21.15.2:0/419621884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6b41035a0 0x7fd6b4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.590+0000 7fd6bb200700 1 --2- 172.21.15.2:0/419621884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6b4108ac0 0x7fd6b4101c80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.590+0000 7fd6bb200700 1 --2- 172.21.15.2:0/419621884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6b4103f50 0x7fd6b4101740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:49.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.590+0000 7fd6bb200700 1 -- 172.21.15.2:0/419621884 >> 172.21.15.2:0/419621884 conn(0x7fd6b40fcd70 msgr2=0x7fd6b40fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:49.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.590+0000 7fd6bb200700 1 -- 172.21.15.2:0/419621884 shutdown_connections 2024-06-13T11:24:49.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:49.590+0000 7fd6bb200700 1 -- 172.21.15.2:0/419621884 wait complete. 2024-06-13T11:24:49.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:49 smithi178 ceph-mon[36913]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-13T11:24:49.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:49 smithi077 ceph-mon[36410]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-13T11:24:50.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-13T11:24:50.870 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:24:51.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:51 smithi002 ceph-mon[32210]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-06-13T11:24:51.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:51 smithi178 ceph-mon[36913]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-06-13T11:24:51.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:51 smithi077 ceph-mon[36410]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-06-13T11:24:53.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.239+0000 7f70b5600700 1 -- 172.21.15.2:0/2455103993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70b010ec60 msgr2=0x7f70b0111070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:53.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.239+0000 7f70b5600700 1 --2- 172.21.15.2:0/2455103993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70b010ec60 0x7f70b0111070 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009f90 tx=0x7f70a800b330 comp rx=0 tx=0).stop 2024-06-13T11:24:53.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.239+0000 7f70b5600700 1 -- 172.21.15.2:0/2455103993 shutdown_connections 2024-06-13T11:24:53.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.239+0000 7f70b5600700 1 --2- 172.21.15.2:0/2455103993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70b010ec60 0x7f70b0111070 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.239+0000 7f70b5600700 1 --2- 172.21.15.2:0/2455103993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70b0074860 0x7f70b0074c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.239+0000 7f70b5600700 1 --2- 172.21.15.2:0/2455103993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b0075180 0x7f70b010e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.239+0000 7f70b5600700 1 -- 172.21.15.2:0/2455103993 >> 172.21.15.2:0/2455103993 conn(0x7f70b00fdf10 msgr2=0x7f70b0100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:53.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.239+0000 7f70b5600700 1 -- 172.21.15.2:0/2455103993 shutdown_connections 2024-06-13T11:24:53.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.239+0000 7f70b5600700 1 -- 172.21.15.2:0/2455103993 wait complete. 2024-06-13T11:24:53.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.241+0000 7f70b5600700 1 Processor -- start 2024-06-13T11:24:53.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.241+0000 7f70b5600700 1 -- start start 2024-06-13T11:24:53.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.241+0000 7f70b5600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70b0074860 0x7f70b019ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.241+0000 7f70b5600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b0075180 0x7f70b019b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.242+0000 7f70b5600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70b010ec60 0x7f70b019f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.242+0000 7f70b5600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70b0114940 con 0x7f70b0074860 2024-06-13T11:24:53.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.242+0000 7f70b5600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01147c0 con 0x7f70b0075180 2024-06-13T11:24:53.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.242+0000 7f70b5600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f70b0114ac0 con 0x7f70b010ec60 2024-06-13T11:24:53.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.242+0000 7f70af400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b0075180 0x7f70b019b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:53.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.242+0000 7f70af400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b0075180 0x7f70b019b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:44446/0 (socket says 172.21.15.2:44446) 2024-06-13T11:24:53.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.242+0000 7f70af400700 1 -- 172.21.15.2:0/3961379693 learned_addr learned my addr 172.21.15.2:0/3961379693 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:53.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.242+0000 7f70b4c00700 1 --2- 172.21.15.2:0/3961379693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70b010ec60 0x7f70b019f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:53.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.243+0000 7f70afe00700 1 --2- 172.21.15.2:0/3961379693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70b0074860 0x7f70b019ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:53.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.243+0000 7f70b4c00700 1 -- 172.21.15.2:0/3961379693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b0075180 msgr2=0x7f70b019b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:53.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.243+0000 7f70b4c00700 1 --2- 172.21.15.2:0/3961379693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b0075180 0x7f70b019b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.243+0000 7f70b4c00700 1 -- 172.21.15.2:0/3961379693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70b0074860 msgr2=0x7f70b019ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:53.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.243+0000 7f70b4c00700 1 --2- 172.21.15.2:0/3961379693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70b0074860 0x7f70b019ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.243+0000 7f70b4c00700 1 -- 172.21.15.2:0/3961379693 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b019fd80 con 0x7f70b010ec60 2024-06-13T11:24:53.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.243+0000 7f70b4c00700 1 --2- 172.21.15.2:0/3961379693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70b010ec60 0x7f70b019f640 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f70b006ada0 tx=0x7f70a800cfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:53.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.244+0000 7f70acc00700 1 -- 172.21.15.2:0/3961379693 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8021070 con 0x7f70b010ec60 2024-06-13T11:24:53.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.244+0000 7f70acc00700 1 -- 172.21.15.2:0/3961379693 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70a8007ac0 con 0x7f70b010ec60 2024-06-13T11:24:53.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.244+0000 7f70b5600700 1 -- 172.21.15.2:0/3961379693 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b01a0010 con 0x7f70b010ec60 2024-06-13T11:24:53.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.244+0000 7f70acc00700 1 -- 172.21.15.2:0/3961379693 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a80052a0 con 0x7f70b010ec60 2024-06-13T11:24:53.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.244+0000 7f70b5600700 1 -- 172.21.15.2:0/3961379693 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b01a78f0 con 0x7f70b010ec60 2024-06-13T11:24:53.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.249+0000 7f70acc00700 1 -- 172.21.15.2:0/3961379693 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7f70a8024070 con 0x7f70b010ec60 2024-06-13T11:24:53.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.251+0000 7f70c1617b80 1 Processor -- start 2024-06-13T11:24:53.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.251+0000 7f70c1617b80 1 -- start start 2024-06-13T11:24:53.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.251+0000 7f70c1617b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41577d60 0x559b41578140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.251+0000 7f70c1617b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41578680 0x559b41582ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.251+0000 7f70c1617b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41583530 0x559b41585920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.251+0000 7f70c1617b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559b41487a10 con 0x559b41577d60 2024-06-13T11:24:53.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.251+0000 7f70c1617b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559b414cab00 con 0x559b41583530 2024-06-13T11:24:53.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.251+0000 7f70c1617b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559b414858f0 con 0x559b41578680 2024-06-13T11:24:53.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.252+0000 7f70acc00700 1 --2- 172.21.15.2:0/3961379693 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f70940a2ea0 0x7f70940a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.252+0000 7f70af400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41577d60 0x559b41578140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:53.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.252+0000 7f70b4c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41583530 0x559b41585920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:53.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.252+0000 7f70b4c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41583530 0x559b41585920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:44460/0 (socket says 172.21.15.2:44460) 2024-06-13T11:24:53.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.252+0000 7f70b4c00700 1 -- 172.21.15.2:0/1189272244 learned_addr learned my addr 172.21.15.2:0/1189272244 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:53.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.253+0000 7f70afe00700 1 --2- 172.21.15.2:0/3961379693 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f70940a2ea0 0x7f70940a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:53.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.253+0000 7f70b4c00700 1 -- 172.21.15.2:0/1189272244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41578680 msgr2=0x559b41582ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:53.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.253+0000 7f70b4c00700 1 --2- 172.21.15.2:0/1189272244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41578680 0x559b41582ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.253+0000 7f70b4c00700 1 -- 172.21.15.2:0/1189272244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41577d60 msgr2=0x559b41578140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:53.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.253+0000 7f70acc00700 1 -- 172.21.15.2:0/3961379693 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f70a800f020 con 0x7f70b010ec60 2024-06-13T11:24:53.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.253+0000 7f70b4c00700 1 --2- 172.21.15.2:0/1189272244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41577d60 0x559b41578140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.253+0000 7f70b4c00700 1 -- 172.21.15.2:0/1189272244 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b41472f90 con 0x559b41583530 2024-06-13T11:24:53.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.254+0000 7f70af400700 1 --2- 172.21.15.2:0/1189272244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41577d60 0x559b41578140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:24:53.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.254+0000 7f70b4c00700 1 --2- 172.21.15.2:0/1189272244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41583530 0x559b41585920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f70a8004fd0 tx=0x7f70a801dbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91553a901f9cfe3e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:53.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.254+0000 7f70a5600700 1 -- 172.21.15.2:0/1189272244 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a80b2040 con 0x559b41583530 2024-06-13T11:24:53.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.254+0000 7f70a5600700 1 -- 172.21.15.2:0/1189272244 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70a809d3e0 con 0x559b41583530 2024-06-13T11:24:53.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.254+0000 7f70a5600700 1 -- 172.21.15.2:0/1189272244 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a80a58c0 con 0x559b41583530 2024-06-13T11:24:53.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.255+0000 7f70c1617b80 1 -- 172.21.15.2:0/1189272244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41583530 msgr2=0x559b41585920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:53.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.255+0000 7f70afe00700 1 --2- 172.21.15.2:0/3961379693 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f70940a2ea0 0x7f70940a5360 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009bf0 tx=0x7f70a0009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:53.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.255+0000 7f70c1617b80 1 --2- 172.21.15.2:0/1189272244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41583530 0x559b41585920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f70a8004fd0 tx=0x7f70a801dbf0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.255+0000 7f70c1617b80 1 -- 172.21.15.2:0/1189272244 shutdown_connections 2024-06-13T11:24:53.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.255+0000 7f70c1617b80 1 --2- 172.21.15.2:0/1189272244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41577d60 0x559b41578140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.255+0000 7f70c1617b80 1 --2- 172.21.15.2:0/1189272244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41583530 0x559b41585920 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.255+0000 7f70c1617b80 1 --2- 172.21.15.2:0/1189272244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41578680 0x559b41582ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.255+0000 7f70c1617b80 1 -- 172.21.15.2:0/1189272244 >> 172.21.15.2:0/1189272244 conn(0x559b414a5170 msgr2=0x559b41574280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:53.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.256+0000 7f70c1617b80 1 -- 172.21.15.2:0/1189272244 shutdown_connections 2024-06-13T11:24:53.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.256+0000 7f70c1617b80 1 -- 172.21.15.2:0/1189272244 wait complete. 2024-06-13T11:24:53.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.257+0000 7f70c1617b80 1 -- start start 2024-06-13T11:24:53.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.257+0000 7f70c1617b80 1 Processor -- start 2024-06-13T11:24:53.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.258+0000 7f70c1617b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41577d60 0x559b41582de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.258+0000 7f70c1617b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41578680 0x559b415800e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.258+0000 7f70c1617b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41583530 0x559b41580620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.258+0000 7f70c1617b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559b41466f60 con 0x559b41578680 2024-06-13T11:24:53.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.258+0000 7f70c1617b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559b414c6ac0 con 0x559b41583530 2024-06-13T11:24:53.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.258+0000 7f70c1617b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559b414cab00 con 0x559b41577d60 2024-06-13T11:24:53.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.258+0000 7f70c1617b80 10 client.0 _ll_register_callbacks cb 0x559b41460380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:24:53.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.258+0000 7f70afe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41577d60 0x559b41582de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:53.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.258+0000 7f70afe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41577d60 0x559b41582de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55174/0 (socket says 172.21.15.2:55174) 2024-06-13T11:24:53.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.258+0000 7f70b4c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41583530 0x559b41580620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:53.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.258+0000 7f70afe00700 1 -- 172.21.15.2:0/3899815105 learned_addr learned my addr 172.21.15.2:0/3899815105 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:53.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.259+0000 7f70af400700 1 --2- 172.21.15.2:0/3899815105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41578680 0x559b415800e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:53.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.259+0000 7f70b4c00700 1 -- 172.21.15.2:0/3899815105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41577d60 msgr2=0x559b41582de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:53.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.259+0000 7f70b4c00700 1 --2- 172.21.15.2:0/3899815105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41577d60 0x559b41582de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.259+0000 7f70b4c00700 1 -- 172.21.15.2:0/3899815105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41578680 msgr2=0x559b415800e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:53.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.259+0000 7f70b4c00700 1 --2- 172.21.15.2:0/3899815105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41578680 0x559b415800e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.259+0000 7f70b4c00700 1 -- 172.21.15.2:0/3899815105 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b414198d0 con 0x559b41583530 2024-06-13T11:24:53.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.259+0000 7f70b4c00700 1 --2- 172.21.15.2:0/3899815105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41583530 0x559b41580620 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f70a809cea0 tx=0x7f70a809cd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffbecb6b8f42e9b0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:53.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.259+0000 7f709a000700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:24:53.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.260+0000 7f709a000700 1 -- 172.21.15.2:0/3899815105 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a80b2070 con 0x559b41583530 2024-06-13T11:24:53.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.260+0000 7f709a000700 1 -- 172.21.15.2:0/3899815105 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f70a80a3290 con 0x559b41583530 2024-06-13T11:24:53.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.260+0000 7f70c1617b80 1 -- 172.21.15.2:0/3899815105 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70a809d3e0 con 0x559b41583530 2024-06-13T11:24:53.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.260+0000 7f709a000700 1 -- 172.21.15.2:0/3899815105 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f70a8011e50 con 0x559b41583530 2024-06-13T11:24:53.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.260+0000 7f70c1617b80 10 client.25367 fetch_fsmap learned FSMap version 27 2024-06-13T11:24:53.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.260+0000 7f70c1617b80 1 -- 172.21.15.2:0/3899815105 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559b41590420 con 0x559b41583530 2024-06-13T11:24:53.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.261+0000 7f709a000700 1 -- 172.21.15.2:0/3899815105 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70a80b5e50 con 0x559b41583530 2024-06-13T11:24:53.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.261+0000 7f709a000700 1 -- 172.21.15.2:0/3899815105 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f70a8011070 con 0x559b41583530 2024-06-13T11:24:53.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.261+0000 7f70c1617b80 10 client.25367 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:24:53.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.261+0000 7f70c1617b80 10 client.25367 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:24:53.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.261+0000 7f70c1617b80 20 client.25367 populate_metadata read hostname 'smithi002' 2024-06-13T11:24:53.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.261+0000 7f70c1617b80 1 --2- 172.21.15.2:0/3899815105 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x559b415928f0 0x559b41594ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.261+0000 7f70c1617b80 4 client.25367 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:24:53.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.261+0000 7f70c1617b80 1 -- 172.21.15.2:0/3899815105 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b414d8000 con 0x559b415928f0 2024-06-13T11:24:53.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.262+0000 7f70afe00700 1 --2- 172.21.15.2:0/3899815105 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x559b415928f0 0x559b41594ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:53.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.262+0000 7f70afe00700 1 --2- 172.21.15.2:0/3899815105 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x559b415928f0 0x559b41594ce0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5bd6604b3f3fdd20 server_cookie=ff8138e97b7dc837 in_seq=0 out_seq=0 2024-06-13T11:24:53.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.262+0000 7f709a000700 10 client.25367 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:24:53.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.263+0000 7f709a000700 1 -- 172.21.15.2:0/3899815105 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559b414d8000 con 0x559b415928f0 2024-06-13T11:24:53.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.263+0000 7f709a000700 10 client.25367 handle_command_reply: tid=0 2024-06-13T11:24:53.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.263+0000 7f70c1617b80 1 client.25367 shutdown 2024-06-13T11:24:53.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.264+0000 7f70c1617b80 1 -- 172.21.15.2:0/3899815105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41583530 msgr2=0x559b41580620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:53.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.264+0000 7f70c1617b80 1 --2- 172.21.15.2:0/3899815105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41583530 0x559b41580620 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f70a809cea0 tx=0x7f70a809cd60 comp rx=0 tx=0).stop 2024-06-13T11:24:53.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.264+0000 7f70c1617b80 1 -- 172.21.15.2:0/3899815105 shutdown_connections 2024-06-13T11:24:53.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.264+0000 7f70c1617b80 1 --2- 172.21.15.2:0/3899815105 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x559b415928f0 0x559b41594ce0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.264+0000 7f70c1617b80 1 --2- 172.21.15.2:0/3899815105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41583530 0x559b41580620 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.264+0000 7f70c1617b80 1 --2- 172.21.15.2:0/3899815105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41577d60 0x559b41582de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.264+0000 7f70c1617b80 1 --2- 172.21.15.2:0/3899815105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41578680 0x559b415800e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.264+0000 7f70c1617b80 1 -- 172.21.15.2:0/3899815105 >> 172.21.15.2:0/3899815105 conn(0x559b414a5170 msgr2=0x559b41573e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:53.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.264+0000 7f709a000700 0 client.25367 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:24:53.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.264+0000 7f70c1617b80 1 -- 172.21.15.2:0/3899815105 shutdown_connections 2024-06-13T11:24:53.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.264+0000 7f70c1617b80 1 -- 172.21.15.2:0/3899815105 wait complete. 2024-06-13T11:24:53.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.264+0000 7f70c1617b80 20 client.25367 trim_cache size 0 max 16384 2024-06-13T11:24:53.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.280+0000 7f70c1617b80 1 Processor -- start 2024-06-13T11:24:53.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.280+0000 7f70c1617b80 1 -- start start 2024-06-13T11:24:53.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.281+0000 7f70c1617b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41577d60 0x559b4157f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.281+0000 7f70c1617b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41578680 0x559b415800a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.281+0000 7f70c1617b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41583530 0x559b415805e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.281+0000 7f70c1617b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01b2da0 con 0x559b41583530 2024-06-13T11:24:53.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.281+0000 7f70c1617b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01b0630 con 0x559b41577d60 2024-06-13T11:24:53.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.281+0000 7f70c1617b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01ae480 con 0x559b41578680 2024-06-13T11:24:53.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.282+0000 7f70af400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41578680 0x559b415800a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:53.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.282+0000 7f70af400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41578680 0x559b415800a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55182/0 (socket says 172.21.15.2:55182) 2024-06-13T11:24:53.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.282+0000 7f70af400700 1 -- 172.21.15.2:0/721786063 learned_addr learned my addr 172.21.15.2:0/721786063 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:53.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.282+0000 7f70afe00700 1 --2- 172.21.15.2:0/721786063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41577d60 0x559b4157f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:53.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.282+0000 7f70b4c00700 1 --2- 172.21.15.2:0/721786063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41583530 0x559b415805e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:53.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.282+0000 7f70af400700 1 -- 172.21.15.2:0/721786063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41577d60 msgr2=0x559b4157f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:53.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.282+0000 7f70af400700 1 --2- 172.21.15.2:0/721786063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41577d60 0x559b4157f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.282+0000 7f70af400700 1 -- 172.21.15.2:0/721786063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41583530 msgr2=0x559b415805e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:53.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.282+0000 7f70af400700 1 --2- 172.21.15.2:0/721786063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41583530 0x559b415805e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.282+0000 7f70af400700 1 -- 172.21.15.2:0/721786063 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b41573a20 con 0x559b41578680 2024-06-13T11:24:53.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.282+0000 7f70b4c00700 1 --2- 172.21.15.2:0/721786063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41583530 0x559b415805e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:24:53.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.283+0000 7f70af400700 1 --2- 172.21.15.2:0/721786063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41578680 0x559b415800a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f709c009cb0 tx=0x7f709c010430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbcd1ed3c01539b4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:53.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.283+0000 7f70a4c00700 1 -- 172.21.15.2:0/721786063 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c020070 con 0x559b41578680 2024-06-13T11:24:53.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.283+0000 7f70a4c00700 1 -- 172.21.15.2:0/721786063 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f709c010cf0 con 0x559b41578680 2024-06-13T11:24:53.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.283+0000 7f70a4c00700 1 -- 172.21.15.2:0/721786063 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c01b400 con 0x559b41578680 2024-06-13T11:24:53.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.284+0000 7f70c1617b80 1 -- 172.21.15.2:0/721786063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41578680 msgr2=0x559b415800a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:53.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.284+0000 7f70c1617b80 1 --2- 172.21.15.2:0/721786063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41578680 0x559b415800a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f709c009cb0 tx=0x7f709c010430 comp rx=0 tx=0).stop 2024-06-13T11:24:53.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.285+0000 7f70c1617b80 1 -- 172.21.15.2:0/721786063 shutdown_connections 2024-06-13T11:24:53.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.285+0000 7f70c1617b80 1 --2- 172.21.15.2:0/721786063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41583530 0x559b415805e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.285+0000 7f70c1617b80 1 --2- 172.21.15.2:0/721786063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41577d60 0x559b4157f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.285+0000 7f70c1617b80 1 --2- 172.21.15.2:0/721786063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41578680 0x559b415800a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.285+0000 7f70c1617b80 1 -- 172.21.15.2:0/721786063 >> 172.21.15.2:0/721786063 conn(0x559b414a5170 msgr2=0x559b4157f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:53.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.285+0000 7f70c1617b80 1 -- 172.21.15.2:0/721786063 shutdown_connections 2024-06-13T11:24:53.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.285+0000 7f70c1617b80 1 -- 172.21.15.2:0/721786063 wait complete. 2024-06-13T11:24:53.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.286+0000 7f70c1617b80 1 -- start start 2024-06-13T11:24:53.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.286+0000 7f70c1617b80 1 Processor -- start 2024-06-13T11:24:53.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.286+0000 7f70c1617b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41577d60 0x559b41587f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.287+0000 7f70c1617b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41578680 0x559b41588460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.287+0000 7f70c1617b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41583530 0x559b415889a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.287+0000 7f70c1617b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01aeaf0 con 0x559b41577d60 2024-06-13T11:24:53.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.287+0000 7f70c1617b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01aff60 con 0x559b41578680 2024-06-13T11:24:53.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.287+0000 7f70c1617b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f70b01af1c0 con 0x559b41583530 2024-06-13T11:24:53.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.287+0000 7f70c1617b80 10 client.0 _ll_register_callbacks cb 0x559b41460380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:24:53.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.287+0000 7f70afe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41577d60 0x559b41587f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:53.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.287+0000 7f70afe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41577d60 0x559b41587f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45188/0 (socket says 172.21.15.2:45188) 2024-06-13T11:24:53.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.287+0000 7f70afe00700 1 -- 172.21.15.2:0/1268115964 learned_addr learned my addr 172.21.15.2:0/1268115964 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:53.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.287+0000 7f70b4c00700 1 --2- 172.21.15.2:0/1268115964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41583530 0x559b415889a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:53.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.288+0000 7f70afe00700 1 -- 172.21.15.2:0/1268115964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41583530 msgr2=0x559b415889a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:53.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.288+0000 7f70afe00700 1 --2- 172.21.15.2:0/1268115964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41583530 0x559b415889a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.288+0000 7f70afe00700 1 -- 172.21.15.2:0/1268115964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41578680 msgr2=0x559b41588460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:53.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.288+0000 7f70afe00700 1 --2- 172.21.15.2:0/1268115964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41578680 0x559b41588460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.288+0000 7f70afe00700 1 -- 172.21.15.2:0/1268115964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b41603f50 con 0x559b41577d60 2024-06-13T11:24:53.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.288+0000 7f70afe00700 1 --2- 172.21.15.2:0/1268115964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41577d60 0x559b41587f20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x559b415954b0 tx=0x7f70a0014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55bc725db70087b7 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:53.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.288+0000 7f709a000700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:24:53.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.289+0000 7f709a000700 1 -- 172.21.15.2:0/1268115964 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0012db0 con 0x559b41577d60 2024-06-13T11:24:53.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.289+0000 7f709a000700 1 -- 172.21.15.2:0/1268115964 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f70a0004020 con 0x559b41577d60 2024-06-13T11:24:53.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.289+0000 7f70c1617b80 1 -- 172.21.15.2:0/1268115964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f709c010cf0 con 0x559b41577d60 2024-06-13T11:24:53.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.289+0000 7f709a000700 1 -- 172.21.15.2:0/1268115964 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f70a0037050 con 0x559b41577d60 2024-06-13T11:24:53.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.289+0000 7f70c1617b80 10 client.15264 fetch_fsmap learned FSMap version 27 2024-06-13T11:24:53.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.289+0000 7f70c1617b80 1 -- 172.21.15.2:0/1268115964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559b41605290 con 0x559b41577d60 2024-06-13T11:24:53.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.290+0000 7f709a000700 1 -- 172.21.15.2:0/1268115964 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f709c010cf0 con 0x559b41577d60 2024-06-13T11:24:53.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.290+0000 7f709a000700 1 -- 172.21.15.2:0/1268115964 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f70a00204c0 con 0x559b41577d60 2024-06-13T11:24:53.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.290+0000 7f70c1617b80 10 client.15264 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:24:53.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.290+0000 7f70c1617b80 10 client.15264 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:24:53.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.290+0000 7f70c1617b80 20 client.15264 populate_metadata read hostname 'smithi002' 2024-06-13T11:24:53.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.290+0000 7f70c1617b80 1 --2- 172.21.15.2:0/1268115964 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x559b41605a00 0x559b41607e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:53.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.290+0000 7f70c1617b80 4 client.15264 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:24:53.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.290+0000 7f70c1617b80 1 -- 172.21.15.2:0/1268115964 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559b414d2580 con 0x559b41605a00 2024-06-13T11:24:53.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.291+0000 7f70af400700 1 --2- 172.21.15.2:0/1268115964 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x559b41605a00 0x559b41607e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:53.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.291+0000 7f709a000700 10 client.15264 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:24:53.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.291+0000 7f70af400700 1 --2- 172.21.15.2:0/1268115964 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x559b41605a00 0x559b41607e80 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1d56f2c9f95fec23 server_cookie=4930a6618d354e5b in_seq=0 out_seq=0 2024-06-13T11:24:53.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.292+0000 7f709a000700 1 -- 172.21.15.2:0/1268115964 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559b414d2580 con 0x559b41605a00 2024-06-13T11:24:53.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.292+0000 7f709a000700 10 client.15264 handle_command_reply: tid=0 2024-06-13T11:24:53.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.292+0000 7f70c1617b80 1 client.15264 shutdown 2024-06-13T11:24:53.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.292+0000 7f70c1617b80 1 -- 172.21.15.2:0/1268115964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41577d60 msgr2=0x559b41587f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:53.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.292+0000 7f70c1617b80 1 --2- 172.21.15.2:0/1268115964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41577d60 0x559b41587f20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x559b415954b0 tx=0x7f70a0014070 comp rx=0 tx=0).stop 2024-06-13T11:24:53.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.292+0000 7f70c1617b80 1 -- 172.21.15.2:0/1268115964 shutdown_connections 2024-06-13T11:24:53.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.292+0000 7f70c1617b80 1 --2- 172.21.15.2:0/1268115964 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x559b41605a00 0x559b41607e80 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.292+0000 7f70c1617b80 1 --2- 172.21.15.2:0/1268115964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559b41577d60 0x559b41587f20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.292+0000 7f70c1617b80 1 --2- 172.21.15.2:0/1268115964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559b41583530 0x559b415889a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.292+0000 7f70c1617b80 1 --2- 172.21.15.2:0/1268115964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b41578680 0x559b41588460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.292+0000 7f70c1617b80 1 -- 172.21.15.2:0/1268115964 >> 172.21.15.2:0/1268115964 conn(0x559b414a5170 msgr2=0x559b41581910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:53.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.292+0000 7f709a000700 0 client.15264 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:24:53.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.293+0000 7f70c1617b80 1 -- 172.21.15.2:0/1268115964 shutdown_connections 2024-06-13T11:24:53.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.293+0000 7f70c1617b80 1 -- 172.21.15.2:0/1268115964 wait complete. 2024-06-13T11:24:53.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.294+0000 7f70c1617b80 20 client.15264 trim_cache size 0 max 16384 2024-06-13T11:24:53.294 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:24:53.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.296+0000 7f70b5600700 1 -- 172.21.15.2:0/3961379693 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f70940a2ea0 msgr2=0x7f70940a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:53.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.296+0000 7f70b5600700 1 --2- 172.21.15.2:0/3961379693 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f70940a2ea0 0x7f70940a5360 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009bf0 tx=0x7f70a0009260 comp rx=0 tx=0).stop 2024-06-13T11:24:53.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.297+0000 7f70b5600700 1 -- 172.21.15.2:0/3961379693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70b010ec60 msgr2=0x7f70b019f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:53.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.297+0000 7f70b5600700 1 --2- 172.21.15.2:0/3961379693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70b010ec60 0x7f70b019f640 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f70b006ada0 tx=0x7f70a800cfa0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.298+0000 7f70b5600700 1 -- 172.21.15.2:0/3961379693 shutdown_connections 2024-06-13T11:24:53.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.298+0000 7f70b5600700 1 --2- 172.21.15.2:0/3961379693 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f70940a2ea0 0x7f70940a5360 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.298+0000 7f70b5600700 1 --2- 172.21.15.2:0/3961379693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70b0074860 0x7f70b019ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.298+0000 7f70b5600700 1 --2- 172.21.15.2:0/3961379693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70b010ec60 0x7f70b019f640 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.298+0000 7f70b5600700 1 --2- 172.21.15.2:0/3961379693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b0075180 0x7f70b019b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:53.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.298+0000 7f70b5600700 1 -- 172.21.15.2:0/3961379693 >> 172.21.15.2:0/3961379693 conn(0x7f70b00fdf10 msgr2=0x7f70b00feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:53.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.298+0000 7f70b5600700 1 -- 172.21.15.2:0/3961379693 shutdown_connections 2024-06-13T11:24:53.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:53.298+0000 7f70b5600700 1 -- 172.21.15.2:0/3961379693 wait complete. 2024-06-13T11:24:53.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:53 smithi002 ceph-mon[32210]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-13T11:24:53.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:53 smithi178 ceph-mon[36913]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-13T11:24:53.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:53 smithi077 ceph-mon[36410]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-13T11:24:54.203 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-13T11:24:54.639 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:24:55.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:55 smithi002 ceph-mon[32210]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:55.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:55 smithi178 ceph-mon[36913]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:55.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:55 smithi077 ceph-mon[36410]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:57.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:57 smithi178 ceph-mon[36913]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:57.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:57 smithi077 ceph-mon[36410]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:57.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:57 smithi002 ceph-mon[32210]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:24:59.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.209+0000 7f13b7000700 1 -- 172.21.15.2:0/4143980174 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13b0101c90 msgr2=0x7f13b0106160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:59.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.209+0000 7f13b7000700 1 --2- 172.21.15.2:0/4143980174 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13b0101c90 0x7f13b0106160 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f139c0098f0 tx=0x7f139c009c00 comp rx=0 tx=0).stop 2024-06-13T11:24:59.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.209+0000 7f13b7000700 1 -- 172.21.15.2:0/4143980174 shutdown_connections 2024-06-13T11:24:59.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.209+0000 7f13b7000700 1 --2- 172.21.15.2:0/4143980174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13b0101370 0x7f13b0101750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.209+0000 7f13b7000700 1 --2- 172.21.15.2:0/4143980174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13b0106780 0x7f13b0106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.209+0000 7f13b7000700 1 --2- 172.21.15.2:0/4143980174 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13b0101c90 0x7f13b0106160 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.209+0000 7f13b7000700 1 -- 172.21.15.2:0/4143980174 >> 172.21.15.2:0/4143980174 conn(0x7f13b00fcdb0 msgr2=0x7f13b00ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:59.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.209+0000 7f13b7000700 1 -- 172.21.15.2:0/4143980174 shutdown_connections 2024-06-13T11:24:59.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.209+0000 7f13b7000700 1 -- 172.21.15.2:0/4143980174 wait complete. 2024-06-13T11:24:59.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.211+0000 7f13b7000700 1 Processor -- start 2024-06-13T11:24:59.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.211+0000 7f13b7000700 1 -- start start 2024-06-13T11:24:59.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.211+0000 7f13b7000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13b0101370 0x7f13b019f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.212+0000 7f13b7000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13b0101c90 0x7f13b019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.212+0000 7f13b7000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13b0106780 0x7f13b01a3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.212+0000 7f13b7000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f13b0118d20 con 0x7f13b0101370 2024-06-13T11:24:59.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.212+0000 7f13b7000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f13b0118ba0 con 0x7f13b0101c90 2024-06-13T11:24:59.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.212+0000 7f13b7000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f13b0118ea0 con 0x7f13b0106780 2024-06-13T11:24:59.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.212+0000 7f13b5c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13b0101370 0x7f13b019f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:59.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.212+0000 7f13b6600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13b0106780 0x7f13b01a3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:59.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.212+0000 7f13b5200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13b0101c90 0x7f13b019f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:59.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.212+0000 7f13b6600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13b0106780 0x7f13b01a3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:48010/0 (socket says 172.21.15.2:48010) 2024-06-13T11:24:59.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.212+0000 7f13b6600700 1 -- 172.21.15.2:0/1717070948 learned_addr learned my addr 172.21.15.2:0/1717070948 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.213+0000 7f13b5200700 1 -- 172.21.15.2:0/1717070948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13b0106780 msgr2=0x7f13b01a3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.213+0000 7f13b5200700 1 --2- 172.21.15.2:0/1717070948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13b0106780 0x7f13b01a3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.213+0000 7f13b5200700 1 -- 172.21.15.2:0/1717070948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13b0101370 msgr2=0x7f13b019f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.213+0000 7f13b5200700 1 --2- 172.21.15.2:0/1717070948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13b0101370 0x7f13b019f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.213+0000 7f13b5200700 1 -- 172.21.15.2:0/1717070948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b01a4210 con 0x7f13b0101c90 2024-06-13T11:24:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.213+0000 7f13b5200700 1 --2- 172.21.15.2:0/1717070948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13b0101c90 0x7f13b019f790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f139c000c00 tx=0x7f139c00f950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.214+0000 7f13ae000700 1 -- 172.21.15.2:0/1717070948 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c005040 con 0x7f13b0101c90 2024-06-13T11:24:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.214+0000 7f13ae000700 1 -- 172.21.15.2:0/1717070948 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f139c0056c0 con 0x7f13b0101c90 2024-06-13T11:24:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.214+0000 7f13ae000700 1 -- 172.21.15.2:0/1717070948 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c003a00 con 0x7f13b0101c90 2024-06-13T11:24:59.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.214+0000 7f13b7000700 1 -- 172.21.15.2:0/1717070948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b01a44a0 con 0x7f13b0101c90 2024-06-13T11:24:59.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.214+0000 7f13b7000700 1 -- 172.21.15.2:0/1717070948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b01abd80 con 0x7f13b0101c90 2024-06-13T11:24:59.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.219+0000 7f13ae000700 1 -- 172.21.15.2:0/1717070948 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) ==== 138008+0+0 (secure 0 0 0) 0x7f139c00b880 con 0x7f13b0101c90 2024-06-13T11:24:59.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.221+0000 7f13c2f34b80 1 Processor -- start 2024-06-13T11:24:59.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.221+0000 7f13c2f34b80 1 -- start start 2024-06-13T11:24:59.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.222+0000 7f13c2f34b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b69fe40 0x56302b725420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.222+0000 7f13c2f34b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b725960 0x56302b725de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.222+0000 7f13c2f34b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b72e570 0x56302b730960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.222+0000 7f13c2f34b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56302b632a10 con 0x56302b72e570 2024-06-13T11:24:59.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.222+0000 7f13c2f34b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56302b675b00 con 0x56302b725960 2024-06-13T11:24:59.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.222+0000 7f13c2f34b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56302b6308f0 con 0x56302b69fe40 2024-06-13T11:24:59.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.222+0000 7f13ae000700 1 --2- 172.21.15.2:0/1717070948 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f13980a2ea0 0x7f13980a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.222+0000 7f13b5c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b725960 0x56302b725de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.222+0000 7f13b5c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b725960 0x56302b725de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:55438/0 (socket says 172.21.15.2:55438) 2024-06-13T11:24:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.222+0000 7f13b5c00700 1 -- 172.21.15.2:0/2495686800 learned_addr learned my addr 172.21.15.2:0/2495686800 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.223+0000 7f13b6600700 1 --2- 172.21.15.2:0/2495686800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b69fe40 0x56302b725420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.223+0000 7f13b6600700 1 --2- 172.21.15.2:0/1717070948 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f13980a2ea0 0x7f13980a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.223+0000 7f13ae000700 1 -- 172.21.15.2:0/1717070948 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f139c0d0980 con 0x7f13b0101c90 2024-06-13T11:24:59.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.223+0000 7f13b5200700 1 --2- 172.21.15.2:0/2495686800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b72e570 0x56302b730960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:59.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.224+0000 7f13b6600700 1 --2- 172.21.15.2:0/1717070948 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f13980a2ea0 0x7f13980a5360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009550 tx=0x7f13a800e160 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:59.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.224+0000 7f13b6600700 1 -- 172.21.15.2:0/2495686800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b725960 msgr2=0x56302b725de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:59.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.225+0000 7f13b6600700 1 --2- 172.21.15.2:0/2495686800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b725960 0x56302b725de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.225+0000 7f13b6600700 1 -- 172.21.15.2:0/2495686800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b72e570 msgr2=0x56302b730960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:59.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.225+0000 7f13b6600700 1 --2- 172.21.15.2:0/2495686800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b72e570 0x56302b730960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.225+0000 7f13b6600700 1 -- 172.21.15.2:0/2495686800 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56302b61df90 con 0x56302b69fe40 2024-06-13T11:24:59.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.225+0000 7f13b5c00700 1 --2- 172.21.15.2:0/2495686800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b725960 0x56302b725de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:24:59.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.225+0000 7f13b6600700 1 --2- 172.21.15.2:0/2495686800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b69fe40 0x56302b725420 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009690 tx=0x7f13a801d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c5425297f58c245 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:59.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.226+0000 7f13a2a00700 1 -- 172.21.15.2:0/2495686800 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a801e070 con 0x56302b69fe40 2024-06-13T11:24:59.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.226+0000 7f13a2a00700 1 -- 172.21.15.2:0/2495686800 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13a8022650 con 0x56302b69fe40 2024-06-13T11:24:59.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.226+0000 7f13a2a00700 1 -- 172.21.15.2:0/2495686800 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8004280 con 0x56302b69fe40 2024-06-13T11:24:59.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.227+0000 7f13c2f34b80 1 -- 172.21.15.2:0/2495686800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b69fe40 msgr2=0x56302b725420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:59.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.227+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/2495686800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b69fe40 0x56302b725420 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009690 tx=0x7f13a801d000 comp rx=0 tx=0).stop 2024-06-13T11:24:59.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.227+0000 7f13c2f34b80 1 -- 172.21.15.2:0/2495686800 shutdown_connections 2024-06-13T11:24:59.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.227+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/2495686800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b72e570 0x56302b730960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.227+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/2495686800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b69fe40 0x56302b725420 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.227+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/2495686800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b725960 0x56302b725de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.227+0000 7f13c2f34b80 1 -- 172.21.15.2:0/2495686800 >> 172.21.15.2:0/2495686800 conn(0x56302b650170 msgr2=0x56302b71f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:59.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.228+0000 7f13c2f34b80 1 -- 172.21.15.2:0/2495686800 shutdown_connections 2024-06-13T11:24:59.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.228+0000 7f13c2f34b80 1 -- 172.21.15.2:0/2495686800 wait complete. 2024-06-13T11:24:59.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.228+0000 7f13c2f34b80 1 -- start start 2024-06-13T11:24:59.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.229+0000 7f13c2f34b80 1 Processor -- start 2024-06-13T11:24:59.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.230+0000 7f13c2f34b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 0x56302b72dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.230+0000 7f13c2f34b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b725960 0x56302b72b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.230+0000 7f13c2f34b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b72e570 0x56302b72b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.230+0000 7f13c2f34b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56302b611f60 con 0x56302b725960 2024-06-13T11:24:59.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.230+0000 7f13c2f34b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56302b671ac0 con 0x56302b69fe40 2024-06-13T11:24:59.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.230+0000 7f13c2f34b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56302b731120 con 0x56302b72e570 2024-06-13T11:24:59.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.230+0000 7f13c2f34b80 10 client.0 _ll_register_callbacks cb 0x56302b60f720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:24:59.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.230+0000 7f13b5c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 0x56302b72dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:59.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.230+0000 7f13b5c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 0x56302b72dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:55450/0 (socket says 172.21.15.2:55450) 2024-06-13T11:24:59.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.231+0000 7f13b5c00700 1 -- 172.21.15.2:0/741043961 learned_addr learned my addr 172.21.15.2:0/741043961 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:59.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.231+0000 7f13b6600700 1 --2- 172.21.15.2:0/741043961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b72e570 0x56302b72b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:59.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.231+0000 7f13b5c00700 1 -- 172.21.15.2:0/741043961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b72e570 msgr2=0x56302b72b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:59.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.231+0000 7f13b5c00700 1 --2- 172.21.15.2:0/741043961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b72e570 0x56302b72b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.231+0000 7f13b5c00700 1 -- 172.21.15.2:0/741043961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b725960 msgr2=0x56302b72b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:59.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.231+0000 7f13b5c00700 1 --2- 172.21.15.2:0/741043961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b725960 0x56302b72b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.231+0000 7f13b5c00700 1 -- 172.21.15.2:0/741043961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56302b5c48d0 con 0x56302b69fe40 2024-06-13T11:24:59.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.232+0000 7f13b5c00700 1 --2- 172.21.15.2:0/741043961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 0x56302b72dd30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f13a4012700 tx=0x7f13a4012a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4a9ef7e2eafbc93 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:59.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.232+0000 7f1397400700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:24:59.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.232+0000 7f1397400700 1 -- 172.21.15.2:0/741043961 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a4011710 con 0x56302b69fe40 2024-06-13T11:24:59.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.232+0000 7f1397400700 1 -- 172.21.15.2:0/741043961 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f13a40118b0 con 0x56302b69fe40 2024-06-13T11:24:59.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.233+0000 7f13c2f34b80 1 -- 172.21.15.2:0/741043961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13a8022650 con 0x56302b69fe40 2024-06-13T11:24:59.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.233+0000 7f1397400700 1 -- 172.21.15.2:0/741043961 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f13a4011ab0 con 0x56302b69fe40 2024-06-13T11:24:59.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.233+0000 7f13c2f34b80 10 client.25382 fetch_fsmap learned FSMap version 27 2024-06-13T11:24:59.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.233+0000 7f13c2f34b80 1 -- 172.21.15.2:0/741043961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56302b73b950 con 0x56302b69fe40 2024-06-13T11:24:59.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.234+0000 7f1397400700 1 -- 172.21.15.2:0/741043961 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13a8022650 con 0x56302b69fe40 2024-06-13T11:24:59.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.235+0000 7f1397400700 1 -- 172.21.15.2:0/741043961 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f13a400f460 con 0x56302b69fe40 2024-06-13T11:24:59.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.235+0000 7f13c2f34b80 10 client.25382 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:24:59.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.235+0000 7f13c2f34b80 10 client.25382 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:24:59.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.235+0000 7f13c2f34b80 20 client.25382 populate_metadata read hostname 'smithi002' 2024-06-13T11:24:59.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.235+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/741043961 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x56302b73dee0 0x56302b7402d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.235+0000 7f13c2f34b80 4 client.25382 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:24:59.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.235+0000 7f13c2f34b80 1 -- 172.21.15.2:0/741043961 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56302b683000 con 0x56302b73dee0 2024-06-13T11:24:59.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.236+0000 7f13b5200700 1 --2- 172.21.15.2:0/741043961 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x56302b73dee0 0x56302b7402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:59.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.237+0000 7f13b5200700 1 --2- 172.21.15.2:0/741043961 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x56302b73dee0 0x56302b7402d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9de12d5f5d516998 server_cookie=af327086742c1b47 in_seq=0 out_seq=0 2024-06-13T11:24:59.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.237+0000 7f1397400700 10 client.25382 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:24:59.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.238+0000 7f1397400700 1 -- 172.21.15.2:0/741043961 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56302b683000 con 0x56302b73dee0 2024-06-13T11:24:59.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.238+0000 7f1397400700 10 client.25382 handle_command_reply: tid=0 2024-06-13T11:24:59.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.238+0000 7f13c2f34b80 1 client.25382 shutdown 2024-06-13T11:24:59.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.238+0000 7f13c2f34b80 1 -- 172.21.15.2:0/741043961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 msgr2=0x56302b72dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:59.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.238+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/741043961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 0x56302b72dd30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f13a4012700 tx=0x7f13a4012a10 comp rx=0 tx=0).stop 2024-06-13T11:24:59.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.238+0000 7f13c2f34b80 1 -- 172.21.15.2:0/741043961 shutdown_connections 2024-06-13T11:24:59.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.238+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/741043961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b72e570 0x56302b72b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.238+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/741043961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 0x56302b72dd30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.238+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/741043961 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x56302b73dee0 0x56302b7402d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.238+0000 7f1397400700 0 client.25382 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:24:59.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.238+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/741043961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b725960 0x56302b72b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.238+0000 7f13c2f34b80 1 -- 172.21.15.2:0/741043961 >> 172.21.15.2:0/741043961 conn(0x56302b650170 msgr2=0x56302b71f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:59.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.239+0000 7f13c2f34b80 1 -- 172.21.15.2:0/741043961 shutdown_connections 2024-06-13T11:24:59.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.239+0000 7f13c2f34b80 1 -- 172.21.15.2:0/741043961 wait complete. 2024-06-13T11:24:59.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.239+0000 7f13c2f34b80 20 client.25382 trim_cache size 0 max 16384 2024-06-13T11:24:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.255+0000 7f13c2f34b80 1 Processor -- start 2024-06-13T11:24:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.255+0000 7f13c2f34b80 1 -- start start 2024-06-13T11:24:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.256+0000 7f13c2f34b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 0x56302b71f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.256+0000 7f13c2f34b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b725960 0x56302b726740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.256+0000 7f13c2f34b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b72e570 0x56302b72a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.256+0000 7f13c2f34b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f13b01b71e0 con 0x56302b725960 2024-06-13T11:24:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.256+0000 7f13c2f34b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f13b01b4a70 con 0x56302b69fe40 2024-06-13T11:24:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.256+0000 7f13c2f34b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f13b01b28c0 con 0x56302b72e570 2024-06-13T11:24:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.256+0000 7f13b5200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b725960 0x56302b726740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.256+0000 7f13b5c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 0x56302b71f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.256+0000 7f13b5200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b725960 0x56302b726740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45436/0 (socket says 172.21.15.2:45436) 2024-06-13T11:24:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.256+0000 7f13b5200700 1 -- 172.21.15.2:0/3008362592 learned_addr learned my addr 172.21.15.2:0/3008362592 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.257+0000 7f13b5c00700 1 -- 172.21.15.2:0/3008362592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b72e570 msgr2=0x56302b72a1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-13T11:24:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.257+0000 7f13b5c00700 1 --2- 172.21.15.2:0/3008362592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b72e570 0x56302b72a1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.257+0000 7f13b5c00700 1 -- 172.21.15.2:0/3008362592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b725960 msgr2=0x56302b726740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:59.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.257+0000 7f13b5c00700 1 --2- 172.21.15.2:0/3008362592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b725960 0x56302b726740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.257+0000 7f13b5c00700 1 -- 172.21.15.2:0/3008362592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56302b7295a0 con 0x56302b69fe40 2024-06-13T11:24:59.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.257+0000 7f13b5c00700 1 --2- 172.21.15.2:0/3008362592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 0x56302b71f960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f13a400f830 tx=0x7f13a4012e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5561816d93930c9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:59.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.258+0000 7f13a2000700 1 -- 172.21.15.2:0/3008362592 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a400f520 con 0x56302b69fe40 2024-06-13T11:24:59.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.258+0000 7f13a2000700 1 -- 172.21.15.2:0/3008362592 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13a4005520 con 0x56302b69fe40 2024-06-13T11:24:59.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.258+0000 7f13a2000700 1 -- 172.21.15.2:0/3008362592 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a4011c50 con 0x56302b69fe40 2024-06-13T11:24:59.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.258+0000 7f13c2f34b80 1 -- 172.21.15.2:0/3008362592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 msgr2=0x56302b71f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:59.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.258+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/3008362592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 0x56302b71f960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f13a400f830 tx=0x7f13a4012e10 comp rx=0 tx=0).stop 2024-06-13T11:24:59.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.259+0000 7f13c2f34b80 1 -- 172.21.15.2:0/3008362592 shutdown_connections 2024-06-13T11:24:59.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.259+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/3008362592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b72e570 0x56302b72a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.259+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/3008362592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 0x56302b71f960 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.259+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/3008362592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b725960 0x56302b726740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.259+0000 7f13c2f34b80 1 -- 172.21.15.2:0/3008362592 >> 172.21.15.2:0/3008362592 conn(0x56302b650170 msgr2=0x56302b72c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:59.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.259+0000 7f13c2f34b80 1 -- 172.21.15.2:0/3008362592 shutdown_connections 2024-06-13T11:24:59.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.259+0000 7f13c2f34b80 1 -- 172.21.15.2:0/3008362592 wait complete. 2024-06-13T11:24:59.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.260+0000 7f13c2f34b80 1 -- start start 2024-06-13T11:24:59.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.260+0000 7f13c2f34b80 1 Processor -- start 2024-06-13T11:24:59.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.261+0000 7f13c2f34b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 0x56302b736970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.261+0000 7f13c2f34b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b725960 0x56302b731cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.261+0000 7f13c2f34b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b72e570 0x56302b732230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.261+0000 7f13c2f34b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f13b01b2f30 con 0x56302b725960 2024-06-13T11:24:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.261+0000 7f13c2f34b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f13b01b43a0 con 0x56302b69fe40 2024-06-13T11:24:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.261+0000 7f13c2f34b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f13b01b3600 con 0x56302b72e570 2024-06-13T11:24:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.261+0000 7f13c2f34b80 10 client.0 _ll_register_callbacks cb 0x56302b60f720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:24:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.261+0000 7f13b6600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b72e570 0x56302b732230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.262+0000 7f13b5c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 0x56302b736970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.262+0000 7f13b6600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b72e570 0x56302b732230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:48054/0 (socket says 172.21.15.2:48054) 2024-06-13T11:24:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.262+0000 7f13b6600700 1 -- 172.21.15.2:0/2783110351 learned_addr learned my addr 172.21.15.2:0/2783110351 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:24:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.262+0000 7f13b5200700 1 --2- 172.21.15.2:0/2783110351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b725960 0x56302b731cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.262+0000 7f13b6600700 1 -- 172.21.15.2:0/2783110351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 msgr2=0x56302b736970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.262+0000 7f13b6600700 1 --2- 172.21.15.2:0/2783110351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 0x56302b736970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.262+0000 7f13b6600700 1 -- 172.21.15.2:0/2783110351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b725960 msgr2=0x56302b731cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:24:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.262+0000 7f13b6600700 1 --2- 172.21.15.2:0/2783110351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b725960 0x56302b731cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.262+0000 7f13b6600700 1 -- 172.21.15.2:0/2783110351 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56302b7328b0 con 0x56302b72e570 2024-06-13T11:24:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.262+0000 7f13b6600700 1 --2- 172.21.15.2:0/2783110351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b72e570 0x56302b732230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009d10 tx=0x7f13a8004a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad8e6edc0de95ecf server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:24:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.262+0000 7f1397400700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:24:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.263+0000 7f13b5c00700 1 --2- 172.21.15.2:0/2783110351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 0x56302b736970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:24:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.263+0000 7f1397400700 1 -- 172.21.15.2:0/2783110351 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8030070 con 0x56302b72e570 2024-06-13T11:24:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.263+0000 7f13c2f34b80 1 -- 172.21.15.2:0/2783110351 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13a4005520 con 0x56302b72e570 2024-06-13T11:24:59.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.263+0000 7f1397400700 1 -- 172.21.15.2:0/2783110351 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f13a8003a00 con 0x56302b72e570 2024-06-13T11:24:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.263+0000 7f1397400700 1 -- 172.21.15.2:0/2783110351 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f13a803b050 con 0x56302b72e570 2024-06-13T11:24:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.263+0000 7f13c2f34b80 10 client.25411 fetch_fsmap learned FSMap version 27 2024-06-13T11:24:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.263+0000 7f13c2f34b80 1 -- 172.21.15.2:0/2783110351 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56302b7a89e0 con 0x56302b72e570 2024-06-13T11:24:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.264+0000 7f1397400700 1 -- 172.21.15.2:0/2783110351 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13a4005520 con 0x56302b72e570 2024-06-13T11:24:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.264+0000 7f1397400700 1 -- 172.21.15.2:0/2783110351 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f13a802b950 con 0x56302b72e570 2024-06-13T11:24:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.264+0000 7f13c2f34b80 10 client.25411 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:24:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.264+0000 7f13c2f34b80 10 client.25411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:24:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.264+0000 7f13c2f34b80 20 client.25411 populate_metadata read hostname 'smithi002' 2024-06-13T11:24:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.264+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/2783110351 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x56302b7a8e20 0x56302b7ab240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:24:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.264+0000 7f13c2f34b80 4 client.25411 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:24:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.264+0000 7f13c2f34b80 1 -- 172.21.15.2:0/2783110351 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56302b67d580 con 0x56302b7a8e20 2024-06-13T11:24:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.265+0000 7f13b5c00700 1 --2- 172.21.15.2:0/2783110351 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x56302b7a8e20 0x56302b7ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:24:59.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.265+0000 7f13b5c00700 1 --2- 172.21.15.2:0/2783110351 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x56302b7a8e20 0x56302b7ab240 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=260b8ee46976e5e0 server_cookie=ccc12e7a8aa3816d in_seq=0 out_seq=0 2024-06-13T11:24:59.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.265+0000 7f1397400700 10 client.25411 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:24:59.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.266+0000 7f1397400700 1 -- 172.21.15.2:0/2783110351 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56302b67d580 con 0x56302b7a8e20 2024-06-13T11:24:59.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.266+0000 7f1397400700 10 client.25411 handle_command_reply: tid=0 2024-06-13T11:24:59.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.266+0000 7f13c2f34b80 1 client.25411 shutdown 2024-06-13T11:24:59.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.266+0000 7f13c2f34b80 1 -- 172.21.15.2:0/2783110351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b72e570 msgr2=0x56302b732230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:59.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.266+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/2783110351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b72e570 0x56302b732230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009d10 tx=0x7f13a8004a90 comp rx=0 tx=0).stop 2024-06-13T11:24:59.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.266+0000 7f13c2f34b80 1 -- 172.21.15.2:0/2783110351 shutdown_connections 2024-06-13T11:24:59.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.266+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/2783110351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56302b72e570 0x56302b732230 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.266+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/2783110351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56302b69fe40 0x56302b736970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.266+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/2783110351 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x56302b7a8e20 0x56302b7ab240 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.266+0000 7f13c2f34b80 1 --2- 172.21.15.2:0/2783110351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56302b725960 0x56302b731cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.266+0000 7f13c2f34b80 1 -- 172.21.15.2:0/2783110351 >> 172.21.15.2:0/2783110351 conn(0x56302b650170 msgr2=0x56302b72a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:59.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.267+0000 7f1397400700 0 client.25411 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:24:59.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.267+0000 7f13c2f34b80 1 -- 172.21.15.2:0/2783110351 shutdown_connections 2024-06-13T11:24:59.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.267+0000 7f13c2f34b80 1 -- 172.21.15.2:0/2783110351 wait complete. 2024-06-13T11:24:59.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.267+0000 7f13c2f34b80 20 client.25411 trim_cache size 0 max 16384 2024-06-13T11:24:59.267 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:24:59.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.268+0000 7f13b7000700 1 -- 172.21.15.2:0/1717070948 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f13980a2ea0 msgr2=0x7f13980a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:59.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.268+0000 7f13b7000700 1 --2- 172.21.15.2:0/1717070948 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f13980a2ea0 0x7f13980a5360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009550 tx=0x7f13a800e160 comp rx=0 tx=0).stop 2024-06-13T11:24:59.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.268+0000 7f13b7000700 1 -- 172.21.15.2:0/1717070948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13b0101c90 msgr2=0x7f13b019f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:24:59.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.268+0000 7f13b7000700 1 --2- 172.21.15.2:0/1717070948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13b0101c90 0x7f13b019f790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f139c000c00 tx=0x7f139c00f950 comp rx=0 tx=0).stop 2024-06-13T11:24:59.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.268+0000 7f13b7000700 1 -- 172.21.15.2:0/1717070948 shutdown_connections 2024-06-13T11:24:59.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.268+0000 7f13b7000700 1 --2- 172.21.15.2:0/1717070948 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f13980a2ea0 0x7f13980a5360 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.268+0000 7f13b7000700 1 --2- 172.21.15.2:0/1717070948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13b0101370 0x7f13b019f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.268+0000 7f13b7000700 1 --2- 172.21.15.2:0/1717070948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13b0106780 0x7f13b01a3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.268+0000 7f13b7000700 1 --2- 172.21.15.2:0/1717070948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13b0101c90 0x7f13b019f790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:24:59.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.268+0000 7f13b7000700 1 -- 172.21.15.2:0/1717070948 >> 172.21.15.2:0/1717070948 conn(0x7f13b00fcdb0 msgr2=0x7f13b0104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:24:59.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.268+0000 7f13b7000700 1 -- 172.21.15.2:0/1717070948 shutdown_connections 2024-06-13T11:24:59.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:24:59.268+0000 7f13b7000700 1 -- 172.21.15.2:0/1717070948 wait complete. 2024-06-13T11:24:59.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:24:59 smithi002 ceph-mon[32210]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:24:59.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:24:59 smithi178 ceph-mon[36913]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:24:59.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:24:59 smithi077 ceph-mon[36410]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:25:00.395 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:25:00 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:25:00.308+0000 7fd07e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:25:00.396 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:25:00 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:25:00.308+0000 7fd07e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:25:00.396 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:25:00 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:25:00.308+0000 7fd07e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:25:00.396 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:25:00 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:25:00.308+0000 7fd07e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:25:00.396 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:25:00 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:25:00.308+0000 7fd07e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T11:25:01.201 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-13T11:25:01.201 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-13T11:25:01.624 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:25:01.647 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:01 smithi002 ceph-mon[32210]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:25:01.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:01 smithi178 ceph-mon[36913]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:25:01.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:01 smithi077 ceph-mon[36410]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:25:03.679 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:03 smithi002 ceph-mon[32210]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:25:03.679 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:03 smithi002 ceph-mon[32210]: mgrmap e25: x(active, since 76s), standbys: y, z 2024-06-13T11:25:03.679 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:03 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:25:03.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:03 smithi178 ceph-mon[36913]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:25:03.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:03 smithi178 ceph-mon[36913]: mgrmap e25: x(active, since 76s), standbys: y, z 2024-06-13T11:25:03.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:03 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:25:03.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:03 smithi077 ceph-mon[36410]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:25:03.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:03 smithi077 ceph-mon[36410]: mgrmap e25: x(active, since 76s), standbys: y, z 2024-06-13T11:25:03.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:03 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:25:04.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.152+0000 7f4d99600700 1 -- 172.21.15.2:0/3110894344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d9406a6b0 msgr2=0x7f4d9406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:04.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.152+0000 7f4d99600700 1 --2- 172.21.15.2:0/3110894344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d9406a6b0 0x7f4d9406ab10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009990 tx=0x7f4d80009ca0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.152+0000 7f4d99600700 1 -- 172.21.15.2:0/3110894344 shutdown_connections 2024-06-13T11:25:04.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.152+0000 7f4d99600700 1 --2- 172.21.15.2:0/3110894344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d94104e90 0x7f4d94105320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.152+0000 7f4d99600700 1 --2- 172.21.15.2:0/3110894344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d94107380 0x7f4d9406a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.152+0000 7f4d99600700 1 --2- 172.21.15.2:0/3110894344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d9406a6b0 0x7f4d9406ab10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.152+0000 7f4d99600700 1 -- 172.21.15.2:0/3110894344 >> 172.21.15.2:0/3110894344 conn(0x7f4d940782c0 msgr2=0x7f4d940786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:04.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.152+0000 7f4d99600700 1 -- 172.21.15.2:0/3110894344 shutdown_connections 2024-06-13T11:25:04.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.152+0000 7f4d99600700 1 -- 172.21.15.2:0/3110894344 wait complete. 2024-06-13T11:25:04.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.154+0000 7f4d99600700 1 Processor -- start 2024-06-13T11:25:04.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.154+0000 7f4d99600700 1 -- start start 2024-06-13T11:25:04.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.155+0000 7f4d99600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d9406a6b0 0x7f4d94073c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.155+0000 7f4d99600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d94104e90 0x7f4d94074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.155+0000 7f4d99600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d94107380 0x7f4d9406cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.155+0000 7f4d99600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d94118d70 con 0x7f4d94107380 2024-06-13T11:25:04.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.155+0000 7f4d99600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d94118bf0 con 0x7f4d94104e90 2024-06-13T11:25:04.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.155+0000 7f4d99600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4d94118ef0 con 0x7f4d9406a6b0 2024-06-13T11:25:04.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.155+0000 7f4d92a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d9406a6b0 0x7f4d94073c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.155+0000 7f4d92a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d9406a6b0 0x7f4d94073c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:48090/0 (socket says 172.21.15.2:48090) 2024-06-13T11:25:04.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.155+0000 7f4d92a00700 1 -- 172.21.15.2:0/3964277512 learned_addr learned my addr 172.21.15.2:0/3964277512 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:04.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.155+0000 7f4d93400700 1 --2- 172.21.15.2:0/3964277512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d94107380 0x7f4d9406cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.155+0000 7f4d92000700 1 --2- 172.21.15.2:0/3964277512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d94104e90 0x7f4d94074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.156+0000 7f4d92a00700 1 -- 172.21.15.2:0/3964277512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d94104e90 msgr2=0x7f4d94074170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.156+0000 7f4d92a00700 1 --2- 172.21.15.2:0/3964277512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d94104e90 0x7f4d94074170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.156+0000 7f4d92a00700 1 -- 172.21.15.2:0/3964277512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d94107380 msgr2=0x7f4d9406cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.156+0000 7f4d92a00700 1 --2- 172.21.15.2:0/3964277512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d94107380 0x7f4d9406cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.156+0000 7f4d92a00700 1 -- 172.21.15.2:0/3964277512 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9406d7c0 con 0x7f4d9406a6b0 2024-06-13T11:25:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.156+0000 7f4d93400700 1 --2- 172.21.15.2:0/3964277512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d94107380 0x7f4d9406cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.157+0000 7f4d92a00700 1 --2- 172.21.15.2:0/3964277512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d9406a6b0 0x7f4d94073c30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400c9b0 tx=0x7f4d8400ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.157+0000 7f4d8b400700 1 -- 172.21.15.2:0/3964277512 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84007b00 con 0x7f4d9406a6b0 2024-06-13T11:25:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.157+0000 7f4d8b400700 1 -- 172.21.15.2:0/3964277512 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d8400ce40 con 0x7f4d9406a6b0 2024-06-13T11:25:04.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.157+0000 7f4d8b400700 1 -- 172.21.15.2:0/3964277512 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84018660 con 0x7f4d9406a6b0 2024-06-13T11:25:04.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.157+0000 7f4d99600700 1 -- 172.21.15.2:0/3964277512 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d9406dab0 con 0x7f4d9406a6b0 2024-06-13T11:25:04.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.157+0000 7f4d99600700 1 -- 172.21.15.2:0/3964277512 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d94071a50 con 0x7f4d9406a6b0 2024-06-13T11:25:04.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.162+0000 7f4d8b400700 1 -- 172.21.15.2:0/3964277512 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138065+0+0 (secure 0 0 0) 0x7f4d84004830 con 0x7f4d9406a6b0 2024-06-13T11:25:04.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.164+0000 7f4da3f95b80 1 Processor -- start 2024-06-13T11:25:04.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.164+0000 7f4da3f95b80 1 -- start start 2024-06-13T11:25:04.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.164+0000 7f4da3f95b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d1c0ec0 0x561b7d2440f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.164+0000 7f4da3f95b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d244630 0x561b7d244ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.165+0000 7f4da3f95b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 0x561b7d251770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.165+0000 7f4da3f95b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561b7d153a90 con 0x561b7d1c0ec0 2024-06-13T11:25:04.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.165+0000 7f4da3f95b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561b7d196b80 con 0x561b7d244630 2024-06-13T11:25:04.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.165+0000 7f4da3f95b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561b7d151970 con 0x561b7d24f380 2024-06-13T11:25:04.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.165+0000 7f4d8b400700 1 --2- 172.21.15.2:0/3964277512 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4d780a2f30 0x7f4d780a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.165+0000 7f4d8b400700 1 -- 172.21.15.2:0/3964277512 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f4d840cf800 con 0x7f4d9406a6b0 2024-06-13T11:25:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.165+0000 7f4d92000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 0x561b7d251770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.165+0000 7f4d92000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 0x561b7d251770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:48096/0 (socket says 172.21.15.2:48096) 2024-06-13T11:25:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.165+0000 7f4d92000700 1 -- 172.21.15.2:0/3132818130 learned_addr learned my addr 172.21.15.2:0/3132818130 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.165+0000 7f4d93400700 1 --2- 172.21.15.2:0/3132818130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d1c0ec0 0x561b7d2440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.165+0000 7f4d92a00700 1 --2- 172.21.15.2:0/3132818130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d244630 0x561b7d244ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.165+0000 7f4d92000700 1 -- 172.21.15.2:0/3132818130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d244630 msgr2=0x561b7d244ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.165+0000 7f4d92000700 1 --2- 172.21.15.2:0/3132818130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d244630 0x561b7d244ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.166+0000 7f4d92000700 1 -- 172.21.15.2:0/3132818130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d1c0ec0 msgr2=0x561b7d2440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.166+0000 7f4d92000700 1 --2- 172.21.15.2:0/3132818130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d1c0ec0 0x561b7d2440f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.166+0000 7f4d92000700 1 -- 172.21.15.2:0/3132818130 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7d13f010 con 0x561b7d24f380 2024-06-13T11:25:04.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.166+0000 7f4d93400700 1 --2- 172.21.15.2:0/3964277512 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4d780a2f30 0x7f4d780a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.166+0000 7f4d92000700 1 --2- 172.21.15.2:0/3132818130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 0x561b7d251770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4d80000c00 tx=0x7f4d8000b6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb59aa956a399343 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:04.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.167+0000 7f4d7fe00700 1 -- 172.21.15.2:0/3132818130 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80027070 con 0x561b7d24f380 2024-06-13T11:25:04.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.167+0000 7f4d7fe00700 1 -- 172.21.15.2:0/3132818130 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d80005550 con 0x561b7d24f380 2024-06-13T11:25:04.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.167+0000 7f4d7fe00700 1 -- 172.21.15.2:0/3132818130 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80003e40 con 0x561b7d24f380 2024-06-13T11:25:04.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.168+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3132818130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 msgr2=0x561b7d251770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:04.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.168+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3132818130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 0x561b7d251770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4d80000c00 tx=0x7f4d8000b6c0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.168+0000 7f4d93400700 1 --2- 172.21.15.2:0/3964277512 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4d780a2f30 0x7f4d780a53f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x561b7d241430 tx=0x7f4d8c004b40 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:04.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.168+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3132818130 shutdown_connections 2024-06-13T11:25:04.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.168+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3132818130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d1c0ec0 0x561b7d2440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.168+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3132818130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 0x561b7d251770 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.168+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3132818130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d244630 0x561b7d244ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.168+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3132818130 >> 172.21.15.2:0/3132818130 conn(0x561b7d1711f0 msgr2=0x561b7d240530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:04.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.168+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3132818130 shutdown_connections 2024-06-13T11:25:04.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.168+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3132818130 wait complete. 2024-06-13T11:25:04.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.169+0000 7f4da3f95b80 1 -- start start 2024-06-13T11:25:04.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.169+0000 7f4da3f95b80 1 Processor -- start 2024-06-13T11:25:04.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.170+0000 7f4da3f95b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d1c0ec0 0x561b7d24e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.170+0000 7f4da3f95b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d244630 0x561b7d24bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.170+0000 7f4da3f95b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d24f380 0x561b7d24c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.170+0000 7f4da3f95b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561b7d132fe0 con 0x561b7d24f380 2024-06-13T11:25:04.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.170+0000 7f4da3f95b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561b7d192b40 con 0x561b7d1c0ec0 2024-06-13T11:25:04.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.170+0000 7f4da3f95b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561b7d251fe0 con 0x561b7d244630 2024-06-13T11:25:04.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.170+0000 7f4da3f95b80 10 client.0 _ll_register_callbacks cb 0x561b7d1307a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:04.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.170+0000 7f4d92a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d1c0ec0 0x561b7d24e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.170+0000 7f4d92a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d1c0ec0 0x561b7d24e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:55512/0 (socket says 172.21.15.2:55512) 2024-06-13T11:25:04.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.170+0000 7f4d92a00700 1 -- 172.21.15.2:0/3099569365 learned_addr learned my addr 172.21.15.2:0/3099569365 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:04.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.170+0000 7f4d92000700 1 --2- 172.21.15.2:0/3099569365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d244630 0x561b7d24bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.171+0000 7f4d93400700 1 --2- 172.21.15.2:0/3099569365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d24f380 0x561b7d24c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.171+0000 7f4d92a00700 1 -- 172.21.15.2:0/3099569365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d244630 msgr2=0x561b7d24bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:04.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.171+0000 7f4d92a00700 1 --2- 172.21.15.2:0/3099569365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d244630 0x561b7d24bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.171+0000 7f4d92a00700 1 -- 172.21.15.2:0/3099569365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d24f380 msgr2=0x561b7d24c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:04.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.171+0000 7f4d92a00700 1 --2- 172.21.15.2:0/3099569365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d24f380 0x561b7d24c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.171+0000 7f4d92a00700 1 -- 172.21.15.2:0/3099569365 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b7d0e5950 con 0x561b7d1c0ec0 2024-06-13T11:25:04.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.171+0000 7f4d93400700 1 --2- 172.21.15.2:0/3099569365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d24f380 0x561b7d24c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:25:04.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.172+0000 7f4d92a00700 1 --2- 172.21.15.2:0/3099569365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d1c0ec0 0x561b7d24e9c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400afd0 tx=0x7f4d8409b1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78365af290422526 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:04.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.172+0000 7f4d7cc00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:25:04.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.172+0000 7f4d7cc00700 1 -- 172.21.15.2:0/3099569365 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84064e60 con 0x561b7d1c0ec0 2024-06-13T11:25:04.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.172+0000 7f4d7cc00700 1 -- 172.21.15.2:0/3099569365 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f4d840cf450 con 0x561b7d1c0ec0 2024-06-13T11:25:04.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.172+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3099569365 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d80005550 con 0x561b7d1c0ec0 2024-06-13T11:25:04.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.172+0000 7f4d7cc00700 1 -- 172.21.15.2:0/3099569365 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4d840cf650 con 0x561b7d1c0ec0 2024-06-13T11:25:04.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.172+0000 7f4da3f95b80 10 client.25397 fetch_fsmap learned FSMap version 27 2024-06-13T11:25:04.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.172+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3099569365 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561b7d25c6a0 con 0x561b7d1c0ec0 2024-06-13T11:25:04.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.173+0000 7f4d7cc00700 1 -- 172.21.15.2:0/3099569365 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d80005550 con 0x561b7d1c0ec0 2024-06-13T11:25:04.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.173+0000 7f4d7cc00700 1 -- 172.21.15.2:0/3099569365 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4d8409b9c0 con 0x561b7d1c0ec0 2024-06-13T11:25:04.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.173+0000 7f4da3f95b80 10 client.25397 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:25:04.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.173+0000 7f4da3f95b80 10 client.25397 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:25:04.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.173+0000 7f4da3f95b80 20 client.25397 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:04.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.173+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3099569365 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561b7d25ec80 0x561b7d2610b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.173+0000 7f4da3f95b80 4 client.25397 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:25:04.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.173+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3099569365 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b7d1a4080 con 0x561b7d25ec80 2024-06-13T11:25:04.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.174+0000 7f4d92000700 1 --2- 172.21.15.2:0/3099569365 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561b7d25ec80 0x561b7d2610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.175+0000 7f4d92000700 1 --2- 172.21.15.2:0/3099569365 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561b7d25ec80 0x561b7d2610b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e07f7edba2c8b65d server_cookie=37c8d0b262d8679e in_seq=0 out_seq=0 2024-06-13T11:25:04.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.175+0000 7f4d7cc00700 10 client.25397 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:04.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.176+0000 7f4d7cc00700 1 -- 172.21.15.2:0/3099569365 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561b7d1a4080 con 0x561b7d25ec80 2024-06-13T11:25:04.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.176+0000 7f4d7cc00700 10 client.25397 handle_command_reply: tid=0 2024-06-13T11:25:04.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.176+0000 7f4da3f95b80 1 client.25397 shutdown 2024-06-13T11:25:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.177+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3099569365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d1c0ec0 msgr2=0x561b7d24e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.177+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3099569365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d1c0ec0 0x561b7d24e9c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400afd0 tx=0x7f4d8409b1b0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.177+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3099569365 shutdown_connections 2024-06-13T11:25:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.177+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3099569365 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561b7d25ec80 0x561b7d2610b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.177+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3099569365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d24f380 0x561b7d24c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.177+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3099569365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d1c0ec0 0x561b7d24e9c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.177+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3099569365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d244630 0x561b7d24bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.177+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3099569365 >> 172.21.15.2:0/3099569365 conn(0x561b7d1711f0 msgr2=0x561b7d23f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:04.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.177+0000 7f4d7cc00700 0 client.25397 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:04.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.178+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3099569365 shutdown_connections 2024-06-13T11:25:04.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.178+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3099569365 wait complete. 2024-06-13T11:25:04.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.178+0000 7f4da3f95b80 20 client.25397 trim_cache size 0 max 16384 2024-06-13T11:25:04.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.202+0000 7f4da3f95b80 1 Processor -- start 2024-06-13T11:25:04.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.202+0000 7f4da3f95b80 1 -- start start 2024-06-13T11:25:04.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.203+0000 7f4da3f95b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d1c0ec0 0x561b7d24ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.203+0000 7f4da3f95b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d244630 0x561b7d24dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.203+0000 7f4da3f95b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 0x561b7d250770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.203+0000 7f4da3f95b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d74011470 con 0x561b7d244630 2024-06-13T11:25:04.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.203+0000 7f4da3f95b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7400ed00 con 0x561b7d1c0ec0 2024-06-13T11:25:04.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.203+0000 7f4da3f95b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7400cb50 con 0x561b7d24f380 2024-06-13T11:25:04.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.203+0000 7f4d92a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d1c0ec0 0x561b7d24ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.203+0000 7f4d92a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d1c0ec0 0x561b7d24ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:55518/0 (socket says 172.21.15.2:55518) 2024-06-13T11:25:04.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.203+0000 7f4d93400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 0x561b7d250770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.203+0000 7f4d92a00700 1 -- 172.21.15.2:0/3520618378 learned_addr learned my addr 172.21.15.2:0/3520618378 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:04.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.203+0000 7f4d92000700 1 --2- 172.21.15.2:0/3520618378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d244630 0x561b7d24dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.204+0000 7f4d92a00700 1 -- 172.21.15.2:0/3520618378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 msgr2=0x561b7d250770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:04.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.204+0000 7f4d92a00700 1 --2- 172.21.15.2:0/3520618378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 0x561b7d250770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.204+0000 7f4d92a00700 1 -- 172.21.15.2:0/3520618378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d244630 msgr2=0x561b7d24dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:04.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.204+0000 7f4d92a00700 1 --2- 172.21.15.2:0/3520618378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d244630 0x561b7d24dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.204+0000 7f4d92a00700 1 -- 172.21.15.2:0/3520618378 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7d245c50 con 0x561b7d1c0ec0 2024-06-13T11:25:04.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.204+0000 7f4d92000700 1 --2- 172.21.15.2:0/3520618378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d244630 0x561b7d24dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:25:04.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.205+0000 7f4d92a00700 1 --2- 172.21.15.2:0/3520618378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d1c0ec0 0x561b7d24ae80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4d84099a10 tx=0x7f4d84000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbfc054ccd92bd46 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:04.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.205+0000 7f4d7f400700 1 -- 172.21.15.2:0/3520618378 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84097a00 con 0x561b7d1c0ec0 2024-06-13T11:25:04.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.205+0000 7f4d7f400700 1 -- 172.21.15.2:0/3520618378 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d840cc9a0 con 0x561b7d1c0ec0 2024-06-13T11:25:04.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.205+0000 7f4d7f400700 1 -- 172.21.15.2:0/3520618378 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d840a3f40 con 0x561b7d1c0ec0 2024-06-13T11:25:04.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.206+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3520618378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d1c0ec0 msgr2=0x561b7d24ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:04.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.206+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3520618378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d1c0ec0 0x561b7d24ae80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4d84099a10 tx=0x7f4d84000bc0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.206+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3520618378 shutdown_connections 2024-06-13T11:25:04.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.206+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3520618378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 0x561b7d250770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.206+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3520618378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d1c0ec0 0x561b7d24ae80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.206+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3520618378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d244630 0x561b7d24dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.206+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3520618378 >> 172.21.15.2:0/3520618378 conn(0x561b7d1711f0 msgr2=0x561b7d24d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:04.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.206+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3520618378 shutdown_connections 2024-06-13T11:25:04.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.206+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3520618378 wait complete. 2024-06-13T11:25:04.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.207+0000 7f4da3f95b80 1 -- start start 2024-06-13T11:25:04.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.207+0000 7f4da3f95b80 1 Processor -- start 2024-06-13T11:25:04.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.207+0000 7f4da3f95b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d1c0ec0 0x561b7d249990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.207+0000 7f4da3f95b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d244630 0x561b7d2572d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.207+0000 7f4da3f95b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 0x561b7d2578e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.207+0000 7f4da3f95b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7400d1c0 con 0x561b7d1c0ec0 2024-06-13T11:25:04.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.207+0000 7f4da3f95b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7400e630 con 0x561b7d244630 2024-06-13T11:25:04.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.207+0000 7f4da3f95b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7400d890 con 0x561b7d24f380 2024-06-13T11:25:04.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.207+0000 7f4da3f95b80 10 client.0 _ll_register_callbacks cb 0x561b7d1307a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:04.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.208+0000 7f4d92a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d1c0ec0 0x561b7d249990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.208+0000 7f4d92000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d244630 0x561b7d2572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.208+0000 7f4d92000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d244630 0x561b7d2572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:55522/0 (socket says 172.21.15.2:55522) 2024-06-13T11:25:04.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.208+0000 7f4d92000700 1 -- 172.21.15.2:0/3222010278 learned_addr learned my addr 172.21.15.2:0/3222010278 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:04.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.209+0000 7f4d93400700 1 --2- 172.21.15.2:0/3222010278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 0x561b7d2578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.209+0000 7f4d92000700 1 -- 172.21.15.2:0/3222010278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 msgr2=0x561b7d2578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:04.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.209+0000 7f4d92000700 1 --2- 172.21.15.2:0/3222010278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 0x561b7d2578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.209+0000 7f4d92000700 1 -- 172.21.15.2:0/3222010278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d1c0ec0 msgr2=0x561b7d249990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:04.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.209+0000 7f4d92000700 1 --2- 172.21.15.2:0/3222010278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d1c0ec0 0x561b7d249990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.209+0000 7f4d92000700 1 -- 172.21.15.2:0/3222010278 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b7d266570 con 0x561b7d244630 2024-06-13T11:25:04.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.209+0000 7f4d92a00700 1 --2- 172.21.15.2:0/3222010278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d1c0ec0 0x561b7d249990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:25:04.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.210+0000 7f4d92000700 1 --2- 172.21.15.2:0/3222010278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d244630 0x561b7d2572d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4d800098e0 tx=0x7f4d80003a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7a22b1670f0b7bd server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:04.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.210+0000 7f4d7cc00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:25:04.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.210+0000 7f4d7cc00700 1 -- 172.21.15.2:0/3222010278 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80027030 con 0x561b7d244630 2024-06-13T11:25:04.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.211+0000 7f4d7cc00700 1 -- 172.21.15.2:0/3222010278 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f4d80003a90 con 0x561b7d244630 2024-06-13T11:25:04.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.211+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3222010278 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d840cc9a0 con 0x561b7d244630 2024-06-13T11:25:04.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.211+0000 7f4d7cc00700 1 -- 172.21.15.2:0/3222010278 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4d80003cd0 con 0x561b7d244630 2024-06-13T11:25:04.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.211+0000 7f4da3f95b80 10 client.25403 fetch_fsmap learned FSMap version 27 2024-06-13T11:25:04.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.211+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3222010278 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561b7d2c9c10 con 0x561b7d244630 2024-06-13T11:25:04.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.212+0000 7f4d7cc00700 1 -- 172.21.15.2:0/3222010278 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d840cc9a0 con 0x561b7d244630 2024-06-13T11:25:04.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.212+0000 7f4d7cc00700 1 -- 172.21.15.2:0/3222010278 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4d80021030 con 0x561b7d244630 2024-06-13T11:25:04.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.212+0000 7f4da3f95b80 10 client.25403 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:25:04.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.212+0000 7f4da3f95b80 10 client.25403 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:25:04.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.212+0000 7f4da3f95b80 20 client.25403 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:04.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.212+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3222010278 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561b7d2c9f00 0x561b7d2cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:04.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.212+0000 7f4da3f95b80 4 client.25403 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-13T11:25:04.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.212+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3222010278 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561b7d19e600 con 0x561b7d2c9f00 2024-06-13T11:25:04.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.213+0000 7f4d92a00700 1 --2- 172.21.15.2:0/3222010278 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561b7d2c9f00 0x561b7d2cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:04.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.213+0000 7f4d92a00700 1 --2- 172.21.15.2:0/3222010278 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561b7d2c9f00 0x561b7d2cc2f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e724b1c89798bcb0 server_cookie=9f3e255b55170dd6 in_seq=0 out_seq=0 2024-06-13T11:25:04.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.213+0000 7f4d7cc00700 10 client.25403 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:04.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.214+0000 7f4d7cc00700 1 -- 172.21.15.2:0/3222010278 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561b7d19e600 con 0x561b7d2c9f00 2024-06-13T11:25:04.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.214+0000 7f4d7cc00700 10 client.25403 handle_command_reply: tid=0 2024-06-13T11:25:04.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.214+0000 7f4da3f95b80 1 client.25403 shutdown 2024-06-13T11:25:04.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.215+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3222010278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d244630 msgr2=0x561b7d2572d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:04.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.215+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3222010278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d244630 0x561b7d2572d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4d800098e0 tx=0x7f4d80003a20 comp rx=0 tx=0).stop 2024-06-13T11:25:04.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.215+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3222010278 shutdown_connections 2024-06-13T11:25:04.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.215+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3222010278 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561b7d2c9f00 0x561b7d2cc2f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.215+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3222010278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561b7d1c0ec0 0x561b7d249990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.215+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3222010278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b7d24f380 0x561b7d2578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.215+0000 7f4da3f95b80 1 --2- 172.21.15.2:0/3222010278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561b7d244630 0x561b7d2572d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.215+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3222010278 >> 172.21.15.2:0/3222010278 conn(0x561b7d1711f0 msgr2=0x561b7d24dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:04.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.215+0000 7f4d7cc00700 0 client.25403 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:04.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.216+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3222010278 shutdown_connections 2024-06-13T11:25:04.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.216+0000 7f4da3f95b80 1 -- 172.21.15.2:0/3222010278 wait complete. 2024-06-13T11:25:04.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.216+0000 7f4da3f95b80 20 client.25403 trim_cache size 0 max 16384 2024-06-13T11:25:04.216 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:25:04.216 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-06-13T11:25:04.216 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "142b3ca2-753a-49eb-bf87-738a44df1045", 2024-06-13T11:25:04.216 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-06-13T11:25:04.216 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:25:04.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.217+0000 7f4d99600700 1 -- 172.21.15.2:0/3964277512 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4d780a2f30 msgr2=0x7f4d780a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:04.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.217+0000 7f4d99600700 1 --2- 172.21.15.2:0/3964277512 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4d780a2f30 0x7f4d780a53f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x561b7d241430 tx=0x7f4d8c004b40 comp rx=0 tx=0).stop 2024-06-13T11:25:04.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.217+0000 7f4d99600700 1 -- 172.21.15.2:0/3964277512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d9406a6b0 msgr2=0x7f4d94073c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:04.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.217+0000 7f4d99600700 1 --2- 172.21.15.2:0/3964277512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d9406a6b0 0x7f4d94073c30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400c9b0 tx=0x7f4d8400ccc0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.217+0000 7f4d99600700 1 -- 172.21.15.2:0/3964277512 shutdown_connections 2024-06-13T11:25:04.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.217+0000 7f4d99600700 1 --2- 172.21.15.2:0/3964277512 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4d780a2f30 0x7f4d780a53f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.217+0000 7f4d99600700 1 --2- 172.21.15.2:0/3964277512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d94107380 0x7f4d9406cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.217+0000 7f4d99600700 1 --2- 172.21.15.2:0/3964277512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d9406a6b0 0x7f4d94073c30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.217+0000 7f4d99600700 1 --2- 172.21.15.2:0/3964277512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d94104e90 0x7f4d94074170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:04.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.217+0000 7f4d99600700 1 -- 172.21.15.2:0/3964277512 >> 172.21.15.2:0/3964277512 conn(0x7f4d940782c0 msgr2=0x7f4d94103e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:04.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.218+0000 7f4d99600700 1 -- 172.21.15.2:0/3964277512 shutdown_connections 2024-06-13T11:25:04.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:04.218+0000 7f4d99600700 1 -- 172.21.15.2:0/3964277512 wait complete. 2024-06-13T11:25:04.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:04 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:25:04.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:04 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:25:04.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:04 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:25:04.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:04 smithi178 ceph-mon[36913]: scrub queued for path: / 2024-06-13T11:25:04.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:04 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:04.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:04 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:25:04.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:04 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:04.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:04 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:25:04.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:04 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:25:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:04 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:25:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:04 smithi077 ceph-mon[36410]: scrub queued for path: / 2024-06-13T11:25:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:04 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:04 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:25:04.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:04 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:04.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:04 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:25:04.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:04 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:25:04.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:04 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:25:04.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:04 smithi002 ceph-mon[32210]: scrub queued for path: / 2024-06-13T11:25:04.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:04 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:04.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:04 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:25:04.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:04 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:05.127 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:25:05.581 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:25:05.691 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:05 smithi077 ceph-mon[36410]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:25:05.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:05 smithi178 ceph-mon[36913]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:25:05.732 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:05 smithi002 ceph-mon[32210]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:25:06.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:06 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:25:06.768 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:06 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:25:06.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:06 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:25:07.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:07 smithi178 ceph-mon[36913]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:25:07.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:07 smithi077 ceph-mon[36410]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:25:07.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:07 smithi002 ceph-mon[32210]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:25:07.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.977+0000 7f3534a00700 1 -- 172.21.15.2:0/3893081745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3530102740 msgr2=0x7f3530102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:07.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.977+0000 7f3534a00700 1 --2- 172.21.15.2:0/3893081745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3530102740 0x7f3530102b20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f35200099c0 tx=0x7f3520009cd0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.977+0000 7f3534a00700 1 -- 172.21.15.2:0/3893081745 shutdown_connections 2024-06-13T11:25:07.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.977+0000 7f3534a00700 1 --2- 172.21.15.2:0/3893081745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3530102740 0x7f3530102b20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.977+0000 7f3534a00700 1 --2- 172.21.15.2:0/3893081745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3530107840 0x7f353010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.977+0000 7f3534a00700 1 --2- 172.21.15.2:0/3893081745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35301030f0 0x7f3530107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.977+0000 7f3534a00700 1 -- 172.21.15.2:0/3893081745 >> 172.21.15.2:0/3893081745 conn(0x7f35300795f0 msgr2=0x7f3530079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:07.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.977+0000 7f3534a00700 1 -- 172.21.15.2:0/3893081745 shutdown_connections 2024-06-13T11:25:07.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.977+0000 7f3534a00700 1 -- 172.21.15.2:0/3893081745 wait complete. 2024-06-13T11:25:07.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.979+0000 7f3534a00700 1 Processor -- start 2024-06-13T11:25:07.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.979+0000 7f3534a00700 1 -- start start 2024-06-13T11:25:07.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.979+0000 7f3534a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3530102740 0x7f353019add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:07.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.979+0000 7f3534a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35301030f0 0x7f353019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:07.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.979+0000 7f3534a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3530107840 0x7f353019f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:07.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.979+0000 7f3534a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35301127d0 con 0x7f3530107840 2024-06-13T11:25:07.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.979+0000 7f3534a00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3530112650 con 0x7f35301030f0 2024-06-13T11:25:07.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.979+0000 7f3534a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3530112950 con 0x7f3530102740 2024-06-13T11:25:07.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.980+0000 7f352e800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3530107840 0x7f353019f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:07.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.980+0000 7f352de00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3530102740 0x7f353019add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:07.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.980+0000 7f352d400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35301030f0 0x7f353019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:07.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.980+0000 7f352e800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3530107840 0x7f353019f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55812/0 (socket says 172.21.15.2:55812) 2024-06-13T11:25:07.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.980+0000 7f352d400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35301030f0 0x7f353019b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:34276/0 (socket says 172.21.15.2:34276) 2024-06-13T11:25:07.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.980+0000 7f352de00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3530102740 0x7f353019add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49408/0 (socket says 172.21.15.2:49408) 2024-06-13T11:25:07.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.980+0000 7f352e800700 1 -- 172.21.15.2:0/2236086965 learned_addr learned my addr 172.21.15.2:0/2236086965 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:07.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.980+0000 7f352de00700 1 -- 172.21.15.2:0/2236086965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35301030f0 msgr2=0x7f353019b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:07.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.980+0000 7f352de00700 1 --2- 172.21.15.2:0/2236086965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35301030f0 0x7f353019b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.980+0000 7f352de00700 1 -- 172.21.15.2:0/2236086965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3530107840 msgr2=0x7f353019f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:07.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.980+0000 7f352de00700 1 --2- 172.21.15.2:0/2236086965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3530107840 0x7f353019f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.980+0000 7f352de00700 1 -- 172.21.15.2:0/2236086965 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353019fde0 con 0x7f3530102740 2024-06-13T11:25:07.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.981+0000 7f352de00700 1 --2- 172.21.15.2:0/2236086965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3530102740 0x7f353019add0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f35200098e0 tx=0x7f3520005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:07.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.981+0000 7f3526a00700 1 -- 172.21.15.2:0/2236086965 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520027070 con 0x7f3530102740 2024-06-13T11:25:07.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.981+0000 7f3534a00700 1 -- 172.21.15.2:0/2236086965 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35301a0070 con 0x7f3530102740 2024-06-13T11:25:07.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.981+0000 7f3526a00700 1 -- 172.21.15.2:0/2236086965 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3520003680 con 0x7f3530102740 2024-06-13T11:25:07.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.981+0000 7f3526a00700 1 -- 172.21.15.2:0/2236086965 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520022e60 con 0x7f3530102740 2024-06-13T11:25:07.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.981+0000 7f3534a00700 1 -- 172.21.15.2:0/2236086965 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35301a7950 con 0x7f3530102740 2024-06-13T11:25:07.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.984+0000 7f3526a00700 1 -- 172.21.15.2:0/2236086965 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138065+0+0 (secure 0 0 0) 0x7f352002a070 con 0x7f3530102740 2024-06-13T11:25:07.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.986+0000 7f3526a00700 1 --2- 172.21.15.2:0/2236086965 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f35140a2eb0 0x7f35140a5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:07.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.986+0000 7f3526a00700 1 -- 172.21.15.2:0/2236086965 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f35200d0440 con 0x7f3530102740 2024-06-13T11:25:07.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.986+0000 7f352d400700 1 --2- 172.21.15.2:0/2236086965 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f35140a2eb0 0x7f35140a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:07.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.987+0000 7f352d400700 1 --2- 172.21.15.2:0/2236086965 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f35140a2eb0 0x7f35140a5370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f353010f770 tx=0x7f351c009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:07.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.988+0000 7f353f457b80 1 Processor -- start 2024-06-13T11:25:07.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.988+0000 7f353f457b80 1 -- start start 2024-06-13T11:25:07.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.988+0000 7f353f457b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 0x55a375e8a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:07.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.988+0000 7f353f457b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e8a5b0 0x55a375e8aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:07.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.988+0000 7f353f457b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e95300 0x55a375e976f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:07.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.988+0000 7f353f457b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a375d99a10 con 0x55a375e8a5b0 2024-06-13T11:25:07.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.988+0000 7f353f457b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a375ddcb00 con 0x55a375e95300 2024-06-13T11:25:07.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.988+0000 7f353f457b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a375d978f0 con 0x55a375e06e40 2024-06-13T11:25:07.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.989+0000 7f352d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e8a5b0 0x55a375e8aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.989+0000 7f352d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e8a5b0 0x55a375e8aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55824/0 (socket says 172.21.15.2:55824) 2024-06-13T11:25:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.989+0000 7f352d400700 1 -- 172.21.15.2:0/1896803228 learned_addr learned my addr 172.21.15.2:0/1896803228 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.989+0000 7f352e800700 1 --2- 172.21.15.2:0/1896803228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e95300 0x55a375e976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.989+0000 7f352de00700 1 --2- 172.21.15.2:0/1896803228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 0x55a375e8a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.989+0000 7f352e800700 1 -- 172.21.15.2:0/1896803228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 msgr2=0x55a375e8a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.989+0000 7f352e800700 1 --2- 172.21.15.2:0/1896803228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 0x55a375e8a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.989+0000 7f352e800700 1 -- 172.21.15.2:0/1896803228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e8a5b0 msgr2=0x55a375e8aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.989+0000 7f352e800700 1 --2- 172.21.15.2:0/1896803228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e8a5b0 0x55a375e8aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.989+0000 7f352e800700 1 -- 172.21.15.2:0/1896803228 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a375d84f90 con 0x55a375e95300 2024-06-13T11:25:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.990+0000 7f352e800700 1 --2- 172.21.15.2:0/1896803228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e95300 0x55a375e976f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3528009c10 tx=0x7f3528009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd6c6c3e5cbea8c5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:07.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.990+0000 7f351b400700 1 -- 172.21.15.2:0/1896803228 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3528019030 con 0x55a375e95300 2024-06-13T11:25:07.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.990+0000 7f351b400700 1 -- 172.21.15.2:0/1896803228 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35280092e0 con 0x55a375e95300 2024-06-13T11:25:07.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.990+0000 7f351b400700 1 -- 172.21.15.2:0/1896803228 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3528007500 con 0x55a375e95300 2024-06-13T11:25:07.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.991+0000 7f353f457b80 1 -- 172.21.15.2:0/1896803228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e95300 msgr2=0x55a375e976f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:07.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.991+0000 7f353f457b80 1 --2- 172.21.15.2:0/1896803228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e95300 0x55a375e976f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3528009c10 tx=0x7f3528009920 comp rx=0 tx=0).stop 2024-06-13T11:25:07.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.991+0000 7f353f457b80 1 -- 172.21.15.2:0/1896803228 shutdown_connections 2024-06-13T11:25:07.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.991+0000 7f353f457b80 1 --2- 172.21.15.2:0/1896803228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e95300 0x55a375e976f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.991+0000 7f353f457b80 1 --2- 172.21.15.2:0/1896803228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 0x55a375e8a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.991+0000 7f353f457b80 1 --2- 172.21.15.2:0/1896803228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e8a5b0 0x55a375e8aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.991+0000 7f353f457b80 1 -- 172.21.15.2:0/1896803228 >> 172.21.15.2:0/1896803228 conn(0x55a375db7170 msgr2=0x55a375e864b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:07.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.991+0000 7f353f457b80 1 -- 172.21.15.2:0/1896803228 shutdown_connections 2024-06-13T11:25:07.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.991+0000 7f353f457b80 1 -- 172.21.15.2:0/1896803228 wait complete. 2024-06-13T11:25:07.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.991+0000 7f353f457b80 1 -- start start 2024-06-13T11:25:07.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.992+0000 7f353f457b80 1 Processor -- start 2024-06-13T11:25:07.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.992+0000 7f353f457b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e06e40 0x55a375e949e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:07.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.992+0000 7f353f457b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e8a5b0 0x55a375e91ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:07.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.992+0000 7f353f457b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e95300 0x55a375e92220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:07.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.992+0000 7f353f457b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a375d78f60 con 0x55a375e06e40 2024-06-13T11:25:07.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.992+0000 7f353f457b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a375dd8ac0 con 0x55a375e8a5b0 2024-06-13T11:25:07.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.992+0000 7f353f457b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a375e97fc0 con 0x55a375e95300 2024-06-13T11:25:07.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.992+0000 7f353f457b80 10 client.0 _ll_register_callbacks cb 0x55a375d76720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:07.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.993+0000 7f352de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e06e40 0x55a375e949e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.993+0000 7f352de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e06e40 0x55a375e949e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55830/0 (socket says 172.21.15.2:55830) 2024-06-13T11:25:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.993+0000 7f352de00700 1 -- 172.21.15.2:0/4127164057 learned_addr learned my addr 172.21.15.2:0/4127164057 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.993+0000 7f352d400700 1 --2- 172.21.15.2:0/4127164057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e8a5b0 0x55a375e91ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.993+0000 7f352e800700 1 --2- 172.21.15.2:0/4127164057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e95300 0x55a375e92220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.993+0000 7f352de00700 1 -- 172.21.15.2:0/4127164057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e95300 msgr2=0x55a375e92220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.993+0000 7f352de00700 1 --2- 172.21.15.2:0/4127164057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e95300 0x55a375e92220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.993+0000 7f352de00700 1 -- 172.21.15.2:0/4127164057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e8a5b0 msgr2=0x55a375e91ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.993+0000 7f352de00700 1 --2- 172.21.15.2:0/4127164057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e8a5b0 0x55a375e91ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.993+0000 7f352de00700 1 -- 172.21.15.2:0/4127164057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a375d2b8d0 con 0x55a375e06e40 2024-06-13T11:25:07.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.993+0000 7f352de00700 1 --2- 172.21.15.2:0/4127164057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e06e40 0x55a375e949e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f352009c360 tx=0x7f3520022870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02e75b213aaccf3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:07.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.993+0000 7f350fe00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:25:07.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.994+0000 7f350fe00700 1 -- 172.21.15.2:0/4127164057 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352009cad0 con 0x55a375e06e40 2024-06-13T11:25:07.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.994+0000 7f350fe00700 1 -- 172.21.15.2:0/4127164057 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f35200a4b20 con 0x55a375e06e40 2024-06-13T11:25:07.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.994+0000 7f353f457b80 1 -- 172.21.15.2:0/4127164057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35280092e0 con 0x55a375e06e40 2024-06-13T11:25:07.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.994+0000 7f350fe00700 1 -- 172.21.15.2:0/4127164057 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f352009c3d0 con 0x55a375e06e40 2024-06-13T11:25:07.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.994+0000 7f353f457b80 10 client.15312 fetch_fsmap learned FSMap version 27 2024-06-13T11:25:07.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.994+0000 7f353f457b80 1 -- 172.21.15.2:0/4127164057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a375ea2660 con 0x55a375e06e40 2024-06-13T11:25:07.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.994+0000 7f350fe00700 1 -- 172.21.15.2:0/4127164057 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35280092e0 con 0x55a375e06e40 2024-06-13T11:25:07.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.994+0000 7f350fe00700 1 -- 172.21.15.2:0/4127164057 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f35200cd920 con 0x55a375e06e40 2024-06-13T11:25:07.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.995+0000 7f353f457b80 10 client.15312 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:25:07.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.995+0000 7f353f457b80 10 client.15312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:25:07.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.995+0000 7f353f457b80 20 client.15312 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:07.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.995+0000 7f353f457b80 1 --2- 172.21.15.2:0/4127164057 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a375ea4b80 0x55a375ea7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:07.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.995+0000 7f353f457b80 4 client.15312 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:25:07.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.995+0000 7f353f457b80 1 -- 172.21.15.2:0/4127164057 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a375dea000 con 0x55a375ea4b80 2024-06-13T11:25:07.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.995+0000 7f352d400700 1 --2- 172.21.15.2:0/4127164057 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a375ea4b80 0x55a375ea7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:07.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.996+0000 7f352d400700 1 --2- 172.21.15.2:0/4127164057 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a375ea4b80 0x55a375ea7020 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1549c5e867998632 server_cookie=c059f715a37794b in_seq=0 out_seq=0 2024-06-13T11:25:07.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.996+0000 7f350fe00700 10 client.15312 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:07.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.996+0000 7f350fe00700 1 -- 172.21.15.2:0/4127164057 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a375dea000 con 0x55a375ea4b80 2024-06-13T11:25:07.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.996+0000 7f350fe00700 10 client.15312 handle_command_reply: tid=0 2024-06-13T11:25:07.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.997+0000 7f353f457b80 1 client.15312 shutdown 2024-06-13T11:25:07.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.997+0000 7f353f457b80 1 -- 172.21.15.2:0/4127164057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e06e40 msgr2=0x55a375e949e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:07.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.997+0000 7f353f457b80 1 --2- 172.21.15.2:0/4127164057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e06e40 0x55a375e949e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f352009c360 tx=0x7f3520022870 comp rx=0 tx=0).stop 2024-06-13T11:25:07.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.997+0000 7f353f457b80 1 -- 172.21.15.2:0/4127164057 shutdown_connections 2024-06-13T11:25:07.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.997+0000 7f353f457b80 1 --2- 172.21.15.2:0/4127164057 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a375ea4b80 0x55a375ea7020 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.997+0000 7f353f457b80 1 --2- 172.21.15.2:0/4127164057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e06e40 0x55a375e949e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.997+0000 7f353f457b80 1 --2- 172.21.15.2:0/4127164057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e95300 0x55a375e92220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.997+0000 7f353f457b80 1 --2- 172.21.15.2:0/4127164057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e8a5b0 0x55a375e91ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:07.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.997+0000 7f353f457b80 1 -- 172.21.15.2:0/4127164057 >> 172.21.15.2:0/4127164057 conn(0x55a375db7170 msgr2=0x55a375e85740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:07.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.997+0000 7f350fe00700 0 client.15312 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:07.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.997+0000 7f353f457b80 1 -- 172.21.15.2:0/4127164057 shutdown_connections 2024-06-13T11:25:07.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.997+0000 7f353f457b80 1 -- 172.21.15.2:0/4127164057 wait complete. 2024-06-13T11:25:07.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:07.997+0000 7f353f457b80 20 client.15312 trim_cache size 0 max 16384 2024-06-13T11:25:08.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.036+0000 7f353f457b80 1 Processor -- start 2024-06-13T11:25:08.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.036+0000 7f353f457b80 1 -- start start 2024-06-13T11:25:08.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.037+0000 7f353f457b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 0x55a375e90e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:08.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.037+0000 7f353f457b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e8a5b0 0x55a375e93c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:08.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.037+0000 7f353f457b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e95300 0x55a375e966f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:08.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.037+0000 7f353f457b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35301b2e20 con 0x55a375e95300 2024-06-13T11:25:08.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.037+0000 7f353f457b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f35301b06b0 con 0x55a375e8a5b0 2024-06-13T11:25:08.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.037+0000 7f353f457b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f35301ae500 con 0x55a375e06e40 2024-06-13T11:25:08.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.037+0000 7f352de00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 0x55a375e90e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:08.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.037+0000 7f352de00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 0x55a375e90e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49436/0 (socket says 172.21.15.2:49436) 2024-06-13T11:25:08.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.037+0000 7f352de00700 1 -- 172.21.15.2:0/2187908294 learned_addr learned my addr 172.21.15.2:0/2187908294 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.037+0000 7f352d400700 1 --2- 172.21.15.2:0/2187908294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e8a5b0 0x55a375e93c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.037+0000 7f352e800700 1 --2- 172.21.15.2:0/2187908294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e95300 0x55a375e966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.038+0000 7f352de00700 1 -- 172.21.15.2:0/2187908294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e8a5b0 msgr2=0x55a375e93c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.038+0000 7f352de00700 1 --2- 172.21.15.2:0/2187908294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e8a5b0 0x55a375e93c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.038+0000 7f352de00700 1 -- 172.21.15.2:0/2187908294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e95300 msgr2=0x55a375e966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.038+0000 7f352de00700 1 --2- 172.21.15.2:0/2187908294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e95300 0x55a375e966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.038+0000 7f352de00700 1 -- 172.21.15.2:0/2187908294 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a375e869f0 con 0x55a375e06e40 2024-06-13T11:25:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.038+0000 7f352e800700 1 --2- 172.21.15.2:0/2187908294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e95300 0x55a375e966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:25:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.038+0000 7f352de00700 1 --2- 172.21.15.2:0/2187908294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 0x55a375e90e60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3520098d50 tx=0x7f3520022930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dfafe681ac0fb4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.038+0000 7f351aa00700 1 -- 172.21.15.2:0/2187908294 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352009cad0 con 0x55a375e06e40 2024-06-13T11:25:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.038+0000 7f351aa00700 1 -- 172.21.15.2:0/2187908294 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35200a0780 con 0x55a375e06e40 2024-06-13T11:25:08.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.038+0000 7f351aa00700 1 -- 172.21.15.2:0/2187908294 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35200a4fb0 con 0x55a375e06e40 2024-06-13T11:25:08.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.039+0000 7f353f457b80 1 -- 172.21.15.2:0/2187908294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 msgr2=0x55a375e90e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:08.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.039+0000 7f353f457b80 1 --2- 172.21.15.2:0/2187908294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 0x55a375e90e60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3520098d50 tx=0x7f3520022930 comp rx=0 tx=0).stop 2024-06-13T11:25:08.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.039+0000 7f353f457b80 1 -- 172.21.15.2:0/2187908294 shutdown_connections 2024-06-13T11:25:08.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.039+0000 7f353f457b80 1 --2- 172.21.15.2:0/2187908294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e95300 0x55a375e966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:08.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.039+0000 7f353f457b80 1 --2- 172.21.15.2:0/2187908294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 0x55a375e90e60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:08.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.039+0000 7f353f457b80 1 --2- 172.21.15.2:0/2187908294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e8a5b0 0x55a375e93c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:08.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.039+0000 7f353f457b80 1 -- 172.21.15.2:0/2187908294 >> 172.21.15.2:0/2187908294 conn(0x55a375db7170 msgr2=0x55a375e93510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:08.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.040+0000 7f353f457b80 1 -- 172.21.15.2:0/2187908294 shutdown_connections 2024-06-13T11:25:08.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.040+0000 7f353f457b80 1 -- 172.21.15.2:0/2187908294 wait complete. 2024-06-13T11:25:08.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.040+0000 7f353f457b80 1 -- start start 2024-06-13T11:25:08.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.040+0000 7f353f457b80 1 Processor -- start 2024-06-13T11:25:08.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.041+0000 7f353f457b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 0x55a375e9d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:08.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.041+0000 7f353f457b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e8a5b0 0x55a375e9d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:08.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.041+0000 7f353f457b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e95300 0x55a375e8df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:08.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.041+0000 7f353f457b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35301aeb70 con 0x55a375e8a5b0 2024-06-13T11:25:08.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.041+0000 7f353f457b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f35301affe0 con 0x55a375e95300 2024-06-13T11:25:08.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.041+0000 7f353f457b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f35301af240 con 0x55a375e06e40 2024-06-13T11:25:08.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.041+0000 7f353f457b80 10 client.0 _ll_register_callbacks cb 0x55a375d76720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:08.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.042+0000 7f352d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e8a5b0 0x55a375e9d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.042+0000 7f352d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e8a5b0 0x55a375e9d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55848/0 (socket says 172.21.15.2:55848) 2024-06-13T11:25:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.042+0000 7f352d400700 1 -- 172.21.15.2:0/1905727573 learned_addr learned my addr 172.21.15.2:0/1905727573 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.042+0000 7f352de00700 1 --2- 172.21.15.2:0/1905727573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 0x55a375e9d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.042+0000 7f352e800700 1 --2- 172.21.15.2:0/1905727573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e95300 0x55a375e8df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.042+0000 7f352de00700 1 -- 172.21.15.2:0/1905727573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e95300 msgr2=0x55a375e8df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.042+0000 7f352de00700 1 --2- 172.21.15.2:0/1905727573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e95300 0x55a375e8df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.042+0000 7f352de00700 1 -- 172.21.15.2:0/1905727573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e8a5b0 msgr2=0x55a375e9d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.042+0000 7f352de00700 1 --2- 172.21.15.2:0/1905727573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e8a5b0 0x55a375e9d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.042+0000 7f352de00700 1 -- 172.21.15.2:0/1905727573 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a375e8e4e0 con 0x55a375e06e40 2024-06-13T11:25:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.042+0000 7f352d400700 1 --2- 172.21.15.2:0/1905727573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e8a5b0 0x55a375e9d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.042+0000 7f352e800700 1 --2- 172.21.15.2:0/1905727573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e95300 0x55a375e8df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.042+0000 7f352de00700 1 --2- 172.21.15.2:0/1905727573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 0x55a375e9d250 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f35200a4a80 tx=0x7f3520022870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=965f2a9daa539176 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.042+0000 7f350fe00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:25:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.043+0000 7f350fe00700 1 -- 172.21.15.2:0/1905727573 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352009cad0 con 0x55a375e06e40 2024-06-13T11:25:08.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.043+0000 7f350fe00700 1 -- 172.21.15.2:0/1905727573 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f35200cd920 con 0x55a375e06e40 2024-06-13T11:25:08.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.043+0000 7f353f457b80 1 -- 172.21.15.2:0/1905727573 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35200a0780 con 0x55a375e06e40 2024-06-13T11:25:08.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.043+0000 7f350fe00700 1 -- 172.21.15.2:0/1905727573 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f35200a4fb0 con 0x55a375e06e40 2024-06-13T11:25:08.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.043+0000 7f353f457b80 10 client.25453 fetch_fsmap learned FSMap version 27 2024-06-13T11:25:08.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.043+0000 7f353f457b80 1 -- 172.21.15.2:0/1905727573 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a375e8e4e0 con 0x55a375e06e40 2024-06-13T11:25:08.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.043+0000 7f350fe00700 1 -- 172.21.15.2:0/1905727573 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35200a0780 con 0x55a375e06e40 2024-06-13T11:25:08.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.044+0000 7f350fe00700 1 -- 172.21.15.2:0/1905727573 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f352000fa60 con 0x55a375e06e40 2024-06-13T11:25:08.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.044+0000 7f353f457b80 10 client.25453 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:25:08.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.044+0000 7f353f457b80 10 client.25453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:25:08.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.044+0000 7f353f457b80 20 client.25453 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:08.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.044+0000 7f353f457b80 1 --2- 172.21.15.2:0/1905727573 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a375e8fa00 0x55a375f128e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:08.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.044+0000 7f353f457b80 4 client.25453 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:25:08.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.044+0000 7f353f457b80 1 -- 172.21.15.2:0/1905727573 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a375de4580 con 0x55a375e8fa00 2024-06-13T11:25:08.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.044+0000 7f352d400700 1 --2- 172.21.15.2:0/1905727573 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a375e8fa00 0x55a375f128e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:08.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.045+0000 7f352d400700 1 --2- 172.21.15.2:0/1905727573 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a375e8fa00 0x55a375f128e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e4595db3bcdb930 server_cookie=3b78377bb5253e25 in_seq=0 out_seq=0 2024-06-13T11:25:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.045+0000 7f350fe00700 10 client.25453 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.045+0000 7f350fe00700 1 -- 172.21.15.2:0/1905727573 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a375de4580 con 0x55a375e8fa00 2024-06-13T11:25:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.045+0000 7f350fe00700 10 client.25453 handle_command_reply: tid=0 2024-06-13T11:25:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.045+0000 7f353f457b80 1 client.25453 shutdown 2024-06-13T11:25:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.045+0000 7f353f457b80 1 -- 172.21.15.2:0/1905727573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 msgr2=0x55a375e9d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.045+0000 7f353f457b80 1 --2- 172.21.15.2:0/1905727573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 0x55a375e9d250 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f35200a4a80 tx=0x7f3520022870 comp rx=0 tx=0).stop 2024-06-13T11:25:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.045+0000 7f353f457b80 1 -- 172.21.15.2:0/1905727573 shutdown_connections 2024-06-13T11:25:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.045+0000 7f353f457b80 1 --2- 172.21.15.2:0/1905727573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a375e95300 0x55a375e8df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.045+0000 7f353f457b80 1 --2- 172.21.15.2:0/1905727573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a375e06e40 0x55a375e9d250 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.045+0000 7f353f457b80 1 --2- 172.21.15.2:0/1905727573 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a375e8fa00 0x55a375f128e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.045+0000 7f353f457b80 1 --2- 172.21.15.2:0/1905727573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a375e8a5b0 0x55a375e9d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.045+0000 7f350fe00700 0 client.25453 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.045+0000 7f353f457b80 1 -- 172.21.15.2:0/1905727573 >> 172.21.15.2:0/1905727573 conn(0x55a375db7170 msgr2=0x55a375e85740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:08.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.046+0000 7f353f457b80 1 -- 172.21.15.2:0/1905727573 shutdown_connections 2024-06-13T11:25:08.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.046+0000 7f353f457b80 1 -- 172.21.15.2:0/1905727573 wait complete. 2024-06-13T11:25:08.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.046+0000 7f353f457b80 20 client.25453 trim_cache size 0 max 16384 2024-06-13T11:25:08.048 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:25:08.048 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-06-13T11:25:08.048 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-06-13T11:25:08.048 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:25:08.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.046+0000 7f3534a00700 1 -- 172.21.15.2:0/2236086965 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f35140a2eb0 msgr2=0x7f35140a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:08.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.046+0000 7f3534a00700 1 --2- 172.21.15.2:0/2236086965 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f35140a2eb0 0x7f35140a5370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f353010f770 tx=0x7f351c009260 comp rx=0 tx=0).stop 2024-06-13T11:25:08.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.047+0000 7f3534a00700 1 -- 172.21.15.2:0/2236086965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3530102740 msgr2=0x7f353019add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:08.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.047+0000 7f3534a00700 1 --2- 172.21.15.2:0/2236086965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3530102740 0x7f353019add0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f35200098e0 tx=0x7f3520005f10 comp rx=0 tx=0).stop 2024-06-13T11:25:08.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.047+0000 7f3534a00700 1 -- 172.21.15.2:0/2236086965 shutdown_connections 2024-06-13T11:25:08.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.047+0000 7f3534a00700 1 --2- 172.21.15.2:0/2236086965 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f35140a2eb0 0x7f35140a5370 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:08.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.047+0000 7f3534a00700 1 --2- 172.21.15.2:0/2236086965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3530107840 0x7f353019f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:08.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.047+0000 7f3534a00700 1 --2- 172.21.15.2:0/2236086965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3530102740 0x7f353019add0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:08.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.047+0000 7f3534a00700 1 --2- 172.21.15.2:0/2236086965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35301030f0 0x7f353019b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:08.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.047+0000 7f3534a00700 1 -- 172.21.15.2:0/2236086965 >> 172.21.15.2:0/2236086965 conn(0x7f35300795f0 msgr2=0x7f3530101c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:08.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.047+0000 7f3534a00700 1 -- 172.21.15.2:0/2236086965 shutdown_connections 2024-06-13T11:25:08.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:08.047+0000 7f3534a00700 1 -- 172.21.15.2:0/2236086965 wait complete. 2024-06-13T11:25:08.550 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 57% (7183/12572) Updating files: 58% (7292/12572) Updating files: 59% (7418/12572) Updating files: 60% (7544/12572) Updating files: 61% (7669/12572) Updating files: 62% (7795/12572) Updating files: 63% (7921/12572) Updating files: 64% (8047/12572) Updating files: 65% (8172/12572) Updating files: 66% (8298/12572) Updating files: 67% (8424/12572) Updating files: 68% (8549/12572) Updating files: 69% (8675/12572) Updating files: 70% (8801/12572) Updating files: 71% (8927/12572) Updating files: 72% (9052/12572) Updating files: 73% (9178/12572) Updating files: 74% (9304/12572) Updating files: 75% (9429/12572) Updating files: 76% (9555/12572) Updating files: 77% (9681/12572) Updating files: 78% (9807/12572) Updating files: 79% (9932/12572) Updating files: 80% (10058/12572) Updating files: 81% (10184/12572) Updating files: 82% (10310/12572) Updating files: 83% (10435/12572) Updating files: 84% (10561/12572) Updating files: 85% (10687/12572) Updating files: 86% (10812/12572) Updating files: 87% (10938/12572) Updating files: 88% (11064/12572) Updating files: 89% (11190/12572) Updating files: 90% (11315/12572) Updating files: 90% (11323/12572) Updating files: 91% (11441/12572) Updating files: 92% (11567/12572) Updating files: 93% (11692/12572) Updating files: 94% (11818/12572) Updating files: 95% (11944/12572) Updating files: 96% (12070/12572) Updating files: 97% (12195/12572) Updating files: 98% (12321/12572) Updating files: 99% (12447/12572) Updating files: 100% (12572/12572) Updating files: 100% (12572/12572), done. 2024-06-13T11:25:09.098 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-13T11:25:09.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:25:09.336 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to '1373963c202323287783ccb099bbae1ec8f14a5d'. 2024-06-13T11:25:09.336 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T11:25:09.336 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-13T11:25:09.336 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-13T11:25:09.336 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-06-13T11:25:09.336 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T11:25:09.336 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-13T11:25:09.337 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-13T11:25:09.337 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T11:25:09.337 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-06-13T11:25:09.337 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T11:25:09.337 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-06-13T11:25:09.337 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T11:25:09.337 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-06-13T11:25:09.337 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T11:25:09.337 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-13T11:25:09.337 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T11:25:09.337 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at 1373963c202 Merge pull request #56700 from joscollin/wip-65318-squid 2024-06-13T11:25:09.347 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-06-13T11:25:09.394 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-06-13T11:25:09.400 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-13T11:25:09.401 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-06-13T11:25:09.523 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:25:09.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:09 smithi178 ceph-mon[36913]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-06-13T11:25:09.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:09 smithi002 ceph-mon[32210]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-06-13T11:25:09.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:09 smithi077 ceph-mon[36410]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-06-13T11:25:11.096 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-06-13T11:25:11.285 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-06-13T11:25:11.372 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-13T11:25:11.379 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-13T11:25:11.379 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-06-13T11:25:11.466 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-13T11:25:11.475 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:25:11.475 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-06-13T11:25:11.520 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-06-13T11:25:11.522 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-06-13T11:25:11.522 DEBUG:teuthology.orchestra.run.smithi002:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1373963c202323287783ccb099bbae1ec8f14a5d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-06-13T11:25:11.638 INFO:tasks.workunit.client.0.smithi002.stderr:+ set -e 2024-06-13T11:25:11.638 INFO:tasks.workunit.client.0.smithi002.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-06-13T11:25:11.645 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into 'xfstests-dev'... 2024-06-13T11:25:11.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:11 smithi178 ceph-mon[36913]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:25:11.733 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:11 smithi002 ceph-mon[32210]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:25:11.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:11 smithi077 ceph-mon[36410]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:25:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.043+0000 7fba7c600700 1 -- 172.21.15.2:0/4201615259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba741024e0 msgr2=0x7fba74102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.043+0000 7fba7c600700 1 --2- 172.21.15.2:0/4201615259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba741024e0 0x7fba74102940 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fba60009990 tx=0x7fba60009ca0 comp rx=0 tx=0).stop 2024-06-13T11:25:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.043+0000 7fba7c600700 1 -- 172.21.15.2:0/4201615259 shutdown_connections 2024-06-13T11:25:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.043+0000 7fba7c600700 1 --2- 172.21.15.2:0/4201615259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba74102e80 0x7fba7410f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.044+0000 7fba7c600700 1 --2- 172.21.15.2:0/4201615259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba74108650 0x7fba74108a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.044+0000 7fba7c600700 1 --2- 172.21.15.2:0/4201615259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba741024e0 0x7fba74102940 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.044+0000 7fba7c600700 1 -- 172.21.15.2:0/4201615259 >> 172.21.15.2:0/4201615259 conn(0x7fba740795f0 msgr2=0x7fba74079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.044+0000 7fba7c600700 1 -- 172.21.15.2:0/4201615259 shutdown_connections 2024-06-13T11:25:12.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.044+0000 7fba7c600700 1 -- 172.21.15.2:0/4201615259 wait complete. 2024-06-13T11:25:12.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.045+0000 7fba7c600700 1 Processor -- start 2024-06-13T11:25:12.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.045+0000 7fba7c600700 1 -- start start 2024-06-13T11:25:12.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba7c600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba741024e0 0x7fba74074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:12.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba7c600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba74102e80 0x7fba74074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:12.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba7c600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba74108650 0x7fba74075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:12.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba7c600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fba74112810 con 0x7fba74102e80 2024-06-13T11:25:12.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba7c600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fba74112690 con 0x7fba74108650 2024-06-13T11:25:12.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba7c600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fba74112990 con 0x7fba741024e0 2024-06-13T11:25:12.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba79c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba741024e0 0x7fba74074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:12.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba79200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba74102e80 0x7fba74074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:12.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba79c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba741024e0 0x7fba74074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49464/0 (socket says 172.21.15.2:49464) 2024-06-13T11:25:12.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba79c00700 1 -- 172.21.15.2:0/4174940090 learned_addr learned my addr 172.21.15.2:0/4174940090 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:12.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba7a600700 1 --2- 172.21.15.2:0/4174940090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba74108650 0x7fba74075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:12.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba79c00700 1 -- 172.21.15.2:0/4174940090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba74108650 msgr2=0x7fba74075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:12.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba79c00700 1 --2- 172.21.15.2:0/4174940090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba74108650 0x7fba74075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:12.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba79c00700 1 -- 172.21.15.2:0/4174940090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba74102e80 msgr2=0x7fba74074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:12.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba79c00700 1 --2- 172.21.15.2:0/4174940090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba74102e80 0x7fba74074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:12.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba79c00700 1 -- 172.21.15.2:0/4174940090 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba741a7190 con 0x7fba741024e0 2024-06-13T11:25:12.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.046+0000 7fba7a600700 1 --2- 172.21.15.2:0/4174940090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba74108650 0x7fba74075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:25:12.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.047+0000 7fba79c00700 1 --2- 172.21.15.2:0/4174940090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba741024e0 0x7fba74074790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fba6800e9c0 tx=0x7fba6800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:12.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.047+0000 7fba72000700 1 -- 172.21.15.2:0/4174940090 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6800cbd0 con 0x7fba741024e0 2024-06-13T11:25:12.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.047+0000 7fba7c600700 1 -- 172.21.15.2:0/4174940090 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba741a7480 con 0x7fba741024e0 2024-06-13T11:25:12.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.047+0000 7fba7c600700 1 -- 172.21.15.2:0/4174940090 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba741a79c0 con 0x7fba741024e0 2024-06-13T11:25:12.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.047+0000 7fba72000700 1 -- 172.21.15.2:0/4174940090 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba6800cd70 con 0x7fba741024e0 2024-06-13T11:25:12.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.047+0000 7fba72000700 1 -- 172.21.15.2:0/4174940090 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba680056c0 con 0x7fba741024e0 2024-06-13T11:25:12.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.048+0000 7fba7c600700 1 -- 172.21.15.2:0/4174940090 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba74069180 con 0x7fba741024e0 2024-06-13T11:25:12.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.050+0000 7fba72000700 1 -- 172.21.15.2:0/4174940090 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138065+0+0 (secure 0 0 0) 0x7fba68004750 con 0x7fba741024e0 2024-06-13T11:25:12.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.052+0000 7fba72000700 1 --2- 172.21.15.2:0/4174940090 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fba5c0a2f30 0x7fba5c0a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:12.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.052+0000 7fba72000700 1 -- 172.21.15.2:0/4174940090 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fba680cffe0 con 0x7fba741024e0 2024-06-13T11:25:12.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.052+0000 7fba79200700 1 --2- 172.21.15.2:0/4174940090 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fba5c0a2f30 0x7fba5c0a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:12.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.053+0000 7fba79200700 1 --2- 172.21.15.2:0/4174940090 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fba5c0a2f30 0x7fba5c0a53f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fba74079c60 tx=0x7fba6000b260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:12.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.054+0000 7fba72000700 1 -- 172.21.15.2:0/4174940090 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fba6809c620 con 0x7fba741024e0 2024-06-13T11:25:12.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.335+0000 7fba7c600700 1 -- 172.21.15.2:0/4174940090 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba74075cc0 con 0x7fba741024e0 2024-06-13T11:25:12.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.336+0000 7fba72000700 1 -- 172.21.15.2:0/4174940090 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11853 (secure 0 0 0) 0x7fba6809bf20 con 0x7fba741024e0 2024-06-13T11:25:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:25:12.335 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:23:44.392864+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24493,24509,24511]},"id":1}]} 2024-06-13T11:25:12.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.341+0000 7fba7c600700 1 -- 172.21.15.2:0/4174940090 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fba5c0a2f30 msgr2=0x7fba5c0a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:12.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.341+0000 7fba7c600700 1 --2- 172.21.15.2:0/4174940090 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fba5c0a2f30 0x7fba5c0a53f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fba74079c60 tx=0x7fba6000b260 comp rx=0 tx=0).stop 2024-06-13T11:25:12.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.341+0000 7fba7c600700 1 -- 172.21.15.2:0/4174940090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba741024e0 msgr2=0x7fba74074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:12.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.341+0000 7fba7c600700 1 --2- 172.21.15.2:0/4174940090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba741024e0 0x7fba74074790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fba6800e9c0 tx=0x7fba6800ecd0 comp rx=0 tx=0).stop 2024-06-13T11:25:12.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.342+0000 7fba7c600700 1 -- 172.21.15.2:0/4174940090 shutdown_connections 2024-06-13T11:25:12.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.342+0000 7fba7c600700 1 --2- 172.21.15.2:0/4174940090 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fba5c0a2f30 0x7fba5c0a53f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:12.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.342+0000 7fba7c600700 1 --2- 172.21.15.2:0/4174940090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba74108650 0x7fba74075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:12.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.342+0000 7fba7c600700 1 --2- 172.21.15.2:0/4174940090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba741024e0 0x7fba74074790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:12.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.342+0000 7fba7c600700 1 --2- 172.21.15.2:0/4174940090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba74102e80 0x7fba74074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:12.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.342+0000 7fba7c600700 1 -- 172.21.15.2:0/4174940090 >> 172.21.15.2:0/4174940090 conn(0x7fba740795f0 msgr2=0x7fba74101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:12.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.342+0000 7fba7c600700 1 -- 172.21.15.2:0/4174940090 shutdown_connections 2024-06-13T11:25:12.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:12.342+0000 7fba7c600700 1 -- 172.21.15.2:0/4174940090 wait complete. 2024-06-13T11:25:12.343 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-06-13T11:25:12.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:12 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/4174940090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:25:12.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:12 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/4174940090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:25:12.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:12 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/4174940090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:25:13.250 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-13T11:25:13.741 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:25:13.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:13 smithi077 ceph-mon[36410]: pgmap v46: 129 pgs: 129 active+clean; 1.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-06-13T11:25:13.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:13 smithi002 ceph-mon[32210]: pgmap v46: 129 pgs: 129 active+clean; 1.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-06-13T11:25:13.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:13 smithi178 ceph-mon[36913]: pgmap v46: 129 pgs: 129 active+clean; 1.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-06-13T11:25:15.727 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:15 smithi002 ceph-mon[32210]: pgmap v47: 129 pgs: 129 active+clean; 1.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-06-13T11:25:15.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:15 smithi077 ceph-mon[36410]: pgmap v47: 129 pgs: 129 active+clean; 1.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-06-13T11:25:15.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:15 smithi178 ceph-mon[36913]: pgmap v47: 129 pgs: 129 active+clean; 1.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-06-13T11:25:16.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.029+0000 7f55bba00700 1 -- 172.21.15.2:0/38232586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55b406ab10 msgr2=0x7f55b410f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:16.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.029+0000 7f55bba00700 1 --2- 172.21.15.2:0/38232586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55b406ab10 0x7f55b410f320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00b0d0 tx=0x7f55ac00b3e0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.029+0000 7f55bba00700 1 -- 172.21.15.2:0/38232586 shutdown_connections 2024-06-13T11:25:16.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.029+0000 7f55bba00700 1 --2- 172.21.15.2:0/38232586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55b406ab10 0x7f55b410f320 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.030+0000 7f55bba00700 1 --2- 172.21.15.2:0/38232586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b41084e0 0x7f55b41088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.030+0000 7f55bba00700 1 --2- 172.21.15.2:0/38232586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55b406a170 0x7f55b406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.030+0000 7f55bba00700 1 -- 172.21.15.2:0/38232586 >> 172.21.15.2:0/38232586 conn(0x7f55b40782c0 msgr2=0x7f55b40786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:16.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.030+0000 7f55bba00700 1 -- 172.21.15.2:0/38232586 shutdown_connections 2024-06-13T11:25:16.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.030+0000 7f55bba00700 1 -- 172.21.15.2:0/38232586 wait complete. 2024-06-13T11:25:16.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.031+0000 7f55bba00700 1 Processor -- start 2024-06-13T11:25:16.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.032+0000 7f55bba00700 1 -- start start 2024-06-13T11:25:16.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.032+0000 7f55bba00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55b406a170 0x7f55b419ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.032+0000 7f55bba00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55b406ab10 0x7f55b419b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.032+0000 7f55bba00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b41084e0 0x7f55b419f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.032+0000 7f55bba00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f55b4112780 con 0x7f55b406ab10 2024-06-13T11:25:16.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.032+0000 7f55bba00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f55b4112600 con 0x7f55b406a170 2024-06-13T11:25:16.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.032+0000 7f55bba00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f55b4112900 con 0x7f55b41084e0 2024-06-13T11:25:16.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.032+0000 7f55b3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55b406ab10 0x7f55b419b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.032+0000 7f55b9000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55b406a170 0x7f55b419ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.033+0000 7f55b3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55b406ab10 0x7f55b419b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39754/0 (socket says 172.21.15.2:39754) 2024-06-13T11:25:16.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.033+0000 7f55b9000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55b406a170 0x7f55b419ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:53646/0 (socket says 172.21.15.2:53646) 2024-06-13T11:25:16.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.033+0000 7f55b3e00700 1 -- 172.21.15.2:0/1422560641 learned_addr learned my addr 172.21.15.2:0/1422560641 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:16.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.033+0000 7f55b9a00700 1 --2- 172.21.15.2:0/1422560641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b41084e0 0x7f55b419f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.033+0000 7f55b9000700 1 -- 172.21.15.2:0/1422560641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b41084e0 msgr2=0x7f55b419f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:16.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.033+0000 7f55b9000700 1 --2- 172.21.15.2:0/1422560641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b41084e0 0x7f55b419f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.033+0000 7f55b9000700 1 -- 172.21.15.2:0/1422560641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55b406ab10 msgr2=0x7f55b419b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:16.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.033+0000 7f55b9000700 1 --2- 172.21.15.2:0/1422560641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55b406ab10 0x7f55b419b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.033+0000 7f55b9000700 1 -- 172.21.15.2:0/1422560641 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b419fdb0 con 0x7f55b406a170 2024-06-13T11:25:16.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.033+0000 7f55b9a00700 1 --2- 172.21.15.2:0/1422560641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b41084e0 0x7f55b419f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:16.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.033+0000 7f55b9000700 1 --2- 172.21.15.2:0/1422560641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55b406a170 0x7f55b419ada0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f55a800e9f0 tx=0x7f55a800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.034+0000 7f55b1600700 1 -- 172.21.15.2:0/1422560641 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a800c9c0 con 0x7f55b406a170 2024-06-13T11:25:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.034+0000 7f55b1600700 1 -- 172.21.15.2:0/1422560641 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55a800cb60 con 0x7f55b406a170 2024-06-13T11:25:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.034+0000 7f55b1600700 1 -- 172.21.15.2:0/1422560641 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a8018680 con 0x7f55b406a170 2024-06-13T11:25:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.034+0000 7f55bba00700 1 -- 172.21.15.2:0/1422560641 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55b41a00a0 con 0x7f55b406a170 2024-06-13T11:25:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.034+0000 7f55bba00700 1 -- 172.21.15.2:0/1422560641 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55b41a7920 con 0x7f55b406a170 2024-06-13T11:25:16.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.038+0000 7f55b1600700 1 -- 172.21.15.2:0/1422560641 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) ==== 138065+0+0 (secure 0 0 0) 0x7f55a8010430 con 0x7f55b406a170 2024-06-13T11:25:16.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.039+0000 7f55c62c6b80 1 Processor -- start 2024-06-13T11:25:16.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.040+0000 7f55c62c6b80 1 -- start start 2024-06-13T11:25:16.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.040+0000 7f55b1600700 1 --2- 172.21.15.2:0/1422560641 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f559c0a2f30 0x7f559c0a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.040+0000 7f55b1600700 1 -- 172.21.15.2:0/1422560641 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f55a80cfad0 con 0x7f55b406a170 2024-06-13T11:25:16.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.040+0000 7f55c62c6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d0fb90 0x5576e0d0ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.040+0000 7f55c62c6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d104b0 0x5576e0d09d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.040+0000 7f55b9a00700 1 --2- 172.21.15.2:0/1422560641 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f559c0a2f30 0x7f559c0a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.040+0000 7f55c62c6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d0a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.040+0000 7f55c62c6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5576e0c18a10 con 0x5576e0d104b0 2024-06-13T11:25:16.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.040+0000 7f55c62c6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5576e0c5bb00 con 0x5576e0d0a240 2024-06-13T11:25:16.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.040+0000 7f55c62c6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5576e0c168f0 con 0x5576e0d0fb90 2024-06-13T11:25:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.041+0000 7f55b3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d104b0 0x5576e0d09d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.041+0000 7f55b9a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d0a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.041+0000 7f55b9000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d0fb90 0x5576e0d0ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.041+0000 7f55b3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d104b0 0x5576e0d09d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39768/0 (socket says 172.21.15.2:39768) 2024-06-13T11:25:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.041+0000 7f55b9a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d0a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:53662/0 (socket says 172.21.15.2:53662) 2024-06-13T11:25:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.041+0000 7f55b3e00700 1 -- 172.21.15.2:0/3034391175 learned_addr learned my addr 172.21.15.2:0/3034391175 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.041+0000 7f55b9000700 1 -- 172.21.15.2:0/3034391175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 msgr2=0x5576e0d0a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.041+0000 7f55b9000700 1 --2- 172.21.15.2:0/3034391175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d0a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.041+0000 7f55b9000700 1 -- 172.21.15.2:0/3034391175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d104b0 msgr2=0x5576e0d09d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.041+0000 7f55b9000700 1 --2- 172.21.15.2:0/3034391175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d104b0 0x5576e0d09d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.041+0000 7f55b9000700 1 -- 172.21.15.2:0/3034391175 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576e0c03f90 con 0x5576e0d0fb90 2024-06-13T11:25:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.042+0000 7f55b9a00700 1 --2- 172.21.15.2:0/1422560641 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f559c0a2f30 0x7f559c0a53f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009fd0 tx=0x7f55ac009ce0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:16.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.042+0000 7f55b9000700 1 --2- 172.21.15.2:0/3034391175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d0fb90 0x5576e0d0ff70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f55a80cccd0 tx=0x7f55a8097da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aff6061d42419eb6 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:16.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.042+0000 7f55a6000700 1 -- 172.21.15.2:0/3034391175 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a809b9d0 con 0x5576e0d0fb90 2024-06-13T11:25:16.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.042+0000 7f55a6000700 1 -- 172.21.15.2:0/3034391175 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55a809fd80 con 0x5576e0d0fb90 2024-06-13T11:25:16.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.042+0000 7f55a6000700 1 -- 172.21.15.2:0/3034391175 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a80ccfb0 con 0x5576e0d0fb90 2024-06-13T11:25:16.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.043+0000 7f55c62c6b80 1 -- 172.21.15.2:0/3034391175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d0fb90 msgr2=0x5576e0d0ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:16.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.043+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/3034391175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d0fb90 0x5576e0d0ff70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f55a80cccd0 tx=0x7f55a8097da0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.043+0000 7f55c62c6b80 1 -- 172.21.15.2:0/3034391175 shutdown_connections 2024-06-13T11:25:16.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.043+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/3034391175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d0a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.043+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/3034391175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d0fb90 0x5576e0d0ff70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.043+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/3034391175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d104b0 0x5576e0d09d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.043+0000 7f55c62c6b80 1 -- 172.21.15.2:0/3034391175 >> 172.21.15.2:0/3034391175 conn(0x5576e0c36170 msgr2=0x5576e0d04ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:16.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.043+0000 7f55c62c6b80 1 -- 172.21.15.2:0/3034391175 shutdown_connections 2024-06-13T11:25:16.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.043+0000 7f55c62c6b80 1 -- 172.21.15.2:0/3034391175 wait complete. 2024-06-13T11:25:16.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.044+0000 7f55c62c6b80 1 -- start start 2024-06-13T11:25:16.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.044+0000 7f55c62c6b80 1 Processor -- start 2024-06-13T11:25:16.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55c62c6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d16200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55c62c6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d0fb90 0x5576e0d13500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55c62c6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d104b0 0x5576e0d13a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55c62c6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5576e0bf7f60 con 0x5576e0d0fb90 2024-06-13T11:25:16.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55c62c6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5576e0c57ac0 con 0x5576e0d0a240 2024-06-13T11:25:16.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55c62c6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5576e0d16dd0 con 0x5576e0d104b0 2024-06-13T11:25:16.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55c62c6b80 10 client.0 _ll_register_callbacks cb 0x5576e0bf1380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:16.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55b3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d0fb90 0x5576e0d13500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55b9000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d16200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55b9a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d104b0 0x5576e0d13a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55b3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d0fb90 0x5576e0d13500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39776/0 (socket says 172.21.15.2:39776) 2024-06-13T11:25:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55b9a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d104b0 0x5576e0d13a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56542/0 (socket says 172.21.15.2:56542) 2024-06-13T11:25:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55b9000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d16200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:53664/0 (socket says 172.21.15.2:53664) 2024-06-13T11:25:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55b3e00700 1 -- 172.21.15.2:0/3021075436 learned_addr learned my addr 172.21.15.2:0/3021075436 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55b9000700 1 -- 172.21.15.2:0/3021075436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d104b0 msgr2=0x5576e0d13a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55b9000700 1 --2- 172.21.15.2:0/3021075436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d104b0 0x5576e0d13a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55b9000700 1 -- 172.21.15.2:0/3021075436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d0fb90 msgr2=0x5576e0d13500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.045+0000 7f55b9000700 1 --2- 172.21.15.2:0/3021075436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d0fb90 0x5576e0d13500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.046+0000 7f55b9000700 1 -- 172.21.15.2:0/3021075436 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576e0baa8d0 con 0x5576e0d0a240 2024-06-13T11:25:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.046+0000 7f55b3e00700 1 --2- 172.21.15.2:0/3021075436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d0fb90 0x5576e0d13500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.046+0000 7f55b9000700 1 --2- 172.21.15.2:0/3021075436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d16200 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f55a809b810 tx=0x7f55a809b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eebd8ec682de9fe7 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.046+0000 7f559aa00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:25:16.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.046+0000 7f559aa00700 1 -- 172.21.15.2:0/3021075436 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a80b3020 con 0x5576e0d0a240 2024-06-13T11:25:16.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.046+0000 7f559aa00700 1 -- 172.21.15.2:0/3021075436 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f55a80ccfb0 con 0x5576e0d0a240 2024-06-13T11:25:16.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.046+0000 7f55c62c6b80 1 -- 172.21.15.2:0/3021075436 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55a809fd80 con 0x5576e0d0a240 2024-06-13T11:25:16.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.047+0000 7f559aa00700 1 -- 172.21.15.2:0/3021075436 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f55a809b9d0 con 0x5576e0d0a240 2024-06-13T11:25:16.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.047+0000 7f55c62c6b80 10 client.25439 fetch_fsmap learned FSMap version 27 2024-06-13T11:25:16.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.047+0000 7f55c62c6b80 1 -- 172.21.15.2:0/3021075436 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5576e0d21500 con 0x5576e0d0a240 2024-06-13T11:25:16.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.047+0000 7f559aa00700 1 -- 172.21.15.2:0/3021075436 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55a809fd80 con 0x5576e0d0a240 2024-06-13T11:25:16.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.047+0000 7f559aa00700 1 -- 172.21.15.2:0/3021075436 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f55a80860b0 con 0x5576e0d0a240 2024-06-13T11:25:16.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.047+0000 7f55c62c6b80 10 client.25439 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:25:16.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.047+0000 7f55c62c6b80 10 client.25439 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:25:16.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.047+0000 7f55c62c6b80 20 client.25439 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:16.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.047+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/3021075436 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5576e0d239d0 0x5576e0d25dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.047+0000 7f55c62c6b80 4 client.25439 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:25:16.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.047+0000 7f55c62c6b80 1 -- 172.21.15.2:0/3021075436 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576e0c69000 con 0x5576e0d239d0 2024-06-13T11:25:16.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.048+0000 7f55b3e00700 1 --2- 172.21.15.2:0/3021075436 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5576e0d239d0 0x5576e0d25dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.048+0000 7f55b3e00700 1 --2- 172.21.15.2:0/3021075436 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5576e0d239d0 0x5576e0d25dc0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=94abc3b05ecc4690 server_cookie=490d6182f6c58a66 in_seq=0 out_seq=0 2024-06-13T11:25:16.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.048+0000 7f559aa00700 10 client.25439 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:25:16.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.049+0000 7f559aa00700 1 -- 172.21.15.2:0/3021075436 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5576e0c69000 con 0x5576e0d239d0 2024-06-13T11:25:16.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.049+0000 7f559aa00700 10 client.25439 handle_command_reply: tid=0 2024-06-13T11:25:16.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.049+0000 7f55c62c6b80 1 client.25439 shutdown 2024-06-13T11:25:16.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.050+0000 7f55c62c6b80 1 -- 172.21.15.2:0/3021075436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 msgr2=0x5576e0d16200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:16.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.050+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/3021075436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d16200 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f55a809b810 tx=0x7f55a809b8d0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.050+0000 7f55c62c6b80 1 -- 172.21.15.2:0/3021075436 shutdown_connections 2024-06-13T11:25:16.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.050+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/3021075436 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5576e0d239d0 0x5576e0d25dc0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.050+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/3021075436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d104b0 0x5576e0d13a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.050+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/3021075436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d16200 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.050+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/3021075436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d0fb90 0x5576e0d13500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.050+0000 7f55c62c6b80 1 -- 172.21.15.2:0/3021075436 >> 172.21.15.2:0/3021075436 conn(0x5576e0c36170 msgr2=0x5576e0cfe790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:16.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.050+0000 7f559aa00700 0 client.25439 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:25:16.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.050+0000 7f55c62c6b80 1 -- 172.21.15.2:0/3021075436 shutdown_connections 2024-06-13T11:25:16.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.050+0000 7f55c62c6b80 1 -- 172.21.15.2:0/3021075436 wait complete. 2024-06-13T11:25:16.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.051+0000 7f55c62c6b80 20 client.25439 trim_cache size 0 max 16384 2024-06-13T11:25:16.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.068+0000 7f55c62c6b80 1 Processor -- start 2024-06-13T11:25:16.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.068+0000 7f55c62c6b80 1 -- start start 2024-06-13T11:25:16.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.068+0000 7f55c62c6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d09d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.068+0000 7f55c62c6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d0fb90 0x5576e0cff130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.068+0000 7f55c62c6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d104b0 0x5576e0d10fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.068+0000 7f55c62c6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f55b41b2f80 con 0x5576e0d104b0 2024-06-13T11:25:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.068+0000 7f55c62c6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f55b41b0810 con 0x5576e0d0a240 2024-06-13T11:25:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.068+0000 7f55c62c6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f55b41ae660 con 0x5576e0d0fb90 2024-06-13T11:25:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.069+0000 7f55b9a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d104b0 0x5576e0d10fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.069+0000 7f55b9000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d09d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.069+0000 7f55b9a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d104b0 0x5576e0d10fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39792/0 (socket says 172.21.15.2:39792) 2024-06-13T11:25:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.069+0000 7f55b9000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d09d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:53678/0 (socket says 172.21.15.2:53678) 2024-06-13T11:25:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.069+0000 7f55b9a00700 1 -- 172.21.15.2:0/1991714891 learned_addr learned my addr 172.21.15.2:0/1991714891 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:16.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.069+0000 7f55b3e00700 1 --2- 172.21.15.2:0/1991714891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d0fb90 0x5576e0cff130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.069+0000 7f55b9000700 1 -- 172.21.15.2:0/1991714891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d0fb90 msgr2=0x5576e0cff130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:16.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.069+0000 7f55b9000700 1 --2- 172.21.15.2:0/1991714891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d0fb90 0x5576e0cff130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.069+0000 7f55b9000700 1 -- 172.21.15.2:0/1991714891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d104b0 msgr2=0x5576e0d10fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.069+0000 7f55b9000700 1 --2- 172.21.15.2:0/1991714891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d104b0 0x5576e0d10fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.069+0000 7f55b9000700 1 -- 172.21.15.2:0/1991714891 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576e0d101c0 con 0x5576e0d0a240 2024-06-13T11:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.069+0000 7f55b9000700 1 --2- 172.21.15.2:0/1991714891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d09d00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f55a8099c80 tx=0x7f55a8086500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf878f31bbab10 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.070+0000 7f55a5600700 1 -- 172.21.15.2:0/1991714891 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a80b3070 con 0x5576e0d0a240 2024-06-13T11:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.070+0000 7f55a5600700 1 -- 172.21.15.2:0/1991714891 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55a80ccc10 con 0x5576e0d0a240 2024-06-13T11:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.070+0000 7f55a5600700 1 -- 172.21.15.2:0/1991714891 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a8086200 con 0x5576e0d0a240 2024-06-13T11:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.070+0000 7f55c62c6b80 1 -- 172.21.15.2:0/1991714891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 msgr2=0x5576e0d09d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.070+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/1991714891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d09d00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f55a8099c80 tx=0x7f55a8086500 comp rx=0 tx=0).stop 2024-06-13T11:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.071+0000 7f55c62c6b80 1 -- 172.21.15.2:0/1991714891 shutdown_connections 2024-06-13T11:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.071+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/1991714891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d104b0 0x5576e0d10fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.071+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/1991714891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0a240 0x5576e0d09d00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.071+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/1991714891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d0fb90 0x5576e0cff130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.071+0000 7f55c62c6b80 1 -- 172.21.15.2:0/1991714891 >> 172.21.15.2:0/1991714891 conn(0x5576e0c36170 msgr2=0x5576e0d10890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.071+0000 7f55c62c6b80 1 -- 172.21.15.2:0/1991714891 shutdown_connections 2024-06-13T11:25:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.071+0000 7f55c62c6b80 1 -- 172.21.15.2:0/1991714891 wait complete. 2024-06-13T11:25:16.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.071+0000 7f55c62c6b80 1 -- start start 2024-06-13T11:25:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.071+0000 7f55c62c6b80 1 Processor -- start 2024-06-13T11:25:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.072+0000 7f55c62c6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d0a240 0x5576e0d25dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.072+0000 7f55c62c6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0fb90 0x5576e0d26300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.072+0000 7f55c62c6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d104b0 0x5576e0d26840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.072+0000 7f55c62c6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f55b41aecd0 con 0x5576e0d0a240 2024-06-13T11:25:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.072+0000 7f55c62c6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f55b41b0140 con 0x5576e0d0fb90 2024-06-13T11:25:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.072+0000 7f55c62c6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f55b41af3a0 con 0x5576e0d104b0 2024-06-13T11:25:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.072+0000 7f55c62c6b80 10 client.0 _ll_register_callbacks cb 0x5576e0bf1380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.072+0000 7f55b9000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d0a240 0x5576e0d25dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.072+0000 7f55b3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0fb90 0x5576e0d26300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.072+0000 7f55b3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0fb90 0x5576e0d26300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:53684/0 (socket says 172.21.15.2:53684) 2024-06-13T11:25:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.072+0000 7f55b3e00700 1 -- 172.21.15.2:0/1386121732 learned_addr learned my addr 172.21.15.2:0/1386121732 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.073+0000 7f55b9a00700 1 --2- 172.21.15.2:0/1386121732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d104b0 0x5576e0d26840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.073+0000 7f55b3e00700 1 -- 172.21.15.2:0/1386121732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d104b0 msgr2=0x5576e0d26840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.073+0000 7f55b3e00700 1 --2- 172.21.15.2:0/1386121732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d104b0 0x5576e0d26840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.073+0000 7f55b3e00700 1 -- 172.21.15.2:0/1386121732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d0a240 msgr2=0x5576e0d25dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.073+0000 7f55b3e00700 1 --2- 172.21.15.2:0/1386121732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d0a240 0x5576e0d25dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.073+0000 7f55b3e00700 1 -- 172.21.15.2:0/1386121732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576e0d8c4b0 con 0x5576e0d0fb90 2024-06-13T11:25:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.073+0000 7f55b3e00700 1 --2- 172.21.15.2:0/1386121732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0fb90 0x5576e0d26300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f55a0000c00 tx=0x7f55a0010a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bda006d333c30356 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.073+0000 7f559aa00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:25:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.073+0000 7f559aa00700 1 -- 172.21.15.2:0/1386121732 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a0021070 con 0x5576e0d0fb90 2024-06-13T11:25:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.074+0000 7f55c62c6b80 1 -- 172.21.15.2:0/1386121732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55a80ccc10 con 0x5576e0d0fb90 2024-06-13T11:25:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.074+0000 7f559aa00700 1 -- 172.21.15.2:0/1386121732 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f55a0004220 con 0x5576e0d0fb90 2024-06-13T11:25:16.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.074+0000 7f559aa00700 1 -- 172.21.15.2:0/1386121732 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f55a002d050 con 0x5576e0d0fb90 2024-06-13T11:25:16.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.074+0000 7f55c62c6b80 10 client.25445 fetch_fsmap learned FSMap version 27 2024-06-13T11:25:16.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.074+0000 7f55c62c6b80 1 -- 172.21.15.2:0/1386121732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5576e0d8d7f0 con 0x5576e0d0fb90 2024-06-13T11:25:16.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.074+0000 7f559aa00700 1 -- 172.21.15.2:0/1386121732 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55a80ccc10 con 0x5576e0d0fb90 2024-06-13T11:25:16.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.074+0000 7f559aa00700 1 -- 172.21.15.2:0/1386121732 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f55a001da20 con 0x5576e0d0fb90 2024-06-13T11:25:16.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.074+0000 7f55c62c6b80 10 client.25445 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:25:16.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.074+0000 7f55c62c6b80 10 client.25445 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:25:16.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.074+0000 7f55c62c6b80 20 client.25445 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:16.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.074+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/1386121732 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5576e0d8df30 0x5576e0d90350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:16.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.075+0000 7f55c62c6b80 4 client.25445 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:25:16.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.075+0000 7f55c62c6b80 1 -- 172.21.15.2:0/1386121732 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5576e0c63580 con 0x5576e0d8df30 2024-06-13T11:25:16.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.075+0000 7f55b9000700 1 --2- 172.21.15.2:0/1386121732 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5576e0d8df30 0x5576e0d90350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:16.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.075+0000 7f55b9000700 1 --2- 172.21.15.2:0/1386121732 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5576e0d8df30 0x5576e0d90350 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=22d18a9bca804a76 server_cookie=f722e2a0ca11b52d in_seq=0 out_seq=0 2024-06-13T11:25:16.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.075+0000 7f559aa00700 10 client.25445 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:25:16.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.076+0000 7f559aa00700 1 -- 172.21.15.2:0/1386121732 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5576e0c63580 con 0x5576e0d8df30 2024-06-13T11:25:16.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.076+0000 7f559aa00700 10 client.25445 handle_command_reply: tid=0 2024-06-13T11:25:16.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.076+0000 7f55c62c6b80 1 client.25445 shutdown 2024-06-13T11:25:16.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.076+0000 7f55c62c6b80 1 -- 172.21.15.2:0/1386121732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0fb90 msgr2=0x5576e0d26300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:16.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.076+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/1386121732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0fb90 0x5576e0d26300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f55a0000c00 tx=0x7f55a0010a90 comp rx=0 tx=0).stop 2024-06-13T11:25:16.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.076+0000 7f55c62c6b80 1 -- 172.21.15.2:0/1386121732 shutdown_connections 2024-06-13T11:25:16.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.076+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/1386121732 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5576e0d8df30 0x5576e0d90350 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.076+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/1386121732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5576e0d0a240 0x5576e0d25dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.076+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/1386121732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5576e0d104b0 0x5576e0d26840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.076+0000 7f55c62c6b80 1 --2- 172.21.15.2:0/1386121732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5576e0d0fb90 0x5576e0d26300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.076+0000 7f559aa00700 0 client.25445 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:25:16.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.076+0000 7f55c62c6b80 1 -- 172.21.15.2:0/1386121732 >> 172.21.15.2:0/1386121732 conn(0x5576e0c36170 msgr2=0x5576e0d11df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:16.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.076+0000 7f55c62c6b80 1 -- 172.21.15.2:0/1386121732 shutdown_connections 2024-06-13T11:25:16.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.076+0000 7f55c62c6b80 1 -- 172.21.15.2:0/1386121732 wait complete. 2024-06-13T11:25:16.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.076+0000 7f55c62c6b80 20 client.25445 trim_cache size 0 max 16384 2024-06-13T11:25:16.079 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:25:16.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.077+0000 7f55bba00700 1 -- 172.21.15.2:0/1422560641 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f559c0a2f30 msgr2=0x7f559c0a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:16.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.077+0000 7f55bba00700 1 --2- 172.21.15.2:0/1422560641 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f559c0a2f30 0x7f559c0a53f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009fd0 tx=0x7f55ac009ce0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.077+0000 7f55bba00700 1 -- 172.21.15.2:0/1422560641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55b406a170 msgr2=0x7f55b419ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:16.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.077+0000 7f55bba00700 1 --2- 172.21.15.2:0/1422560641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55b406a170 0x7f55b419ada0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f55a800e9f0 tx=0x7f55a800ed00 comp rx=0 tx=0).stop 2024-06-13T11:25:16.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.077+0000 7f55bba00700 1 -- 172.21.15.2:0/1422560641 shutdown_connections 2024-06-13T11:25:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.077+0000 7f55bba00700 1 --2- 172.21.15.2:0/1422560641 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f559c0a2f30 0x7f559c0a53f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.077+0000 7f55bba00700 1 --2- 172.21.15.2:0/1422560641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b41084e0 0x7f55b419f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.077+0000 7f55bba00700 1 --2- 172.21.15.2:0/1422560641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55b406a170 0x7f55b419ada0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.077+0000 7f55bba00700 1 --2- 172.21.15.2:0/1422560641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55b406ab10 0x7f55b419b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.077+0000 7f55bba00700 1 -- 172.21.15.2:0/1422560641 >> 172.21.15.2:0/1422560641 conn(0x7f55b40782c0 msgr2=0x7f55b410d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.078+0000 7f55bba00700 1 -- 172.21.15.2:0/1422560641 shutdown_connections 2024-06-13T11:25:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:16.078+0000 7f55bba00700 1 -- 172.21.15.2:0/1422560641 wait complete. 2024-06-13T11:25:16.992 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-13T11:25:17.469 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:25:17.760 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:17 smithi002 ceph-mon[32210]: pgmap v48: 129 pgs: 129 active+clean; 1.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-06-13T11:25:17.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:17 smithi077 ceph-mon[36410]: pgmap v48: 129 pgs: 129 active+clean; 1.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-06-13T11:25:17.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:17 smithi178 ceph-mon[36913]: pgmap v48: 129 pgs: 129 active+clean; 1.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-06-13T11:25:19.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.748+0000 7f6a73200700 1 -- 172.21.15.2:0/2036637642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a7410ed60 msgr2=0x7f6a74111150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:19.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.748+0000 7f6a73200700 1 --2- 172.21.15.2:0/2036637642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a7410ed60 0x7f6a74111150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00b0a0 tx=0x7f6a6c00b3b0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.748+0000 7f6a73200700 1 -- 172.21.15.2:0/2036637642 shutdown_connections 2024-06-13T11:25:19.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.748+0000 7f6a73200700 1 --2- 172.21.15.2:0/2036637642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a7410ed60 0x7f6a74111150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.748+0000 7f6a73200700 1 --2- 172.21.15.2:0/2036637642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a74074a50 0x7f6a74074e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.748+0000 7f6a73200700 1 --2- 172.21.15.2:0/2036637642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a74075370 0x7f6a7410e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.748+0000 7f6a73200700 1 -- 172.21.15.2:0/2036637642 >> 172.21.15.2:0/2036637642 conn(0x7f6a740fde80 msgr2=0x7f6a741002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:19.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.748+0000 7f6a73200700 1 -- 172.21.15.2:0/2036637642 shutdown_connections 2024-06-13T11:25:19.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.748+0000 7f6a73200700 1 -- 172.21.15.2:0/2036637642 wait complete. 2024-06-13T11:25:19.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:19 smithi002 ceph-mon[32210]: pgmap v49: 129 pgs: 129 active+clean; 15 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-06-13T11:25:19.749 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:19 smithi002 ceph-mon[32210]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-06-13T11:25:19.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.749+0000 7f6a73200700 1 Processor -- start 2024-06-13T11:25:19.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.750+0000 7f6a73200700 1 -- start start 2024-06-13T11:25:19.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.750+0000 7f6a73200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a74074a50 0x7f6a7419ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.750+0000 7f6a73200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a74075370 0x7f6a7419b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.750+0000 7f6a73200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a7410ed60 0x7f6a7419f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.750+0000 7f6a73200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6a74114a50 con 0x7f6a7410ed60 2024-06-13T11:25:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.750+0000 7f6a73200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a741148d0 con 0x7f6a74074a50 2024-06-13T11:25:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.750+0000 7f6a73200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6a74114bd0 con 0x7f6a74075370 2024-06-13T11:25:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.750+0000 7f6a71e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a74074a50 0x7f6a7419ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.751+0000 7f6a71e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a74074a50 0x7f6a7419ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:53710/0 (socket says 172.21.15.2:53710) 2024-06-13T11:25:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.751+0000 7f6a71e00700 1 -- 172.21.15.2:0/596001644 learned_addr learned my addr 172.21.15.2:0/596001644 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.751+0000 7f6a71400700 1 --2- 172.21.15.2:0/596001644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a74075370 0x7f6a7419b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.751+0000 7f6a72800700 1 --2- 172.21.15.2:0/596001644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a7410ed60 0x7f6a7419f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.751+0000 7f6a71e00700 1 -- 172.21.15.2:0/596001644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a74075370 msgr2=0x7f6a7419b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.751+0000 7f6a71e00700 1 --2- 172.21.15.2:0/596001644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a74075370 0x7f6a7419b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.751+0000 7f6a71e00700 1 -- 172.21.15.2:0/596001644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a7410ed60 msgr2=0x7f6a7419f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.751+0000 7f6a71e00700 1 --2- 172.21.15.2:0/596001644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a7410ed60 0x7f6a7419f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.751+0000 7f6a71e00700 1 -- 172.21.15.2:0/596001644 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7419fe70 con 0x7f6a74074a50 2024-06-13T11:25:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.751+0000 7f6a71400700 1 --2- 172.21.15.2:0/596001644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a74075370 0x7f6a7419b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.751+0000 7f6a71e00700 1 --2- 172.21.15.2:0/596001644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a74074a50 0x7f6a7419ae60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400e9c0 tx=0x7f6a6400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.752+0000 7f6a6aa00700 1 -- 172.21.15.2:0/596001644 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6400cbd0 con 0x7f6a74074a50 2024-06-13T11:25:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.752+0000 7f6a6aa00700 1 -- 172.21.15.2:0/596001644 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a6400ee60 con 0x7f6a74074a50 2024-06-13T11:25:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.752+0000 7f6a6aa00700 1 -- 172.21.15.2:0/596001644 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64005630 con 0x7f6a74074a50 2024-06-13T11:25:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.752+0000 7f6a73200700 1 -- 172.21.15.2:0/596001644 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a741a0160 con 0x7f6a74074a50 2024-06-13T11:25:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.752+0000 7f6a73200700 1 -- 172.21.15.2:0/596001644 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a741a79e0 con 0x7f6a74074a50 2024-06-13T11:25:19.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.755+0000 7f6a6aa00700 1 -- 172.21.15.2:0/596001644 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f6a64004750 con 0x7f6a74074a50 2024-06-13T11:25:19.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.756+0000 7f6a6aa00700 1 --2- 172.21.15.2:0/596001644 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6a580a2d90 0x7f6a580a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.757+0000 7f6a6aa00700 1 -- 172.21.15.2:0/596001644 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f6a640cfac0 con 0x7f6a74074a50 2024-06-13T11:25:19.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.757+0000 7f6a71400700 1 --2- 172.21.15.2:0/596001644 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6a580a2d90 0x7f6a580a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.757+0000 7f6a837c1b80 1 Processor -- start 2024-06-13T11:25:19.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.757+0000 7f6a837c1b80 1 -- start start 2024-06-13T11:25:19.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.757+0000 7f6a837c1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564462318e40 0x56446239e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.758+0000 7f6a837c1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446239e960 0x56446239ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.758+0000 7f6a71400700 1 --2- 172.21.15.2:0/596001644 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6a580a2d90 0x7f6a580a5250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a60009680 tx=0x7f6a60009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:19.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.758+0000 7f6a837c1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5644623a7570 0x5644623a9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.758+0000 7f6a837c1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5644622aba10 con 0x56446239e960 2024-06-13T11:25:19.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.758+0000 7f6a837c1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5644622eeb00 con 0x564462318e40 2024-06-13T11:25:19.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.758+0000 7f6a837c1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5644622a98f0 con 0x5644623a7570 2024-06-13T11:25:19.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.758+0000 7f6a71400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446239e960 0x56446239ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.758+0000 7f6a71e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564462318e40 0x56446239e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.758+0000 7f6a71400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446239e960 0x56446239ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39820/0 (socket says 172.21.15.2:39820) 2024-06-13T11:25:19.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.758+0000 7f6a71400700 1 -- 172.21.15.2:0/1052023411 learned_addr learned my addr 172.21.15.2:0/1052023411 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:19.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.758+0000 7f6a72800700 1 --2- 172.21.15.2:0/1052023411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5644623a7570 0x5644623a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.758+0000 7f6a71e00700 1 -- 172.21.15.2:0/1052023411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5644623a7570 msgr2=0x5644623a9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:19.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.758+0000 7f6a71e00700 1 --2- 172.21.15.2:0/1052023411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5644623a7570 0x5644623a9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.758+0000 7f6a71e00700 1 -- 172.21.15.2:0/1052023411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446239e960 msgr2=0x56446239ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:19.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.759+0000 7f6a71e00700 1 --2- 172.21.15.2:0/1052023411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446239e960 0x56446239ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.759+0000 7f6a71e00700 1 -- 172.21.15.2:0/1052023411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564462296f90 con 0x564462318e40 2024-06-13T11:25:19.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.759+0000 7f6a71400700 1 --2- 172.21.15.2:0/1052023411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446239e960 0x56446239ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:19.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.759+0000 7f6a72800700 1 --2- 172.21.15.2:0/1052023411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5644623a7570 0x5644623a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:19.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.759+0000 7f6a71e00700 1 --2- 172.21.15.2:0/1052023411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564462318e40 0x56446239e420 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6a640cce40 tx=0x7f6a6409b640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3df2846581daf8ae server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:19.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.759+0000 7f6a5f400700 1 -- 172.21.15.2:0/1052023411 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6409ffc0 con 0x564462318e40 2024-06-13T11:25:19.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.759+0000 7f6a5f400700 1 -- 172.21.15.2:0/1052023411 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a640a4880 con 0x564462318e40 2024-06-13T11:25:19.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.759+0000 7f6a5f400700 1 -- 172.21.15.2:0/1052023411 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a640a43f0 con 0x564462318e40 2024-06-13T11:25:19.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.760+0000 7f6a837c1b80 1 -- 172.21.15.2:0/1052023411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564462318e40 msgr2=0x56446239e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:19.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.760+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/1052023411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564462318e40 0x56446239e420 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6a640cce40 tx=0x7f6a6409b640 comp rx=0 tx=0).stop 2024-06-13T11:25:19.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.760+0000 7f6a837c1b80 1 -- 172.21.15.2:0/1052023411 shutdown_connections 2024-06-13T11:25:19.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.760+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/1052023411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5644623a7570 0x5644623a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.760+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/1052023411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564462318e40 0x56446239e420 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.760+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/1052023411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446239e960 0x56446239ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.760+0000 7f6a837c1b80 1 -- 172.21.15.2:0/1052023411 >> 172.21.15.2:0/1052023411 conn(0x5644622c9170 msgr2=0x564462398820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:19.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.760+0000 7f6a837c1b80 1 -- 172.21.15.2:0/1052023411 shutdown_connections 2024-06-13T11:25:19.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.760+0000 7f6a837c1b80 1 -- 172.21.15.2:0/1052023411 wait complete. 2024-06-13T11:25:19.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.761+0000 7f6a837c1b80 1 -- start start 2024-06-13T11:25:19.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.761+0000 7f6a837c1b80 1 Processor -- start 2024-06-13T11:25:19.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.762+0000 7f6a837c1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564462318e40 0x5644623a6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.762+0000 7f6a837c1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56446239e960 0x5644623a4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.762+0000 7f6a837c1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644623a7570 0x5644623a45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.762+0000 7f6a837c1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56446228af60 con 0x564462318e40 2024-06-13T11:25:19.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.762+0000 7f6a837c1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5644622eaac0 con 0x5644623a7570 2024-06-13T11:25:19.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.762+0000 7f6a837c1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5644623aa1e0 con 0x56446239e960 2024-06-13T11:25:19.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.762+0000 7f6a837c1b80 10 client.0 _ll_register_callbacks cb 0x564462288720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:19.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.762+0000 7f6a71e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564462318e40 0x5644623a6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.762+0000 7f6a71e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564462318e40 0x5644623a6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39824/0 (socket says 172.21.15.2:39824) 2024-06-13T11:25:19.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.762+0000 7f6a71e00700 1 -- 172.21.15.2:0/2487982004 learned_addr learned my addr 172.21.15.2:0/2487982004 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:19.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.762+0000 7f6a72800700 1 --2- 172.21.15.2:0/2487982004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644623a7570 0x5644623a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.763+0000 7f6a71400700 1 --2- 172.21.15.2:0/2487982004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56446239e960 0x5644623a4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.763+0000 7f6a71e00700 1 -- 172.21.15.2:0/2487982004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56446239e960 msgr2=0x5644623a4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:19.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.763+0000 7f6a71e00700 1 --2- 172.21.15.2:0/2487982004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56446239e960 0x5644623a4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.763+0000 7f6a71e00700 1 -- 172.21.15.2:0/2487982004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644623a7570 msgr2=0x5644623a45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:19.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.763+0000 7f6a71e00700 1 --2- 172.21.15.2:0/2487982004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644623a7570 0x5644623a45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.763+0000 7f6a71e00700 1 -- 172.21.15.2:0/2487982004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56446223d8d0 con 0x564462318e40 2024-06-13T11:25:19.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.763+0000 7f6a72800700 1 --2- 172.21.15.2:0/2487982004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644623a7570 0x5644623a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:19.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.763+0000 7f6a71e00700 1 --2- 172.21.15.2:0/2487982004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564462318e40 0x5644623a6d70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6a64018000 tx=0x7f6a64005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e1749f33de36f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:19.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.763+0000 7f6a53e00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:25:19.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.764+0000 7f6a53e00700 1 -- 172.21.15.2:0/2487982004 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a640ba050 con 0x564462318e40 2024-06-13T11:25:19.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.764+0000 7f6a53e00700 1 -- 172.21.15.2:0/2487982004 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f6a6409c080 con 0x564462318e40 2024-06-13T11:25:19.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.764+0000 7f6a837c1b80 1 -- 172.21.15.2:0/2487982004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a640a4880 con 0x564462318e40 2024-06-13T11:25:19.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.764+0000 7f6a53e00700 1 -- 172.21.15.2:0/2487982004 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6a640a43f0 con 0x564462318e40 2024-06-13T11:25:19.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.764+0000 7f6a837c1b80 10 client.15354 fetch_fsmap learned FSMap version 27 2024-06-13T11:25:19.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.764+0000 7f6a837c1b80 1 -- 172.21.15.2:0/2487982004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5644623b4990 con 0x564462318e40 2024-06-13T11:25:19.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.764+0000 7f6a53e00700 1 -- 172.21.15.2:0/2487982004 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a640a4880 con 0x564462318e40 2024-06-13T11:25:19.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.765+0000 7f6a53e00700 1 -- 172.21.15.2:0/2487982004 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6a640979f0 con 0x564462318e40 2024-06-13T11:25:19.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.765+0000 7f6a837c1b80 10 client.15354 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:25:19.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.765+0000 7f6a837c1b80 10 client.15354 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:25:19.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.765+0000 7f6a837c1b80 20 client.15354 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:19.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.765+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/2487982004 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5644623b6e60 0x5644623b9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.765+0000 7f6a837c1b80 4 client.15354 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:25:19.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.765+0000 7f6a837c1b80 1 -- 172.21.15.2:0/2487982004 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644622fc000 con 0x5644623b6e60 2024-06-13T11:25:19.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.765+0000 7f6a71400700 1 --2- 172.21.15.2:0/2487982004 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5644623b6e60 0x5644623b9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.766+0000 7f6a71400700 1 --2- 172.21.15.2:0/2487982004 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5644623b6e60 0x5644623b9250 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9512c66eb2fa8d8b server_cookie=3275e7846b8e70dc in_seq=0 out_seq=0 2024-06-13T11:25:19.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.766+0000 7f6a53e00700 10 client.15354 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:25:19.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.767+0000 7f6a53e00700 1 -- 172.21.15.2:0/2487982004 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5644622fc000 con 0x5644623b6e60 2024-06-13T11:25:19.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.767+0000 7f6a53e00700 10 client.15354 handle_command_reply: tid=0 2024-06-13T11:25:19.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.767+0000 7f6a837c1b80 1 client.15354 shutdown 2024-06-13T11:25:19.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.767+0000 7f6a837c1b80 1 -- 172.21.15.2:0/2487982004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564462318e40 msgr2=0x5644623a6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:19.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.767+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/2487982004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564462318e40 0x5644623a6d70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6a64018000 tx=0x7f6a64005000 comp rx=0 tx=0).stop 2024-06-13T11:25:19.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.767+0000 7f6a837c1b80 1 -- 172.21.15.2:0/2487982004 shutdown_connections 2024-06-13T11:25:19.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.767+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/2487982004 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5644623b6e60 0x5644623b9250 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.767+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/2487982004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564462318e40 0x5644623a6d70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.767+0000 7f6a53e00700 0 client.15354 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:25:19.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.767+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/2487982004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644623a7570 0x5644623a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.767+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/2487982004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56446239e960 0x5644623a4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.767+0000 7f6a837c1b80 1 -- 172.21.15.2:0/2487982004 >> 172.21.15.2:0/2487982004 conn(0x5644622c9170 msgr2=0x564462398410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:19.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.767+0000 7f6a837c1b80 1 -- 172.21.15.2:0/2487982004 shutdown_connections 2024-06-13T11:25:19.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.768+0000 7f6a837c1b80 1 -- 172.21.15.2:0/2487982004 wait complete. 2024-06-13T11:25:19.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.768+0000 7f6a837c1b80 20 client.15354 trim_cache size 0 max 16384 2024-06-13T11:25:19.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.785+0000 7f6a837c1b80 1 Processor -- start 2024-06-13T11:25:19.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.785+0000 7f6a837c1b80 1 -- start start 2024-06-13T11:25:19.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.785+0000 7f6a837c1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564462318e40 0x564462398960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.785+0000 7f6a837c1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56446239e960 0x5644623a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.785+0000 7f6a837c1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644623a7570 0x5644623a4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.785+0000 7f6a837c1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6a741b2e10 con 0x5644623a7570 2024-06-13T11:25:19.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.785+0000 7f6a837c1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a741b06a0 con 0x56446239e960 2024-06-13T11:25:19.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.785+0000 7f6a837c1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6a741ae4f0 con 0x564462318e40 2024-06-13T11:25:19.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.785+0000 7f6a72800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644623a7570 0x5644623a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.785+0000 7f6a71e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564462318e40 0x564462398960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.785+0000 7f6a72800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644623a7570 0x5644623a4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39826/0 (socket says 172.21.15.2:39826) 2024-06-13T11:25:19.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.785+0000 7f6a72800700 1 -- 172.21.15.2:0/888595698 learned_addr learned my addr 172.21.15.2:0/888595698 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:19.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.786+0000 7f6a71400700 1 --2- 172.21.15.2:0/888595698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56446239e960 0x5644623a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.786+0000 7f6a71e00700 1 -- 172.21.15.2:0/888595698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56446239e960 msgr2=0x5644623a5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:19.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.786+0000 7f6a71e00700 1 --2- 172.21.15.2:0/888595698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56446239e960 0x5644623a5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.786+0000 7f6a71e00700 1 -- 172.21.15.2:0/888595698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644623a7570 msgr2=0x5644623a4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:19.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.786+0000 7f6a71e00700 1 --2- 172.21.15.2:0/888595698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644623a7570 0x5644623a4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.786+0000 7f6a71e00700 1 -- 172.21.15.2:0/888595698 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446239d570 con 0x564462318e40 2024-06-13T11:25:19.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.786+0000 7f6a71e00700 1 --2- 172.21.15.2:0/888595698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564462318e40 0x564462398960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400c5b0 tx=0x7f6a640cd3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9761286bf9c75a0a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:19.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.786+0000 7f6a5ea00700 1 -- 172.21.15.2:0/888595698 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64097eb0 con 0x564462318e40 2024-06-13T11:25:19.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.787+0000 7f6a5ea00700 1 -- 172.21.15.2:0/888595698 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a640a4880 con 0x564462318e40 2024-06-13T11:25:19.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.787+0000 7f6a5ea00700 1 -- 172.21.15.2:0/888595698 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64097960 con 0x564462318e40 2024-06-13T11:25:19.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.787+0000 7f6a837c1b80 1 -- 172.21.15.2:0/888595698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564462318e40 msgr2=0x564462398960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:19.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.787+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/888595698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564462318e40 0x564462398960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400c5b0 tx=0x7f6a640cd3a0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.787+0000 7f6a837c1b80 1 -- 172.21.15.2:0/888595698 shutdown_connections 2024-06-13T11:25:19.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.787+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/888595698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5644623a7570 0x5644623a4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.787+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/888595698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564462318e40 0x564462398960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.787+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/888595698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56446239e960 0x5644623a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.787+0000 7f6a837c1b80 1 -- 172.21.15.2:0/888595698 >> 172.21.15.2:0/888595698 conn(0x5644622c9170 msgr2=0x5644623a58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:19.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.787+0000 7f6a837c1b80 1 -- 172.21.15.2:0/888595698 shutdown_connections 2024-06-13T11:25:19.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.787+0000 7f6a837c1b80 1 -- 172.21.15.2:0/888595698 wait complete. 2024-06-13T11:25:19.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.788+0000 7f6a837c1b80 1 -- start start 2024-06-13T11:25:19.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.788+0000 7f6a837c1b80 1 Processor -- start 2024-06-13T11:25:19.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.788+0000 7f6a837c1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564462318e40 0x5644623b9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.789+0000 7f6a837c1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446239e960 0x5644623b9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.789+0000 7f6a837c1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5644623a7570 0x56446241f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.789+0000 7f6a837c1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6a741aeb60 con 0x56446239e960 2024-06-13T11:25:19.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.789+0000 7f6a837c1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a741affd0 con 0x564462318e40 2024-06-13T11:25:19.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.789+0000 7f6a837c1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6a741af230 con 0x5644623a7570 2024-06-13T11:25:19.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.789+0000 7f6a837c1b80 10 client.0 _ll_register_callbacks cb 0x564462288720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:19.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.789+0000 7f6a71e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564462318e40 0x5644623b9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.789+0000 7f6a71e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564462318e40 0x5644623b9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:53748/0 (socket says 172.21.15.2:53748) 2024-06-13T11:25:19.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.789+0000 7f6a71e00700 1 -- 172.21.15.2:0/1955034398 learned_addr learned my addr 172.21.15.2:0/1955034398 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:19.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:19 smithi077 ceph-mon[36410]: pgmap v49: 129 pgs: 129 active+clean; 15 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-06-13T11:25:19.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:19 smithi077 ceph-mon[36410]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-06-13T11:25:19.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.789+0000 7f6a71400700 1 --2- 172.21.15.2:0/1955034398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446239e960 0x5644623b9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.789+0000 7f6a72800700 1 --2- 172.21.15.2:0/1955034398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5644623a7570 0x56446241f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.789+0000 7f6a71e00700 1 -- 172.21.15.2:0/1955034398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5644623a7570 msgr2=0x56446241f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:19.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.789+0000 7f6a71e00700 1 --2- 172.21.15.2:0/1955034398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5644623a7570 0x56446241f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.789+0000 7f6a71e00700 1 -- 172.21.15.2:0/1955034398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446239e960 msgr2=0x5644623b9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:19.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.789+0000 7f6a71e00700 1 --2- 172.21.15.2:0/1955034398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446239e960 0x5644623b9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.789+0000 7f6a71e00700 1 -- 172.21.15.2:0/1955034398 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56446241fcd0 con 0x564462318e40 2024-06-13T11:25:19.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.790+0000 7f6a71e00700 1 --2- 172.21.15.2:0/1955034398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564462318e40 0x5644623b9430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6a6409b590 tx=0x7f6a6409add0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2453b0ef53bc1aa5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:19.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.790+0000 7f6a53e00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:25:19.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.790+0000 7f6a53e00700 1 -- 172.21.15.2:0/1955034398 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64097eb0 con 0x564462318e40 2024-06-13T11:25:19.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.790+0000 7f6a837c1b80 1 -- 172.21.15.2:0/1955034398 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a640a4880 con 0x564462318e40 2024-06-13T11:25:19.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.790+0000 7f6a53e00700 1 -- 172.21.15.2:0/1955034398 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f6a6409b060 con 0x564462318e40 2024-06-13T11:25:19.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.790+0000 7f6a53e00700 1 -- 172.21.15.2:0/1955034398 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6a6409b260 con 0x564462318e40 2024-06-13T11:25:19.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.790+0000 7f6a837c1b80 10 client.25463 fetch_fsmap learned FSMap version 27 2024-06-13T11:25:19.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.790+0000 7f6a837c1b80 1 -- 172.21.15.2:0/1955034398 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56446241fcd0 con 0x564462318e40 2024-06-13T11:25:19.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.791+0000 7f6a53e00700 1 -- 172.21.15.2:0/1955034398 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a640a4880 con 0x564462318e40 2024-06-13T11:25:19.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.791+0000 7f6a53e00700 1 -- 172.21.15.2:0/1955034398 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6a640a4ad0 con 0x564462318e40 2024-06-13T11:25:19.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.791+0000 7f6a837c1b80 10 client.25463 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:25:19.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.791+0000 7f6a837c1b80 10 client.25463 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:25:19.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.791+0000 7f6a837c1b80 20 client.25463 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:19.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.791+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/1955034398 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x564462421070 0x564462423460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:19.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.791+0000 7f6a837c1b80 4 client.25463 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:25:19.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.791+0000 7f6a837c1b80 1 -- 172.21.15.2:0/1955034398 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5644622f6580 con 0x564462421070 2024-06-13T11:25:19.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.791+0000 7f6a71400700 1 --2- 172.21.15.2:0/1955034398 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x564462421070 0x564462423460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:19.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.792+0000 7f6a71400700 1 --2- 172.21.15.2:0/1955034398 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x564462421070 0x564462423460 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1a7c50e4c554ee04 server_cookie=b40e487d5b3bf2a9 in_seq=0 out_seq=0 2024-06-13T11:25:19.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.792+0000 7f6a53e00700 10 client.25463 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:25:19.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.792+0000 7f6a53e00700 1 -- 172.21.15.2:0/1955034398 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5644622f6580 con 0x564462421070 2024-06-13T11:25:19.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.792+0000 7f6a53e00700 10 client.25463 handle_command_reply: tid=0 2024-06-13T11:25:19.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.792+0000 7f6a837c1b80 1 client.25463 shutdown 2024-06-13T11:25:19.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.792+0000 7f6a837c1b80 1 -- 172.21.15.2:0/1955034398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564462318e40 msgr2=0x5644623b9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:19.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.792+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/1955034398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564462318e40 0x5644623b9430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6a6409b590 tx=0x7f6a6409add0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.792+0000 7f6a837c1b80 1 -- 172.21.15.2:0/1955034398 shutdown_connections 2024-06-13T11:25:19.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.792+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/1955034398 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x564462421070 0x564462423460 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.792+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/1955034398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5644623a7570 0x56446241f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.792+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/1955034398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564462318e40 0x5644623b9430 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.792+0000 7f6a837c1b80 1 --2- 172.21.15.2:0/1955034398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56446239e960 0x5644623b9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.792+0000 7f6a53e00700 0 client.25463 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:25:19.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.793+0000 7f6a837c1b80 1 -- 172.21.15.2:0/1955034398 >> 172.21.15.2:0/1955034398 conn(0x5644622c9170 msgr2=0x56446239c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:19.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.793+0000 7f6a837c1b80 1 -- 172.21.15.2:0/1955034398 shutdown_connections 2024-06-13T11:25:19.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.793+0000 7f6a837c1b80 1 -- 172.21.15.2:0/1955034398 wait complete. 2024-06-13T11:25:19.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.793+0000 7f6a837c1b80 20 client.25463 trim_cache size 0 max 16384 2024-06-13T11:25:19.796 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:25:19.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.794+0000 7f6a73200700 1 -- 172.21.15.2:0/596001644 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6a580a2d90 msgr2=0x7f6a580a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:19.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.794+0000 7f6a73200700 1 --2- 172.21.15.2:0/596001644 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6a580a2d90 0x7f6a580a5250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a60009680 tx=0x7f6a60009260 comp rx=0 tx=0).stop 2024-06-13T11:25:19.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.794+0000 7f6a73200700 1 -- 172.21.15.2:0/596001644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a74074a50 msgr2=0x7f6a7419ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:19.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.794+0000 7f6a73200700 1 --2- 172.21.15.2:0/596001644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a74074a50 0x7f6a7419ae60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400e9c0 tx=0x7f6a6400ecd0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.794+0000 7f6a73200700 1 -- 172.21.15.2:0/596001644 shutdown_connections 2024-06-13T11:25:19.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.794+0000 7f6a73200700 1 --2- 172.21.15.2:0/596001644 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6a580a2d90 0x7f6a580a5250 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.794+0000 7f6a73200700 1 --2- 172.21.15.2:0/596001644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a7410ed60 0x7f6a7419f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.794+0000 7f6a73200700 1 --2- 172.21.15.2:0/596001644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a74074a50 0x7f6a7419ae60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.794+0000 7f6a73200700 1 --2- 172.21.15.2:0/596001644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a74075370 0x7f6a7419b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:19.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.794+0000 7f6a73200700 1 -- 172.21.15.2:0/596001644 >> 172.21.15.2:0/596001644 conn(0x7f6a740fde80 msgr2=0x7f6a740feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:19.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.794+0000 7f6a73200700 1 -- 172.21.15.2:0/596001644 shutdown_connections 2024-06-13T11:25:19.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:19.794+0000 7f6a73200700 1 -- 172.21.15.2:0/596001644 wait complete. 2024-06-13T11:25:19.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:19 smithi178 ceph-mon[36913]: pgmap v49: 129 pgs: 129 active+clean; 15 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 1.2 MiB/s wr, 13 op/s 2024-06-13T11:25:19.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:19 smithi178 ceph-mon[36913]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-06-13T11:25:20.721 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-13T11:25:21.195 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:25:21.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:21 smithi002 ceph-mon[32210]: pgmap v50: 129 pgs: 129 active+clean; 15 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-06-13T11:25:21.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:21 smithi077 ceph-mon[36410]: pgmap v50: 129 pgs: 129 active+clean; 15 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-06-13T11:25:21.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:21 smithi178 ceph-mon[36913]: pgmap v50: 129 pgs: 129 active+clean; 15 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 1.2 MiB/s wr, 10 op/s 2024-06-13T11:25:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.439+0000 7fc71d200700 1 -- 172.21.15.2:0/2160652502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc718102fd0 msgr2=0x7fc718107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.439+0000 7fc71d200700 1 --2- 172.21.15.2:0/2160652502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc718102fd0 0x7fc718107020 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc7040099c0 tx=0x7fc704009cd0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.439+0000 7fc71d200700 1 -- 172.21.15.2:0/2160652502 shutdown_connections 2024-06-13T11:25:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.439+0000 7fc71d200700 1 --2- 172.21.15.2:0/2160652502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc718107700 0x7fc71810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.439+0000 7fc71d200700 1 --2- 172.21.15.2:0/2160652502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc718102620 0x7fc718102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.439+0000 7fc71d200700 1 --2- 172.21.15.2:0/2160652502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc718102fd0 0x7fc718107020 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.439+0000 7fc71d200700 1 -- 172.21.15.2:0/2160652502 >> 172.21.15.2:0/2160652502 conn(0x7fc7180fdf10 msgr2=0x7fc718100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.439+0000 7fc71d200700 1 -- 172.21.15.2:0/2160652502 shutdown_connections 2024-06-13T11:25:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.439+0000 7fc71d200700 1 -- 172.21.15.2:0/2160652502 wait complete. 2024-06-13T11:25:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.440+0000 7fc71d200700 1 Processor -- start 2024-06-13T11:25:23.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.440+0000 7fc71d200700 1 -- start start 2024-06-13T11:25:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.441+0000 7fc71d200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc718102620 0x7fc71819ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.441+0000 7fc71d200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc718102fd0 0x7fc71819b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.441+0000 7fc71d200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc718107700 0x7fc71819f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.441+0000 7fc71d200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc718112710 con 0x7fc718102620 2024-06-13T11:25:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.441+0000 7fc71d200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc718112590 con 0x7fc718102fd0 2024-06-13T11:25:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.441+0000 7fc71d200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc718112890 con 0x7fc718107700 2024-06-13T11:25:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.441+0000 7fc717400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc718102620 0x7fc71819ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.441+0000 7fc717400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc718102620 0x7fc71819ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39860/0 (socket says 172.21.15.2:39860) 2024-06-13T11:25:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.441+0000 7fc717400700 1 -- 172.21.15.2:0/647741218 learned_addr learned my addr 172.21.15.2:0/647741218 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.441+0000 7fc717e00700 1 --2- 172.21.15.2:0/647741218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc718107700 0x7fc71819f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.441+0000 7fc716a00700 1 --2- 172.21.15.2:0/647741218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc718102fd0 0x7fc71819b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.442+0000 7fc717400700 1 -- 172.21.15.2:0/647741218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc718107700 msgr2=0x7fc71819f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.442+0000 7fc717400700 1 --2- 172.21.15.2:0/647741218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc718107700 0x7fc71819f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.442+0000 7fc717400700 1 -- 172.21.15.2:0/647741218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc718102fd0 msgr2=0x7fc71819b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.442+0000 7fc717400700 1 --2- 172.21.15.2:0/647741218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc718102fd0 0x7fc71819b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.442+0000 7fc717400700 1 -- 172.21.15.2:0/647741218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71819fe10 con 0x7fc718102620 2024-06-13T11:25:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.442+0000 7fc717e00700 1 --2- 172.21.15.2:0/647741218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc718107700 0x7fc71819f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.442+0000 7fc717400700 1 --2- 172.21.15.2:0/647741218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc718102620 0x7fc71819ae00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc70800eb30 tx=0x7fc70800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.442+0000 7fc70fe00700 1 -- 172.21.15.2:0/647741218 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70800cbd0 con 0x7fc718102620 2024-06-13T11:25:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.442+0000 7fc71d200700 1 -- 172.21.15.2:0/647741218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7181a0100 con 0x7fc718102620 2024-06-13T11:25:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.442+0000 7fc70fe00700 1 -- 172.21.15.2:0/647741218 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc708004500 con 0x7fc718102620 2024-06-13T11:25:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.442+0000 7fc70fe00700 1 -- 172.21.15.2:0/647741218 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708010430 con 0x7fc718102620 2024-06-13T11:25:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.442+0000 7fc71d200700 1 -- 172.21.15.2:0/647741218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7181a7980 con 0x7fc718102620 2024-06-13T11:25:23.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.446+0000 7fc70fe00700 1 -- 172.21.15.2:0/647741218 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fc708003f00 con 0x7fc718102620 2024-06-13T11:25:23.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.447+0000 7fc70fe00700 1 --2- 172.21.15.2:0/647741218 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6fc0a2e10 0x7fc6fc0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.447+0000 7fc729151b80 1 Processor -- start 2024-06-13T11:25:23.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.447+0000 7fc70fe00700 1 -- 172.21.15.2:0/647741218 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fc7080cfb00 con 0x7fc718102620 2024-06-13T11:25:23.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.448+0000 7fc729151b80 1 -- start start 2024-06-13T11:25:23.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.448+0000 7fc716a00700 1 --2- 172.21.15.2:0/647741218 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6fc0a2e10 0x7fc6fc0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.448+0000 7fc729151b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d63cd60 0x55ac7d63d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.448+0000 7fc729151b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d63d680 0x55ac7d647ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.448+0000 7fc729151b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d648530 0x55ac7d64a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.448+0000 7fc729151b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ac7d54ca10 con 0x55ac7d648530 2024-06-13T11:25:23.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.448+0000 7fc729151b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ac7d58fb00 con 0x55ac7d63d680 2024-06-13T11:25:23.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.448+0000 7fc729151b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55ac7d54a8f0 con 0x55ac7d63cd60 2024-06-13T11:25:23.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.448+0000 7fc717e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d648530 0x55ac7d64a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.448+0000 7fc717e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d648530 0x55ac7d64a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39872/0 (socket says 172.21.15.2:39872) 2024-06-13T11:25:23.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.448+0000 7fc717e00700 1 -- 172.21.15.2:0/3416636775 learned_addr learned my addr 172.21.15.2:0/3416636775 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:23.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.449+0000 7fc717400700 1 --2- 172.21.15.2:0/3416636775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d63cd60 0x55ac7d63d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.449+0000 7fc716a00700 1 --2- 172.21.15.2:0/647741218 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6fc0a2e10 0x7fc6fc0a52d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc704000c00 tx=0x7fc704005fb0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:23.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.449+0000 7fc716a00700 1 --2- 172.21.15.2:0/3416636775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d63d680 0x55ac7d647ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.449+0000 7fc717e00700 1 -- 172.21.15.2:0/3416636775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d63cd60 msgr2=0x55ac7d63d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:23.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.449+0000 7fc717e00700 1 --2- 172.21.15.2:0/3416636775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d63cd60 0x55ac7d63d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.449+0000 7fc717e00700 1 -- 172.21.15.2:0/3416636775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d63d680 msgr2=0x55ac7d647ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.449+0000 7fc717e00700 1 --2- 172.21.15.2:0/3416636775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d63d680 0x55ac7d647ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.449+0000 7fc717e00700 1 -- 172.21.15.2:0/3416636775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac7d537f90 con 0x55ac7d648530 2024-06-13T11:25:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.449+0000 7fc717400700 1 --2- 172.21.15.2:0/3416636775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d63cd60 0x55ac7d63d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.449+0000 7fc717e00700 1 --2- 172.21.15.2:0/3416636775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d648530 0x55ac7d64a920 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc710009550 tx=0x7fc7100079f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1eec4fefdd72899 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.450+0000 7fc70cc00700 1 -- 172.21.15.2:0/3416636775 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710019020 con 0x55ac7d648530 2024-06-13T11:25:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.450+0000 7fc70cc00700 1 -- 172.21.15.2:0/3416636775 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc710015d30 con 0x55ac7d648530 2024-06-13T11:25:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.450+0000 7fc70cc00700 1 -- 172.21.15.2:0/3416636775 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710012360 con 0x55ac7d648530 2024-06-13T11:25:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.450+0000 7fc729151b80 1 -- 172.21.15.2:0/3416636775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d648530 msgr2=0x55ac7d64a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.450+0000 7fc729151b80 1 --2- 172.21.15.2:0/3416636775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d648530 0x55ac7d64a920 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc710009550 tx=0x7fc7100079f0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.451+0000 7fc729151b80 1 -- 172.21.15.2:0/3416636775 shutdown_connections 2024-06-13T11:25:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.451+0000 7fc729151b80 1 --2- 172.21.15.2:0/3416636775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d648530 0x55ac7d64a920 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.451+0000 7fc729151b80 1 --2- 172.21.15.2:0/3416636775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d63cd60 0x55ac7d63d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.451+0000 7fc729151b80 1 --2- 172.21.15.2:0/3416636775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d63d680 0x55ac7d647ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.451+0000 7fc729151b80 1 -- 172.21.15.2:0/3416636775 >> 172.21.15.2:0/3416636775 conn(0x55ac7d56a170 msgr2=0x55ac7d639280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:23.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.451+0000 7fc729151b80 1 -- 172.21.15.2:0/3416636775 shutdown_connections 2024-06-13T11:25:23.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.451+0000 7fc729151b80 1 -- 172.21.15.2:0/3416636775 wait complete. 2024-06-13T11:25:23.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.451+0000 7fc729151b80 1 -- start start 2024-06-13T11:25:23.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.452+0000 7fc729151b80 1 Processor -- start 2024-06-13T11:25:23.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.452+0000 7fc729151b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63cd60 0x55ac7d647c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.452+0000 7fc729151b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d63d680 0x55ac7d644f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.452+0000 7fc729151b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d648530 0x55ac7d6454d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.452+0000 7fc729151b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ac7d52bf60 con 0x55ac7d63cd60 2024-06-13T11:25:23.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.452+0000 7fc729151b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ac7d58bac0 con 0x55ac7d63d680 2024-06-13T11:25:23.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.452+0000 7fc729151b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55ac7d64afc0 con 0x55ac7d648530 2024-06-13T11:25:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.452+0000 7fc729151b80 10 client.0 _ll_register_callbacks cb 0x55ac7d525380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.452+0000 7fc717400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63cd60 0x55ac7d647c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.452+0000 7fc717400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63cd60 0x55ac7d647c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39880/0 (socket says 172.21.15.2:39880) 2024-06-13T11:25:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.452+0000 7fc717400700 1 -- 172.21.15.2:0/4001179545 learned_addr learned my addr 172.21.15.2:0/4001179545 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.453+0000 7fc716a00700 1 --2- 172.21.15.2:0/4001179545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d63d680 0x55ac7d644f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.453+0000 7fc717e00700 1 --2- 172.21.15.2:0/4001179545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d648530 0x55ac7d6454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.453+0000 7fc717400700 1 -- 172.21.15.2:0/4001179545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d648530 msgr2=0x55ac7d6454d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.453+0000 7fc717400700 1 --2- 172.21.15.2:0/4001179545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d648530 0x55ac7d6454d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.453+0000 7fc717400700 1 -- 172.21.15.2:0/4001179545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d63d680 msgr2=0x55ac7d644f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.453+0000 7fc717400700 1 --2- 172.21.15.2:0/4001179545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d63d680 0x55ac7d644f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.453+0000 7fc717400700 1 -- 172.21.15.2:0/4001179545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac7d4de8d0 con 0x55ac7d63cd60 2024-06-13T11:25:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.453+0000 7fc717400700 1 --2- 172.21.15.2:0/4001179545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63cd60 0x55ac7d647c90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc70801f000 tx=0x7fc70809b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6771bc711ba8e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:23.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.453+0000 7fc701600700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:25:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.454+0000 7fc701600700 1 -- 172.21.15.2:0/4001179545 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7080b1070 con 0x55ac7d63cd60 2024-06-13T11:25:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.454+0000 7fc701600700 1 -- 172.21.15.2:0/4001179545 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fc70809beb0 con 0x55ac7d63cd60 2024-06-13T11:25:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.454+0000 7fc729151b80 1 -- 172.21.15.2:0/4001179545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc710015d30 con 0x55ac7d63cd60 2024-06-13T11:25:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.454+0000 7fc701600700 1 -- 172.21.15.2:0/4001179545 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc70809bc50 con 0x55ac7d63cd60 2024-06-13T11:25:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.454+0000 7fc729151b80 10 client.15372 fetch_fsmap learned FSMap version 27 2024-06-13T11:25:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.454+0000 7fc729151b80 1 -- 172.21.15.2:0/4001179545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ac7d655750 con 0x55ac7d63cd60 2024-06-13T11:25:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.454+0000 7fc701600700 1 -- 172.21.15.2:0/4001179545 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc710015d30 con 0x55ac7d63cd60 2024-06-13T11:25:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.454+0000 7fc701600700 1 -- 172.21.15.2:0/4001179545 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc7080a4430 con 0x55ac7d63cd60 2024-06-13T11:25:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.454+0000 7fc729151b80 10 client.15372 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:25:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.454+0000 7fc729151b80 10 client.15372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:25:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.455+0000 7fc729151b80 20 client.15372 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:23.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.455+0000 7fc729151b80 1 --2- 172.21.15.2:0/4001179545 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ac7d657ce0 0x55ac7d65a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.455+0000 7fc729151b80 4 client.15372 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:25:23.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.455+0000 7fc729151b80 1 -- 172.21.15.2:0/4001179545 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac7d59d000 con 0x55ac7d657ce0 2024-06-13T11:25:23.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.455+0000 7fc716a00700 1 --2- 172.21.15.2:0/4001179545 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ac7d657ce0 0x55ac7d65a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.456+0000 7fc716a00700 1 --2- 172.21.15.2:0/4001179545 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ac7d657ce0 0x55ac7d65a110 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3298e22c5beedd90 server_cookie=c1d595ad53582252 in_seq=0 out_seq=0 2024-06-13T11:25:23.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.456+0000 7fc701600700 10 client.15372 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:23.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.457+0000 7fc701600700 1 -- 172.21.15.2:0/4001179545 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ac7d59d000 con 0x55ac7d657ce0 2024-06-13T11:25:23.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.457+0000 7fc701600700 10 client.15372 handle_command_reply: tid=0 2024-06-13T11:25:23.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.457+0000 7fc729151b80 1 client.15372 shutdown 2024-06-13T11:25:23.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.457+0000 7fc729151b80 1 -- 172.21.15.2:0/4001179545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63cd60 msgr2=0x55ac7d647c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:23.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.457+0000 7fc729151b80 1 --2- 172.21.15.2:0/4001179545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63cd60 0x55ac7d647c90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc70801f000 tx=0x7fc70809b810 comp rx=0 tx=0).stop 2024-06-13T11:25:23.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.457+0000 7fc729151b80 1 -- 172.21.15.2:0/4001179545 shutdown_connections 2024-06-13T11:25:23.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.457+0000 7fc729151b80 1 --2- 172.21.15.2:0/4001179545 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ac7d657ce0 0x55ac7d65a110 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.457+0000 7fc729151b80 1 --2- 172.21.15.2:0/4001179545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63cd60 0x55ac7d647c90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.457+0000 7fc729151b80 1 --2- 172.21.15.2:0/4001179545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d648530 0x55ac7d6454d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.457+0000 7fc729151b80 1 --2- 172.21.15.2:0/4001179545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d63d680 0x55ac7d644f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.457+0000 7fc701600700 0 client.15372 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:23.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.457+0000 7fc729151b80 1 -- 172.21.15.2:0/4001179545 >> 172.21.15.2:0/4001179545 conn(0x55ac7d56a170 msgr2=0x55ac7d638e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:23.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.457+0000 7fc729151b80 1 -- 172.21.15.2:0/4001179545 shutdown_connections 2024-06-13T11:25:23.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.457+0000 7fc729151b80 1 -- 172.21.15.2:0/4001179545 wait complete. 2024-06-13T11:25:23.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.458+0000 7fc729151b80 20 client.15372 trim_cache size 0 max 16384 2024-06-13T11:25:23.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.474+0000 7fc729151b80 1 Processor -- start 2024-06-13T11:25:23.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.475+0000 7fc729151b80 1 -- start start 2024-06-13T11:25:23.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.475+0000 7fc729151b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d63cd60 0x55ac7d6477d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.475+0000 7fc729151b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63d680 0x55ac7d65fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.475+0000 7fc729151b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d648530 0x55ac7d65ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.475+0000 7fc729151b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7181b2ef0 con 0x55ac7d63d680 2024-06-13T11:25:23.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.475+0000 7fc729151b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc7181b0780 con 0x55ac7d648530 2024-06-13T11:25:23.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.475+0000 7fc729151b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc7181ae5d0 con 0x55ac7d63cd60 2024-06-13T11:25:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.475+0000 7fc717400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d63cd60 0x55ac7d6477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.475+0000 7fc716a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63d680 0x55ac7d65fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.475+0000 7fc717400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d63cd60 0x55ac7d6477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56662/0 (socket says 172.21.15.2:56662) 2024-06-13T11:25:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.475+0000 7fc717400700 1 -- 172.21.15.2:0/1544664819 learned_addr learned my addr 172.21.15.2:0/1544664819 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:23.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.475+0000 7fc717e00700 1 --2- 172.21.15.2:0/1544664819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d648530 0x55ac7d65ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.476+0000 7fc717400700 1 -- 172.21.15.2:0/1544664819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d648530 msgr2=0x55ac7d65ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.476+0000 7fc717400700 1 --2- 172.21.15.2:0/1544664819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d648530 0x55ac7d65ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.476+0000 7fc717400700 1 -- 172.21.15.2:0/1544664819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63d680 msgr2=0x55ac7d65fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.476+0000 7fc717400700 1 --2- 172.21.15.2:0/1544664819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63d680 0x55ac7d65fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.476+0000 7fc717400700 1 -- 172.21.15.2:0/1544664819 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac7d640bc0 con 0x55ac7d63cd60 2024-06-13T11:25:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.476+0000 7fc716a00700 1 --2- 172.21.15.2:0/1544664819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63d680 0x55ac7d65fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.476+0000 7fc717400700 1 --2- 172.21.15.2:0/1544664819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d63cd60 0x55ac7d6477d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc708009930 tx=0x7fc708009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86eb2bb1575a55b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.476+0000 7fc703e00700 1 -- 172.21.15.2:0/1544664819 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7080b1070 con 0x55ac7d63cd60 2024-06-13T11:25:23.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.476+0000 7fc703e00700 1 -- 172.21.15.2:0/1544664819 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc708081070 con 0x55ac7d63cd60 2024-06-13T11:25:23.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.476+0000 7fc703e00700 1 -- 172.21.15.2:0/1544664819 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7080982c0 con 0x55ac7d63cd60 2024-06-13T11:25:23.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.477+0000 7fc729151b80 1 -- 172.21.15.2:0/1544664819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d63cd60 msgr2=0x55ac7d6477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:23.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.477+0000 7fc729151b80 1 --2- 172.21.15.2:0/1544664819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d63cd60 0x55ac7d6477d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc708009930 tx=0x7fc708009f60 comp rx=0 tx=0).stop 2024-06-13T11:25:23.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.477+0000 7fc729151b80 1 -- 172.21.15.2:0/1544664819 shutdown_connections 2024-06-13T11:25:23.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.477+0000 7fc729151b80 1 --2- 172.21.15.2:0/1544664819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d648530 0x55ac7d65ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.477+0000 7fc729151b80 1 --2- 172.21.15.2:0/1544664819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d63cd60 0x55ac7d6477d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.477+0000 7fc729151b80 1 --2- 172.21.15.2:0/1544664819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63d680 0x55ac7d65fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.477+0000 7fc729151b80 1 -- 172.21.15.2:0/1544664819 >> 172.21.15.2:0/1544664819 conn(0x55ac7d56a170 msgr2=0x55ac7d644000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:23.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.477+0000 7fc729151b80 1 -- 172.21.15.2:0/1544664819 shutdown_connections 2024-06-13T11:25:23.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.477+0000 7fc729151b80 1 -- 172.21.15.2:0/1544664819 wait complete. 2024-06-13T11:25:23.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.478+0000 7fc729151b80 1 -- start start 2024-06-13T11:25:23.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.478+0000 7fc729151b80 1 Processor -- start 2024-06-13T11:25:23.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.478+0000 7fc729151b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d63cd60 0x55ac7d64da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.478+0000 7fc729151b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63d680 0x55ac7d64df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.478+0000 7fc729151b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d648530 0x55ac7d6baa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.478+0000 7fc729151b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc7181aec40 con 0x55ac7d63d680 2024-06-13T11:25:23.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.478+0000 7fc729151b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc7181b00b0 con 0x55ac7d63cd60 2024-06-13T11:25:23.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.478+0000 7fc729151b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc7181af310 con 0x55ac7d648530 2024-06-13T11:25:23.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.479+0000 7fc729151b80 10 client.0 _ll_register_callbacks cb 0x55ac7d525380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:23.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.479+0000 7fc716a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63d680 0x55ac7d64df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.479+0000 7fc716a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63d680 0x55ac7d64df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39894/0 (socket says 172.21.15.2:39894) 2024-06-13T11:25:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.479+0000 7fc717400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d63cd60 0x55ac7d64da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.479+0000 7fc716a00700 1 -- 172.21.15.2:0/3195933185 learned_addr learned my addr 172.21.15.2:0/3195933185 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.479+0000 7fc717e00700 1 --2- 172.21.15.2:0/3195933185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d648530 0x55ac7d6baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.479+0000 7fc717400700 1 -- 172.21.15.2:0/3195933185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d648530 msgr2=0x55ac7d6baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.479+0000 7fc717400700 1 --2- 172.21.15.2:0/3195933185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d648530 0x55ac7d6baa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.479+0000 7fc717400700 1 -- 172.21.15.2:0/3195933185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63d680 msgr2=0x55ac7d64df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.479+0000 7fc717400700 1 --2- 172.21.15.2:0/3195933185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63d680 0x55ac7d64df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.479+0000 7fc717400700 1 -- 172.21.15.2:0/3195933185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac7d6bb050 con 0x55ac7d63cd60 2024-06-13T11:25:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.480+0000 7fc717400700 1 --2- 172.21.15.2:0/3195933185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d63cd60 0x55ac7d64da00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc708009930 tx=0x7fc7080ccf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceecf828937fd9f3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.480+0000 7fc701600700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:25:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.480+0000 7fc701600700 1 -- 172.21.15.2:0/3195933185 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7080b1070 con 0x55ac7d63cd60 2024-06-13T11:25:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.480+0000 7fc701600700 1 -- 172.21.15.2:0/3195933185 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fc70809c0b0 con 0x55ac7d63cd60 2024-06-13T11:25:23.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.480+0000 7fc729151b80 1 -- 172.21.15.2:0/3195933185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc708081070 con 0x55ac7d63cd60 2024-06-13T11:25:23.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.480+0000 7fc701600700 1 -- 172.21.15.2:0/3195933185 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc7080aa050 con 0x55ac7d63cd60 2024-06-13T11:25:23.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.480+0000 7fc729151b80 10 client.25481 fetch_fsmap learned FSMap version 27 2024-06-13T11:25:23.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.480+0000 7fc729151b80 1 -- 172.21.15.2:0/3195933185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ac7d6c23e0 con 0x55ac7d63cd60 2024-06-13T11:25:23.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.481+0000 7fc701600700 1 -- 172.21.15.2:0/3195933185 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc708081070 con 0x55ac7d63cd60 2024-06-13T11:25:23.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.481+0000 7fc701600700 1 -- 172.21.15.2:0/3195933185 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc70809ab10 con 0x55ac7d63cd60 2024-06-13T11:25:23.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.481+0000 7fc729151b80 10 client.25481 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:25:23.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.481+0000 7fc729151b80 10 client.25481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:25:23.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.481+0000 7fc729151b80 20 client.25481 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.481+0000 7fc729151b80 1 --2- 172.21.15.2:0/3195933185 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ac7d6c27f0 0x55ac7d6c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.481+0000 7fc729151b80 4 client.25481 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:25:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.481+0000 7fc729151b80 1 -- 172.21.15.2:0/3195933185 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ac7d597580 con 0x55ac7d6c27f0 2024-06-13T11:25:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.481+0000 7fc716a00700 1 --2- 172.21.15.2:0/3195933185 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ac7d6c27f0 0x55ac7d6c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.482+0000 7fc716a00700 1 --2- 172.21.15.2:0/3195933185 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ac7d6c27f0 0x55ac7d6c4be0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1715c9985275a8ea server_cookie=72cf038f9eab33fd in_seq=0 out_seq=0 2024-06-13T11:25:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.482+0000 7fc701600700 10 client.25481 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.482+0000 7fc701600700 1 -- 172.21.15.2:0/3195933185 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ac7d597580 con 0x55ac7d6c27f0 2024-06-13T11:25:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.482+0000 7fc701600700 10 client.25481 handle_command_reply: tid=0 2024-06-13T11:25:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.482+0000 7fc729151b80 1 client.25481 shutdown 2024-06-13T11:25:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.482+0000 7fc729151b80 1 -- 172.21.15.2:0/3195933185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d63cd60 msgr2=0x55ac7d64da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.482+0000 7fc729151b80 1 --2- 172.21.15.2:0/3195933185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d63cd60 0x55ac7d64da00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc708009930 tx=0x7fc7080ccf80 comp rx=0 tx=0).stop 2024-06-13T11:25:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.482+0000 7fc729151b80 1 -- 172.21.15.2:0/3195933185 shutdown_connections 2024-06-13T11:25:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.482+0000 7fc729151b80 1 --2- 172.21.15.2:0/3195933185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac7d648530 0x55ac7d6baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.482+0000 7fc729151b80 1 --2- 172.21.15.2:0/3195933185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac7d63cd60 0x55ac7d64da00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.482+0000 7fc729151b80 1 --2- 172.21.15.2:0/3195933185 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ac7d6c27f0 0x55ac7d6c4be0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.482+0000 7fc729151b80 1 --2- 172.21.15.2:0/3195933185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac7d63d680 0x55ac7d64df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.482+0000 7fc729151b80 1 -- 172.21.15.2:0/3195933185 >> 172.21.15.2:0/3195933185 conn(0x55ac7d56a170 msgr2=0x55ac7d6530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.482+0000 7fc701600700 0 client.25481 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.483+0000 7fc729151b80 1 -- 172.21.15.2:0/3195933185 shutdown_connections 2024-06-13T11:25:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.483+0000 7fc729151b80 1 -- 172.21.15.2:0/3195933185 wait complete. 2024-06-13T11:25:23.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.483+0000 7fc729151b80 20 client.25481 trim_cache size 0 max 16384 2024-06-13T11:25:23.484 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:25:23.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.483+0000 7fc71d200700 1 -- 172.21.15.2:0/647741218 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6fc0a2e10 msgr2=0x7fc6fc0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:23.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.483+0000 7fc71d200700 1 --2- 172.21.15.2:0/647741218 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6fc0a2e10 0x7fc6fc0a52d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc704000c00 tx=0x7fc704005fb0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.483+0000 7fc71d200700 1 -- 172.21.15.2:0/647741218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc718102620 msgr2=0x7fc71819ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:23.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.483+0000 7fc71d200700 1 --2- 172.21.15.2:0/647741218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc718102620 0x7fc71819ae00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc70800eb30 tx=0x7fc70800ee40 comp rx=0 tx=0).stop 2024-06-13T11:25:23.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.484+0000 7fc71d200700 1 -- 172.21.15.2:0/647741218 shutdown_connections 2024-06-13T11:25:23.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.484+0000 7fc71d200700 1 --2- 172.21.15.2:0/647741218 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6fc0a2e10 0x7fc6fc0a52d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.484+0000 7fc71d200700 1 --2- 172.21.15.2:0/647741218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc718102620 0x7fc71819ae00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.484+0000 7fc71d200700 1 --2- 172.21.15.2:0/647741218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc718107700 0x7fc71819f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.484+0000 7fc71d200700 1 --2- 172.21.15.2:0/647741218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc718102fd0 0x7fc71819b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:23.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.484+0000 7fc71d200700 1 -- 172.21.15.2:0/647741218 >> 172.21.15.2:0/647741218 conn(0x7fc7180fdf10 msgr2=0x7fc71810efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:23.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.484+0000 7fc71d200700 1 -- 172.21.15.2:0/647741218 shutdown_connections 2024-06-13T11:25:23.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:23.484+0000 7fc71d200700 1 -- 172.21.15.2:0/647741218 wait complete. 2024-06-13T11:25:23.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:23 smithi002 ceph-mon[32210]: pgmap v51: 129 pgs: 129 active+clean; 16 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-06-13T11:25:23.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:23 smithi077 ceph-mon[36410]: pgmap v51: 129 pgs: 129 active+clean; 16 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-06-13T11:25:23.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:23 smithi178 ceph-mon[36913]: pgmap v51: 129 pgs: 129 active+clean; 16 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 1.2 MiB/s wr, 17 op/s 2024-06-13T11:25:25.565 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-13T11:25:25.565 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-13T11:25:25.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:25 smithi077 ceph-mon[36410]: pgmap v52: 129 pgs: 129 active+clean; 16 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-06-13T11:25:25.894 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:25 smithi002 ceph-mon[32210]: pgmap v52: 129 pgs: 129 active+clean; 16 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-06-13T11:25:25.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:25 smithi178 ceph-mon[36913]: pgmap v52: 129 pgs: 129 active+clean; 16 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-06-13T11:25:26.042 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:25:27.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:27 smithi077 ceph-mon[36410]: pgmap v53: 129 pgs: 129 active+clean; 16 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-06-13T11:25:27.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:27 smithi002 ceph-mon[32210]: pgmap v53: 129 pgs: 129 active+clean; 16 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-06-13T11:25:27.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:27 smithi178 ceph-mon[36913]: pgmap v53: 129 pgs: 129 active+clean; 16 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 1.2 MiB/s wr, 14 op/s 2024-06-13T11:25:28.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.540+0000 7f32d3e00700 1 -- 172.21.15.2:0/4159016814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc10ee90 msgr2=0x7f32cc111280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:28.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.540+0000 7f32d3e00700 1 --2- 172.21.15.2:0/4159016814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc10ee90 0x7f32cc111280 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f32c400b0a0 tx=0x7f32c400b3b0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.540+0000 7f32d3e00700 1 -- 172.21.15.2:0/4159016814 shutdown_connections 2024-06-13T11:25:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.540+0000 7f32d3e00700 1 --2- 172.21.15.2:0/4159016814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc10ee90 0x7f32cc111280 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.540+0000 7f32d3e00700 1 --2- 172.21.15.2:0/4159016814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32cc0746c0 0x7f32cc074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.540+0000 7f32d3e00700 1 --2- 172.21.15.2:0/4159016814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32cc074fe0 0x7f32cc10e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.540+0000 7f32d3e00700 1 -- 172.21.15.2:0/4159016814 >> 172.21.15.2:0/4159016814 conn(0x7f32cc0795f0 msgr2=0x7f32cc079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.540+0000 7f32d3e00700 1 -- 172.21.15.2:0/4159016814 shutdown_connections 2024-06-13T11:25:28.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.540+0000 7f32d3e00700 1 -- 172.21.15.2:0/4159016814 wait complete. 2024-06-13T11:25:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.542+0000 7f32d3e00700 1 Processor -- start 2024-06-13T11:25:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.542+0000 7f32d3e00700 1 -- start start 2024-06-13T11:25:28.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.542+0000 7f32d3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32cc0746c0 0x7f32cc19ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.542+0000 7f32d3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc074fe0 0x7f32cc19b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.543+0000 7f32d3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32cc10ee90 0x7f32cc19f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.543+0000 7f32d3e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc114a10 con 0x7f32cc10ee90 2024-06-13T11:25:28.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.543+0000 7f32d3e00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc114890 con 0x7f32cc0746c0 2024-06-13T11:25:28.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.543+0000 7f32d3e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc114b90 con 0x7f32cc074fe0 2024-06-13T11:25:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.543+0000 7f32d1400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32cc0746c0 0x7f32cc19ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.543+0000 7f32d1400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32cc0746c0 0x7f32cc19ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:52402/0 (socket says 172.21.15.2:52402) 2024-06-13T11:25:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.543+0000 7f32d1400700 1 -- 172.21.15.2:0/3200211521 learned_addr learned my addr 172.21.15.2:0/3200211521 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.543+0000 7f32d1e00700 1 --2- 172.21.15.2:0/3200211521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32cc10ee90 0x7f32cc19f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.543+0000 7f32d0a00700 1 --2- 172.21.15.2:0/3200211521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc074fe0 0x7f32cc19b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.543+0000 7f32d1400700 1 -- 172.21.15.2:0/3200211521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc074fe0 msgr2=0x7f32cc19b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.543+0000 7f32d1400700 1 --2- 172.21.15.2:0/3200211521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc074fe0 0x7f32cc19b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.543+0000 7f32d1400700 1 -- 172.21.15.2:0/3200211521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32cc10ee90 msgr2=0x7f32cc19f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.543+0000 7f32d1400700 1 --2- 172.21.15.2:0/3200211521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32cc10ee90 0x7f32cc19f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.543+0000 7f32d1400700 1 -- 172.21.15.2:0/3200211521 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32cc19fdf0 con 0x7f32cc0746c0 2024-06-13T11:25:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.544+0000 7f32d1e00700 1 --2- 172.21.15.2:0/3200211521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32cc10ee90 0x7f32cc19f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.544+0000 7f32d1400700 1 --2- 172.21.15.2:0/3200211521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32cc0746c0 0x7f32cc19ade0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f32c000e9a0 tx=0x7f32c000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.544+0000 7f32ca000700 1 -- 172.21.15.2:0/3200211521 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c000ca10 con 0x7f32cc0746c0 2024-06-13T11:25:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.544+0000 7f32ca000700 1 -- 172.21.15.2:0/3200211521 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32c000cbb0 con 0x7f32cc0746c0 2024-06-13T11:25:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.544+0000 7f32ca000700 1 -- 172.21.15.2:0/3200211521 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c0018660 con 0x7f32cc0746c0 2024-06-13T11:25:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.544+0000 7f32d3e00700 1 -- 172.21.15.2:0/3200211521 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32cc1a00e0 con 0x7f32cc0746c0 2024-06-13T11:25:28.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.544+0000 7f32d3e00700 1 -- 172.21.15.2:0/3200211521 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32cc1a7960 con 0x7f32cc0746c0 2024-06-13T11:25:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.549+0000 7f32ca000700 1 -- 172.21.15.2:0/3200211521 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f32c0010430 con 0x7f32cc0746c0 2024-06-13T11:25:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.549+0000 7f32de732b80 1 Processor -- start 2024-06-13T11:25:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.550+0000 7f32de732b80 1 -- start start 2024-06-13T11:25:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.550+0000 7f32de732b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b97c10 0x5590e9b97ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.550+0000 7f32de732b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b98530 0x5590e9b91d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.550+0000 7f32de732b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b922c0 0x5590e9b92700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.550+0000 7f32de732b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5590e9aa0a90 con 0x5590e9b922c0 2024-06-13T11:25:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.550+0000 7f32de732b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5590e9ae3b80 con 0x5590e9b98530 2024-06-13T11:25:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.550+0000 7f32de732b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5590e9a9e970 con 0x5590e9b97c10 2024-06-13T11:25:28.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.550+0000 7f32d1e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b97c10 0x5590e9b97ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.550+0000 7f32d0a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b922c0 0x5590e9b92700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.550+0000 7f32d1e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b97c10 0x5590e9b97ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:38360/0 (socket says 172.21.15.2:38360) 2024-06-13T11:25:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.550+0000 7f32d1e00700 1 -- 172.21.15.2:0/2308994450 learned_addr learned my addr 172.21.15.2:0/2308994450 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.550+0000 7f32d1400700 1 --2- 172.21.15.2:0/2308994450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b98530 0x5590e9b91d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.551+0000 7f32d1e00700 1 -- 172.21.15.2:0/2308994450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b98530 msgr2=0x5590e9b91d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.551+0000 7f32d1e00700 1 --2- 172.21.15.2:0/2308994450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b98530 0x5590e9b91d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.551+0000 7f32d1e00700 1 -- 172.21.15.2:0/2308994450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b922c0 msgr2=0x5590e9b92700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.551+0000 7f32d1e00700 1 --2- 172.21.15.2:0/2308994450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b922c0 0x5590e9b92700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.551+0000 7f32d1e00700 1 -- 172.21.15.2:0/2308994450 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590e9a8c010 con 0x5590e9b97c10 2024-06-13T11:25:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.551+0000 7f32ca000700 1 --2- 172.21.15.2:0/3200211521 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f32b40a2e10 0x7f32b40a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.551+0000 7f32d1e00700 1 --2- 172.21.15.2:0/2308994450 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b97c10 0x5590e9b97ff0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f32c4015000 tx=0x7f32c4009d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8bbe7870dcdccb4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.551+0000 7f32ca000700 1 -- 172.21.15.2:0/3200211521 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f32c00cf990 con 0x7f32cc0746c0 2024-06-13T11:25:28.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.551+0000 7f32d1400700 1 --2- 172.21.15.2:0/3200211521 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f32b40a2e10 0x7f32b40a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.551+0000 7f32bea00700 1 -- 172.21.15.2:0/2308994450 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4021070 con 0x5590e9b97c10 2024-06-13T11:25:28.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.552+0000 7f32bea00700 1 -- 172.21.15.2:0/2308994450 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32c40074e0 con 0x5590e9b97c10 2024-06-13T11:25:28.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.552+0000 7f32bea00700 1 -- 172.21.15.2:0/2308994450 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4005280 con 0x5590e9b97c10 2024-06-13T11:25:28.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.552+0000 7f32de732b80 1 -- 172.21.15.2:0/2308994450 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b97c10 msgr2=0x5590e9b97ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:28.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.552+0000 7f32d1400700 1 --2- 172.21.15.2:0/3200211521 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f32b40a2e10 0x7f32b40a52d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f32c00096b0 tx=0x7f32c0009620 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:28.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.552+0000 7f32de732b80 1 --2- 172.21.15.2:0/2308994450 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b97c10 0x5590e9b97ff0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f32c4015000 tx=0x7f32c4009d90 comp rx=0 tx=0).stop 2024-06-13T11:25:28.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.553+0000 7f32de732b80 1 -- 172.21.15.2:0/2308994450 shutdown_connections 2024-06-13T11:25:28.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.553+0000 7f32de732b80 1 --2- 172.21.15.2:0/2308994450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b922c0 0x5590e9b92700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.553+0000 7f32de732b80 1 --2- 172.21.15.2:0/2308994450 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b97c10 0x5590e9b97ff0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.553+0000 7f32de732b80 1 --2- 172.21.15.2:0/2308994450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b98530 0x5590e9b91d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.553+0000 7f32de732b80 1 -- 172.21.15.2:0/2308994450 >> 172.21.15.2:0/2308994450 conn(0x5590e9abe1f0 msgr2=0x5590e9b8d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:28.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.553+0000 7f32de732b80 1 -- 172.21.15.2:0/2308994450 shutdown_connections 2024-06-13T11:25:28.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.553+0000 7f32de732b80 1 -- 172.21.15.2:0/2308994450 wait complete. 2024-06-13T11:25:28.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.553+0000 7f32de732b80 1 -- start start 2024-06-13T11:25:28.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.554+0000 7f32de732b80 1 Processor -- start 2024-06-13T11:25:28.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.554+0000 7f32de732b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b922c0 0x5590e9b9e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.554+0000 7f32de732b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b97c10 0x5590e9b9b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.554+0000 7f32de732b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b98530 0x5590e9b9ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.554+0000 7f32de732b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5590e9a7ffe0 con 0x5590e9b98530 2024-06-13T11:25:28.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.554+0000 7f32de732b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5590e9adfb40 con 0x5590e9b97c10 2024-06-13T11:25:28.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.554+0000 7f32de732b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5590e9b9eeb0 con 0x5590e9b922c0 2024-06-13T11:25:28.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.554+0000 7f32de732b80 10 client.0 _ll_register_callbacks cb 0x5590e9a79400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:28.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.555+0000 7f32d1e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b922c0 0x5590e9b9e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.555+0000 7f32d1e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b922c0 0x5590e9b9e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:38372/0 (socket says 172.21.15.2:38372) 2024-06-13T11:25:28.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.555+0000 7f32d1e00700 1 -- 172.21.15.2:0/2157606256 learned_addr learned my addr 172.21.15.2:0/2157606256 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:28.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.555+0000 7f32d0a00700 1 --2- 172.21.15.2:0/2157606256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b97c10 0x5590e9b9b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.555+0000 7f32d1e00700 1 --2- 172.21.15.2:0/2157606256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b98530 0x5590e9b9ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.555+0000 7f32d1e00700 1 -- 172.21.15.2:0/2157606256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b97c10 msgr2=0x5590e9b9b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:28.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.555+0000 7f32d1e00700 1 --2- 172.21.15.2:0/2157606256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b97c10 0x5590e9b9b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.555+0000 7f32d1e00700 1 -- 172.21.15.2:0/2157606256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b98530 msgr2=0x5590e9b9ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:28.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.555+0000 7f32d1e00700 1 --2- 172.21.15.2:0/2157606256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b98530 0x5590e9b9ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.555+0000 7f32d1e00700 1 -- 172.21.15.2:0/2157606256 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590e9a32950 con 0x5590e9b922c0 2024-06-13T11:25:28.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.555+0000 7f32d1e00700 1 --2- 172.21.15.2:0/2157606256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b922c0 0x5590e9b9e250 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f32c4009610 tx=0x7f32c4007e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88d68dadd887148e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.555+0000 7f32b3400700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:25:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.556+0000 7f32b3400700 1 -- 172.21.15.2:0/2157606256 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4021070 con 0x5590e9b922c0 2024-06-13T11:25:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.556+0000 7f32de732b80 1 -- 172.21.15.2:0/2157606256 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32c40074e0 con 0x5590e9b922c0 2024-06-13T11:25:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.556+0000 7f32b3400700 1 -- 172.21.15.2:0/2157606256 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f32c40078d0 con 0x5590e9b922c0 2024-06-13T11:25:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.556+0000 7f32b3400700 1 -- 172.21.15.2:0/2157606256 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f32c403a050 con 0x5590e9b922c0 2024-06-13T11:25:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.556+0000 7f32de732b80 10 client.25525 fetch_fsmap learned FSMap version 27 2024-06-13T11:25:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.556+0000 7f32de732b80 1 -- 172.21.15.2:0/2157606256 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5590e9ba9610 con 0x5590e9b922c0 2024-06-13T11:25:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.556+0000 7f32b3400700 1 -- 172.21.15.2:0/2157606256 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32c40074e0 con 0x5590e9b922c0 2024-06-13T11:25:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.557+0000 7f32b3400700 1 -- 172.21.15.2:0/2157606256 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f32c4011070 con 0x5590e9b922c0 2024-06-13T11:25:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.557+0000 7f32de732b80 10 client.25525 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:25:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.557+0000 7f32de732b80 10 client.25525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:25:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.557+0000 7f32de732b80 20 client.25525 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.557+0000 7f32de732b80 1 --2- 172.21.15.2:0/2157606256 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5590e9babae0 0x5590e9baded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.557+0000 7f32de732b80 4 client.25525 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:25:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.557+0000 7f32de732b80 1 -- 172.21.15.2:0/2157606256 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590e9af1080 con 0x5590e9babae0 2024-06-13T11:25:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.557+0000 7f32d0a00700 1 --2- 172.21.15.2:0/2157606256 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5590e9babae0 0x5590e9baded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.558+0000 7f32d0a00700 1 --2- 172.21.15.2:0/2157606256 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5590e9babae0 0x5590e9baded0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4a58b27ce1225fe server_cookie=cbfe2069820ebcbb in_seq=0 out_seq=0 2024-06-13T11:25:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.558+0000 7f32b3400700 10 client.25525 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:28.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.559+0000 7f32b3400700 1 -- 172.21.15.2:0/2157606256 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5590e9af1080 con 0x5590e9babae0 2024-06-13T11:25:28.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.559+0000 7f32b3400700 10 client.25525 handle_command_reply: tid=0 2024-06-13T11:25:28.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.559+0000 7f32de732b80 1 client.25525 shutdown 2024-06-13T11:25:28.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.559+0000 7f32de732b80 1 -- 172.21.15.2:0/2157606256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b922c0 msgr2=0x5590e9b9e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:28.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.559+0000 7f32de732b80 1 --2- 172.21.15.2:0/2157606256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b922c0 0x5590e9b9e250 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f32c4009610 tx=0x7f32c4007e30 comp rx=0 tx=0).stop 2024-06-13T11:25:28.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.559+0000 7f32de732b80 1 -- 172.21.15.2:0/2157606256 shutdown_connections 2024-06-13T11:25:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.559+0000 7f32de732b80 1 --2- 172.21.15.2:0/2157606256 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5590e9babae0 0x5590e9baded0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.560+0000 7f32de732b80 1 --2- 172.21.15.2:0/2157606256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b98530 0x5590e9b9ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.560+0000 7f32de732b80 1 --2- 172.21.15.2:0/2157606256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b922c0 0x5590e9b9e250 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.560+0000 7f32de732b80 1 --2- 172.21.15.2:0/2157606256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b97c10 0x5590e9b9b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.560+0000 7f32de732b80 1 -- 172.21.15.2:0/2157606256 >> 172.21.15.2:0/2157606256 conn(0x5590e9abe1f0 msgr2=0x5590e9b86810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.560+0000 7f32b3400700 0 client.25525 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.560+0000 7f32de732b80 1 -- 172.21.15.2:0/2157606256 shutdown_connections 2024-06-13T11:25:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.560+0000 7f32de732b80 1 -- 172.21.15.2:0/2157606256 wait complete. 2024-06-13T11:25:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.560+0000 7f32de732b80 20 client.25525 trim_cache size 0 max 16384 2024-06-13T11:25:28.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.588+0000 7f32de732b80 1 Processor -- start 2024-06-13T11:25:28.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.588+0000 7f32de732b80 1 -- start start 2024-06-13T11:25:28.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.589+0000 7f32de732b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b922c0 0x5590e9b91d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.589+0000 7f32de732b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b97c10 0x5590e9b871b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.589+0000 7f32de732b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b98530 0x5590e9b9d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.589+0000 7f32de732b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc1b2e60 con 0x5590e9b97c10 2024-06-13T11:25:28.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.589+0000 7f32de732b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc1b06f0 con 0x5590e9b922c0 2024-06-13T11:25:28.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.589+0000 7f32de732b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc1ae540 con 0x5590e9b98530 2024-06-13T11:25:28.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.589+0000 7f32d1e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b922c0 0x5590e9b91d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.589+0000 7f32d1e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b922c0 0x5590e9b91d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:52420/0 (socket says 172.21.15.2:52420) 2024-06-13T11:25:28.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.589+0000 7f32d1e00700 1 -- 172.21.15.2:0/3701593308 learned_addr learned my addr 172.21.15.2:0/3701593308 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:28.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.589+0000 7f32d1e00700 1 --2- 172.21.15.2:0/3701593308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b98530 0x5590e9b9d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.589+0000 7f32d0a00700 1 --2- 172.21.15.2:0/3701593308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b97c10 0x5590e9b871b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.590+0000 7f32d1e00700 1 -- 172.21.15.2:0/3701593308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b922c0 msgr2=0x5590e9b91d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:28.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.590+0000 7f32d1e00700 1 --2- 172.21.15.2:0/3701593308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b922c0 0x5590e9b91d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.590+0000 7f32d1e00700 1 -- 172.21.15.2:0/3701593308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b97c10 msgr2=0x5590e9b871b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:28.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.590+0000 7f32d1e00700 1 --2- 172.21.15.2:0/3701593308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b97c10 0x5590e9b871b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.590+0000 7f32d1e00700 1 -- 172.21.15.2:0/3701593308 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590e9b8e3d0 con 0x5590e9b98530 2024-06-13T11:25:28.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.590+0000 7f32d1e00700 1 --2- 172.21.15.2:0/3701593308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b98530 0x5590e9b9d610 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f32c400b0a0 tx=0x7f32c4000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8621b559858d8d80 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:28.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.590+0000 7f32be000700 1 -- 172.21.15.2:0/3701593308 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4021040 con 0x5590e9b98530 2024-06-13T11:25:28.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.590+0000 7f32be000700 1 -- 172.21.15.2:0/3701593308 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32c40092e0 con 0x5590e9b98530 2024-06-13T11:25:28.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.590+0000 7f32be000700 1 -- 172.21.15.2:0/3701593308 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c40259b0 con 0x5590e9b98530 2024-06-13T11:25:28.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.591+0000 7f32de732b80 1 -- 172.21.15.2:0/3701593308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b98530 msgr2=0x5590e9b9d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:28.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.591+0000 7f32de732b80 1 --2- 172.21.15.2:0/3701593308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b98530 0x5590e9b9d610 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f32c400b0a0 tx=0x7f32c4000f40 comp rx=0 tx=0).stop 2024-06-13T11:25:28.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.591+0000 7f32de732b80 1 -- 172.21.15.2:0/3701593308 shutdown_connections 2024-06-13T11:25:28.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.591+0000 7f32de732b80 1 --2- 172.21.15.2:0/3701593308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b98530 0x5590e9b9d610 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.591+0000 7f32de732b80 1 --2- 172.21.15.2:0/3701593308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b922c0 0x5590e9b91d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.591+0000 7f32de732b80 1 --2- 172.21.15.2:0/3701593308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b97c10 0x5590e9b871b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.591+0000 7f32de732b80 1 -- 172.21.15.2:0/3701593308 >> 172.21.15.2:0/3701593308 conn(0x5590e9abe1f0 msgr2=0x5590e9b98f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:28.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.591+0000 7f32de732b80 1 -- 172.21.15.2:0/3701593308 shutdown_connections 2024-06-13T11:25:28.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.591+0000 7f32de732b80 1 -- 172.21.15.2:0/3701593308 wait complete. 2024-06-13T11:25:28.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.592+0000 7f32de732b80 1 -- start start 2024-06-13T11:25:28.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.592+0000 7f32de732b80 1 Processor -- start 2024-06-13T11:25:28.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.592+0000 7f32de732b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b922c0 0x5590e9bb13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.592+0000 7f32de732b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b97c10 0x5590e9baf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.592+0000 7f32de732b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b98530 0x5590e9bafc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.592+0000 7f32de732b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc1aebb0 con 0x5590e9b922c0 2024-06-13T11:25:28.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.592+0000 7f32de732b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc1b0020 con 0x5590e9b97c10 2024-06-13T11:25:28.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.592+0000 7f32de732b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc1af280 con 0x5590e9b98530 2024-06-13T11:25:28.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.593+0000 7f32de732b80 10 client.0 _ll_register_callbacks cb 0x5590e9a79400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:28.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.593+0000 7f32d0a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b97c10 0x5590e9baf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.593+0000 7f32d1e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b922c0 0x5590e9bb13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.593+0000 7f32d0a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b97c10 0x5590e9baf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:52428/0 (socket says 172.21.15.2:52428) 2024-06-13T11:25:28.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.593+0000 7f32d0a00700 1 -- 172.21.15.2:0/1578452592 learned_addr learned my addr 172.21.15.2:0/1578452592 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:28.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.593+0000 7f32d1e00700 1 --2- 172.21.15.2:0/1578452592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b98530 0x5590e9bafc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.593+0000 7f32d0a00700 1 -- 172.21.15.2:0/1578452592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b98530 msgr2=0x5590e9bafc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:28.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.593+0000 7f32d0a00700 1 --2- 172.21.15.2:0/1578452592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b98530 0x5590e9bafc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.593+0000 7f32d0a00700 1 -- 172.21.15.2:0/1578452592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b922c0 msgr2=0x5590e9bb13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:28.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.593+0000 7f32d0a00700 1 --2- 172.21.15.2:0/1578452592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b922c0 0x5590e9bb13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.593+0000 7f32d0a00700 1 -- 172.21.15.2:0/1578452592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590e9bb0250 con 0x5590e9b97c10 2024-06-13T11:25:28.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.594+0000 7f32d0a00700 1 --2- 172.21.15.2:0/1578452592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b97c10 0x5590e9baf750 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5590e9a7ffe0 tx=0x7f32b8010710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38d3f32ee2b6162d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:28.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.594+0000 7f32b3400700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:25:28.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.594+0000 7f32b3400700 1 -- 172.21.15.2:0/1578452592 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8004a30 con 0x5590e9b97c10 2024-06-13T11:25:28.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.594+0000 7f32de732b80 1 -- 172.21.15.2:0/1578452592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5590e9aeb600 con 0x5590e9b97c10 2024-06-13T11:25:28.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.594+0000 7f32b3400700 1 -- 172.21.15.2:0/1578452592 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f32b8004bd0 con 0x5590e9b97c10 2024-06-13T11:25:28.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.594+0000 7f32b3400700 1 -- 172.21.15.2:0/1578452592 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f32b802f050 con 0x5590e9b97c10 2024-06-13T11:25:28.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.594+0000 7f32de732b80 10 client.25499 fetch_fsmap learned FSMap version 27 2024-06-13T11:25:28.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.594+0000 7f32de732b80 1 -- 172.21.15.2:0/1578452592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5590e9c172f0 con 0x5590e9b97c10 2024-06-13T11:25:28.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.595+0000 7f32b3400700 1 -- 172.21.15.2:0/1578452592 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5590e9aeb600 con 0x5590e9b97c10 2024-06-13T11:25:28.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.595+0000 7f32b3400700 1 -- 172.21.15.2:0/1578452592 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f32b8025030 con 0x5590e9b97c10 2024-06-13T11:25:28.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.595+0000 7f32de732b80 10 client.25499 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T11:25:28.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.595+0000 7f32de732b80 10 client.25499 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:25:28.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.595+0000 7f32de732b80 20 client.25499 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:28.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.595+0000 7f32de732b80 1 --2- 172.21.15.2:0/1578452592 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5590e9c179e0 0x5590e9c19e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:28.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.595+0000 7f32de732b80 4 client.25499 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-13T11:25:28.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.595+0000 7f32de732b80 1 -- 172.21.15.2:0/1578452592 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5590e99652d0 con 0x5590e9c179e0 2024-06-13T11:25:28.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.595+0000 7f32d1e00700 1 --2- 172.21.15.2:0/1578452592 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5590e9c179e0 0x5590e9c19e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:28.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.597+0000 7f32d1e00700 1 --2- 172.21.15.2:0/1578452592 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5590e9c179e0 0x5590e9c19e00 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b8305b25fcc57bf server_cookie=1729ed53a690efb2 in_seq=0 out_seq=0 2024-06-13T11:25:28.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.597+0000 7f32b3400700 10 client.25499 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:28.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.598+0000 7f32b3400700 1 -- 172.21.15.2:0/1578452592 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5590e99652d0 con 0x5590e9c179e0 2024-06-13T11:25:28.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.598+0000 7f32b3400700 10 client.25499 handle_command_reply: tid=0 2024-06-13T11:25:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.598+0000 7f32de732b80 1 client.25499 shutdown 2024-06-13T11:25:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.599+0000 7f32de732b80 1 -- 172.21.15.2:0/1578452592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b97c10 msgr2=0x5590e9baf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.599+0000 7f32de732b80 1 --2- 172.21.15.2:0/1578452592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b97c10 0x5590e9baf750 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5590e9a7ffe0 tx=0x7f32b8010710 comp rx=0 tx=0).stop 2024-06-13T11:25:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.599+0000 7f32de732b80 1 -- 172.21.15.2:0/1578452592 shutdown_connections 2024-06-13T11:25:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.599+0000 7f32de732b80 1 --2- 172.21.15.2:0/1578452592 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5590e9c179e0 0x5590e9c19e00 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.599+0000 7f32de732b80 1 --2- 172.21.15.2:0/1578452592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5590e9b922c0 0x5590e9bb13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.599+0000 7f32de732b80 1 --2- 172.21.15.2:0/1578452592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590e9b98530 0x5590e9bafc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.599+0000 7f32de732b80 1 --2- 172.21.15.2:0/1578452592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590e9b97c10 0x5590e9baf750 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.599+0000 7f32de732b80 1 -- 172.21.15.2:0/1578452592 >> 172.21.15.2:0/1578452592 conn(0x5590e9abe1f0 msgr2=0x5590e9b9d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.599+0000 7f32b3400700 0 client.25499 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.599+0000 7f32de732b80 1 -- 172.21.15.2:0/1578452592 shutdown_connections 2024-06-13T11:25:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.599+0000 7f32de732b80 1 -- 172.21.15.2:0/1578452592 wait complete. 2024-06-13T11:25:28.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.599+0000 7f32de732b80 20 client.25499 trim_cache size 0 max 16384 2024-06-13T11:25:28.600 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:25:28.600 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-06-13T11:25:28.600 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "37588bfe-3cbc-4c2f-9ff5-045af6148bc3", 2024-06-13T11:25:28.600 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-06-13T11:25:28.600 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:25:28.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.600+0000 7f32d3e00700 1 -- 172.21.15.2:0/3200211521 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f32b40a2e10 msgr2=0x7f32b40a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:28.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.600+0000 7f32d3e00700 1 --2- 172.21.15.2:0/3200211521 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f32b40a2e10 0x7f32b40a52d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f32c00096b0 tx=0x7f32c0009620 comp rx=0 tx=0).stop 2024-06-13T11:25:28.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.600+0000 7f32d3e00700 1 -- 172.21.15.2:0/3200211521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32cc0746c0 msgr2=0x7f32cc19ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:28.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.600+0000 7f32d3e00700 1 --2- 172.21.15.2:0/3200211521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32cc0746c0 0x7f32cc19ade0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f32c000e9a0 tx=0x7f32c000ecb0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.600+0000 7f32d3e00700 1 -- 172.21.15.2:0/3200211521 shutdown_connections 2024-06-13T11:25:28.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.600+0000 7f32d3e00700 1 --2- 172.21.15.2:0/3200211521 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f32b40a2e10 0x7f32b40a52d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.600+0000 7f32d3e00700 1 --2- 172.21.15.2:0/3200211521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32cc10ee90 0x7f32cc19f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.600+0000 7f32d3e00700 1 --2- 172.21.15.2:0/3200211521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32cc0746c0 0x7f32cc19ade0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.600+0000 7f32d3e00700 1 --2- 172.21.15.2:0/3200211521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32cc074fe0 0x7f32cc19b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:28.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.600+0000 7f32d3e00700 1 -- 172.21.15.2:0/3200211521 >> 172.21.15.2:0/3200211521 conn(0x7f32cc0795f0 msgr2=0x7f32cc0ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:28.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.600+0000 7f32d3e00700 1 -- 172.21.15.2:0/3200211521 shutdown_connections 2024-06-13T11:25:28.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:28.600+0000 7f32d3e00700 1 -- 172.21.15.2:0/3200211521 wait complete. 2024-06-13T11:25:29.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:29 smithi002 ceph-mon[32210]: pgmap v54: 129 pgs: 129 active+clean; 17 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 1.4 MiB/s wr, 19 op/s 2024-06-13T11:25:29.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:29 smithi002 ceph-mon[32210]: scrub queued for path: / 2024-06-13T11:25:29.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:29 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:29.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:29 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:25:29.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:29 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:29.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:29 smithi077 ceph-mon[36410]: pgmap v54: 129 pgs: 129 active+clean; 17 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 1.4 MiB/s wr, 19 op/s 2024-06-13T11:25:29.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:29 smithi077 ceph-mon[36410]: scrub queued for path: / 2024-06-13T11:25:29.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:29 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:29.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:29 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:25:29.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:29 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:29.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:25:29.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:29 smithi178 ceph-mon[36913]: pgmap v54: 129 pgs: 129 active+clean; 17 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 1.4 MiB/s wr, 19 op/s 2024-06-13T11:25:29.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:29 smithi178 ceph-mon[36913]: scrub queued for path: / 2024-06-13T11:25:29.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:29 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:29.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:29 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:25:29.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:29 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:30.301 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:25:31.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:31 smithi077 ceph-mon[36410]: pgmap v55: 129 pgs: 129 active+clean; 17 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 198 KiB/s wr, 11 op/s 2024-06-13T11:25:31.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:31 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:25:31.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:31 smithi002 ceph-mon[32210]: pgmap v55: 129 pgs: 129 active+clean; 17 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 198 KiB/s wr, 11 op/s 2024-06-13T11:25:31.824 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:31 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:25:31.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:31 smithi178 ceph-mon[36913]: pgmap v55: 129 pgs: 129 active+clean; 17 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 198 KiB/s wr, 11 op/s 2024-06-13T11:25:31.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:31 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:25:32.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.697+0000 7fd846a00700 1 -- 172.21.15.2:0/3879758830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8401030f0 msgr2=0x7fd840107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:32.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.697+0000 7fd846a00700 1 --2- 172.21.15.2:0/3879758830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8401030f0 0x7fd840107110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009920 tx=0x7fd82c009c30 comp rx=0 tx=0).stop 2024-06-13T11:25:32.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.697+0000 7fd846a00700 1 -- 172.21.15.2:0/3879758830 shutdown_connections 2024-06-13T11:25:32.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.697+0000 7fd846a00700 1 --2- 172.21.15.2:0/3879758830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd840107840 0x7fd84010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.697+0000 7fd846a00700 1 --2- 172.21.15.2:0/3879758830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd840102740 0x7fd840102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.697+0000 7fd846a00700 1 --2- 172.21.15.2:0/3879758830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8401030f0 0x7fd840107110 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.698+0000 7fd846a00700 1 -- 172.21.15.2:0/3879758830 >> 172.21.15.2:0/3879758830 conn(0x7fd8400795f0 msgr2=0x7fd840079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:32.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.698+0000 7fd846a00700 1 -- 172.21.15.2:0/3879758830 shutdown_connections 2024-06-13T11:25:32.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.698+0000 7fd846a00700 1 -- 172.21.15.2:0/3879758830 wait complete. 2024-06-13T11:25:32.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.699+0000 7fd846a00700 1 Processor -- start 2024-06-13T11:25:32.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.699+0000 7fd846a00700 1 -- start start 2024-06-13T11:25:32.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.699+0000 7fd846a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd840102740 0x7fd84019ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.699+0000 7fd846a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8401030f0 0x7fd84019b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.700+0000 7fd846a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd840107840 0x7fd84019f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.700+0000 7fd846a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd8401127a0 con 0x7fd840102740 2024-06-13T11:25:32.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.700+0000 7fd846a00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd840112620 con 0x7fd8401030f0 2024-06-13T11:25:32.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.700+0000 7fd846a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd840112920 con 0x7fd840107840 2024-06-13T11:25:32.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.700+0000 7fd83fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd840102740 0x7fd84019ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.700+0000 7fd844a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd840107840 0x7fd84019f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.700+0000 7fd83f400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8401030f0 0x7fd84019b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.700+0000 7fd83fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd840102740 0x7fd84019ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42744/0 (socket says 172.21.15.2:42744) 2024-06-13T11:25:32.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.700+0000 7fd83fe00700 1 -- 172.21.15.2:0/960129874 learned_addr learned my addr 172.21.15.2:0/960129874 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:32.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.700+0000 7fd844a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd840107840 0x7fd84019f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:38410/0 (socket says 172.21.15.2:38410) 2024-06-13T11:25:32.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.700+0000 7fd844a00700 1 -- 172.21.15.2:0/960129874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8401030f0 msgr2=0x7fd84019b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:32.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.700+0000 7fd844a00700 1 --2- 172.21.15.2:0/960129874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8401030f0 0x7fd84019b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.700+0000 7fd844a00700 1 -- 172.21.15.2:0/960129874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd840102740 msgr2=0x7fd84019ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:32.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.700+0000 7fd844a00700 1 --2- 172.21.15.2:0/960129874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd840102740 0x7fd84019ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.700+0000 7fd844a00700 1 -- 172.21.15.2:0/960129874 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd84019fea0 con 0x7fd840107840 2024-06-13T11:25:32.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.701+0000 7fd844a00700 1 --2- 172.21.15.2:0/960129874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd840107840 0x7fd84019f760 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd83800efc0 tx=0x7fd83800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:32.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.701+0000 7fd83cc00700 1 -- 172.21.15.2:0/960129874 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8380092e0 con 0x7fd840107840 2024-06-13T11:25:32.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.701+0000 7fd83cc00700 1 -- 172.21.15.2:0/960129874 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd838004bb0 con 0x7fd840107840 2024-06-13T11:25:32.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.701+0000 7fd846a00700 1 -- 172.21.15.2:0/960129874 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8401a0130 con 0x7fd840107840 2024-06-13T11:25:32.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.701+0000 7fd83cc00700 1 -- 172.21.15.2:0/960129874 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd838004280 con 0x7fd840107840 2024-06-13T11:25:32.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.701+0000 7fd846a00700 1 -- 172.21.15.2:0/960129874 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8401a7a10 con 0x7fd840107840 2024-06-13T11:25:32.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.704+0000 7fd83cc00700 1 -- 172.21.15.2:0/960129874 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fd83801b030 con 0x7fd840107840 2024-06-13T11:25:32.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.706+0000 7fd83cc00700 1 --2- 172.21.15.2:0/960129874 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd8240a2d90 0x7fd8240a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.706+0000 7fd83cc00700 1 -- 172.21.15.2:0/960129874 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fd8380cf380 con 0x7fd840107840 2024-06-13T11:25:32.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.706+0000 7fd83fe00700 1 --2- 172.21.15.2:0/960129874 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd8240a2d90 0x7fd8240a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.707+0000 7fd83fe00700 1 --2- 172.21.15.2:0/960129874 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd8240a2d90 0x7fd8240a5250 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd830005950 tx=0x7fd830009310 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:32.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.707+0000 7fd851362b80 1 Processor -- start 2024-06-13T11:25:32.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.707+0000 7fd851362b80 1 -- start start 2024-06-13T11:25:32.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.708+0000 7fd851362b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 0x55cca6119070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.708+0000 7fd851362b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca61195b0 0x55cca6119a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.708+0000 7fd851362b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca6124300 0x55cca61266f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.708+0000 7fd851362b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cca6028a10 con 0x55cca61195b0 2024-06-13T11:25:32.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.708+0000 7fd851362b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cca606bb00 con 0x55cca6095e40 2024-06-13T11:25:32.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.708+0000 7fd851362b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55cca60268f0 con 0x55cca6124300 2024-06-13T11:25:32.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.708+0000 7fd83f400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca61195b0 0x55cca6119a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.708+0000 7fd83fe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 0x55cca6119070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.708+0000 7fd83f400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca61195b0 0x55cca6119a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42758/0 (socket says 172.21.15.2:42758) 2024-06-13T11:25:32.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.708+0000 7fd83f400700 1 -- 172.21.15.2:0/2634328853 learned_addr learned my addr 172.21.15.2:0/2634328853 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:32.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.708+0000 7fd844a00700 1 --2- 172.21.15.2:0/2634328853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca6124300 0x55cca61266f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.709+0000 7fd83fe00700 1 -- 172.21.15.2:0/2634328853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca6124300 msgr2=0x55cca61266f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:32.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.709+0000 7fd83fe00700 1 --2- 172.21.15.2:0/2634328853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca6124300 0x55cca61266f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.709+0000 7fd83fe00700 1 -- 172.21.15.2:0/2634328853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca61195b0 msgr2=0x55cca6119a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:32.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.709+0000 7fd83fe00700 1 --2- 172.21.15.2:0/2634328853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca61195b0 0x55cca6119a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.709+0000 7fd83fe00700 1 -- 172.21.15.2:0/2634328853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cca6013f90 con 0x55cca6095e40 2024-06-13T11:25:32.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.709+0000 7fd83f400700 1 --2- 172.21.15.2:0/2634328853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca61195b0 0x55cca6119a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:32.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.709+0000 7fd83fe00700 1 --2- 172.21.15.2:0/2634328853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 0x55cca6119070 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd830004180 tx=0x7fd830014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9db4ea6d2a6ab0c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:32.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.709+0000 7fd835600700 1 -- 172.21.15.2:0/2634328853 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd830003b10 con 0x55cca6095e40 2024-06-13T11:25:32.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.710+0000 7fd835600700 1 -- 172.21.15.2:0/2634328853 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd830003cb0 con 0x55cca6095e40 2024-06-13T11:25:32.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.710+0000 7fd835600700 1 -- 172.21.15.2:0/2634328853 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd830026750 con 0x55cca6095e40 2024-06-13T11:25:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.710+0000 7fd851362b80 1 -- 172.21.15.2:0/2634328853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 msgr2=0x55cca6119070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.710+0000 7fd851362b80 1 --2- 172.21.15.2:0/2634328853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 0x55cca6119070 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd830004180 tx=0x7fd830014000 comp rx=0 tx=0).stop 2024-06-13T11:25:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.711+0000 7fd851362b80 1 -- 172.21.15.2:0/2634328853 shutdown_connections 2024-06-13T11:25:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.711+0000 7fd851362b80 1 --2- 172.21.15.2:0/2634328853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca6124300 0x55cca61266f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.711+0000 7fd851362b80 1 --2- 172.21.15.2:0/2634328853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 0x55cca6119070 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.711+0000 7fd851362b80 1 --2- 172.21.15.2:0/2634328853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca61195b0 0x55cca6119a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.711+0000 7fd851362b80 1 -- 172.21.15.2:0/2634328853 >> 172.21.15.2:0/2634328853 conn(0x55cca6046170 msgr2=0x55cca61154b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.711+0000 7fd851362b80 1 -- 172.21.15.2:0/2634328853 shutdown_connections 2024-06-13T11:25:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.711+0000 7fd851362b80 1 -- 172.21.15.2:0/2634328853 wait complete. 2024-06-13T11:25:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.711+0000 7fd851362b80 1 -- start start 2024-06-13T11:25:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.712+0000 7fd851362b80 1 Processor -- start 2024-06-13T11:25:32.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.712+0000 7fd851362b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 0x55cca6123a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.712+0000 7fd851362b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca61195b0 0x55cca6120d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.712+0000 7fd851362b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca6124300 0x55cca6121280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.712+0000 7fd851362b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cca6007f60 con 0x55cca6124300 2024-06-13T11:25:32.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.712+0000 7fd851362b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cca6067ac0 con 0x55cca6095e40 2024-06-13T11:25:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.712+0000 7fd851362b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55cca6126fc0 con 0x55cca61195b0 2024-06-13T11:25:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.712+0000 7fd851362b80 10 client.0 _ll_register_callbacks cb 0x55cca6005720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:32.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.713+0000 7fd83f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca61195b0 0x55cca6120d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.713+0000 7fd83f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca61195b0 0x55cca6120d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:38432/0 (socket says 172.21.15.2:38432) 2024-06-13T11:25:32.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.713+0000 7fd83f400700 1 -- 172.21.15.2:0/3112777699 learned_addr learned my addr 172.21.15.2:0/3112777699 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:32.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.713+0000 7fd844a00700 1 --2- 172.21.15.2:0/3112777699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca6124300 0x55cca6121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.713+0000 7fd83fe00700 1 --2- 172.21.15.2:0/3112777699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 0x55cca6123a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.713+0000 7fd83f400700 1 -- 172.21.15.2:0/3112777699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 msgr2=0x55cca6123a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:32.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.713+0000 7fd83f400700 1 --2- 172.21.15.2:0/3112777699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 0x55cca6123a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.713+0000 7fd83f400700 1 -- 172.21.15.2:0/3112777699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca6124300 msgr2=0x55cca6121280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:32.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.713+0000 7fd83f400700 1 --2- 172.21.15.2:0/3112777699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca6124300 0x55cca6121280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.713+0000 7fd83f400700 1 -- 172.21.15.2:0/3112777699 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cca5fba8d0 con 0x55cca61195b0 2024-06-13T11:25:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.714+0000 7fd83f400700 1 --2- 172.21.15.2:0/3112777699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca61195b0 0x55cca6120d40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00a010 tx=0x7fd82c0094e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d0e3f3c707c0582 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.714+0000 7fd82a000700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:25:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.714+0000 7fd82a000700 1 -- 172.21.15.2:0/3112777699 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c027030 con 0x55cca61195b0 2024-06-13T11:25:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.714+0000 7fd851362b80 1 -- 172.21.15.2:0/3112777699 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd830003cb0 con 0x55cca61195b0 2024-06-13T11:25:32.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.714+0000 7fd82a000700 1 -- 172.21.15.2:0/3112777699 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fd82c005250 con 0x55cca61195b0 2024-06-13T11:25:32.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.714+0000 7fd82a000700 1 -- 172.21.15.2:0/3112777699 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd82c031050 con 0x55cca61195b0 2024-06-13T11:25:32.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.714+0000 7fd851362b80 10 client.25543 fetch_fsmap learned FSMap version 28 2024-06-13T11:25:32.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.714+0000 7fd851362b80 1 -- 172.21.15.2:0/3112777699 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cca61316b0 con 0x55cca61195b0 2024-06-13T11:25:32.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.715+0000 7fd82a000700 1 -- 172.21.15.2:0/3112777699 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd830003cb0 con 0x55cca61195b0 2024-06-13T11:25:32.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.715+0000 7fd82a000700 1 -- 172.21.15.2:0/3112777699 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7fd82c00b7c0 con 0x55cca61195b0 2024-06-13T11:25:32.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.715+0000 7fd851362b80 10 client.25543 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T11:25:32.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.715+0000 7fd851362b80 10 client.25543 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:25:32.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.715+0000 7fd851362b80 20 client.25543 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:32.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.715+0000 7fd851362b80 1 --2- 172.21.15.2:0/3112777699 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55cca6133d30 0x55cca6136150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.715+0000 7fd851362b80 4 client.25543 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:25:32.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.715+0000 7fd851362b80 1 -- 172.21.15.2:0/3112777699 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cca6079000 con 0x55cca6133d30 2024-06-13T11:25:32.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.715+0000 7fd83fe00700 1 --2- 172.21.15.2:0/3112777699 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55cca6133d30 0x55cca6136150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.716+0000 7fd83fe00700 1 --2- 172.21.15.2:0/3112777699 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55cca6133d30 0x55cca6136150 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ff9f46ce6563a06 server_cookie=2775b1bf21fac9fc in_seq=0 out_seq=0 2024-06-13T11:25:32.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.716+0000 7fd82a000700 10 client.25543 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:32.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.717+0000 7fd82a000700 1 -- 172.21.15.2:0/3112777699 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55cca6079000 con 0x55cca6133d30 2024-06-13T11:25:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.717+0000 7fd82a000700 10 client.25543 handle_command_reply: tid=0 2024-06-13T11:25:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.717+0000 7fd851362b80 1 client.25543 shutdown 2024-06-13T11:25:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.718+0000 7fd851362b80 1 -- 172.21.15.2:0/3112777699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca61195b0 msgr2=0x55cca6120d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.718+0000 7fd851362b80 1 --2- 172.21.15.2:0/3112777699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca61195b0 0x55cca6120d40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00a010 tx=0x7fd82c0094e0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.718+0000 7fd851362b80 1 -- 172.21.15.2:0/3112777699 shutdown_connections 2024-06-13T11:25:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.718+0000 7fd851362b80 1 --2- 172.21.15.2:0/3112777699 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55cca6133d30 0x55cca6136150 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.718+0000 7fd851362b80 1 --2- 172.21.15.2:0/3112777699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca6124300 0x55cca6121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.718+0000 7fd851362b80 1 --2- 172.21.15.2:0/3112777699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 0x55cca6123a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.718+0000 7fd851362b80 1 --2- 172.21.15.2:0/3112777699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca61195b0 0x55cca6120d40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.718+0000 7fd851362b80 1 -- 172.21.15.2:0/3112777699 >> 172.21.15.2:0/3112777699 conn(0x55cca6046170 msgr2=0x55cca6114740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:32.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.718+0000 7fd82a000700 0 client.25543 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:32.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.718+0000 7fd851362b80 1 -- 172.21.15.2:0/3112777699 shutdown_connections 2024-06-13T11:25:32.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.718+0000 7fd851362b80 1 -- 172.21.15.2:0/3112777699 wait complete. 2024-06-13T11:25:32.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.718+0000 7fd851362b80 20 client.25543 trim_cache size 0 max 16384 2024-06-13T11:25:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.755+0000 7fd851362b80 1 Processor -- start 2024-06-13T11:25:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.755+0000 7fd851362b80 1 -- start start 2024-06-13T11:25:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.755+0000 7fd851362b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 0x55cca6115620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.755+0000 7fd851362b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca61195b0 0x55cca611fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.755+0000 7fd851362b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca6124300 0x55cca611b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.755+0000 7fd851362b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd8401b2e10 con 0x55cca6124300 2024-06-13T11:25:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.755+0000 7fd851362b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd8401b06a0 con 0x55cca6095e40 2024-06-13T11:25:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.755+0000 7fd851362b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd8401ae4f0 con 0x55cca61195b0 2024-06-13T11:25:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.756+0000 7fd83f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca61195b0 0x55cca611fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.756+0000 7fd83f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca61195b0 0x55cca611fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:38444/0 (socket says 172.21.15.2:38444) 2024-06-13T11:25:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.756+0000 7fd844a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca6124300 0x55cca611b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.756+0000 7fd83f400700 1 -- 172.21.15.2:0/1993291146 learned_addr learned my addr 172.21.15.2:0/1993291146 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.756+0000 7fd83fe00700 1 --2- 172.21.15.2:0/1993291146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 0x55cca6115620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.756+0000 7fd844a00700 1 -- 172.21.15.2:0/1993291146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca61195b0 msgr2=0x55cca611fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.756+0000 7fd844a00700 1 --2- 172.21.15.2:0/1993291146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca61195b0 0x55cca611fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.756+0000 7fd844a00700 1 -- 172.21.15.2:0/1993291146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 msgr2=0x55cca6115620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.757+0000 7fd844a00700 1 --2- 172.21.15.2:0/1993291146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 0x55cca6115620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.757+0000 7fd844a00700 1 -- 172.21.15.2:0/1993291146 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cca611cbc0 con 0x55cca6124300 2024-06-13T11:25:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.757+0000 7fd83f400700 1 --2- 172.21.15.2:0/1993291146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca61195b0 0x55cca611fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.757+0000 7fd83fe00700 1 --2- 172.21.15.2:0/1993291146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 0x55cca6115620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:25:32.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.757+0000 7fd844a00700 1 --2- 172.21.15.2:0/1993291146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca6124300 0x55cca611b770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd8380cc700 tx=0x7fd83809b0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140b9bf5bc2a4d53 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.758+0000 7fd834c00700 1 -- 172.21.15.2:0/1993291146 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83809bc60 con 0x55cca6124300 2024-06-13T11:25:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.758+0000 7fd834c00700 1 -- 172.21.15.2:0/1993291146 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8380cce50 con 0x55cca6124300 2024-06-13T11:25:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.758+0000 7fd834c00700 1 -- 172.21.15.2:0/1993291146 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8380998f0 con 0x55cca6124300 2024-06-13T11:25:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.759+0000 7fd851362b80 1 -- 172.21.15.2:0/1993291146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca6124300 msgr2=0x55cca611b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.759+0000 7fd851362b80 1 --2- 172.21.15.2:0/1993291146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca6124300 0x55cca611b770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd8380cc700 tx=0x7fd83809b0a0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.759+0000 7fd851362b80 1 -- 172.21.15.2:0/1993291146 shutdown_connections 2024-06-13T11:25:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.759+0000 7fd851362b80 1 --2- 172.21.15.2:0/1993291146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca6124300 0x55cca611b770 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.759+0000 7fd851362b80 1 --2- 172.21.15.2:0/1993291146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca6095e40 0x55cca6115620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.759+0000 7fd851362b80 1 --2- 172.21.15.2:0/1993291146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca61195b0 0x55cca611fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.759+0000 7fd851362b80 1 -- 172.21.15.2:0/1993291146 >> 172.21.15.2:0/1993291146 conn(0x55cca6046170 msgr2=0x55cca611b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:32.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.759+0000 7fd851362b80 1 -- 172.21.15.2:0/1993291146 shutdown_connections 2024-06-13T11:25:32.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.759+0000 7fd851362b80 1 -- 172.21.15.2:0/1993291146 wait complete. 2024-06-13T11:25:32.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.760+0000 7fd851362b80 1 -- start start 2024-06-13T11:25:32.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.760+0000 7fd851362b80 1 Processor -- start 2024-06-13T11:25:32.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.760+0000 7fd851362b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca6095e40 0x55cca611fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.760+0000 7fd851362b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca61195b0 0x55cca6120150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.760+0000 7fd851362b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca6124300 0x55cca6120690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.760+0000 7fd851362b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd8401aeb60 con 0x55cca6124300 2024-06-13T11:25:32.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.760+0000 7fd851362b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd8401affd0 con 0x55cca61195b0 2024-06-13T11:25:32.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.760+0000 7fd851362b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd8401af230 con 0x55cca6095e40 2024-06-13T11:25:32.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.761+0000 7fd851362b80 10 client.0 _ll_register_callbacks cb 0x55cca6005720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:32.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.761+0000 7fd83fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca6095e40 0x55cca611fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.761+0000 7fd83fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca6095e40 0x55cca611fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:38446/0 (socket says 172.21.15.2:38446) 2024-06-13T11:25:32.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.761+0000 7fd83fe00700 1 -- 172.21.15.2:0/623153538 learned_addr learned my addr 172.21.15.2:0/623153538 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:32.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.761+0000 7fd844a00700 1 --2- 172.21.15.2:0/623153538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca6124300 0x55cca6120690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.761+0000 7fd83f400700 1 --2- 172.21.15.2:0/623153538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca61195b0 0x55cca6120150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.761+0000 7fd83fe00700 1 -- 172.21.15.2:0/623153538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca61195b0 msgr2=0x55cca6120150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:32.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.761+0000 7fd83fe00700 1 --2- 172.21.15.2:0/623153538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca61195b0 0x55cca6120150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.761+0000 7fd83fe00700 1 -- 172.21.15.2:0/623153538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca6124300 msgr2=0x55cca6120690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:32.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.761+0000 7fd83fe00700 1 --2- 172.21.15.2:0/623153538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca6124300 0x55cca6120690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.761+0000 7fd83fe00700 1 -- 172.21.15.2:0/623153538 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cca612b500 con 0x55cca6095e40 2024-06-13T11:25:32.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.762+0000 7fd83fe00700 1 --2- 172.21.15.2:0/623153538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca6095e40 0x55cca611fc10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd830004180 tx=0x7fd830011b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3736e1880b46853f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:32.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.762+0000 7fd82a000700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:25:32.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.762+0000 7fd82a000700 1 -- 172.21.15.2:0/623153538 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd830003da0 con 0x55cca6095e40 2024-06-13T11:25:32.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.762+0000 7fd851362b80 1 -- 172.21.15.2:0/623153538 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8380cce50 con 0x55cca6095e40 2024-06-13T11:25:32.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.762+0000 7fd82a000700 1 -- 172.21.15.2:0/623153538 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fd830005050 con 0x55cca6095e40 2024-06-13T11:25:32.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.762+0000 7fd82a000700 1 -- 172.21.15.2:0/623153538 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd830040050 con 0x55cca6095e40 2024-06-13T11:25:32.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.762+0000 7fd851362b80 10 client.25549 fetch_fsmap learned FSMap version 28 2024-06-13T11:25:32.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.762+0000 7fd851362b80 1 -- 172.21.15.2:0/623153538 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cca612c780 con 0x55cca6095e40 2024-06-13T11:25:32.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.763+0000 7fd82a000700 1 -- 172.21.15.2:0/623153538 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8380cce50 con 0x55cca6095e40 2024-06-13T11:25:32.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.763+0000 7fd82a000700 1 -- 172.21.15.2:0/623153538 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7fd830004710 con 0x55cca6095e40 2024-06-13T11:25:32.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.763+0000 7fd851362b80 10 client.25549 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T11:25:32.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.763+0000 7fd851362b80 10 client.25549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:25:32.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.763+0000 7fd851362b80 20 client.25549 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:32.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.763+0000 7fd851362b80 1 --2- 172.21.15.2:0/623153538 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55cca612cc60 0x55cca61a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:32.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.764+0000 7fd851362b80 4 client.25549 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:25:32.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.764+0000 7fd851362b80 1 -- 172.21.15.2:0/623153538 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cca6073580 con 0x55cca612cc60 2024-06-13T11:25:32.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.764+0000 7fd83f400700 1 --2- 172.21.15.2:0/623153538 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55cca612cc60 0x55cca61a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:32.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.765+0000 7fd83f400700 1 --2- 172.21.15.2:0/623153538 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55cca612cc60 0x55cca61a0a00 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e017482db0addda6 server_cookie=f441909627f45a0a in_seq=0 out_seq=0 2024-06-13T11:25:32.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.765+0000 7fd82a000700 10 client.25549 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:32.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.765+0000 7fd82a000700 1 -- 172.21.15.2:0/623153538 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cca6073580 con 0x55cca612cc60 2024-06-13T11:25:32.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.765+0000 7fd82a000700 10 client.25549 handle_command_reply: tid=0 2024-06-13T11:25:32.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.765+0000 7fd851362b80 1 client.25549 shutdown 2024-06-13T11:25:32.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.766+0000 7fd851362b80 1 -- 172.21.15.2:0/623153538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca6095e40 msgr2=0x55cca611fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:32.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.766+0000 7fd851362b80 1 --2- 172.21.15.2:0/623153538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca6095e40 0x55cca611fc10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd830004180 tx=0x7fd830011b70 comp rx=0 tx=0).stop 2024-06-13T11:25:32.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.766+0000 7fd851362b80 1 -- 172.21.15.2:0/623153538 shutdown_connections 2024-06-13T11:25:32.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.766+0000 7fd851362b80 1 --2- 172.21.15.2:0/623153538 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55cca612cc60 0x55cca61a0a00 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.766+0000 7fd851362b80 1 --2- 172.21.15.2:0/623153538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cca6124300 0x55cca6120690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.766+0000 7fd851362b80 1 --2- 172.21.15.2:0/623153538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cca6095e40 0x55cca611fc10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.766+0000 7fd851362b80 1 --2- 172.21.15.2:0/623153538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cca61195b0 0x55cca6120150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.766+0000 7fd851362b80 1 -- 172.21.15.2:0/623153538 >> 172.21.15.2:0/623153538 conn(0x55cca6046170 msgr2=0x55cca611afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:32.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.766+0000 7fd82a000700 0 client.25549 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:32.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.766+0000 7fd851362b80 1 -- 172.21.15.2:0/623153538 shutdown_connections 2024-06-13T11:25:32.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.766+0000 7fd851362b80 1 -- 172.21.15.2:0/623153538 wait complete. 2024-06-13T11:25:32.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.766+0000 7fd851362b80 20 client.25549 trim_cache size 0 max 16384 2024-06-13T11:25:32.768 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:25:32.768 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-06-13T11:25:32.768 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-06-13T11:25:32.768 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:25:32.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.767+0000 7fd846a00700 1 -- 172.21.15.2:0/960129874 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd8240a2d90 msgr2=0x7fd8240a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.767+0000 7fd846a00700 1 --2- 172.21.15.2:0/960129874 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd8240a2d90 0x7fd8240a5250 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd830005950 tx=0x7fd830009310 comp rx=0 tx=0).stop 2024-06-13T11:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.767+0000 7fd846a00700 1 -- 172.21.15.2:0/960129874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd840107840 msgr2=0x7fd84019f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.767+0000 7fd846a00700 1 --2- 172.21.15.2:0/960129874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd840107840 0x7fd84019f760 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd83800efc0 tx=0x7fd83800c3a0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.767+0000 7fd846a00700 1 -- 172.21.15.2:0/960129874 shutdown_connections 2024-06-13T11:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.767+0000 7fd846a00700 1 --2- 172.21.15.2:0/960129874 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd8240a2d90 0x7fd8240a5250 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.767+0000 7fd846a00700 1 --2- 172.21.15.2:0/960129874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd840102740 0x7fd84019ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.767+0000 7fd846a00700 1 --2- 172.21.15.2:0/960129874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd840107840 0x7fd84019f760 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.767+0000 7fd846a00700 1 --2- 172.21.15.2:0/960129874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8401030f0 0x7fd84019b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.767+0000 7fd846a00700 1 -- 172.21.15.2:0/960129874 >> 172.21.15.2:0/960129874 conn(0x7fd8400795f0 msgr2=0x7fd840108990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.768+0000 7fd846a00700 1 -- 172.21.15.2:0/960129874 shutdown_connections 2024-06-13T11:25:32.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:32.768+0000 7fd846a00700 1 -- 172.21.15.2:0/960129874 wait complete. 2024-06-13T11:25:32.785 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:32 smithi002 ceph-mon[32210]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:25:32.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:32 smithi077 ceph-mon[36410]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:25:32.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:32 smithi178 ceph-mon[36913]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:25:33.530 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:33 smithi002 ceph-mon[32210]: pgmap v56: 129 pgs: 129 active+clean; 21 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 646 KiB/s wr, 35 op/s 2024-06-13T11:25:33.721 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-13T11:25:33.722 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:25:33.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:33 smithi077 ceph-mon[36410]: pgmap v56: 129 pgs: 129 active+clean; 21 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 646 KiB/s wr, 35 op/s 2024-06-13T11:25:33.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:33 smithi178 ceph-mon[36913]: pgmap v56: 129 pgs: 129 active+clean; 21 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 646 KiB/s wr, 35 op/s 2024-06-13T11:25:34.180 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:25:34.297 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 7% (321/4278) Updating files: 8% (343/4278) Updating files: 9% (386/4278) Updating files: 10% (428/4278) Updating files: 11% (471/4278) Updating files: 11% (490/4278) Updating files: 12% (514/4278) Updating files: 13% (557/4278) Updating files: 14% (599/4278) Updating files: 15% (642/4278) Updating files: 16% (685/4278) Updating files: 17% (728/4278) Updating files: 18% (771/4278) Updating files: 19% (813/4278) Updating files: 20% (856/4278) Updating files: 21% (899/4278) Updating files: 22% (942/4278) Updating files: 23% (984/4278) Updating files: 24% (1027/4278) Updating files: 25% (1070/4278) Updating files: 26% (1113/4278) Updating files: 26% (1143/4278) Updating files: 27% (1156/4278) Updating files: 28% (1198/4278) Updating files: 29% (1241/4278) Updating files: 30% (1284/4278) Updating files: 30% (1288/4278) Updating files: 31% (1327/4278) Updating files: 32% (1369/4278) Updating files: 33% (1412/4278) Updating files: 34% (1455/4278) Updating files: 35% (1498/4278) Updating files: 36% (1541/4278) Updating files: 37% (1583/4278) Updating files: 38% (1626/4278) Updating files: 39% (1669/4278) Updating files: 40% (1712/4278) Updating files: 40% (1742/4278) Updating files: 41% (1754/4278) Updating files: 42% (1797/4278) Updating files: 43% (1840/4278) Updating files: 44% (1883/4278) Updating files: 45% (1926/4278) Updating files: 46% (1968/4278) Updating files: 47% (2011/4278) Updating files: 48% (2054/4278) Updating files: 49% (2097/4278) Updating files: 50% (2139/4278) Updating files: 51% (2182/4278) Updating files: 52% (2225/4278) Updating files: 52% (2248/4278) Updating files: 53% (2268/4278) Updating files: 54% (2311/4278) Updating files: 55% (2353/4278) Updating files: 56% (2396/4278) Updating files: 57% (2439/4278) Updating files: 58% (2482/4278) Updating files: 59% (2525/4278) Updating files: 60% (2567/4278) Updating files: 61% (2610/4278) Updating files: 61% (2619/4278) Updating files: 62% (2653/4278) Updating files: 63% (2696/4278) Updating files: 64% (2738/4278) Updating files: 64% (2776/4278) Updating files: 65% (2781/4278) Updating files: 66% (2824/4278) Updating files: 66% (2825/4278) Updating files: 67% (2867/4278) Updating files: 68% (2910/4278) Updating files: 69% (2952/4278) Updating files: 70% (2995/4278) Updating files: 71% (3038/4278) Updating files: 72% (3081/4278) Updating files: 73% (3123/4278) Updating files: 74% (3166/4278) Updating files: 75% (3209/4278) Updating files: 76% (3252/4278) Updating files: 77% (3295/4278) Updating files: 78% (3337/4278) Updating files: 78% (3360/4278) Updating files: 79% (3380/4278) Updating files: 80% (3423/4278) Updating files: 81% (3466/4278) Updating files: 82% (3508/4278) Updating files: 83% (3551/4278) Updating files: 84% (3594/4278) Updating files: 85% (3637/4278) Updating files: 86% (3680/4278) Updating files: 87% (3722/4278) Updating files: 88% (3765/4278) Updating files: 89% (3808/4278) Updating files: 90% (3851/4278) Updating files: 91% (3893/4278) Updating files: 91% (3922/4278) Updating files: 92% (3936/4278) Updating files: 93% (3979/4278) Updating files: 94% (4022/4278) Updating files: 95% (4065/4278) Updating files: 96% (4107/4278) Updating files: 97% (4150/4278) Updating files: 98% (4193/4278) Updating files: 99% (4236/4278) Updating files: 100% (4278/4278) Updating files: 100% (4278/4278), done. 2024-06-13T11:25:34.311 INFO:tasks.workunit.client.0.smithi002.stderr:+ cd xfstests-dev 2024-06-13T11:25:34.311 INFO:tasks.workunit.client.0.smithi002.stderr:+ git checkout 12973fc04fd10d4af086901e10ffa8e48866b735 2024-06-13T11:25:35.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:35 smithi077 ceph-mon[36410]: pgmap v57: 129 pgs: 129 active+clean; 21 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 601 KiB/s wr, 28 op/s 2024-06-13T11:25:35.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:35 smithi002 ceph-mon[32210]: pgmap v57: 129 pgs: 129 active+clean; 21 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 601 KiB/s wr, 28 op/s 2024-06-13T11:25:35.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:35 smithi178 ceph-mon[36913]: pgmap v57: 129 pgs: 129 active+clean; 21 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 601 KiB/s wr, 28 op/s 2024-06-13T11:25:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.522+0000 7f589d800700 1 -- 172.21.15.2:0/3119474674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5898102550 msgr2=0x7f58981029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.522+0000 7f589d800700 1 --2- 172.21.15.2:0/3119474674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5898102550 0x7f58981029d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5884009990 tx=0x7f5884009ca0 comp rx=0 tx=0).stop 2024-06-13T11:25:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.522+0000 7f589d800700 1 -- 172.21.15.2:0/3119474674 shutdown_connections 2024-06-13T11:25:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.522+0000 7f589d800700 1 --2- 172.21.15.2:0/3119474674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5898102f10 0x7f589810f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.522+0000 7f589d800700 1 --2- 172.21.15.2:0/3119474674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58981084f0 0x7f58981088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.522+0000 7f589d800700 1 --2- 172.21.15.2:0/3119474674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5898102550 0x7f58981029d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.522+0000 7f589d800700 1 -- 172.21.15.2:0/3119474674 >> 172.21.15.2:0/3119474674 conn(0x7f5898079650 msgr2=0x7f5898079a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.522+0000 7f589d800700 1 -- 172.21.15.2:0/3119474674 shutdown_connections 2024-06-13T11:25:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.522+0000 7f589d800700 1 -- 172.21.15.2:0/3119474674 wait complete. 2024-06-13T11:25:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.523+0000 7f589d800700 1 Processor -- start 2024-06-13T11:25:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.524+0000 7f589d800700 1 -- start start 2024-06-13T11:25:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.524+0000 7f589d800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5898102550 0x7f5898074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.524+0000 7f589d800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5898102f10 0x7f5898074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.524+0000 7f589d800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58981084f0 0x7f5898075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.524+0000 7f589d800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f58981127b0 con 0x7f5898102f10 2024-06-13T11:25:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.524+0000 7f589d800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5898112630 con 0x7f5898102550 2024-06-13T11:25:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.524+0000 7f589d800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5898112930 con 0x7f58981084f0 2024-06-13T11:25:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.525+0000 7f5897400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58981084f0 0x7f5898075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.525+0000 7f5897400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58981084f0 0x7f5898075210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:50064/0 (socket says 172.21.15.2:50064) 2024-06-13T11:25:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.525+0000 7f5897400700 1 -- 172.21.15.2:0/176466604 learned_addr learned my addr 172.21.15.2:0/176466604 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.525+0000 7f5896a00700 1 --2- 172.21.15.2:0/176466604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5898102550 0x7f5898074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.525+0000 7f5896000700 1 --2- 172.21.15.2:0/176466604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5898102f10 0x7f5898074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.525+0000 7f5897400700 1 -- 172.21.15.2:0/176466604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5898102550 msgr2=0x7f5898074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.525+0000 7f5897400700 1 --2- 172.21.15.2:0/176466604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5898102550 0x7f5898074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.525+0000 7f5897400700 1 -- 172.21.15.2:0/176466604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5898102f10 msgr2=0x7f5898074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.525+0000 7f5897400700 1 --2- 172.21.15.2:0/176466604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5898102f10 0x7f5898074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.525+0000 7f5897400700 1 -- 172.21.15.2:0/176466604 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58981a71f0 con 0x7f58981084f0 2024-06-13T11:25:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.525+0000 7f5896000700 1 --2- 172.21.15.2:0/176466604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5898102f10 0x7f5898074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:25:36.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.525+0000 7f5897400700 1 --2- 172.21.15.2:0/176466604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58981084f0 0x7f5898075210 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f589000e940 tx=0x7f589000ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.526+0000 7f588f400700 1 -- 172.21.15.2:0/176466604 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589000cbd0 con 0x7f58981084f0 2024-06-13T11:25:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.526+0000 7f588f400700 1 -- 172.21.15.2:0/176466604 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f589000ee90 con 0x7f58981084f0 2024-06-13T11:25:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.526+0000 7f589d800700 1 -- 172.21.15.2:0/176466604 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58981a74e0 con 0x7f58981084f0 2024-06-13T11:25:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.526+0000 7f588f400700 1 -- 172.21.15.2:0/176466604 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58900056c0 con 0x7f58981084f0 2024-06-13T11:25:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.526+0000 7f589d800700 1 -- 172.21.15.2:0/176466604 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58981a7a70 con 0x7f58981084f0 2024-06-13T11:25:36.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.527+0000 7f589d800700 1 -- 172.21.15.2:0/176466604 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5878005330 con 0x7f58981084f0 2024-06-13T11:25:36.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.529+0000 7f588f400700 1 -- 172.21.15.2:0/176466604 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f5890004750 con 0x7f58981084f0 2024-06-13T11:25:36.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.531+0000 7f588f400700 1 --2- 172.21.15.2:0/176466604 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f587c0a2e10 0x7f587c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:36.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.531+0000 7f588f400700 1 -- 172.21.15.2:0/176466604 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f58900cf920 con 0x7f58981084f0 2024-06-13T11:25:36.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.531+0000 7f5896a00700 1 --2- 172.21.15.2:0/176466604 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f587c0a2e10 0x7f587c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:36.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.532+0000 7f5896a00700 1 --2- 172.21.15.2:0/176466604 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f587c0a2e10 0x7f587c0a52d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f588800f540 tx=0x7f588800b040 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:36.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.535+0000 7f588f400700 1 -- 172.21.15.2:0/176466604 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f589009c170 con 0x7f58981084f0 2024-06-13T11:25:36.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.824+0000 7f589d800700 1 -- 172.21.15.2:0/176466604 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58780058f0 con 0x7f58981084f0 2024-06-13T11:25:36.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.825+0000 7f588f400700 1 -- 172.21.15.2:0/176466604 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11856 (secure 0 0 0) 0x7f589009ba70 con 0x7f58981084f0 2024-06-13T11:25:36.824 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:25:36.824 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:25:36.301244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24509,24511,24493]},"id":1}]} 2024-06-13T11:25:36.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.828+0000 7f589d800700 1 -- 172.21.15.2:0/176466604 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f587c0a2e10 msgr2=0x7f587c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:36.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.828+0000 7f589d800700 1 --2- 172.21.15.2:0/176466604 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f587c0a2e10 0x7f587c0a52d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f588800f540 tx=0x7f588800b040 comp rx=0 tx=0).stop 2024-06-13T11:25:36.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.828+0000 7f589d800700 1 -- 172.21.15.2:0/176466604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58981084f0 msgr2=0x7f5898075210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:36.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.828+0000 7f589d800700 1 --2- 172.21.15.2:0/176466604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58981084f0 0x7f5898075210 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f589000e940 tx=0x7f589000ec50 comp rx=0 tx=0).stop 2024-06-13T11:25:36.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.828+0000 7f589d800700 1 -- 172.21.15.2:0/176466604 shutdown_connections 2024-06-13T11:25:36.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.828+0000 7f589d800700 1 --2- 172.21.15.2:0/176466604 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f587c0a2e10 0x7f587c0a52d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:36.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.828+0000 7f589d800700 1 --2- 172.21.15.2:0/176466604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58981084f0 0x7f5898075210 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:36.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.828+0000 7f589d800700 1 --2- 172.21.15.2:0/176466604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5898102550 0x7f5898074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:36.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.828+0000 7f589d800700 1 --2- 172.21.15.2:0/176466604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5898102f10 0x7f5898074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:36.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.828+0000 7f589d800700 1 -- 172.21.15.2:0/176466604 >> 172.21.15.2:0/176466604 conn(0x7f5898079650 msgr2=0x7f58981005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:36.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.829+0000 7f589d800700 1 -- 172.21.15.2:0/176466604 shutdown_connections 2024-06-13T11:25:36.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:36.829+0000 7f589d800700 1 -- 172.21.15.2:0/176466604 wait complete. 2024-06-13T11:25:36.829 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 29 2024-06-13T11:25:37.746 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-13T11:25:37.868 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:37 smithi002 ceph-mon[32210]: pgmap v58: 129 pgs: 129 active+clean; 21 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 601 KiB/s wr, 28 op/s 2024-06-13T11:25:37.868 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:37 smithi002 ceph-mon[32210]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:25:37.868 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:37 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/176466604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:25:37.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:37 smithi178 ceph-mon[36913]: pgmap v58: 129 pgs: 129 active+clean; 21 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 601 KiB/s wr, 28 op/s 2024-06-13T11:25:37.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:37 smithi178 ceph-mon[36913]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:25:37.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:37 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/176466604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:25:38.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:37 smithi077 ceph-mon[36410]: pgmap v58: 129 pgs: 129 active+clean; 21 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 601 KiB/s wr, 28 op/s 2024-06-13T11:25:38.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:37 smithi077 ceph-mon[36410]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:25:38.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:37 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/176466604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:25:38.263 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:25:39.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:39 smithi002 ceph-mon[32210]: pgmap v59: 129 pgs: 129 active+clean; 28 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 50 op/s 2024-06-13T11:25:39.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:39 smithi178 ceph-mon[36913]: pgmap v59: 129 pgs: 129 active+clean; 28 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 50 op/s 2024-06-13T11:25:40.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:39 smithi077 ceph-mon[36410]: pgmap v59: 129 pgs: 129 active+clean; 28 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 50 op/s 2024-06-13T11:25:41.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:41 smithi002 ceph-mon[32210]: pgmap v60: 129 pgs: 129 active+clean; 28 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 1.1 MiB/s wr, 45 op/s 2024-06-13T11:25:41.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:41 smithi178 ceph-mon[36913]: pgmap v60: 129 pgs: 129 active+clean; 28 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 1.1 MiB/s wr, 45 op/s 2024-06-13T11:25:42.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:41 smithi077 ceph-mon[36410]: pgmap v60: 129 pgs: 129 active+clean; 28 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 1.1 MiB/s wr, 45 op/s 2024-06-13T11:25:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.261+0000 7f5f0d200700 1 -- 172.21.15.2:0/3665787358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f080746c0 msgr2=0x7f5f08074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.261+0000 7f5f0d200700 1 --2- 172.21.15.2:0/3665787358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f080746c0 0x7f5f08074aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009990 tx=0x7f5ef8009ca0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.261+0000 7f5f0d200700 1 -- 172.21.15.2:0/3665787358 shutdown_connections 2024-06-13T11:25:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.261+0000 7f5f0d200700 1 --2- 172.21.15.2:0/3665787358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0810eef0 0x7f5f081112e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.261+0000 7f5f0d200700 1 --2- 172.21.15.2:0/3665787358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f080746c0 0x7f5f08074aa0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.261+0000 7f5f0d200700 1 --2- 172.21.15.2:0/3665787358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f08074fe0 0x7f5f0810e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.262+0000 7f5f0d200700 1 -- 172.21.15.2:0/3665787358 >> 172.21.15.2:0/3665787358 conn(0x7f5f080795f0 msgr2=0x7f5f08079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:42.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.262+0000 7f5f0d200700 1 -- 172.21.15.2:0/3665787358 shutdown_connections 2024-06-13T11:25:42.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.262+0000 7f5f0d200700 1 -- 172.21.15.2:0/3665787358 wait complete. 2024-06-13T11:25:42.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.263+0000 7f5f0d200700 1 Processor -- start 2024-06-13T11:25:42.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.264+0000 7f5f0d200700 1 -- start start 2024-06-13T11:25:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.265+0000 7f5f0d200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f080746c0 0x7f5f08102610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.265+0000 7f5f0d200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f08074fe0 0x7f5f08102b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.265+0000 7f5f0d200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0810eef0 0x7f5f08103090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.265+0000 7f5f0d200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f08114a40 con 0x7f5f0810eef0 2024-06-13T11:25:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.265+0000 7f5f0d200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f081148c0 con 0x7f5f08074fe0 2024-06-13T11:25:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.265+0000 7f5f0d200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5f08114bc0 con 0x7f5f080746c0 2024-06-13T11:25:42.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.265+0000 7f5f06800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0810eef0 0x7f5f08103090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:42.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.265+0000 7f5f05400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f08074fe0 0x7f5f08102b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:42.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.265+0000 7f5f06800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0810eef0 0x7f5f08103090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34900/0 (socket says 172.21.15.2:34900) 2024-06-13T11:25:42.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.265+0000 7f5f06800700 1 -- 172.21.15.2:0/1541138059 learned_addr learned my addr 172.21.15.2:0/1541138059 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:42.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.266+0000 7f5f05400700 1 -- 172.21.15.2:0/1541138059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f080746c0 msgr2=0x7f5f08102610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-13T11:25:42.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.266+0000 7f5f05400700 1 --2- 172.21.15.2:0/1541138059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f080746c0 0x7f5f08102610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.266+0000 7f5f05400700 1 -- 172.21.15.2:0/1541138059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0810eef0 msgr2=0x7f5f08103090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:42.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.266+0000 7f5f05400700 1 --2- 172.21.15.2:0/1541138059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0810eef0 0x7f5f08103090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.266+0000 7f5f05400700 1 -- 172.21.15.2:0/1541138059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f081ab4a0 con 0x7f5f08074fe0 2024-06-13T11:25:42.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.266+0000 7f5f05400700 1 --2- 172.21.15.2:0/1541138059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f08074fe0 0x7f5f08102b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400e9f0 tx=0x7f5ef400edb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:42.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.267+0000 7f5efea00700 1 -- 172.21.15.2:0/1541138059 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef400cbd0 con 0x7f5f08074fe0 2024-06-13T11:25:42.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.267+0000 7f5efea00700 1 -- 172.21.15.2:0/1541138059 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ef400cd70 con 0x7f5f08074fe0 2024-06-13T11:25:42.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.267+0000 7f5efea00700 1 -- 172.21.15.2:0/1541138059 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4018840 con 0x7f5f08074fe0 2024-06-13T11:25:42.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.267+0000 7f5f0d200700 1 -- 172.21.15.2:0/1541138059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f081ab790 con 0x7f5f08074fe0 2024-06-13T11:25:42.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.267+0000 7f5f0d200700 1 -- 172.21.15.2:0/1541138059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f081abc80 con 0x7f5f08074fe0 2024-06-13T11:25:42.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.271+0000 7f5efea00700 1 -- 172.21.15.2:0/1541138059 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f5ef4010a30 con 0x7f5f08074fe0 2024-06-13T11:25:42.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.273+0000 7f5efea00700 1 --2- 172.21.15.2:0/1541138059 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f5eec0a2e40 0x7f5eec0a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.273+0000 7f5efea00700 1 -- 172.21.15.2:0/1541138059 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f5ef40cf970 con 0x7f5f08074fe0 2024-06-13T11:25:42.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.273+0000 7f5f05e00700 1 --2- 172.21.15.2:0/1541138059 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f5eec0a2e40 0x7f5eec0a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.274+0000 7f5f17bfcb80 1 Processor -- start 2024-06-13T11:25:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.274+0000 7f5f05e00700 1 --2- 172.21.15.2:0/1541138059 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f5eec0a2e40 0x7f5eec0a5300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8000c00 tx=0x7f5ef8005fb0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.274+0000 7f5f17bfcb80 1 -- start start 2024-06-13T11:25:42.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.275+0000 7f5f17bfcb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b8e2e40 0x56421b966070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.275+0000 7f5f17bfcb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b9665b0 0x56421b966a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.275+0000 7f5f17bfcb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b971300 0x56421b9736f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.275+0000 7f5f17bfcb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56421b875a10 con 0x56421b8e2e40 2024-06-13T11:25:42.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.275+0000 7f5f17bfcb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56421b8b8b00 con 0x56421b9665b0 2024-06-13T11:25:42.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.275+0000 7f5f17bfcb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56421b8738f0 con 0x56421b971300 2024-06-13T11:25:42.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.275+0000 7f5f06800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b971300 0x56421b9736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:42.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.275+0000 7f5f05e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b8e2e40 0x56421b966070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:42.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.275+0000 7f5f06800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b971300 0x56421b9736f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:50082/0 (socket says 172.21.15.2:50082) 2024-06-13T11:25:42.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.275+0000 7f5f06800700 1 -- 172.21.15.2:0/3086371274 learned_addr learned my addr 172.21.15.2:0/3086371274 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:42.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.275+0000 7f5f05400700 1 --2- 172.21.15.2:0/3086371274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b9665b0 0x56421b966a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:42.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.276+0000 7f5f05400700 1 -- 172.21.15.2:0/3086371274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b971300 msgr2=0x56421b9736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:42.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.276+0000 7f5f05400700 1 --2- 172.21.15.2:0/3086371274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b971300 0x56421b9736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.276+0000 7f5f05400700 1 -- 172.21.15.2:0/3086371274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b8e2e40 msgr2=0x56421b966070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:42.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.276+0000 7f5f05400700 1 --2- 172.21.15.2:0/3086371274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b8e2e40 0x56421b966070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.276+0000 7f5f05400700 1 -- 172.21.15.2:0/3086371274 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56421b860f90 con 0x56421b9665b0 2024-06-13T11:25:42.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.276+0000 7f5f05400700 1 --2- 172.21.15.2:0/3086371274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b9665b0 0x56421b966a30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40cccf0 tx=0x7f5ef409c1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d695776a836f649 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:42.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.276+0000 7f5ef3400700 1 -- 172.21.15.2:0/3086371274 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef40a4730 con 0x56421b9665b0 2024-06-13T11:25:42.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.276+0000 7f5ef3400700 1 -- 172.21.15.2:0/3086371274 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ef409bd20 con 0x56421b9665b0 2024-06-13T11:25:42.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.276+0000 7f5ef3400700 1 -- 172.21.15.2:0/3086371274 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef409b170 con 0x56421b9665b0 2024-06-13T11:25:42.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.277+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/3086371274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b9665b0 msgr2=0x56421b966a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:42.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.277+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/3086371274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b9665b0 0x56421b966a30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40cccf0 tx=0x7f5ef409c1c0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.277+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/3086371274 shutdown_connections 2024-06-13T11:25:42.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.277+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/3086371274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b8e2e40 0x56421b966070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.277+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/3086371274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b971300 0x56421b9736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.277+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/3086371274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b9665b0 0x56421b966a30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.277+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/3086371274 >> 172.21.15.2:0/3086371274 conn(0x56421b893170 msgr2=0x56421b9624b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:42.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.278+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/3086371274 shutdown_connections 2024-06-13T11:25:42.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.278+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/3086371274 wait complete. 2024-06-13T11:25:42.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.278+0000 7f5f17bfcb80 1 -- start start 2024-06-13T11:25:42.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.279+0000 7f5f17bfcb80 1 Processor -- start 2024-06-13T11:25:42.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.280+0000 7f5f17bfcb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b8e2e40 0x56421b970b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.280+0000 7f5f17bfcb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b9665b0 0x56421b96de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.280+0000 7f5f17bfcb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b971300 0x56421b96e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.280+0000 7f5f17bfcb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56421b854f60 con 0x56421b9665b0 2024-06-13T11:25:42.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.280+0000 7f5f17bfcb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56421b8b4ac0 con 0x56421b8e2e40 2024-06-13T11:25:42.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.280+0000 7f5f17bfcb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56421b973f60 con 0x56421b971300 2024-06-13T11:25:42.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.280+0000 7f5f17bfcb80 10 client.0 _ll_register_callbacks cb 0x56421b852720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.280+0000 7f5f06800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b971300 0x56421b96e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.280+0000 7f5f05e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b8e2e40 0x56421b970b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.280+0000 7f5f05e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b8e2e40 0x56421b970b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:40104/0 (socket says 172.21.15.2:40104) 2024-06-13T11:25:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.280+0000 7f5f05400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b9665b0 0x56421b96de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.280+0000 7f5f05e00700 1 -- 172.21.15.2:0/3944930292 learned_addr learned my addr 172.21.15.2:0/3944930292 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.281+0000 7f5f05e00700 1 -- 172.21.15.2:0/3944930292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b971300 msgr2=0x56421b96e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.281+0000 7f5f05e00700 1 --2- 172.21.15.2:0/3944930292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b971300 0x56421b96e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.281+0000 7f5f05e00700 1 -- 172.21.15.2:0/3944930292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b9665b0 msgr2=0x56421b96de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.281+0000 7f5f05e00700 1 --2- 172.21.15.2:0/3944930292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b9665b0 0x56421b96de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.281+0000 7f5f05e00700 1 -- 172.21.15.2:0/3944930292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56421b8078d0 con 0x56421b8e2e40 2024-06-13T11:25:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.281+0000 7f5f05400700 1 --2- 172.21.15.2:0/3944930292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b9665b0 0x56421b96de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.281+0000 7f5f06800700 1 --2- 172.21.15.2:0/3944930292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b971300 0x56421b96e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:25:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.281+0000 7f5f05e00700 1 --2- 172.21.15.2:0/3944930292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b8e2e40 0x56421b970b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800b840 tx=0x7f5ef8009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88f955992ee26145 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.281+0000 7f5ee7e00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:25:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.281+0000 7f5ee7e00700 1 -- 172.21.15.2:0/3944930292 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8003890 con 0x56421b8e2e40 2024-06-13T11:25:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.281+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/3944930292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ef409bd20 con 0x56421b8e2e40 2024-06-13T11:25:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.281+0000 7f5ee7e00700 1 -- 172.21.15.2:0/3944930292 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f5ef8003a30 con 0x56421b8e2e40 2024-06-13T11:25:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.282+0000 7f5ee7e00700 1 -- 172.21.15.2:0/3944930292 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5ef8003c30 con 0x56421b8e2e40 2024-06-13T11:25:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.282+0000 7f5f17bfcb80 10 client.25532 fetch_fsmap learned FSMap version 29 2024-06-13T11:25:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.282+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/3944930292 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56421b97e760 con 0x56421b8e2e40 2024-06-13T11:25:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.282+0000 7f5ee7e00700 1 -- 172.21.15.2:0/3944930292 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ef409bd20 con 0x56421b8e2e40 2024-06-13T11:25:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.282+0000 7f5ee7e00700 1 -- 172.21.15.2:0/3944930292 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f5ef8025490 con 0x56421b8e2e40 2024-06-13T11:25:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.282+0000 7f5f17bfcb80 10 client.25532 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:25:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.282+0000 7f5f17bfcb80 10 client.25532 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:25:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.282+0000 7f5f17bfcb80 20 client.25532 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.282+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/3944930292 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x56421b980cf0 0x56421b983140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.283+0000 7f5f17bfcb80 4 client.25532 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:25:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.283+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/3944930292 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56421b8c6000 con 0x56421b980cf0 2024-06-13T11:25:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.283+0000 7f5f05400700 1 --2- 172.21.15.2:0/3944930292 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x56421b980cf0 0x56421b983140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:42.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.284+0000 7f5f05400700 1 --2- 172.21.15.2:0/3944930292 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x56421b980cf0 0x56421b983140 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=486abf118ea28070 server_cookie=4446b8b2ecf607ba in_seq=0 out_seq=0 2024-06-13T11:25:42.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.284+0000 7f5ee7e00700 10 client.25532 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:25:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.284+0000 7f5ee7e00700 1 -- 172.21.15.2:0/3944930292 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56421b8c6000 con 0x56421b980cf0 2024-06-13T11:25:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.284+0000 7f5ee7e00700 10 client.25532 handle_command_reply: tid=0 2024-06-13T11:25:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.284+0000 7f5f17bfcb80 1 client.25532 shutdown 2024-06-13T11:25:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.285+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/3944930292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b8e2e40 msgr2=0x56421b970b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.285+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/3944930292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b8e2e40 0x56421b970b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800b840 tx=0x7f5ef8009310 comp rx=0 tx=0).stop 2024-06-13T11:25:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.285+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/3944930292 shutdown_connections 2024-06-13T11:25:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.285+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/3944930292 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x56421b980cf0 0x56421b983140 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.285+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/3944930292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b971300 0x56421b96e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.285+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/3944930292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b8e2e40 0x56421b970b00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.285+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/3944930292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b9665b0 0x56421b96de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.285+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/3944930292 >> 172.21.15.2:0/3944930292 conn(0x56421b893170 msgr2=0x56421b961740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:42.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.285+0000 7f5ee7e00700 0 client.25532 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:25:42.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.285+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/3944930292 shutdown_connections 2024-06-13T11:25:42.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.285+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/3944930292 wait complete. 2024-06-13T11:25:42.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.285+0000 7f5f17bfcb80 20 client.25532 trim_cache size 0 max 16384 2024-06-13T11:25:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.302+0000 7f5f17bfcb80 1 Processor -- start 2024-06-13T11:25:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.303+0000 7f5f17bfcb80 1 -- start start 2024-06-13T11:25:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.303+0000 7f5f17bfcb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b8e2e40 0x56421b97d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.303+0000 7f5f17bfcb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b9665b0 0x56421b9726f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.303+0000 7f5f17bfcb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b971300 0x56421b972c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.303+0000 7f5f17bfcb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f081b73e0 con 0x56421b9665b0 2024-06-13T11:25:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.303+0000 7f5f17bfcb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f081b4c70 con 0x56421b971300 2024-06-13T11:25:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.303+0000 7f5f17bfcb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5f081b2ac0 con 0x56421b8e2e40 2024-06-13T11:25:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.303+0000 7f5f05e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b8e2e40 0x56421b97d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.303+0000 7f5f05e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b8e2e40 0x56421b97d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:50110/0 (socket says 172.21.15.2:50110) 2024-06-13T11:25:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.303+0000 7f5f05e00700 1 -- 172.21.15.2:0/502342298 learned_addr learned my addr 172.21.15.2:0/502342298 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.303+0000 7f5f05400700 1 --2- 172.21.15.2:0/502342298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b9665b0 0x56421b9726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.303+0000 7f5f06800700 1 --2- 172.21.15.2:0/502342298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b971300 0x56421b972c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.304+0000 7f5f05e00700 1 -- 172.21.15.2:0/502342298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b971300 msgr2=0x56421b972c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.304+0000 7f5f05e00700 1 --2- 172.21.15.2:0/502342298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b971300 0x56421b972c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.304+0000 7f5f05e00700 1 -- 172.21.15.2:0/502342298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b9665b0 msgr2=0x56421b9726f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.304+0000 7f5f05e00700 1 --2- 172.21.15.2:0/502342298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b9665b0 0x56421b9726f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.304+0000 7f5f05e00700 1 -- 172.21.15.2:0/502342298 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56421b967c00 con 0x56421b8e2e40 2024-06-13T11:25:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.304+0000 7f5f05400700 1 --2- 172.21.15.2:0/502342298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b9665b0 0x56421b9726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:25:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.304+0000 7f5f05e00700 1 --2- 172.21.15.2:0/502342298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b8e2e40 0x56421b97d080 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8025880 tx=0x7f5ef80056b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=135b07ccad4e3c1e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.304+0000 7f5ef2a00700 1 -- 172.21.15.2:0/502342298 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8003890 con 0x56421b8e2e40 2024-06-13T11:25:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.304+0000 7f5ef2a00700 1 -- 172.21.15.2:0/502342298 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ef8003a30 con 0x56421b8e2e40 2024-06-13T11:25:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.304+0000 7f5ef2a00700 1 -- 172.21.15.2:0/502342298 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8030b60 con 0x56421b8e2e40 2024-06-13T11:25:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.305+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/502342298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b8e2e40 msgr2=0x56421b97d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.305+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/502342298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b8e2e40 0x56421b97d080 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8025880 tx=0x7f5ef80056b0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.305+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/502342298 shutdown_connections 2024-06-13T11:25:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.305+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/502342298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b971300 0x56421b972c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.305+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/502342298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b8e2e40 0x56421b97d080 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.305+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/502342298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b9665b0 0x56421b9726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.305+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/502342298 >> 172.21.15.2:0/502342298 conn(0x56421b893170 msgr2=0x56421b961fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.305+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/502342298 shutdown_connections 2024-06-13T11:25:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.305+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/502342298 wait complete. 2024-06-13T11:25:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.306+0000 7f5f17bfcb80 1 -- start start 2024-06-13T11:25:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.306+0000 7f5f17bfcb80 1 Processor -- start 2024-06-13T11:25:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.306+0000 7f5f17bfcb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b8e2e40 0x56421b96ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.306+0000 7f5f17bfcb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b9665b0 0x56421b96a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.306+0000 7f5f17bfcb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b971300 0x56421b96a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.307+0000 7f5f17bfcb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5f081b3130 con 0x56421b9665b0 2024-06-13T11:25:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.307+0000 7f5f17bfcb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f081b45a0 con 0x56421b971300 2024-06-13T11:25:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.307+0000 7f5f17bfcb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5f081b3800 con 0x56421b8e2e40 2024-06-13T11:25:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.307+0000 7f5f17bfcb80 10 client.0 _ll_register_callbacks cb 0x56421b852720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.307+0000 7f5f05e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b8e2e40 0x56421b96ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.307+0000 7f5f05e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b8e2e40 0x56421b96ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:50118/0 (socket says 172.21.15.2:50118) 2024-06-13T11:25:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.307+0000 7f5f05e00700 1 -- 172.21.15.2:0/2907711948 learned_addr learned my addr 172.21.15.2:0/2907711948 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.307+0000 7f5f06800700 1 --2- 172.21.15.2:0/2907711948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b971300 0x56421b96a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.307+0000 7f5f05e00700 1 -- 172.21.15.2:0/2907711948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b971300 msgr2=0x56421b96a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.307+0000 7f5f05e00700 1 --2- 172.21.15.2:0/2907711948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b971300 0x56421b96a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.307+0000 7f5f05e00700 1 -- 172.21.15.2:0/2907711948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b9665b0 msgr2=0x56421b96a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.307+0000 7f5f05e00700 1 --2- 172.21.15.2:0/2907711948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b9665b0 0x56421b96a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.307+0000 7f5f05e00700 1 -- 172.21.15.2:0/2907711948 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56421b9781f0 con 0x56421b8e2e40 2024-06-13T11:25:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.308+0000 7f5f05e00700 1 --2- 172.21.15.2:0/2907711948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b8e2e40 0x56421b96ba60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8003c00 tx=0x7f5ef8030480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82cd9d3206e2582b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.308+0000 7f5ee7e00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:25:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.308+0000 7f5ee7e00700 1 -- 172.21.15.2:0/2907711948 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8025c70 con 0x56421b8e2e40 2024-06-13T11:25:42.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.308+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/2907711948 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ef8003a30 con 0x56421b8e2e40 2024-06-13T11:25:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.308+0000 7f5ee7e00700 1 -- 172.21.15.2:0/2907711948 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f5ef80307e0 con 0x56421b8e2e40 2024-06-13T11:25:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.308+0000 7f5ee7e00700 1 -- 172.21.15.2:0/2907711948 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5ef804e050 con 0x56421b8e2e40 2024-06-13T11:25:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.308+0000 7f5f17bfcb80 10 client.25570 fetch_fsmap learned FSMap version 29 2024-06-13T11:25:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.308+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/2907711948 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56421b9794d0 con 0x56421b8e2e40 2024-06-13T11:25:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.309+0000 7f5ee7e00700 1 -- 172.21.15.2:0/2907711948 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ef8003a30 con 0x56421b8e2e40 2024-06-13T11:25:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.309+0000 7f5ee7e00700 1 -- 172.21.15.2:0/2907711948 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f5ef8045980 con 0x56421b8e2e40 2024-06-13T11:25:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.309+0000 7f5f17bfcb80 10 client.25570 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:25:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.309+0000 7f5f17bfcb80 10 client.25570 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:25:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.309+0000 7f5f17bfcb80 20 client.25570 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.309+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/2907711948 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x56421b979be0 0x56421b9eda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.309+0000 7f5f17bfcb80 4 client.25570 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:25:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.309+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/2907711948 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56421b8c0580 con 0x56421b979be0 2024-06-13T11:25:42.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.309+0000 7f5f05400700 1 --2- 172.21.15.2:0/2907711948 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x56421b979be0 0x56421b9eda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:42.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.310+0000 7f5f05400700 1 --2- 172.21.15.2:0/2907711948 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x56421b979be0 0x56421b9eda30 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=78858b3a2cdaf248 server_cookie=10aa5ad67dba5840 in_seq=0 out_seq=0 2024-06-13T11:25:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.310+0000 7f5ee7e00700 10 client.25570 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:25:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.310+0000 7f5ee7e00700 1 -- 172.21.15.2:0/2907711948 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56421b8c0580 con 0x56421b979be0 2024-06-13T11:25:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.310+0000 7f5ee7e00700 10 client.25570 handle_command_reply: tid=0 2024-06-13T11:25:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.310+0000 7f5f17bfcb80 1 client.25570 shutdown 2024-06-13T11:25:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.311+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/2907711948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b8e2e40 msgr2=0x56421b96ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.311+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/2907711948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b8e2e40 0x56421b96ba60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8003c00 tx=0x7f5ef8030480 comp rx=0 tx=0).stop 2024-06-13T11:25:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.311+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/2907711948 shutdown_connections 2024-06-13T11:25:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.311+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/2907711948 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x56421b979be0 0x56421b9eda30 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.311+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/2907711948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56421b971300 0x56421b96a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.311+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/2907711948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56421b8e2e40 0x56421b96ba60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.311+0000 7f5f17bfcb80 1 --2- 172.21.15.2:0/2907711948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56421b9665b0 0x56421b96a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.311+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/2907711948 >> 172.21.15.2:0/2907711948 conn(0x56421b893170 msgr2=0x56421b960eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:42.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.311+0000 7f5ee7e00700 0 client.25570 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:25:42.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.311+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/2907711948 shutdown_connections 2024-06-13T11:25:42.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.311+0000 7f5f17bfcb80 1 -- 172.21.15.2:0/2907711948 wait complete. 2024-06-13T11:25:42.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.311+0000 7f5f17bfcb80 20 client.25570 trim_cache size 0 max 16384 2024-06-13T11:25:42.313 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:25:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.312+0000 7f5f0d200700 1 -- 172.21.15.2:0/1541138059 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f5eec0a2e40 msgr2=0x7f5eec0a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.312+0000 7f5f0d200700 1 --2- 172.21.15.2:0/1541138059 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f5eec0a2e40 0x7f5eec0a5300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8000c00 tx=0x7f5ef8005fb0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.312+0000 7f5f0d200700 1 -- 172.21.15.2:0/1541138059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f08074fe0 msgr2=0x7f5f08102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.312+0000 7f5f0d200700 1 --2- 172.21.15.2:0/1541138059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f08074fe0 0x7f5f08102b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400e9f0 tx=0x7f5ef400edb0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.312+0000 7f5f0d200700 1 -- 172.21.15.2:0/1541138059 shutdown_connections 2024-06-13T11:25:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.312+0000 7f5f0d200700 1 --2- 172.21.15.2:0/1541138059 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f5eec0a2e40 0x7f5eec0a5300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.312+0000 7f5f0d200700 1 --2- 172.21.15.2:0/1541138059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f0810eef0 0x7f5f08103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.312+0000 7f5f0d200700 1 --2- 172.21.15.2:0/1541138059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f080746c0 0x7f5f08102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.312+0000 7f5f0d200700 1 --2- 172.21.15.2:0/1541138059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f08074fe0 0x7f5f08102b50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.312+0000 7f5f0d200700 1 -- 172.21.15.2:0/1541138059 >> 172.21.15.2:0/1541138059 conn(0x7f5f080795f0 msgr2=0x7f5f080ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.312+0000 7f5f0d200700 1 -- 172.21.15.2:0/1541138059 shutdown_connections 2024-06-13T11:25:42.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:42.312+0000 7f5f0d200700 1 -- 172.21.15.2:0/1541138059 wait complete. 2024-06-13T11:25:43.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-13T11:25:43.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:43 smithi002 ceph-mon[32210]: pgmap v61: 129 pgs: 129 active+clean; 37 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 53 op/s 2024-06-13T11:25:43.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:43 smithi178 ceph-mon[36913]: pgmap v61: 129 pgs: 129 active+clean; 37 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 53 op/s 2024-06-13T11:25:43.976 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:25:44.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:43 smithi077 ceph-mon[36410]: pgmap v61: 129 pgs: 129 active+clean; 37 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 53 op/s 2024-06-13T11:25:45.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:45 smithi002 ceph-mon[32210]: pgmap v62: 129 pgs: 129 active+clean; 37 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 29 op/s 2024-06-13T11:25:45.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:45 smithi178 ceph-mon[36913]: pgmap v62: 129 pgs: 129 active+clean; 37 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 29 op/s 2024-06-13T11:25:46.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:45 smithi077 ceph-mon[36410]: pgmap v62: 129 pgs: 129 active+clean; 37 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 29 op/s 2024-06-13T11:25:46.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.755+0000 7f6b98000700 1 -- 172.21.15.2:0/2021148902 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b90108500 msgr2=0x7f6b901088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:46.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.755+0000 7f6b98000700 1 --2- 172.21.15.2:0/2021148902 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b90108500 0x7f6b901088e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009990 tx=0x7f6b84009ca0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.755+0000 7f6b98000700 1 -- 172.21.15.2:0/2021148902 shutdown_connections 2024-06-13T11:25:46.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.755+0000 7f6b98000700 1 --2- 172.21.15.2:0/2021148902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b9006ab30 0x7f6b9010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.755+0000 7f6b98000700 1 --2- 172.21.15.2:0/2021148902 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b90108500 0x7f6b901088e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.755+0000 7f6b98000700 1 --2- 172.21.15.2:0/2021148902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b9006a170 0x7f6b9006a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.755+0000 7f6b98000700 1 -- 172.21.15.2:0/2021148902 >> 172.21.15.2:0/2021148902 conn(0x7f6b90078340 msgr2=0x7f6b90078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.758+0000 7f6b98000700 1 -- 172.21.15.2:0/2021148902 shutdown_connections 2024-06-13T11:25:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.758+0000 7f6b98000700 1 -- 172.21.15.2:0/2021148902 wait complete. 2024-06-13T11:25:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.759+0000 7f6b98000700 1 Processor -- start 2024-06-13T11:25:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.760+0000 7f6b98000700 1 -- start start 2024-06-13T11:25:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.761+0000 7f6b98000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b9006a170 0x7f6b9019aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.761+0000 7f6b98000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b9006ab30 0x7f6b9019b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.761+0000 7f6b98000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b90108500 0x7f6b9019f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.761+0000 7f6b98000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90112830 con 0x7f6b90108500 2024-06-13T11:25:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.761+0000 7f6b98000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6b901126b0 con 0x7f6b9006a170 2024-06-13T11:25:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.761+0000 7f6b98000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6b901129b0 con 0x7f6b9006ab30 2024-06-13T11:25:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.761+0000 7f6b95600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b9006a170 0x7f6b9019aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.761+0000 7f6b95600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b9006a170 0x7f6b9019aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:56496/0 (socket says 172.21.15.2:56496) 2024-06-13T11:25:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.761+0000 7f6b95600700 1 -- 172.21.15.2:0/1549137007 learned_addr learned my addr 172.21.15.2:0/1549137007 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.762+0000 7f6b96000700 1 --2- 172.21.15.2:0/1549137007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b90108500 0x7f6b9019f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:46.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.762+0000 7f6b94c00700 1 --2- 172.21.15.2:0/1549137007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b9006ab30 0x7f6b9019b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:46.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.763+0000 7f6b95600700 1 -- 172.21.15.2:0/1549137007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b9006ab30 msgr2=0x7f6b9019b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:46.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.763+0000 7f6b95600700 1 --2- 172.21.15.2:0/1549137007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b9006ab30 0x7f6b9019b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.763+0000 7f6b95600700 1 -- 172.21.15.2:0/1549137007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b90108500 msgr2=0x7f6b9019f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.763+0000 7f6b95600700 1 --2- 172.21.15.2:0/1549137007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b90108500 0x7f6b9019f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.764+0000 7f6b95600700 1 -- 172.21.15.2:0/1549137007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9019feb0 con 0x7f6b9006a170 2024-06-13T11:25:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.764+0000 7f6b96000700 1 --2- 172.21.15.2:0/1549137007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b90108500 0x7f6b9019f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:25:46.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.766+0000 7f6b95600700 1 --2- 172.21.15.2:0/1549137007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b9006a170 0x7f6b9019aea0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400b5c0 tx=0x7f6b84005640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:46.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.768+0000 7f6b8e000700 1 -- 172.21.15.2:0/1549137007 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84027070 con 0x7f6b9006a170 2024-06-13T11:25:46.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.768+0000 7f6b98000700 1 -- 172.21.15.2:0/1549137007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b901a0140 con 0x7f6b9006a170 2024-06-13T11:25:46.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.768+0000 7f6b8e000700 1 -- 172.21.15.2:0/1549137007 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b84004050 con 0x7f6b9006a170 2024-06-13T11:25:46.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.768+0000 7f6b8e000700 1 -- 172.21.15.2:0/1549137007 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8400f460 con 0x7f6b9006a170 2024-06-13T11:25:46.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.769+0000 7f6b98000700 1 -- 172.21.15.2:0/1549137007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b901a7a20 con 0x7f6b9006a170 2024-06-13T11:25:46.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.773+0000 7f6b8e000700 1 -- 172.21.15.2:0/1549137007 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f6b8402a070 con 0x7f6b9006a170 2024-06-13T11:25:46.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.776+0000 7f6b8e000700 1 --2- 172.21.15.2:0/1549137007 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6b780a2e10 0x7f6b780a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.777+0000 7f6b8e000700 1 -- 172.21.15.2:0/1549137007 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f6b840d1ab0 con 0x7f6b9006a170 2024-06-13T11:25:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.777+0000 7f6b94c00700 1 --2- 172.21.15.2:0/1549137007 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6b780a2e10 0x7f6b780a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.778+0000 7f6ba29b4b80 1 Processor -- start 2024-06-13T11:25:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.779+0000 7f6ba29b4b80 1 -- start start 2024-06-13T11:25:46.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.779+0000 7f6ba29b4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5affe40 0x5597c5b83070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.779+0000 7f6ba29b4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5b835b0 0x5597c5b83a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.779+0000 7f6ba29b4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5b8e300 0x5597c5b906f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.779+0000 7f6ba29b4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5597c5a92a10 con 0x5597c5affe40 2024-06-13T11:25:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.779+0000 7f6ba29b4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5597c5ad5b00 con 0x5597c5b8e300 2024-06-13T11:25:46.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.779+0000 7f6ba29b4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5597c5a908f0 con 0x5597c5b835b0 2024-06-13T11:25:46.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.780+0000 7f6b95600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5affe40 0x5597c5b83070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:46.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.780+0000 7f6b95600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5affe40 0x5597c5b83070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50258/0 (socket says 172.21.15.2:50258) 2024-06-13T11:25:46.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.780+0000 7f6b95600700 1 -- 172.21.15.2:0/3628000734 learned_addr learned my addr 172.21.15.2:0/3628000734 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:46.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.782+0000 7f6b94c00700 1 --2- 172.21.15.2:0/1549137007 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6b780a2e10 0x7f6b780a52d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c005ea0 tx=0x7f6b7c005e30 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.782+0000 7f6b96000700 1 --2- 172.21.15.2:0/3628000734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5b8e300 0x5597c5b906f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.782+0000 7f6b95600700 1 -- 172.21.15.2:0/3628000734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5b835b0 msgr2=0x5597c5b83a30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-13T11:25:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.782+0000 7f6b95600700 1 --2- 172.21.15.2:0/3628000734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5b835b0 0x5597c5b83a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.782+0000 7f6b95600700 1 -- 172.21.15.2:0/3628000734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5b8e300 msgr2=0x5597c5b906f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.782+0000 7f6b95600700 1 --2- 172.21.15.2:0/3628000734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5b8e300 0x5597c5b906f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.782+0000 7f6b95600700 1 -- 172.21.15.2:0/3628000734 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597c5a7df90 con 0x5597c5affe40 2024-06-13T11:25:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.784+0000 7f6b95600700 1 --2- 172.21.15.2:0/3628000734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5affe40 0x5597c5b83070 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400c010 tx=0x7f6b8409d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8909c7fda0fd78 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:46.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.785+0000 7f6b82a00700 1 -- 172.21.15.2:0/3628000734 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b840b6e60 con 0x5597c5affe40 2024-06-13T11:25:46.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.785+0000 7f6b82a00700 1 -- 172.21.15.2:0/3628000734 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b840b3030 con 0x5597c5affe40 2024-06-13T11:25:46.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.785+0000 7f6b82a00700 1 -- 172.21.15.2:0/3628000734 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b840a66a0 con 0x5597c5affe40 2024-06-13T11:25:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.786+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/3628000734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5affe40 msgr2=0x5597c5b83070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.786+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/3628000734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5affe40 0x5597c5b83070 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400c010 tx=0x7f6b8409d830 comp rx=0 tx=0).stop 2024-06-13T11:25:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.786+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/3628000734 shutdown_connections 2024-06-13T11:25:46.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.786+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/3628000734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5affe40 0x5597c5b83070 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.786+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/3628000734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5b8e300 0x5597c5b906f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.786+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/3628000734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5b835b0 0x5597c5b83a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.786+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/3628000734 >> 172.21.15.2:0/3628000734 conn(0x5597c5ab0170 msgr2=0x5597c5b7f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:46.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.787+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/3628000734 shutdown_connections 2024-06-13T11:25:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.787+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/3628000734 wait complete. 2024-06-13T11:25:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.788+0000 7f6ba29b4b80 1 -- start start 2024-06-13T11:25:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.788+0000 7f6ba29b4b80 1 Processor -- start 2024-06-13T11:25:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.789+0000 7f6ba29b4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5affe40 0x5597c5b8d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.789+0000 7f6ba29b4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5b835b0 0x5597c5b8acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.789+0000 7f6ba29b4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5b8e300 0x5597c5b8b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.789+0000 7f6ba29b4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5597c5a71f60 con 0x5597c5b835b0 2024-06-13T11:25:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.789+0000 7f6ba29b4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5597c5ad1ac0 con 0x5597c5affe40 2024-06-13T11:25:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.789+0000 7f6ba29b4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5597c5b90d70 con 0x5597c5b8e300 2024-06-13T11:25:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.789+0000 7f6ba29b4b80 10 client.0 _ll_register_callbacks cb 0x5597c5a6f720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.789+0000 7f6b95600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5affe40 0x5597c5b8d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.789+0000 7f6b95600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5affe40 0x5597c5b8d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:56522/0 (socket says 172.21.15.2:56522) 2024-06-13T11:25:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.789+0000 7f6b95600700 1 -- 172.21.15.2:0/3158139223 learned_addr learned my addr 172.21.15.2:0/3158139223 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.789+0000 7f6b96000700 1 --2- 172.21.15.2:0/3158139223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5b8e300 0x5597c5b8b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.790+0000 7f6b95600700 1 -- 172.21.15.2:0/3158139223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5b8e300 msgr2=0x5597c5b8b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.790+0000 7f6b95600700 1 --2- 172.21.15.2:0/3158139223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5b8e300 0x5597c5b8b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.790+0000 7f6b95600700 1 -- 172.21.15.2:0/3158139223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5b835b0 msgr2=0x5597c5b8acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.790+0000 7f6b95600700 1 --2- 172.21.15.2:0/3158139223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5b835b0 0x5597c5b8acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.790+0000 7f6b95600700 1 -- 172.21.15.2:0/3158139223 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597c5a248d0 con 0x5597c5affe40 2024-06-13T11:25:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.791+0000 7f6b95600700 1 --2- 172.21.15.2:0/3158139223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5affe40 0x5597c5b8d9b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6b84005560 tx=0x7f6b840b7fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca1f9b4b999de624 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.791+0000 7f6b77400700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:25:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.792+0000 7f6b77400700 1 -- 172.21.15.2:0/3158139223 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b840b6e60 con 0x5597c5affe40 2024-06-13T11:25:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.792+0000 7f6b77400700 1 -- 172.21.15.2:0/3158139223 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f6b840a6650 con 0x5597c5affe40 2024-06-13T11:25:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.793+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/3158139223 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b840b3030 con 0x5597c5affe40 2024-06-13T11:25:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.793+0000 7f6b77400700 1 -- 172.21.15.2:0/3158139223 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6b840bc050 con 0x5597c5affe40 2024-06-13T11:25:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.793+0000 7f6ba29b4b80 10 client.25550 fetch_fsmap learned FSMap version 29 2024-06-13T11:25:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.793+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/3158139223 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5597c5b9b3f0 con 0x5597c5affe40 2024-06-13T11:25:46.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.794+0000 7f6b77400700 1 -- 172.21.15.2:0/3158139223 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b840b3030 con 0x5597c5affe40 2024-06-13T11:25:46.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.794+0000 7f6b77400700 1 -- 172.21.15.2:0/3158139223 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6b840ae030 con 0x5597c5affe40 2024-06-13T11:25:46.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.794+0000 7f6ba29b4b80 10 client.25550 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:25:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.794+0000 7f6ba29b4b80 10 client.25550 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:25:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.794+0000 7f6ba29b4b80 20 client.25550 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.794+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/3158139223 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5597c5b9d8c0 0x5597c5b9fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.794+0000 7f6ba29b4b80 4 client.25550 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:25:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.794+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/3158139223 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597c5ae3000 con 0x5597c5b9d8c0 2024-06-13T11:25:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.794+0000 7f6b94c00700 1 --2- 172.21.15.2:0/3158139223 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5597c5b9d8c0 0x5597c5b9fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.795+0000 7f6b77400700 10 client.25550 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:25:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.796+0000 7f6b94c00700 1 --2- 172.21.15.2:0/3158139223 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5597c5b9d8c0 0x5597c5b9fcb0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cc7b7716c9a4523d server_cookie=7792a268197fecf5 in_seq=0 out_seq=0 2024-06-13T11:25:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.797+0000 7f6b77400700 1 -- 172.21.15.2:0/3158139223 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5597c5ae3000 con 0x5597c5b9d8c0 2024-06-13T11:25:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.797+0000 7f6b77400700 10 client.25550 handle_command_reply: tid=0 2024-06-13T11:25:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.797+0000 7f6ba29b4b80 1 client.25550 shutdown 2024-06-13T11:25:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.798+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/3158139223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5affe40 msgr2=0x5597c5b8d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.798+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/3158139223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5affe40 0x5597c5b8d9b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6b84005560 tx=0x7f6b840b7fa0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.798+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/3158139223 shutdown_connections 2024-06-13T11:25:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.798+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/3158139223 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5597c5b9d8c0 0x5597c5b9fcb0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.798+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/3158139223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5b8e300 0x5597c5b8b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.798+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/3158139223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5affe40 0x5597c5b8d9b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.798+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/3158139223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5b835b0 0x5597c5b8acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.798+0000 7f6b77400700 0 client.25550 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:25:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.798+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/3158139223 >> 172.21.15.2:0/3158139223 conn(0x5597c5ab0170 msgr2=0x5597c5b7e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.799+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/3158139223 shutdown_connections 2024-06-13T11:25:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.799+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/3158139223 wait complete. 2024-06-13T11:25:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.800+0000 7f6ba29b4b80 20 client.25550 trim_cache size 0 max 16384 2024-06-13T11:25:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.823+0000 7f6ba29b4b80 1 Processor -- start 2024-06-13T11:25:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.823+0000 7f6ba29b4b80 1 -- start start 2024-06-13T11:25:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.824+0000 7f6ba29b4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5affe40 0x5597c5b90780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.824+0000 7f6ba29b4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5b835b0 0x5597c5b8f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.825+0000 7f6ba29b4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5b8e300 0x5597c5b8d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.825+0000 7f6ba29b4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6b70011520 con 0x5597c5b835b0 2024-06-13T11:25:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.825+0000 7f6ba29b4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7000edb0 con 0x5597c5b8e300 2024-06-13T11:25:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.825+0000 7f6ba29b4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7000cc00 con 0x5597c5affe40 2024-06-13T11:25:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.825+0000 7f6b95600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5affe40 0x5597c5b90780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.825+0000 7f6b96000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5b8e300 0x5597c5b8d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.825+0000 7f6b95600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5affe40 0x5597c5b90780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:43036/0 (socket says 172.21.15.2:43036) 2024-06-13T11:25:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.826+0000 7f6b95600700 1 -- 172.21.15.2:0/2333980391 learned_addr learned my addr 172.21.15.2:0/2333980391 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.825+0000 7f6b94c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5b835b0 0x5597c5b8f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.826+0000 7f6b95600700 1 -- 172.21.15.2:0/2333980391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5b8e300 msgr2=0x5597c5b8d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.826+0000 7f6b95600700 1 --2- 172.21.15.2:0/2333980391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5b8e300 0x5597c5b8d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.826+0000 7f6b95600700 1 -- 172.21.15.2:0/2333980391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5b835b0 msgr2=0x5597c5b8f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.826+0000 7f6b95600700 1 --2- 172.21.15.2:0/2333980391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5b835b0 0x5597c5b8f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.826+0000 7f6b95600700 1 -- 172.21.15.2:0/2333980391 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597c5b89220 con 0x5597c5affe40 2024-06-13T11:25:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.826+0000 7f6b94c00700 1 --2- 172.21.15.2:0/2333980391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5b835b0 0x5597c5b8f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:25:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.827+0000 7f6b95600700 1 --2- 172.21.15.2:0/2333980391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5affe40 0x5597c5b90780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6b8409bfa0 tx=0x7f6b84005860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3118a0d14b6a66b8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.827+0000 7f6b82000700 1 -- 172.21.15.2:0/2333980391 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b840b6e60 con 0x5597c5affe40 2024-06-13T11:25:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.827+0000 7f6b82000700 1 -- 172.21.15.2:0/2333980391 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b840b3070 con 0x5597c5affe40 2024-06-13T11:25:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.827+0000 7f6b82000700 1 -- 172.21.15.2:0/2333980391 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b840226d0 con 0x5597c5affe40 2024-06-13T11:25:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.828+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/2333980391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5affe40 msgr2=0x5597c5b90780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.828+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/2333980391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5affe40 0x5597c5b90780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6b8409bfa0 tx=0x7f6b84005860 comp rx=0 tx=0).stop 2024-06-13T11:25:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.829+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/2333980391 shutdown_connections 2024-06-13T11:25:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.829+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/2333980391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5b8e300 0x5597c5b8d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.829+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/2333980391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5affe40 0x5597c5b90780 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.829+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/2333980391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5b835b0 0x5597c5b8f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.829+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/2333980391 >> 172.21.15.2:0/2333980391 conn(0x5597c5ab0170 msgr2=0x5597c5b90070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.829+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/2333980391 shutdown_connections 2024-06-13T11:25:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.830+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/2333980391 wait complete. 2024-06-13T11:25:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.830+0000 7f6ba29b4b80 1 -- start start 2024-06-13T11:25:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.830+0000 7f6ba29b4b80 1 Processor -- start 2024-06-13T11:25:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.831+0000 7f6ba29b4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5affe40 0x5597c5b8ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.831+0000 7f6ba29b4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5b835b0 0x5597c5b8f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.831+0000 7f6ba29b4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5b8e300 0x5597c5b8f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.831+0000 7f6ba29b4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7000d270 con 0x5597c5b8e300 2024-06-13T11:25:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.831+0000 7f6ba29b4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7000e6e0 con 0x5597c5affe40 2024-06-13T11:25:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.831+0000 7f6ba29b4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7000d940 con 0x5597c5b835b0 2024-06-13T11:25:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.832+0000 7f6ba29b4b80 10 client.0 _ll_register_callbacks cb 0x5597c5a6f720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.832+0000 7f6b94c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5b835b0 0x5597c5b8f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.832+0000 7f6b95600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5affe40 0x5597c5b8ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.832+0000 7f6b95600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5affe40 0x5597c5b8ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:56546/0 (socket says 172.21.15.2:56546) 2024-06-13T11:25:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.832+0000 7f6b95600700 1 -- 172.21.15.2:0/1776471463 learned_addr learned my addr 172.21.15.2:0/1776471463 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.833+0000 7f6b95600700 1 -- 172.21.15.2:0/1776471463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5b835b0 msgr2=0x5597c5b8f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.833+0000 7f6b95600700 1 --2- 172.21.15.2:0/1776471463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5b835b0 0x5597c5b8f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.833+0000 7f6b95600700 1 -- 172.21.15.2:0/1776471463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5b8e300 msgr2=0x5597c5b8f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.833+0000 7f6b95600700 1 --2- 172.21.15.2:0/1776471463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5b8e300 0x5597c5b8f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.833+0000 7f6b95600700 1 -- 172.21.15.2:0/1776471463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597c5b95270 con 0x5597c5affe40 2024-06-13T11:25:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.833+0000 7f6b95600700 1 --2- 172.21.15.2:0/1776471463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5affe40 0x5597c5b8ee50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6b84006010 tx=0x7f6b840092e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69dfe9b12f50d502 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.833+0000 7f6b77400700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:25:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.834+0000 7f6b77400700 1 -- 172.21.15.2:0/1776471463 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b840b6e60 con 0x5597c5affe40 2024-06-13T11:25:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.834+0000 7f6b77400700 1 -- 172.21.15.2:0/1776471463 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f6b8409bff0 con 0x5597c5affe40 2024-06-13T11:25:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.834+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/1776471463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b840b3070 con 0x5597c5affe40 2024-06-13T11:25:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.835+0000 7f6b77400700 1 -- 172.21.15.2:0/1776471463 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6b840a68d0 con 0x5597c5affe40 2024-06-13T11:25:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.835+0000 7f6ba29b4b80 10 client.25556 fetch_fsmap learned FSMap version 29 2024-06-13T11:25:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.835+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/1776471463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5597c5b95270 con 0x5597c5affe40 2024-06-13T11:25:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.836+0000 7f6b77400700 1 -- 172.21.15.2:0/1776471463 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b840b3070 con 0x5597c5affe40 2024-06-13T11:25:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.836+0000 7f6b77400700 1 -- 172.21.15.2:0/1776471463 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6b840ae070 con 0x5597c5affe40 2024-06-13T11:25:46.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.836+0000 7f6ba29b4b80 10 client.25556 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:25:46.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.837+0000 7f6ba29b4b80 10 client.25556 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:25:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.838+0000 7f6ba29b4b80 20 client.25556 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.838+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/1776471463 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5597c5b96650 0x5597c5c0a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.838+0000 7f6ba29b4b80 4 client.25556 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:25:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.838+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/1776471463 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5597c5add580 con 0x5597c5b96650 2024-06-13T11:25:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.838+0000 7f6b94c00700 1 --2- 172.21.15.2:0/1776471463 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5597c5b96650 0x5597c5c0a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.840+0000 7f6b94c00700 1 --2- 172.21.15.2:0/1776471463 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5597c5b96650 0x5597c5c0a510 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=97d8f6456abf27e4 server_cookie=4e64932c20646c6 in_seq=0 out_seq=0 2024-06-13T11:25:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.840+0000 7f6b77400700 10 client.25556 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:25:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.840+0000 7f6b77400700 1 -- 172.21.15.2:0/1776471463 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5597c5add580 con 0x5597c5b96650 2024-06-13T11:25:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.840+0000 7f6b77400700 10 client.25556 handle_command_reply: tid=0 2024-06-13T11:25:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.840+0000 7f6ba29b4b80 1 client.25556 shutdown 2024-06-13T11:25:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.841+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/1776471463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5affe40 msgr2=0x5597c5b8ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.841+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/1776471463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5affe40 0x5597c5b8ee50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6b84006010 tx=0x7f6b840092e0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.842+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/1776471463 shutdown_connections 2024-06-13T11:25:46.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.842+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/1776471463 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5597c5b96650 0x5597c5c0a510 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.842+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/1776471463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597c5b8e300 0x5597c5b8f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.842+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/1776471463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5597c5affe40 0x5597c5b8ee50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.842+0000 7f6ba29b4b80 1 --2- 172.21.15.2:0/1776471463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5597c5b835b0 0x5597c5b8f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.842+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/1776471463 >> 172.21.15.2:0/1776471463 conn(0x5597c5ab0170 msgr2=0x5597c5b7e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.842+0000 7f6b77400700 0 client.25556 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:25:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.842+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/1776471463 shutdown_connections 2024-06-13T11:25:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.842+0000 7f6ba29b4b80 1 -- 172.21.15.2:0/1776471463 wait complete. 2024-06-13T11:25:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.842+0000 7f6ba29b4b80 20 client.25556 trim_cache size 0 max 16384 2024-06-13T11:25:46.841 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:25:46.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.843+0000 7f6b98000700 1 -- 172.21.15.2:0/1549137007 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6b780a2e10 msgr2=0x7f6b780a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.843+0000 7f6b98000700 1 --2- 172.21.15.2:0/1549137007 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6b780a2e10 0x7f6b780a52d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c005ea0 tx=0x7f6b7c005e30 comp rx=0 tx=0).stop 2024-06-13T11:25:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.843+0000 7f6b98000700 1 -- 172.21.15.2:0/1549137007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b9006a170 msgr2=0x7f6b9019aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.843+0000 7f6b98000700 1 --2- 172.21.15.2:0/1549137007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b9006a170 0x7f6b9019aea0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400b5c0 tx=0x7f6b84005640 comp rx=0 tx=0).stop 2024-06-13T11:25:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.844+0000 7f6b98000700 1 -- 172.21.15.2:0/1549137007 shutdown_connections 2024-06-13T11:25:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.844+0000 7f6b98000700 1 --2- 172.21.15.2:0/1549137007 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6b780a2e10 0x7f6b780a52d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.844+0000 7f6b98000700 1 --2- 172.21.15.2:0/1549137007 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b90108500 0x7f6b9019f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.844+0000 7f6b98000700 1 --2- 172.21.15.2:0/1549137007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b9006a170 0x7f6b9019aea0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.844+0000 7f6b98000700 1 --2- 172.21.15.2:0/1549137007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b9006ab30 0x7f6b9019b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.844+0000 7f6b98000700 1 -- 172.21.15.2:0/1549137007 >> 172.21.15.2:0/1549137007 conn(0x7f6b90078340 msgr2=0x7f6b9010d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.844+0000 7f6b98000700 1 -- 172.21.15.2:0/1549137007 shutdown_connections 2024-06-13T11:25:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:46.844+0000 7f6b98000700 1 -- 172.21.15.2:0/1549137007 wait complete. 2024-06-13T11:25:47.744 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-13T11:25:47.819 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:47 smithi002 ceph-mon[32210]: pgmap v63: 129 pgs: 129 active+clean; 37 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 29 op/s 2024-06-13T11:25:47.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:47 smithi178 ceph-mon[36913]: pgmap v63: 129 pgs: 129 active+clean; 37 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 29 op/s 2024-06-13T11:25:48.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:47 smithi077 ceph-mon[36410]: pgmap v63: 129 pgs: 129 active+clean; 37 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 29 op/s 2024-06-13T11:25:48.194 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:25:49.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:49 smithi002 ceph-mon[32210]: pgmap v64: 129 pgs: 129 active+clean; 52 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 497 op/s 2024-06-13T11:25:49.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:49 smithi178 ceph-mon[36913]: pgmap v64: 129 pgs: 129 active+clean; 52 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 497 op/s 2024-06-13T11:25:50.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:49 smithi077 ceph-mon[36410]: pgmap v64: 129 pgs: 129 active+clean; 52 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 497 op/s 2024-06-13T11:25:50.847 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to '12973fc04fd10d4af086901e10ffa8e48866b735'. 2024-06-13T11:25:50.847 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T11:25:50.848 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-13T11:25:50.848 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-13T11:25:50.848 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-06-13T11:25:50.848 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T11:25:50.848 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-13T11:25:50.848 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-13T11:25:50.848 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T11:25:50.848 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-06-13T11:25:50.848 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T11:25:50.848 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-06-13T11:25:50.848 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T11:25:50.848 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-06-13T11:25:50.848 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T11:25:50.849 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-13T11:25:50.849 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T11:25:50.849 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at 12973fc0 btrfs/022: Correct seq number in golden output 2024-06-13T11:25:50.864 INFO:tasks.workunit.client.0.smithi002.stderr:+ make -j4 2024-06-13T11:25:50.884 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize -cfi 2024-06-13T11:25:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.615+0000 7f0e67200700 1 -- 172.21.15.2:0/1031117703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e60113190 msgr2=0x7f0e60115580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.615+0000 7f0e67200700 1 --2- 172.21.15.2:0/1031117703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e60113190 0x7f0e60115580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009990 tx=0x7f0e58009ca0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.615+0000 7f0e67200700 1 -- 172.21.15.2:0/1031117703 shutdown_connections 2024-06-13T11:25:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.615+0000 7f0e67200700 1 --2- 172.21.15.2:0/1031117703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e60113190 0x7f0e60115580 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.615+0000 7f0e67200700 1 --2- 172.21.15.2:0/1031117703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e60076470 0x7f0e600746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.615+0000 7f0e67200700 1 --2- 172.21.15.2:0/1031117703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e60074c00 0x7f0e60075080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.616+0000 7f0e67200700 1 -- 172.21.15.2:0/1031117703 >> 172.21.15.2:0/1031117703 conn(0x7f0e60079650 msgr2=0x7f0e60079a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.617+0000 7f0e67200700 1 -- 172.21.15.2:0/1031117703 shutdown_connections 2024-06-13T11:25:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.617+0000 7f0e67200700 1 -- 172.21.15.2:0/1031117703 wait complete. 2024-06-13T11:25:51.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.619+0000 7f0e67200700 1 Processor -- start 2024-06-13T11:25:51.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.621+0000 7f0e67200700 1 -- start start 2024-06-13T11:25:51.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.624+0000 7f0e67200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e60074c00 0x7f0e6019f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.625+0000 7f0e67200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e60076470 0x7f0e6019f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.625+0000 7f0e67200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e60113190 0x7f0e601a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.625+0000 7f0e67200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0e60118de0 con 0x7f0e60076470 2024-06-13T11:25:51.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.625+0000 7f0e67200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0e60118c60 con 0x7f0e60074c00 2024-06-13T11:25:51.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.625+0000 7f0e67200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0e60118f60 con 0x7f0e60113190 2024-06-13T11:25:51.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.626+0000 7f0e57e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e60076470 0x7f0e6019f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.626+0000 7f0e57e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e60076470 0x7f0e6019f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50330/0 (socket says 172.21.15.2:50330) 2024-06-13T11:25:51.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.626+0000 7f0e57e00700 1 -- 172.21.15.2:0/1423106590 learned_addr learned my addr 172.21.15.2:0/1423106590 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:51.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.626+0000 7f0e65200700 1 --2- 172.21.15.2:0/1423106590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e60113190 0x7f0e601a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.626+0000 7f0e57e00700 1 -- 172.21.15.2:0/1423106590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e60113190 msgr2=0x7f0e601a3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:51.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.627+0000 7f0e5fe00700 1 --2- 172.21.15.2:0/1423106590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e60074c00 0x7f0e6019f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.627+0000 7f0e57e00700 1 --2- 172.21.15.2:0/1423106590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e60113190 0x7f0e601a3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.627+0000 7f0e57e00700 1 -- 172.21.15.2:0/1423106590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e60074c00 msgr2=0x7f0e6019f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.627+0000 7f0e57e00700 1 --2- 172.21.15.2:0/1423106590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e60074c00 0x7f0e6019f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.627+0000 7f0e57e00700 1 -- 172.21.15.2:0/1423106590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e601a41d0 con 0x7f0e60076470 2024-06-13T11:25:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.627+0000 7f0e5fe00700 1 --2- 172.21.15.2:0/1423106590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e60074c00 0x7f0e6019f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:25:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.627+0000 7f0e65200700 1 --2- 172.21.15.2:0/1423106590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e60113190 0x7f0e601a3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:25:51.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.627+0000 7f0e57e00700 1 --2- 172.21.15.2:0/1423106590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e60076470 0x7f0e6019f750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800c9b0 tx=0x7f0e4800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.628+0000 7f0e5d600700 1 -- 172.21.15.2:0/1423106590 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e48007b00 con 0x7f0e60076470 2024-06-13T11:25:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.628+0000 7f0e5d600700 1 -- 172.21.15.2:0/1423106590 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e48007ca0 con 0x7f0e60076470 2024-06-13T11:25:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.628+0000 7f0e5d600700 1 -- 172.21.15.2:0/1423106590 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e48018780 con 0x7f0e60076470 2024-06-13T11:25:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.628+0000 7f0e67200700 1 -- 172.21.15.2:0/1423106590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e601a44c0 con 0x7f0e60076470 2024-06-13T11:25:51.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.629+0000 7f0e67200700 1 -- 172.21.15.2:0/1423106590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e601abd40 con 0x7f0e60076470 2024-06-13T11:25:51.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.640+0000 7f0e71c5db80 1 Processor -- start 2024-06-13T11:25:51.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.642+0000 7f0e71c5db80 1 -- start start 2024-06-13T11:25:51.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.643+0000 7f0e71c5db80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6b9b90 0x55cb7e6b9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.644+0000 7f0e71c5db80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.644+0000 7f0e71c5db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6b4240 0x55cb7e6b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.644+0000 7f0e5d600700 1 -- 172.21.15.2:0/1423106590 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f0e4800f450 con 0x7f0e60076470 2024-06-13T11:25:51.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.645+0000 7f0e65200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6b9b90 0x55cb7e6b9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.645+0000 7f0e65200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6b9b90 0x55cb7e6b9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:56582/0 (socket says 172.21.15.2:56582) 2024-06-13T11:25:51.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.645+0000 7f0e5fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.646+0000 7f0e71c5db80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cb7e5c2a10 con 0x55cb7e6ba4b0 2024-06-13T11:25:51.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.646+0000 7f0e71c5db80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cb7e605b00 con 0x55cb7e6b9b90 2024-06-13T11:25:51.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.646+0000 7f0e71c5db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55cb7e5c08f0 con 0x55cb7e6b4240 2024-06-13T11:25:51.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.646+0000 7f0e5fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50336/0 (socket says 172.21.15.2:50336) 2024-06-13T11:25:51.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.646+0000 7f0e65200700 1 -- 172.21.15.2:0/1035007640 learned_addr learned my addr 172.21.15.2:0/1035007640 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:51.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.646+0000 7f0e57e00700 1 --2- 172.21.15.2:0/1035007640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6b4240 0x55cb7e6b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.648+0000 7f0e65200700 1 -- 172.21.15.2:0/1035007640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6b4240 msgr2=0x55cb7e6b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:51.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.648+0000 7f0e65200700 1 --2- 172.21.15.2:0/1035007640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6b4240 0x55cb7e6b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.648+0000 7f0e65200700 1 -- 172.21.15.2:0/1035007640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6ba4b0 msgr2=0x55cb7e6b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:51.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.648+0000 7f0e65200700 1 --2- 172.21.15.2:0/1035007640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.648+0000 7f0e65200700 1 -- 172.21.15.2:0/1035007640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb7e5adf90 con 0x55cb7e6b9b90 2024-06-13T11:25:51.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.648+0000 7f0e57e00700 1 --2- 172.21.15.2:0/1035007640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6b4240 0x55cb7e6b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:25:51.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.649+0000 7f0e5d600700 1 --2- 172.21.15.2:0/1423106590 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0e440a2e10 0x7f0e440a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.651+0000 7f0e5d600700 1 -- 172.21.15.2:0/1423106590 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f0e480cf6a0 con 0x7f0e60076470 2024-06-13T11:25:51.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.651+0000 7f0e5fe00700 1 --2- 172.21.15.2:0/1423106590 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0e440a2e10 0x7f0e440a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.651+0000 7f0e65200700 1 --2- 172.21.15.2:0/1035007640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6b9b90 0x55cb7e6b9f70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0e58015000 tx=0x7f0e5800b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62961e3550db87b0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:51.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.653+0000 7f0e55600700 1 -- 172.21.15.2:0/1035007640 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e58026020 con 0x55cb7e6b9b90 2024-06-13T11:25:51.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.653+0000 7f0e55600700 1 -- 172.21.15.2:0/1035007640 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e58004d10 con 0x55cb7e6b9b90 2024-06-13T11:25:51.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.653+0000 7f0e55600700 1 -- 172.21.15.2:0/1035007640 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e580055f0 con 0x55cb7e6b9b90 2024-06-13T11:25:51.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.654+0000 7f0e71c5db80 1 -- 172.21.15.2:0/1035007640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6b9b90 msgr2=0x55cb7e6b9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:51.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.654+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/1035007640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6b9b90 0x55cb7e6b9f70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0e58015000 tx=0x7f0e5800b690 comp rx=0 tx=0).stop 2024-06-13T11:25:51.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.655+0000 7f0e5fe00700 1 --2- 172.21.15.2:0/1423106590 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0e440a2e10 0x7f0e440a52d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0e50003a20 tx=0x7f0e5000b040 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:51.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.655+0000 7f0e71c5db80 1 -- 172.21.15.2:0/1035007640 shutdown_connections 2024-06-13T11:25:51.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.655+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/1035007640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6b4240 0x55cb7e6b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.655+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/1035007640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6b9b90 0x55cb7e6b9f70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.656+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/1035007640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.656+0000 7f0e71c5db80 1 -- 172.21.15.2:0/1035007640 >> 172.21.15.2:0/1035007640 conn(0x55cb7e5e0170 msgr2=0x55cb7e6aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:51.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.656+0000 7f0e71c5db80 1 -- 172.21.15.2:0/1035007640 shutdown_connections 2024-06-13T11:25:51.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.657+0000 7f0e71c5db80 1 -- 172.21.15.2:0/1035007640 wait complete. 2024-06-13T11:25:51.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.658+0000 7f0e71c5db80 1 -- start start 2024-06-13T11:25:51.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.659+0000 7f0e71c5db80 1 Processor -- start 2024-06-13T11:25:51.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.660+0000 7f0e71c5db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6b4240 0x55cb7e6c0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.661+0000 7f0e71c5db80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6b9b90 0x55cb7e6bd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.661+0000 7f0e71c5db80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6bda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.662+0000 7f0e71c5db80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cb7e5a1f60 con 0x55cb7e6b9b90 2024-06-13T11:25:51.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.662+0000 7f0e71c5db80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cb7e601ac0 con 0x55cb7e6ba4b0 2024-06-13T11:25:51.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.662+0000 7f0e71c5db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55cb7e6c0e30 con 0x55cb7e6b4240 2024-06-13T11:25:51.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.662+0000 7f0e5fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6b4240 0x55cb7e6c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.662+0000 7f0e5fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6b4240 0x55cb7e6c0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:43076/0 (socket says 172.21.15.2:43076) 2024-06-13T11:25:51.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.662+0000 7f0e5fe00700 1 -- 172.21.15.2:0/3164643088 learned_addr learned my addr 172.21.15.2:0/3164643088 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:51.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.663+0000 7f0e71c5db80 10 client.0 _ll_register_callbacks cb 0x55cb7e59b380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:51.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.664+0000 7f0e65200700 1 --2- 172.21.15.2:0/3164643088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6bda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.664+0000 7f0e57e00700 1 --2- 172.21.15.2:0/3164643088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6b9b90 0x55cb7e6bd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.666+0000 7f0e57e00700 1 -- 172.21.15.2:0/3164643088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6b4240 msgr2=0x55cb7e6c0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:51.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.666+0000 7f0e57e00700 1 --2- 172.21.15.2:0/3164643088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6b4240 0x55cb7e6c0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.666+0000 7f0e57e00700 1 -- 172.21.15.2:0/3164643088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6ba4b0 msgr2=0x55cb7e6bda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:51.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.666+0000 7f0e57e00700 1 --2- 172.21.15.2:0/3164643088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6bda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.666+0000 7f0e57e00700 1 -- 172.21.15.2:0/3164643088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb7e5548d0 con 0x55cb7e6b9b90 2024-06-13T11:25:51.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.667+0000 7f0e57e00700 1 --2- 172.21.15.2:0/3164643088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6b9b90 0x55cb7e6bd500 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0e480cca80 tx=0x7f0e4809b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c071cfc75e3c3a69 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:51.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.667+0000 7f0e4e000700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:25:51.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.667+0000 7f0e4e000700 1 -- 172.21.15.2:0/3164643088 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4809b850 con 0x55cb7e6b9b90 2024-06-13T11:25:51.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.667+0000 7f0e4e000700 1 -- 172.21.15.2:0/3164643088 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f0e4800fa30 con 0x55cb7e6b9b90 2024-06-13T11:25:51.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.667+0000 7f0e71c5db80 1 -- 172.21.15.2:0/3164643088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e58004d10 con 0x55cb7e6b9b90 2024-06-13T11:25:51.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.668+0000 7f0e4e000700 1 -- 172.21.15.2:0/3164643088 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0e4809fc00 con 0x55cb7e6b9b90 2024-06-13T11:25:51.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.668+0000 7f0e71c5db80 10 client.15450 fetch_fsmap learned FSMap version 29 2024-06-13T11:25:51.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.668+0000 7f0e71c5db80 1 -- 172.21.15.2:0/3164643088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cb7e6cb5c0 con 0x55cb7e6b9b90 2024-06-13T11:25:51.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.669+0000 7f0e4e000700 1 -- 172.21.15.2:0/3164643088 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e58004d10 con 0x55cb7e6b9b90 2024-06-13T11:25:51.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.669+0000 7f0e4e000700 1 -- 172.21.15.2:0/3164643088 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f0e48020020 con 0x55cb7e6b9b90 2024-06-13T11:25:51.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.669+0000 7f0e71c5db80 10 client.15450 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:25:51.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.669+0000 7f0e71c5db80 10 client.15450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:25:51.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.669+0000 7f0e71c5db80 20 client.15450 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:51.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.669+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/3164643088 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55cb7e6cdc00 0x55cb7e6cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.669+0000 7f0e71c5db80 4 client.15450 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:25:51.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.669+0000 7f0e71c5db80 1 -- 172.21.15.2:0/3164643088 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb7e613000 con 0x55cb7e6cdc00 2024-06-13T11:25:51.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.672+0000 7f0e5fe00700 1 --2- 172.21.15.2:0/3164643088 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55cb7e6cdc00 0x55cb7e6cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.673+0000 7f0e5fe00700 1 --2- 172.21.15.2:0/3164643088 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55cb7e6cdc00 0x55cb7e6cfff0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dedc00d70022568 server_cookie=7439d81b32828e in_seq=0 out_seq=0 2024-06-13T11:25:51.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.673+0000 7f0e4e000700 10 client.15450 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:51.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.674+0000 7f0e4e000700 1 -- 172.21.15.2:0/3164643088 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55cb7e613000 con 0x55cb7e6cdc00 2024-06-13T11:25:51.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.674+0000 7f0e4e000700 10 client.15450 handle_command_reply: tid=0 2024-06-13T11:25:51.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.674+0000 7f0e71c5db80 1 client.15450 shutdown 2024-06-13T11:25:51.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.674+0000 7f0e71c5db80 1 -- 172.21.15.2:0/3164643088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6b9b90 msgr2=0x55cb7e6bd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:51.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.674+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/3164643088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6b9b90 0x55cb7e6bd500 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0e480cca80 tx=0x7f0e4809b720 comp rx=0 tx=0).stop 2024-06-13T11:25:51.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.675+0000 7f0e71c5db80 1 -- 172.21.15.2:0/3164643088 shutdown_connections 2024-06-13T11:25:51.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.675+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/3164643088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6bda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.675+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/3164643088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6b4240 0x55cb7e6c0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.675+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/3164643088 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55cb7e6cdc00 0x55cb7e6cfff0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.675+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/3164643088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6b9b90 0x55cb7e6bd500 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0e480cca80 tx=0x7f0e4809b720 comp rx=0 tx=0).stop 2024-06-13T11:25:51.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.675+0000 7f0e71c5db80 1 -- 172.21.15.2:0/3164643088 >> 172.21.15.2:0/3164643088 conn(0x55cb7e5e0170 msgr2=0x55cb7e6a8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:51.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.675+0000 7f0e4e000700 0 client.15450 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:51.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.675+0000 7f0e71c5db80 1 -- 172.21.15.2:0/3164643088 shutdown_connections 2024-06-13T11:25:51.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.676+0000 7f0e71c5db80 1 -- 172.21.15.2:0/3164643088 wait complete. 2024-06-13T11:25:51.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.677+0000 7f0e71c5db80 20 client.15450 trim_cache size 0 max 16384 2024-06-13T11:25:51.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.713+0000 7f0e71c5db80 1 Processor -- start 2024-06-13T11:25:51.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.713+0000 7f0e71c5db80 1 -- start start 2024-06-13T11:25:51.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.714+0000 7f0e71c5db80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6b4240 0x55cb7e6b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.715+0000 7f0e71c5db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.715+0000 7f0e71c5db80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6c9fd0 0x55cb7e6aea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.715+0000 7f0e71c5db80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0e601b7290 con 0x55cb7e6b4240 2024-06-13T11:25:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.715+0000 7f0e71c5db80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0e601b4b20 con 0x55cb7e6c9fd0 2024-06-13T11:25:51.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.715+0000 7f0e71c5db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0e601b2970 con 0x55cb7e6ba4b0 2024-06-13T11:25:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.715+0000 7f0e57e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.715+0000 7f0e57e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:43092/0 (socket says 172.21.15.2:43092) 2024-06-13T11:25:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.715+0000 7f0e57e00700 1 -- 172.21.15.2:0/3975609937 learned_addr learned my addr 172.21.15.2:0/3975609937 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.716+0000 7f0e5fe00700 1 --2- 172.21.15.2:0/3975609937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6b4240 0x55cb7e6b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.716+0000 7f0e65200700 1 --2- 172.21.15.2:0/3975609937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6c9fd0 0x55cb7e6aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.717+0000 7f0e57e00700 1 -- 172.21.15.2:0/3975609937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6c9fd0 msgr2=0x55cb7e6aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.717+0000 7f0e57e00700 1 --2- 172.21.15.2:0/3975609937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6c9fd0 0x55cb7e6aea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.717+0000 7f0e57e00700 1 -- 172.21.15.2:0/3975609937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6b4240 msgr2=0x55cb7e6b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:51.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.717+0000 7f0e57e00700 1 --2- 172.21.15.2:0/3975609937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6b4240 0x55cb7e6b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.717+0000 7f0e57e00700 1 -- 172.21.15.2:0/3975609937 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb7e6b0740 con 0x55cb7e6ba4b0 2024-06-13T11:25:51.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.718+0000 7f0e65200700 1 --2- 172.21.15.2:0/3975609937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6c9fd0 0x55cb7e6aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:25:51.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.718+0000 7f0e57e00700 1 --2- 172.21.15.2:0/3975609937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6a9130 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0e48098220 tx=0x7f0e48000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcc943124f834dcf server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:51.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.718+0000 7f0e54c00700 1 -- 172.21.15.2:0/3975609937 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4809b850 con 0x55cb7e6ba4b0 2024-06-13T11:25:51.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.718+0000 7f0e54c00700 1 -- 172.21.15.2:0/3975609937 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e480a44c0 con 0x55cb7e6ba4b0 2024-06-13T11:25:51.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.718+0000 7f0e54c00700 1 -- 172.21.15.2:0/3975609937 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e480a4270 con 0x55cb7e6ba4b0 2024-06-13T11:25:51.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.719+0000 7f0e71c5db80 1 -- 172.21.15.2:0/3975609937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6ba4b0 msgr2=0x55cb7e6a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:51.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.719+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/3975609937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6a9130 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0e48098220 tx=0x7f0e48000bc0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.719+0000 7f0e71c5db80 1 -- 172.21.15.2:0/3975609937 shutdown_connections 2024-06-13T11:25:51.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.719+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/3975609937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6b4240 0x55cb7e6b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.719+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/3975609937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6c9fd0 0x55cb7e6aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.719+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/3975609937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6a9130 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.719+0000 7f0e71c5db80 1 -- 172.21.15.2:0/3975609937 >> 172.21.15.2:0/3975609937 conn(0x55cb7e5e0170 msgr2=0x55cb7e6bbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.719+0000 7f0e71c5db80 1 -- 172.21.15.2:0/3975609937 shutdown_connections 2024-06-13T11:25:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.719+0000 7f0e71c5db80 1 -- 172.21.15.2:0/3975609937 wait complete. 2024-06-13T11:25:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.720+0000 7f0e71c5db80 1 -- start start 2024-06-13T11:25:51.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.720+0000 7f0e71c5db80 1 Processor -- start 2024-06-13T11:25:51.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.721+0000 7f0e71c5db80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6b4240 0x55cb7e6c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.721+0000 7f0e71c5db80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6c6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.721+0000 7f0e71c5db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6c9fd0 0x55cb7e6d4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.722+0000 7f0e71c5db80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0e601b2fe0 con 0x55cb7e6b4240 2024-06-13T11:25:51.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.722+0000 7f0e71c5db80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0e601b4450 con 0x55cb7e6ba4b0 2024-06-13T11:25:51.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.722+0000 7f0e71c5db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0e601b36b0 con 0x55cb7e6c9fd0 2024-06-13T11:25:51.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.722+0000 7f0e71c5db80 10 client.0 _ll_register_callbacks cb 0x55cb7e59b380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:51.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.722+0000 7f0e65200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6c9fd0 0x55cb7e6d4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.722+0000 7f0e65200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6c9fd0 0x55cb7e6d4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:43096/0 (socket says 172.21.15.2:43096) 2024-06-13T11:25:51.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.722+0000 7f0e65200700 1 -- 172.21.15.2:0/74261964 learned_addr learned my addr 172.21.15.2:0/74261964 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:51.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.723+0000 7f0e65200700 1 -- 172.21.15.2:0/74261964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6ba4b0 msgr2=0x55cb7e6c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:51.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.723+0000 7f0e57e00700 1 --2- 172.21.15.2:0/74261964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.723+0000 7f0e65200700 1 --2- 172.21.15.2:0/74261964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6c6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.723+0000 7f0e65200700 1 -- 172.21.15.2:0/74261964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6b4240 msgr2=0x55cb7e6c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:51.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.723+0000 7f0e65200700 1 --2- 172.21.15.2:0/74261964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6b4240 0x55cb7e6c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.723+0000 7f0e65200700 1 -- 172.21.15.2:0/74261964 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb7e6d5450 con 0x55cb7e6c9fd0 2024-06-13T11:25:51.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.723+0000 7f0e57e00700 1 --2- 172.21.15.2:0/74261964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6c6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:25:51.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.723+0000 7f0e65200700 1 --2- 172.21.15.2:0/74261964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6c9fd0 0x55cb7e6d4c40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0e58000c00 tx=0x7f0e58005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7e5fc7dd8b2403f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:51.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.723+0000 7f0e4e000700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:25:51.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.724+0000 7f0e4e000700 1 -- 172.21.15.2:0/74261964 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e58026030 con 0x55cb7e6c9fd0 2024-06-13T11:25:51.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.724+0000 7f0e4e000700 1 -- 172.21.15.2:0/74261964 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f0e580055e0 con 0x55cb7e6c9fd0 2024-06-13T11:25:51.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.724+0000 7f0e71c5db80 1 -- 172.21.15.2:0/74261964 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e480a44c0 con 0x55cb7e6c9fd0 2024-06-13T11:25:51.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.725+0000 7f0e4e000700 1 -- 172.21.15.2:0/74261964 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0e58004830 con 0x55cb7e6c9fd0 2024-06-13T11:25:51.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.725+0000 7f0e71c5db80 10 client.25600 fetch_fsmap learned FSMap version 29 2024-06-13T11:25:51.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.725+0000 7f0e71c5db80 1 -- 172.21.15.2:0/74261964 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cb7e738360 con 0x55cb7e6c9fd0 2024-06-13T11:25:51.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.725+0000 7f0e4e000700 1 -- 172.21.15.2:0/74261964 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e480a44c0 con 0x55cb7e6c9fd0 2024-06-13T11:25:51.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.726+0000 7f0e4e000700 1 -- 172.21.15.2:0/74261964 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f0e5802b040 con 0x55cb7e6c9fd0 2024-06-13T11:25:51.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.726+0000 7f0e71c5db80 10 client.25600 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:25:51.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.726+0000 7f0e71c5db80 10 client.25600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:25:51.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.726+0000 7f0e71c5db80 20 client.25600 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:51.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.726+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/74261964 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55cb7e7389a0 0x55cb7e73adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:51.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.726+0000 7f0e71c5db80 4 client.25600 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:25:51.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.726+0000 7f0e71c5db80 1 -- 172.21.15.2:0/74261964 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cb7e60d580 con 0x55cb7e7389a0 2024-06-13T11:25:51.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.726+0000 7f0e5fe00700 1 --2- 172.21.15.2:0/74261964 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55cb7e7389a0 0x55cb7e73adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:51.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.727+0000 7f0e5fe00700 1 --2- 172.21.15.2:0/74261964 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55cb7e7389a0 0x55cb7e73adc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=269590d8b05b52f5 server_cookie=837dd0aa6427a18f in_seq=0 out_seq=0 2024-06-13T11:25:51.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.727+0000 7f0e4e000700 10 client.25600 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:51.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.727+0000 7f0e4e000700 1 -- 172.21.15.2:0/74261964 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cb7e60d580 con 0x55cb7e7389a0 2024-06-13T11:25:51.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.727+0000 7f0e4e000700 10 client.25600 handle_command_reply: tid=0 2024-06-13T11:25:51.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.727+0000 7f0e71c5db80 1 client.25600 shutdown 2024-06-13T11:25:51.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.727+0000 7f0e71c5db80 1 -- 172.21.15.2:0/74261964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6c9fd0 msgr2=0x55cb7e6d4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:51.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.727+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/74261964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6c9fd0 0x55cb7e6d4c40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0e58000c00 tx=0x7f0e58005970 comp rx=0 tx=0).stop 2024-06-13T11:25:51.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.727+0000 7f0e71c5db80 1 -- 172.21.15.2:0/74261964 shutdown_connections 2024-06-13T11:25:51.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.727+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/74261964 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55cb7e7389a0 0x55cb7e73adc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.727+0000 7f0e4e000700 0 client.25600 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:51.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.727+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/74261964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cb7e6b4240 0x55cb7e6c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.727+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/74261964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb7e6c9fd0 0x55cb7e6d4c40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.727+0000 7f0e71c5db80 1 --2- 172.21.15.2:0/74261964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb7e6ba4b0 0x55cb7e6c6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.727+0000 7f0e71c5db80 1 -- 172.21.15.2:0/74261964 >> 172.21.15.2:0/74261964 conn(0x55cb7e5e0170 msgr2=0x55cb7e6aea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:51.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.728+0000 7f0e71c5db80 1 -- 172.21.15.2:0/74261964 shutdown_connections 2024-06-13T11:25:51.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.728+0000 7f0e71c5db80 1 -- 172.21.15.2:0/74261964 wait complete. 2024-06-13T11:25:51.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.728+0000 7f0e71c5db80 20 client.25600 trim_cache size 0 max 16384 2024-06-13T11:25:51.728 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:25:51.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.729+0000 7f0e67200700 1 -- 172.21.15.2:0/1423106590 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0e440a2e10 msgr2=0x7f0e440a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:51.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.729+0000 7f0e67200700 1 --2- 172.21.15.2:0/1423106590 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0e440a2e10 0x7f0e440a52d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0e50003a20 tx=0x7f0e5000b040 comp rx=0 tx=0).stop 2024-06-13T11:25:51.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.729+0000 7f0e67200700 1 -- 172.21.15.2:0/1423106590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e60076470 msgr2=0x7f0e6019f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:51.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.729+0000 7f0e67200700 1 --2- 172.21.15.2:0/1423106590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e60076470 0x7f0e6019f750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800c9b0 tx=0x7f0e4800cd70 comp rx=0 tx=0).stop 2024-06-13T11:25:51.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.729+0000 7f0e67200700 1 -- 172.21.15.2:0/1423106590 shutdown_connections 2024-06-13T11:25:51.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.729+0000 7f0e67200700 1 --2- 172.21.15.2:0/1423106590 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0e440a2e10 0x7f0e440a52d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.729+0000 7f0e67200700 1 --2- 172.21.15.2:0/1423106590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e60113190 0x7f0e601a3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.729+0000 7f0e67200700 1 --2- 172.21.15.2:0/1423106590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e60074c00 0x7f0e6019f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.729+0000 7f0e67200700 1 --2- 172.21.15.2:0/1423106590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e60076470 0x7f0e6019f750 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:51.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.729+0000 7f0e67200700 1 -- 172.21.15.2:0/1423106590 >> 172.21.15.2:0/1423106590 conn(0x7f0e60079650 msgr2=0x7f0e60111df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:51.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.729+0000 7f0e67200700 1 -- 172.21.15.2:0/1423106590 shutdown_connections 2024-06-13T11:25:51.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:51.729+0000 7f0e67200700 1 -- 172.21.15.2:0/1423106590 wait complete. 2024-06-13T11:25:51.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:51 smithi002 ceph-mon[32210]: pgmap v65: 129 pgs: 129 active+clean; 52 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 476 op/s 2024-06-13T11:25:51.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:51 smithi178 ceph-mon[36913]: pgmap v65: 129 pgs: 129 active+clean; 52 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 476 op/s 2024-06-13T11:25:51.965 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: putting auxiliary files in '.'. 2024-06-13T11:25:51.965 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file './config.guess' 2024-06-13T11:25:51.977 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file './config.sub' 2024-06-13T11:25:51.990 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file './install-sh' 2024-06-13T11:25:52.004 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file './ltmain.sh' 2024-06-13T11:25:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:51 smithi077 ceph-mon[36410]: pgmap v65: 129 pgs: 129 active+clean; 52 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 476 op/s 2024-06-13T11:25:52.098 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-06-13T11:25:52.098 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-06-13T11:25:52.128 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-06-13T11:25:52.160 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-06-13T11:25:52.192 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-06-13T11:25:52.223 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-06-13T11:25:52.248 INFO:tasks.workunit.client.0.smithi002.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-06-13T11:25:52.252 INFO:tasks.workunit.client.0.smithi002.stdout:cp include/install-sh . 2024-06-13T11:25:52.262 INFO:tasks.workunit.client.0.smithi002.stdout:aclocal -I m4 2024-06-13T11:25:53.644 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-13T11:25:53.644 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-13T11:25:53.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:53 smithi002 ceph-mon[32210]: pgmap v66: 129 pgs: 129 active+clean; 63 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.8 MiB/s wr, 720 op/s 2024-06-13T11:25:53.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:53 smithi178 ceph-mon[36913]: pgmap v66: 129 pgs: 129 active+clean; 63 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.8 MiB/s wr, 720 op/s 2024-06-13T11:25:54.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:53 smithi077 ceph-mon[36410]: pgmap v66: 129 pgs: 129 active+clean; 63 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.8 MiB/s wr, 720 op/s 2024-06-13T11:25:54.104 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:25:54.150 INFO:tasks.workunit.client.0.smithi002.stdout:autoheader 2024-06-13T11:25:54.615 INFO:tasks.workunit.client.0.smithi002.stdout:autoconf 2024-06-13T11:25:54.891 INFO:tasks.workunit.client.0.smithi002.stdout:./configure \ 2024-06-13T11:25:54.891 INFO:tasks.workunit.client.0.smithi002.stdout: --libexecdir=/usr/lib \ 2024-06-13T11:25:54.891 INFO:tasks.workunit.client.0.smithi002.stdout: --exec_prefix=/var/lib 2024-06-13T11:25:55.289 INFO:tasks.workunit.client.0.smithi002.stdout:checking build system type... x86_64-pc-linux-gnu 2024-06-13T11:25:55.289 INFO:tasks.workunit.client.0.smithi002.stdout:checking host system type... x86_64-pc-linux-gnu 2024-06-13T11:25:55.295 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to print strings... printf 2024-06-13T11:25:55.296 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gcc... gcc 2024-06-13T11:25:55.493 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether the C compiler works... yes 2024-06-13T11:25:55.494 INFO:tasks.workunit.client.0.smithi002.stdout:checking for C compiler default output file name... a.out 2024-06-13T11:25:55.586 INFO:tasks.workunit.client.0.smithi002.stdout:checking for suffix of executables... 2024-06-13T11:25:55.676 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether we are cross compiling... no 2024-06-13T11:25:55.752 INFO:tasks.workunit.client.0.smithi002.stdout:checking for suffix of object files... o 2024-06-13T11:25:55.807 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether we are using the GNU C compiler... yes 2024-06-13T11:25:55.857 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether gcc accepts -g... yes 2024-06-13T11:25:55.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:55 smithi002 ceph-mon[32210]: pgmap v67: 129 pgs: 129 active+clean; 63 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 712 op/s 2024-06-13T11:25:55.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:55 smithi178 ceph-mon[36913]: pgmap v67: 129 pgs: 129 active+clean; 63 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 712 op/s 2024-06-13T11:25:56.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:55 smithi077 ceph-mon[36410]: pgmap v67: 129 pgs: 129 active+clean; 63 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 712 op/s 2024-06-13T11:25:56.043 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gcc option to accept ISO C89... none needed 2024-06-13T11:25:56.055 INFO:tasks.workunit.client.0.smithi002.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-06-13T11:25:56.065 INFO:tasks.workunit.client.0.smithi002.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-06-13T11:25:56.070 INFO:tasks.workunit.client.0.smithi002.stdout:checking for egrep... /usr/bin/grep -E 2024-06-13T11:25:56.074 INFO:tasks.workunit.client.0.smithi002.stdout:checking for fgrep... /usr/bin/grep -F 2024-06-13T11:25:56.087 INFO:tasks.workunit.client.0.smithi002.stdout:checking for ld used by gcc... /usr/bin/ld 2024-06-13T11:25:56.093 INFO:tasks.workunit.client.0.smithi002.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-06-13T11:25:56.141 INFO:tasks.workunit.client.0.smithi002.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-06-13T11:25:56.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.576+0000 7efdeb600700 1 -- 172.21.15.2:0/2311787378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde4074fe0 msgr2=0x7efde410e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:56.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.576+0000 7efdeb600700 1 --2- 172.21.15.2:0/2311787378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde4074fe0 0x7efde410e9b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009990 tx=0x7efdd0009ca0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.577+0000 7efdeb600700 1 -- 172.21.15.2:0/2311787378 shutdown_connections 2024-06-13T11:25:56.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.577+0000 7efdeb600700 1 --2- 172.21.15.2:0/2311787378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde40746c0 0x7efde4074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.577+0000 7efdeb600700 1 --2- 172.21.15.2:0/2311787378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efde410eef0 0x7efde41112e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.577+0000 7efdeb600700 1 --2- 172.21.15.2:0/2311787378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde4074fe0 0x7efde410e9b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.577+0000 7efdeb600700 1 -- 172.21.15.2:0/2311787378 >> 172.21.15.2:0/2311787378 conn(0x7efde40795f0 msgr2=0x7efde4079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.577+0000 7efdeb600700 1 -- 172.21.15.2:0/2311787378 shutdown_connections 2024-06-13T11:25:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.577+0000 7efdeb600700 1 -- 172.21.15.2:0/2311787378 wait complete. 2024-06-13T11:25:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.578+0000 7efdeb600700 1 Processor -- start 2024-06-13T11:25:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.578+0000 7efdeb600700 1 -- start start 2024-06-13T11:25:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.578+0000 7efdeb600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde40746c0 0x7efde419ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.578+0000 7efdeb600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efde4074fe0 0x7efde419b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.578+0000 7efdeb600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde410eef0 0x7efde419f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.578+0000 7efdeb600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efde4114a30 con 0x7efde410eef0 2024-06-13T11:25:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.578+0000 7efdeb600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efde41148b0 con 0x7efde4074fe0 2024-06-13T11:25:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.578+0000 7efdeb600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efde4114bb0 con 0x7efde40746c0 2024-06-13T11:25:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.579+0000 7efde9600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde410eef0 0x7efde419f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.579+0000 7efde8c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde40746c0 0x7efde419ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.579+0000 7efde8c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde40746c0 0x7efde419ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49038/0 (socket says 172.21.15.2:49038) 2024-06-13T11:25:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.579+0000 7efde8c00700 1 -- 172.21.15.2:0/571276261 learned_addr learned my addr 172.21.15.2:0/571276261 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.579+0000 7efde3e00700 1 --2- 172.21.15.2:0/571276261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efde4074fe0 0x7efde419b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.579+0000 7efde8c00700 1 -- 172.21.15.2:0/571276261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efde4074fe0 msgr2=0x7efde419b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.579+0000 7efde8c00700 1 --2- 172.21.15.2:0/571276261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efde4074fe0 0x7efde419b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.579+0000 7efde8c00700 1 -- 172.21.15.2:0/571276261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde410eef0 msgr2=0x7efde419f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.579+0000 7efde8c00700 1 --2- 172.21.15.2:0/571276261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde410eef0 0x7efde419f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.579+0000 7efde8c00700 1 -- 172.21.15.2:0/571276261 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde419fe70 con 0x7efde40746c0 2024-06-13T11:25:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.579+0000 7efde8c00700 1 --2- 172.21.15.2:0/571276261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde40746c0 0x7efde419ae60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efdd800e9a0 tx=0x7efdd800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.580+0000 7efde1600700 1 -- 172.21.15.2:0/571276261 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd800ca10 con 0x7efde40746c0 2024-06-13T11:25:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.580+0000 7efde1600700 1 -- 172.21.15.2:0/571276261 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdd800cbb0 con 0x7efde40746c0 2024-06-13T11:25:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.580+0000 7efde1600700 1 -- 172.21.15.2:0/571276261 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd8018680 con 0x7efde40746c0 2024-06-13T11:25:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.580+0000 7efdeb600700 1 -- 172.21.15.2:0/571276261 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde41a0160 con 0x7efde40746c0 2024-06-13T11:25:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.580+0000 7efdeb600700 1 -- 172.21.15.2:0/571276261 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde41a79e0 con 0x7efde40746c0 2024-06-13T11:25:56.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.583+0000 7efde1600700 1 -- 172.21.15.2:0/571276261 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7efdd8010430 con 0x7efde40746c0 2024-06-13T11:25:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.585+0000 7efde1600700 1 --2- 172.21.15.2:0/571276261 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7efdcc0a2e10 0x7efdcc0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.586+0000 7efde1600700 1 -- 172.21.15.2:0/571276261 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7efdd80cf9a0 con 0x7efde40746c0 2024-06-13T11:25:56.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.586+0000 7efdf5eb5b80 1 Processor -- start 2024-06-13T11:25:56.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.586+0000 7efde3e00700 1 --2- 172.21.15.2:0/571276261 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7efdcc0a2e10 0x7efdcc0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.586+0000 7efdf5eb5b80 1 -- start start 2024-06-13T11:25:56.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.586+0000 7efdf5eb5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951aec10 0x55ac951aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.586+0000 7efdf5eb5b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951af530 0x55ac951a8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.586+0000 7efdf5eb5b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951a92c0 0x55ac951a9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.586+0000 7efdf5eb5b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ac950b7a90 con 0x55ac951a92c0 2024-06-13T11:25:56.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.586+0000 7efdf5eb5b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ac950fab80 con 0x55ac951af530 2024-06-13T11:25:56.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.586+0000 7efdf5eb5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55ac950b5970 con 0x55ac951aec10 2024-06-13T11:25:56.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.587+0000 7efde3e00700 1 --2- 172.21.15.2:0/571276261 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7efdcc0a2e10 0x7efdcc0a52d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efde41016d0 tx=0x7efdd0005fd0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:56.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.587+0000 7efde8c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951aec10 0x55ac951aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.587+0000 7efde3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951af530 0x55ac951a8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.587+0000 7efde8c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951aec10 0x55ac951aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49046/0 (socket says 172.21.15.2:49046) 2024-06-13T11:25:56.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.587+0000 7efde3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951af530 0x55ac951a8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:39094/0 (socket says 172.21.15.2:39094) 2024-06-13T11:25:56.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.587+0000 7efde8c00700 1 -- 172.21.15.2:0/901619046 learned_addr learned my addr 172.21.15.2:0/901619046 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:56.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.587+0000 7efde9600700 1 --2- 172.21.15.2:0/901619046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951a92c0 0x55ac951a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.587+0000 7efde8c00700 1 -- 172.21.15.2:0/901619046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951af530 msgr2=0x55ac951a8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:56.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.587+0000 7efde8c00700 1 --2- 172.21.15.2:0/901619046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951af530 0x55ac951a8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.587+0000 7efde8c00700 1 -- 172.21.15.2:0/901619046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951a92c0 msgr2=0x55ac951a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:56.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.587+0000 7efde8c00700 1 --2- 172.21.15.2:0/901619046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951a92c0 0x55ac951a9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.587+0000 7efde8c00700 1 -- 172.21.15.2:0/901619046 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac950a3010 con 0x55ac951aec10 2024-06-13T11:25:56.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.587+0000 7efde8c00700 1 --2- 172.21.15.2:0/901619046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951aec10 0x55ac951aeff0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efdd8097f50 tx=0x7efdd809c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d014f262de30b0a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:56.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.588+0000 7efdd6000700 1 -- 172.21.15.2:0/901619046 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd80a4760 con 0x55ac951aec10 2024-06-13T11:25:56.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.588+0000 7efdd6000700 1 -- 172.21.15.2:0/901619046 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdd8099df0 con 0x55ac951aec10 2024-06-13T11:25:56.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.588+0000 7efdd6000700 1 -- 172.21.15.2:0/901619046 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd8010980 con 0x55ac951aec10 2024-06-13T11:25:56.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.588+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/901619046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951aec10 msgr2=0x55ac951aeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:56.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.588+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/901619046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951aec10 0x55ac951aeff0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efdd8097f50 tx=0x7efdd809c270 comp rx=0 tx=0).stop 2024-06-13T11:25:56.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.589+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/901619046 shutdown_connections 2024-06-13T11:25:56.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.589+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/901619046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951a92c0 0x55ac951a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.589+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/901619046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951aec10 0x55ac951aeff0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.589+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/901619046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951af530 0x55ac951a8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.589+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/901619046 >> 172.21.15.2:0/901619046 conn(0x55ac950d51f0 msgr2=0x55ac951a4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.589+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/901619046 shutdown_connections 2024-06-13T11:25:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.589+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/901619046 wait complete. 2024-06-13T11:25:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.589+0000 7efdf5eb5b80 1 -- start start 2024-06-13T11:25:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.590+0000 7efdf5eb5b80 1 Processor -- start 2024-06-13T11:25:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.590+0000 7efdf5eb5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951a92c0 0x55ac951b5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.590+0000 7efdf5eb5b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951aec10 0x55ac951b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.590+0000 7efdf5eb5b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951af530 0x55ac951b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.590+0000 7efdf5eb5b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ac95096fe0 con 0x55ac951af530 2024-06-13T11:25:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.590+0000 7efdf5eb5b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ac950f6b40 con 0x55ac951aec10 2024-06-13T11:25:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.590+0000 7efdf5eb5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55ac951b5eb0 con 0x55ac951a92c0 2024-06-13T11:25:56.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.590+0000 7efdf5eb5b80 10 client.0 _ll_register_callbacks cb 0x55ac95090400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.591+0000 7efde8c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951a92c0 0x55ac951b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.591+0000 7efde3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951aec10 0x55ac951b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.591+0000 7efde9600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951af530 0x55ac951b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.591+0000 7efde8c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951a92c0 0x55ac951b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49048/0 (socket says 172.21.15.2:49048) 2024-06-13T11:25:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.591+0000 7efde8c00700 1 -- 172.21.15.2:0/512814467 learned_addr learned my addr 172.21.15.2:0/512814467 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.591+0000 7efde3e00700 1 -- 172.21.15.2:0/512814467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951a92c0 msgr2=0x55ac951b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.591+0000 7efde3e00700 1 --2- 172.21.15.2:0/512814467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951a92c0 0x55ac951b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.591+0000 7efde3e00700 1 -- 172.21.15.2:0/512814467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951af530 msgr2=0x55ac951b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.591+0000 7efde3e00700 1 --2- 172.21.15.2:0/512814467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951af530 0x55ac951b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.591+0000 7efde3e00700 1 -- 172.21.15.2:0/512814467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac95049950 con 0x55ac951aec10 2024-06-13T11:25:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.592+0000 7efde3e00700 1 --2- 172.21.15.2:0/512814467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951aec10 0x55ac951b2670 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efdd000b2e0 tx=0x7efdd0009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd4a4c997cb02459 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.592+0000 7efdcaa00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:25:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.592+0000 7efdcaa00700 1 -- 172.21.15.2:0/512814467 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0033060 con 0x55ac951aec10 2024-06-13T11:25:56.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.592+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/512814467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdd8099df0 con 0x55ac951aec10 2024-06-13T11:25:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.592+0000 7efdcaa00700 1 -- 172.21.15.2:0/512814467 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7efdd0003c70 con 0x55ac951aec10 2024-06-13T11:25:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.595+0000 7efdcaa00700 1 -- 172.21.15.2:0/512814467 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efdd003a050 con 0x55ac951aec10 2024-06-13T11:25:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.595+0000 7efdf5eb5b80 10 client.25577 fetch_fsmap learned FSMap version 29 2024-06-13T11:25:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.595+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/512814467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ac951c0730 con 0x55ac951aec10 2024-06-13T11:25:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.596+0000 7efdcaa00700 1 -- 172.21.15.2:0/512814467 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdd8099df0 con 0x55ac951aec10 2024-06-13T11:25:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.596+0000 7efdcaa00700 1 -- 172.21.15.2:0/512814467 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7efdd002e4b0 con 0x55ac951aec10 2024-06-13T11:25:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.596+0000 7efdf5eb5b80 10 client.25577 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:25:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.596+0000 7efdf5eb5b80 10 client.25577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:25:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.596+0000 7efdf5eb5b80 20 client.25577 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.596+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/512814467 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ac951c2d10 0x55ac951c5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.596+0000 7efdf5eb5b80 4 client.25577 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:25:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.596+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/512814467 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac95108080 con 0x55ac951c2d10 2024-06-13T11:25:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.597+0000 7efde8c00700 1 --2- 172.21.15.2:0/512814467 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ac951c2d10 0x55ac951c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.597+0000 7efde8c00700 1 --2- 172.21.15.2:0/512814467 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ac951c2d10 0x55ac951c5130 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e73f744e50df47e2 server_cookie=9d3c00ffa7ddb6d4 in_seq=0 out_seq=0 2024-06-13T11:25:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.597+0000 7efdcaa00700 10 client.25577 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.598+0000 7efdcaa00700 1 -- 172.21.15.2:0/512814467 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ac95108080 con 0x55ac951c2d10 2024-06-13T11:25:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.598+0000 7efdcaa00700 10 client.25577 handle_command_reply: tid=0 2024-06-13T11:25:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.598+0000 7efdf5eb5b80 1 client.25577 shutdown 2024-06-13T11:25:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.598+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/512814467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951aec10 msgr2=0x55ac951b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.598+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/512814467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951aec10 0x55ac951b2670 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efdd000b2e0 tx=0x7efdd0009310 comp rx=0 tx=0).stop 2024-06-13T11:25:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.598+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/512814467 shutdown_connections 2024-06-13T11:25:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.598+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/512814467 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ac951c2d10 0x55ac951c5130 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.598+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/512814467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951af530 0x55ac951b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.598+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/512814467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951a92c0 0x55ac951b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.598+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/512814467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951aec10 0x55ac951b2670 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.598+0000 7efdcaa00700 0 client.25577 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.598+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/512814467 >> 172.21.15.2:0/512814467 conn(0x55ac950d51f0 msgr2=0x55ac9519d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.598+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/512814467 shutdown_connections 2024-06-13T11:25:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.598+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/512814467 wait complete. 2024-06-13T11:25:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.599+0000 7efdf5eb5b80 20 client.25577 trim_cache size 0 max 16384 2024-06-13T11:25:56.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.622+0000 7efdf5eb5b80 1 Processor -- start 2024-06-13T11:25:56.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.622+0000 7efdf5eb5b80 1 -- start start 2024-06-13T11:25:56.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.622+0000 7efdf5eb5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951a92c0 0x55ac951a8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.622+0000 7efdf5eb5b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951aec10 0x55ac951b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.622+0000 7efdf5eb5b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951af530 0x55ac9519e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.622+0000 7efdf5eb5b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efde41b3070 con 0x55ac951af530 2024-06-13T11:25:56.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.622+0000 7efdf5eb5b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efde41b0900 con 0x55ac951aec10 2024-06-13T11:25:56.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.622+0000 7efdf5eb5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efde41ae750 con 0x55ac951a92c0 2024-06-13T11:25:56.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.623+0000 7efde9600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951af530 0x55ac9519e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.623+0000 7efde3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951aec10 0x55ac951b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.623+0000 7efde3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951aec10 0x55ac951b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:39106/0 (socket says 172.21.15.2:39106) 2024-06-13T11:25:56.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.623+0000 7efde8c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951a92c0 0x55ac951a8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.623+0000 7efde3e00700 1 -- 172.21.15.2:0/2688973141 learned_addr learned my addr 172.21.15.2:0/2688973141 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:56.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.623+0000 7efde3e00700 1 -- 172.21.15.2:0/2688973141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951a92c0 msgr2=0x55ac951a8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:56.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.623+0000 7efde3e00700 1 --2- 172.21.15.2:0/2688973141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951a92c0 0x55ac951a8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.623+0000 7efde3e00700 1 -- 172.21.15.2:0/2688973141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951af530 msgr2=0x55ac9519e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:56.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.623+0000 7efde3e00700 1 --2- 172.21.15.2:0/2688973141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951af530 0x55ac9519e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.623+0000 7efde3e00700 1 -- 172.21.15.2:0/2688973141 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac951b2440 con 0x55ac951aec10 2024-06-13T11:25:56.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.623+0000 7efde3e00700 1 --2- 172.21.15.2:0/2688973141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951aec10 0x55ac951b15d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efdd0005040 tx=0x7efdd00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb6bfb6b8ee210b9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:56.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.624+0000 7efdd5600700 1 -- 172.21.15.2:0/2688973141 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0033050 con 0x55ac951aec10 2024-06-13T11:25:56.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.624+0000 7efdd5600700 1 -- 172.21.15.2:0/2688973141 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdd0003c70 con 0x55ac951aec10 2024-06-13T11:25:56.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.624+0000 7efdd5600700 1 -- 172.21.15.2:0/2688973141 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd000fba0 con 0x55ac951aec10 2024-06-13T11:25:56.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.624+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/2688973141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951aec10 msgr2=0x55ac951b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:56.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.624+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/2688973141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951aec10 0x55ac951b15d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efdd0005040 tx=0x7efdd00057f0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.624+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/2688973141 shutdown_connections 2024-06-13T11:25:56.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.624+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/2688973141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951af530 0x55ac9519e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.624+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/2688973141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951a92c0 0x55ac951a8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.624+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/2688973141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951aec10 0x55ac951b15d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.624+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/2688973141 >> 172.21.15.2:0/2688973141 conn(0x55ac950d51f0 msgr2=0x55ac951ad7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:56.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.625+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/2688973141 shutdown_connections 2024-06-13T11:25:56.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.625+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/2688973141 wait complete. 2024-06-13T11:25:56.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.625+0000 7efdf5eb5b80 1 -- start start 2024-06-13T11:25:56.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.625+0000 7efdf5eb5b80 1 Processor -- start 2024-06-13T11:25:56.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.626+0000 7efdf5eb5b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951a92c0 0x55ac951ca810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.626+0000 7efdf5eb5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951aec10 0x55ac951cad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.626+0000 7efdf5eb5b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951af530 0x55ac951cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.626+0000 7efdf5eb5b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efde41aedc0 con 0x55ac951af530 2024-06-13T11:25:56.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.626+0000 7efdf5eb5b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efde41b0230 con 0x55ac951a92c0 2024-06-13T11:25:56.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.626+0000 7efdf5eb5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efde41af490 con 0x55ac951aec10 2024-06-13T11:25:56.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.626+0000 7efdf5eb5b80 10 client.0 _ll_register_callbacks cb 0x55ac95090400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:25:56.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.626+0000 7efde3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951aec10 0x55ac951cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.626+0000 7efde3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951aec10 0x55ac951cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49076/0 (socket says 172.21.15.2:49076) 2024-06-13T11:25:56.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.626+0000 7efde3e00700 1 -- 172.21.15.2:0/2196966598 learned_addr learned my addr 172.21.15.2:0/2196966598 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:25:56.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.626+0000 7efde9600700 1 --2- 172.21.15.2:0/2196966598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951af530 0x55ac951cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.626+0000 7efde8c00700 1 --2- 172.21.15.2:0/2196966598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951a92c0 0x55ac951ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.626+0000 7efde3e00700 1 -- 172.21.15.2:0/2196966598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951a92c0 msgr2=0x55ac951ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:56.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.626+0000 7efde3e00700 1 --2- 172.21.15.2:0/2196966598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951a92c0 0x55ac951ca810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.626+0000 7efde3e00700 1 -- 172.21.15.2:0/2196966598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951af530 msgr2=0x55ac951cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:25:56.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.627+0000 7efde3e00700 1 --2- 172.21.15.2:0/2196966598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951af530 0x55ac951cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.627+0000 7efde3e00700 1 -- 172.21.15.2:0/2196966598 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac9522cbc0 con 0x55ac951aec10 2024-06-13T11:25:56.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.627+0000 7efde8c00700 1 --2- 172.21.15.2:0/2196966598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951a92c0 0x55ac951ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:25:56.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.627+0000 7efde9600700 1 --2- 172.21.15.2:0/2196966598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951af530 0x55ac951cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:25:56.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.627+0000 7efde3e00700 1 --2- 172.21.15.2:0/2196966598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951aec10 0x55ac951cad50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efdd00098e0 tx=0x7efdd000b410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffa7c09ebe12e356 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:25:56.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.627+0000 7efdcaa00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:25:56.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.627+0000 7efdcaa00700 1 -- 172.21.15.2:0/2196966598 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0033040 con 0x55ac951aec10 2024-06-13T11:25:56.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.627+0000 7efdcaa00700 1 -- 172.21.15.2:0/2196966598 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7efdd003f480 con 0x55ac951aec10 2024-06-13T11:25:56.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.627+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/2196966598 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdd0003c70 con 0x55ac951aec10 2024-06-13T11:25:56.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.627+0000 7efdcaa00700 1 -- 172.21.15.2:0/2196966598 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efdd004e050 con 0x55ac951aec10 2024-06-13T11:25:56.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.627+0000 7efdf5eb5b80 10 client.25618 fetch_fsmap learned FSMap version 29 2024-06-13T11:25:56.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.627+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/2196966598 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ac9522df00 con 0x55ac951aec10 2024-06-13T11:25:56.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.628+0000 7efdcaa00700 1 -- 172.21.15.2:0/2196966598 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdd0003c70 con 0x55ac951aec10 2024-06-13T11:25:56.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.628+0000 7efdcaa00700 1 -- 172.21.15.2:0/2196966598 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7efdd000f920 con 0x55ac951aec10 2024-06-13T11:25:56.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.628+0000 7efdf5eb5b80 10 client.25618 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:25:56.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.628+0000 7efdf5eb5b80 10 client.25618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:25:56.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.628+0000 7efdf5eb5b80 20 client.25618 populate_metadata read hostname 'smithi002' 2024-06-13T11:25:56.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.628+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/2196966598 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ac9522e660 0x55ac95230a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:25:56.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.628+0000 7efdf5eb5b80 4 client.25618 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-13T11:25:56.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.628+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/2196966598 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ac951ad170 con 0x55ac9522e660 2024-06-13T11:25:56.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.628+0000 7efde8c00700 1 --2- 172.21.15.2:0/2196966598 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ac9522e660 0x55ac95230a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:25:56.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.629+0000 7efde8c00700 1 --2- 172.21.15.2:0/2196966598 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ac9522e660 0x55ac95230a80 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64ba46126fb5686a server_cookie=18da56d6e98d7a4b in_seq=0 out_seq=0 2024-06-13T11:25:56.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.629+0000 7efdcaa00700 10 client.25618 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:56.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.630+0000 7efdcaa00700 1 -- 172.21.15.2:0/2196966598 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ac951ad170 con 0x55ac9522e660 2024-06-13T11:25:56.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.630+0000 7efdcaa00700 10 client.25618 handle_command_reply: tid=0 2024-06-13T11:25:56.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.630+0000 7efdf5eb5b80 1 client.25618 shutdown 2024-06-13T11:25:56.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.630+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/2196966598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951aec10 msgr2=0x55ac951cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:56.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.630+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/2196966598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951aec10 0x55ac951cad50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efdd00098e0 tx=0x7efdd000b410 comp rx=0 tx=0).stop 2024-06-13T11:25:56.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.630+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/2196966598 shutdown_connections 2024-06-13T11:25:56.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.630+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/2196966598 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ac9522e660 0x55ac95230a80 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.630+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/2196966598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ac951af530 0x55ac951cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.630+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/2196966598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ac951a92c0 0x55ac951ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.630+0000 7efdf5eb5b80 1 --2- 172.21.15.2:0/2196966598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ac951aec10 0x55ac951cad50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.630+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/2196966598 >> 172.21.15.2:0/2196966598 conn(0x55ac950d51f0 msgr2=0x55ac951ad7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:56.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.630+0000 7efdcaa00700 0 client.25618 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:25:56.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.630+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/2196966598 shutdown_connections 2024-06-13T11:25:56.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.631+0000 7efdf5eb5b80 1 -- 172.21.15.2:0/2196966598 wait complete. 2024-06-13T11:25:56.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.631+0000 7efdf5eb5b80 20 client.25618 trim_cache size 0 max 16384 2024-06-13T11:25:56.632 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:25:56.633 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-06-13T11:25:56.633 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "a921dac3-49fa-4ef9-94c3-4b2e24b45491", 2024-06-13T11:25:56.633 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-06-13T11:25:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:25:56.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.631+0000 7efdeb600700 1 -- 172.21.15.2:0/571276261 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7efdcc0a2e10 msgr2=0x7efdcc0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:56.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.631+0000 7efdeb600700 1 --2- 172.21.15.2:0/571276261 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7efdcc0a2e10 0x7efdcc0a52d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efde41016d0 tx=0x7efdd0005fd0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.631+0000 7efdeb600700 1 -- 172.21.15.2:0/571276261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde40746c0 msgr2=0x7efde419ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:25:56.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.631+0000 7efdeb600700 1 --2- 172.21.15.2:0/571276261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde40746c0 0x7efde419ae60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efdd800e9a0 tx=0x7efdd800ecb0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.631+0000 7efdeb600700 1 -- 172.21.15.2:0/571276261 shutdown_connections 2024-06-13T11:25:56.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.631+0000 7efdeb600700 1 --2- 172.21.15.2:0/571276261 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7efdcc0a2e10 0x7efdcc0a52d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.632+0000 7efdeb600700 1 --2- 172.21.15.2:0/571276261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde410eef0 0x7efde419f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.632+0000 7efdeb600700 1 --2- 172.21.15.2:0/571276261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde40746c0 0x7efde419ae60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.632+0000 7efdeb600700 1 --2- 172.21.15.2:0/571276261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efde4074fe0 0x7efde419b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:25:56.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.632+0000 7efdeb600700 1 -- 172.21.15.2:0/571276261 >> 172.21.15.2:0/571276261 conn(0x7efde40795f0 msgr2=0x7efde4100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:25:56.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.632+0000 7efdeb600700 1 -- 172.21.15.2:0/571276261 shutdown_connections 2024-06-13T11:25:56.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:25:56.632+0000 7efdeb600700 1 -- 172.21.15.2:0/571276261 wait complete. 2024-06-13T11:25:57.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:25:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: pgmap v68: 129 pgs: 129 active+clean; 63 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 712 op/s 2024-06-13T11:25:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: scrub queued for path: / 2024-06-13T11:25:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:25:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:25:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:25:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:25:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:25:57.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:57.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:25:57.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:57.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:25:57.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:57.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:57.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:57 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:57.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: pgmap v68: 129 pgs: 129 active+clean; 63 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 712 op/s 2024-06-13T11:25:57.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: scrub queued for path: / 2024-06-13T11:25:57.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:57.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:25:57.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:25:57.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:25:57.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:57.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:57.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:25:57.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:25:57.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:57.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:25:57.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:57.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:25:57.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:57.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:57.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:57 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:58.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: pgmap v68: 129 pgs: 129 active+clean; 63 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 712 op/s 2024-06-13T11:25:58.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: scrub queued for path: / 2024-06-13T11:25:58.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:58.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:25:58.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:25:58.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:25:58.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:58.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:58.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:25:58.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:25:58.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:58.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:25:58.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:58.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:25:58.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:58.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:58.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:57 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:25:58.079 INFO:tasks.workunit.client.0.smithi002.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-06-13T11:25:58.079 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether ln -s works... yes 2024-06-13T11:25:58.096 INFO:tasks.workunit.client.0.smithi002.stdout:checking the maximum length of command line arguments... 1572864 2024-06-13T11:25:58.108 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-06-13T11:25:58.108 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-06-13T11:25:58.108 INFO:tasks.workunit.client.0.smithi002.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-06-13T11:25:58.108 INFO:tasks.workunit.client.0.smithi002.stdout:checking for objdump... objdump 2024-06-13T11:25:58.108 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to recognize dependent libraries... pass_all 2024-06-13T11:25:58.109 INFO:tasks.workunit.client.0.smithi002.stdout:checking for dlltool... no 2024-06-13T11:25:58.109 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-06-13T11:25:58.110 INFO:tasks.workunit.client.0.smithi002.stdout:checking for ar... ar 2024-06-13T11:25:58.237 INFO:tasks.workunit.client.0.smithi002.stdout:checking for archiver @FILE support... @ 2024-06-13T11:25:58.237 INFO:tasks.workunit.client.0.smithi002.stdout:checking for strip... strip 2024-06-13T11:25:58.237 INFO:tasks.workunit.client.0.smithi002.stdout:checking for ranlib... ranlib 2024-06-13T11:25:58.238 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gawk... gawk 2024-06-13T11:25:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:25:58.429 INFO:tasks.workunit.client.0.smithi002.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-06-13T11:25:58.434 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sysroot... no 2024-06-13T11:25:58.456 INFO:tasks.workunit.client.0.smithi002.stdout:checking for a working dd... /usr/bin/dd 2024-06-13T11:25:58.476 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-06-13T11:25:58.547 INFO:tasks.workunit.client.0.smithi002.stdout:checking for mt... no 2024-06-13T11:25:58.571 INFO:tasks.workunit.client.0.smithi002.stdout:checking if : is a manifest tool... no 2024-06-13T11:25:58.730 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to run the C preprocessor... gcc -E 2024-06-13T11:25:59.149 INFO:tasks.workunit.client.0.smithi002.stdout:checking for ANSI C header files... yes 2024-06-13T11:25:59.239 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/types.h... yes 2024-06-13T11:25:59.336 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/stat.h... yes 2024-06-13T11:25:59.439 INFO:tasks.workunit.client.0.smithi002.stdout:checking for stdlib.h... yes 2024-06-13T11:25:59.540 INFO:tasks.workunit.client.0.smithi002.stdout:checking for string.h... yes 2024-06-13T11:25:59.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:25:59 smithi002 ceph-mon[32210]: pgmap v69: 129 pgs: 129 active+clean; 65 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 739 op/s 2024-06-13T11:25:59.772 INFO:tasks.workunit.client.0.smithi002.stdout:checking for memory.h... yes 2024-06-13T11:25:59.876 INFO:tasks.workunit.client.0.smithi002.stdout:checking for strings.h... yes 2024-06-13T11:25:59.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:25:59 smithi178 ceph-mon[36913]: pgmap v69: 129 pgs: 129 active+clean; 65 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 739 op/s 2024-06-13T11:25:59.978 INFO:tasks.workunit.client.0.smithi002.stdout:checking for inttypes.h... yes 2024-06-13T11:26:00.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:25:59 smithi077 ceph-mon[36410]: pgmap v69: 129 pgs: 129 active+clean; 65 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 739 op/s 2024-06-13T11:26:00.071 INFO:tasks.workunit.client.0.smithi002.stdout:checking for stdint.h... yes 2024-06-13T11:26:00.162 INFO:tasks.workunit.client.0.smithi002.stdout:checking for unistd.h... yes 2024-06-13T11:26:00.262 INFO:tasks.workunit.client.0.smithi002.stdout:checking for dlfcn.h... yes 2024-06-13T11:26:00.338 INFO:tasks.workunit.client.0.smithi002.stdout:checking for objdir... .libs 2024-06-13T11:26:00.612 INFO:tasks.workunit.client.0.smithi002.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-06-13T11:26:00.612 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-06-13T11:26:00.702 INFO:tasks.workunit.client.0.smithi002.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-06-13T11:26:00.815 INFO:tasks.workunit.client.0.smithi002.stdout:checking if gcc static flag -static works... no 2024-06-13T11:26:00.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.823+0000 7f162d400700 1 -- 172.21.15.2:0/3477554017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16280746c0 msgr2=0x7f1628074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.823+0000 7f162d400700 1 --2- 172.21.15.2:0/3477554017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16280746c0 0x7f1628074aa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1618009990 tx=0x7f1618009ca0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.823+0000 7f162d400700 1 -- 172.21.15.2:0/3477554017 shutdown_connections 2024-06-13T11:26:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.823+0000 7f162d400700 1 --2- 172.21.15.2:0/3477554017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1628113660 0x7f1628115a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.823+0000 7f162d400700 1 --2- 172.21.15.2:0/3477554017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16280746c0 0x7f1628074aa0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.823+0000 7f162d400700 1 --2- 172.21.15.2:0/3477554017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1628074fe0 0x7f1628113120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.823+0000 7f162d400700 1 -- 172.21.15.2:0/3477554017 >> 172.21.15.2:0/3477554017 conn(0x7f16280795f0 msgr2=0x7f1628079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.823+0000 7f162d400700 1 -- 172.21.15.2:0/3477554017 shutdown_connections 2024-06-13T11:26:00.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.823+0000 7f162d400700 1 -- 172.21.15.2:0/3477554017 wait complete. 2024-06-13T11:26:00.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.824+0000 7f162d400700 1 Processor -- start 2024-06-13T11:26:00.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.825+0000 7f162d400700 1 -- start start 2024-06-13T11:26:00.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.825+0000 7f162d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16280746c0 0x7f162819f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.825+0000 7f162d400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1628074fe0 0x7f162819f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.825+0000 7f162d400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1628113660 0x7f16281a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.825+0000 7f162d400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1628118de0 con 0x7f16280746c0 2024-06-13T11:26:00.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.825+0000 7f162d400700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1628118c60 con 0x7f1628074fe0 2024-06-13T11:26:00.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.825+0000 7f162d400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1628118f60 con 0x7f1628113660 2024-06-13T11:26:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.825+0000 7f1626800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16280746c0 0x7f162819f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.825+0000 7f1627200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1628113660 0x7f16281a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.825+0000 7f1626800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16280746c0 0x7f162819f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38136/0 (socket says 172.21.15.2:38136) 2024-06-13T11:26:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.825+0000 7f1626800700 1 -- 172.21.15.2:0/3051734221 learned_addr learned my addr 172.21.15.2:0/3051734221 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.826+0000 7f161fe00700 1 --2- 172.21.15.2:0/3051734221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1628074fe0 0x7f162819f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.826+0000 7f1627200700 1 -- 172.21.15.2:0/3051734221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1628074fe0 msgr2=0x7f162819f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.826+0000 7f1627200700 1 --2- 172.21.15.2:0/3051734221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1628074fe0 0x7f162819f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.826+0000 7f1627200700 1 -- 172.21.15.2:0/3051734221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16280746c0 msgr2=0x7f162819f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.826+0000 7f1627200700 1 --2- 172.21.15.2:0/3051734221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16280746c0 0x7f162819f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.826+0000 7f1627200700 1 -- 172.21.15.2:0/3051734221 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16281a42c0 con 0x7f1628113660 2024-06-13T11:26:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.826+0000 7f1627200700 1 --2- 172.21.15.2:0/3051734221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1628113660 0x7f16281a3b80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1620007ee0 tx=0x7f162000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.827+0000 7f161f400700 1 -- 172.21.15.2:0/3051734221 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620004db0 con 0x7f1628113660 2024-06-13T11:26:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.827+0000 7f161f400700 1 -- 172.21.15.2:0/3051734221 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1620009e20 con 0x7f1628113660 2024-06-13T11:26:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.827+0000 7f161f400700 1 -- 172.21.15.2:0/3051734221 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620015400 con 0x7f1628113660 2024-06-13T11:26:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.827+0000 7f162d400700 1 -- 172.21.15.2:0/3051734221 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16281a45b0 con 0x7f1628113660 2024-06-13T11:26:00.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.827+0000 7f162d400700 1 -- 172.21.15.2:0/3051734221 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16281abe30 con 0x7f1628113660 2024-06-13T11:26:00.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.830+0000 7f161f400700 1 -- 172.21.15.2:0/3051734221 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f162000db20 con 0x7f1628113660 2024-06-13T11:26:00.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.831+0000 7f161f400700 1 --2- 172.21.15.2:0/3051734221 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f160c0a2e10 0x7f160c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.832+0000 7f1637e27b80 1 Processor -- start 2024-06-13T11:26:00.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.832+0000 7f161f400700 1 -- 172.21.15.2:0/3051734221 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f16200cf0a0 con 0x7f1628113660 2024-06-13T11:26:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.832+0000 7f1637e27b80 1 -- start start 2024-06-13T11:26:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.832+0000 7f1626800700 1 --2- 172.21.15.2:0/3051734221 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f160c0a2e10 0x7f160c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.832+0000 7f1637e27b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca34070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.832+0000 7f1637e27b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca345b0 0x55ba8ca34a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.832+0000 7f1637e27b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca3f300 0x55ba8ca416f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.832+0000 7f1637e27b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ba8c943a10 con 0x55ba8c9b0e40 2024-06-13T11:26:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.832+0000 7f1637e27b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ba8c986b00 con 0x55ba8ca3f300 2024-06-13T11:26:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.832+0000 7f1637e27b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55ba8c9418f0 con 0x55ba8ca345b0 2024-06-13T11:26:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.833+0000 7f1626800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca34070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.833+0000 7f1627200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca3f300 0x55ba8ca416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.833+0000 7f161fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca345b0 0x55ba8ca34a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.833+0000 7f1627200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca3f300 0x55ba8ca416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:39150/0 (socket says 172.21.15.2:39150) 2024-06-13T11:26:00.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.833+0000 7f1627200700 1 -- 172.21.15.2:0/4164804302 learned_addr learned my addr 172.21.15.2:0/4164804302 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:00.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.833+0000 7f1626800700 1 --2- 172.21.15.2:0/3051734221 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f160c0a2e10 0x7f160c0a52d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1618006010 tx=0x7f161800b610 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:00.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.833+0000 7f1627200700 1 -- 172.21.15.2:0/4164804302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca345b0 msgr2=0x55ba8ca34a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:00.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.833+0000 7f1627200700 1 --2- 172.21.15.2:0/4164804302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca345b0 0x55ba8ca34a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.833+0000 7f1627200700 1 -- 172.21.15.2:0/4164804302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8c9b0e40 msgr2=0x55ba8ca34070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:00.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.833+0000 7f1627200700 1 --2- 172.21.15.2:0/4164804302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca34070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.833+0000 7f1627200700 1 -- 172.21.15.2:0/4164804302 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba8c92ef90 con 0x55ba8ca3f300 2024-06-13T11:26:00.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.834+0000 7f1627200700 1 --2- 172.21.15.2:0/4164804302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca3f300 0x55ba8ca416f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f16200a3930 tx=0x7f162009ac40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee93a62284e6b0e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:00.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.834+0000 7f1617e00700 1 -- 172.21.15.2:0/4164804302 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162009b1f0 con 0x55ba8ca3f300 2024-06-13T11:26:00.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.834+0000 7f1617e00700 1 -- 172.21.15.2:0/4164804302 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f162009f5a0 con 0x55ba8ca3f300 2024-06-13T11:26:00.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.834+0000 7f1617e00700 1 -- 172.21.15.2:0/4164804302 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162009b450 con 0x55ba8ca3f300 2024-06-13T11:26:00.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.835+0000 7f1637e27b80 1 -- 172.21.15.2:0/4164804302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca3f300 msgr2=0x55ba8ca416f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:00.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.835+0000 7f1637e27b80 1 --2- 172.21.15.2:0/4164804302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca3f300 0x55ba8ca416f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f16200a3930 tx=0x7f162009ac40 comp rx=0 tx=0).stop 2024-06-13T11:26:00.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.835+0000 7f1637e27b80 1 -- 172.21.15.2:0/4164804302 shutdown_connections 2024-06-13T11:26:00.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.835+0000 7f1637e27b80 1 --2- 172.21.15.2:0/4164804302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca34070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.835+0000 7f1637e27b80 1 --2- 172.21.15.2:0/4164804302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca3f300 0x55ba8ca416f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.835+0000 7f1637e27b80 1 --2- 172.21.15.2:0/4164804302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca345b0 0x55ba8ca34a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.835+0000 7f1637e27b80 1 -- 172.21.15.2:0/4164804302 >> 172.21.15.2:0/4164804302 conn(0x55ba8c961170 msgr2=0x55ba8ca304b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:00.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.835+0000 7f1637e27b80 1 -- 172.21.15.2:0/4164804302 shutdown_connections 2024-06-13T11:26:00.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.835+0000 7f1637e27b80 1 -- 172.21.15.2:0/4164804302 wait complete. 2024-06-13T11:26:00.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.836+0000 7f1637e27b80 1 -- start start 2024-06-13T11:26:00.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.836+0000 7f1637e27b80 1 Processor -- start 2024-06-13T11:26:00.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.836+0000 7f1637e27b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca3eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.836+0000 7f1637e27b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8ca345b0 0x55ba8ca3bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.837+0000 7f1637e27b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca3f300 0x55ba8ca3c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.837+0000 7f1637e27b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ba8c922f60 con 0x55ba8ca345b0 2024-06-13T11:26:00.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.837+0000 7f1637e27b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ba8c982ac0 con 0x55ba8c9b0e40 2024-06-13T11:26:00.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.837+0000 7f1637e27b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55ba8ca52f70 con 0x55ba8ca3f300 2024-06-13T11:26:00.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.837+0000 7f1637e27b80 10 client.0 _ll_register_callbacks cb 0x55ba8c920720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:26:00.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.837+0000 7f1626800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca3eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.837+0000 7f1627200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca3f300 0x55ba8ca3c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.837+0000 7f1626800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca3eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:39164/0 (socket says 172.21.15.2:39164) 2024-06-13T11:26:00.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.837+0000 7f1626800700 1 -- 172.21.15.2:0/863901136 learned_addr learned my addr 172.21.15.2:0/863901136 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:00.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.837+0000 7f161fe00700 1 --2- 172.21.15.2:0/863901136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8ca345b0 0x55ba8ca3bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.837+0000 7f1626800700 1 -- 172.21.15.2:0/863901136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca3f300 msgr2=0x55ba8ca3c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:00.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.837+0000 7f1626800700 1 --2- 172.21.15.2:0/863901136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca3f300 0x55ba8ca3c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.837+0000 7f1626800700 1 -- 172.21.15.2:0/863901136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8ca345b0 msgr2=0x55ba8ca3bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:00.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.837+0000 7f1626800700 1 --2- 172.21.15.2:0/863901136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8ca345b0 0x55ba8ca3bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.837+0000 7f1626800700 1 -- 172.21.15.2:0/863901136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba8c8d58d0 con 0x55ba8c9b0e40 2024-06-13T11:26:00.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.838+0000 7f1626800700 1 --2- 172.21.15.2:0/863901136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca3eb90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1618005910 tx=0x7f1618009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=533cc2f02752855a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:00.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.838+0000 7f1614c00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:26:00.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.838+0000 7f1614c00700 1 -- 172.21.15.2:0/863901136 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1618003910 con 0x55ba8c9b0e40 2024-06-13T11:26:00.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.838+0000 7f1614c00700 1 -- 172.21.15.2:0/863901136 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f1618021070 con 0x55ba8c9b0e40 2024-06-13T11:26:00.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.838+0000 7f1637e27b80 1 -- 172.21.15.2:0/863901136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f162009f5a0 con 0x55ba8c9b0e40 2024-06-13T11:26:00.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.838+0000 7f1614c00700 1 -- 172.21.15.2:0/863901136 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f161803e050 con 0x55ba8c9b0e40 2024-06-13T11:26:00.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.838+0000 7f1637e27b80 10 client.25595 fetch_fsmap learned FSMap version 29 2024-06-13T11:26:00.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.838+0000 7f1637e27b80 1 -- 172.21.15.2:0/863901136 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ba8ca5d740 con 0x55ba8c9b0e40 2024-06-13T11:26:00.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.839+0000 7f1614c00700 1 -- 172.21.15.2:0/863901136 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f162009f5a0 con 0x55ba8c9b0e40 2024-06-13T11:26:00.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.839+0000 7f1614c00700 1 -- 172.21.15.2:0/863901136 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f161800fcd0 con 0x55ba8c9b0e40 2024-06-13T11:26:00.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.839+0000 7f1637e27b80 10 client.25595 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:26:00.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.839+0000 7f1637e27b80 10 client.25595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:26:00.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.839+0000 7f1637e27b80 20 client.25595 populate_metadata read hostname 'smithi002' 2024-06-13T11:26:00.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.839+0000 7f1637e27b80 1 --2- 172.21.15.2:0/863901136 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ba8ca5fe20 0x55ba8ca62270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.839+0000 7f1637e27b80 4 client.25595 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:26:00.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.839+0000 7f1637e27b80 1 -- 172.21.15.2:0/863901136 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba8c994000 con 0x55ba8ca5fe20 2024-06-13T11:26:00.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.840+0000 7f161fe00700 1 --2- 172.21.15.2:0/863901136 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ba8ca5fe20 0x55ba8ca62270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.840+0000 7f161fe00700 1 --2- 172.21.15.2:0/863901136 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ba8ca5fe20 0x55ba8ca62270 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b77da068d368e2c2 server_cookie=fa40517d404e999c in_seq=0 out_seq=0 2024-06-13T11:26:00.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.840+0000 7f1614c00700 10 client.25595 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:00.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.841+0000 7f1614c00700 1 -- 172.21.15.2:0/863901136 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ba8c994000 con 0x55ba8ca5fe20 2024-06-13T11:26:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.841+0000 7f1614c00700 10 client.25595 handle_command_reply: tid=0 2024-06-13T11:26:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.841+0000 7f1637e27b80 1 client.25595 shutdown 2024-06-13T11:26:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.841+0000 7f1637e27b80 1 -- 172.21.15.2:0/863901136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8c9b0e40 msgr2=0x55ba8ca3eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.841+0000 7f1637e27b80 1 --2- 172.21.15.2:0/863901136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca3eb90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1618005910 tx=0x7f1618009ca0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.842+0000 7f1637e27b80 1 -- 172.21.15.2:0/863901136 shutdown_connections 2024-06-13T11:26:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.842+0000 7f1637e27b80 1 --2- 172.21.15.2:0/863901136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca3f300 0x55ba8ca3c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.842+0000 7f1637e27b80 1 --2- 172.21.15.2:0/863901136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca3eb90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.842+0000 7f1637e27b80 1 --2- 172.21.15.2:0/863901136 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ba8ca5fe20 0x55ba8ca62270 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.842+0000 7f1637e27b80 1 --2- 172.21.15.2:0/863901136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8ca345b0 0x55ba8ca3bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.842+0000 7f1614c00700 0 client.25595 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.842+0000 7f1637e27b80 1 -- 172.21.15.2:0/863901136 >> 172.21.15.2:0/863901136 conn(0x55ba8c961170 msgr2=0x55ba8ca2f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.842+0000 7f1637e27b80 1 -- 172.21.15.2:0/863901136 shutdown_connections 2024-06-13T11:26:00.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.842+0000 7f1637e27b80 1 -- 172.21.15.2:0/863901136 wait complete. 2024-06-13T11:26:00.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.842+0000 7f1637e27b80 20 client.25595 trim_cache size 0 max 16384 2024-06-13T11:26:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.865+0000 7f1637e27b80 1 Processor -- start 2024-06-13T11:26:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.865+0000 7f1637e27b80 1 -- start start 2024-06-13T11:26:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.865+0000 7f1637e27b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca5c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.865+0000 7f1637e27b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca345b0 0x55ba8ca406f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.865+0000 7f1637e27b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8ca3f300 0x55ba8ca40c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.866+0000 7f1637e27b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f16281aeb60 con 0x55ba8ca3f300 2024-06-13T11:26:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.866+0000 7f1637e27b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f16281ac3f0 con 0x55ba8ca345b0 2024-06-13T11:26:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.866+0000 7f1637e27b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f162810d2d0 con 0x55ba8c9b0e40 2024-06-13T11:26:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.866+0000 7f1626800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca5c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.866+0000 7f1626800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca5c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49100/0 (socket says 172.21.15.2:49100) 2024-06-13T11:26:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.866+0000 7f1626800700 1 -- 172.21.15.2:0/917729868 learned_addr learned my addr 172.21.15.2:0/917729868 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.866+0000 7f161fe00700 1 --2- 172.21.15.2:0/917729868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca345b0 0x55ba8ca406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.866+0000 7f1627200700 1 --2- 172.21.15.2:0/917729868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8ca3f300 0x55ba8ca40c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.866+0000 7f1626800700 1 -- 172.21.15.2:0/917729868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca345b0 msgr2=0x55ba8ca406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.866+0000 7f1626800700 1 --2- 172.21.15.2:0/917729868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca345b0 0x55ba8ca406f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.866+0000 7f1626800700 1 -- 172.21.15.2:0/917729868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8ca3f300 msgr2=0x55ba8ca40c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.866+0000 7f1626800700 1 --2- 172.21.15.2:0/917729868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8ca3f300 0x55ba8ca40c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.866+0000 7f1626800700 1 -- 172.21.15.2:0/917729868 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba8ca628f0 con 0x55ba8c9b0e40 2024-06-13T11:26:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.866+0000 7f1627200700 1 --2- 172.21.15.2:0/917729868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8ca3f300 0x55ba8ca40c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:26:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.867+0000 7f1626800700 1 --2- 172.21.15.2:0/917729868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca5c050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1618027500 tx=0x7f161800bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e01fb24401660bb0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.867+0000 7f1617400700 1 -- 172.21.15.2:0/917729868 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161800b2e0 con 0x55ba8c9b0e40 2024-06-13T11:26:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.867+0000 7f1617400700 1 -- 172.21.15.2:0/917729868 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1618035070 con 0x55ba8c9b0e40 2024-06-13T11:26:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.867+0000 7f1617400700 1 -- 172.21.15.2:0/917729868 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161800f6c0 con 0x55ba8c9b0e40 2024-06-13T11:26:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.868+0000 7f1637e27b80 1 -- 172.21.15.2:0/917729868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8c9b0e40 msgr2=0x55ba8ca5c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.868+0000 7f1637e27b80 1 --2- 172.21.15.2:0/917729868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca5c050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1618027500 tx=0x7f161800bf60 comp rx=0 tx=0).stop 2024-06-13T11:26:00.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.868+0000 7f1637e27b80 1 -- 172.21.15.2:0/917729868 shutdown_connections 2024-06-13T11:26:00.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.868+0000 7f1637e27b80 1 --2- 172.21.15.2:0/917729868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8ca3f300 0x55ba8ca40c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.868+0000 7f1637e27b80 1 --2- 172.21.15.2:0/917729868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca5c050 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.868+0000 7f1637e27b80 1 --2- 172.21.15.2:0/917729868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca345b0 0x55ba8ca406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.868+0000 7f1637e27b80 1 -- 172.21.15.2:0/917729868 >> 172.21.15.2:0/917729868 conn(0x55ba8c961170 msgr2=0x55ba8ca3a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.868+0000 7f1637e27b80 1 -- 172.21.15.2:0/917729868 shutdown_connections 2024-06-13T11:26:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.868+0000 7f1637e27b80 1 -- 172.21.15.2:0/917729868 wait complete. 2024-06-13T11:26:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.869+0000 7f1637e27b80 1 -- start start 2024-06-13T11:26:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.869+0000 7f1637e27b80 1 Processor -- start 2024-06-13T11:26:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f1637e27b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca586d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f1637e27b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca345b0 0x55ba8ca392b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f1637e27b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca3f300 0x55ba8ca397f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f1637e27b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f162810d940 con 0x55ba8c9b0e40 2024-06-13T11:26:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f1637e27b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f162810edb0 con 0x55ba8ca3f300 2024-06-13T11:26:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f1637e27b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f162810e010 con 0x55ba8ca345b0 2024-06-13T11:26:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f1637e27b80 10 client.0 _ll_register_callbacks cb 0x55ba8c920720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:26:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f1626800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f161fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca345b0 0x55ba8ca392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f161fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca345b0 0x55ba8ca392b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49116/0 (socket says 172.21.15.2:49116) 2024-06-13T11:26:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f161fe00700 1 -- 172.21.15.2:0/2189726382 learned_addr learned my addr 172.21.15.2:0/2189726382 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f1627200700 1 --2- 172.21.15.2:0/2189726382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca3f300 0x55ba8ca397f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f161fe00700 1 -- 172.21.15.2:0/2189726382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca3f300 msgr2=0x55ba8ca397f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f161fe00700 1 --2- 172.21.15.2:0/2189726382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca3f300 0x55ba8ca397f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f161fe00700 1 -- 172.21.15.2:0/2189726382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8c9b0e40 msgr2=0x55ba8ca586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f161fe00700 1 --2- 172.21.15.2:0/2189726382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.870+0000 7f161fe00700 1 -- 172.21.15.2:0/2189726382 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba8ca27da0 con 0x55ba8ca345b0 2024-06-13T11:26:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.871+0000 7f161fe00700 1 --2- 172.21.15.2:0/2189726382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca345b0 0x55ba8ca392b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f16100097c0 tx=0x7f161001f8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f000dd73d1de38 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.871+0000 7f1614c00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:26:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.871+0000 7f1614c00700 1 -- 172.21.15.2:0/2189726382 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610004a30 con 0x55ba8ca345b0 2024-06-13T11:26:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.871+0000 7f1614c00700 1 -- 172.21.15.2:0/2189726382 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f1610004bd0 con 0x55ba8ca345b0 2024-06-13T11:26:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.871+0000 7f1637e27b80 1 -- 172.21.15.2:0/2189726382 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1618035070 con 0x55ba8ca345b0 2024-06-13T11:26:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.872+0000 7f1614c00700 1 -- 172.21.15.2:0/2189726382 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1610004dd0 con 0x55ba8ca345b0 2024-06-13T11:26:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.872+0000 7f1637e27b80 10 client.25636 fetch_fsmap learned FSMap version 29 2024-06-13T11:26:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.872+0000 7f1637e27b80 1 -- 172.21.15.2:0/2189726382 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ba8ca38ea0 con 0x55ba8ca345b0 2024-06-13T11:26:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.872+0000 7f1614c00700 1 -- 172.21.15.2:0/2189726382 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1618035070 con 0x55ba8ca345b0 2024-06-13T11:26:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.872+0000 7f1614c00700 1 -- 172.21.15.2:0/2189726382 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f1610030ae0 con 0x55ba8ca345b0 2024-06-13T11:26:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.872+0000 7f1637e27b80 10 client.25636 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:26:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.872+0000 7f1637e27b80 10 client.25636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:26:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.872+0000 7f1637e27b80 20 client.25636 populate_metadata read hostname 'smithi002' 2024-06-13T11:26:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.872+0000 7f1637e27b80 1 --2- 172.21.15.2:0/2189726382 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ba8cacbfc0 0x55ba8cace3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.872+0000 7f1637e27b80 4 client.25636 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:26:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.872+0000 7f1637e27b80 1 -- 172.21.15.2:0/2189726382 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ba8c98e580 con 0x55ba8cacbfc0 2024-06-13T11:26:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.873+0000 7f1626800700 1 --2- 172.21.15.2:0/2189726382 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ba8cacbfc0 0x55ba8cace3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.873+0000 7f1626800700 1 --2- 172.21.15.2:0/2189726382 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ba8cacbfc0 0x55ba8cace3e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f61cff95fb49587 server_cookie=b905730c45757217 in_seq=0 out_seq=0 2024-06-13T11:26:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.873+0000 7f1614c00700 10 client.25636 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.873+0000 7f1614c00700 1 -- 172.21.15.2:0/2189726382 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ba8c98e580 con 0x55ba8cacbfc0 2024-06-13T11:26:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.873+0000 7f1614c00700 10 client.25636 handle_command_reply: tid=0 2024-06-13T11:26:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.873+0000 7f1637e27b80 1 client.25636 shutdown 2024-06-13T11:26:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.874+0000 7f1637e27b80 1 -- 172.21.15.2:0/2189726382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca345b0 msgr2=0x55ba8ca392b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.874+0000 7f1637e27b80 1 --2- 172.21.15.2:0/2189726382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca345b0 0x55ba8ca392b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f16100097c0 tx=0x7f161001f8b0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.874+0000 7f1637e27b80 1 -- 172.21.15.2:0/2189726382 shutdown_connections 2024-06-13T11:26:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.874+0000 7f1637e27b80 1 --2- 172.21.15.2:0/2189726382 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ba8cacbfc0 0x55ba8cace3e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.874+0000 7f1637e27b80 1 --2- 172.21.15.2:0/2189726382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ba8c9b0e40 0x55ba8ca586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.874+0000 7f1614c00700 0 client.25636 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.874+0000 7f1637e27b80 1 --2- 172.21.15.2:0/2189726382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba8ca3f300 0x55ba8ca397f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.874+0000 7f1637e27b80 1 --2- 172.21.15.2:0/2189726382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba8ca345b0 0x55ba8ca392b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.874+0000 7f1637e27b80 1 -- 172.21.15.2:0/2189726382 >> 172.21.15.2:0/2189726382 conn(0x55ba8c961170 msgr2=0x55ba8ca36060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.874+0000 7f1637e27b80 1 -- 172.21.15.2:0/2189726382 shutdown_connections 2024-06-13T11:26:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.874+0000 7f1637e27b80 1 -- 172.21.15.2:0/2189726382 wait complete. 2024-06-13T11:26:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.874+0000 7f1637e27b80 20 client.25636 trim_cache size 0 max 16384 2024-06-13T11:26:00.876 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:26:00.876 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-13T11:26:00.876 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-06-13T11:26:00.876 INFO:teuthology.orchestra.run.smithi002.stdout: "a921dac3-49fa-4ef9-94c3-4b2e24b45491": { 2024-06-13T11:26:00.877 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-06-13T11:26:00.877 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "a921dac3-49fa-4ef9-94c3-4b2e24b45491", 2024-06-13T11:26:00.877 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-06-13T11:26:00.877 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:26:00.877 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:26:00.877 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:26:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.875+0000 7f162d400700 1 -- 172.21.15.2:0/3051734221 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f160c0a2e10 msgr2=0x7f160c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.875+0000 7f162d400700 1 --2- 172.21.15.2:0/3051734221 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f160c0a2e10 0x7f160c0a52d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1618006010 tx=0x7f161800b610 comp rx=0 tx=0).stop 2024-06-13T11:26:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.875+0000 7f162d400700 1 -- 172.21.15.2:0/3051734221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1628113660 msgr2=0x7f16281a3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.875+0000 7f162d400700 1 --2- 172.21.15.2:0/3051734221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1628113660 0x7f16281a3b80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1620007ee0 tx=0x7f162000d3b0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.875+0000 7f162d400700 1 -- 172.21.15.2:0/3051734221 shutdown_connections 2024-06-13T11:26:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.875+0000 7f162d400700 1 --2- 172.21.15.2:0/3051734221 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f160c0a2e10 0x7f160c0a52d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.875+0000 7f162d400700 1 --2- 172.21.15.2:0/3051734221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16280746c0 0x7f162819f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.875+0000 7f162d400700 1 --2- 172.21.15.2:0/3051734221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1628113660 0x7f16281a3b80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.875+0000 7f162d400700 1 --2- 172.21.15.2:0/3051734221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1628074fe0 0x7f162819f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.875+0000 7f162d400700 1 -- 172.21.15.2:0/3051734221 >> 172.21.15.2:0/3051734221 conn(0x7f16280795f0 msgr2=0x7f162810f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.875+0000 7f162d400700 1 -- 172.21.15.2:0/3051734221 shutdown_connections 2024-06-13T11:26:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:00.875+0000 7f162d400700 1 -- 172.21.15.2:0/3051734221 wait complete. 2024-06-13T11:26:00.927 INFO:tasks.workunit.client.0.smithi002.stdout:checking if gcc supports -c -o file.o... yes 2024-06-13T11:26:00.927 INFO:tasks.workunit.client.0.smithi002.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-06-13T11:26:00.945 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-06-13T11:26:01.033 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether -lc should be explicitly linked in... no 2024-06-13T11:26:01.240 INFO:tasks.workunit.client.0.smithi002.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-06-13T11:26:01.240 INFO:tasks.workunit.client.0.smithi002.stdout:checking how to hardcode library paths into programs... immediate 2024-06-13T11:26:01.244 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether stripping libraries is possible... yes 2024-06-13T11:26:01.244 INFO:tasks.workunit.client.0.smithi002.stdout:checking if libtool supports shared libraries... yes 2024-06-13T11:26:01.244 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether to build shared libraries... yes 2024-06-13T11:26:01.244 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether to build static libraries... yes 2024-06-13T11:26:01.262 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gcc... (cached) gcc 2024-06-13T11:26:01.359 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-06-13T11:26:01.359 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether gcc accepts -g... (cached) yes 2024-06-13T11:26:01.360 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-06-13T11:26:01.360 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gmake... /usr/bin/gmake 2024-06-13T11:26:01.361 INFO:tasks.workunit.client.0.smithi002.stderr:./configure: line 11968: test: $(SHELL): binary operator expected 2024-06-13T11:26:01.362 INFO:tasks.workunit.client.0.smithi002.stdout:checking for tar... /bin/tar 2024-06-13T11:26:01.362 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gzip... /bin/gzip 2024-06-13T11:26:01.430 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether gcc -MM is supported... yes 2024-06-13T11:26:01.432 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sort... /bin/sort 2024-06-13T11:26:01.432 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether ln -s works... yes 2024-06-13T11:26:01.435 INFO:tasks.workunit.client.0.smithi002.stdout:checking for rpm... /bin/rpm 2024-06-13T11:26:01.448 INFO:tasks.workunit.client.0.smithi002.stdout:checking for rpmbuild... no 2024-06-13T11:26:01.448 INFO:tasks.workunit.client.0.smithi002.stdout:checking for ANSI C header files... (cached) yes 2024-06-13T11:26:01.556 INFO:tasks.workunit.client.0.smithi002.stdout:checking assert.h usability... yes 2024-06-13T11:26:01.595 INFO:tasks.workunit.client.0.smithi002.stdout:checking assert.h presence... yes 2024-06-13T11:26:01.595 INFO:tasks.workunit.client.0.smithi002.stdout:checking for assert.h... yes 2024-06-13T11:26:01.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:01 smithi002 ceph-mon[32210]: pgmap v70: 129 pgs: 129 active+clean; 65 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 1.3 MiB/s wr, 271 op/s 2024-06-13T11:26:01.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:01 smithi178 ceph-mon[36913]: pgmap v70: 129 pgs: 129 active+clean; 65 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 1.3 MiB/s wr, 271 op/s 2024-06-13T11:26:01.969 INFO:tasks.workunit.client.0.smithi002.stdout:checking bstring.h usability... no 2024-06-13T11:26:02.038 INFO:tasks.workunit.client.0.smithi002.stdout:checking bstring.h presence... no 2024-06-13T11:26:02.038 INFO:tasks.workunit.client.0.smithi002.stdout:checking for bstring.h... no 2024-06-13T11:26:02.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:01 smithi077 ceph-mon[36410]: pgmap v70: 129 pgs: 129 active+clean; 65 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 1.3 MiB/s wr, 271 op/s 2024-06-13T11:26:02.147 INFO:tasks.workunit.client.0.smithi002.stdout:checking libgen.h usability... yes 2024-06-13T11:26:02.183 INFO:tasks.workunit.client.0.smithi002.stdout:checking libgen.h presence... yes 2024-06-13T11:26:02.183 INFO:tasks.workunit.client.0.smithi002.stdout:checking for libgen.h... yes 2024-06-13T11:26:02.188 INFO:tasks.cephfs.filesystem:scrub status for tag:a921dac3-49fa-4ef9-94c3-4b2e24b45491 - {'path': '/', 'tag': 'a921dac3-49fa-4ef9-94c3-4b2e24b45491', 'options': 'recursive,force'} 2024-06-13T11:26:02.292 INFO:tasks.workunit.client.0.smithi002.stdout:checking dirent.h usability... yes 2024-06-13T11:26:02.331 INFO:tasks.workunit.client.0.smithi002.stdout:checking dirent.h presence... yes 2024-06-13T11:26:02.331 INFO:tasks.workunit.client.0.smithi002.stdout:checking for dirent.h... yes 2024-06-13T11:26:02.434 INFO:tasks.workunit.client.0.smithi002.stdout:checking errno.h usability... yes 2024-06-13T11:26:02.466 INFO:tasks.workunit.client.0.smithi002.stdout:checking errno.h presence... yes 2024-06-13T11:26:02.467 INFO:tasks.workunit.client.0.smithi002.stdout:checking for errno.h... yes 2024-06-13T11:26:02.566 INFO:tasks.workunit.client.0.smithi002.stdout:checking malloc.h usability... yes 2024-06-13T11:26:02.609 INFO:tasks.workunit.client.0.smithi002.stdout:checking malloc.h presence... yes 2024-06-13T11:26:02.609 INFO:tasks.workunit.client.0.smithi002.stdout:checking for malloc.h... yes 2024-06-13T11:26:02.711 INFO:tasks.workunit.client.0.smithi002.stdout:checking uuid.h usability... no 2024-06-13T11:26:02.773 INFO:tasks.workunit.client.0.smithi002.stdout:checking uuid.h presence... no 2024-06-13T11:26:02.773 INFO:tasks.workunit.client.0.smithi002.stdout:checking for uuid.h... no 2024-06-13T11:26:02.876 INFO:tasks.workunit.client.0.smithi002.stdout:checking uuid/uuid.h usability... yes 2024-06-13T11:26:02.918 INFO:tasks.workunit.client.0.smithi002.stdout:checking uuid/uuid.h presence... yes 2024-06-13T11:26:02.918 INFO:tasks.workunit.client.0.smithi002.stdout:checking for uuid/uuid.h... yes 2024-06-13T11:26:03.025 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/uuid.h usability... no 2024-06-13T11:26:03.084 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/uuid.h presence... no 2024-06-13T11:26:03.084 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/uuid.h... no 2024-06-13T11:26:03.173 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/file.h usability... yes 2024-06-13T11:26:03.208 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/file.h presence... yes 2024-06-13T11:26:03.208 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/file.h... yes 2024-06-13T11:26:03.315 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/fcntl.h usability... yes 2024-06-13T11:26:03.350 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/fcntl.h presence... yes 2024-06-13T11:26:03.351 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/fcntl.h... yes 2024-06-13T11:26:03.452 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/syssgi.h usability... no 2024-06-13T11:26:03.505 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/syssgi.h presence... no 2024-06-13T11:26:03.505 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/syssgi.h... no 2024-06-13T11:26:03.637 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/param.h usability... yes 2024-06-13T11:26:03.676 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/param.h presence... yes 2024-06-13T11:26:03.676 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/param.h... yes 2024-06-13T11:26:03.704 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/stat.h... (cached) yes 2024-06-13T11:26:03.793 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/statvfs.h usability... yes 2024-06-13T11:26:03.830 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/statvfs.h presence... yes 2024-06-13T11:26:03.830 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/statvfs.h... yes 2024-06-13T11:26:03.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:03 smithi002 ceph-mon[32210]: pgmap v71: 129 pgs: 129 active+clean; 66 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 1.4 MiB/s wr, 297 op/s 2024-06-13T11:26:03.935 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/time.h usability... yes 2024-06-13T11:26:03.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:03 smithi178 ceph-mon[36913]: pgmap v71: 129 pgs: 129 active+clean; 66 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 1.4 MiB/s wr, 297 op/s 2024-06-13T11:26:03.975 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/time.h presence... yes 2024-06-13T11:26:03.976 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/time.h... yes 2024-06-13T11:26:04.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:03 smithi077 ceph-mon[36410]: pgmap v71: 129 pgs: 129 active+clean; 66 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 1.4 MiB/s wr, 297 op/s 2024-06-13T11:26:04.086 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/ioctl.h usability... yes 2024-06-13T11:26:04.127 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/ioctl.h presence... yes 2024-06-13T11:26:04.127 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/ioctl.h... yes 2024-06-13T11:26:04.259 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/wait.h usability... yes 2024-06-13T11:26:04.305 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/wait.h presence... yes 2024-06-13T11:26:04.305 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/wait.h... yes 2024-06-13T11:26:04.340 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/types.h... (cached) yes 2024-06-13T11:26:04.358 INFO:tasks.workunit.client.0.smithi002.stdout:checking for strings.h... (cached) yes 2024-06-13T11:26:04.446 INFO:tasks.workunit.client.0.smithi002.stdout:checking err.h usability... yes 2024-06-13T11:26:04.480 INFO:tasks.workunit.client.0.smithi002.stdout:checking err.h presence... yes 2024-06-13T11:26:04.480 INFO:tasks.workunit.client.0.smithi002.stdout:checking for err.h... yes 2024-06-13T11:26:04.583 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/falloc.h usability... yes 2024-06-13T11:26:04.620 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/falloc.h presence... yes 2024-06-13T11:26:04.620 INFO:tasks.workunit.client.0.smithi002.stdout:checking for linux/falloc.h... yes 2024-06-13T11:26:04.734 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-06-13T11:26:04.797 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-06-13T11:26:04.797 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/fs/xfs_fsops.h... no 2024-06-13T11:26:04.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:04 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:26:04.896 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/fs/xfs_itable.h usability... no 2024-06-13T11:26:04.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:04 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:26:04.951 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/fs/xfs_itable.h presence... no 2024-06-13T11:26:04.951 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/fs/xfs_itable.h... no 2024-06-13T11:26:05.034 INFO:tasks.workunit.client.0.smithi002.stdout:checking xfs/platform_defs.h usability... no 2024-06-13T11:26:05.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:04 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:26:05.088 INFO:tasks.workunit.client.0.smithi002.stdout:checking xfs/platform_defs.h presence... no 2024-06-13T11:26:05.088 INFO:tasks.workunit.client.0.smithi002.stdout:checking for xfs/platform_defs.h... no 2024-06-13T11:26:05.172 INFO:tasks.workunit.client.0.smithi002.stdout:checking btrfs/ioctl.h usability... no 2024-06-13T11:26:05.228 INFO:tasks.workunit.client.0.smithi002.stdout:checking btrfs/ioctl.h presence... no 2024-06-13T11:26:05.228 INFO:tasks.workunit.client.0.smithi002.stdout:checking for btrfs/ioctl.h... no 2024-06-13T11:26:05.317 INFO:tasks.workunit.client.0.smithi002.stdout:checking cifs/ioctl.h usability... no 2024-06-13T11:26:05.372 INFO:tasks.workunit.client.0.smithi002.stdout:checking cifs/ioctl.h presence... no 2024-06-13T11:26:05.372 INFO:tasks.workunit.client.0.smithi002.stdout:checking for cifs/ioctl.h... no 2024-06-13T11:26:05.472 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/mman.h usability... yes 2024-06-13T11:26:05.513 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/mman.h presence... yes 2024-06-13T11:26:05.513 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/mman.h... yes 2024-06-13T11:26:05.593 INFO:tasks.workunit.client.0.smithi002.stdout:checking for xfs/xfs_log_format.h... no 2024-06-13T11:26:05.704 INFO:tasks.workunit.client.0.smithi002.stdout:checking for uuid_compare... no 2024-06-13T11:26:05.804 INFO:tasks.workunit.client.0.smithi002.stdout:checking for uuid_compare in -luuid... yes 2024-06-13T11:26:05.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:05 smithi002 ceph-mon[32210]: pgmap v72: 129 pgs: 129 active+clean; 66 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 296 KiB/s wr, 53 op/s 2024-06-13T11:26:05.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:05 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:26:05.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:05 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:26:05.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:05 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:26:05.941 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:05 smithi077 ceph-mon[36410]: pgmap v72: 129 pgs: 129 active+clean; 66 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 296 KiB/s wr, 53 op/s 2024-06-13T11:26:05.941 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:05 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:26:05.941 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:05 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:26:05.941 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:05 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:26:05.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:05 smithi178 ceph-mon[36913]: pgmap v72: 129 pgs: 129 active+clean; 66 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 296 KiB/s wr, 53 op/s 2024-06-13T11:26:05.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:05 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:26:05.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:05 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:26:05.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:05 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:26:05.960 INFO:tasks.workunit.client.0.smithi002.stdout:checking for xfs/xfs.h... yes 2024-06-13T11:26:06.034 INFO:tasks.workunit.client.0.smithi002.stdout:checking for xfs/libxfs.h... no 2024-06-13T11:26:06.115 INFO:tasks.workunit.client.0.smithi002.stdout:checking whether xlog_assign_lsn is declared... no 2024-06-13T11:26:06.207 INFO:tasks.workunit.client.0.smithi002.stdout:checking for xfs/xqm.h... yes 2024-06-13T11:26:06.335 INFO:tasks.workunit.client.0.smithi002.stdout:checking xfsctl from xfs/xfs.h... ok 2024-06-13T11:26:06.409 INFO:tasks.workunit.client.0.smithi002.stdout:checking xfs/handle.h usability... yes 2024-06-13T11:26:06.448 INFO:tasks.workunit.client.0.smithi002.stdout:checking xfs/handle.h presence... yes 2024-06-13T11:26:06.448 INFO:tasks.workunit.client.0.smithi002.stdout:checking for xfs/handle.h... yes 2024-06-13T11:26:06.553 INFO:tasks.workunit.client.0.smithi002.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-06-13T11:26:06.678 INFO:tasks.workunit.client.0.smithi002.stdout:checking attr/attributes.h usability... yes 2024-06-13T11:26:06.718 INFO:tasks.workunit.client.0.smithi002.stdout:checking attr/attributes.h presence... yes 2024-06-13T11:26:06.718 INFO:tasks.workunit.client.0.smithi002.stdout:checking for attr/attributes.h... yes 2024-06-13T11:26:06.834 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/attributes.h usability... no 2024-06-13T11:26:06.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:06 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:26:06.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:06 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:26:06.897 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/attributes.h presence... no 2024-06-13T11:26:06.897 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/attributes.h... no 2024-06-13T11:26:06.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:06 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:26:06.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:06 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:26:07.000 INFO:tasks.workunit.client.0.smithi002.stdout:checking for attr_list in -lattr... yes 2024-06-13T11:26:07.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:06 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:26:07.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:06 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:26:07.096 INFO:tasks.workunit.client.0.smithi002.stdout:checking for attr_set in -lattr... yes 2024-06-13T11:26:07.194 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/acl.h usability... yes 2024-06-13T11:26:07.227 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/acl.h presence... yes 2024-06-13T11:26:07.227 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/acl.h... yes 2024-06-13T11:26:07.311 INFO:tasks.workunit.client.0.smithi002.stdout:checking acl/libacl.h usability... yes 2024-06-13T11:26:07.352 INFO:tasks.workunit.client.0.smithi002.stdout:checking acl/libacl.h presence... yes 2024-06-13T11:26:07.353 INFO:tasks.workunit.client.0.smithi002.stdout:checking for acl/libacl.h... yes 2024-06-13T11:26:07.462 INFO:tasks.workunit.client.0.smithi002.stdout:checking for acl_init in -lacl... yes 2024-06-13T11:26:07.581 INFO:tasks.workunit.client.0.smithi002.stdout:checking gdbm-ndbm.h usability... no 2024-06-13T11:26:07.649 INFO:tasks.workunit.client.0.smithi002.stdout:checking gdbm-ndbm.h presence... no 2024-06-13T11:26:07.649 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gdbm-ndbm.h... no 2024-06-13T11:26:07.737 INFO:tasks.workunit.client.0.smithi002.stdout:checking gdbm/ndbm.h usability... no 2024-06-13T11:26:07.801 INFO:tasks.workunit.client.0.smithi002.stdout:checking gdbm/ndbm.h presence... no 2024-06-13T11:26:07.801 INFO:tasks.workunit.client.0.smithi002.stdout:checking for gdbm/ndbm.h... no 2024-06-13T11:26:07.891 INFO:tasks.workunit.client.0.smithi002.stdout:checking ndbm.h usability... no 2024-06-13T11:26:07.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:07 smithi002 ceph-mon[32210]: pgmap v73: 129 pgs: 129 active+clean; 66 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 296 KiB/s wr, 53 op/s 2024-06-13T11:26:07.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:07 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:26:07.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:07 smithi178 ceph-mon[36913]: pgmap v73: 129 pgs: 129 active+clean; 66 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 296 KiB/s wr, 53 op/s 2024-06-13T11:26:07.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:07 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:26:07.958 INFO:tasks.workunit.client.0.smithi002.stdout:checking ndbm.h presence... no 2024-06-13T11:26:07.958 INFO:tasks.workunit.client.0.smithi002.stdout:checking for ndbm.h... no 2024-06-13T11:26:08.036 INFO:tasks.workunit.client.0.smithi002.stdout:checking libaio.h usability... yes 2024-06-13T11:26:08.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:07 smithi077 ceph-mon[36410]: pgmap v73: 129 pgs: 129 active+clean; 66 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 296 KiB/s wr, 53 op/s 2024-06-13T11:26:08.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:07 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:26:08.081 INFO:tasks.workunit.client.0.smithi002.stdout:checking libaio.h presence... yes 2024-06-13T11:26:08.081 INFO:tasks.workunit.client.0.smithi002.stdout:checking for libaio.h... yes 2024-06-13T11:26:08.204 INFO:tasks.workunit.client.0.smithi002.stdout:checking for dm_make_handle in -ldm... no 2024-06-13T11:26:08.204 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-06-13T11:26:08.204 INFO:tasks.workunit.client.0.smithi002.stdout:WARNING: could not find a valid DMAPI base library. 2024-06-13T11:26:08.204 INFO:tasks.workunit.client.0.smithi002.stdout:If you want DMAPI support please install the data migration 2024-06-13T11:26:08.205 INFO:tasks.workunit.client.0.smithi002.stdout:API (dmapi) library package. Alternatively, run "make install" 2024-06-13T11:26:08.205 INFO:tasks.workunit.client.0.smithi002.stdout:from the dmapi source. 2024-06-13T11:26:08.205 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-06-13T11:26:08.286 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/fiemap.h usability... yes 2024-06-13T11:26:08.327 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/fiemap.h presence... yes 2024-06-13T11:26:08.327 INFO:tasks.workunit.client.0.smithi002.stdout:checking for linux/fiemap.h... yes 2024-06-13T11:26:08.430 INFO:tasks.workunit.client.0.smithi002.stdout:checking for fallocate... yes 2024-06-13T11:26:08.553 INFO:tasks.workunit.client.0.smithi002.stdout:checking for open_by_handle_at... yes 2024-06-13T11:26:08.644 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/prctl.h usability... yes 2024-06-13T11:26:08.690 INFO:tasks.workunit.client.0.smithi002.stdout:checking sys/prctl.h presence... yes 2024-06-13T11:26:08.690 INFO:tasks.workunit.client.0.smithi002.stdout:checking for sys/prctl.h... yes 2024-06-13T11:26:08.776 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/fs.h usability... yes 2024-06-13T11:26:08.847 INFO:tasks.workunit.client.0.smithi002.stdout:checking linux/fs.h presence... yes 2024-06-13T11:26:08.847 INFO:tasks.workunit.client.0.smithi002.stdout:checking for linux/fs.h... yes 2024-06-13T11:26:09.410 INFO:tasks.workunit.client.0.smithi002.stdout:checking btrfsutil.h usability... no 2024-06-13T11:26:09.489 INFO:tasks.workunit.client.0.smithi002.stdout:checking btrfsutil.h presence... no 2024-06-13T11:26:09.490 INFO:tasks.workunit.client.0.smithi002.stdout:checking for btrfsutil.h... no 2024-06-13T11:26:09.595 INFO:tasks.workunit.client.0.smithi002.stdout:checking for copy_file_range... yes 2024-06-13T11:26:09.705 INFO:tasks.workunit.client.0.smithi002.stdout:checking for renameat2... yes 2024-06-13T11:26:09.749 INFO:tasks.workunit.client.0.smithi002.stdout:configure: creating ./config.status 2024-06-13T11:26:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:09 smithi002 ceph-mon[32210]: pgmap v74: 129 pgs: 129 active+clean; 68 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 464 KiB/s wr, 61 op/s 2024-06-13T11:26:09.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:09 smithi178 ceph-mon[36913]: pgmap v74: 129 pgs: 129 active+clean; 68 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 464 KiB/s wr, 61 op/s 2024-06-13T11:26:10.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:09 smithi077 ceph-mon[36410]: pgmap v74: 129 pgs: 129 active+clean; 68 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 464 KiB/s wr, 61 op/s 2024-06-13T11:26:11.056 INFO:tasks.workunit.client.0.smithi002.stdout:config.status: creating include/builddefs 2024-06-13T11:26:11.112 INFO:tasks.workunit.client.0.smithi002.stdout:config.status: creating include/config.h 2024-06-13T11:26:11.153 INFO:tasks.workunit.client.0.smithi002.stdout:config.status: executing libtool commands 2024-06-13T11:26:11.338 INFO:tasks.workunit.client.0.smithi002.stdout:Building include 2024-06-13T11:26:11.339 INFO:tasks.workunit.client.0.smithi002.stdout:Building lib 2024-06-13T11:26:11.340 INFO:tasks.workunit.client.0.smithi002.stdout:Building tests 2024-06-13T11:26:11.364 INFO:tasks.workunit.client.0.smithi002.stdout: [LTDEP] 2024-06-13T11:26:11.848 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] dataascii.lo 2024-06-13T11:26:11.849 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] databin.lo 2024-06-13T11:26:11.850 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] file_lock.lo 2024-06-13T11:26:11.850 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] datapid.lo 2024-06-13T11:26:11.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:11 smithi002 ceph-mon[32210]: pgmap v75: 129 pgs: 129 active+clean; 68 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 295 KiB/s wr, 34 op/s 2024-06-13T11:26:11.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:11 smithi178 ceph-mon[36913]: pgmap v75: 129 pgs: 129 active+clean; 68 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 295 KiB/s wr, 34 op/s 2024-06-13T11:26:12.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:11 smithi077 ceph-mon[36410]: pgmap v75: 129 pgs: 129 active+clean; 68 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 295 KiB/s wr, 34 op/s 2024-06-13T11:26:12.093 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] forker.lo 2024-06-13T11:26:12.097 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] pattern.lo 2024-06-13T11:26:12.152 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] open_flags.lo 2024-06-13T11:26:12.162 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] random_range.lo 2024-06-13T11:26:12.346 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] string_to_tokens.lo 2024-06-13T11:26:12.387 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] str_to_bytes.lo 2024-06-13T11:26:12.443 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] tlibio.lo 2024-06-13T11:26:12.566 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] write_log.lo 2024-06-13T11:26:12.575 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] random.lo 2024-06-13T11:26:12.962 INFO:tasks.workunit.client.0.smithi002.stdout: [LD] 2024-06-13T11:26:13.237 INFO:tasks.workunit.client.0.smithi002.stdout:Building ltp 2024-06-13T11:26:13.237 INFO:tasks.workunit.client.0.smithi002.stdout:Building m4 2024-06-13T11:26:13.238 INFO:tasks.workunit.client.0.smithi002.stdout:Building src 2024-06-13T11:26:13.238 INFO:tasks.workunit.client.0.smithi002.stdout:Building common 2024-06-13T11:26:13.252 INFO:tasks.workunit.client.0.smithi002.stdout: [DEP] 2024-06-13T11:26:13.279 INFO:tasks.workunit.client.0.smithi002.stdout: [DEP] 2024-06-13T11:26:13.727 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] doio 2024-06-13T11:26:13.727 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fsstress 2024-06-13T11:26:13.728 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fsx 2024-06-13T11:26:13.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:13 smithi002 ceph-mon[32210]: pgmap v76: 129 pgs: 129 active+clean; 80 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-06-13T11:26:13.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:13 smithi178 ceph-mon[36913]: pgmap v76: 129 pgs: 129 active+clean; 80 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-06-13T11:26:14.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:13 smithi077 ceph-mon[36410]: pgmap v76: 129 pgs: 129 active+clean; 80 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-06-13T11:26:14.041 INFO:tasks.workunit.client.0.smithi002.stderr:fsstress.c: In function 'attr_list_path': 2024-06-13T11:26:14.041 INFO:tasks.workunit.client.0.smithi002.stderr:fsstress.c:859:9: warning: 'attr_list' is deprecated: Use listxattr or llistxattr instead [-Wdeprecated-declarations] 2024-06-13T11:26:14.041 INFO:tasks.workunit.client.0.smithi002.stderr: 859 | rval = attr_list(name->path, buffer, buffersize, flags, cursor); 2024-06-13T11:26:14.041 INFO:tasks.workunit.client.0.smithi002.stderr: | ^~~~ 2024-06-13T11:26:14.041 INFO:tasks.workunit.client.0.smithi002.stderr:In file included from ../src/global.h:25, 2024-06-13T11:26:14.041 INFO:tasks.workunit.client.0.smithi002.stderr: from fsstress.c:12: 2024-06-13T11:26:14.041 INFO:tasks.workunit.client.0.smithi002.stderr:/usr/include/attr/attributes.h:165:12: note: declared here 2024-06-13T11:26:14.041 INFO:tasks.workunit.client.0.smithi002.stderr: 165 | extern int attr_list(const char *__path, char *__buffer, const int __buffersize, 2024-06-13T11:26:14.042 INFO:tasks.workunit.client.0.smithi002.stderr: | ^~~~~~~~~ 2024-06-13T11:26:14.042 INFO:tasks.workunit.client.0.smithi002.stderr:fsstress.c: In function 'attr_remove_path': 2024-06-13T11:26:14.042 INFO:tasks.workunit.client.0.smithi002.stderr:fsstress.c:878:9: warning: 'attr_remove' is deprecated: Use removexattr or lremovexattr instead [-Wdeprecated-declarations] 2024-06-13T11:26:14.042 INFO:tasks.workunit.client.0.smithi002.stderr: 878 | rval = attr_remove(name->path, attrname, flags); 2024-06-13T11:26:14.042 INFO:tasks.workunit.client.0.smithi002.stderr: | ^~~~ 2024-06-13T11:26:14.042 INFO:tasks.workunit.client.0.smithi002.stderr:In file included from ../src/global.h:25, 2024-06-13T11:26:14.042 INFO:tasks.workunit.client.0.smithi002.stderr: from fsstress.c:12: 2024-06-13T11:26:14.042 INFO:tasks.workunit.client.0.smithi002.stderr:/usr/include/attr/attributes.h:152:12: note: declared here 2024-06-13T11:26:14.042 INFO:tasks.workunit.client.0.smithi002.stderr: 152 | extern int attr_remove (const char *__path, const char *__attrname, 2024-06-13T11:26:14.042 INFO:tasks.workunit.client.0.smithi002.stderr: | ^~~~~~~~~~~ 2024-06-13T11:26:14.042 INFO:tasks.workunit.client.0.smithi002.stderr:fsstress.c: In function 'attr_set_path': 2024-06-13T11:26:14.042 INFO:tasks.workunit.client.0.smithi002.stderr:fsstress.c:898:9: warning: 'attr_set' is deprecated: Use setxattr or lsetxattr instead [-Wdeprecated-declarations] 2024-06-13T11:26:14.042 INFO:tasks.workunit.client.0.smithi002.stderr: 898 | rval = attr_set(name->path, attrname, attrvalue, valuelength, flags); 2024-06-13T11:26:14.043 INFO:tasks.workunit.client.0.smithi002.stderr: | ^~~~ 2024-06-13T11:26:14.043 INFO:tasks.workunit.client.0.smithi002.stderr:In file included from ../src/global.h:25, 2024-06-13T11:26:14.043 INFO:tasks.workunit.client.0.smithi002.stderr: from fsstress.c:12: 2024-06-13T11:26:14.043 INFO:tasks.workunit.client.0.smithi002.stderr:/usr/include/attr/attributes.h:139:12: note: declared here 2024-06-13T11:26:14.043 INFO:tasks.workunit.client.0.smithi002.stderr: 139 | extern int attr_set (const char *__path, const char *__attrname, 2024-06-13T11:26:14.043 INFO:tasks.workunit.client.0.smithi002.stderr: | ^~~~~~~~ 2024-06-13T11:26:14.054 INFO:tasks.workunit.client.0.smithi002.stderr:fsstress.c: In function 'allocsp_f': 2024-06-13T11:26:14.054 INFO:tasks.workunit.client.0.smithi002.stderr:fsstress.c:2047:32: error: 'XFS_IOC_ALLOCSP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2024-06-13T11:26:14.054 INFO:tasks.workunit.client.0.smithi002.stderr: 2047 | e = xfsctl(f.path, fd, XFS_IOC_ALLOCSP64, &fl) < 0 ? errno : 0; 2024-06-13T11:26:14.054 INFO:tasks.workunit.client.0.smithi002.stderr: | ^~~~~~~~~~~~~~~~~ 2024-06-13T11:26:14.054 INFO:tasks.workunit.client.0.smithi002.stderr: | XFS_IOC_RESVSP64 2024-06-13T11:26:14.054 INFO:tasks.workunit.client.0.smithi002.stderr:fsstress.c:2047:32: note: each undeclared identifier is reported only once for each function it appears in 2024-06-13T11:26:14.075 INFO:tasks.workunit.client.0.smithi002.stderr:fsstress.c: In function 'freesp_f': 2024-06-13T11:26:14.075 INFO:tasks.workunit.client.0.smithi002.stderr:fsstress.c:3640:32: error: 'XFS_IOC_FREESP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2024-06-13T11:26:14.075 INFO:tasks.workunit.client.0.smithi002.stderr: 3640 | e = xfsctl(f.path, fd, XFS_IOC_FREESP64, &fl) < 0 ? errno : 0; 2024-06-13T11:26:14.075 INFO:tasks.workunit.client.0.smithi002.stderr: | ^~~~~~~~~~~~~~~~ 2024-06-13T11:26:14.075 INFO:tasks.workunit.client.0.smithi002.stderr: | XFS_IOC_RESVSP64 2024-06-13T11:26:14.120 INFO:tasks.workunit.client.0.smithi002.stderr:gmake[3]: *** [Makefile:47: fsstress] Error 1 2024-06-13T11:26:14.120 INFO:tasks.workunit.client.0.smithi002.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2024-06-13T11:26:14.548 INFO:tasks.workunit.client.0.smithi002.stderr:doio.c: In function 'parse_cmdline': 2024-06-13T11:26:14.548 INFO:tasks.workunit.client.0.smithi002.stderr:doio.c:3113:33: warning: '%s' directive argument is null [-Wformat-overflow=] 2024-06-13T11:26:14.548 INFO:tasks.workunit.client.0.smithi002.stderr: 3113 | fprintf(stderr, 2024-06-13T11:26:14.548 INFO:tasks.workunit.client.0.smithi002.stderr: | ^~~~~~~~~~~~~~~ 2024-06-13T11:26:14.549 INFO:tasks.workunit.client.0.smithi002.stderr: 3114 | "%s%s: Illegal -C arg (%s). Must be one of: ", 2024-06-13T11:26:14.549 INFO:tasks.workunit.client.0.smithi002.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-06-13T11:26:14.549 INFO:tasks.workunit.client.0.smithi002.stderr: 3115 | Prog, TagName, tok); 2024-06-13T11:26:14.549 INFO:tasks.workunit.client.0.smithi002.stderr: | ~~~~~~~~~~~~~~~~~~~ 2024-06-13T11:26:14.576 INFO:tasks.workunit.client.0.smithi002.stderr:fsx.c: In function 'main': 2024-06-13T11:26:14.576 INFO:tasks.workunit.client.0.smithi002.stderr:fsx.c:2662:33: warning: 'strncpy' specified bound 4096 equals destination size [-Wstringop-truncation] 2024-06-13T11:26:14.577 INFO:tasks.workunit.client.0.smithi002.stderr: 2662 | strncpy(opsfile, optarg, sizeof(opsfile)); 2024-06-13T11:26:14.577 INFO:tasks.workunit.client.0.smithi002.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-06-13T11:26:14.577 INFO:tasks.workunit.client.0.smithi002.stderr:fsx.c:2632:25: warning: 'strncpy' specified bound 1024 equals destination size [-Wstringop-truncation] 2024-06-13T11:26:14.577 INFO:tasks.workunit.client.0.smithi002.stderr: 2632 | strncpy(dname, optarg, sizeof(dname)); 2024-06-13T11:26:14.577 INFO:tasks.workunit.client.0.smithi002.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-06-13T11:26:14.725 INFO:tasks.workunit.client.0.smithi002.stderr:gmake[2]: *** [include/buildrules:30: ltp] Error 2 2024-06-13T11:26:14.726 INFO:tasks.workunit.client.0.smithi002.stderr:gmake[2]: *** Waiting for unfinished jobs.... 2024-06-13T11:26:15.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:15 smithi002 ceph-mon[32210]: pgmap v77: 129 pgs: 129 active+clean; 80 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-06-13T11:26:15.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:15 smithi178 ceph-mon[36913]: pgmap v77: 129 pgs: 129 active+clean; 80 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-06-13T11:26:16.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:15 smithi077 ceph-mon[36410]: pgmap v77: 129 pgs: 129 active+clean; 80 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-06-13T11:26:16.814 INFO:tasks.workunit.client.0.smithi002.stdout: [DEP] 2024-06-13T11:26:16.816 INFO:tasks.workunit.client.0.smithi002.stdout: [DEP] 2024-06-13T11:26:16.818 INFO:tasks.workunit.client.0.smithi002.stdout: [DEP] 2024-06-13T11:26:17.385 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] dirstress 2024-06-13T11:26:17.387 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fill 2024-06-13T11:26:17.390 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fill2 2024-06-13T11:26:17.394 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] getpagesize 2024-06-13T11:26:17.709 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] holes 2024-06-13T11:26:17.728 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] lstat64 2024-06-13T11:26:17.833 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] nametest 2024-06-13T11:26:17.849 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] permname 2024-06-13T11:26:17.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:17 smithi178 ceph-mon[36913]: pgmap v78: 129 pgs: 129 active+clean; 80 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-06-13T11:26:18.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:17 smithi077 ceph-mon[36410]: pgmap v78: 129 pgs: 129 active+clean; 80 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-06-13T11:26:18.078 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] randholes 2024-06-13T11:26:18.123 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] runas 2024-06-13T11:26:18.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:17 smithi002 ceph-mon[32210]: pgmap v78: 129 pgs: 129 active+clean; 80 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-06-13T11:26:18.228 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] truncfile 2024-06-13T11:26:18.317 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] usemem 2024-06-13T11:26:18.511 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] mmapcat 2024-06-13T11:26:18.555 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] append_reader 2024-06-13T11:26:18.582 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] append_writer 2024-06-13T11:26:18.594 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] dirperf 2024-06-13T11:26:18.833 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] metaperf 2024-06-13T11:26:18.862 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] devzero 2024-06-13T11:26:18.871 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] feature 2024-06-13T11:26:19.007 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] alloc 2024-06-13T11:26:19.238 INFO:tasks.workunit.client.0.smithi002.stderr:alloc.c: In function 'main': 2024-06-13T11:26:19.238 INFO:tasks.workunit.client.0.smithi002.stderr:alloc.c:154:1: error: 'bozo' undeclared (first use in this function) 2024-06-13T11:26:19.238 INFO:tasks.workunit.client.0.smithi002.stderr: 154 | bozo! 2024-06-13T11:26:19.238 INFO:tasks.workunit.client.0.smithi002.stderr: | ^~~~ 2024-06-13T11:26:19.238 INFO:tasks.workunit.client.0.smithi002.stderr:alloc.c:154:1: note: each undeclared identifier is reported only once for each function it appears in 2024-06-13T11:26:19.238 INFO:tasks.workunit.client.0.smithi002.stderr:alloc.c:154:5: error: expected ';' before '!' token 2024-06-13T11:26:19.238 INFO:tasks.workunit.client.0.smithi002.stderr: 154 | bozo! 2024-06-13T11:26:19.238 INFO:tasks.workunit.client.0.smithi002.stderr: | ^ 2024-06-13T11:26:19.238 INFO:tasks.workunit.client.0.smithi002.stderr: | ; 2024-06-13T11:26:19.239 INFO:tasks.workunit.client.0.smithi002.stderr:alloc.c:184:25: error: 'rflag' undeclared (first use in this function); did you mean 'nflag'? 2024-06-13T11:26:19.239 INFO:tasks.workunit.client.0.smithi002.stderr: 184 | rflag = 1; 2024-06-13T11:26:19.239 INFO:tasks.workunit.client.0.smithi002.stderr: | ^~~~~ 2024-06-13T11:26:19.239 INFO:tasks.workunit.client.0.smithi002.stderr: | nflag 2024-06-13T11:26:19.239 INFO:tasks.workunit.client.0.smithi002.stderr:alloc.c:320:5: error: expected ';' before '!' token 2024-06-13T11:26:19.239 INFO:tasks.workunit.client.0.smithi002.stderr: 320 | bozo! 2024-06-13T11:26:19.240 INFO:tasks.workunit.client.0.smithi002.stderr: | ^ 2024-06-13T11:26:19.240 INFO:tasks.workunit.client.0.smithi002.stderr: | ; 2024-06-13T11:26:19.240 INFO:tasks.workunit.client.0.smithi002.stderr:alloc.c:128:25: warning: variable 'f' set but not used [-Wunused-but-set-variable] 2024-06-13T11:26:19.240 INFO:tasks.workunit.client.0.smithi002.stderr: 128 | struct flock64 f; 2024-06-13T11:26:19.240 INFO:tasks.workunit.client.0.smithi002.stderr: | ^ 2024-06-13T11:26:19.243 INFO:tasks.workunit.client.0.smithi002.stdout: [CC] fault 2024-06-13T11:26:19.246 INFO:tasks.workunit.client.0.smithi002.stderr:gmake[3]: *** [Makefile:83: alloc] Error 1 2024-06-13T11:26:19.246 INFO:tasks.workunit.client.0.smithi002.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2024-06-13T11:26:19.557 INFO:tasks.workunit.client.0.smithi002.stderr:gmake[2]: *** [include/buildrules:30: src] Error 2 2024-06-13T11:26:19.557 INFO:tasks.workunit.client.0.smithi002.stderr:make[1]: *** [Makefile:53: default] Error 2 2024-06-13T11:26:19.558 INFO:tasks.workunit.client.0.smithi002.stderr:make: *** [Makefile:51: default] Error 2 2024-06-13T11:26:19.560 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-06-13T11:26:19.560 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-06-13T11:26:19.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-06-13T11:26:19.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:19 smithi178 ceph-mon[36913]: pgmap v79: 129 pgs: 129 active+clean; 80 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 1.4 MiB/s wr, 158 op/s 2024-06-13T11:26:20.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:19 smithi077 ceph-mon[36410]: pgmap v79: 129 pgs: 129 active+clean; 80 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 1.4 MiB/s wr, 158 op/s 2024-06-13T11:26:20.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:19 smithi002 ceph-mon[32210]: pgmap v79: 129 pgs: 129 active+clean; 80 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 1.4 MiB/s wr, 158 op/s 2024-06-13T11:26:20.767 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi002 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1373963c202323287783ccb099bbae1ec8f14a5d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2024-06-13T11:26:20.987 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9ba828c1029b47bab9200634099bb160 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi002 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1373963c202323287783ccb099bbae1ec8f14a5d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2024-06-13T11:26:20.990 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-06-13T11:26:21.000 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-06-13T11:26:21.000 INFO:teuthology.task.exec:Executing custom commands... 2024-06-13T11:26:21.000 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T11:26:21.000 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-06-13T11:26:21.104 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-06-13T11:26:21.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:21 smithi178 ceph-mon[36913]: pgmap v80: 129 pgs: 129 active+clean; 80 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-06-13T11:26:22.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:21 smithi077 ceph-mon[36410]: pgmap v80: 129 pgs: 129 active+clean; 80 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-06-13T11:26:22.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:21 smithi002 ceph-mon[32210]: pgmap v80: 129 pgs: 129 active+clean; 80 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 1.2 MiB/s wr, 150 op/s 2024-06-13T11:26:23.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:23 smithi178 ceph-mon[36913]: pgmap v81: 129 pgs: 129 active+clean; 81 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 1.2 MiB/s wr, 160 op/s 2024-06-13T11:26:24.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:23 smithi077 ceph-mon[36410]: pgmap v81: 129 pgs: 129 active+clean; 81 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 1.2 MiB/s wr, 160 op/s 2024-06-13T11:26:24.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:23 smithi002 ceph-mon[32210]: pgmap v81: 129 pgs: 129 active+clean; 81 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 1.2 MiB/s wr, 160 op/s 2024-06-13T11:26:25.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:25 smithi178 ceph-mon[36913]: pgmap v82: 129 pgs: 129 active+clean; 81 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 59 KiB/s wr, 19 op/s 2024-06-13T11:26:26.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:25 smithi077 ceph-mon[36410]: pgmap v82: 129 pgs: 129 active+clean; 81 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 59 KiB/s wr, 19 op/s 2024-06-13T11:26:26.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:25 smithi002 ceph-mon[32210]: pgmap v82: 129 pgs: 129 active+clean; 81 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 59 KiB/s wr, 19 op/s 2024-06-13T11:26:27.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:27 smithi178 ceph-mon[36913]: pgmap v83: 129 pgs: 129 active+clean; 81 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 59 KiB/s wr, 19 op/s 2024-06-13T11:26:28.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:27 smithi077 ceph-mon[36410]: pgmap v83: 129 pgs: 129 active+clean; 81 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 59 KiB/s wr, 19 op/s 2024-06-13T11:26:28.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:27 smithi002 ceph-mon[32210]: pgmap v83: 129 pgs: 129 active+clean; 81 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 59 KiB/s wr, 19 op/s 2024-06-13T11:26:29.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:29 smithi178 ceph-mon[36913]: pgmap v84: 129 pgs: 129 active+clean; 81 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 61 KiB/s wr, 23 op/s 2024-06-13T11:26:30.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:29 smithi077 ceph-mon[36410]: pgmap v84: 129 pgs: 129 active+clean; 81 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 61 KiB/s wr, 23 op/s 2024-06-13T11:26:30.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:29 smithi002 ceph-mon[32210]: pgmap v84: 129 pgs: 129 active+clean; 81 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 61 KiB/s wr, 23 op/s 2024-06-13T11:26:31.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:31 smithi178 ceph-mon[36913]: pgmap v85: 129 pgs: 129 active+clean; 81 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-06-13T11:26:31.948 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:31 smithi002 ceph-mon[32210]: pgmap v85: 129 pgs: 129 active+clean; 81 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-06-13T11:26:32.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:31 smithi077 ceph-mon[36410]: pgmap v85: 129 pgs: 129 active+clean; 81 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-06-13T11:26:32.189 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:26:32.645 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:26:33.930 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:33 smithi002 ceph-mon[32210]: pgmap v86: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 243 KiB/s wr, 28 op/s 2024-06-13T11:26:33.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:33 smithi178 ceph-mon[36913]: pgmap v86: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 243 KiB/s wr, 28 op/s 2024-06-13T11:26:34.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:33 smithi077 ceph-mon[36410]: pgmap v86: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 243 KiB/s wr, 28 op/s 2024-06-13T11:26:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.019+0000 7fdc13e00700 1 -- 172.21.15.2:0/2555298813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc0c105070 msgr2=0x7fdc0c111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.019+0000 7fdc13e00700 1 --2- 172.21.15.2:0/2555298813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc0c105070 0x7fdc0c111580 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009990 tx=0x7fdc04009ca0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.019+0000 7fdc13e00700 1 -- 172.21.15.2:0/2555298813 shutdown_connections 2024-06-13T11:26:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.019+0000 7fdc13e00700 1 --2- 172.21.15.2:0/2555298813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc0c105070 0x7fdc0c111580 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.019+0000 7fdc13e00700 1 --2- 172.21.15.2:0/2555298813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc0c10a6b0 0x7fdc0c10aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.019+0000 7fdc13e00700 1 --2- 172.21.15.2:0/2555298813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc0c1046b0 0x7fdc0c104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.019+0000 7fdc13e00700 1 -- 172.21.15.2:0/2555298813 >> 172.21.15.2:0/2555298813 conn(0x7fdc0c1001a0 msgr2=0x7fdc0c1025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.019+0000 7fdc13e00700 1 -- 172.21.15.2:0/2555298813 shutdown_connections 2024-06-13T11:26:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.019+0000 7fdc13e00700 1 -- 172.21.15.2:0/2555298813 wait complete. 2024-06-13T11:26:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.020+0000 7fdc13e00700 1 Processor -- start 2024-06-13T11:26:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.021+0000 7fdc13e00700 1 -- start start 2024-06-13T11:26:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.021+0000 7fdc13e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc0c1046b0 0x7fdc0c19ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.021+0000 7fdc13e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc0c105070 0x7fdc0c19b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.021+0000 7fdc13e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc0c10a6b0 0x7fdc0c19f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.021+0000 7fdc13e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1149e0 con 0x7fdc0c1046b0 2024-06-13T11:26:35.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.021+0000 7fdc13e00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c114860 con 0x7fdc0c105070 2024-06-13T11:26:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.021+0000 7fdc13e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c114b60 con 0x7fdc0c10a6b0 2024-06-13T11:26:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.021+0000 7fdc11400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc0c1046b0 0x7fdc0c19ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.021+0000 7fdc11400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc0c1046b0 0x7fdc0c19ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45682/0 (socket says 172.21.15.2:45682) 2024-06-13T11:26:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.021+0000 7fdc11400700 1 -- 172.21.15.2:0/1218420230 learned_addr learned my addr 172.21.15.2:0/1218420230 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.021+0000 7fdc11e00700 1 --2- 172.21.15.2:0/1218420230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc0c10a6b0 0x7fdc0c19f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.021+0000 7fdc10a00700 1 --2- 172.21.15.2:0/1218420230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc0c105070 0x7fdc0c19b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.022+0000 7fdc11e00700 1 -- 172.21.15.2:0/1218420230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc0c105070 msgr2=0x7fdc0c19b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.022+0000 7fdc11e00700 1 --2- 172.21.15.2:0/1218420230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc0c105070 0x7fdc0c19b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.022+0000 7fdc11e00700 1 -- 172.21.15.2:0/1218420230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc0c1046b0 msgr2=0x7fdc0c19ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.022+0000 7fdc11e00700 1 --2- 172.21.15.2:0/1218420230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc0c1046b0 0x7fdc0c19ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.022+0000 7fdc11e00700 1 -- 172.21.15.2:0/1218420230 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0c19fd80 con 0x7fdc0c10a6b0 2024-06-13T11:26:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.022+0000 7fdc11e00700 1 --2- 172.21.15.2:0/1218420230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc0c10a6b0 0x7fdc0c19f640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdc040098e0 tx=0x7fdc0400bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.023+0000 7fdc0a000700 1 -- 172.21.15.2:0/1218420230 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04027070 con 0x7fdc0c10a6b0 2024-06-13T11:26:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.023+0000 7fdc13e00700 1 -- 172.21.15.2:0/1218420230 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0c1a0010 con 0x7fdc0c10a6b0 2024-06-13T11:26:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.023+0000 7fdc0a000700 1 -- 172.21.15.2:0/1218420230 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc04003d70 con 0x7fdc0c10a6b0 2024-06-13T11:26:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.023+0000 7fdc0a000700 1 -- 172.21.15.2:0/1218420230 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0400f460 con 0x7fdc0c10a6b0 2024-06-13T11:26:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.023+0000 7fdc13e00700 1 -- 172.21.15.2:0/1218420230 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc0c1a78f0 con 0x7fdc0c10a6b0 2024-06-13T11:26:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.026+0000 7fdc0a000700 1 -- 172.21.15.2:0/1218420230 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fdc0402a070 con 0x7fdc0c10a6b0 2024-06-13T11:26:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.027+0000 7fdc0a000700 1 --2- 172.21.15.2:0/1218420230 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdbf40a2d90 0x7fdbf40a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.028+0000 7fdc1e6c1b80 1 Processor -- start 2024-06-13T11:26:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.028+0000 7fdc0a000700 1 -- 172.21.15.2:0/1218420230 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fdc040d0790 con 0x7fdc0c10a6b0 2024-06-13T11:26:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.028+0000 7fdc1e6c1b80 1 -- start start 2024-06-13T11:26:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.028+0000 7fdc11400700 1 --2- 172.21.15.2:0/1218420230 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdbf40a2d90 0x7fdbf40a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.028+0000 7fdc1e6c1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecaaae40 0x55d7ecb2e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.028+0000 7fdc1e6c1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb2ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.028+0000 7fdc1e6c1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecb39300 0x55d7ecb3b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.028+0000 7fdc1e6c1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d7eca3da10 con 0x55d7ecaaae40 2024-06-13T11:26:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.028+0000 7fdc1e6c1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d7eca80b00 con 0x55d7ecb39300 2024-06-13T11:26:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.028+0000 7fdc1e6c1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d7eca3b8f0 con 0x55d7ecb2e5b0 2024-06-13T11:26:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.029+0000 7fdc11400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecaaae40 0x55d7ecb2e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.029+0000 7fdc10a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb2ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.029+0000 7fdc10a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb2ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:39614/0 (socket says 172.21.15.2:39614) 2024-06-13T11:26:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.029+0000 7fdc11400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecaaae40 0x55d7ecb2e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45686/0 (socket says 172.21.15.2:45686) 2024-06-13T11:26:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.029+0000 7fdc10a00700 1 -- 172.21.15.2:0/913885225 learned_addr learned my addr 172.21.15.2:0/913885225 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.029+0000 7fdc11e00700 1 --2- 172.21.15.2:0/913885225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecb39300 0x55d7ecb3b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.029+0000 7fdc11400700 1 --2- 172.21.15.2:0/1218420230 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdbf40a2d90 0x7fdbf40a5250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009c10 tx=0x7fdc00009920 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.029+0000 7fdc10a00700 1 -- 172.21.15.2:0/913885225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecb39300 msgr2=0x55d7ecb3b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.029+0000 7fdc10a00700 1 --2- 172.21.15.2:0/913885225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecb39300 0x55d7ecb3b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.029+0000 7fdc10a00700 1 -- 172.21.15.2:0/913885225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecaaae40 msgr2=0x55d7ecb2e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.029+0000 7fdc10a00700 1 --2- 172.21.15.2:0/913885225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecaaae40 0x55d7ecb2e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.029+0000 7fdc10a00700 1 -- 172.21.15.2:0/913885225 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7eca28f90 con 0x55d7ecb2e5b0 2024-06-13T11:26:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.029+0000 7fdc11e00700 1 --2- 172.21.15.2:0/913885225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecb39300 0x55d7ecb3b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.029+0000 7fdc11400700 1 --2- 172.21.15.2:0/913885225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecaaae40 0x55d7ecb2e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.030+0000 7fdc10a00700 1 --2- 172.21.15.2:0/913885225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb2ea30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8007c90 tx=0x7fdbf80103d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91ed95a64243d6dc server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.030+0000 7fdbfea00700 1 -- 172.21.15.2:0/913885225 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8004310 con 0x55d7ecb2e5b0 2024-06-13T11:26:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.030+0000 7fdbfea00700 1 -- 172.21.15.2:0/913885225 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbf8015070 con 0x55d7ecb2e5b0 2024-06-13T11:26:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.030+0000 7fdbfea00700 1 -- 172.21.15.2:0/913885225 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8003dd0 con 0x55d7ecb2e5b0 2024-06-13T11:26:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.031+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/913885225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 msgr2=0x55d7ecb2ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.031+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/913885225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb2ea30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8007c90 tx=0x7fdbf80103d0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.031+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/913885225 shutdown_connections 2024-06-13T11:26:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.031+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/913885225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecaaae40 0x55d7ecb2e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.031+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/913885225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecb39300 0x55d7ecb3b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.031+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/913885225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb2ea30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.031+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/913885225 >> 172.21.15.2:0/913885225 conn(0x55d7eca5b170 msgr2=0x55d7ecb2a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.031+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/913885225 shutdown_connections 2024-06-13T11:26:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.031+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/913885225 wait complete. 2024-06-13T11:26:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.032+0000 7fdc1e6c1b80 1 -- start start 2024-06-13T11:26:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.032+0000 7fdc1e6c1b80 1 Processor -- start 2024-06-13T11:26:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.033+0000 7fdc1e6c1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecaaae40 0x55d7ecb38a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.033+0000 7fdc1e6c1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb35d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.033+0000 7fdc1e6c1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecb39300 0x55d7ecb36280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.033+0000 7fdc1e6c1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d7eca1cf60 con 0x55d7ecaaae40 2024-06-13T11:26:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.033+0000 7fdc1e6c1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d7eca7cac0 con 0x55d7ecb39300 2024-06-13T11:26:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.033+0000 7fdc1e6c1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d7ecb3bfc0 con 0x55d7ecb2e5b0 2024-06-13T11:26:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.033+0000 7fdc1e6c1b80 10 client.0 _ll_register_callbacks cb 0x55d7eca1a720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:26:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.033+0000 7fdc11400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecaaae40 0x55d7ecb38a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.033+0000 7fdc10a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb35d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.033+0000 7fdc11400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecaaae40 0x55d7ecb38a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45698/0 (socket says 172.21.15.2:45698) 2024-06-13T11:26:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.033+0000 7fdc11400700 1 -- 172.21.15.2:0/2807569261 learned_addr learned my addr 172.21.15.2:0/2807569261 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.033+0000 7fdc11e00700 1 --2- 172.21.15.2:0/2807569261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecb39300 0x55d7ecb36280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.034+0000 7fdc10a00700 1 -- 172.21.15.2:0/2807569261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecb39300 msgr2=0x55d7ecb36280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.034+0000 7fdc10a00700 1 --2- 172.21.15.2:0/2807569261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecb39300 0x55d7ecb36280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.034+0000 7fdc10a00700 1 -- 172.21.15.2:0/2807569261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecaaae40 msgr2=0x55d7ecb38a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.034+0000 7fdc10a00700 1 --2- 172.21.15.2:0/2807569261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecaaae40 0x55d7ecb38a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.034+0000 7fdc10a00700 1 -- 172.21.15.2:0/2807569261 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7ec9cf8d0 con 0x55d7ecb2e5b0 2024-06-13T11:26:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.034+0000 7fdc11400700 1 --2- 172.21.15.2:0/2807569261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecaaae40 0x55d7ecb38a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.034+0000 7fdc10a00700 1 --2- 172.21.15.2:0/2807569261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb35d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8000c00 tx=0x7fdbf8004340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cff7a1c7d5630b9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.034+0000 7fdbf3400700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:26:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.035+0000 7fdbf3400700 1 -- 172.21.15.2:0/2807569261 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8028060 con 0x55d7ecb2e5b0 2024-06-13T11:26:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.035+0000 7fdbf3400700 1 -- 172.21.15.2:0/2807569261 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fdbf8003c80 con 0x55d7ecb2e5b0 2024-06-13T11:26:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.035+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/2807569261 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbf8015070 con 0x55d7ecb2e5b0 2024-06-13T11:26:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.035+0000 7fdbf3400700 1 -- 172.21.15.2:0/2807569261 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdbf802f050 con 0x55d7ecb2e5b0 2024-06-13T11:26:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.035+0000 7fdc1e6c1b80 10 client.25648 fetch_fsmap learned FSMap version 29 2024-06-13T11:26:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.035+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/2807569261 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d7ecb466b0 con 0x55d7ecb2e5b0 2024-06-13T11:26:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.036+0000 7fdbf3400700 1 -- 172.21.15.2:0/2807569261 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbf8015070 con 0x55d7ecb2e5b0 2024-06-13T11:26:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.036+0000 7fdbf3400700 1 -- 172.21.15.2:0/2807569261 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fdbf801a770 con 0x55d7ecb2e5b0 2024-06-13T11:26:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.036+0000 7fdc1e6c1b80 10 client.25648 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:26:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.036+0000 7fdc1e6c1b80 10 client.25648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:26:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.036+0000 7fdc1e6c1b80 20 client.25648 populate_metadata read hostname 'smithi002' 2024-06-13T11:26:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.036+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/2807569261 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d7ecb48c90 0x55d7ecb4b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.036+0000 7fdc1e6c1b80 4 client.25648 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:26:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.036+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/2807569261 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7eca8e000 con 0x55d7ecb48c90 2024-06-13T11:26:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.036+0000 7fdc11400700 1 --2- 172.21.15.2:0/2807569261 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d7ecb48c90 0x55d7ecb4b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.037+0000 7fdc11400700 1 --2- 172.21.15.2:0/2807569261 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d7ecb48c90 0x55d7ecb4b080 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91be65d70f28d630 server_cookie=24c07c591f4625b9 in_seq=0 out_seq=0 2024-06-13T11:26:35.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.037+0000 7fdbf3400700 10 client.25648 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:35.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.038+0000 7fdbf3400700 1 -- 172.21.15.2:0/2807569261 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d7eca8e000 con 0x55d7ecb48c90 2024-06-13T11:26:35.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.038+0000 7fdbf3400700 10 client.25648 handle_command_reply: tid=0 2024-06-13T11:26:35.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.038+0000 7fdc1e6c1b80 1 client.25648 shutdown 2024-06-13T11:26:35.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.038+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/2807569261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 msgr2=0x55d7ecb35d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:35.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.038+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/2807569261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb35d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8000c00 tx=0x7fdbf8004340 comp rx=0 tx=0).stop 2024-06-13T11:26:35.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.038+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/2807569261 shutdown_connections 2024-06-13T11:26:35.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.038+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/2807569261 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d7ecb48c90 0x55d7ecb4b080 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.038+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/2807569261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecaaae40 0x55d7ecb38a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.038+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/2807569261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecb39300 0x55d7ecb36280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.038+0000 7fdbf3400700 0 client.25648 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:35.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.038+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/2807569261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb35d40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.038+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/2807569261 >> 172.21.15.2:0/2807569261 conn(0x55d7eca5b170 msgr2=0x55d7ecb29740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:35.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.039+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/2807569261 shutdown_connections 2024-06-13T11:26:35.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.039+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/2807569261 wait complete. 2024-06-13T11:26:35.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.039+0000 7fdc1e6c1b80 20 client.25648 trim_cache size 0 max 16384 2024-06-13T11:26:35.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.062+0000 7fdc1e6c1b80 1 Processor -- start 2024-06-13T11:26:35.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.062+0000 7fdc1e6c1b80 1 -- start start 2024-06-13T11:26:35.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.062+0000 7fdc1e6c1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecaaae40 0x55d7ecb295c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.062+0000 7fdc1e6c1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb38580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.062+0000 7fdc1e6c1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecb39300 0x55d7ecb3a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.062+0000 7fdc1e6c1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1b2cc0 con 0x55d7ecb39300 2024-06-13T11:26:35.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.062+0000 7fdc1e6c1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1b0550 con 0x55d7ecaaae40 2024-06-13T11:26:35.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.062+0000 7fdc1e6c1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1ae3a0 con 0x55d7ecb2e5b0 2024-06-13T11:26:35.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.062+0000 7fdc10a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb38580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.062+0000 7fdc11400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecaaae40 0x55d7ecb295c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.063+0000 7fdc11400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecaaae40 0x55d7ecb295c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:57146/0 (socket says 172.21.15.2:57146) 2024-06-13T11:26:35.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.063+0000 7fdc11400700 1 -- 172.21.15.2:0/1570063508 learned_addr learned my addr 172.21.15.2:0/1570063508 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:35.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.063+0000 7fdc10a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb38580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:39632/0 (socket says 172.21.15.2:39632) 2024-06-13T11:26:35.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.063+0000 7fdc11e00700 1 --2- 172.21.15.2:0/1570063508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecb39300 0x55d7ecb3a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.063+0000 7fdc11400700 1 -- 172.21.15.2:0/1570063508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 msgr2=0x55d7ecb38580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:35.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.063+0000 7fdc11400700 1 --2- 172.21.15.2:0/1570063508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb38580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.063+0000 7fdc11400700 1 -- 172.21.15.2:0/1570063508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecb39300 msgr2=0x55d7ecb3a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:35.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.063+0000 7fdc11400700 1 --2- 172.21.15.2:0/1570063508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecb39300 0x55d7ecb3a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.063+0000 7fdc11400700 1 -- 172.21.15.2:0/1570063508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7ecb21e10 con 0x55d7ecaaae40 2024-06-13T11:26:35.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.063+0000 7fdc10a00700 1 --2- 172.21.15.2:0/1570063508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb38580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:35.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.063+0000 7fdc11e00700 1 --2- 172.21.15.2:0/1570063508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecb39300 0x55d7ecb3a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:26:35.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.063+0000 7fdc11400700 1 --2- 172.21.15.2:0/1570063508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecaaae40 0x55d7ecb295c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdc00019bc0 tx=0x7fdc0001d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=698fd03f9b246561 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.064+0000 7fdbfe000700 1 -- 172.21.15.2:0/1570063508 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0001d070 con 0x55d7ecaaae40 2024-06-13T11:26:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.064+0000 7fdbfe000700 1 -- 172.21.15.2:0/1570063508 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc00004bb0 con 0x55d7ecaaae40 2024-06-13T11:26:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.064+0000 7fdbfe000700 1 -- 172.21.15.2:0/1570063508 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00017860 con 0x55d7ecaaae40 2024-06-13T11:26:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.064+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/1570063508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecaaae40 msgr2=0x55d7ecb295c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.064+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/1570063508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecaaae40 0x55d7ecb295c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdc00019bc0 tx=0x7fdc0001d000 comp rx=0 tx=0).stop 2024-06-13T11:26:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.064+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/1570063508 shutdown_connections 2024-06-13T11:26:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.064+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/1570063508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecb39300 0x55d7ecb3a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.064+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/1570063508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecaaae40 0x55d7ecb295c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.064+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/1570063508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb38580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.064+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/1570063508 >> 172.21.15.2:0/1570063508 conn(0x55d7eca5b170 msgr2=0x55d7ecb28eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.065+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/1570063508 shutdown_connections 2024-06-13T11:26:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.065+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/1570063508 wait complete. 2024-06-13T11:26:35.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.065+0000 7fdc1e6c1b80 1 -- start start 2024-06-13T11:26:35.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.065+0000 7fdc1e6c1b80 1 Processor -- start 2024-06-13T11:26:35.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.066+0000 7fdc1e6c1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecaaae40 0x55d7ecb41260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.066+0000 7fdc1e6c1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb417a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.066+0000 7fdc1e6c1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb39300 0x55d7ecb3c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.066+0000 7fdc1e6c1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1aea10 con 0x55d7ecb2e5b0 2024-06-13T11:26:35.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.066+0000 7fdc1e6c1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1afe80 con 0x55d7ecaaae40 2024-06-13T11:26:35.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.066+0000 7fdc1e6c1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c1af0e0 con 0x55d7ecb39300 2024-06-13T11:26:35.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.066+0000 7fdc1e6c1b80 10 client.0 _ll_register_callbacks cb 0x55d7eca1a720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:26:35.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.066+0000 7fdc10a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.066+0000 7fdc11400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecaaae40 0x55d7ecb41260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.066+0000 7fdc11400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecaaae40 0x55d7ecb41260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:57160/0 (socket says 172.21.15.2:57160) 2024-06-13T11:26:35.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.066+0000 7fdc11400700 1 -- 172.21.15.2:0/3059094835 learned_addr learned my addr 172.21.15.2:0/3059094835 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:35.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.066+0000 7fdc11e00700 1 --2- 172.21.15.2:0/3059094835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb39300 0x55d7ecb3c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.067+0000 7fdc11400700 1 -- 172.21.15.2:0/3059094835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb39300 msgr2=0x55d7ecb3c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:35.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.067+0000 7fdc11400700 1 --2- 172.21.15.2:0/3059094835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb39300 0x55d7ecb3c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.067+0000 7fdc11400700 1 -- 172.21.15.2:0/3059094835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecb2e5b0 msgr2=0x55d7ecb417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:35.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.067+0000 7fdc11400700 1 --2- 172.21.15.2:0/3059094835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb417a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.067+0000 7fdc11400700 1 -- 172.21.15.2:0/3059094835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7ecb3c7d0 con 0x55d7ecaaae40 2024-06-13T11:26:35.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.067+0000 7fdc11400700 1 --2- 172.21.15.2:0/3059094835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecaaae40 0x55d7ecb41260 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdc00019ed0 tx=0x7fdc00004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa75a33f188e81e7 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:35.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.067+0000 7fdbf3400700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:26:35.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.067+0000 7fdbf3400700 1 -- 172.21.15.2:0/3059094835 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00039020 con 0x55d7ecaaae40 2024-06-13T11:26:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.067+0000 7fdbf3400700 1 -- 172.21.15.2:0/3059094835 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fdc0002b590 con 0x55d7ecaaae40 2024-06-13T11:26:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.067+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/3059094835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc00004bb0 con 0x55d7ecaaae40 2024-06-13T11:26:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.068+0000 7fdbf3400700 1 -- 172.21.15.2:0/3059094835 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdc0002b790 con 0x55d7ecaaae40 2024-06-13T11:26:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.068+0000 7fdc1e6c1b80 10 client.25619 fetch_fsmap learned FSMap version 29 2024-06-13T11:26:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.068+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/3059094835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d7ecbbc6b0 con 0x55d7ecaaae40 2024-06-13T11:26:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.068+0000 7fdbf3400700 1 -- 172.21.15.2:0/3059094835 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc00004bb0 con 0x55d7ecaaae40 2024-06-13T11:26:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.068+0000 7fdbf3400700 1 -- 172.21.15.2:0/3059094835 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fdc00035450 con 0x55d7ecaaae40 2024-06-13T11:26:35.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.068+0000 7fdc1e6c1b80 10 client.25619 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:26:35.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.068+0000 7fdc1e6c1b80 10 client.25619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:26:35.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.068+0000 7fdc1e6c1b80 20 client.25619 populate_metadata read hostname 'smithi002' 2024-06-13T11:26:35.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.068+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/3059094835 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d7ecbbcde0 0x55d7ecbbf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:35.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.068+0000 7fdc1e6c1b80 4 client.25619 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:26:35.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.068+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/3059094835 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d7eca88580 con 0x55d7ecbbcde0 2024-06-13T11:26:35.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.069+0000 7fdc10a00700 1 --2- 172.21.15.2:0/3059094835 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d7ecbbcde0 0x55d7ecbbf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:35.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.069+0000 7fdc10a00700 1 --2- 172.21.15.2:0/3059094835 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d7ecbbcde0 0x55d7ecbbf200 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bea3a06b56663250 server_cookie=7ad0fa5cf087bc1b in_seq=0 out_seq=0 2024-06-13T11:26:35.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.069+0000 7fdbf3400700 10 client.25619 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:35.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.070+0000 7fdbf3400700 1 -- 172.21.15.2:0/3059094835 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d7eca88580 con 0x55d7ecbbcde0 2024-06-13T11:26:35.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.070+0000 7fdbf3400700 10 client.25619 handle_command_reply: tid=0 2024-06-13T11:26:35.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.070+0000 7fdc1e6c1b80 1 client.25619 shutdown 2024-06-13T11:26:35.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.070+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/3059094835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecaaae40 msgr2=0x55d7ecb41260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:35.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.070+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/3059094835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecaaae40 0x55d7ecb41260 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdc00019ed0 tx=0x7fdc00004b40 comp rx=0 tx=0).stop 2024-06-13T11:26:35.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.070+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/3059094835 shutdown_connections 2024-06-13T11:26:35.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.070+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/3059094835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7ecb39300 0x55d7ecb3c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.070+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/3059094835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d7ecaaae40 0x55d7ecb41260 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.070+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/3059094835 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d7ecbbcde0 0x55d7ecbbf200 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.070+0000 7fdc1e6c1b80 1 --2- 172.21.15.2:0/3059094835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7ecb2e5b0 0x55d7ecb417a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.070+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/3059094835 >> 172.21.15.2:0/3059094835 conn(0x55d7eca5b170 msgr2=0x55d7ecb29740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.070+0000 7fdbf3400700 0 client.25619 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.070+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/3059094835 shutdown_connections 2024-06-13T11:26:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.070+0000 7fdc1e6c1b80 1 -- 172.21.15.2:0/3059094835 wait complete. 2024-06-13T11:26:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.070+0000 7fdc1e6c1b80 20 client.25619 trim_cache size 0 max 16384 2024-06-13T11:26:35.078 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:26:35.078 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-06-13T11:26:35.078 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-06-13T11:26:35.078 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:26:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.071+0000 7fdc13e00700 1 -- 172.21.15.2:0/1218420230 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdbf40a2d90 msgr2=0x7fdbf40a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.071+0000 7fdc13e00700 1 --2- 172.21.15.2:0/1218420230 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdbf40a2d90 0x7fdbf40a5250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009c10 tx=0x7fdc00009920 comp rx=0 tx=0).stop 2024-06-13T11:26:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.071+0000 7fdc13e00700 1 -- 172.21.15.2:0/1218420230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc0c10a6b0 msgr2=0x7fdc0c19f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.071+0000 7fdc13e00700 1 --2- 172.21.15.2:0/1218420230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc0c10a6b0 0x7fdc0c19f640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdc040098e0 tx=0x7fdc0400bab0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.071+0000 7fdc13e00700 1 -- 172.21.15.2:0/1218420230 shutdown_connections 2024-06-13T11:26:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.071+0000 7fdc13e00700 1 --2- 172.21.15.2:0/1218420230 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdbf40a2d90 0x7fdbf40a5250 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.071+0000 7fdc13e00700 1 --2- 172.21.15.2:0/1218420230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc0c1046b0 0x7fdc0c19ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.071+0000 7fdc13e00700 1 --2- 172.21.15.2:0/1218420230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc0c10a6b0 0x7fdc0c19f640 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.071+0000 7fdc13e00700 1 --2- 172.21.15.2:0/1218420230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc0c105070 0x7fdc0c19b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.071+0000 7fdc13e00700 1 -- 172.21.15.2:0/1218420230 >> 172.21.15.2:0/1218420230 conn(0x7fdc0c1001a0 msgr2=0x7fdc0c100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.071+0000 7fdc13e00700 1 -- 172.21.15.2:0/1218420230 shutdown_connections 2024-06-13T11:26:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:35.071+0000 7fdc13e00700 1 -- 172.21.15.2:0/1218420230 wait complete. 2024-06-13T11:26:35.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:35 smithi002 ceph-mon[32210]: pgmap v87: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 212 KiB/s wr, 18 op/s 2024-06-13T11:26:35.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:35 smithi178 ceph-mon[36913]: pgmap v87: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 212 KiB/s wr, 18 op/s 2024-06-13T11:26:36.039 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-13T11:26:36.039 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:26:36.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:35 smithi077 ceph-mon[36410]: pgmap v87: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 212 KiB/s wr, 18 op/s 2024-06-13T11:26:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:26:37.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:37 smithi002 ceph-mon[32210]: pgmap v88: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 212 KiB/s wr, 18 op/s 2024-06-13T11:26:37.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:37 smithi178 ceph-mon[36913]: pgmap v88: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 212 KiB/s wr, 18 op/s 2024-06-13T11:26:38.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:37 smithi077 ceph-mon[36410]: pgmap v88: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 212 KiB/s wr, 18 op/s 2024-06-13T11:26:38.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.803+0000 7ff1aa400700 1 -- 172.21.15.2:0/4206789357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1a406ab30 msgr2=0x7ff1a410f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:38.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.803+0000 7ff1aa400700 1 --2- 172.21.15.2:0/4206789357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1a406ab30 0x7ff1a410f320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff19c009f90 tx=0x7ff19c00b330 comp rx=0 tx=0).stop 2024-06-13T11:26:38.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.803+0000 7ff1aa400700 1 -- 172.21.15.2:0/4206789357 shutdown_connections 2024-06-13T11:26:38.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.803+0000 7ff1aa400700 1 --2- 172.21.15.2:0/4206789357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1a406ab30 0x7ff1a410f320 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:38.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.803+0000 7ff1aa400700 1 --2- 172.21.15.2:0/4206789357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1a4108500 0x7ff1a41088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:38.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.803+0000 7ff1aa400700 1 --2- 172.21.15.2:0/4206789357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a406a170 0x7ff1a406a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:38.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.803+0000 7ff1aa400700 1 -- 172.21.15.2:0/4206789357 >> 172.21.15.2:0/4206789357 conn(0x7ff1a4078340 msgr2=0x7ff1a4078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:38.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.804+0000 7ff1aa400700 1 -- 172.21.15.2:0/4206789357 shutdown_connections 2024-06-13T11:26:38.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.804+0000 7ff1aa400700 1 -- 172.21.15.2:0/4206789357 wait complete. 2024-06-13T11:26:38.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.805+0000 7ff1aa400700 1 Processor -- start 2024-06-13T11:26:38.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.805+0000 7ff1aa400700 1 -- start start 2024-06-13T11:26:38.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff1aa400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a406a170 0x7ff1a419adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:38.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff1aa400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1a406ab30 0x7ff1a419b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:38.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff1aa400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1a4108500 0x7ff1a419f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:38.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff1aa400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a41127b0 con 0x7ff1a406ab30 2024-06-13T11:26:38.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff1aa400700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a4112630 con 0x7ff1a406a170 2024-06-13T11:26:38.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff1aa400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a4112930 con 0x7ff1a4108500 2024-06-13T11:26:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff1a3400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a406a170 0x7ff1a419adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff1a3400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a406a170 0x7ff1a419adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:60966/0 (socket says 172.21.15.2:60966) 2024-06-13T11:26:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff1a3400700 1 -- 172.21.15.2:0/2440884119 learned_addr learned my addr 172.21.15.2:0/2440884119 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff1a3e00700 1 --2- 172.21.15.2:0/2440884119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1a4108500 0x7ff1a419f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff19aa00700 1 --2- 172.21.15.2:0/2440884119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1a406ab30 0x7ff1a419b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff1a3400700 1 -- 172.21.15.2:0/2440884119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1a4108500 msgr2=0x7ff1a419f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff1a3400700 1 --2- 172.21.15.2:0/2440884119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1a4108500 0x7ff1a419f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff1a3400700 1 -- 172.21.15.2:0/2440884119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1a406ab30 msgr2=0x7ff1a419b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:38.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff1a3400700 1 --2- 172.21.15.2:0/2440884119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1a406ab30 0x7ff1a419b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:38.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff1a3400700 1 -- 172.21.15.2:0/2440884119 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a419fe00 con 0x7ff1a406a170 2024-06-13T11:26:38.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.806+0000 7ff19aa00700 1 --2- 172.21.15.2:0/2440884119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1a406ab30 0x7ff1a419b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:26:38.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.807+0000 7ff1a3400700 1 --2- 172.21.15.2:0/2440884119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a406a170 0x7ff1a419adf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff19400e9c0 tx=0x7ff19400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:38.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.807+0000 7ff1a0c00700 1 -- 172.21.15.2:0/2440884119 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19400cbd0 con 0x7ff1a406a170 2024-06-13T11:26:38.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.807+0000 7ff1a0c00700 1 -- 172.21.15.2:0/2440884119 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff19400cd70 con 0x7ff1a406a170 2024-06-13T11:26:38.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.807+0000 7ff1a0c00700 1 -- 172.21.15.2:0/2440884119 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff194005660 con 0x7ff1a406a170 2024-06-13T11:26:38.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.807+0000 7ff1aa400700 1 -- 172.21.15.2:0/2440884119 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a41a00f0 con 0x7ff1a406a170 2024-06-13T11:26:38.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.807+0000 7ff1aa400700 1 -- 172.21.15.2:0/2440884119 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a41a7970 con 0x7ff1a406a170 2024-06-13T11:26:38.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.808+0000 7ff1aa400700 1 -- 172.21.15.2:0/2440884119 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a4069180 con 0x7ff1a406a170 2024-06-13T11:26:38.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.810+0000 7ff1a0c00700 1 -- 172.21.15.2:0/2440884119 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7ff194004750 con 0x7ff1a406a170 2024-06-13T11:26:38.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.812+0000 7ff1a0c00700 1 --2- 172.21.15.2:0/2440884119 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff1880a2e10 0x7ff1880a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:38.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.812+0000 7ff1a0c00700 1 -- 172.21.15.2:0/2440884119 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7ff1940cf890 con 0x7ff1a406a170 2024-06-13T11:26:38.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.812+0000 7ff19aa00700 1 --2- 172.21.15.2:0/2440884119 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff1880a2e10 0x7ff1880a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:38.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.813+0000 7ff19aa00700 1 --2- 172.21.15.2:0/2440884119 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff1880a2e10 0x7ff1880a52d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff1a41033f0 tx=0x7ff18c009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:38.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:38.816+0000 7ff1a0c00700 1 -- 172.21.15.2:0/2440884119 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff19409c0e0 con 0x7ff1a406a170 2024-06-13T11:26:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:39.099+0000 7ff1aa400700 1 -- 172.21.15.2:0/2440884119 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1a419c150 con 0x7ff1a406a170 2024-06-13T11:26:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:39.100+0000 7ff1a0c00700 1 -- 172.21.15.2:0/2440884119 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11856 (secure 0 0 0) 0x7ff19409b9e0 con 0x7ff1a406a170 2024-06-13T11:26:39.100 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:26:39.100 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:25:36.301244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24509,24511,24493]},"id":1}]} 2024-06-13T11:26:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:39.103+0000 7ff1aa400700 1 -- 172.21.15.2:0/2440884119 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff1880a2e10 msgr2=0x7ff1880a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:39.103+0000 7ff1aa400700 1 --2- 172.21.15.2:0/2440884119 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff1880a2e10 0x7ff1880a52d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff1a41033f0 tx=0x7ff18c009260 comp rx=0 tx=0).stop 2024-06-13T11:26:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:39.103+0000 7ff1aa400700 1 -- 172.21.15.2:0/2440884119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a406a170 msgr2=0x7ff1a419adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:39.103+0000 7ff1aa400700 1 --2- 172.21.15.2:0/2440884119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a406a170 0x7ff1a419adf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff19400e9c0 tx=0x7ff19400ecd0 comp rx=0 tx=0).stop 2024-06-13T11:26:39.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:39.103+0000 7ff1aa400700 1 -- 172.21.15.2:0/2440884119 shutdown_connections 2024-06-13T11:26:39.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:39.103+0000 7ff1aa400700 1 --2- 172.21.15.2:0/2440884119 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff1880a2e10 0x7ff1880a52d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:39.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:39.103+0000 7ff1aa400700 1 --2- 172.21.15.2:0/2440884119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1a4108500 0x7ff1a419f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:39.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:39.103+0000 7ff1aa400700 1 --2- 172.21.15.2:0/2440884119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a406a170 0x7ff1a419adf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:39.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:39.103+0000 7ff1aa400700 1 --2- 172.21.15.2:0/2440884119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1a406ab30 0x7ff1a419b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:39.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:39.103+0000 7ff1aa400700 1 -- 172.21.15.2:0/2440884119 >> 172.21.15.2:0/2440884119 conn(0x7ff1a4078340 msgr2=0x7ff1a40ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:39.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:39.104+0000 7ff1aa400700 1 -- 172.21.15.2:0/2440884119 shutdown_connections 2024-06-13T11:26:39.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:39.104+0000 7ff1aa400700 1 -- 172.21.15.2:0/2440884119 wait complete. 2024-06-13T11:26:39.104 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 29 2024-06-13T11:26:40.024 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:39 smithi002 ceph-mon[32210]: pgmap v89: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 222 KiB/s wr, 22 op/s 2024-06-13T11:26:40.024 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:39 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2440884119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:26:40.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:39 smithi077 ceph-mon[36410]: pgmap v89: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 222 KiB/s wr, 22 op/s 2024-06-13T11:26:40.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:39 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2440884119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:26:40.109 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-13T11:26:40.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:39 smithi178 ceph-mon[36913]: pgmap v89: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 222 KiB/s wr, 22 op/s 2024-06-13T11:26:40.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:39 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2440884119' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:26:40.583 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:26:41.998 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:41 smithi178 ceph-mon[36913]: pgmap v90: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 220 KiB/s wr, 19 op/s 2024-06-13T11:26:42.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:41 smithi077 ceph-mon[36410]: pgmap v90: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 220 KiB/s wr, 19 op/s 2024-06-13T11:26:42.141 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:41 smithi002 ceph-mon[32210]: pgmap v90: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 220 KiB/s wr, 19 op/s 2024-06-13T11:26:43.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.024+0000 7f4a3f600700 1 -- 172.21.15.2:0/2011490919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a38107840 msgr2=0x7f4a3810f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:43.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.024+0000 7f4a3f600700 1 --2- 172.21.15.2:0/2011490919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a38107840 0x7f4a3810f3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4a3000b0d0 tx=0x7f4a3000b3e0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.024+0000 7f4a3f600700 1 -- 172.21.15.2:0/2011490919 shutdown_connections 2024-06-13T11:26:43.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.024+0000 7f4a3f600700 1 --2- 172.21.15.2:0/2011490919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38102740 0x7f4a38102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.024+0000 7f4a3f600700 1 --2- 172.21.15.2:0/2011490919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a38107840 0x7f4a3810f3c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.024+0000 7f4a3f600700 1 --2- 172.21.15.2:0/2011490919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a381030f0 0x7f4a38107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.024+0000 7f4a3f600700 1 -- 172.21.15.2:0/2011490919 >> 172.21.15.2:0/2011490919 conn(0x7f4a380795f0 msgr2=0x7f4a38079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:43.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.024+0000 7f4a3f600700 1 -- 172.21.15.2:0/2011490919 shutdown_connections 2024-06-13T11:26:43.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.024+0000 7f4a3f600700 1 -- 172.21.15.2:0/2011490919 wait complete. 2024-06-13T11:26:43.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.025+0000 7f4a3f600700 1 Processor -- start 2024-06-13T11:26:43.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.026+0000 7f4a3f600700 1 -- start start 2024-06-13T11:26:43.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.026+0000 7f4a3f600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38102740 0x7f4a3819ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.026+0000 7f4a3f600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a381030f0 0x7f4a3819b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.026+0000 7f4a3f600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a38107840 0x7f4a3819f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.026+0000 7f4a3f600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4a381127b0 con 0x7f4a38102740 2024-06-13T11:26:43.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.026+0000 7f4a3f600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4a38112630 con 0x7f4a381030f0 2024-06-13T11:26:43.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.026+0000 7f4a3f600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4a38112930 con 0x7f4a38107840 2024-06-13T11:26:43.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.027+0000 7f4a3cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38102740 0x7f4a3819ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.027+0000 7f4a3cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38102740 0x7f4a3819ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59102/0 (socket says 172.21.15.2:59102) 2024-06-13T11:26:43.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.027+0000 7f4a3cc00700 1 -- 172.21.15.2:0/3600390603 learned_addr learned my addr 172.21.15.2:0/3600390603 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:43.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.027+0000 7f4a37e00700 1 --2- 172.21.15.2:0/3600390603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a381030f0 0x7f4a3819b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.027+0000 7f4a3d600700 1 --2- 172.21.15.2:0/3600390603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a38107840 0x7f4a3819f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.027+0000 7f4a3cc00700 1 -- 172.21.15.2:0/3600390603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a38107840 msgr2=0x7f4a3819f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:43.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.027+0000 7f4a3cc00700 1 --2- 172.21.15.2:0/3600390603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a38107840 0x7f4a3819f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.027+0000 7f4a3cc00700 1 -- 172.21.15.2:0/3600390603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a381030f0 msgr2=0x7f4a3819b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:43.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.027+0000 7f4a3cc00700 1 --2- 172.21.15.2:0/3600390603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a381030f0 0x7f4a3819b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.027+0000 7f4a3cc00700 1 -- 172.21.15.2:0/3600390603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3819fd90 con 0x7f4a38102740 2024-06-13T11:26:43.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.028+0000 7f4a3cc00700 1 --2- 172.21.15.2:0/3600390603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38102740 0x7f4a3819ad80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00e9a0 tx=0x7f4a2c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:43.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.028+0000 7f4a35600700 1 -- 172.21.15.2:0/3600390603 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c00ca10 con 0x7f4a38102740 2024-06-13T11:26:43.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.028+0000 7f4a35600700 1 -- 172.21.15.2:0/3600390603 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a2c00cbb0 con 0x7f4a38102740 2024-06-13T11:26:43.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.028+0000 7f4a35600700 1 -- 172.21.15.2:0/3600390603 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c018680 con 0x7f4a38102740 2024-06-13T11:26:43.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.028+0000 7f4a3f600700 1 -- 172.21.15.2:0/3600390603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a381a0080 con 0x7f4a38102740 2024-06-13T11:26:43.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.028+0000 7f4a3f600700 1 -- 172.21.15.2:0/3600390603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a381a7900 con 0x7f4a38102740 2024-06-13T11:26:43.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.032+0000 7f4a35600700 1 -- 172.21.15.2:0/3600390603 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f4a2c010430 con 0x7f4a38102740 2024-06-13T11:26:43.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.033+0000 7f4a49fbbb80 1 Processor -- start 2024-06-13T11:26:43.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.034+0000 7f4a49fbbb80 1 -- start start 2024-06-13T11:26:43.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.034+0000 7f4a35600700 1 --2- 172.21.15.2:0/3600390603 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4a200a2d90 0x7f4a200a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.034+0000 7f4a49fbbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3e4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.034+0000 7f4a49fbbb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3ded00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.034+0000 7f4a49fbbb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3df240 0x55ed9f3df680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.034+0000 7f4a49fbbb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ed9f2eda10 con 0x55ed9f3df240 2024-06-13T11:26:43.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.034+0000 7f4a35600700 1 -- 172.21.15.2:0/3600390603 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f4a2c0cfa60 con 0x7f4a38102740 2024-06-13T11:26:43.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.034+0000 7f4a49fbbb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ed9f330b00 con 0x55ed9f3e54b0 2024-06-13T11:26:43.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.034+0000 7f4a49fbbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55ed9f2eb8f0 con 0x55ed9f3e4b90 2024-06-13T11:26:43.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.034+0000 7f4a3d600700 1 --2- 172.21.15.2:0/3600390603 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4a200a2d90 0x7f4a200a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.035+0000 7f4a37e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3ded00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.035+0000 7f4a3cc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3e4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.035+0000 7f4a3cc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3e4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:39176/0 (socket says 172.21.15.2:39176) 2024-06-13T11:26:43.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.035+0000 7f4a3cc00700 1 -- 172.21.15.2:0/3825596027 learned_addr learned my addr 172.21.15.2:0/3825596027 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:43.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.035+0000 7f4a37e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3ded00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:32776/0 (socket says 172.21.15.2:32776) 2024-06-13T11:26:43.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.035+0000 7f4a3d600700 1 --2- 172.21.15.2:0/3825596027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3df240 0x55ed9f3df680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.035+0000 7f4a37e00700 1 -- 172.21.15.2:0/3825596027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e4b90 msgr2=0x55ed9f3e4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:43.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.035+0000 7f4a37e00700 1 --2- 172.21.15.2:0/3825596027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3e4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.035+0000 7f4a37e00700 1 -- 172.21.15.2:0/3825596027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3df240 msgr2=0x55ed9f3df680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:43.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.035+0000 7f4a37e00700 1 --2- 172.21.15.2:0/3825596027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3df240 0x55ed9f3df680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.035+0000 7f4a37e00700 1 -- 172.21.15.2:0/3825596027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed9f2d8f90 con 0x55ed9f3e54b0 2024-06-13T11:26:43.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.036+0000 7f4a37e00700 1 --2- 172.21.15.2:0/3825596027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3ded00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009c80 tx=0x7f4a28009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8013831481b9b058 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:43.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.036+0000 7f4a3d600700 1 --2- 172.21.15.2:0/3600390603 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4a200a2d90 0x7f4a200a5250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009610 tx=0x7f4a30009320 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:43.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.036+0000 7f4a26000700 1 -- 172.21.15.2:0/3825596027 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2801e070 con 0x55ed9f3e54b0 2024-06-13T11:26:43.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.036+0000 7f4a26000700 1 -- 172.21.15.2:0/3825596027 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a28011cb0 con 0x55ed9f3e54b0 2024-06-13T11:26:43.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.036+0000 7f4a26000700 1 -- 172.21.15.2:0/3825596027 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800e710 con 0x55ed9f3e54b0 2024-06-13T11:26:43.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.037+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/3825596027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3e54b0 msgr2=0x55ed9f3ded00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:43.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.037+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/3825596027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3ded00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009c80 tx=0x7f4a28009f90 comp rx=0 tx=0).stop 2024-06-13T11:26:43.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.037+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/3825596027 shutdown_connections 2024-06-13T11:26:43.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.037+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/3825596027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3df240 0x55ed9f3df680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.037+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/3825596027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3e4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.037+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/3825596027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3ded00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.037+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/3825596027 >> 172.21.15.2:0/3825596027 conn(0x55ed9f30b170 msgr2=0x55ed9f3d9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.037+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/3825596027 shutdown_connections 2024-06-13T11:26:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.037+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/3825596027 wait complete. 2024-06-13T11:26:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.037+0000 7f4a49fbbb80 1 -- start start 2024-06-13T11:26:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.038+0000 7f4a49fbbb80 1 Processor -- start 2024-06-13T11:26:43.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.038+0000 7f4a49fbbb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3df240 0x55ed9f3eb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.038+0000 7f4a49fbbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3e8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.038+0000 7f4a49fbbb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3e8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.038+0000 7f4a49fbbb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ed9f2ccf60 con 0x55ed9f3df240 2024-06-13T11:26:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.038+0000 7f4a49fbbb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ed9f32cac0 con 0x55ed9f3e54b0 2024-06-13T11:26:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.038+0000 7f4a49fbbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55ed9f3ebe90 con 0x55ed9f3e4b90 2024-06-13T11:26:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.038+0000 7f4a49fbbb80 10 client.0 _ll_register_callbacks cb 0x55ed9f2c6380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:26:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.039+0000 7f4a3cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3df240 0x55ed9f3eb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.039+0000 7f4a37e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3e8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.039+0000 7f4a3cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3df240 0x55ed9f3eb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59112/0 (socket says 172.21.15.2:59112) 2024-06-13T11:26:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.039+0000 7f4a3cc00700 1 -- 172.21.15.2:0/2494213402 learned_addr learned my addr 172.21.15.2:0/2494213402 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:43.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.039+0000 7f4a3d600700 1 --2- 172.21.15.2:0/2494213402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3e8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.039+0000 7f4a3cc00700 1 -- 172.21.15.2:0/2494213402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e4b90 msgr2=0x55ed9f3e8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:43.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.039+0000 7f4a3cc00700 1 --2- 172.21.15.2:0/2494213402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3e8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.039+0000 7f4a3cc00700 1 -- 172.21.15.2:0/2494213402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3e54b0 msgr2=0x55ed9f3e8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:43.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.039+0000 7f4a3cc00700 1 --2- 172.21.15.2:0/2494213402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3e8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.039+0000 7f4a3cc00700 1 -- 172.21.15.2:0/2494213402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed9f27f8d0 con 0x55ed9f3df240 2024-06-13T11:26:43.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.039+0000 7f4a3cc00700 1 --2- 172.21.15.2:0/2494213402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3df240 0x55ed9f3eb200 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c000c00 tx=0x7f4a2c09c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d47204b9c8169 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:43.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.039+0000 7f4a1aa00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:26:43.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.040+0000 7f4a1aa00700 1 -- 172.21.15.2:0/2494213402 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c09ff60 con 0x55ed9f3df240 2024-06-13T11:26:43.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.040+0000 7f4a1aa00700 1 -- 172.21.15.2:0/2494213402 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f4a2c0a4390 con 0x55ed9f3df240 2024-06-13T11:26:43.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.040+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/2494213402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a28011cb0 con 0x55ed9f3df240 2024-06-13T11:26:43.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.040+0000 7f4a1aa00700 1 -- 172.21.15.2:0/2494213402 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4a2c0a4820 con 0x55ed9f3df240 2024-06-13T11:26:43.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.040+0000 7f4a49fbbb80 10 client.15525 fetch_fsmap learned FSMap version 29 2024-06-13T11:26:43.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.040+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/2494213402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ed9f3f6650 con 0x55ed9f3df240 2024-06-13T11:26:43.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.040+0000 7f4a1aa00700 1 -- 172.21.15.2:0/2494213402 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a28011cb0 con 0x55ed9f3df240 2024-06-13T11:26:43.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.040+0000 7f4a1aa00700 1 -- 172.21.15.2:0/2494213402 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4a2c09b120 con 0x55ed9f3df240 2024-06-13T11:26:43.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.041+0000 7f4a49fbbb80 10 client.15525 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:26:43.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.041+0000 7f4a49fbbb80 10 client.15525 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:26:43.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.041+0000 7f4a49fbbb80 20 client.15525 populate_metadata read hostname 'smithi002' 2024-06-13T11:26:43.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.041+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/2494213402 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55ed9f3f8be0 0x55ed9f3fb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.041+0000 7f4a49fbbb80 4 client.15525 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:26:43.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.041+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/2494213402 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed9f33e000 con 0x55ed9f3f8be0 2024-06-13T11:26:43.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.041+0000 7f4a37e00700 1 --2- 172.21.15.2:0/2494213402 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55ed9f3f8be0 0x55ed9f3fb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.042+0000 7f4a37e00700 1 --2- 172.21.15.2:0/2494213402 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55ed9f3f8be0 0x55ed9f3fb020 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2e6232cba8618433 server_cookie=548edc8f8c2a8d50 in_seq=0 out_seq=0 2024-06-13T11:26:43.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.042+0000 7f4a1aa00700 10 client.15525 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:26:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.043+0000 7f4a1aa00700 1 -- 172.21.15.2:0/2494213402 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ed9f33e000 con 0x55ed9f3f8be0 2024-06-13T11:26:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.043+0000 7f4a1aa00700 10 client.15525 handle_command_reply: tid=0 2024-06-13T11:26:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.043+0000 7f4a49fbbb80 1 client.15525 shutdown 2024-06-13T11:26:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.043+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/2494213402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3df240 msgr2=0x55ed9f3eb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.043+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/2494213402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3df240 0x55ed9f3eb200 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c000c00 tx=0x7f4a2c09c380 comp rx=0 tx=0).stop 2024-06-13T11:26:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.043+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/2494213402 shutdown_connections 2024-06-13T11:26:43.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.043+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/2494213402 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55ed9f3f8be0 0x55ed9f3fb020 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.043+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/2494213402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3df240 0x55ed9f3eb200 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.043+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/2494213402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3e8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.043+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/2494213402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3e8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.043+0000 7f4a1aa00700 0 client.15525 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:26:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.043+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/2494213402 >> 172.21.15.2:0/2494213402 conn(0x55ed9f30b170 msgr2=0x55ed9f3d3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.044+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/2494213402 shutdown_connections 2024-06-13T11:26:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.044+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/2494213402 wait complete. 2024-06-13T11:26:43.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.044+0000 7f4a49fbbb80 20 client.15525 trim_cache size 0 max 16384 2024-06-13T11:26:43.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.061+0000 7f4a49fbbb80 1 Processor -- start 2024-06-13T11:26:43.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.061+0000 7f4a49fbbb80 1 -- start start 2024-06-13T11:26:43.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.061+0000 7f4a49fbbb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3df240 0x55ed9f3ded00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.061+0000 7f4a49fbbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3fafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.061+0000 7f4a49fbbb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.061+0000 7f4a49fbbb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4a381b3000 con 0x55ed9f3e54b0 2024-06-13T11:26:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.061+0000 7f4a49fbbb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4a381b0890 con 0x55ed9f3df240 2024-06-13T11:26:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.061+0000 7f4a49fbbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4a381ae6e0 con 0x55ed9f3e4b90 2024-06-13T11:26:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.062+0000 7f4a3d600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.062+0000 7f4a3d600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59126/0 (socket says 172.21.15.2:59126) 2024-06-13T11:26:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.062+0000 7f4a3d600700 1 -- 172.21.15.2:0/3619211556 learned_addr learned my addr 172.21.15.2:0/3619211556 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.062+0000 7f4a3cc00700 1 --2- 172.21.15.2:0/3619211556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3df240 0x55ed9f3ded00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.062+0000 7f4a37e00700 1 --2- 172.21.15.2:0/3619211556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3fafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.062+0000 7f4a3d600700 1 -- 172.21.15.2:0/3619211556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e4b90 msgr2=0x55ed9f3fafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.062+0000 7f4a3d600700 1 --2- 172.21.15.2:0/3619211556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3fafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.062+0000 7f4a3d600700 1 -- 172.21.15.2:0/3619211556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3df240 msgr2=0x55ed9f3ded00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.062+0000 7f4a3d600700 1 --2- 172.21.15.2:0/3619211556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3df240 0x55ed9f3ded00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.062+0000 7f4a3d600700 1 -- 172.21.15.2:0/3619211556 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed9f3e82d0 con 0x55ed9f3e54b0 2024-06-13T11:26:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.062+0000 7f4a3cc00700 1 --2- 172.21.15.2:0/3619211556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3df240 0x55ed9f3ded00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.063+0000 7f4a3d600700 1 --2- 172.21.15.2:0/3619211556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3d4130 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009e30 tx=0x7f4a30029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a934d7c0f3c3d59 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.063+0000 7f4a25600700 1 -- 172.21.15.2:0/3619211556 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30031070 con 0x55ed9f3e54b0 2024-06-13T11:26:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.063+0000 7f4a25600700 1 -- 172.21.15.2:0/3619211556 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a30007de0 con 0x55ed9f3e54b0 2024-06-13T11:26:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.063+0000 7f4a25600700 1 -- 172.21.15.2:0/3619211556 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30021be0 con 0x55ed9f3e54b0 2024-06-13T11:26:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.064+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/3619211556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3e54b0 msgr2=0x55ed9f3d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.064+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/3619211556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3d4130 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009e30 tx=0x7f4a30029000 comp rx=0 tx=0).stop 2024-06-13T11:26:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.064+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/3619211556 shutdown_connections 2024-06-13T11:26:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.064+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/3619211556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3d4130 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.064+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/3619211556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3df240 0x55ed9f3ded00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.064+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/3619211556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3fafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.064+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/3619211556 >> 172.21.15.2:0/3619211556 conn(0x55ed9f30b170 msgr2=0x55ed9f3e5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.064+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/3619211556 shutdown_connections 2024-06-13T11:26:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.064+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/3619211556 wait complete. 2024-06-13T11:26:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.064+0000 7f4a49fbbb80 1 -- start start 2024-06-13T11:26:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.065+0000 7f4a49fbbb80 1 Processor -- start 2024-06-13T11:26:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.065+0000 7f4a49fbbb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3df240 0x55ed9f3f1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.065+0000 7f4a49fbbb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3f1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.065+0000 7f4a49fbbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3ff9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.065+0000 7f4a49fbbb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4a381aed50 con 0x55ed9f3e4b90 2024-06-13T11:26:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.065+0000 7f4a49fbbb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4a381b01c0 con 0x55ed9f3df240 2024-06-13T11:26:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.065+0000 7f4a49fbbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4a381af420 con 0x55ed9f3e54b0 2024-06-13T11:26:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.065+0000 7f4a49fbbb80 10 client.0 _ll_register_callbacks cb 0x55ed9f2c6380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:26:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.065+0000 7f4a37e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.065+0000 7f4a37e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3f1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59134/0 (socket says 172.21.15.2:59134) 2024-06-13T11:26:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.065+0000 7f4a37e00700 1 -- 172.21.15.2:0/1805918341 learned_addr learned my addr 172.21.15.2:0/1805918341 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.066+0000 7f4a3cc00700 1 --2- 172.21.15.2:0/1805918341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3df240 0x55ed9f3f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.066+0000 7f4a3d600700 1 --2- 172.21.15.2:0/1805918341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3ff9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.066+0000 7f4a37e00700 1 -- 172.21.15.2:0/1805918341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e54b0 msgr2=0x55ed9f3ff9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.066+0000 7f4a37e00700 1 --2- 172.21.15.2:0/1805918341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3ff9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.066+0000 7f4a37e00700 1 -- 172.21.15.2:0/1805918341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3df240 msgr2=0x55ed9f3f1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.066+0000 7f4a37e00700 1 --2- 172.21.15.2:0/1805918341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3df240 0x55ed9f3f1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.066+0000 7f4a37e00700 1 -- 172.21.15.2:0/1805918341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed9f3fff10 con 0x55ed9f3e4b90 2024-06-13T11:26:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.066+0000 7f4a3cc00700 1 --2- 172.21.15.2:0/1805918341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3df240 0x55ed9f3f1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.066+0000 7f4a37e00700 1 --2- 172.21.15.2:0/1805918341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3f1690 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4a2801c040 tx=0x7f4a280094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c545d097bff7204 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.066+0000 7f4a1aa00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:26:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.067+0000 7f4a1aa00700 1 -- 172.21.15.2:0/1805918341 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2801e040 con 0x55ed9f3e4b90 2024-06-13T11:26:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.067+0000 7f4a1aa00700 1 -- 172.21.15.2:0/1805918341 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f4a28005040 con 0x55ed9f3e4b90 2024-06-13T11:26:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.067+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/1805918341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a30007de0 con 0x55ed9f3e4b90 2024-06-13T11:26:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.067+0000 7f4a1aa00700 1 -- 172.21.15.2:0/1805918341 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4a2803d050 con 0x55ed9f3e4b90 2024-06-13T11:26:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.067+0000 7f4a49fbbb80 10 client.15531 fetch_fsmap learned FSMap version 29 2024-06-13T11:26:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.067+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/1805918341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ed9f46b8b0 con 0x55ed9f3e4b90 2024-06-13T11:26:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.067+0000 7f4a1aa00700 1 -- 172.21.15.2:0/1805918341 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a30007de0 con 0x55ed9f3e4b90 2024-06-13T11:26:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.068+0000 7f4a1aa00700 1 -- 172.21.15.2:0/1805918341 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4a28019430 con 0x55ed9f3e4b90 2024-06-13T11:26:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.068+0000 7f4a49fbbb80 10 client.15531 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:26:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.068+0000 7f4a49fbbb80 10 client.15531 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:26:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.068+0000 7f4a49fbbb80 20 client.15531 populate_metadata read hostname 'smithi002' 2024-06-13T11:26:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.068+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/1805918341 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55ed9f46bde0 0x55ed9f46e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.068+0000 7f4a49fbbb80 4 client.15531 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:26:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.068+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/1805918341 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ed9f338580 con 0x55ed9f46bde0 2024-06-13T11:26:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.069+0000 7f4a3cc00700 1 --2- 172.21.15.2:0/1805918341 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55ed9f46bde0 0x55ed9f46e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.070+0000 7f4a3cc00700 1 --2- 172.21.15.2:0/1805918341 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55ed9f46bde0 0x55ed9f46e1d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2f035f9a50e665af server_cookie=9b1e41765240fa69 in_seq=0 out_seq=0 2024-06-13T11:26:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.071+0000 7f4a1aa00700 10 client.15531 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:26:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.071+0000 7f4a1aa00700 1 -- 172.21.15.2:0/1805918341 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ed9f338580 con 0x55ed9f46bde0 2024-06-13T11:26:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.071+0000 7f4a1aa00700 10 client.15531 handle_command_reply: tid=0 2024-06-13T11:26:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.071+0000 7f4a49fbbb80 1 client.15531 shutdown 2024-06-13T11:26:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.071+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/1805918341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3e4b90 msgr2=0x55ed9f3f1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.071+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/1805918341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3f1690 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4a2801c040 tx=0x7f4a280094c0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.071+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/1805918341 shutdown_connections 2024-06-13T11:26:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.071+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/1805918341 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55ed9f46bde0 0x55ed9f46e1d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.071+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/1805918341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed9f3e54b0 0x55ed9f3ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.071+0000 7f4a1aa00700 0 client.15531 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:26:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.071+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/1805918341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed9f3df240 0x55ed9f3f1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.071+0000 7f4a49fbbb80 1 --2- 172.21.15.2:0/1805918341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed9f3e4b90 0x55ed9f3f1690 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.071+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/1805918341 >> 172.21.15.2:0/1805918341 conn(0x55ed9f30b170 msgr2=0x55ed9f3e6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:43.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.071+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/1805918341 shutdown_connections 2024-06-13T11:26:43.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.071+0000 7f4a49fbbb80 1 -- 172.21.15.2:0/1805918341 wait complete. 2024-06-13T11:26:43.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.072+0000 7f4a49fbbb80 20 client.15531 trim_cache size 0 max 16384 2024-06-13T11:26:43.075 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:26:43.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.072+0000 7f4a3f600700 1 -- 172.21.15.2:0/3600390603 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4a200a2d90 msgr2=0x7f4a200a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:43.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.072+0000 7f4a3f600700 1 --2- 172.21.15.2:0/3600390603 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4a200a2d90 0x7f4a200a5250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009610 tx=0x7f4a30009320 comp rx=0 tx=0).stop 2024-06-13T11:26:43.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.072+0000 7f4a3f600700 1 -- 172.21.15.2:0/3600390603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38102740 msgr2=0x7f4a3819ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:43.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.072+0000 7f4a3f600700 1 --2- 172.21.15.2:0/3600390603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38102740 0x7f4a3819ad80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00e9a0 tx=0x7f4a2c00ecb0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.072+0000 7f4a3f600700 1 -- 172.21.15.2:0/3600390603 shutdown_connections 2024-06-13T11:26:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.072+0000 7f4a3f600700 1 --2- 172.21.15.2:0/3600390603 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4a200a2d90 0x7f4a200a5250 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.072+0000 7f4a3f600700 1 --2- 172.21.15.2:0/3600390603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38102740 0x7f4a3819ad80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.072+0000 7f4a3f600700 1 --2- 172.21.15.2:0/3600390603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a38107840 0x7f4a3819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.072+0000 7f4a3f600700 1 --2- 172.21.15.2:0/3600390603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a381030f0 0x7f4a3819b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.072+0000 7f4a3f600700 1 -- 172.21.15.2:0/3600390603 >> 172.21.15.2:0/3600390603 conn(0x7f4a380795f0 msgr2=0x7f4a381006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.073+0000 7f4a3f600700 1 -- 172.21.15.2:0/3600390603 shutdown_connections 2024-06-13T11:26:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:43.073+0000 7f4a3f600700 1 -- 172.21.15.2:0/3600390603 wait complete. 2024-06-13T11:26:43.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:43 smithi002 ceph-mon[32210]: pgmap v91: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 221 KiB/s wr, 22 op/s 2024-06-13T11:26:44.013 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-13T11:26:44.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:43 smithi077 ceph-mon[36410]: pgmap v91: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 221 KiB/s wr, 22 op/s 2024-06-13T11:26:44.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:43 smithi178 ceph-mon[36913]: pgmap v91: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 221 KiB/s wr, 22 op/s 2024-06-13T11:26:44.499 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:26:45.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:45 smithi002 ceph-mon[32210]: pgmap v92: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-06-13T11:26:46.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:45 smithi077 ceph-mon[36410]: pgmap v92: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-06-13T11:26:46.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:45 smithi178 ceph-mon[36913]: pgmap v92: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-06-13T11:26:46.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.800+0000 7f6dbfe00700 1 -- 172.21.15.2:0/2712415765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6db8102540 msgr2=0x7f6db81029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.800+0000 7f6dbfe00700 1 --2- 172.21.15.2:0/2712415765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6db8102540 0x7f6db81029a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009990 tx=0x7f6da4009ca0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.801+0000 7f6dbfe00700 1 -- 172.21.15.2:0/2712415765 shutdown_connections 2024-06-13T11:26:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.801+0000 7f6dbfe00700 1 --2- 172.21.15.2:0/2712415765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db8102ee0 0x7f6db810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.801+0000 7f6dbfe00700 1 --2- 172.21.15.2:0/2712415765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db8107450 0x7f6db8107830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.801+0000 7f6dbfe00700 1 --2- 172.21.15.2:0/2712415765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6db8102540 0x7f6db81029a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.801+0000 7f6dbfe00700 1 -- 172.21.15.2:0/2712415765 >> 172.21.15.2:0/2712415765 conn(0x7f6db80795f0 msgr2=0x7f6db8079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.801+0000 7f6dbfe00700 1 -- 172.21.15.2:0/2712415765 shutdown_connections 2024-06-13T11:26:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.801+0000 7f6dbfe00700 1 -- 172.21.15.2:0/2712415765 wait complete. 2024-06-13T11:26:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.802+0000 7f6dbfe00700 1 Processor -- start 2024-06-13T11:26:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.802+0000 7f6dbfe00700 1 -- start start 2024-06-13T11:26:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.803+0000 7f6dbfe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db8102540 0x7f6db819ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.803+0000 7f6dbfe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6db8102ee0 0x7f6db819b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.803+0000 7f6dbfe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db8107450 0x7f6db819f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.803+0000 7f6dbfe00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6db8112830 con 0x7f6db8102540 2024-06-13T11:26:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.803+0000 7f6dbfe00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81126b0 con 0x7f6db8107450 2024-06-13T11:26:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.803+0000 7f6dbfe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81129b0 con 0x7f6db8102ee0 2024-06-13T11:26:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.803+0000 7f6dbd400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db8102540 0x7f6db819ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.803+0000 7f6dbca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6db8102ee0 0x7f6db819b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.803+0000 7f6dbd400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db8102540 0x7f6db819ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39518/0 (socket says 172.21.15.2:39518) 2024-06-13T11:26:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.803+0000 7f6dbd400700 1 -- 172.21.15.2:0/3137984757 learned_addr learned my addr 172.21.15.2:0/3137984757 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.803+0000 7f6dbde00700 1 --2- 172.21.15.2:0/3137984757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db8107450 0x7f6db819f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.803+0000 7f6dbca00700 1 -- 172.21.15.2:0/3137984757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db8107450 msgr2=0x7f6db819f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.803+0000 7f6dbca00700 1 --2- 172.21.15.2:0/3137984757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db8107450 0x7f6db819f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.803+0000 7f6dbca00700 1 -- 172.21.15.2:0/3137984757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db8102540 msgr2=0x7f6db819ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.803+0000 7f6dbca00700 1 --2- 172.21.15.2:0/3137984757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db8102540 0x7f6db819ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.804+0000 7f6dbca00700 1 -- 172.21.15.2:0/3137984757 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db819fe90 con 0x7f6db8102ee0 2024-06-13T11:26:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.804+0000 7f6dbd400700 1 --2- 172.21.15.2:0/3137984757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db8102540 0x7f6db819ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.804+0000 7f6dbca00700 1 --2- 172.21.15.2:0/3137984757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6db8102ee0 0x7f6db819b3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6da4000c00 tx=0x7f6da400bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.804+0000 7f6db6000700 1 -- 172.21.15.2:0/3137984757 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da4026070 con 0x7f6db8102ee0 2024-06-13T11:26:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.804+0000 7f6dbfe00700 1 -- 172.21.15.2:0/3137984757 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db81a0120 con 0x7f6db8102ee0 2024-06-13T11:26:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.804+0000 7f6db6000700 1 -- 172.21.15.2:0/3137984757 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6da4003d70 con 0x7f6db8102ee0 2024-06-13T11:26:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.804+0000 7f6db6000700 1 -- 172.21.15.2:0/3137984757 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da400fdc0 con 0x7f6db8102ee0 2024-06-13T11:26:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.804+0000 7f6dbfe00700 1 -- 172.21.15.2:0/3137984757 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db81a7a00 con 0x7f6db8102ee0 2024-06-13T11:26:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.807+0000 7f6db6000700 1 -- 172.21.15.2:0/3137984757 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f6da4029070 con 0x7f6db8102ee0 2024-06-13T11:26:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.809+0000 7f6db6000700 1 --2- 172.21.15.2:0/3137984757 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6da00a2d90 0x7f6da00a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.809+0000 7f6dca731b80 1 Processor -- start 2024-06-13T11:26:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.809+0000 7f6db6000700 1 -- 172.21.15.2:0/3137984757 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f6da40d0500 con 0x7f6db8102ee0 2024-06-13T11:26:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.809+0000 7f6dca731b80 1 -- start start 2024-06-13T11:26:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.809+0000 7f6dbd400700 1 --2- 172.21.15.2:0/3137984757 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6da00a2d90 0x7f6da00a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.810+0000 7f6dca731b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d773a0 0x55a2d5d77780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.810+0000 7f6dca731b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d71510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.810+0000 7f6dca731b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d71a50 0x55a2d5d71e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.810+0000 7f6dca731b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a2d5c77a10 con 0x55a2d5d773a0 2024-06-13T11:26:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.810+0000 7f6dca731b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a2d5cbab00 con 0x55a2d5d71a50 2024-06-13T11:26:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.810+0000 7f6dca731b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a2d5c758f0 con 0x55a2d5d77cc0 2024-06-13T11:26:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.810+0000 7f6dbca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d71510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.810+0000 7f6dbca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d71510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49338/0 (socket says 172.21.15.2:49338) 2024-06-13T11:26:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.810+0000 7f6dbca00700 1 -- 172.21.15.2:0/2011060101 learned_addr learned my addr 172.21.15.2:0/2011060101 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.810+0000 7f6dbde00700 1 --2- 172.21.15.2:0/2011060101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d71a50 0x55a2d5d71e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.810+0000 7f6dbd400700 1 --2- 172.21.15.2:0/2011060101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d773a0 0x55a2d5d77780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.810+0000 7f6dbca00700 1 -- 172.21.15.2:0/2011060101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d71a50 msgr2=0x55a2d5d71e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.811+0000 7f6dbca00700 1 --2- 172.21.15.2:0/2011060101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d71a50 0x55a2d5d71e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.811+0000 7f6dbca00700 1 -- 172.21.15.2:0/2011060101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d773a0 msgr2=0x55a2d5d77780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.811+0000 7f6dbca00700 1 --2- 172.21.15.2:0/2011060101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d773a0 0x55a2d5d77780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.811+0000 7f6dbca00700 1 -- 172.21.15.2:0/2011060101 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2d5c62f90 con 0x55a2d5d77cc0 2024-06-13T11:26:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.811+0000 7f6dbd400700 1 --2- 172.21.15.2:0/2011060101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d773a0 0x55a2d5d77780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:26:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.811+0000 7f6dbd400700 1 --2- 172.21.15.2:0/3137984757 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6da00a2d90 0x7f6da00a5250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6dac005950 tx=0x7f6dac0118e0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.811+0000 7f6dbca00700 1 --2- 172.21.15.2:0/2011060101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d71510 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6da40990b0 tx=0x7f6da4009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9a39b6f61d8ceef server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.811+0000 7f6daaa00700 1 -- 172.21.15.2:0/2011060101 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da40870d0 con 0x55a2d5d77cc0 2024-06-13T11:26:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.811+0000 7f6daaa00700 1 -- 172.21.15.2:0/2011060101 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6da40043b0 con 0x55a2d5d77cc0 2024-06-13T11:26:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.811+0000 7f6daaa00700 1 -- 172.21.15.2:0/2011060101 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da400f4f0 con 0x55a2d5d77cc0 2024-06-13T11:26:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.812+0000 7f6dca731b80 1 -- 172.21.15.2:0/2011060101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d77cc0 msgr2=0x55a2d5d71510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.812+0000 7f6dca731b80 1 --2- 172.21.15.2:0/2011060101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d71510 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6da40990b0 tx=0x7f6da4009ca0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.812+0000 7f6dca731b80 1 -- 172.21.15.2:0/2011060101 shutdown_connections 2024-06-13T11:26:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.812+0000 7f6dca731b80 1 --2- 172.21.15.2:0/2011060101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d773a0 0x55a2d5d77780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.812+0000 7f6dca731b80 1 --2- 172.21.15.2:0/2011060101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d71a50 0x55a2d5d71e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.812+0000 7f6dca731b80 1 --2- 172.21.15.2:0/2011060101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d71510 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.812+0000 7f6dca731b80 1 -- 172.21.15.2:0/2011060101 >> 172.21.15.2:0/2011060101 conn(0x55a2d5c95170 msgr2=0x55a2d5d63ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.812+0000 7f6dca731b80 1 -- 172.21.15.2:0/2011060101 shutdown_connections 2024-06-13T11:26:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.812+0000 7f6dca731b80 1 -- 172.21.15.2:0/2011060101 wait complete. 2024-06-13T11:26:46.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.813+0000 7f6dca731b80 1 -- start start 2024-06-13T11:26:46.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.813+0000 7f6dca731b80 1 Processor -- start 2024-06-13T11:26:46.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.814+0000 7f6dca731b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d71a50 0x55a2d5d7d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.814+0000 7f6dca731b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d773a0 0x55a2d5d7ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.814+0000 7f6dca731b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d7b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.814+0000 7f6dca731b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a2d5c56f60 con 0x55a2d5d77cc0 2024-06-13T11:26:46.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.814+0000 7f6dca731b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a2d5cb6ac0 con 0x55a2d5d773a0 2024-06-13T11:26:46.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.814+0000 7f6dca731b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a2d5d7e450 con 0x55a2d5d71a50 2024-06-13T11:26:46.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.814+0000 7f6dca731b80 10 client.0 _ll_register_callbacks cb 0x55a2d5c50380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:26:46.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.814+0000 7f6dbde00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d7b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.814+0000 7f6dbde00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d7b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39542/0 (socket says 172.21.15.2:39542) 2024-06-13T11:26:46.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.814+0000 7f6dbde00700 1 -- 172.21.15.2:0/3047640934 learned_addr learned my addr 172.21.15.2:0/3047640934 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:46.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.814+0000 7f6dbca00700 1 --2- 172.21.15.2:0/3047640934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d773a0 0x55a2d5d7ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.814+0000 7f6dbd400700 1 --2- 172.21.15.2:0/3047640934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d71a50 0x55a2d5d7d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.815+0000 7f6dbde00700 1 -- 172.21.15.2:0/3047640934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d71a50 msgr2=0x55a2d5d7d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.815+0000 7f6dbde00700 1 --2- 172.21.15.2:0/3047640934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d71a50 0x55a2d5d7d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.815+0000 7f6dbde00700 1 -- 172.21.15.2:0/3047640934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d773a0 msgr2=0x55a2d5d7ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.815+0000 7f6dbde00700 1 --2- 172.21.15.2:0/3047640934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d773a0 0x55a2d5d7ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.815+0000 7f6dbde00700 1 -- 172.21.15.2:0/3047640934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2d5c098d0 con 0x55a2d5d77cc0 2024-06-13T11:26:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.815+0000 7f6dbca00700 1 --2- 172.21.15.2:0/3047640934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d773a0 0x55a2d5d7ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.815+0000 7f6dbde00700 1 --2- 172.21.15.2:0/3047640934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d7b290 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6db0011f10 tx=0x7f6db0014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1d6f75308cbd8d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.815+0000 7f6d9f400700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:26:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.815+0000 7f6d9f400700 1 -- 172.21.15.2:0/3047640934 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0004db0 con 0x55a2d5d77cc0 2024-06-13T11:26:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.815+0000 7f6d9f400700 1 -- 172.21.15.2:0/3047640934 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f6db0014ba0 con 0x55a2d5d77cc0 2024-06-13T11:26:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.816+0000 7f6dca731b80 1 -- 172.21.15.2:0/3047640934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6da40043b0 con 0x55a2d5d77cc0 2024-06-13T11:26:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.816+0000 7f6d9f400700 1 -- 172.21.15.2:0/3047640934 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6db0026050 con 0x55a2d5d77cc0 2024-06-13T11:26:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.816+0000 7f6dca731b80 10 client.15543 fetch_fsmap learned FSMap version 29 2024-06-13T11:26:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.816+0000 7f6dca731b80 1 -- 172.21.15.2:0/3047640934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a2d5d88b50 con 0x55a2d5d77cc0 2024-06-13T11:26:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.816+0000 7f6d9f400700 1 -- 172.21.15.2:0/3047640934 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6da40043b0 con 0x55a2d5d77cc0 2024-06-13T11:26:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.816+0000 7f6d9f400700 1 -- 172.21.15.2:0/3047640934 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6db0004420 con 0x55a2d5d77cc0 2024-06-13T11:26:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.816+0000 7f6dca731b80 10 client.15543 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:26:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.816+0000 7f6dca731b80 10 client.15543 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:26:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.817+0000 7f6dca731b80 20 client.15543 populate_metadata read hostname 'smithi002' 2024-06-13T11:26:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.817+0000 7f6dca731b80 1 --2- 172.21.15.2:0/3047640934 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55a2d5d8b1e0 0x55a2d5d8d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.817+0000 7f6dca731b80 4 client.15543 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:26:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.817+0000 7f6dca731b80 1 -- 172.21.15.2:0/3047640934 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2d5cc8000 con 0x55a2d5d8b1e0 2024-06-13T11:26:46.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.817+0000 7f6dbd400700 1 --2- 172.21.15.2:0/3047640934 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55a2d5d8b1e0 0x55a2d5d8d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.818+0000 7f6dbd400700 1 --2- 172.21.15.2:0/3047640934 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55a2d5d8b1e0 0x55a2d5d8d5d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cd5a2d3001340301 server_cookie=d78b0ef4f6dd1f67 in_seq=0 out_seq=0 2024-06-13T11:26:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.818+0000 7f6d9f400700 10 client.15543 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:26:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.819+0000 7f6d9f400700 1 -- 172.21.15.2:0/3047640934 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a2d5cc8000 con 0x55a2d5d8b1e0 2024-06-13T11:26:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.819+0000 7f6d9f400700 10 client.15543 handle_command_reply: tid=0 2024-06-13T11:26:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.819+0000 7f6dca731b80 1 client.15543 shutdown 2024-06-13T11:26:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.819+0000 7f6dca731b80 1 -- 172.21.15.2:0/3047640934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d77cc0 msgr2=0x55a2d5d7b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.819+0000 7f6dca731b80 1 --2- 172.21.15.2:0/3047640934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d7b290 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6db0011f10 tx=0x7f6db0014600 comp rx=0 tx=0).stop 2024-06-13T11:26:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.819+0000 7f6dca731b80 1 -- 172.21.15.2:0/3047640934 shutdown_connections 2024-06-13T11:26:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.819+0000 7f6dca731b80 1 --2- 172.21.15.2:0/3047640934 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55a2d5d8b1e0 0x55a2d5d8d5d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.819+0000 7f6dca731b80 1 --2- 172.21.15.2:0/3047640934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d7b290 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.819+0000 7f6dca731b80 1 --2- 172.21.15.2:0/3047640934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d71a50 0x55a2d5d7d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.819+0000 7f6dca731b80 1 --2- 172.21.15.2:0/3047640934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d773a0 0x55a2d5d7ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.819+0000 7f6dca731b80 1 -- 172.21.15.2:0/3047640934 >> 172.21.15.2:0/3047640934 conn(0x55a2d5c95170 msgr2=0x55a2d5d5d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.819+0000 7f6d9f400700 0 client.15543 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:26:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.819+0000 7f6dca731b80 1 -- 172.21.15.2:0/3047640934 shutdown_connections 2024-06-13T11:26:46.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.819+0000 7f6dca731b80 1 -- 172.21.15.2:0/3047640934 wait complete. 2024-06-13T11:26:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.819+0000 7f6dca731b80 20 client.15543 trim_cache size 0 max 16384 2024-06-13T11:26:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.836+0000 7f6dca731b80 1 Processor -- start 2024-06-13T11:26:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.837+0000 7f6dca731b80 1 -- start start 2024-06-13T11:26:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.837+0000 7f6dca731b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d71a50 0x55a2d5d5e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.837+0000 7f6dca731b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d773a0 0x55a2d5d788d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.837+0000 7f6dca731b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d7a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.837+0000 7f6dca731b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81aea70 con 0x55a2d5d71a50 2024-06-13T11:26:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.837+0000 7f6dca731b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81ac300 con 0x55a2d5d77cc0 2024-06-13T11:26:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.837+0000 7f6dca731b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81aa150 con 0x55a2d5d773a0 2024-06-13T11:26:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.837+0000 7f6dbd400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d71a50 0x55a2d5d5e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.837+0000 7f6dbd400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d71a50 0x55a2d5d5e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39556/0 (socket says 172.21.15.2:39556) 2024-06-13T11:26:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.837+0000 7f6dbd400700 1 -- 172.21.15.2:0/1294988536 learned_addr learned my addr 172.21.15.2:0/1294988536 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.837+0000 7f6dbca00700 1 --2- 172.21.15.2:0/1294988536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d773a0 0x55a2d5d788d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.838+0000 7f6dbde00700 1 --2- 172.21.15.2:0/1294988536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d7a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.838+0000 7f6dbca00700 1 -- 172.21.15.2:0/1294988536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d77cc0 msgr2=0x55a2d5d7a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.838+0000 7f6dbca00700 1 --2- 172.21.15.2:0/1294988536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d7a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.838+0000 7f6dbca00700 1 -- 172.21.15.2:0/1294988536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d71a50 msgr2=0x55a2d5d5e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.838+0000 7f6dbca00700 1 --2- 172.21.15.2:0/1294988536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d71a50 0x55a2d5d5e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.838+0000 7f6dbca00700 1 -- 172.21.15.2:0/1294988536 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2d5d7b680 con 0x55a2d5d773a0 2024-06-13T11:26:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.838+0000 7f6dbca00700 1 --2- 172.21.15.2:0/1294988536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d773a0 0x55a2d5d788d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6da40990b0 tx=0x7f6da4009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24be31ba726d7866 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:46.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.838+0000 7f6daa000700 1 -- 172.21.15.2:0/1294988536 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da40b4070 con 0x55a2d5d773a0 2024-06-13T11:26:46.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.839+0000 7f6daa000700 1 -- 172.21.15.2:0/1294988536 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6da40043b0 con 0x55a2d5d773a0 2024-06-13T11:26:46.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.839+0000 7f6daa000700 1 -- 172.21.15.2:0/1294988536 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da409c6e0 con 0x55a2d5d773a0 2024-06-13T11:26:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.839+0000 7f6dca731b80 1 -- 172.21.15.2:0/1294988536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d773a0 msgr2=0x55a2d5d788d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.839+0000 7f6dca731b80 1 --2- 172.21.15.2:0/1294988536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d773a0 0x55a2d5d788d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6da40990b0 tx=0x7f6da4009310 comp rx=0 tx=0).stop 2024-06-13T11:26:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.839+0000 7f6dca731b80 1 -- 172.21.15.2:0/1294988536 shutdown_connections 2024-06-13T11:26:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.839+0000 7f6dca731b80 1 --2- 172.21.15.2:0/1294988536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d71a50 0x55a2d5d5e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.839+0000 7f6dca731b80 1 --2- 172.21.15.2:0/1294988536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d7a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.839+0000 7f6dca731b80 1 --2- 172.21.15.2:0/1294988536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d773a0 0x55a2d5d788d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.839+0000 7f6dca731b80 1 -- 172.21.15.2:0/1294988536 >> 172.21.15.2:0/1294988536 conn(0x55a2d5c95170 msgr2=0x55a2d5d781c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:46.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.839+0000 7f6dca731b80 1 -- 172.21.15.2:0/1294988536 shutdown_connections 2024-06-13T11:26:46.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.839+0000 7f6dca731b80 1 -- 172.21.15.2:0/1294988536 wait complete. 2024-06-13T11:26:46.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.840+0000 7f6dca731b80 1 -- start start 2024-06-13T11:26:46.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.840+0000 7f6dca731b80 1 Processor -- start 2024-06-13T11:26:46.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dca731b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d71a50 0x55a2d5d836a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dca731b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d773a0 0x55a2d5d83be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dca731b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d92010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dca731b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81aa7c0 con 0x55a2d5d71a50 2024-06-13T11:26:46.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dca731b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81abc30 con 0x55a2d5d77cc0 2024-06-13T11:26:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dca731b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6db81aae90 con 0x55a2d5d773a0 2024-06-13T11:26:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dca731b80 10 client.0 _ll_register_callbacks cb 0x55a2d5c50380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:26:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dbd400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d71a50 0x55a2d5d836a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dbd400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d71a50 0x55a2d5d836a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39566/0 (socket says 172.21.15.2:39566) 2024-06-13T11:26:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dbd400700 1 -- 172.21.15.2:0/3160975116 learned_addr learned my addr 172.21.15.2:0/3160975116 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dbca00700 1 --2- 172.21.15.2:0/3160975116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d773a0 0x55a2d5d83be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dbde00700 1 --2- 172.21.15.2:0/3160975116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d92010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dbd400700 1 -- 172.21.15.2:0/3160975116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d773a0 msgr2=0x55a2d5d83be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:46.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dbd400700 1 --2- 172.21.15.2:0/3160975116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d773a0 0x55a2d5d83be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dbd400700 1 -- 172.21.15.2:0/3160975116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d77cc0 msgr2=0x55a2d5d92010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:46.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dbd400700 1 --2- 172.21.15.2:0/3160975116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d92010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.841+0000 7f6dbd400700 1 -- 172.21.15.2:0/3160975116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2d5d92600 con 0x55a2d5d71a50 2024-06-13T11:26:46.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.842+0000 7f6dbd400700 1 --2- 172.21.15.2:0/3160975116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d71a50 0x55a2d5d836a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00fbd0 tx=0x7f6dac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb11514dcfa27cb server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:46.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.842+0000 7f6d9f400700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:26:46.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.842+0000 7f6d9f400700 1 -- 172.21.15.2:0/3160975116 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac02f030 con 0x55a2d5d71a50 2024-06-13T11:26:46.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.842+0000 7f6d9f400700 1 -- 172.21.15.2:0/3160975116 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f6dac009040 con 0x55a2d5d71a50 2024-06-13T11:26:46.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.842+0000 7f6dca731b80 1 -- 172.21.15.2:0/3160975116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6da40043b0 con 0x55a2d5d71a50 2024-06-13T11:26:46.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.842+0000 7f6d9f400700 1 -- 172.21.15.2:0/3160975116 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6dac039050 con 0x55a2d5d71a50 2024-06-13T11:26:46.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.842+0000 7f6dca731b80 10 client.15549 fetch_fsmap learned FSMap version 29 2024-06-13T11:26:46.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.842+0000 7f6dca731b80 1 -- 172.21.15.2:0/3160975116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a2d5df5790 con 0x55a2d5d71a50 2024-06-13T11:26:46.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.843+0000 7f6d9f400700 1 -- 172.21.15.2:0/3160975116 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6da40043b0 con 0x55a2d5d71a50 2024-06-13T11:26:46.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.843+0000 7f6d9f400700 1 -- 172.21.15.2:0/3160975116 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6dac01dc60 con 0x55a2d5d71a50 2024-06-13T11:26:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.843+0000 7f6dca731b80 10 client.15549 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:26:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.843+0000 7f6dca731b80 10 client.15549 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:26:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.843+0000 7f6dca731b80 20 client.15549 populate_metadata read hostname 'smithi002' 2024-06-13T11:26:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.843+0000 7f6dca731b80 1 --2- 172.21.15.2:0/3160975116 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55a2d5df5ee0 0x55a2d5df82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.843+0000 7f6dca731b80 4 client.15549 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:26:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.843+0000 7f6dca731b80 1 -- 172.21.15.2:0/3160975116 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a2d5cc2580 con 0x55a2d5df5ee0 2024-06-13T11:26:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.843+0000 7f6dbca00700 1 --2- 172.21.15.2:0/3160975116 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55a2d5df5ee0 0x55a2d5df82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.844+0000 7f6dbca00700 1 --2- 172.21.15.2:0/3160975116 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55a2d5df5ee0 0x55a2d5df82d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b71ff810cb3130f2 server_cookie=fa8340ff143719cf in_seq=0 out_seq=0 2024-06-13T11:26:46.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.844+0000 7f6d9f400700 10 client.15549 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:26:46.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.844+0000 7f6d9f400700 1 -- 172.21.15.2:0/3160975116 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a2d5cc2580 con 0x55a2d5df5ee0 2024-06-13T11:26:46.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.844+0000 7f6d9f400700 10 client.15549 handle_command_reply: tid=0 2024-06-13T11:26:46.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.844+0000 7f6dca731b80 1 client.15549 shutdown 2024-06-13T11:26:46.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.844+0000 7f6dca731b80 1 -- 172.21.15.2:0/3160975116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d71a50 msgr2=0x55a2d5d836a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:46.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.844+0000 7f6dca731b80 1 --2- 172.21.15.2:0/3160975116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d71a50 0x55a2d5d836a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00fbd0 tx=0x7f6dac016000 comp rx=0 tx=0).stop 2024-06-13T11:26:46.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.844+0000 7f6dca731b80 1 -- 172.21.15.2:0/3160975116 shutdown_connections 2024-06-13T11:26:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.844+0000 7f6dca731b80 1 --2- 172.21.15.2:0/3160975116 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55a2d5df5ee0 0x55a2d5df82d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.844+0000 7f6dca731b80 1 --2- 172.21.15.2:0/3160975116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a2d5d71a50 0x55a2d5d836a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.844+0000 7f6dca731b80 1 --2- 172.21.15.2:0/3160975116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a2d5d77cc0 0x55a2d5d92010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.844+0000 7f6dca731b80 1 --2- 172.21.15.2:0/3160975116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a2d5d773a0 0x55a2d5d83be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.844+0000 7f6dca731b80 1 -- 172.21.15.2:0/3160975116 >> 172.21.15.2:0/3160975116 conn(0x55a2d5c95170 msgr2=0x55a2d5d67cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.844+0000 7f6d9f400700 0 client.15549 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:26:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.845+0000 7f6dca731b80 1 -- 172.21.15.2:0/3160975116 shutdown_connections 2024-06-13T11:26:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.845+0000 7f6dca731b80 1 -- 172.21.15.2:0/3160975116 wait complete. 2024-06-13T11:26:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.845+0000 7f6dca731b80 20 client.15549 trim_cache size 0 max 16384 2024-06-13T11:26:46.855 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:26:46.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.845+0000 7f6dbfe00700 1 -- 172.21.15.2:0/3137984757 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6da00a2d90 msgr2=0x7f6da00a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:46.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.845+0000 7f6dbfe00700 1 --2- 172.21.15.2:0/3137984757 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6da00a2d90 0x7f6da00a5250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6dac005950 tx=0x7f6dac0118e0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.845+0000 7f6dbfe00700 1 -- 172.21.15.2:0/3137984757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6db8102ee0 msgr2=0x7f6db819b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:46.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.845+0000 7f6dbfe00700 1 --2- 172.21.15.2:0/3137984757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6db8102ee0 0x7f6db819b3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6da4000c00 tx=0x7f6da400bab0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.846+0000 7f6dbfe00700 1 -- 172.21.15.2:0/3137984757 shutdown_connections 2024-06-13T11:26:46.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.846+0000 7f6dbfe00700 1 --2- 172.21.15.2:0/3137984757 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6da00a2d90 0x7f6da00a5250 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.846+0000 7f6dbfe00700 1 --2- 172.21.15.2:0/3137984757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db8102540 0x7f6db819ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.846+0000 7f6dbfe00700 1 --2- 172.21.15.2:0/3137984757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db8107450 0x7f6db819f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.846+0000 7f6dbfe00700 1 --2- 172.21.15.2:0/3137984757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6db8102ee0 0x7f6db819b3c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:46.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.846+0000 7f6dbfe00700 1 -- 172.21.15.2:0/3137984757 >> 172.21.15.2:0/3137984757 conn(0x7f6db80795f0 msgr2=0x7f6db81003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:46.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.846+0000 7f6dbfe00700 1 -- 172.21.15.2:0/3137984757 shutdown_connections 2024-06-13T11:26:46.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:46.846+0000 7f6dbfe00700 1 -- 172.21.15.2:0/3137984757 wait complete. 2024-06-13T11:26:47.835 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-13T11:26:48.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:47 smithi077 ceph-mon[36410]: pgmap v93: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-06-13T11:26:48.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:47 smithi002 ceph-mon[32210]: pgmap v93: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-06-13T11:26:48.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:47 smithi178 ceph-mon[36913]: pgmap v93: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-06-13T11:26:48.301 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:26:49.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:48 smithi077 ceph-mon[36410]: pgmap v94: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-06-13T11:26:49.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:48 smithi002 ceph-mon[32210]: pgmap v94: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-06-13T11:26:49.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:48 smithi178 ceph-mon[36913]: pgmap v94: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-06-13T11:26:50.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.773+0000 7fb1e3a00700 1 -- 172.21.15.2:0/4076194256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1dc101d50 msgr2=0x7fb1dc10e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:50.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.773+0000 7fb1e3a00700 1 --2- 172.21.15.2:0/4076194256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1dc101d50 0x7fb1dc10e240 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400b0a0 tx=0x7fb1d400b3b0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.773+0000 7fb1e3a00700 1 -- 172.21.15.2:0/4076194256 shutdown_connections 2024-06-13T11:26:50.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.773+0000 7fb1e3a00700 1 --2- 172.21.15.2:0/4076194256 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1dc101d50 0x7fb1dc10e240 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.773+0000 7fb1e3a00700 1 --2- 172.21.15.2:0/4076194256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1dc107400 0x7fb1dc1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.773+0000 7fb1e3a00700 1 --2- 172.21.15.2:0/4076194256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1dc101390 0x7fb1dc101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.773+0000 7fb1e3a00700 1 -- 172.21.15.2:0/4076194256 >> 172.21.15.2:0/4076194256 conn(0x7fb1dc078340 msgr2=0x7fb1dc078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.773+0000 7fb1e3a00700 1 -- 172.21.15.2:0/4076194256 shutdown_connections 2024-06-13T11:26:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.773+0000 7fb1e3a00700 1 -- 172.21.15.2:0/4076194256 wait complete. 2024-06-13T11:26:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.774+0000 7fb1e3a00700 1 Processor -- start 2024-06-13T11:26:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.775+0000 7fb1e3a00700 1 -- start start 2024-06-13T11:26:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.775+0000 7fb1e3a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1dc101390 0x7fb1dc19ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.775+0000 7fb1e3a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1dc101d50 0x7fb1dc19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.775+0000 7fb1e3a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1dc107400 0x7fb1dc19f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.775+0000 7fb1e3a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc111670 con 0x7fb1dc101d50 2024-06-13T11:26:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.775+0000 7fb1e3a00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc1114f0 con 0x7fb1dc107400 2024-06-13T11:26:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.775+0000 7fb1e3a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc1117f0 con 0x7fb1dc101390 2024-06-13T11:26:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.776+0000 7fb1e1a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1dc107400 0x7fb1dc19f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.776+0000 7fb1e1000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1dc101390 0x7fb1dc19ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.776+0000 7fb1d3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1dc101d50 0x7fb1dc19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.776+0000 7fb1e1000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1dc101390 0x7fb1dc19ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49384/0 (socket says 172.21.15.2:49384) 2024-06-13T11:26:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.776+0000 7fb1e1000700 1 -- 172.21.15.2:0/2243559068 learned_addr learned my addr 172.21.15.2:0/2243559068 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.776+0000 7fb1e1a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1dc107400 0x7fb1dc19f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:52864/0 (socket says 172.21.15.2:52864) 2024-06-13T11:26:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.776+0000 7fb1e1000700 1 -- 172.21.15.2:0/2243559068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1dc107400 msgr2=0x7fb1dc19f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.776+0000 7fb1e1000700 1 --2- 172.21.15.2:0/2243559068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1dc107400 0x7fb1dc19f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.776+0000 7fb1e1000700 1 -- 172.21.15.2:0/2243559068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1dc101d50 msgr2=0x7fb1dc19b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.776+0000 7fb1e1000700 1 --2- 172.21.15.2:0/2243559068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1dc101d50 0x7fb1dc19b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.776+0000 7fb1e1000700 1 -- 172.21.15.2:0/2243559068 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1dc19fda0 con 0x7fb1dc101390 2024-06-13T11:26:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.776+0000 7fb1e1a00700 1 --2- 172.21.15.2:0/2243559068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1dc107400 0x7fb1dc19f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.777+0000 7fb1e1000700 1 --2- 172.21.15.2:0/2243559068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1dc101390 0x7fb1dc19ad90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00e9a0 tx=0x7fb1cc00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.777+0000 7fb1da000700 1 -- 172.21.15.2:0/2243559068 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc00ca10 con 0x7fb1dc101390 2024-06-13T11:26:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.777+0000 7fb1da000700 1 -- 172.21.15.2:0/2243559068 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1cc00cbb0 con 0x7fb1dc101390 2024-06-13T11:26:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.777+0000 7fb1e3a00700 1 -- 172.21.15.2:0/2243559068 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1dc1a0090 con 0x7fb1dc101390 2024-06-13T11:26:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.777+0000 7fb1da000700 1 -- 172.21.15.2:0/2243559068 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc018680 con 0x7fb1dc101390 2024-06-13T11:26:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.777+0000 7fb1e3a00700 1 -- 172.21.15.2:0/2243559068 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1dc1a7910 con 0x7fb1dc101390 2024-06-13T11:26:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.781+0000 7fb1da000700 1 -- 172.21.15.2:0/2243559068 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fb1cc010430 con 0x7fb1dc101390 2024-06-13T11:26:50.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.782+0000 7fb1ee3b7b80 1 Processor -- start 2024-06-13T11:26:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.782+0000 7fb1ee3b7b80 1 -- start start 2024-06-13T11:26:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.782+0000 7fb1da000700 1 --2- 172.21.15.2:0/2243559068 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb1c00a2d90 0x7fb1c00a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.782+0000 7fb1ee3b7b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730cc9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.782+0000 7fb1ee3b7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cca4b0 0x562730cc3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.782+0000 7fb1ee3b7b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cc4240 0x562730cc4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.782+0000 7fb1ee3b7b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562730bd2a10 con 0x562730cc9b90 2024-06-13T11:26:50.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.782+0000 7fb1ee3b7b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562730c15b00 con 0x562730cc4240 2024-06-13T11:26:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.782+0000 7fb1ee3b7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562730bd08f0 con 0x562730cca4b0 2024-06-13T11:26:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.782+0000 7fb1da000700 1 -- 172.21.15.2:0/2243559068 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fb1cc0cf970 con 0x7fb1dc101390 2024-06-13T11:26:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.783+0000 7fb1e1000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730cc9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.783+0000 7fb1d3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cca4b0 0x562730cc3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.783+0000 7fb1e1a00700 1 --2- 172.21.15.2:0/2243559068 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb1c00a2d90 0x7fb1c00a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.783+0000 7fb1e1000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730cc9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39602/0 (socket says 172.21.15.2:39602) 2024-06-13T11:26:50.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.783+0000 7fb1e1000700 1 -- 172.21.15.2:0/2994869648 learned_addr learned my addr 172.21.15.2:0/2994869648 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:50.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.783+0000 7fb1e1000700 1 -- 172.21.15.2:0/2994869648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cca4b0 msgr2=0x562730cc3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:50.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.783+0000 7fb1e1000700 1 --2- 172.21.15.2:0/2994869648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cca4b0 0x562730cc3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.783+0000 7fb1e1000700 1 -- 172.21.15.2:0/2994869648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cc4240 msgr2=0x562730cc4680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-13T11:26:50.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.783+0000 7fb1e1000700 1 --2- 172.21.15.2:0/2994869648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cc4240 0x562730cc4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.783+0000 7fb1e1000700 1 -- 172.21.15.2:0/2994869648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562730bbdf90 con 0x562730cc9b90 2024-06-13T11:26:50.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.783+0000 7fb1d3e00700 1 --2- 172.21.15.2:0/2994869648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cca4b0 0x562730cc3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:50.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.784+0000 7fb1e1000700 1 --2- 172.21.15.2:0/2994869648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730cc9f70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0984f0 tx=0x7fb1cc09c2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c6138b1f447a4f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:50.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.784+0000 7fb1e1a00700 1 --2- 172.21.15.2:0/2243559068 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb1c00a2d90 0x7fb1c00a5250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4009fd0 tx=0x7fb1d4009d60 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:50.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.784+0000 7fb1d2000700 1 -- 172.21.15.2:0/2994869648 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc0a4790 con 0x562730cc9b90 2024-06-13T11:26:50.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.784+0000 7fb1d2000700 1 -- 172.21.15.2:0/2994869648 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1cc00cd60 con 0x562730cc9b90 2024-06-13T11:26:50.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.784+0000 7fb1d2000700 1 -- 172.21.15.2:0/2994869648 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc0a4560 con 0x562730cc9b90 2024-06-13T11:26:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.785+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/2994869648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 msgr2=0x562730cc9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.785+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/2994869648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730cc9f70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0984f0 tx=0x7fb1cc09c2c0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.785+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/2994869648 shutdown_connections 2024-06-13T11:26:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.785+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/2994869648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730cc9f70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.785+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/2994869648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cc4240 0x562730cc4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.785+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/2994869648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cca4b0 0x562730cc3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.785+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/2994869648 >> 172.21.15.2:0/2994869648 conn(0x562730bf0170 msgr2=0x562730cbeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.785+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/2994869648 shutdown_connections 2024-06-13T11:26:50.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.785+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/2994869648 wait complete. 2024-06-13T11:26:50.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.786+0000 7fb1ee3b7b80 1 -- start start 2024-06-13T11:26:50.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.786+0000 7fb1ee3b7b80 1 Processor -- start 2024-06-13T11:26:50.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.786+0000 7fb1ee3b7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cc4240 0x562730cd0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.786+0000 7fb1ee3b7b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730ccd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1ee3b7b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cca4b0 0x562730ccda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1ee3b7b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562730bb1f60 con 0x562730cc9b90 2024-06-13T11:26:50.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1ee3b7b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562730c11ac0 con 0x562730cca4b0 2024-06-13T11:26:50.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1ee3b7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562730cd0e90 con 0x562730cc4240 2024-06-13T11:26:50.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1ee3b7b80 10 client.0 _ll_register_callbacks cb 0x562730bab380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:26:50.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1d3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730ccd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1d3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730ccd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39608/0 (socket says 172.21.15.2:39608) 2024-06-13T11:26:50.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1d3e00700 1 -- 172.21.15.2:0/3107072317 learned_addr learned my addr 172.21.15.2:0/3107072317 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:50.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1e1000700 1 --2- 172.21.15.2:0/3107072317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cc4240 0x562730cd0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1e1a00700 1 --2- 172.21.15.2:0/3107072317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cca4b0 0x562730ccda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1e1000700 1 -- 172.21.15.2:0/3107072317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cca4b0 msgr2=0x562730ccda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:50.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1e1000700 1 --2- 172.21.15.2:0/3107072317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cca4b0 0x562730ccda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1e1000700 1 -- 172.21.15.2:0/3107072317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 msgr2=0x562730ccd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:50.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1e1000700 1 --2- 172.21.15.2:0/3107072317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730ccd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1e1000700 1 -- 172.21.15.2:0/3107072317 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562730b648d0 con 0x562730cc4240 2024-06-13T11:26:50.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1d3e00700 1 --2- 172.21.15.2:0/3107072317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730ccd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:50.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.787+0000 7fb1e1a00700 1 --2- 172.21.15.2:0/3107072317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cca4b0 0x562730ccda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:50.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.788+0000 7fb1e1000700 1 --2- 172.21.15.2:0/3107072317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cc4240 0x562730cd0220 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00e970 tx=0x7fb1cc010c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c2d0bc8120e148c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:50.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.788+0000 7fb1caa00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:26:50.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.788+0000 7fb1caa00700 1 -- 172.21.15.2:0/3107072317 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc010720 con 0x562730cc4240 2024-06-13T11:26:50.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.788+0000 7fb1caa00700 1 -- 172.21.15.2:0/3107072317 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fb1cc0108c0 con 0x562730cc4240 2024-06-13T11:26:50.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.788+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/3107072317 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1cc00cd60 con 0x562730cc4240 2024-06-13T11:26:50.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.788+0000 7fb1caa00700 1 -- 172.21.15.2:0/3107072317 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb1cc09af70 con 0x562730cc4240 2024-06-13T11:26:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.788+0000 7fb1ee3b7b80 10 client.25708 fetch_fsmap learned FSMap version 29 2024-06-13T11:26:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.788+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/3107072317 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562730cdb610 con 0x562730cc4240 2024-06-13T11:26:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.789+0000 7fb1caa00700 1 -- 172.21.15.2:0/3107072317 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1cc00cd60 con 0x562730cc4240 2024-06-13T11:26:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.789+0000 7fb1caa00700 1 -- 172.21.15.2:0/3107072317 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fb1cc086120 con 0x562730cc4240 2024-06-13T11:26:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.789+0000 7fb1ee3b7b80 10 client.25708 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:26:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.789+0000 7fb1ee3b7b80 10 client.25708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:26:50.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.789+0000 7fb1ee3b7b80 20 client.25708 populate_metadata read hostname 'smithi002' 2024-06-13T11:26:50.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.789+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/3107072317 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562730cddae0 0x562730cdfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.789+0000 7fb1ee3b7b80 4 client.25708 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:26:50.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.789+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/3107072317 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562730c23000 con 0x562730cddae0 2024-06-13T11:26:50.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.789+0000 7fb1d3e00700 1 --2- 172.21.15.2:0/3107072317 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562730cddae0 0x562730cdfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.790+0000 7fb1d3e00700 1 --2- 172.21.15.2:0/3107072317 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562730cddae0 0x562730cdfed0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7da6d4fc31388f9f server_cookie=2a6ddd597c077731 in_seq=0 out_seq=0 2024-06-13T11:26:50.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.790+0000 7fb1caa00700 10 client.25708 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:50.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.791+0000 7fb1caa00700 1 -- 172.21.15.2:0/3107072317 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562730c23000 con 0x562730cddae0 2024-06-13T11:26:50.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.791+0000 7fb1caa00700 10 client.25708 handle_command_reply: tid=0 2024-06-13T11:26:50.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.791+0000 7fb1ee3b7b80 1 client.25708 shutdown 2024-06-13T11:26:50.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.791+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/3107072317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cc4240 msgr2=0x562730cd0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:50.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.791+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/3107072317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cc4240 0x562730cd0220 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00e970 tx=0x7fb1cc010c10 comp rx=0 tx=0).stop 2024-06-13T11:26:50.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.791+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/3107072317 shutdown_connections 2024-06-13T11:26:50.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.791+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/3107072317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cca4b0 0x562730ccda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.791+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/3107072317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cc4240 0x562730cd0220 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.791+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/3107072317 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562730cddae0 0x562730cdfed0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.791+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/3107072317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730ccd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.791+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/3107072317 >> 172.21.15.2:0/3107072317 conn(0x562730bf0170 msgr2=0x562730cb8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:50.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.791+0000 7fb1caa00700 0 client.25708 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:50.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.792+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/3107072317 shutdown_connections 2024-06-13T11:26:50.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.792+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/3107072317 wait complete. 2024-06-13T11:26:50.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.792+0000 7fb1ee3b7b80 20 client.25708 trim_cache size 0 max 16384 2024-06-13T11:26:50.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.809+0000 7fb1ee3b7b80 1 Processor -- start 2024-06-13T11:26:50.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.809+0000 7fb1ee3b7b80 1 -- start start 2024-06-13T11:26:50.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.809+0000 7fb1ee3b7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cc4240 0x562730cc3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.809+0000 7fb1ee3b7b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730cd9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.809+0000 7fb1ee3b7b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cca4b0 0x562730ccaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.809+0000 7fb1ee3b7b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc1b2f20 con 0x562730cc9b90 2024-06-13T11:26:50.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.809+0000 7fb1ee3b7b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc1b07b0 con 0x562730cca4b0 2024-06-13T11:26:50.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.809+0000 7fb1ee3b7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc1ae600 con 0x562730cc4240 2024-06-13T11:26:50.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.810+0000 7fb1d3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730cd9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.810+0000 7fb1d3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730cd9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39612/0 (socket says 172.21.15.2:39612) 2024-06-13T11:26:50.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.810+0000 7fb1d3e00700 1 -- 172.21.15.2:0/1843388959 learned_addr learned my addr 172.21.15.2:0/1843388959 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:50.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.810+0000 7fb1e1000700 1 --2- 172.21.15.2:0/1843388959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cc4240 0x562730cc3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.810+0000 7fb1e1a00700 1 --2- 172.21.15.2:0/1843388959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cca4b0 0x562730ccaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.810+0000 7fb1e1000700 1 -- 172.21.15.2:0/1843388959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cca4b0 msgr2=0x562730ccaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:50.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.810+0000 7fb1e1000700 1 --2- 172.21.15.2:0/1843388959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cca4b0 0x562730ccaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.810+0000 7fb1e1000700 1 -- 172.21.15.2:0/1843388959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 msgr2=0x562730cd9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:50.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.810+0000 7fb1e1000700 1 --2- 172.21.15.2:0/1843388959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730cd9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.810+0000 7fb1e1000700 1 -- 172.21.15.2:0/1843388959 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562730cca1c0 con 0x562730cc4240 2024-06-13T11:26:50.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.811+0000 7fb1e1000700 1 --2- 172.21.15.2:0/1843388959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cc4240 0x562730cc3d00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc097f80 tx=0x7fb1cc010c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b216bb151c5013b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:50.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.811+0000 7fb1d1600700 1 -- 172.21.15.2:0/1843388959 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc00cd60 con 0x562730cc4240 2024-06-13T11:26:50.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.811+0000 7fb1d1600700 1 -- 172.21.15.2:0/1843388959 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1cc09ce50 con 0x562730cc4240 2024-06-13T11:26:50.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.811+0000 7fb1d1600700 1 -- 172.21.15.2:0/1843388959 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc010720 con 0x562730cc4240 2024-06-13T11:26:50.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.811+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/1843388959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cc4240 msgr2=0x562730cc3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:50.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.811+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/1843388959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cc4240 0x562730cc3d00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc097f80 tx=0x7fb1cc010c80 comp rx=0 tx=0).stop 2024-06-13T11:26:50.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.812+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/1843388959 shutdown_connections 2024-06-13T11:26:50.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.812+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/1843388959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cca4b0 0x562730ccaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.812+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/1843388959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cc4240 0x562730cc3d00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.812+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/1843388959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc9b90 0x562730cd9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.812+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/1843388959 >> 172.21.15.2:0/1843388959 conn(0x562730bf0170 msgr2=0x562730ccc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:50.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.812+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/1843388959 shutdown_connections 2024-06-13T11:26:50.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.812+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/1843388959 wait complete. 2024-06-13T11:26:50.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.812+0000 7fb1ee3b7b80 1 -- start start 2024-06-13T11:26:50.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.812+0000 7fb1ee3b7b80 1 Processor -- start 2024-06-13T11:26:50.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.813+0000 7fb1ee3b7b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc4240 0x562730ce5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.813+0000 7fb1ee3b7b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cc9b90 0x562730cd6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.813+0000 7fb1ee3b7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cca4b0 0x562730cd6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.813+0000 7fb1ee3b7b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc1aec70 con 0x562730cc4240 2024-06-13T11:26:50.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.813+0000 7fb1ee3b7b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc1b00e0 con 0x562730cc9b90 2024-06-13T11:26:50.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.813+0000 7fb1ee3b7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc1af340 con 0x562730cca4b0 2024-06-13T11:26:50.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.813+0000 7fb1ee3b7b80 10 client.0 _ll_register_callbacks cb 0x562730bab380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:26:50.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.813+0000 7fb1e1a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cca4b0 0x562730cd6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.813+0000 7fb1e1a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cca4b0 0x562730cd6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49410/0 (socket says 172.21.15.2:49410) 2024-06-13T11:26:50.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.813+0000 7fb1e1a00700 1 -- 172.21.15.2:0/4261259005 learned_addr learned my addr 172.21.15.2:0/4261259005 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:50.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.813+0000 7fb1e1000700 1 --2- 172.21.15.2:0/4261259005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc4240 0x562730ce5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.813+0000 7fb1d3e00700 1 --2- 172.21.15.2:0/4261259005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cc9b90 0x562730cd6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.814+0000 7fb1e1a00700 1 -- 172.21.15.2:0/4261259005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cc9b90 msgr2=0x562730cd6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:50.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.814+0000 7fb1e1a00700 1 --2- 172.21.15.2:0/4261259005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cc9b90 0x562730cd6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.814+0000 7fb1e1a00700 1 -- 172.21.15.2:0/4261259005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc4240 msgr2=0x562730ce5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:50.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.814+0000 7fb1e1a00700 1 --2- 172.21.15.2:0/4261259005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc4240 0x562730ce5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.814+0000 7fb1e1a00700 1 -- 172.21.15.2:0/4261259005 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562730ce4520 con 0x562730cca4b0 2024-06-13T11:26:50.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.814+0000 7fb1e1a00700 1 --2- 172.21.15.2:0/4261259005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cca4b0 0x562730cd6750 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400b0a0 tx=0x7fb1d400b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fef2fe478a603077 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:50.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.814+0000 7fb1caa00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:26:50.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.814+0000 7fb1caa00700 1 -- 172.21.15.2:0/4261259005 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4023070 con 0x562730cca4b0 2024-06-13T11:26:50.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.814+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/4261259005 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1cc09ce50 con 0x562730cca4b0 2024-06-13T11:26:50.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.814+0000 7fb1caa00700 1 -- 172.21.15.2:0/4261259005 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fb1d4005690 con 0x562730cca4b0 2024-06-13T11:26:50.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.815+0000 7fb1caa00700 1 -- 172.21.15.2:0/4261259005 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb1d4005890 con 0x562730cca4b0 2024-06-13T11:26:50.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.815+0000 7fb1ee3b7b80 10 client.25714 fetch_fsmap learned FSMap version 29 2024-06-13T11:26:50.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.815+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/4261259005 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562730d47780 con 0x562730cca4b0 2024-06-13T11:26:50.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.815+0000 7fb1caa00700 1 -- 172.21.15.2:0/4261259005 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1cc09ce50 con 0x562730cca4b0 2024-06-13T11:26:50.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.815+0000 7fb1caa00700 1 -- 172.21.15.2:0/4261259005 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fb1d4031020 con 0x562730cca4b0 2024-06-13T11:26:50.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.815+0000 7fb1ee3b7b80 10 client.25714 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:26:50.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.815+0000 7fb1ee3b7b80 10 client.25714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:26:50.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.815+0000 7fb1ee3b7b80 20 client.25714 populate_metadata read hostname 'smithi002' 2024-06-13T11:26:50.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.815+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/4261259005 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562730d47e90 0x562730d4a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:50.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.815+0000 7fb1ee3b7b80 4 client.25714 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:26:50.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.815+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/4261259005 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562730c1d580 con 0x562730d47e90 2024-06-13T11:26:50.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.816+0000 7fb1e1000700 1 --2- 172.21.15.2:0/4261259005 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562730d47e90 0x562730d4a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:50.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.816+0000 7fb1e1000700 1 --2- 172.21.15.2:0/4261259005 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562730d47e90 0x562730d4a2b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a6a31cf7a30f7d2 server_cookie=539a38161548d4b6 in_seq=0 out_seq=0 2024-06-13T11:26:50.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.816+0000 7fb1caa00700 10 client.25714 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:50.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.816+0000 7fb1caa00700 1 -- 172.21.15.2:0/4261259005 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562730c1d580 con 0x562730d47e90 2024-06-13T11:26:50.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.816+0000 7fb1caa00700 10 client.25714 handle_command_reply: tid=0 2024-06-13T11:26:50.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.816+0000 7fb1ee3b7b80 1 client.25714 shutdown 2024-06-13T11:26:50.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.817+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/4261259005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cca4b0 msgr2=0x562730cd6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:50.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.817+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/4261259005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cca4b0 0x562730cd6750 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400b0a0 tx=0x7fb1d400b3b0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.817+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/4261259005 shutdown_connections 2024-06-13T11:26:50.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.817+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/4261259005 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562730d47e90 0x562730d4a2b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.817+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/4261259005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562730cc4240 0x562730ce5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.817+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/4261259005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562730cca4b0 0x562730cd6750 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.817+0000 7fb1caa00700 0 client.25714 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:50.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.817+0000 7fb1ee3b7b80 1 --2- 172.21.15.2:0/4261259005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562730cc9b90 0x562730cd6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.817+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/4261259005 >> 172.21.15.2:0/4261259005 conn(0x562730bf0170 msgr2=0x562730ccbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:50.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.817+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/4261259005 shutdown_connections 2024-06-13T11:26:50.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.817+0000 7fb1ee3b7b80 1 -- 172.21.15.2:0/4261259005 wait complete. 2024-06-13T11:26:50.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.817+0000 7fb1ee3b7b80 20 client.25714 trim_cache size 0 max 16384 2024-06-13T11:26:50.824 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:26:50.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.818+0000 7fb1e3a00700 1 -- 172.21.15.2:0/2243559068 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb1c00a2d90 msgr2=0x7fb1c00a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:50.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.818+0000 7fb1e3a00700 1 --2- 172.21.15.2:0/2243559068 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb1c00a2d90 0x7fb1c00a5250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4009fd0 tx=0x7fb1d4009d60 comp rx=0 tx=0).stop 2024-06-13T11:26:50.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.818+0000 7fb1e3a00700 1 -- 172.21.15.2:0/2243559068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1dc101390 msgr2=0x7fb1dc19ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:50.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.818+0000 7fb1e3a00700 1 --2- 172.21.15.2:0/2243559068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1dc101390 0x7fb1dc19ad90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00e9a0 tx=0x7fb1cc00ecb0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.818+0000 7fb1e3a00700 1 -- 172.21.15.2:0/2243559068 shutdown_connections 2024-06-13T11:26:50.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.818+0000 7fb1e3a00700 1 --2- 172.21.15.2:0/2243559068 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb1c00a2d90 0x7fb1c00a5250 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.818+0000 7fb1e3a00700 1 --2- 172.21.15.2:0/2243559068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1dc107400 0x7fb1dc19f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.818+0000 7fb1e3a00700 1 --2- 172.21.15.2:0/2243559068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1dc101390 0x7fb1dc19ad90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.818+0000 7fb1e3a00700 1 --2- 172.21.15.2:0/2243559068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1dc101d50 0x7fb1dc19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:50.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.818+0000 7fb1e3a00700 1 -- 172.21.15.2:0/2243559068 >> 172.21.15.2:0/2243559068 conn(0x7fb1dc078340 msgr2=0x7fb1dc06a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:50.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.818+0000 7fb1e3a00700 1 -- 172.21.15.2:0/2243559068 shutdown_connections 2024-06-13T11:26:50.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:50.818+0000 7fb1e3a00700 1 -- 172.21.15.2:0/2243559068 wait complete. 2024-06-13T11:26:51.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:51 smithi002 ceph-mon[32210]: pgmap v95: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-06-13T11:26:51.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:51 smithi178 ceph-mon[36913]: pgmap v95: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-06-13T11:26:51.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:51 smithi077 ceph-mon[36410]: pgmap v95: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-06-13T11:26:52.828 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-13T11:26:52.829 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-13T11:26:53.308 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:26:53.643 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:53 smithi002 ceph-mon[32210]: pgmap v96: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-06-13T11:26:53.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:53 smithi178 ceph-mon[36913]: pgmap v96: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-06-13T11:26:53.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:53 smithi077 ceph-mon[36410]: pgmap v96: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-06-13T11:26:55.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:55 smithi002 ceph-mon[32210]: pgmap v97: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-06-13T11:26:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.693+0000 7fc64ae00700 1 -- 172.21.15.2:0/1408785821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc644105040 msgr2=0x7fc644111550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.693+0000 7fc64ae00700 1 --2- 172.21.15.2:0/1408785821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc644105040 0x7fc644111550 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00b0a0 tx=0x7fc63c00b3b0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.693+0000 7fc64ae00700 1 -- 172.21.15.2:0/1408785821 shutdown_connections 2024-06-13T11:26:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.693+0000 7fc64ae00700 1 --2- 172.21.15.2:0/1408785821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc644105040 0x7fc644111550 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.693+0000 7fc64ae00700 1 --2- 172.21.15.2:0/1408785821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc64410a680 0x7fc64410aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.693+0000 7fc64ae00700 1 --2- 172.21.15.2:0/1408785821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc644104680 0x7fc644104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.693+0000 7fc64ae00700 1 -- 172.21.15.2:0/1408785821 >> 172.21.15.2:0/1408785821 conn(0x7fc644100170 msgr2=0x7fc644102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:55.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.694+0000 7fc64ae00700 1 -- 172.21.15.2:0/1408785821 shutdown_connections 2024-06-13T11:26:55.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.694+0000 7fc64ae00700 1 -- 172.21.15.2:0/1408785821 wait complete. 2024-06-13T11:26:55.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.695+0000 7fc64ae00700 1 Processor -- start 2024-06-13T11:26:55.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.695+0000 7fc64ae00700 1 -- start start 2024-06-13T11:26:55.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.695+0000 7fc64ae00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc644104680 0x7fc64419ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.695+0000 7fc64ae00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc644105040 0x7fc64419b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.695+0000 7fc64ae00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc64410a680 0x7fc64419f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.695+0000 7fc64ae00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc6441149d0 con 0x7fc64410a680 2024-06-13T11:26:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.695+0000 7fc64ae00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc644114850 con 0x7fc644105040 2024-06-13T11:26:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.695+0000 7fc64ae00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc644114b50 con 0x7fc644104680 2024-06-13T11:26:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.696+0000 7fc648e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc64410a680 0x7fc64419f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.696+0000 7fc643400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc644105040 0x7fc64419b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.696+0000 7fc643e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc644104680 0x7fc64419ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.696+0000 7fc643400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc644105040 0x7fc64419b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:52918/0 (socket says 172.21.15.2:52918) 2024-06-13T11:26:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.696+0000 7fc648e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc64410a680 0x7fc64419f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39644/0 (socket says 172.21.15.2:39644) 2024-06-13T11:26:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.696+0000 7fc643400700 1 -- 172.21.15.2:0/4067484916 learned_addr learned my addr 172.21.15.2:0/4067484916 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.696+0000 7fc643400700 1 -- 172.21.15.2:0/4067484916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc644104680 msgr2=0x7fc64419ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.696+0000 7fc643400700 1 --2- 172.21.15.2:0/4067484916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc644104680 0x7fc64419ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.696+0000 7fc643400700 1 -- 172.21.15.2:0/4067484916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc64410a680 msgr2=0x7fc64419f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.696+0000 7fc643400700 1 --2- 172.21.15.2:0/4067484916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc64410a680 0x7fc64419f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.696+0000 7fc643400700 1 -- 172.21.15.2:0/4067484916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64419fe30 con 0x7fc644105040 2024-06-13T11:26:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.696+0000 7fc643e00700 1 --2- 172.21.15.2:0/4067484916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc644104680 0x7fc64419ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:55.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.696+0000 7fc648e00700 1 --2- 172.21.15.2:0/4067484916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc64410a680 0x7fc64419f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:55.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.697+0000 7fc643400700 1 --2- 172.21.15.2:0/4067484916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc644105040 0x7fc64419b360 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc63000e9c0 tx=0x7fc63000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:55.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.697+0000 7fc640c00700 1 -- 172.21.15.2:0/4067484916 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63000cbd0 con 0x7fc644105040 2024-06-13T11:26:55.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.697+0000 7fc64ae00700 1 -- 172.21.15.2:0/4067484916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6441a0120 con 0x7fc644105040 2024-06-13T11:26:55.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.697+0000 7fc640c00700 1 -- 172.21.15.2:0/4067484916 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc63000ee60 con 0x7fc644105040 2024-06-13T11:26:55.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.697+0000 7fc640c00700 1 -- 172.21.15.2:0/4067484916 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630005630 con 0x7fc644105040 2024-06-13T11:26:55.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.697+0000 7fc64ae00700 1 -- 172.21.15.2:0/4067484916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6441a79a0 con 0x7fc644105040 2024-06-13T11:26:55.700 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:55 smithi178 ceph-mon[36913]: pgmap v97: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-06-13T11:26:55.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.701+0000 7fc640c00700 1 -- 172.21.15.2:0/4067484916 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fc630004750 con 0x7fc644105040 2024-06-13T11:26:55.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.702+0000 7fc65572ab80 1 Processor -- start 2024-06-13T11:26:55.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.702+0000 7fc65572ab80 1 -- start start 2024-06-13T11:26:55.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.702+0000 7fc65572ab80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206902c10 0x562206902ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.702+0000 7fc65572ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206903530 0x5622068fcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.702+0000 7fc65572ab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622068fd2c0 0x5622068fd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.702+0000 7fc65572ab80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56220680ba90 con 0x562206902c10 2024-06-13T11:26:55.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.702+0000 7fc65572ab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56220684eb80 con 0x5622068fd2c0 2024-06-13T11:26:55.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.702+0000 7fc65572ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562206809970 con 0x562206903530 2024-06-13T11:26:55.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.703+0000 7fc643e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206903530 0x5622068fcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.703+0000 7fc643e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206903530 0x5622068fcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49446/0 (socket says 172.21.15.2:49446) 2024-06-13T11:26:55.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.703+0000 7fc648e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206902c10 0x562206902ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.703+0000 7fc643e00700 1 -- 172.21.15.2:0/941130056 learned_addr learned my addr 172.21.15.2:0/941130056 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.703+0000 7fc643400700 1 --2- 172.21.15.2:0/941130056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622068fd2c0 0x5622068fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.703+0000 7fc640c00700 1 --2- 172.21.15.2:0/4067484916 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6280a2d90 0x7fc6280a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.703+0000 7fc643e00700 1 -- 172.21.15.2:0/941130056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622068fd2c0 msgr2=0x5622068fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.703+0000 7fc643e00700 1 --2- 172.21.15.2:0/941130056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622068fd2c0 0x5622068fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.703+0000 7fc643e00700 1 -- 172.21.15.2:0/941130056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206902c10 msgr2=0x562206902ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:55.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.703+0000 7fc643e00700 1 --2- 172.21.15.2:0/941130056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206902c10 0x562206902ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.703+0000 7fc643e00700 1 -- 172.21.15.2:0/941130056 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622067f7010 con 0x562206903530 2024-06-13T11:26:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.704+0000 7fc640c00700 1 -- 172.21.15.2:0/4067484916 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fc6300cfa90 con 0x7fc644105040 2024-06-13T11:26:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.704+0000 7fc648e00700 1 --2- 172.21.15.2:0/4067484916 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6280a2d90 0x7fc6280a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.704+0000 7fc643e00700 1 --2- 172.21.15.2:0/941130056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206903530 0x5622068fcd80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc6340115f0 tx=0x7fc634011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6b7071c798e2ac server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.704+0000 7fc639600700 1 -- 172.21.15.2:0/941130056 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63401e070 con 0x562206903530 2024-06-13T11:26:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.704+0000 7fc639600700 1 -- 172.21.15.2:0/941130056 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc634019b10 con 0x562206903530 2024-06-13T11:26:55.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.704+0000 7fc639600700 1 -- 172.21.15.2:0/941130056 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63400eb60 con 0x562206903530 2024-06-13T11:26:55.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.705+0000 7fc65572ab80 1 -- 172.21.15.2:0/941130056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206903530 msgr2=0x5622068fcd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:55.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.705+0000 7fc65572ab80 1 --2- 172.21.15.2:0/941130056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206903530 0x5622068fcd80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc6340115f0 tx=0x7fc634011900 comp rx=0 tx=0).stop 2024-06-13T11:26:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.705+0000 7fc648e00700 1 --2- 172.21.15.2:0/4067484916 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6280a2d90 0x7fc6280a5250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009fd0 tx=0x7fc63c01f040 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.705+0000 7fc65572ab80 1 -- 172.21.15.2:0/941130056 shutdown_connections 2024-06-13T11:26:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.705+0000 7fc65572ab80 1 --2- 172.21.15.2:0/941130056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206902c10 0x562206902ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.705+0000 7fc65572ab80 1 --2- 172.21.15.2:0/941130056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622068fd2c0 0x5622068fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.705+0000 7fc65572ab80 1 --2- 172.21.15.2:0/941130056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206903530 0x5622068fcd80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.705+0000 7fc65572ab80 1 -- 172.21.15.2:0/941130056 >> 172.21.15.2:0/941130056 conn(0x5622068291f0 msgr2=0x5622068f8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.705+0000 7fc65572ab80 1 -- 172.21.15.2:0/941130056 shutdown_connections 2024-06-13T11:26:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.705+0000 7fc65572ab80 1 -- 172.21.15.2:0/941130056 wait complete. 2024-06-13T11:26:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.706+0000 7fc65572ab80 1 -- start start 2024-06-13T11:26:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.706+0000 7fc65572ab80 1 Processor -- start 2024-06-13T11:26:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.707+0000 7fc65572ab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622068fd2c0 0x562206909290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.707+0000 7fc65572ab80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206902c10 0x562206906590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.707+0000 7fc65572ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206903530 0x562206906ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.707+0000 7fc65572ab80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5622067eafe0 con 0x562206902c10 2024-06-13T11:26:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.707+0000 7fc65572ab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56220684ab40 con 0x5622068fd2c0 2024-06-13T11:26:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.707+0000 7fc65572ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562206909f10 con 0x562206903530 2024-06-13T11:26:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.707+0000 7fc65572ab80 10 client.0 _ll_register_callbacks cb 0x5622067e4400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:26:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.707+0000 7fc648e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206903530 0x562206906ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.707+0000 7fc643400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206902c10 0x562206906590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.707+0000 7fc643e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622068fd2c0 0x562206909290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.707+0000 7fc648e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206903530 0x562206906ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49462/0 (socket says 172.21.15.2:49462) 2024-06-13T11:26:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.707+0000 7fc648e00700 1 -- 172.21.15.2:0/1460501533 learned_addr learned my addr 172.21.15.2:0/1460501533 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.707+0000 7fc643400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206902c10 0x562206906590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39670/0 (socket says 172.21.15.2:39670) 2024-06-13T11:26:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.708+0000 7fc643e00700 1 -- 172.21.15.2:0/1460501533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206903530 msgr2=0x562206906ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:55.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.708+0000 7fc643e00700 1 --2- 172.21.15.2:0/1460501533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206903530 0x562206906ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.708+0000 7fc643e00700 1 -- 172.21.15.2:0/1460501533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206902c10 msgr2=0x562206906590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.708+0000 7fc643e00700 1 --2- 172.21.15.2:0/1460501533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206902c10 0x562206906590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.708+0000 7fc643e00700 1 -- 172.21.15.2:0/1460501533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56220679d950 con 0x5622068fd2c0 2024-06-13T11:26:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.708+0000 7fc643e00700 1 --2- 172.21.15.2:0/1460501533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622068fd2c0 0x562206909290 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc63401c040 tx=0x7fc63400e430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=854831bf7855b41d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.708+0000 7fc62e000700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:26:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.708+0000 7fc62e000700 1 -- 172.21.15.2:0/1460501533 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634027070 con 0x5622068fd2c0 2024-06-13T11:26:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.708+0000 7fc65572ab80 1 -- 172.21.15.2:0/1460501533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc634019b10 con 0x5622068fd2c0 2024-06-13T11:26:55.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.708+0000 7fc62e000700 1 -- 172.21.15.2:0/1460501533 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fc634004450 con 0x5622068fd2c0 2024-06-13T11:26:55.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.709+0000 7fc62e000700 1 -- 172.21.15.2:0/1460501533 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc634032050 con 0x5622068fd2c0 2024-06-13T11:26:55.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.709+0000 7fc65572ab80 10 client.25688 fetch_fsmap learned FSMap version 29 2024-06-13T11:26:55.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.709+0000 7fc65572ab80 1 -- 172.21.15.2:0/1460501533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562206914690 con 0x5622068fd2c0 2024-06-13T11:26:55.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.709+0000 7fc62e000700 1 -- 172.21.15.2:0/1460501533 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc634019b10 con 0x5622068fd2c0 2024-06-13T11:26:55.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.709+0000 7fc62e000700 1 -- 172.21.15.2:0/1460501533 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc634003680 con 0x5622068fd2c0 2024-06-13T11:26:55.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.709+0000 7fc65572ab80 10 client.25688 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:26:55.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.710+0000 7fc65572ab80 10 client.25688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:26:55.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.710+0000 7fc65572ab80 20 client.25688 populate_metadata read hostname 'smithi002' 2024-06-13T11:26:55.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.710+0000 7fc65572ab80 1 --2- 172.21.15.2:0/1460501533 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562206916bc0 0x562206918fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.710+0000 7fc65572ab80 4 client.25688 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:26:55.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.710+0000 7fc65572ab80 1 -- 172.21.15.2:0/1460501533 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56220685c080 con 0x562206916bc0 2024-06-13T11:26:55.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.710+0000 7fc643400700 1 --2- 172.21.15.2:0/1460501533 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562206916bc0 0x562206918fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.711+0000 7fc643400700 1 --2- 172.21.15.2:0/1460501533 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562206916bc0 0x562206918fb0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a89e9b21e74f682 server_cookie=53bd4dc91387b398 in_seq=0 out_seq=0 2024-06-13T11:26:55.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.711+0000 7fc62e000700 10 client.25688 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:55.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.711+0000 7fc62e000700 1 -- 172.21.15.2:0/1460501533 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56220685c080 con 0x562206916bc0 2024-06-13T11:26:55.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.711+0000 7fc62e000700 10 client.25688 handle_command_reply: tid=0 2024-06-13T11:26:55.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.712+0000 7fc65572ab80 1 client.25688 shutdown 2024-06-13T11:26:55.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.712+0000 7fc65572ab80 1 -- 172.21.15.2:0/1460501533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622068fd2c0 msgr2=0x562206909290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:55.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.712+0000 7fc65572ab80 1 --2- 172.21.15.2:0/1460501533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622068fd2c0 0x562206909290 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc63401c040 tx=0x7fc63400e430 comp rx=0 tx=0).stop 2024-06-13T11:26:55.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.712+0000 7fc65572ab80 1 -- 172.21.15.2:0/1460501533 shutdown_connections 2024-06-13T11:26:55.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.712+0000 7fc65572ab80 1 --2- 172.21.15.2:0/1460501533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206903530 0x562206906ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.712+0000 7fc65572ab80 1 --2- 172.21.15.2:0/1460501533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622068fd2c0 0x562206909290 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.712+0000 7fc65572ab80 1 --2- 172.21.15.2:0/1460501533 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562206916bc0 0x562206918fb0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.712+0000 7fc65572ab80 1 --2- 172.21.15.2:0/1460501533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206902c10 0x562206906590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.712+0000 7fc62e000700 0 client.25688 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:55.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.712+0000 7fc65572ab80 1 -- 172.21.15.2:0/1460501533 >> 172.21.15.2:0/1460501533 conn(0x5622068291f0 msgr2=0x5622068f1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:55.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.712+0000 7fc65572ab80 1 -- 172.21.15.2:0/1460501533 shutdown_connections 2024-06-13T11:26:55.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.712+0000 7fc65572ab80 1 -- 172.21.15.2:0/1460501533 wait complete. 2024-06-13T11:26:55.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.712+0000 7fc65572ab80 20 client.25688 trim_cache size 0 max 16384 2024-06-13T11:26:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.735+0000 7fc65572ab80 1 Processor -- start 2024-06-13T11:26:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.735+0000 7fc65572ab80 1 -- start start 2024-06-13T11:26:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.736+0000 7fc65572ab80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622068fd2c0 0x5622068fcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.736+0000 7fc65572ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206902c10 0x5622068f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.736+0000 7fc65572ab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562206903530 0x562206905710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.736+0000 7fc65572ab80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc6441b2f90 con 0x5622068fd2c0 2024-06-13T11:26:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.736+0000 7fc65572ab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6441b0820 con 0x562206903530 2024-06-13T11:26:55.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.736+0000 7fc65572ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc6441ae670 con 0x562206902c10 2024-06-13T11:26:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.736+0000 7fc643e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622068fd2c0 0x5622068fcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.736+0000 7fc643e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622068fd2c0 0x5622068fcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39678/0 (socket says 172.21.15.2:39678) 2024-06-13T11:26:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.736+0000 7fc643e00700 1 -- 172.21.15.2:0/3978754052 learned_addr learned my addr 172.21.15.2:0/3978754052 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.736+0000 7fc643400700 1 --2- 172.21.15.2:0/3978754052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206902c10 0x5622068f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.736+0000 7fc648e00700 1 --2- 172.21.15.2:0/3978754052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562206903530 0x562206905710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.737+0000 7fc643400700 1 -- 172.21.15.2:0/3978754052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562206903530 msgr2=0x562206905710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:55.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.737+0000 7fc643400700 1 --2- 172.21.15.2:0/3978754052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562206903530 0x562206905710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.737+0000 7fc643400700 1 -- 172.21.15.2:0/3978754052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622068fd2c0 msgr2=0x5622068fcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:55.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.737+0000 7fc643400700 1 --2- 172.21.15.2:0/3978754052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622068fd2c0 0x5622068fcd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.737+0000 7fc643400700 1 -- 172.21.15.2:0/3978754052 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562206906360 con 0x562206902c10 2024-06-13T11:26:55.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.737+0000 7fc643400700 1 --2- 172.21.15.2:0/3978754052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206902c10 0x5622068f21b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc6300cce10 tx=0x7fc6300d3540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a74c0598c2d96060 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:55.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.737+0000 7fc638c00700 1 -- 172.21.15.2:0/3978754052 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6300d8070 con 0x562206902c10 2024-06-13T11:26:55.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.737+0000 7fc638c00700 1 -- 172.21.15.2:0/3978754052 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6300d9040 con 0x562206902c10 2024-06-13T11:26:55.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.737+0000 7fc638c00700 1 -- 172.21.15.2:0/3978754052 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6300a4850 con 0x562206902c10 2024-06-13T11:26:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.738+0000 7fc65572ab80 1 -- 172.21.15.2:0/3978754052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206902c10 msgr2=0x5622068f21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.738+0000 7fc65572ab80 1 --2- 172.21.15.2:0/3978754052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206902c10 0x5622068f21b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc6300cce10 tx=0x7fc6300d3540 comp rx=0 tx=0).stop 2024-06-13T11:26:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.738+0000 7fc65572ab80 1 -- 172.21.15.2:0/3978754052 shutdown_connections 2024-06-13T11:26:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.738+0000 7fc65572ab80 1 --2- 172.21.15.2:0/3978754052 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622068fd2c0 0x5622068fcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.738+0000 7fc65572ab80 1 --2- 172.21.15.2:0/3978754052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562206903530 0x562206905710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.738+0000 7fc65572ab80 1 --2- 172.21.15.2:0/3978754052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562206902c10 0x5622068f21b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.738+0000 7fc65572ab80 1 -- 172.21.15.2:0/3978754052 >> 172.21.15.2:0/3978754052 conn(0x5622068291f0 msgr2=0x562206904020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.738+0000 7fc65572ab80 1 -- 172.21.15.2:0/3978754052 shutdown_connections 2024-06-13T11:26:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.738+0000 7fc65572ab80 1 -- 172.21.15.2:0/3978754052 wait complete. 2024-06-13T11:26:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.739+0000 7fc65572ab80 1 -- start start 2024-06-13T11:26:55.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.739+0000 7fc65572ab80 1 Processor -- start 2024-06-13T11:26:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.739+0000 7fc65572ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622068fd2c0 0x56220690f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.739+0000 7fc65572ab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562206902c10 0x56220690f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.739+0000 7fc65572ab80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206903530 0x56220690c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.739+0000 7fc65572ab80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc6441aece0 con 0x562206903530 2024-06-13T11:26:55.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.739+0000 7fc65572ab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6441b0150 con 0x562206902c10 2024-06-13T11:26:55.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.739+0000 7fc65572ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc6441af3b0 con 0x5622068fd2c0 2024-06-13T11:26:55.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.740+0000 7fc65572ab80 10 client.0 _ll_register_callbacks cb 0x5622067e4400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:26:55.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.740+0000 7fc648e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206903530 0x56220690c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.740+0000 7fc643e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622068fd2c0 0x56220690f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.740+0000 7fc648e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206903530 0x56220690c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39686/0 (socket says 172.21.15.2:39686) 2024-06-13T11:26:55.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.740+0000 7fc648e00700 1 -- 172.21.15.2:0/2377300334 learned_addr learned my addr 172.21.15.2:0/2377300334 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:55.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.740+0000 7fc643400700 1 --2- 172.21.15.2:0/2377300334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562206902c10 0x56220690f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.740+0000 7fc643e00700 1 -- 172.21.15.2:0/2377300334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562206902c10 msgr2=0x56220690f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:55.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.740+0000 7fc643e00700 1 --2- 172.21.15.2:0/2377300334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562206902c10 0x56220690f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.740+0000 7fc643e00700 1 -- 172.21.15.2:0/2377300334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206903530 msgr2=0x56220690c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:55.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.740+0000 7fc643e00700 1 --2- 172.21.15.2:0/2377300334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206903530 0x56220690c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.740+0000 7fc643e00700 1 -- 172.21.15.2:0/2377300334 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56220690fd90 con 0x5622068fd2c0 2024-06-13T11:26:55.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.740+0000 7fc643400700 1 --2- 172.21.15.2:0/2377300334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562206902c10 0x56220690f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:55.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.740+0000 7fc648e00700 1 --2- 172.21.15.2:0/2377300334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206903530 0x56220690c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:55.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.741+0000 7fc643e00700 1 --2- 172.21.15.2:0/2377300334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622068fd2c0 0x56220690f1d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc634001eb0 tx=0x7fc6340038b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbaa8cb60551a2e4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:55.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.741+0000 7fc62e000700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:26:55.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.741+0000 7fc62e000700 1 -- 172.21.15.2:0/2377300334 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634027050 con 0x5622068fd2c0 2024-06-13T11:26:55.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.741+0000 7fc65572ab80 1 -- 172.21.15.2:0/2377300334 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6300d9040 con 0x5622068fd2c0 2024-06-13T11:26:55.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.741+0000 7fc62e000700 1 -- 172.21.15.2:0/2377300334 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fc634019430 con 0x5622068fd2c0 2024-06-13T11:26:55.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.741+0000 7fc62e000700 1 -- 172.21.15.2:0/2377300334 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc63401e040 con 0x5622068fd2c0 2024-06-13T11:26:55.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.741+0000 7fc65572ab80 10 client.25732 fetch_fsmap learned FSMap version 29 2024-06-13T11:26:55.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.741+0000 7fc65572ab80 1 -- 172.21.15.2:0/2377300334 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562206981cd0 con 0x5622068fd2c0 2024-06-13T11:26:55.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.742+0000 7fc62e000700 1 -- 172.21.15.2:0/2377300334 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6300d9040 con 0x5622068fd2c0 2024-06-13T11:26:55.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.742+0000 7fc62e000700 1 -- 172.21.15.2:0/2377300334 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc63400e670 con 0x5622068fd2c0 2024-06-13T11:26:55.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.742+0000 7fc65572ab80 10 client.25732 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:26:55.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.742+0000 7fc65572ab80 10 client.25732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:26:55.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.742+0000 7fc65572ab80 20 client.25732 populate_metadata read hostname 'smithi002' 2024-06-13T11:26:55.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.742+0000 7fc65572ab80 1 --2- 172.21.15.2:0/2377300334 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562206982310 0x562206984700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:55.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.742+0000 7fc65572ab80 4 client.25732 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-13T11:26:55.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.742+0000 7fc65572ab80 1 -- 172.21.15.2:0/2377300334 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562206856600 con 0x562206982310 2024-06-13T11:26:55.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.743+0000 7fc643400700 1 --2- 172.21.15.2:0/2377300334 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562206982310 0x562206984700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:55.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.743+0000 7fc643400700 1 --2- 172.21.15.2:0/2377300334 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562206982310 0x562206984700 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14783e00f27cc5f0 server_cookie=1535b5ef1da03b7e in_seq=0 out_seq=0 2024-06-13T11:26:55.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.743+0000 7fc62e000700 10 client.25732 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:55.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.744+0000 7fc62e000700 1 -- 172.21.15.2:0/2377300334 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562206856600 con 0x562206982310 2024-06-13T11:26:55.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.744+0000 7fc62e000700 10 client.25732 handle_command_reply: tid=0 2024-06-13T11:26:55.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.744+0000 7fc65572ab80 1 client.25732 shutdown 2024-06-13T11:26:55.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.744+0000 7fc65572ab80 1 -- 172.21.15.2:0/2377300334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622068fd2c0 msgr2=0x56220690f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:55.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.744+0000 7fc65572ab80 1 --2- 172.21.15.2:0/2377300334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622068fd2c0 0x56220690f1d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc634001eb0 tx=0x7fc6340038b0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.745+0000 7fc65572ab80 1 -- 172.21.15.2:0/2377300334 shutdown_connections 2024-06-13T11:26:55.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.745+0000 7fc65572ab80 1 --2- 172.21.15.2:0/2377300334 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x562206982310 0x562206984700 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.745+0000 7fc62e000700 0 client.25732 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:55.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.745+0000 7fc65572ab80 1 --2- 172.21.15.2:0/2377300334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562206903530 0x56220690c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.745+0000 7fc65572ab80 1 --2- 172.21.15.2:0/2377300334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622068fd2c0 0x56220690f1d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.745+0000 7fc65572ab80 1 --2- 172.21.15.2:0/2377300334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562206902c10 0x56220690f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.745+0000 7fc65572ab80 1 -- 172.21.15.2:0/2377300334 >> 172.21.15.2:0/2377300334 conn(0x5622068291f0 msgr2=0x562206905710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:55.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.745+0000 7fc65572ab80 1 -- 172.21.15.2:0/2377300334 shutdown_connections 2024-06-13T11:26:55.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.745+0000 7fc65572ab80 1 -- 172.21.15.2:0/2377300334 wait complete. 2024-06-13T11:26:55.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.745+0000 7fc65572ab80 20 client.25732 trim_cache size 0 max 16384 2024-06-13T11:26:55.752 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:26:55.752 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-06-13T11:26:55.752 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "79a6c418-72b4-432e-a475-21ac23c263ad", 2024-06-13T11:26:55.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-06-13T11:26:55.753 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:26:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.746+0000 7fc64ae00700 1 -- 172.21.15.2:0/4067484916 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6280a2d90 msgr2=0x7fc6280a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:55.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.746+0000 7fc64ae00700 1 --2- 172.21.15.2:0/4067484916 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6280a2d90 0x7fc6280a5250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009fd0 tx=0x7fc63c01f040 comp rx=0 tx=0).stop 2024-06-13T11:26:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.746+0000 7fc64ae00700 1 -- 172.21.15.2:0/4067484916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc644105040 msgr2=0x7fc64419b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.746+0000 7fc64ae00700 1 --2- 172.21.15.2:0/4067484916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc644105040 0x7fc64419b360 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc63000e9c0 tx=0x7fc63000ecd0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.746+0000 7fc64ae00700 1 -- 172.21.15.2:0/4067484916 shutdown_connections 2024-06-13T11:26:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.746+0000 7fc64ae00700 1 --2- 172.21.15.2:0/4067484916 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc6280a2d90 0x7fc6280a5250 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.746+0000 7fc64ae00700 1 --2- 172.21.15.2:0/4067484916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc64410a680 0x7fc64419f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.746+0000 7fc64ae00700 1 --2- 172.21.15.2:0/4067484916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc644104680 0x7fc64419ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.746+0000 7fc64ae00700 1 --2- 172.21.15.2:0/4067484916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc644105040 0x7fc64419b360 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:55.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.746+0000 7fc64ae00700 1 -- 172.21.15.2:0/4067484916 >> 172.21.15.2:0/4067484916 conn(0x7fc644100170 msgr2=0x7fc644100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.746+0000 7fc64ae00700 1 -- 172.21.15.2:0/4067484916 shutdown_connections 2024-06-13T11:26:55.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:55.746+0000 7fc64ae00700 1 -- 172.21.15.2:0/4067484916 wait complete. 2024-06-13T11:26:55.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:55 smithi077 ceph-mon[36410]: pgmap v97: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-06-13T11:26:56.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:56 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:26:56.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:56 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:26:56.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:56 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:26:56.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:56 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:26:56.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:56 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:26:56.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:56 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:26:56.793 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:26:57.283 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:26:57.607 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:57 smithi002 ceph-mon[32210]: scrub queued for path: / 2024-06-13T11:26:57.607 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:57 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:26:57.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:57 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:26:57.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:57 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:26:57.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:57 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:26:57.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:57 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:26:57.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:57 smithi002 ceph-mon[32210]: pgmap v98: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-06-13T11:26:57.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:57 smithi178 ceph-mon[36913]: scrub queued for path: / 2024-06-13T11:26:57.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:57 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:26:57.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:57 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:26:57.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:57 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:26:57.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:57 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:26:57.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:57 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:26:57.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:57 smithi178 ceph-mon[36913]: pgmap v98: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-06-13T11:26:57.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:57 smithi077 ceph-mon[36410]: scrub queued for path: / 2024-06-13T11:26:57.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:57 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:26:57.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:57 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:26:57.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:57 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:26:57.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:57 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:26:57.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:57 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:26:57.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:57 smithi077 ceph-mon[36410]: pgmap v98: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-06-13T11:26:59.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:26:59 smithi002 ceph-mon[32210]: pgmap v99: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2024-06-13T11:26:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.657+0000 7f2926000700 1 -- 172.21.15.2:0/475075443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29201045c0 msgr2=0x7f2920104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.657+0000 7f2926000700 1 --2- 172.21.15.2:0/475075443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29201045c0 0x7f2920104a40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f290c0099c0 tx=0x7f290c009cd0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.658+0000 7f2926000700 1 -- 172.21.15.2:0/475075443 shutdown_connections 2024-06-13T11:26:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.658+0000 7f2926000700 1 --2- 172.21.15.2:0/475075443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2920104f80 0x7f2920111440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.658+0000 7f2926000700 1 --2- 172.21.15.2:0/475075443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f292010a670 0x7f292010aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.658+0000 7f2926000700 1 --2- 172.21.15.2:0/475075443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29201045c0 0x7f2920104a40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.658+0000 7f2926000700 1 -- 172.21.15.2:0/475075443 >> 172.21.15.2:0/475075443 conn(0x7f2920100070 msgr2=0x7f2920102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.658+0000 7f2926000700 1 -- 172.21.15.2:0/475075443 shutdown_connections 2024-06-13T11:26:59.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.658+0000 7f2926000700 1 -- 172.21.15.2:0/475075443 wait complete. 2024-06-13T11:26:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.659+0000 7f2926000700 1 Processor -- start 2024-06-13T11:26:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.659+0000 7f2926000700 1 -- start start 2024-06-13T11:26:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.659+0000 7f2926000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29201045c0 0x7f29201a0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.659+0000 7f2926000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2920104f80 0x7f29201a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.660+0000 7f2926000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f292010a670 0x7f292019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.660+0000 7f2926000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2920114930 con 0x7f29201045c0 2024-06-13T11:26:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.660+0000 7f2926000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f29201147b0 con 0x7f292010a670 2024-06-13T11:26:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.660+0000 7f2926000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2920114ab0 con 0x7f2920104f80 2024-06-13T11:26:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.660+0000 7f2924c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29201045c0 0x7f29201a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.660+0000 7f2924c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29201045c0 0x7f29201a0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60328/0 (socket says 172.21.15.2:60328) 2024-06-13T11:26:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.660+0000 7f2924c00700 1 -- 172.21.15.2:0/804265366 learned_addr learned my addr 172.21.15.2:0/804265366 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.660+0000 7f2925600700 1 --2- 172.21.15.2:0/804265366 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f292010a670 0x7f292019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.660+0000 7f291fe00700 1 --2- 172.21.15.2:0/804265366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2920104f80 0x7f29201a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.660+0000 7f2924c00700 1 -- 172.21.15.2:0/804265366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2920104f80 msgr2=0x7f29201a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.660+0000 7f2924c00700 1 --2- 172.21.15.2:0/804265366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2920104f80 0x7f29201a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.660+0000 7f2924c00700 1 -- 172.21.15.2:0/804265366 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f292010a670 msgr2=0x7f292019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.660+0000 7f2924c00700 1 --2- 172.21.15.2:0/804265366 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f292010a670 0x7f292019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.661+0000 7f2924c00700 1 -- 172.21.15.2:0/804265366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292019b270 con 0x7f29201045c0 2024-06-13T11:26:59.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.661+0000 7f2925600700 1 --2- 172.21.15.2:0/804265366 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f292010a670 0x7f292019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.661+0000 7f2924c00700 1 --2- 172.21.15.2:0/804265366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29201045c0 0x7f29201a0900 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f291400d980 tx=0x7f291400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.661+0000 7f291d600700 1 -- 172.21.15.2:0/804265366 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2914016070 con 0x7f29201045c0 2024-06-13T11:26:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.661+0000 7f2926000700 1 -- 172.21.15.2:0/804265366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292019b560 con 0x7f29201045c0 2024-06-13T11:26:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.661+0000 7f291d600700 1 -- 172.21.15.2:0/804265366 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2914004d10 con 0x7f29201045c0 2024-06-13T11:26:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.661+0000 7f291d600700 1 -- 172.21.15.2:0/804265366 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2914005670 con 0x7f29201045c0 2024-06-13T11:26:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.661+0000 7f2926000700 1 -- 172.21.15.2:0/804265366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29201a77d0 con 0x7f29201045c0 2024-06-13T11:26:59.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.665+0000 7f291d600700 1 -- 172.21.15.2:0/804265366 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f2914004750 con 0x7f29201045c0 2024-06-13T11:26:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.666+0000 7f291d600700 1 --2- 172.21.15.2:0/804265366 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f29080a2e10 0x7f29080a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.666+0000 7f2931fe1b80 1 Processor -- start 2024-06-13T11:26:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.666+0000 7f291d600700 1 -- 172.21.15.2:0/804265366 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f29140cf470 con 0x7f29201045c0 2024-06-13T11:26:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.667+0000 7f2931fe1b80 1 -- start start 2024-06-13T11:26:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.667+0000 7f291fe00700 1 --2- 172.21.15.2:0/804265366 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f29080a2e10 0x7f29080a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.667+0000 7f2931fe1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a1d60 0x55f0b29a2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.667+0000 7f2931fe1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a2680 0x55f0b29acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.667+0000 7f2931fe1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29af920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.667+0000 7f2931fe1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f0b28b1a10 con 0x55f0b29a2680 2024-06-13T11:26:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.667+0000 7f2931fe1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f0b28f4b00 con 0x55f0b29a1d60 2024-06-13T11:26:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.667+0000 7f2931fe1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f0b28af8f0 con 0x55f0b29ad530 2024-06-13T11:26:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.668+0000 7f2924c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a1d60 0x55f0b29a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.668+0000 7f291fe00700 1 --2- 172.21.15.2:0/804265366 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f29080a2e10 0x7f29080a52d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2920109c60 tx=0x7f290c005fb0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.668+0000 7f2924c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a1d60 0x55f0b29a2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:58614/0 (socket says 172.21.15.2:58614) 2024-06-13T11:26:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.668+0000 7f2924c00700 1 -- 172.21.15.2:0/1100798060 learned_addr learned my addr 172.21.15.2:0/1100798060 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.668+0000 7f291fe00700 1 --2- 172.21.15.2:0/1100798060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a2680 0x55f0b29acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.668+0000 7f2925600700 1 --2- 172.21.15.2:0/1100798060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.668+0000 7f2924c00700 1 -- 172.21.15.2:0/1100798060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 msgr2=0x55f0b29af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.668+0000 7f2924c00700 1 --2- 172.21.15.2:0/1100798060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.668+0000 7f2924c00700 1 -- 172.21.15.2:0/1100798060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a2680 msgr2=0x55f0b29acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.668+0000 7f2924c00700 1 --2- 172.21.15.2:0/1100798060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a2680 0x55f0b29acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.668+0000 7f2924c00700 1 -- 172.21.15.2:0/1100798060 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b289cf90 con 0x55f0b29a1d60 2024-06-13T11:26:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.669+0000 7f2924c00700 1 --2- 172.21.15.2:0/1100798060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a1d60 0x55f0b29a2140 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f291409b650 tx=0x7f2914022350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efaab126a001b09a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.669+0000 7f2912000700 1 -- 172.21.15.2:0/1100798060 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29140860c0 con 0x55f0b29a1d60 2024-06-13T11:26:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.669+0000 7f2912000700 1 -- 172.21.15.2:0/1100798060 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f291409b6c0 con 0x55f0b29a1d60 2024-06-13T11:26:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.669+0000 7f2912000700 1 -- 172.21.15.2:0/1100798060 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29140cf150 con 0x55f0b29a1d60 2024-06-13T11:26:59.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.670+0000 7f2931fe1b80 1 -- 172.21.15.2:0/1100798060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a1d60 msgr2=0x55f0b29a2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.670+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/1100798060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a1d60 0x55f0b29a2140 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f291409b650 tx=0x7f2914022350 comp rx=0 tx=0).stop 2024-06-13T11:26:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.670+0000 7f2931fe1b80 1 -- 172.21.15.2:0/1100798060 shutdown_connections 2024-06-13T11:26:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.670+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/1100798060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.670+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/1100798060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a1d60 0x55f0b29a2140 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.670+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/1100798060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a2680 0x55f0b29acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.670+0000 7f2931fe1b80 1 -- 172.21.15.2:0/1100798060 >> 172.21.15.2:0/1100798060 conn(0x55f0b28cf170 msgr2=0x55f0b299e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.670+0000 7f2931fe1b80 1 -- 172.21.15.2:0/1100798060 shutdown_connections 2024-06-13T11:26:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.670+0000 7f2931fe1b80 1 -- 172.21.15.2:0/1100798060 wait complete. 2024-06-13T11:26:59.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.671+0000 7f2931fe1b80 1 -- start start 2024-06-13T11:26:59.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.671+0000 7f2931fe1b80 1 Processor -- start 2024-06-13T11:26:59.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.671+0000 7f2931fe1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a1d60 0x55f0b29acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.672+0000 7f2931fe1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a2680 0x55f0b29aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.672+0000 7f2931fe1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29aa630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.672+0000 7f2931fe1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f0b2890f60 con 0x55f0b29a1d60 2024-06-13T11:26:59.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.672+0000 7f2931fe1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f0b28f0ac0 con 0x55f0b29a2680 2024-06-13T11:26:59.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.672+0000 7f2931fe1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f0b29affc0 con 0x55f0b29ad530 2024-06-13T11:26:59.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.672+0000 7f2931fe1b80 10 client.0 _ll_register_callbacks cb 0x55f0b288a380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:26:59.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.672+0000 7f291fe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a2680 0x55f0b29aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.672+0000 7f2924c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a1d60 0x55f0b29acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.672+0000 7f291fe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a2680 0x55f0b29aa0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:58624/0 (socket says 172.21.15.2:58624) 2024-06-13T11:26:59.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.672+0000 7f291fe00700 1 -- 172.21.15.2:0/1140639273 learned_addr learned my addr 172.21.15.2:0/1140639273 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:59.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.672+0000 7f2925600700 1 --2- 172.21.15.2:0/1140639273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.672+0000 7f291fe00700 1 -- 172.21.15.2:0/1140639273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 msgr2=0x55f0b29aa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:59.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.672+0000 7f291fe00700 1 --2- 172.21.15.2:0/1140639273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29aa630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.672+0000 7f291fe00700 1 -- 172.21.15.2:0/1140639273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a1d60 msgr2=0x55f0b29acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:59.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.672+0000 7f291fe00700 1 --2- 172.21.15.2:0/1140639273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a1d60 0x55f0b29acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.672+0000 7f291fe00700 1 -- 172.21.15.2:0/1140639273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0b28438d0 con 0x55f0b29a2680 2024-06-13T11:26:59.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.673+0000 7f291fe00700 1 --2- 172.21.15.2:0/1140639273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a2680 0x55f0b29aa0f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f290c0099c0 tx=0x7f290c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c75a40c0cf4405f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:59.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.673+0000 7f2906a00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:26:59.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.673+0000 7f2906a00700 1 -- 172.21.15.2:0/1140639273 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c024cb0 con 0x55f0b29a2680 2024-06-13T11:26:59.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.673+0000 7f2931fe1b80 1 -- 172.21.15.2:0/1140639273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f291409b6c0 con 0x55f0b29a2680 2024-06-13T11:26:59.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.673+0000 7f2906a00700 1 -- 172.21.15.2:0/1140639273 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f290c02f460 con 0x55f0b29a2680 2024-06-13T11:26:59.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.673+0000 7f2906a00700 1 -- 172.21.15.2:0/1140639273 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f290c03d050 con 0x55f0b29a2680 2024-06-13T11:26:59.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.673+0000 7f2931fe1b80 10 client.25706 fetch_fsmap learned FSMap version 29 2024-06-13T11:26:59.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.673+0000 7f2931fe1b80 1 -- 172.21.15.2:0/1140639273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f0b29ba860 con 0x55f0b29a2680 2024-06-13T11:26:59.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.674+0000 7f2906a00700 1 -- 172.21.15.2:0/1140639273 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f291409b6c0 con 0x55f0b29a2680 2024-06-13T11:26:59.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.674+0000 7f2906a00700 1 -- 172.21.15.2:0/1140639273 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f290c00f6a0 con 0x55f0b29a2680 2024-06-13T11:26:59.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.674+0000 7f2931fe1b80 10 client.25706 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:26:59.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.674+0000 7f2931fe1b80 10 client.25706 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:26:59.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.674+0000 7f2931fe1b80 20 client.25706 populate_metadata read hostname 'smithi002' 2024-06-13T11:26:59.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.674+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/1140639273 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55f0b29bcea0 0x55f0b29bf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.674+0000 7f2931fe1b80 4 client.25706 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:26:59.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.674+0000 7f2931fe1b80 1 -- 172.21.15.2:0/1140639273 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0b2902000 con 0x55f0b29bcea0 2024-06-13T11:26:59.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.675+0000 7f2924c00700 1 --2- 172.21.15.2:0/1140639273 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55f0b29bcea0 0x55f0b29bf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.675+0000 7f2924c00700 1 --2- 172.21.15.2:0/1140639273 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55f0b29bcea0 0x55f0b29bf300 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43bc0ec54fec6005 server_cookie=e678ddb6f8687a71 in_seq=0 out_seq=0 2024-06-13T11:26:59.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.675+0000 7f2906a00700 10 client.25706 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:59.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.676+0000 7f2906a00700 1 -- 172.21.15.2:0/1140639273 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f0b2902000 con 0x55f0b29bcea0 2024-06-13T11:26:59.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.676+0000 7f2906a00700 10 client.25706 handle_command_reply: tid=0 2024-06-13T11:26:59.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.676+0000 7f2931fe1b80 1 client.25706 shutdown 2024-06-13T11:26:59.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.676+0000 7f2931fe1b80 1 -- 172.21.15.2:0/1140639273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a2680 msgr2=0x55f0b29aa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:59.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.676+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/1140639273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a2680 0x55f0b29aa0f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f290c0099c0 tx=0x7f290c009310 comp rx=0 tx=0).stop 2024-06-13T11:26:59.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.676+0000 7f2931fe1b80 1 -- 172.21.15.2:0/1140639273 shutdown_connections 2024-06-13T11:26:59.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.676+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/1140639273 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55f0b29bcea0 0x55f0b29bf300 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.676+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/1140639273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a1d60 0x55f0b29acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.676+0000 7f2906a00700 0 client.25706 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:59.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.676+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/1140639273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29aa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.676+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/1140639273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a2680 0x55f0b29aa0f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.677+0000 7f2931fe1b80 1 -- 172.21.15.2:0/1140639273 >> 172.21.15.2:0/1140639273 conn(0x55f0b28cf170 msgr2=0x55f0b299de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:59.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.677+0000 7f2931fe1b80 1 -- 172.21.15.2:0/1140639273 shutdown_connections 2024-06-13T11:26:59.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.677+0000 7f2931fe1b80 1 -- 172.21.15.2:0/1140639273 wait complete. 2024-06-13T11:26:59.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.677+0000 7f2931fe1b80 20 client.25706 trim_cache size 0 max 16384 2024-06-13T11:26:59.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:26:59 smithi178 ceph-mon[36913]: pgmap v99: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2024-06-13T11:26:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.700+0000 7f2931fe1b80 1 Processor -- start 2024-06-13T11:26:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.700+0000 7f2931fe1b80 1 -- start start 2024-06-13T11:26:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.700+0000 7f2931fe1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a1d60 0x55f0b29ac930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.700+0000 7f2931fe1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a2680 0x55f0b29c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.700+0000 7f2931fe1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.700+0000 7f2931fe1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f29201b2ca0 con 0x55f0b29a2680 2024-06-13T11:26:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.700+0000 7f2931fe1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f29201b0530 con 0x55f0b29a1d60 2024-06-13T11:26:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.700+0000 7f2931fe1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f29201ae380 con 0x55f0b29ad530 2024-06-13T11:26:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.701+0000 7f291fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a2680 0x55f0b29c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.701+0000 7f291fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a2680 0x55f0b29c4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60356/0 (socket says 172.21.15.2:60356) 2024-06-13T11:26:59.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.701+0000 7f291fe00700 1 -- 172.21.15.2:0/4020653804 learned_addr learned my addr 172.21.15.2:0/4020653804 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:59.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.701+0000 7f2924c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a1d60 0x55f0b29ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.701+0000 7f2925600700 1 --2- 172.21.15.2:0/4020653804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.701+0000 7f2924c00700 1 -- 172.21.15.2:0/4020653804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 msgr2=0x55f0b29c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:59.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.701+0000 7f2924c00700 1 --2- 172.21.15.2:0/4020653804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.701+0000 7f2924c00700 1 -- 172.21.15.2:0/4020653804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a2680 msgr2=0x55f0b29c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:59.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.701+0000 7f2924c00700 1 --2- 172.21.15.2:0/4020653804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a2680 0x55f0b29c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.701+0000 7f2924c00700 1 -- 172.21.15.2:0/4020653804 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b29a8660 con 0x55f0b29a1d60 2024-06-13T11:26:59.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.702+0000 7f2924c00700 1 --2- 172.21.15.2:0/4020653804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a1d60 0x55f0b29ac930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55f0b29a3dd0 tx=0x7f2914097960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faffc542efe421f7 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:59.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.702+0000 7f2911600700 1 -- 172.21.15.2:0/4020653804 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29140860b0 con 0x55f0b29a1d60 2024-06-13T11:26:59.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.702+0000 7f2911600700 1 -- 172.21.15.2:0/4020653804 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29140999c0 con 0x55f0b29a1d60 2024-06-13T11:26:59.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.702+0000 7f2911600700 1 -- 172.21.15.2:0/4020653804 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29140cf150 con 0x55f0b29a1d60 2024-06-13T11:26:59.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.703+0000 7f2931fe1b80 1 -- 172.21.15.2:0/4020653804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a1d60 msgr2=0x55f0b29ac930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:59.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.703+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/4020653804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a1d60 0x55f0b29ac930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55f0b29a3dd0 tx=0x7f2914097960 comp rx=0 tx=0).stop 2024-06-13T11:26:59.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.703+0000 7f2931fe1b80 1 -- 172.21.15.2:0/4020653804 shutdown_connections 2024-06-13T11:26:59.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.703+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/4020653804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.703+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/4020653804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a1d60 0x55f0b29ac930 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.703+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/4020653804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a2680 0x55f0b29c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.703+0000 7f2931fe1b80 1 -- 172.21.15.2:0/4020653804 >> 172.21.15.2:0/4020653804 conn(0x55f0b28cf170 msgr2=0x55f0b29a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:59.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.703+0000 7f2931fe1b80 1 -- 172.21.15.2:0/4020653804 shutdown_connections 2024-06-13T11:26:59.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.703+0000 7f2931fe1b80 1 -- 172.21.15.2:0/4020653804 wait complete. 2024-06-13T11:26:59.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.703+0000 7f2931fe1b80 1 -- start start 2024-06-13T11:26:59.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.704+0000 7f2931fe1b80 1 Processor -- start 2024-06-13T11:26:59.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.704+0000 7f2931fe1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a1d60 0x55f0b29a7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.704+0000 7f2931fe1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a2680 0x55f0b29a76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.704+0000 7f2931fe1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.704+0000 7f2931fe1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f29201ae9f0 con 0x55f0b29a1d60 2024-06-13T11:26:59.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.704+0000 7f2931fe1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f29201afe60 con 0x55f0b29a2680 2024-06-13T11:26:59.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.704+0000 7f2931fe1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f29201af0c0 con 0x55f0b29ad530 2024-06-13T11:26:59.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.704+0000 7f2931fe1b80 10 client.0 _ll_register_callbacks cb 0x55f0b288a380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:26:59.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.705+0000 7f2924c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a1d60 0x55f0b29a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.705+0000 7f291fe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a2680 0x55f0b29a76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.705+0000 7f2925600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.705+0000 7f291fe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a2680 0x55f0b29a76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:58644/0 (socket says 172.21.15.2:58644) 2024-06-13T11:26:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.705+0000 7f2925600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29a7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:54772/0 (socket says 172.21.15.2:54772) 2024-06-13T11:26:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.705+0000 7f2924c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a1d60 0x55f0b29a7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60370/0 (socket says 172.21.15.2:60370) 2024-06-13T11:26:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.705+0000 7f291fe00700 1 -- 172.21.15.2:0/3590648800 learned_addr learned my addr 172.21.15.2:0/3590648800 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:26:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.705+0000 7f291fe00700 1 -- 172.21.15.2:0/3590648800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 msgr2=0x55f0b29a7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.705+0000 7f291fe00700 1 --2- 172.21.15.2:0/3590648800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29a7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.705+0000 7f291fe00700 1 -- 172.21.15.2:0/3590648800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a1d60 msgr2=0x55f0b29a7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:26:59.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.705+0000 7f291fe00700 1 --2- 172.21.15.2:0/3590648800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a1d60 0x55f0b29a7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.705+0000 7f291fe00700 1 -- 172.21.15.2:0/3590648800 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0b2a26c60 con 0x55f0b29a2680 2024-06-13T11:26:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.705+0000 7f2924c00700 1 --2- 172.21.15.2:0/3590648800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a1d60 0x55f0b29a7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:26:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.706+0000 7f291fe00700 1 --2- 172.21.15.2:0/3590648800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a2680 0x55f0b29a76d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f290c009d10 tx=0x7f290c005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=266c01bce01ca0b2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:26:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.706+0000 7f2906a00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:26:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.706+0000 7f2906a00700 1 -- 172.21.15.2:0/3590648800 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c047020 con 0x55f0b29a2680 2024-06-13T11:26:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.706+0000 7f2931fe1b80 1 -- 172.21.15.2:0/3590648800 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29140999c0 con 0x55f0b29a2680 2024-06-13T11:26:59.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.706+0000 7f2906a00700 1 -- 172.21.15.2:0/3590648800 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f290c024cb0 con 0x55f0b29a2680 2024-06-13T11:26:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.706+0000 7f2906a00700 1 -- 172.21.15.2:0/3590648800 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f290c052050 con 0x55f0b29a2680 2024-06-13T11:26:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.706+0000 7f2931fe1b80 10 client.25712 fetch_fsmap learned FSMap version 29 2024-06-13T11:26:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.706+0000 7f2931fe1b80 1 -- 172.21.15.2:0/3590648800 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f0b2a27f30 con 0x55f0b29a2680 2024-06-13T11:26:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.706+0000 7f2906a00700 1 -- 172.21.15.2:0/3590648800 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29140999c0 con 0x55f0b29a2680 2024-06-13T11:26:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.707+0000 7f2906a00700 1 -- 172.21.15.2:0/3590648800 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f290c017bb0 con 0x55f0b29a2680 2024-06-13T11:26:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.707+0000 7f2931fe1b80 10 client.25712 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:26:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.707+0000 7f2931fe1b80 10 client.25712 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:26:59.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.707+0000 7f2931fe1b80 20 client.25712 populate_metadata read hostname 'smithi002' 2024-06-13T11:26:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.707+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/3590648800 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55f0b2a286c0 0x55f0b2a2aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:26:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.707+0000 7f2931fe1b80 4 client.25712 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:26:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.707+0000 7f2931fe1b80 1 -- 172.21.15.2:0/3590648800 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f0b28fc580 con 0x55f0b2a286c0 2024-06-13T11:26:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.707+0000 7f2924c00700 1 --2- 172.21.15.2:0/3590648800 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55f0b2a286c0 0x55f0b2a2aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:26:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.708+0000 7f2924c00700 1 --2- 172.21.15.2:0/3590648800 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55f0b2a286c0 0x55f0b2a2aae0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a7a41c9d70317db server_cookie=b1537917f91b0c05 in_seq=0 out_seq=0 2024-06-13T11:26:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.708+0000 7f2906a00700 10 client.25712 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:59.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.708+0000 7f2906a00700 1 -- 172.21.15.2:0/3590648800 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f0b28fc580 con 0x55f0b2a286c0 2024-06-13T11:26:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.708+0000 7f2906a00700 10 client.25712 handle_command_reply: tid=0 2024-06-13T11:26:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.708+0000 7f2931fe1b80 1 client.25712 shutdown 2024-06-13T11:26:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.708+0000 7f2931fe1b80 1 -- 172.21.15.2:0/3590648800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a2680 msgr2=0x55f0b29a76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.708+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/3590648800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a2680 0x55f0b29a76d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f290c009d10 tx=0x7f290c005c70 comp rx=0 tx=0).stop 2024-06-13T11:26:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.708+0000 7f2931fe1b80 1 -- 172.21.15.2:0/3590648800 shutdown_connections 2024-06-13T11:26:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.708+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/3590648800 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55f0b2a286c0 0x55f0b2a2aae0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.708+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/3590648800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f0b29a1d60 0x55f0b29a7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.708+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/3590648800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0b29ad530 0x55f0b29a7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.708+0000 7f2931fe1b80 1 --2- 172.21.15.2:0/3590648800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f0b29a2680 0x55f0b29a76d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.708+0000 7f2906a00700 0 client.25712 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:26:59.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.708+0000 7f2931fe1b80 1 -- 172.21.15.2:0/3590648800 >> 172.21.15.2:0/3590648800 conn(0x55f0b28cf170 msgr2=0x55f0b29a4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:59.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.708+0000 7f2931fe1b80 1 -- 172.21.15.2:0/3590648800 shutdown_connections 2024-06-13T11:26:59.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.708+0000 7f2931fe1b80 1 -- 172.21.15.2:0/3590648800 wait complete. 2024-06-13T11:26:59.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.709+0000 7f2931fe1b80 20 client.25712 trim_cache size 0 max 16384 2024-06-13T11:26:59.715 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:26:59.715 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-13T11:26:59.715 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-06-13T11:26:59.715 INFO:teuthology.orchestra.run.smithi002.stdout: "79a6c418-72b4-432e-a475-21ac23c263ad": { 2024-06-13T11:26:59.715 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-06-13T11:26:59.715 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "79a6c418-72b4-432e-a475-21ac23c263ad", 2024-06-13T11:26:59.716 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-06-13T11:26:59.716 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:26:59.716 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:26:59.716 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:26:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.709+0000 7f2926000700 1 -- 172.21.15.2:0/804265366 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f29080a2e10 msgr2=0x7f29080a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.709+0000 7f2926000700 1 --2- 172.21.15.2:0/804265366 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f29080a2e10 0x7f29080a52d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2920109c60 tx=0x7f290c005fb0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.709+0000 7f2926000700 1 -- 172.21.15.2:0/804265366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29201045c0 msgr2=0x7f29201a0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:26:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.709+0000 7f2926000700 1 --2- 172.21.15.2:0/804265366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29201045c0 0x7f29201a0900 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f291400d980 tx=0x7f291400dc90 comp rx=0 tx=0).stop 2024-06-13T11:26:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.710+0000 7f2926000700 1 -- 172.21.15.2:0/804265366 shutdown_connections 2024-06-13T11:26:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.710+0000 7f2926000700 1 --2- 172.21.15.2:0/804265366 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f29080a2e10 0x7f29080a52d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.710+0000 7f2926000700 1 --2- 172.21.15.2:0/804265366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29201045c0 0x7f29201a0900 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.710+0000 7f2926000700 1 --2- 172.21.15.2:0/804265366 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f292010a670 0x7f292019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.710+0000 7f2926000700 1 --2- 172.21.15.2:0/804265366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2920104f80 0x7f29201a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:26:59.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.710+0000 7f2926000700 1 -- 172.21.15.2:0/804265366 >> 172.21.15.2:0/804265366 conn(0x7f2920100070 msgr2=0x7f2920101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:26:59.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.710+0000 7f2926000700 1 -- 172.21.15.2:0/804265366 shutdown_connections 2024-06-13T11:26:59.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:26:59.710+0000 7f2926000700 1 -- 172.21.15.2:0/804265366 wait complete. 2024-06-13T11:26:59.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:26:59 smithi077 ceph-mon[36410]: pgmap v99: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2024-06-13T11:27:00.708 INFO:tasks.cephfs.filesystem:scrub status for tag:79a6c418-72b4-432e-a475-21ac23c263ad - {'path': '/', 'tag': '79a6c418-72b4-432e-a475-21ac23c263ad', 'options': 'recursive,force'} 2024-06-13T11:27:01.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:01 smithi002 ceph-mon[32210]: pgmap v100: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-06-13T11:27:01.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:01 smithi178 ceph-mon[36913]: pgmap v100: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-06-13T11:27:01.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:01 smithi077 ceph-mon[36410]: pgmap v100: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-06-13T11:27:02.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:02 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:27:02.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:02 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:27:02.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:02 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:27:02.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:02 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:27:02.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:02 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:27:02.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:02 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:27:02.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:02 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:27:02.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:02 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:27:02.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:02 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:27:03.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:03 smithi002 ceph-mon[32210]: pgmap v101: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-06-13T11:27:03.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:03 smithi178 ceph-mon[36913]: pgmap v101: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-06-13T11:27:03.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:03 smithi077 ceph-mon[36410]: pgmap v101: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-06-13T11:27:05.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:05 smithi002 ceph-mon[32210]: pgmap v102: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-06-13T11:27:05.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:05 smithi178 ceph-mon[36913]: pgmap v102: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-06-13T11:27:05.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:05 smithi077 ceph-mon[36410]: pgmap v102: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-06-13T11:27:06.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:06 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:27:06.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:06 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:27:06.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:06 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:27:07.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:07 smithi002 ceph-mon[32210]: pgmap v103: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-06-13T11:27:07.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:07 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:27:07.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:07 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:27:07.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:07 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:27:07.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:07 smithi178 ceph-mon[36913]: pgmap v103: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-06-13T11:27:07.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:07 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:27:07.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:07 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:27:07.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:07 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:27:07.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:07 smithi077 ceph-mon[36410]: pgmap v103: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-06-13T11:27:07.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:07 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:27:07.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:07 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:27:07.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:07 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:27:09.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:09 smithi002 ceph-mon[32210]: pgmap v104: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 23 op/s 2024-06-13T11:27:09.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:09 smithi178 ceph-mon[36913]: pgmap v104: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 23 op/s 2024-06-13T11:27:09.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:09 smithi077 ceph-mon[36410]: pgmap v104: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 23 op/s 2024-06-13T11:27:11.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:11 smithi002 ceph-mon[32210]: pgmap v105: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-06-13T11:27:11.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:11 smithi178 ceph-mon[36913]: pgmap v105: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-06-13T11:27:11.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:11 smithi077 ceph-mon[36410]: pgmap v105: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-06-13T11:27:13.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:13 smithi002 ceph-mon[32210]: pgmap v106: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-06-13T11:27:13.698 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:13 smithi178 ceph-mon[36913]: pgmap v106: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-06-13T11:27:13.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:13 smithi077 ceph-mon[36410]: pgmap v106: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-06-13T11:27:15.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:15 smithi002 ceph-mon[32210]: pgmap v107: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-06-13T11:27:15.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:15 smithi178 ceph-mon[36913]: pgmap v107: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-06-13T11:27:15.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:15 smithi077 ceph-mon[36410]: pgmap v107: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-06-13T11:27:17.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:17 smithi002 ceph-mon[32210]: pgmap v108: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-06-13T11:27:17.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:17 smithi178 ceph-mon[36913]: pgmap v108: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-06-13T11:27:17.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:17 smithi077 ceph-mon[36410]: pgmap v108: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-06-13T11:27:19.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:19 smithi002 ceph-mon[32210]: pgmap v109: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-06-13T11:27:19.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:19 smithi178 ceph-mon[36913]: pgmap v109: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-06-13T11:27:19.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:19 smithi077 ceph-mon[36410]: pgmap v109: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-06-13T11:27:21.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:21 smithi002 ceph-mon[32210]: pgmap v110: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-13T11:27:21.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:21 smithi178 ceph-mon[36913]: pgmap v110: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-13T11:27:21.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:21 smithi077 ceph-mon[36410]: pgmap v110: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-13T11:27:23.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:23 smithi178 ceph-mon[36913]: pgmap v111: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 7 op/s 2024-06-13T11:27:23.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:23 smithi077 ceph-mon[36410]: pgmap v111: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 7 op/s 2024-06-13T11:27:23.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:23 smithi002 ceph-mon[32210]: pgmap v111: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 7 op/s 2024-06-13T11:27:25.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:25 smithi178 ceph-mon[36913]: pgmap v112: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-13T11:27:25.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:25 smithi077 ceph-mon[36410]: pgmap v112: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-13T11:27:25.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:25 smithi002 ceph-mon[32210]: pgmap v112: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-13T11:27:27.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:27 smithi178 ceph-mon[36913]: pgmap v113: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-13T11:27:27.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:27 smithi077 ceph-mon[36410]: pgmap v113: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-13T11:27:27.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:27 smithi002 ceph-mon[32210]: pgmap v113: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-13T11:27:29.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:29 smithi178 ceph-mon[36913]: pgmap v114: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.3 KiB/s wr, 8 op/s 2024-06-13T11:27:29.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:29 smithi077 ceph-mon[36410]: pgmap v114: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.3 KiB/s wr, 8 op/s 2024-06-13T11:27:29.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:29 smithi002 ceph-mon[32210]: pgmap v114: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.3 KiB/s wr, 8 op/s 2024-06-13T11:27:30.709 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:27:31.194 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:27:31.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:31 smithi178 ceph-mon[36913]: pgmap v115: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-06-13T11:27:31.745 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:31 smithi002 ceph-mon[32210]: pgmap v115: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-06-13T11:27:31.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:31 smithi077 ceph-mon[36410]: pgmap v115: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-06-13T11:27:33.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.644+0000 7f605ea00700 1 -- 172.21.15.2:0/3538502377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6058109480 msgr2=0x7f6058115990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:33.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.644+0000 7f605ea00700 1 --2- 172.21.15.2:0/3538502377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6058109480 0x7f6058115990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6050009f90 tx=0x7f605000b330 comp rx=0 tx=0).stop 2024-06-13T11:27:33.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.644+0000 7f605ea00700 1 -- 172.21.15.2:0/3538502377 shutdown_connections 2024-06-13T11:27:33.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.644+0000 7f605ea00700 1 --2- 172.21.15.2:0/3538502377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6058109480 0x7f6058115990 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.644+0000 7f605ea00700 1 --2- 172.21.15.2:0/3538502377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f605810eac0 0x7f605810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.644+0000 7f605ea00700 1 --2- 172.21.15.2:0/3538502377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6058108ac0 0x7f6058108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.644+0000 7f605ea00700 1 -- 172.21.15.2:0/3538502377 >> 172.21.15.2:0/3538502377 conn(0x7f6058075c60 msgr2=0x7f60581072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:33.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.645+0000 7f605ea00700 1 -- 172.21.15.2:0/3538502377 shutdown_connections 2024-06-13T11:27:33.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.645+0000 7f605ea00700 1 -- 172.21.15.2:0/3538502377 wait complete. 2024-06-13T11:27:33.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:33 smithi002 ceph-mon[32210]: pgmap v116: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.5 KiB/s wr, 9 op/s 2024-06-13T11:27:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.646+0000 7f605ea00700 1 Processor -- start 2024-06-13T11:27:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.646+0000 7f605ea00700 1 -- start start 2024-06-13T11:27:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.647+0000 7f605ea00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6058108ac0 0x7f605819f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.647+0000 7f605ea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6058109480 0x7f605819f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.647+0000 7f605ea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f605810eac0 0x7f60581a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.647+0000 7f605ea00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6058118ea0 con 0x7f605810eac0 2024-06-13T11:27:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.647+0000 7f605ea00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6058118d20 con 0x7f6058108ac0 2024-06-13T11:27:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.647+0000 7f605ea00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6058119020 con 0x7f6058109480 2024-06-13T11:27:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.647+0000 7f6057e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6058108ac0 0x7f605819f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.647+0000 7f6057400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6058109480 0x7f605819f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.647+0000 7f6057e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6058108ac0 0x7f605819f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:48376/0 (socket says 172.21.15.2:48376) 2024-06-13T11:27:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.647+0000 7f6057400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6058109480 0x7f605819f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:38298/0 (socket says 172.21.15.2:38298) 2024-06-13T11:27:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.647+0000 7f6057e00700 1 -- 172.21.15.2:0/799685133 learned_addr learned my addr 172.21.15.2:0/799685133 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.647+0000 7f605ca00700 1 --2- 172.21.15.2:0/799685133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f605810eac0 0x7f60581a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.648+0000 7f6057e00700 1 -- 172.21.15.2:0/799685133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6058109480 msgr2=0x7f605819f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.648+0000 7f6057e00700 1 --2- 172.21.15.2:0/799685133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6058109480 0x7f605819f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.648+0000 7f6057e00700 1 -- 172.21.15.2:0/799685133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f605810eac0 msgr2=0x7f60581a3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.648+0000 7f6057e00700 1 --2- 172.21.15.2:0/799685133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f605810eac0 0x7f60581a3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.648+0000 7f6057e00700 1 -- 172.21.15.2:0/799685133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60581a4200 con 0x7f6058108ac0 2024-06-13T11:27:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.648+0000 7f6057400700 1 --2- 172.21.15.2:0/799685133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6058109480 0x7f605819f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:27:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.648+0000 7f6057e00700 1 --2- 172.21.15.2:0/799685133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6058108ac0 0x7f605819f1f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f604800eb30 tx=0x7f604800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.648+0000 7f6054c00700 1 -- 172.21.15.2:0/799685133 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604800cbd0 con 0x7f6058108ac0 2024-06-13T11:27:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.648+0000 7f6054c00700 1 -- 172.21.15.2:0/799685133 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6048004500 con 0x7f6058108ac0 2024-06-13T11:27:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.648+0000 7f605ea00700 1 -- 172.21.15.2:0/799685133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60581a44f0 con 0x7f6058108ac0 2024-06-13T11:27:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.649+0000 7f6054c00700 1 -- 172.21.15.2:0/799685133 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048010430 con 0x7f6058108ac0 2024-06-13T11:27:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.649+0000 7f605ea00700 1 -- 172.21.15.2:0/799685133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60581abd70 con 0x7f6058108ac0 2024-06-13T11:27:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.652+0000 7f6054c00700 1 -- 172.21.15.2:0/799685133 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f6048003f00 con 0x7f6058108ac0 2024-06-13T11:27:33.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.653+0000 7f6069449b80 1 Processor -- start 2024-06-13T11:27:33.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.653+0000 7f6069449b80 1 -- start start 2024-06-13T11:27:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.653+0000 7f6054c00700 1 --2- 172.21.15.2:0/799685133 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f603c0a2e10 0x7f603c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.654+0000 7f6054c00700 1 -- 172.21.15.2:0/799685133 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f60480cfaa0 con 0x7f6058108ac0 2024-06-13T11:27:33.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.654+0000 7f6069449b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c8b90 0x55dbb85c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.654+0000 7f6069449b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c94b0 0x55dbb85c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.654+0000 7f6069449b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c3240 0x55dbb85c3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.654+0000 7f6069449b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dbb84d1a10 con 0x55dbb85c3240 2024-06-13T11:27:33.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.654+0000 7f6069449b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dbb8514b00 con 0x55dbb85c8b90 2024-06-13T11:27:33.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.654+0000 7f6069449b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55dbb84cf8f0 con 0x55dbb85c94b0 2024-06-13T11:27:33.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.654+0000 7f605ca00700 1 --2- 172.21.15.2:0/799685133 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f603c0a2e10 0x7f603c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.654+0000 7f6057e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c8b90 0x55dbb85c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.654+0000 7f6057e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c8b90 0x55dbb85c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:48388/0 (socket says 172.21.15.2:48388) 2024-06-13T11:27:33.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.654+0000 7f6057e00700 1 -- 172.21.15.2:0/473314121 learned_addr learned my addr 172.21.15.2:0/473314121 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:33.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.654+0000 7f6057400700 1 --2- 172.21.15.2:0/473314121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c94b0 0x55dbb85c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.655+0000 7f605ca00700 1 --2- 172.21.15.2:0/473314121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c3240 0x55dbb85c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.655+0000 7f6057e00700 1 -- 172.21.15.2:0/473314121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c94b0 msgr2=0x55dbb85c2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.655+0000 7f6057e00700 1 --2- 172.21.15.2:0/473314121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c94b0 0x55dbb85c2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.655+0000 7f6057e00700 1 -- 172.21.15.2:0/473314121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c3240 msgr2=0x55dbb85c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.655+0000 7f6057e00700 1 --2- 172.21.15.2:0/473314121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c3240 0x55dbb85c3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.655+0000 7f6057e00700 1 -- 172.21.15.2:0/473314121 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbb84bcf90 con 0x55dbb85c8b90 2024-06-13T11:27:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.655+0000 7f605ca00700 1 --2- 172.21.15.2:0/473314121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c3240 0x55dbb85c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:27:33.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.655+0000 7f6057e00700 1 --2- 172.21.15.2:0/473314121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c8b90 0x55dbb85c8f70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6048009fd0 tx=0x7f604809b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be26d4f956380cdc server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:33.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.655+0000 7f605ca00700 1 --2- 172.21.15.2:0/799685133 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f603c0a2e10 0x7f603c0a52d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f605000b6c0 tx=0x7f60500093a0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:33.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.655+0000 7f604d600700 1 -- 172.21.15.2:0/473314121 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60480b2070 con 0x55dbb85c8b90 2024-06-13T11:27:33.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.655+0000 7f604d600700 1 -- 172.21.15.2:0/473314121 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f604809c2f0 con 0x55dbb85c8b90 2024-06-13T11:27:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.655+0000 7f604d600700 1 -- 172.21.15.2:0/473314121 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604809be50 con 0x55dbb85c8b90 2024-06-13T11:27:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.656+0000 7f6069449b80 1 -- 172.21.15.2:0/473314121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c8b90 msgr2=0x55dbb85c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.656+0000 7f6069449b80 1 --2- 172.21.15.2:0/473314121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c8b90 0x55dbb85c8f70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6048009fd0 tx=0x7f604809b9c0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.656+0000 7f6069449b80 1 -- 172.21.15.2:0/473314121 shutdown_connections 2024-06-13T11:27:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.656+0000 7f6069449b80 1 --2- 172.21.15.2:0/473314121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c3240 0x55dbb85c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.656+0000 7f6069449b80 1 --2- 172.21.15.2:0/473314121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c8b90 0x55dbb85c8f70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.656+0000 7f6069449b80 1 --2- 172.21.15.2:0/473314121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c94b0 0x55dbb85c2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.656+0000 7f6069449b80 1 -- 172.21.15.2:0/473314121 >> 172.21.15.2:0/473314121 conn(0x55dbb84ef170 msgr2=0x55dbb85bdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.656+0000 7f6069449b80 1 -- 172.21.15.2:0/473314121 shutdown_connections 2024-06-13T11:27:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.657+0000 7f6069449b80 1 -- 172.21.15.2:0/473314121 wait complete. 2024-06-13T11:27:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.657+0000 7f6069449b80 1 -- start start 2024-06-13T11:27:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.657+0000 7f6069449b80 1 Processor -- start 2024-06-13T11:27:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.658+0000 7f6069449b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c3240 0x55dbb85cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.658+0000 7f6069449b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c8b90 0x55dbb85cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.658+0000 7f6069449b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c94b0 0x55dbb85ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.658+0000 7f6069449b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dbb84b0f60 con 0x55dbb85c8b90 2024-06-13T11:27:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.658+0000 7f6069449b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dbb8510ac0 con 0x55dbb85c3240 2024-06-13T11:27:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.658+0000 7f6069449b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55dbb85cfe90 con 0x55dbb85c94b0 2024-06-13T11:27:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.658+0000 7f6057e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c3240 0x55dbb85cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.658+0000 7f6057400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c8b90 0x55dbb85cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.658+0000 7f6069449b80 10 client.0 _ll_register_callbacks cb 0x55dbb84aa380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:27:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.658+0000 7f6057400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c8b90 0x55dbb85cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38788/0 (socket says 172.21.15.2:38788) 2024-06-13T11:27:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.658+0000 7f6057400700 1 -- 172.21.15.2:0/2929236441 learned_addr learned my addr 172.21.15.2:0/2929236441 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.659+0000 7f605ca00700 1 --2- 172.21.15.2:0/2929236441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c94b0 0x55dbb85ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.659+0000 7f6057e00700 1 -- 172.21.15.2:0/2929236441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c94b0 msgr2=0x55dbb85ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.659+0000 7f6057e00700 1 --2- 172.21.15.2:0/2929236441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c94b0 0x55dbb85ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.659+0000 7f6057e00700 1 -- 172.21.15.2:0/2929236441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c8b90 msgr2=0x55dbb85cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.659+0000 7f6057e00700 1 --2- 172.21.15.2:0/2929236441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c8b90 0x55dbb85cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.659+0000 7f6057e00700 1 -- 172.21.15.2:0/2929236441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbb84638d0 con 0x55dbb85c3240 2024-06-13T11:27:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.659+0000 7f6057400700 1 --2- 172.21.15.2:0/2929236441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c8b90 0x55dbb85cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:27:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.659+0000 7f6057e00700 1 --2- 172.21.15.2:0/2929236441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c3240 0x55dbb85cf290 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f60480a4a20 tx=0x7f60480cce40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4149f276b6740352 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.659+0000 7f6042000700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:27:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.659+0000 7f6042000700 1 -- 172.21.15.2:0/2929236441 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60480b2070 con 0x55dbb85c3240 2024-06-13T11:27:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.659+0000 7f6042000700 1 -- 172.21.15.2:0/2929236441 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f6048098260 con 0x55dbb85c3240 2024-06-13T11:27:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.659+0000 7f6069449b80 1 -- 172.21.15.2:0/2929236441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f604809c2f0 con 0x55dbb85c3240 2024-06-13T11:27:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.660+0000 7f6042000700 1 -- 172.21.15.2:0/2929236441 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f60480ba070 con 0x55dbb85c3240 2024-06-13T11:27:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.660+0000 7f6069449b80 10 client.25724 fetch_fsmap learned FSMap version 29 2024-06-13T11:27:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.660+0000 7f6069449b80 1 -- 172.21.15.2:0/2929236441 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dbb85da5d0 con 0x55dbb85c3240 2024-06-13T11:27:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.660+0000 7f6042000700 1 -- 172.21.15.2:0/2929236441 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f604809c2f0 con 0x55dbb85c3240 2024-06-13T11:27:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.660+0000 7f6042000700 1 -- 172.21.15.2:0/2929236441 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f60480a43d0 con 0x55dbb85c3240 2024-06-13T11:27:33.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.660+0000 7f6069449b80 10 client.25724 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:27:33.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.660+0000 7f6069449b80 10 client.25724 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:27:33.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.660+0000 7f6069449b80 20 client.25724 populate_metadata read hostname 'smithi002' 2024-06-13T11:27:33.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.660+0000 7f6069449b80 1 --2- 172.21.15.2:0/2929236441 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55dbb85dcaa0 0x55dbb85dee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.660+0000 7f6069449b80 4 client.25724 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:27:33.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.660+0000 7f6069449b80 1 -- 172.21.15.2:0/2929236441 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbb8522000 con 0x55dbb85dcaa0 2024-06-13T11:27:33.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.661+0000 7f6057400700 1 --2- 172.21.15.2:0/2929236441 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55dbb85dcaa0 0x55dbb85dee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.661+0000 7f6057400700 1 --2- 172.21.15.2:0/2929236441 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55dbb85dcaa0 0x55dbb85dee90 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b615b568be1df351 server_cookie=fe2188561e798351 in_seq=0 out_seq=0 2024-06-13T11:27:33.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.661+0000 7f6042000700 10 client.25724 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:27:33.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.662+0000 7f6042000700 1 -- 172.21.15.2:0/2929236441 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55dbb8522000 con 0x55dbb85dcaa0 2024-06-13T11:27:33.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.662+0000 7f6042000700 10 client.25724 handle_command_reply: tid=0 2024-06-13T11:27:33.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.662+0000 7f6069449b80 1 client.25724 shutdown 2024-06-13T11:27:33.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.662+0000 7f6069449b80 1 -- 172.21.15.2:0/2929236441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c3240 msgr2=0x55dbb85cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:33.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.662+0000 7f6069449b80 1 --2- 172.21.15.2:0/2929236441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c3240 0x55dbb85cf290 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f60480a4a20 tx=0x7f60480cce40 comp rx=0 tx=0).stop 2024-06-13T11:27:33.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.663+0000 7f6069449b80 1 -- 172.21.15.2:0/2929236441 shutdown_connections 2024-06-13T11:27:33.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.663+0000 7f6069449b80 1 --2- 172.21.15.2:0/2929236441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c94b0 0x55dbb85ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.663+0000 7f6069449b80 1 --2- 172.21.15.2:0/2929236441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c3240 0x55dbb85cf290 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.663+0000 7f6069449b80 1 --2- 172.21.15.2:0/2929236441 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55dbb85dcaa0 0x55dbb85dee90 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.663+0000 7f6069449b80 1 --2- 172.21.15.2:0/2929236441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c8b90 0x55dbb85cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.663+0000 7f6042000700 0 client.25724 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:27:33.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.663+0000 7f6069449b80 1 -- 172.21.15.2:0/2929236441 >> 172.21.15.2:0/2929236441 conn(0x55dbb84ef170 msgr2=0x55dbb85b7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:33.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.663+0000 7f6069449b80 1 -- 172.21.15.2:0/2929236441 shutdown_connections 2024-06-13T11:27:33.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.663+0000 7f6069449b80 1 -- 172.21.15.2:0/2929236441 wait complete. 2024-06-13T11:27:33.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.663+0000 7f6069449b80 20 client.25724 trim_cache size 0 max 16384 2024-06-13T11:27:33.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.686+0000 7f6069449b80 1 Processor -- start 2024-06-13T11:27:33.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.687+0000 7f6069449b80 1 -- start start 2024-06-13T11:27:33.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.687+0000 7f6069449b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c3240 0x55dbb85c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.687+0000 7f6069449b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c8b90 0x55dbb85b8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.687+0000 7f6069449b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c94b0 0x55dbb85c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.687+0000 7f6069449b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f60581b7310 con 0x55dbb85c3240 2024-06-13T11:27:33.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.687+0000 7f6069449b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f60581b4ba0 con 0x55dbb85c94b0 2024-06-13T11:27:33.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.687+0000 7f6069449b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f60581b29f0 con 0x55dbb85c8b90 2024-06-13T11:27:33.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.687+0000 7f6057e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c3240 0x55dbb85c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.687+0000 7f6057400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c8b90 0x55dbb85b8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.687+0000 7f6057400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c8b90 0x55dbb85b8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:38320/0 (socket says 172.21.15.2:38320) 2024-06-13T11:27:33.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.687+0000 7f6057400700 1 -- 172.21.15.2:0/1437211927 learned_addr learned my addr 172.21.15.2:0/1437211927 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:33.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.687+0000 7f605ca00700 1 --2- 172.21.15.2:0/1437211927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c94b0 0x55dbb85c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.688+0000 7f6057400700 1 -- 172.21.15.2:0/1437211927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c94b0 msgr2=0x55dbb85c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:33.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.688+0000 7f6057400700 1 --2- 172.21.15.2:0/1437211927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c94b0 0x55dbb85c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.688+0000 7f6057400700 1 -- 172.21.15.2:0/1437211927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c3240 msgr2=0x55dbb85c2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:33.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.688+0000 7f6057400700 1 --2- 172.21.15.2:0/1437211927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c3240 0x55dbb85c2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.688+0000 7f6057400700 1 -- 172.21.15.2:0/1437211927 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbb85cab00 con 0x55dbb85c8b90 2024-06-13T11:27:33.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.688+0000 7f6057400700 1 --2- 172.21.15.2:0/1437211927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c8b90 0x55dbb85b8130 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6044005fd0 tx=0x7f6044009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11e10f1555c6b0b5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:33.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.688+0000 7f604cc00700 1 -- 172.21.15.2:0/1437211927 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604400f720 con 0x55dbb85c8b90 2024-06-13T11:27:33.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.689+0000 7f604cc00700 1 -- 172.21.15.2:0/1437211927 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f604400fda0 con 0x55dbb85c8b90 2024-06-13T11:27:33.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.689+0000 7f604cc00700 1 -- 172.21.15.2:0/1437211927 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044010e60 con 0x55dbb85c8b90 2024-06-13T11:27:33.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.689+0000 7f6069449b80 1 -- 172.21.15.2:0/1437211927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c8b90 msgr2=0x55dbb85b8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:33.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.689+0000 7f6069449b80 1 --2- 172.21.15.2:0/1437211927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c8b90 0x55dbb85b8130 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6044005fd0 tx=0x7f6044009310 comp rx=0 tx=0).stop 2024-06-13T11:27:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.689+0000 7f6069449b80 1 -- 172.21.15.2:0/1437211927 shutdown_connections 2024-06-13T11:27:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.689+0000 7f6069449b80 1 --2- 172.21.15.2:0/1437211927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c3240 0x55dbb85c2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.689+0000 7f6069449b80 1 --2- 172.21.15.2:0/1437211927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c94b0 0x55dbb85c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.689+0000 7f6069449b80 1 --2- 172.21.15.2:0/1437211927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c8b90 0x55dbb85b8130 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.689+0000 7f6069449b80 1 -- 172.21.15.2:0/1437211927 >> 172.21.15.2:0/1437211927 conn(0x55dbb84ef170 msgr2=0x55dbb85c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.689+0000 7f6069449b80 1 -- 172.21.15.2:0/1437211927 shutdown_connections 2024-06-13T11:27:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.689+0000 7f6069449b80 1 -- 172.21.15.2:0/1437211927 wait complete. 2024-06-13T11:27:33.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.690+0000 7f6069449b80 1 -- start start 2024-06-13T11:27:33.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.690+0000 7f6069449b80 1 Processor -- start 2024-06-13T11:27:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f6069449b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c3240 0x55dbb85e2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f6069449b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c8b90 0x55dbb85df850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f6069449b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c94b0 0x55dbb85dfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f6069449b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f60581b3060 con 0x55dbb85c8b90 2024-06-13T11:27:33.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f6069449b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f60581b44d0 con 0x55dbb85c3240 2024-06-13T11:27:33.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f6069449b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f60581b3730 con 0x55dbb85c94b0 2024-06-13T11:27:33.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f6069449b80 10 client.0 _ll_register_callbacks cb 0x55dbb84aa380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:27:33.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f6057400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c8b90 0x55dbb85df850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f6057e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c3240 0x55dbb85e2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f6057400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c8b90 0x55dbb85df850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38808/0 (socket says 172.21.15.2:38808) 2024-06-13T11:27:33.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f6057400700 1 -- 172.21.15.2:0/875688541 learned_addr learned my addr 172.21.15.2:0/875688541 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:33.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f605ca00700 1 --2- 172.21.15.2:0/875688541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c94b0 0x55dbb85dfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f6057e00700 1 -- 172.21.15.2:0/875688541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c94b0 msgr2=0x55dbb85dfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:33.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f6057e00700 1 --2- 172.21.15.2:0/875688541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c94b0 0x55dbb85dfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f6057e00700 1 -- 172.21.15.2:0/875688541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c8b90 msgr2=0x55dbb85df850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:33.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f6057e00700 1 --2- 172.21.15.2:0/875688541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c8b90 0x55dbb85df850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.691+0000 7f6057e00700 1 -- 172.21.15.2:0/875688541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbb85e03d0 con 0x55dbb85c3240 2024-06-13T11:27:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.692+0000 7f605ca00700 1 --2- 172.21.15.2:0/875688541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c94b0 0x55dbb85dfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:27:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.692+0000 7f6057400700 1 --2- 172.21.15.2:0/875688541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c8b90 0x55dbb85df850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:27:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.692+0000 7f6057e00700 1 --2- 172.21.15.2:0/875688541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c3240 0x55dbb85e2460 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f604809b8f0 tx=0x7f6048097890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abc458e420411b49 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.692+0000 7f6042000700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:27:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.692+0000 7f6042000700 1 -- 172.21.15.2:0/875688541 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60480b2040 con 0x55dbb85c3240 2024-06-13T11:27:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.692+0000 7f6042000700 1 -- 172.21.15.2:0/875688541 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f604809be50 con 0x55dbb85c3240 2024-06-13T11:27:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.692+0000 7f6069449b80 1 -- 172.21.15.2:0/875688541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f604400fda0 con 0x55dbb85c3240 2024-06-13T11:27:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.693+0000 7f6042000700 1 -- 172.21.15.2:0/875688541 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f604809b360 con 0x55dbb85c3240 2024-06-13T11:27:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.693+0000 7f6069449b80 10 client.25730 fetch_fsmap learned FSMap version 29 2024-06-13T11:27:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.693+0000 7f6069449b80 1 -- 172.21.15.2:0/875688541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dbb85e03d0 con 0x55dbb85c3240 2024-06-13T11:27:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.693+0000 7f6042000700 1 -- 172.21.15.2:0/875688541 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f604400fda0 con 0x55dbb85c3240 2024-06-13T11:27:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.693+0000 7f6042000700 1 -- 172.21.15.2:0/875688541 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f604809ab30 con 0x55dbb85c3240 2024-06-13T11:27:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.693+0000 7f6069449b80 10 client.25730 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:27:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.693+0000 7f6069449b80 10 client.25730 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:27:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.693+0000 7f6069449b80 20 client.25730 populate_metadata read hostname 'smithi002' 2024-06-13T11:27:33.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.693+0000 7f6069449b80 1 --2- 172.21.15.2:0/875688541 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55dbb8647630 0x55dbb8649a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:33.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.693+0000 7f6069449b80 4 client.25730 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:27:33.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.693+0000 7f6069449b80 1 -- 172.21.15.2:0/875688541 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dbb851c580 con 0x55dbb8647630 2024-06-13T11:27:33.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.694+0000 7f6057400700 1 --2- 172.21.15.2:0/875688541 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55dbb8647630 0x55dbb8649a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:33.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.694+0000 7f6042000700 10 client.25730 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:27:33.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.694+0000 7f6057400700 1 --2- 172.21.15.2:0/875688541 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55dbb8647630 0x55dbb8649a50 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19bc0698a7ba8f47 server_cookie=63aeb0eab508d1c7 in_seq=0 out_seq=0 2024-06-13T11:27:33.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.694+0000 7f6042000700 1 -- 172.21.15.2:0/875688541 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55dbb851c580 con 0x55dbb8647630 2024-06-13T11:27:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.694+0000 7f6042000700 10 client.25730 handle_command_reply: tid=0 2024-06-13T11:27:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.694+0000 7f6069449b80 1 client.25730 shutdown 2024-06-13T11:27:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.695+0000 7f6069449b80 1 -- 172.21.15.2:0/875688541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c3240 msgr2=0x55dbb85e2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.695+0000 7f6069449b80 1 --2- 172.21.15.2:0/875688541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c3240 0x55dbb85e2460 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f604809b8f0 tx=0x7f6048097890 comp rx=0 tx=0).stop 2024-06-13T11:27:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.695+0000 7f6069449b80 1 -- 172.21.15.2:0/875688541 shutdown_connections 2024-06-13T11:27:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.695+0000 7f6069449b80 1 --2- 172.21.15.2:0/875688541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbb85c94b0 0x55dbb85dfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.695+0000 7f6069449b80 1 --2- 172.21.15.2:0/875688541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dbb85c3240 0x55dbb85e2460 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.695+0000 7f6069449b80 1 --2- 172.21.15.2:0/875688541 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55dbb8647630 0x55dbb8649a50 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.695+0000 7f6069449b80 1 --2- 172.21.15.2:0/875688541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbb85c8b90 0x55dbb85df850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.695+0000 7f6042000700 0 client.25730 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:27:33.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.695+0000 7f6069449b80 1 -- 172.21.15.2:0/875688541 >> 172.21.15.2:0/875688541 conn(0x55dbb84ef170 msgr2=0x55dbb85c7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:33.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.695+0000 7f6069449b80 1 -- 172.21.15.2:0/875688541 shutdown_connections 2024-06-13T11:27:33.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.695+0000 7f6069449b80 1 -- 172.21.15.2:0/875688541 wait complete. 2024-06-13T11:27:33.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.695+0000 7f6069449b80 20 client.25730 trim_cache size 0 max 16384 2024-06-13T11:27:33.703 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:27:33.703 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-06-13T11:27:33.703 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-06-13T11:27:33.703 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:27:33.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.696+0000 7f605ea00700 1 -- 172.21.15.2:0/799685133 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f603c0a2e10 msgr2=0x7f603c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:33.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.696+0000 7f605ea00700 1 --2- 172.21.15.2:0/799685133 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f603c0a2e10 0x7f603c0a52d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f605000b6c0 tx=0x7f60500093a0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.696+0000 7f605ea00700 1 -- 172.21.15.2:0/799685133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6058108ac0 msgr2=0x7f605819f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:33.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.696+0000 7f605ea00700 1 --2- 172.21.15.2:0/799685133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6058108ac0 0x7f605819f1f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f604800eb30 tx=0x7f604800ee40 comp rx=0 tx=0).stop 2024-06-13T11:27:33.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.696+0000 7f605ea00700 1 -- 172.21.15.2:0/799685133 shutdown_connections 2024-06-13T11:27:33.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.696+0000 7f605ea00700 1 --2- 172.21.15.2:0/799685133 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f603c0a2e10 0x7f603c0a52d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.696+0000 7f605ea00700 1 --2- 172.21.15.2:0/799685133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f605810eac0 0x7f60581a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.696+0000 7f605ea00700 1 --2- 172.21.15.2:0/799685133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6058108ac0 0x7f605819f1f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.696+0000 7f605ea00700 1 --2- 172.21.15.2:0/799685133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6058109480 0x7f605819f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:33.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.696+0000 7f605ea00700 1 -- 172.21.15.2:0/799685133 >> 172.21.15.2:0/799685133 conn(0x7f6058075c60 msgr2=0x7f60580761e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:33.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.696+0000 7f605ea00700 1 -- 172.21.15.2:0/799685133 shutdown_connections 2024-06-13T11:27:33.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:33.696+0000 7f605ea00700 1 -- 172.21.15.2:0/799685133 wait complete. 2024-06-13T11:27:33.706 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:33 smithi178 ceph-mon[36913]: pgmap v116: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.5 KiB/s wr, 9 op/s 2024-06-13T11:27:33.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:33 smithi077 ceph-mon[36410]: pgmap v116: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.5 KiB/s wr, 9 op/s 2024-06-13T11:27:34.651 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-13T11:27:34.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:27:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:27:35.638 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:35 smithi002 ceph-mon[32210]: pgmap v117: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.5 KiB/s wr, 6 op/s 2024-06-13T11:27:35.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:35 smithi178 ceph-mon[36913]: pgmap v117: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.5 KiB/s wr, 6 op/s 2024-06-13T11:27:35.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:35 smithi077 ceph-mon[36410]: pgmap v117: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.5 KiB/s wr, 6 op/s 2024-06-13T11:27:37.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.498+0000 7f825a000700 1 -- 172.21.15.2:0/3997222267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8254106370 msgr2=0x7f8254106750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:37.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.498+0000 7f825a000700 1 --2- 172.21.15.2:0/3997222267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8254106370 0x7f8254106750 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8244009990 tx=0x7f8244009ca0 comp rx=0 tx=0).stop 2024-06-13T11:27:37.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.498+0000 7f825a000700 1 -- 172.21.15.2:0/3997222267 shutdown_connections 2024-06-13T11:27:37.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.498+0000 7f825a000700 1 --2- 172.21.15.2:0/3997222267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8254102550 0x7f825410e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:37.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.498+0000 7f825a000700 1 --2- 172.21.15.2:0/3997222267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8254106370 0x7f8254106750 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:37.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.498+0000 7f825a000700 1 --2- 172.21.15.2:0/3997222267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8254101b90 0x7f8254102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:37.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.498+0000 7f825a000700 1 -- 172.21.15.2:0/3997222267 >> 172.21.15.2:0/3997222267 conn(0x7f8254077a00 msgr2=0x7f82540fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:37.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.498+0000 7f825a000700 1 -- 172.21.15.2:0/3997222267 shutdown_connections 2024-06-13T11:27:37.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.498+0000 7f825a000700 1 -- 172.21.15.2:0/3997222267 wait complete. 2024-06-13T11:27:37.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.499+0000 7f825a000700 1 Processor -- start 2024-06-13T11:27:37.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.499+0000 7f825a000700 1 -- start start 2024-06-13T11:27:37.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.500+0000 7f825a000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8254101b90 0x7f825419e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:37.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.500+0000 7f825a000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8254102550 0x7f825419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:37.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.500+0000 7f825a000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8254106370 0x7f82541989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:37.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.500+0000 7f825a000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8254112770 con 0x7f8254102550 2024-06-13T11:27:37.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.500+0000 7f825a000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82541125f0 con 0x7f8254106370 2024-06-13T11:27:37.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.500+0000 7f825a000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f82541128f0 con 0x7f8254101b90 2024-06-13T11:27:37.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.500+0000 7f8253400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8254101b90 0x7f825419e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:37.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.500+0000 7f8252a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8254102550 0x7f825419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:37.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.500+0000 7f8253400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8254101b90 0x7f825419e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49898/0 (socket says 172.21.15.2:49898) 2024-06-13T11:27:37.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.500+0000 7f8253400700 1 -- 172.21.15.2:0/1680679994 learned_addr learned my addr 172.21.15.2:0/1680679994 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:37.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.500+0000 7f8253e00700 1 --2- 172.21.15.2:0/1680679994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8254106370 0x7f82541989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:37.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.501+0000 7f8253400700 1 -- 172.21.15.2:0/1680679994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8254106370 msgr2=0x7f82541989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:37.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.501+0000 7f8253400700 1 --2- 172.21.15.2:0/1680679994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8254106370 0x7f82541989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:37.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.501+0000 7f8253400700 1 -- 172.21.15.2:0/1680679994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8254102550 msgr2=0x7f825419ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:37.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.501+0000 7f8253400700 1 --2- 172.21.15.2:0/1680679994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8254102550 0x7f825419ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:37.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.501+0000 7f8253400700 1 -- 172.21.15.2:0/1680679994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8254199150 con 0x7f8254101b90 2024-06-13T11:27:37.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.501+0000 7f8253400700 1 --2- 172.21.15.2:0/1680679994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8254101b90 0x7f825419e7e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f824400bae0 tx=0x7f824400bb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:37.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.501+0000 7f824be00700 1 -- 172.21.15.2:0/1680679994 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244026070 con 0x7f8254101b90 2024-06-13T11:27:37.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.501+0000 7f825a000700 1 -- 172.21.15.2:0/1680679994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82541993e0 con 0x7f8254101b90 2024-06-13T11:27:37.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.501+0000 7f824be00700 1 -- 172.21.15.2:0/1680679994 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8244003d70 con 0x7f8254101b90 2024-06-13T11:27:37.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.501+0000 7f824be00700 1 -- 172.21.15.2:0/1680679994 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244021410 con 0x7f8254101b90 2024-06-13T11:27:37.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.502+0000 7f825a000700 1 -- 172.21.15.2:0/1680679994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82541a56b0 con 0x7f8254101b90 2024-06-13T11:27:37.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.503+0000 7f825a000700 1 -- 172.21.15.2:0/1680679994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8254069180 con 0x7f8254101b90 2024-06-13T11:27:37.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.505+0000 7f824be00700 1 -- 172.21.15.2:0/1680679994 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f8244029070 con 0x7f8254101b90 2024-06-13T11:27:37.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.506+0000 7f824be00700 1 --2- 172.21.15.2:0/1680679994 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f82380a2d90 0x7f82380a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:37.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.506+0000 7f824be00700 1 -- 172.21.15.2:0/1680679994 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f82440d0bf0 con 0x7f8254101b90 2024-06-13T11:27:37.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.507+0000 7f8252a00700 1 --2- 172.21.15.2:0/1680679994 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f82380a2d90 0x7f82380a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:37.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.507+0000 7f8252a00700 1 --2- 172.21.15.2:0/1680679994 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f82380a2d90 0x7f82380a5250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f82540fff80 tx=0x7f8240009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:37.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.509+0000 7f824be00700 1 -- 172.21.15.2:0/1680679994 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8244013070 con 0x7f8254101b90 2024-06-13T11:27:37.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:37 smithi002 ceph-mon[32210]: pgmap v118: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.5 KiB/s wr, 6 op/s 2024-06-13T11:27:37.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:37 smithi178 ceph-mon[36913]: pgmap v118: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.5 KiB/s wr, 6 op/s 2024-06-13T11:27:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.789+0000 7f825a000700 1 -- 172.21.15.2:0/1680679994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8254199ed0 con 0x7f8254101b90 2024-06-13T11:27:37.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:37 smithi077 ceph-mon[36410]: pgmap v118: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.5 KiB/s wr, 6 op/s 2024-06-13T11:27:37.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.790+0000 7f824be00700 1 -- 172.21.15.2:0/1680679994 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11856 (secure 0 0 0) 0x7f824409d4d0 con 0x7f8254101b90 2024-06-13T11:27:37.790 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:27:37.790 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:25:36.301244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24509,24511,24493]},"id":1}]} 2024-06-13T11:27:37.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.794+0000 7f825a000700 1 -- 172.21.15.2:0/1680679994 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f82380a2d90 msgr2=0x7f82380a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:37.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.794+0000 7f825a000700 1 --2- 172.21.15.2:0/1680679994 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f82380a2d90 0x7f82380a5250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f82540fff80 tx=0x7f8240009260 comp rx=0 tx=0).stop 2024-06-13T11:27:37.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.794+0000 7f825a000700 1 -- 172.21.15.2:0/1680679994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8254101b90 msgr2=0x7f825419e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:37.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.794+0000 7f825a000700 1 --2- 172.21.15.2:0/1680679994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8254101b90 0x7f825419e7e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f824400bae0 tx=0x7f824400bb10 comp rx=0 tx=0).stop 2024-06-13T11:27:37.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.794+0000 7f825a000700 1 -- 172.21.15.2:0/1680679994 shutdown_connections 2024-06-13T11:27:37.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.794+0000 7f825a000700 1 --2- 172.21.15.2:0/1680679994 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f82380a2d90 0x7f82380a5250 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:37.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.794+0000 7f825a000700 1 --2- 172.21.15.2:0/1680679994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8254106370 0x7f82541989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:37.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.794+0000 7f825a000700 1 --2- 172.21.15.2:0/1680679994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8254101b90 0x7f825419e7e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:37.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.794+0000 7f825a000700 1 --2- 172.21.15.2:0/1680679994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8254102550 0x7f825419ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:37.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.794+0000 7f825a000700 1 -- 172.21.15.2:0/1680679994 >> 172.21.15.2:0/1680679994 conn(0x7f8254077a00 msgr2=0x7f8254104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:37.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.794+0000 7f825a000700 1 -- 172.21.15.2:0/1680679994 shutdown_connections 2024-06-13T11:27:37.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:37.794+0000 7f825a000700 1 -- 172.21.15.2:0/1680679994 wait complete. 2024-06-13T11:27:37.795 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 29 2024-06-13T11:27:38.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:38 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1680679994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:27:38.711 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:38 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1680679994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:27:38.716 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-13T11:27:38.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:38 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1680679994' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:27:39.201 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:27:39.622 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:39 smithi002 ceph-mon[32210]: pgmap v119: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 KiB/s wr, 9 op/s 2024-06-13T11:27:39.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:39 smithi077 ceph-mon[36410]: pgmap v119: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 KiB/s wr, 9 op/s 2024-06-13T11:27:39.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:39 smithi178 ceph-mon[36913]: pgmap v119: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 KiB/s wr, 9 op/s 2024-06-13T11:27:41.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.645+0000 7fd99a800700 1 -- 172.21.15.2:0/3418299772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd99406a170 msgr2=0x7fd99406a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.645+0000 7fd99a800700 1 --2- 172.21.15.2:0/3418299772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd99406a170 0x7fd99406a5d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd97c009990 tx=0x7fd97c009ca0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.645+0000 7fd99a800700 1 -- 172.21.15.2:0/3418299772 shutdown_connections 2024-06-13T11:27:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.645+0000 7fd99a800700 1 --2- 172.21.15.2:0/3418299772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd99406ab10 0x7fd99410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.645+0000 7fd99a800700 1 --2- 172.21.15.2:0/3418299772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9941084e0 0x7fd9941088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.645+0000 7fd99a800700 1 --2- 172.21.15.2:0/3418299772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd99406a170 0x7fd99406a5d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.645+0000 7fd99a800700 1 -- 172.21.15.2:0/3418299772 >> 172.21.15.2:0/3418299772 conn(0x7fd9940782c0 msgr2=0x7fd9940786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.645+0000 7fd99a800700 1 -- 172.21.15.2:0/3418299772 shutdown_connections 2024-06-13T11:27:41.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.645+0000 7fd99a800700 1 -- 172.21.15.2:0/3418299772 wait complete. 2024-06-13T11:27:41.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.646+0000 7fd99a800700 1 Processor -- start 2024-06-13T11:27:41.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.647+0000 7fd99a800700 1 -- start start 2024-06-13T11:27:41.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.647+0000 7fd99a800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd99406a170 0x7fd994109330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.647+0000 7fd99a800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd99406ab10 0x7fd994109870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.647+0000 7fd99a800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9941084e0 0x7fd994109db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.647+0000 7fd99a800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd994112740 con 0x7fd9941084e0 2024-06-13T11:27:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.647+0000 7fd99a800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9941125c0 con 0x7fd99406ab10 2024-06-13T11:27:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.647+0000 7fd99a800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd9941128c0 con 0x7fd99406a170 2024-06-13T11:27:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.647+0000 7fd993400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd99406a170 0x7fd994109330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.647+0000 7fd993e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9941084e0 0x7fd994109db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.648+0000 7fd98aa00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd99406ab10 0x7fd994109870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.648+0000 7fd993400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd99406a170 0x7fd994109330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49916/0 (socket says 172.21.15.2:49916) 2024-06-13T11:27:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.648+0000 7fd993e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9941084e0 0x7fd994109db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43392/0 (socket says 172.21.15.2:43392) 2024-06-13T11:27:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.648+0000 7fd993400700 1 -- 172.21.15.2:0/2822765584 learned_addr learned my addr 172.21.15.2:0/2822765584 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.648+0000 7fd98aa00700 1 -- 172.21.15.2:0/2822765584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd99406a170 msgr2=0x7fd994109330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.648+0000 7fd98aa00700 1 --2- 172.21.15.2:0/2822765584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd99406a170 0x7fd994109330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.648+0000 7fd98aa00700 1 -- 172.21.15.2:0/2822765584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9941084e0 msgr2=0x7fd994109db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.648+0000 7fd98aa00700 1 --2- 172.21.15.2:0/2822765584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9941084e0 0x7fd994109db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.648+0000 7fd98aa00700 1 -- 172.21.15.2:0/2822765584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9941ab520 con 0x7fd99406ab10 2024-06-13T11:27:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.648+0000 7fd993400700 1 --2- 172.21.15.2:0/2822765584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd99406a170 0x7fd994109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:27:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.648+0000 7fd98aa00700 1 --2- 172.21.15.2:0/2822765584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd99406ab10 0x7fd994109870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0059d0 tx=0x7fd97c00b610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:41.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.649+0000 7fd990c00700 1 -- 172.21.15.2:0/2822765584 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c027070 con 0x7fd99406ab10 2024-06-13T11:27:41.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.649+0000 7fd990c00700 1 -- 172.21.15.2:0/2822765584 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd97c022470 con 0x7fd99406ab10 2024-06-13T11:27:41.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.649+0000 7fd990c00700 1 -- 172.21.15.2:0/2822765584 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c017630 con 0x7fd99406ab10 2024-06-13T11:27:41.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.649+0000 7fd99a800700 1 -- 172.21.15.2:0/2822765584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9941ab7b0 con 0x7fd99406ab10 2024-06-13T11:27:41.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.649+0000 7fd99a800700 1 -- 172.21.15.2:0/2822765584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9941abbb0 con 0x7fd99406ab10 2024-06-13T11:27:41.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.652+0000 7fd990c00700 1 -- 172.21.15.2:0/2822765584 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fd97c02a070 con 0x7fd99406ab10 2024-06-13T11:27:41.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.654+0000 7fd9a51c5b80 1 Processor -- start 2024-06-13T11:27:41.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.654+0000 7fd990c00700 1 --2- 172.21.15.2:0/2822765584 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9740a2e40 0x7fd9740a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.654+0000 7fd9a51c5b80 1 -- start start 2024-06-13T11:27:41.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.654+0000 7fd990c00700 1 -- 172.21.15.2:0/2822765584 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fd97c0d0380 con 0x7fd99406ab10 2024-06-13T11:27:41.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.654+0000 7fd993e00700 1 --2- 172.21.15.2:0/2822765584 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9740a2e40 0x7fd9740a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.654+0000 7fd9a51c5b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b17e40 0x562839b9b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.654+0000 7fd9a51c5b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839b9b5b0 0x562839b9ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.654+0000 7fd9a51c5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839ba6300 0x562839ba86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.654+0000 7fd9a51c5b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562839aaaa10 con 0x562839b9b5b0 2024-06-13T11:27:41.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.654+0000 7fd9a51c5b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562839aedb00 con 0x562839b17e40 2024-06-13T11:27:41.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.654+0000 7fd9a51c5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562839aa88f0 con 0x562839ba6300 2024-06-13T11:27:41.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.655+0000 7fd993400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b17e40 0x562839b9b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.655+0000 7fd98aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839b9b5b0 0x562839b9ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.655+0000 7fd993400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b17e40 0x562839b9b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:35634/0 (socket says 172.21.15.2:35634) 2024-06-13T11:27:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.655+0000 7fd993400700 1 -- 172.21.15.2:0/2137349827 learned_addr learned my addr 172.21.15.2:0/2137349827 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.655+0000 7fd993e00700 1 --2- 172.21.15.2:0/2137349827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839ba6300 0x562839ba86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.655+0000 7fd98aa00700 1 -- 172.21.15.2:0/2137349827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839ba6300 msgr2=0x562839ba86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.655+0000 7fd98aa00700 1 --2- 172.21.15.2:0/2137349827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839ba6300 0x562839ba86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.655+0000 7fd98aa00700 1 -- 172.21.15.2:0/2137349827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b17e40 msgr2=0x562839b9b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.655+0000 7fd98aa00700 1 --2- 172.21.15.2:0/2137349827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b17e40 0x562839b9b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.655+0000 7fd98aa00700 1 -- 172.21.15.2:0/2137349827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562839a95f90 con 0x562839b9b5b0 2024-06-13T11:27:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.655+0000 7fd993e00700 1 --2- 172.21.15.2:0/2822765584 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9740a2e40 0x7fd9740a5300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009fd0 tx=0x7fd98c009920 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.656+0000 7fd98aa00700 1 --2- 172.21.15.2:0/2137349827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839b9b5b0 0x562839b9ba30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0cd700 tx=0x7fd97c09c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3028bc72c438143 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.656+0000 7fd988c00700 1 -- 172.21.15.2:0/2137349827 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c09c560 con 0x562839b9b5b0 2024-06-13T11:27:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.656+0000 7fd988c00700 1 -- 172.21.15.2:0/2137349827 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd97c0cde50 con 0x562839b9b5b0 2024-06-13T11:27:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.656+0000 7fd988c00700 1 -- 172.21.15.2:0/2137349827 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0229d0 con 0x562839b9b5b0 2024-06-13T11:27:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.657+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/2137349827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839b9b5b0 msgr2=0x562839b9ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.657+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/2137349827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839b9b5b0 0x562839b9ba30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0cd700 tx=0x7fd97c09c120 comp rx=0 tx=0).stop 2024-06-13T11:27:41.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.657+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/2137349827 shutdown_connections 2024-06-13T11:27:41.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.657+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/2137349827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839ba6300 0x562839ba86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.657+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/2137349827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b17e40 0x562839b9b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.657+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/2137349827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839b9b5b0 0x562839b9ba30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.657+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/2137349827 >> 172.21.15.2:0/2137349827 conn(0x562839ac8170 msgr2=0x562839b974b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:41.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.657+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/2137349827 shutdown_connections 2024-06-13T11:27:41.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.657+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/2137349827 wait complete. 2024-06-13T11:27:41.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.658+0000 7fd9a51c5b80 1 -- start start 2024-06-13T11:27:41.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.658+0000 7fd9a51c5b80 1 Processor -- start 2024-06-13T11:27:41.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd9a51c5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b17e40 0x562839ba5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd9a51c5b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b9b5b0 0x562839ba2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd9a51c5b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839ba6300 0x562839ba3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd9a51c5b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562839a89f60 con 0x562839ba6300 2024-06-13T11:27:41.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd9a51c5b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562839ae9ac0 con 0x562839b9b5b0 2024-06-13T11:27:41.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd9a51c5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562839ba8d70 con 0x562839b17e40 2024-06-13T11:27:41.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd9a51c5b80 10 client.0 _ll_register_callbacks cb 0x562839a87720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:27:41.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd993e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839ba6300 0x562839ba3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd993400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b17e40 0x562839ba5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd993400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b17e40 0x562839ba5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49930/0 (socket says 172.21.15.2:49930) 2024-06-13T11:27:41.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd993400700 1 -- 172.21.15.2:0/2973397860 learned_addr learned my addr 172.21.15.2:0/2973397860 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:41.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd98aa00700 1 --2- 172.21.15.2:0/2973397860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b9b5b0 0x562839ba2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd993400700 1 -- 172.21.15.2:0/2973397860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b9b5b0 msgr2=0x562839ba2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:41.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd993400700 1 --2- 172.21.15.2:0/2973397860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b9b5b0 0x562839ba2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd993400700 1 -- 172.21.15.2:0/2973397860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839ba6300 msgr2=0x562839ba3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:41.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd993400700 1 --2- 172.21.15.2:0/2973397860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839ba6300 0x562839ba3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd993400700 1 -- 172.21.15.2:0/2973397860 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562839a3c8d0 con 0x562839b17e40 2024-06-13T11:27:41.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.659+0000 7fd98aa00700 1 --2- 172.21.15.2:0/2973397860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b9b5b0 0x562839ba2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:27:41.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.660+0000 7fd993400700 1 --2- 172.21.15.2:0/2973397860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b17e40 0x562839ba5ac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd984011d10 tx=0x7fd98400f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c7b622d9ee9b33b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:41.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.660+0000 7fd981600700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:27:41.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.660+0000 7fd981600700 1 -- 172.21.15.2:0/2973397860 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd984011e60 con 0x562839b17e40 2024-06-13T11:27:41.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.660+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/2973397860 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd97c0cde50 con 0x562839b17e40 2024-06-13T11:27:41.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.660+0000 7fd981600700 1 -- 172.21.15.2:0/2973397860 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fd98400fe40 con 0x562839b17e40 2024-06-13T11:27:41.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.661+0000 7fd981600700 1 -- 172.21.15.2:0/2973397860 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd984027050 con 0x562839b17e40 2024-06-13T11:27:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.661+0000 7fd9a51c5b80 10 client.25786 fetch_fsmap learned FSMap version 29 2024-06-13T11:27:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.661+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/2973397860 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562839bb34d0 con 0x562839b17e40 2024-06-13T11:27:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.661+0000 7fd981600700 1 -- 172.21.15.2:0/2973397860 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd97c0cde50 con 0x562839b17e40 2024-06-13T11:27:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.661+0000 7fd981600700 1 -- 172.21.15.2:0/2973397860 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fd984022030 con 0x562839b17e40 2024-06-13T11:27:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.661+0000 7fd9a51c5b80 10 client.25786 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:27:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.661+0000 7fd9a51c5b80 10 client.25786 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:27:41.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.661+0000 7fd9a51c5b80 20 client.25786 populate_metadata read hostname 'smithi002' 2024-06-13T11:27:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.661+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/2973397860 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x562839bb5b60 0x562839bb7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.661+0000 7fd9a51c5b80 4 client.25786 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:27:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.661+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/2973397860 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562839afb000 con 0x562839bb5b60 2024-06-13T11:27:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.662+0000 7fd98aa00700 1 --2- 172.21.15.2:0/2973397860 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x562839bb5b60 0x562839bb7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.662+0000 7fd98aa00700 1 --2- 172.21.15.2:0/2973397860 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x562839bb5b60 0x562839bb7f50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a009d5654b32804 server_cookie=540ec03cd8a42574 in_seq=0 out_seq=0 2024-06-13T11:27:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.662+0000 7fd981600700 10 client.25786 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:27:41.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.663+0000 7fd981600700 1 -- 172.21.15.2:0/2973397860 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562839afb000 con 0x562839bb5b60 2024-06-13T11:27:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.663+0000 7fd981600700 10 client.25786 handle_command_reply: tid=0 2024-06-13T11:27:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.663+0000 7fd9a51c5b80 1 client.25786 shutdown 2024-06-13T11:27:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.664+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/2973397860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b17e40 msgr2=0x562839ba5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.664+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/2973397860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b17e40 0x562839ba5ac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd984011d10 tx=0x7fd98400f6a0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.664+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/2973397860 shutdown_connections 2024-06-13T11:27:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.664+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/2973397860 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x562839bb5b60 0x562839bb7f50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.664+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/2973397860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839ba6300 0x562839ba3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.664+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/2973397860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b17e40 0x562839ba5ac0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.664+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/2973397860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b9b5b0 0x562839ba2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.664+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/2973397860 >> 172.21.15.2:0/2973397860 conn(0x562839ac8170 msgr2=0x562839b96740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:41.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.664+0000 7fd981600700 0 client.25786 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:27:41.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.664+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/2973397860 shutdown_connections 2024-06-13T11:27:41.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.664+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/2973397860 wait complete. 2024-06-13T11:27:41.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.664+0000 7fd9a51c5b80 20 client.25786 trim_cache size 0 max 16384 2024-06-13T11:27:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.681+0000 7fd9a51c5b80 1 Processor -- start 2024-06-13T11:27:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.681+0000 7fd9a51c5b80 1 -- start start 2024-06-13T11:27:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.682+0000 7fd9a51c5b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b17e40 0x562839ba3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.682+0000 7fd9a51c5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b9b5b0 0x562839ba5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.682+0000 7fd9a51c5b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839ba6300 0x562839ba76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.682+0000 7fd9a51c5b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd9941b7280 con 0x562839ba6300 2024-06-13T11:27:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.682+0000 7fd9a51c5b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9941b4b10 con 0x562839b17e40 2024-06-13T11:27:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.682+0000 7fd9a51c5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd9941b2960 con 0x562839b9b5b0 2024-06-13T11:27:41.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.682+0000 7fd993400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b17e40 0x562839ba3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.682+0000 7fd98aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b9b5b0 0x562839ba5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.682+0000 7fd993400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b17e40 0x562839ba3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:35654/0 (socket says 172.21.15.2:35654) 2024-06-13T11:27:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.682+0000 7fd993400700 1 -- 172.21.15.2:0/3190495782 learned_addr learned my addr 172.21.15.2:0/3190495782 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.682+0000 7fd993e00700 1 --2- 172.21.15.2:0/3190495782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839ba6300 0x562839ba76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.683+0000 7fd98aa00700 1 -- 172.21.15.2:0/3190495782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b17e40 msgr2=0x562839ba3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.683+0000 7fd98aa00700 1 --2- 172.21.15.2:0/3190495782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b17e40 0x562839ba3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.683+0000 7fd98aa00700 1 -- 172.21.15.2:0/3190495782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839ba6300 msgr2=0x562839ba76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.683+0000 7fd98aa00700 1 --2- 172.21.15.2:0/3190495782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839ba6300 0x562839ba76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.683+0000 7fd98aa00700 1 -- 172.21.15.2:0/3190495782 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562839ba1330 con 0x562839b9b5b0 2024-06-13T11:27:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.683+0000 7fd993400700 1 --2- 172.21.15.2:0/3190495782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b17e40 0x562839ba3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:27:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.683+0000 7fd993e00700 1 --2- 172.21.15.2:0/3190495782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839ba6300 0x562839ba76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:27:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.683+0000 7fd98aa00700 1 --2- 172.21.15.2:0/3190495782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b9b5b0 0x562839ba5600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0a5300 tx=0x7fd97c00b490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c83ea44c70320181 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.683+0000 7fd983e00700 1 -- 172.21.15.2:0/3190495782 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0a5140 con 0x562839b9b5b0 2024-06-13T11:27:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.683+0000 7fd983e00700 1 -- 172.21.15.2:0/3190495782 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd97c09c560 con 0x562839b9b5b0 2024-06-13T11:27:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.683+0000 7fd983e00700 1 -- 172.21.15.2:0/3190495782 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c09c7c0 con 0x562839b9b5b0 2024-06-13T11:27:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.684+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/3190495782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b9b5b0 msgr2=0x562839ba5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.684+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/3190495782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b9b5b0 0x562839ba5600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0a5300 tx=0x7fd97c00b490 comp rx=0 tx=0).stop 2024-06-13T11:27:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.684+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/3190495782 shutdown_connections 2024-06-13T11:27:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.684+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/3190495782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839ba6300 0x562839ba76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.684+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/3190495782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839b17e40 0x562839ba3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.684+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/3190495782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b9b5b0 0x562839ba5600 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.684+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/3190495782 >> 172.21.15.2:0/3190495782 conn(0x562839ac8170 msgr2=0x562839ba16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.684+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/3190495782 shutdown_connections 2024-06-13T11:27:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.684+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/3190495782 wait complete. 2024-06-13T11:27:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.685+0000 7fd9a51c5b80 1 -- start start 2024-06-13T11:27:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.685+0000 7fd9a51c5b80 1 Processor -- start 2024-06-13T11:27:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.685+0000 7fd9a51c5b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839b17e40 0x562839ba6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.685+0000 7fd9a51c5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b9b5b0 0x562839ba7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.685+0000 7fd9a51c5b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839ba6300 0x562839ba7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.685+0000 7fd9a51c5b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd9941b2fd0 con 0x562839b17e40 2024-06-13T11:27:41.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.685+0000 7fd9a51c5b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9941b4440 con 0x562839ba6300 2024-06-13T11:27:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.685+0000 7fd9a51c5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd9941b36a0 con 0x562839b9b5b0 2024-06-13T11:27:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.685+0000 7fd9a51c5b80 10 client.0 _ll_register_callbacks cb 0x562839a87720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:27:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.686+0000 7fd993400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839b17e40 0x562839ba6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.686+0000 7fd993400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839b17e40 0x562839ba6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43438/0 (socket says 172.21.15.2:43438) 2024-06-13T11:27:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.686+0000 7fd993400700 1 -- 172.21.15.2:0/1592423525 learned_addr learned my addr 172.21.15.2:0/1592423525 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.686+0000 7fd98aa00700 1 --2- 172.21.15.2:0/1592423525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b9b5b0 0x562839ba7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.686+0000 7fd993e00700 1 --2- 172.21.15.2:0/1592423525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839ba6300 0x562839ba7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.686+0000 7fd993400700 1 -- 172.21.15.2:0/1592423525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b9b5b0 msgr2=0x562839ba7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.686+0000 7fd993400700 1 --2- 172.21.15.2:0/1592423525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b9b5b0 0x562839ba7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.686+0000 7fd993400700 1 -- 172.21.15.2:0/1592423525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839ba6300 msgr2=0x562839ba7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.686+0000 7fd993400700 1 --2- 172.21.15.2:0/1592423525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839ba6300 0x562839ba7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.686+0000 7fd993400700 1 -- 172.21.15.2:0/1592423525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562839bacfc0 con 0x562839b17e40 2024-06-13T11:27:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.687+0000 7fd993400700 1 --2- 172.21.15.2:0/1592423525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839b17e40 0x562839ba6ae0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd984009340 tx=0x7fd984019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4866aae9772434dc server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.687+0000 7fd981600700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:27:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.687+0000 7fd981600700 1 -- 172.21.15.2:0/1592423525 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd984011e60 con 0x562839b17e40 2024-06-13T11:27:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.687+0000 7fd981600700 1 -- 172.21.15.2:0/1592423525 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fd98400fe40 con 0x562839b17e40 2024-06-13T11:27:41.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.687+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/1592423525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd97c09c560 con 0x562839b17e40 2024-06-13T11:27:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.687+0000 7fd981600700 1 -- 172.21.15.2:0/1592423525 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd984039050 con 0x562839b17e40 2024-06-13T11:27:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.687+0000 7fd9a51c5b80 10 client.15642 fetch_fsmap learned FSMap version 29 2024-06-13T11:27:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.687+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/1592423525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562839bae2c0 con 0x562839b17e40 2024-06-13T11:27:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.688+0000 7fd981600700 1 -- 172.21.15.2:0/1592423525 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd97c09c560 con 0x562839b17e40 2024-06-13T11:27:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.688+0000 7fd981600700 1 -- 172.21.15.2:0/1592423525 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fd984022070 con 0x562839b17e40 2024-06-13T11:27:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.688+0000 7fd9a51c5b80 10 client.15642 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:27:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.688+0000 7fd9a51c5b80 10 client.15642 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:27:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.688+0000 7fd9a51c5b80 20 client.15642 populate_metadata read hostname 'smithi002' 2024-06-13T11:27:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.688+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/1592423525 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x562839baea20 0x562839c22820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.688+0000 7fd9a51c5b80 4 client.15642 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:27:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.688+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/1592423525 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562839af5580 con 0x562839baea20 2024-06-13T11:27:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.689+0000 7fd98aa00700 1 --2- 172.21.15.2:0/1592423525 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x562839baea20 0x562839c22820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.689+0000 7fd98aa00700 1 --2- 172.21.15.2:0/1592423525 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x562839baea20 0x562839c22820 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=87c5cc73f6cecc58 server_cookie=f637f828502e43e7 in_seq=0 out_seq=0 2024-06-13T11:27:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.689+0000 7fd981600700 10 client.15642 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:27:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.689+0000 7fd981600700 1 -- 172.21.15.2:0/1592423525 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562839af5580 con 0x562839baea20 2024-06-13T11:27:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.689+0000 7fd981600700 10 client.15642 handle_command_reply: tid=0 2024-06-13T11:27:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.689+0000 7fd9a51c5b80 1 client.15642 shutdown 2024-06-13T11:27:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.690+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/1592423525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839b17e40 msgr2=0x562839ba6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.690+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/1592423525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839b17e40 0x562839ba6ae0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd984009340 tx=0x7fd984019640 comp rx=0 tx=0).stop 2024-06-13T11:27:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.690+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/1592423525 shutdown_connections 2024-06-13T11:27:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.690+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/1592423525 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x562839baea20 0x562839c22820 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.690+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/1592423525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562839b17e40 0x562839ba6ae0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.690+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/1592423525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562839ba6300 0x562839ba7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.690+0000 7fd9a51c5b80 1 --2- 172.21.15.2:0/1592423525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562839b9b5b0 0x562839ba7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.690+0000 7fd981600700 0 client.15642 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:27:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.690+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/1592423525 >> 172.21.15.2:0/1592423525 conn(0x562839ac8170 msgr2=0x562839b96740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.690+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/1592423525 shutdown_connections 2024-06-13T11:27:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.690+0000 7fd9a51c5b80 1 -- 172.21.15.2:0/1592423525 wait complete. 2024-06-13T11:27:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.690+0000 7fd9a51c5b80 20 client.15642 trim_cache size 0 max 16384 2024-06-13T11:27:41.695 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:27:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.691+0000 7fd99a800700 1 -- 172.21.15.2:0/2822765584 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9740a2e40 msgr2=0x7fd9740a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.691+0000 7fd99a800700 1 --2- 172.21.15.2:0/2822765584 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9740a2e40 0x7fd9740a5300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009fd0 tx=0x7fd98c009920 comp rx=0 tx=0).stop 2024-06-13T11:27:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.691+0000 7fd99a800700 1 -- 172.21.15.2:0/2822765584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd99406ab10 msgr2=0x7fd994109870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.691+0000 7fd99a800700 1 --2- 172.21.15.2:0/2822765584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd99406ab10 0x7fd994109870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0059d0 tx=0x7fd97c00b610 comp rx=0 tx=0).stop 2024-06-13T11:27:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.691+0000 7fd99a800700 1 -- 172.21.15.2:0/2822765584 shutdown_connections 2024-06-13T11:27:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.691+0000 7fd99a800700 1 --2- 172.21.15.2:0/2822765584 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9740a2e40 0x7fd9740a5300 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.691+0000 7fd99a800700 1 --2- 172.21.15.2:0/2822765584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9941084e0 0x7fd994109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.691+0000 7fd99a800700 1 --2- 172.21.15.2:0/2822765584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd99406a170 0x7fd994109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.691+0000 7fd99a800700 1 --2- 172.21.15.2:0/2822765584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd99406ab10 0x7fd994109870 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:41.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.691+0000 7fd99a800700 1 -- 172.21.15.2:0/2822765584 >> 172.21.15.2:0/2822765584 conn(0x7fd9940782c0 msgr2=0x7fd9940ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:41.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.691+0000 7fd99a800700 1 -- 172.21.15.2:0/2822765584 shutdown_connections 2024-06-13T11:27:41.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:41.691+0000 7fd99a800700 1 -- 172.21.15.2:0/2822765584 wait complete. 2024-06-13T11:27:41.708 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:41 smithi002 ceph-mon[32210]: pgmap v120: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-06-13T11:27:41.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:41 smithi077 ceph-mon[36410]: pgmap v120: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-06-13T11:27:41.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:41 smithi178 ceph-mon[36913]: pgmap v120: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-06-13T11:27:42.658 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-13T11:27:43.119 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:27:43.524 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:43 smithi002 ceph-mon[32210]: pgmap v121: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-06-13T11:27:43.749 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:43 smithi178 ceph-mon[36913]: pgmap v121: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-06-13T11:27:43.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:43 smithi077 ceph-mon[36410]: pgmap v121: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-06-13T11:27:45.193 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:45 smithi002 ceph-mon[32210]: pgmap v122: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-06-13T11:27:45.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:45 smithi178 ceph-mon[36913]: pgmap v122: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-06-13T11:27:45.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.492+0000 7f8a9f600700 1 -- 172.21.15.2:0/4183181909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a981046b0 msgr2=0x7f8a98104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.492+0000 7f8a9f600700 1 --2- 172.21.15.2:0/4183181909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a981046b0 0x7f8a98104b30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009990 tx=0x7f8a84009ca0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.492+0000 7f8a9f600700 1 -- 172.21.15.2:0/4183181909 shutdown_connections 2024-06-13T11:27:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.492+0000 7f8a9f600700 1 --2- 172.21.15.2:0/4183181909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a98105070 0x7f8a98111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.492+0000 7f8a9f600700 1 --2- 172.21.15.2:0/4183181909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a9810a6b0 0x7f8a9810aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.492+0000 7f8a9f600700 1 --2- 172.21.15.2:0/4183181909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a981046b0 0x7f8a98104b30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.492+0000 7f8a9f600700 1 -- 172.21.15.2:0/4183181909 >> 172.21.15.2:0/4183181909 conn(0x7f8a981001a0 msgr2=0x7f8a981025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:45.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.493+0000 7f8a9f600700 1 -- 172.21.15.2:0/4183181909 shutdown_connections 2024-06-13T11:27:45.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.493+0000 7f8a9f600700 1 -- 172.21.15.2:0/4183181909 wait complete. 2024-06-13T11:27:45.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.494+0000 7f8a9f600700 1 Processor -- start 2024-06-13T11:27:45.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.494+0000 7f8a9f600700 1 -- start start 2024-06-13T11:27:45.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.494+0000 7f8a9f600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a981046b0 0x7f8a9819aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.494+0000 7f8a9f600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a98105070 0x7f8a9819b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.494+0000 7f8a9f600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a9810a6b0 0x7f8a9819f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.494+0000 7f8a9f600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a98114a40 con 0x7f8a981046b0 2024-06-13T11:27:45.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.494+0000 7f8a9f600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981148c0 con 0x7f8a98105070 2024-06-13T11:27:45.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.494+0000 7f8a9f600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8a98114bc0 con 0x7f8a9810a6b0 2024-06-13T11:27:45.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.495+0000 7f8a9cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a981046b0 0x7f8a9819aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.495+0000 7f8a9cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a981046b0 0x7f8a9819aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43458/0 (socket says 172.21.15.2:43458) 2024-06-13T11:27:45.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.495+0000 7f8a97e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a98105070 0x7f8a9819b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.495+0000 7f8a9cc00700 1 -- 172.21.15.2:0/178488760 learned_addr learned my addr 172.21.15.2:0/178488760 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:45.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.495+0000 7f8a9d600700 1 --2- 172.21.15.2:0/178488760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a9810a6b0 0x7f8a9819f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.495+0000 7f8a9cc00700 1 -- 172.21.15.2:0/178488760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a9810a6b0 msgr2=0x7f8a9819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:45.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.495+0000 7f8a9cc00700 1 --2- 172.21.15.2:0/178488760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a9810a6b0 0x7f8a9819f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.495+0000 7f8a9cc00700 1 -- 172.21.15.2:0/178488760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a98105070 msgr2=0x7f8a9819b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:45.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.495+0000 7f8a9cc00700 1 --2- 172.21.15.2:0/178488760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a98105070 0x7f8a9819b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.495+0000 7f8a9cc00700 1 -- 172.21.15.2:0/178488760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9819fee0 con 0x7f8a981046b0 2024-06-13T11:27:45.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.495+0000 7f8a97e00700 1 --2- 172.21.15.2:0/178488760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a98105070 0x7f8a9819b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:27:45.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.496+0000 7f8a9cc00700 1 --2- 172.21.15.2:0/178488760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a981046b0 0x7f8a9819aed0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00c370 tx=0x7f8a8c00c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:45.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.496+0000 7f8a95600700 1 -- 172.21.15.2:0/178488760 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c00cea0 con 0x7f8a981046b0 2024-06-13T11:27:45.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.496+0000 7f8a9f600700 1 -- 172.21.15.2:0/178488760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a981a0170 con 0x7f8a981046b0 2024-06-13T11:27:45.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.496+0000 7f8a95600700 1 -- 172.21.15.2:0/178488760 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a8c0090d0 con 0x7f8a981046b0 2024-06-13T11:27:45.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.496+0000 7f8a95600700 1 -- 172.21.15.2:0/178488760 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c004770 con 0x7f8a981046b0 2024-06-13T11:27:45.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.496+0000 7f8a9f600700 1 -- 172.21.15.2:0/178488760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a981a7a50 con 0x7f8a981046b0 2024-06-13T11:27:45.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.499+0000 7f8a95600700 1 -- 172.21.15.2:0/178488760 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f8a8c01a020 con 0x7f8a981046b0 2024-06-13T11:27:45.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.501+0000 7f8a95600700 1 --2- 172.21.15.2:0/178488760 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8a800a2e10 0x7f8a800a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.501+0000 7f8aaa044b80 1 Processor -- start 2024-06-13T11:27:45.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.501+0000 7f8a95600700 1 -- 172.21.15.2:0/178488760 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f8a8c0cf080 con 0x7f8a981046b0 2024-06-13T11:27:45.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.501+0000 7f8aaa044b80 1 -- start start 2024-06-13T11:27:45.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.501+0000 7f8a97e00700 1 --2- 172.21.15.2:0/178488760 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8a800a2e10 0x7f8a800a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.502+0000 7f8aaa044b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.502+0000 7f8aaa044b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbcd4b0 0x564eacbc6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.502+0000 7f8aaa044b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 0x564eacbc7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.502+0000 7f8aaa044b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564eacad5a10 con 0x564eacbccb90 2024-06-13T11:27:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.502+0000 7f8aaa044b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564eacb18b00 con 0x564eacbc7240 2024-06-13T11:27:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.502+0000 7f8aaa044b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x564eacad38f0 con 0x564eacbcd4b0 2024-06-13T11:27:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.502+0000 7f8a9cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.502+0000 7f8a9cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43472/0 (socket says 172.21.15.2:43472) 2024-06-13T11:27:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.502+0000 7f8a9cc00700 1 -- 172.21.15.2:0/1917839292 learned_addr learned my addr 172.21.15.2:0/1917839292 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.502+0000 7f8a97e00700 1 --2- 172.21.15.2:0/1917839292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbcd4b0 0x564eacbc6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.502+0000 7f8a97e00700 1 --2- 172.21.15.2:0/178488760 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8a800a2e10 0x7f8a800a52d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8a98109cb0 tx=0x7f8a8400b260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:45.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.502+0000 7f8a9d600700 1 --2- 172.21.15.2:0/1917839292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 0x564eacbc7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.503+0000 7f8a9cc00700 1 -- 172.21.15.2:0/1917839292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbcd4b0 msgr2=0x564eacbc6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.503+0000 7f8a9cc00700 1 --2- 172.21.15.2:0/1917839292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbcd4b0 0x564eacbc6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.503+0000 7f8a9cc00700 1 -- 172.21.15.2:0/1917839292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 msgr2=0x564eacbc7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.503+0000 7f8a9cc00700 1 --2- 172.21.15.2:0/1917839292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 0x564eacbc7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.503+0000 7f8a9cc00700 1 -- 172.21.15.2:0/1917839292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eacac0f90 con 0x564eacbccb90 2024-06-13T11:27:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.503+0000 7f8a9d600700 1 --2- 172.21.15.2:0/1917839292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 0x564eacbc7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:27:45.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.503+0000 7f8a9cc00700 1 --2- 172.21.15.2:0/1917839292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbccf70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c097ba0 tx=0x7f8a8c0974f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3be1075975f979d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.503+0000 7f8a8a000700 1 -- 172.21.15.2:0/1917839292 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c09ab30 con 0x564eacbccb90 2024-06-13T11:27:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.503+0000 7f8a8a000700 1 -- 172.21.15.2:0/1917839292 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a8c09b8d0 con 0x564eacbccb90 2024-06-13T11:27:45.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.503+0000 7f8a8a000700 1 -- 172.21.15.2:0/1917839292 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c09f120 con 0x564eacbccb90 2024-06-13T11:27:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.504+0000 7f8aaa044b80 1 -- 172.21.15.2:0/1917839292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 msgr2=0x564eacbccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.504+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/1917839292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbccf70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c097ba0 tx=0x7f8a8c0974f0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.504+0000 7f8aaa044b80 1 -- 172.21.15.2:0/1917839292 shutdown_connections 2024-06-13T11:27:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.504+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/1917839292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbccf70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.504+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/1917839292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 0x564eacbc7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.504+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/1917839292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbcd4b0 0x564eacbc6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.504+0000 7f8aaa044b80 1 -- 172.21.15.2:0/1917839292 >> 172.21.15.2:0/1917839292 conn(0x564eacaf3170 msgr2=0x564eacbc1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.504+0000 7f8aaa044b80 1 -- 172.21.15.2:0/1917839292 shutdown_connections 2024-06-13T11:27:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.504+0000 7f8aaa044b80 1 -- 172.21.15.2:0/1917839292 wait complete. 2024-06-13T11:27:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.505+0000 7f8aaa044b80 1 -- start start 2024-06-13T11:27:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.505+0000 7f8aaa044b80 1 Processor -- start 2024-06-13T11:27:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.506+0000 7f8aaa044b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbc7240 0x564eacbd32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.506+0000 7f8aaa044b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbccb90 0x564eacbd05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.506+0000 7f8aaa044b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbcd4b0 0x564eacbd0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.506+0000 7f8aaa044b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564eacab4f60 con 0x564eacbc7240 2024-06-13T11:27:45.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.506+0000 7f8aaa044b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564eacb14ac0 con 0x564eacbcd4b0 2024-06-13T11:27:45.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.506+0000 7f8aaa044b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x564eacbd3e30 con 0x564eacbccb90 2024-06-13T11:27:45.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.506+0000 7f8aaa044b80 10 client.0 _ll_register_callbacks cb 0x564eacaae380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:27:45.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.506+0000 7f8a9cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbc7240 0x564eacbd32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.506+0000 7f8a9cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbc7240 0x564eacbd32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43478/0 (socket says 172.21.15.2:43478) 2024-06-13T11:27:45.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.506+0000 7f8a9cc00700 1 -- 172.21.15.2:0/3374727393 learned_addr learned my addr 172.21.15.2:0/3374727393 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:45.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.506+0000 7f8a97e00700 1 --2- 172.21.15.2:0/3374727393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbccb90 0x564eacbd05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.506+0000 7f8a9d600700 1 --2- 172.21.15.2:0/3374727393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbcd4b0 0x564eacbd0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.507+0000 7f8a9cc00700 1 -- 172.21.15.2:0/3374727393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbccb90 msgr2=0x564eacbd05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:45.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.507+0000 7f8a9cc00700 1 --2- 172.21.15.2:0/3374727393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbccb90 0x564eacbd05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.507+0000 7f8a9cc00700 1 -- 172.21.15.2:0/3374727393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbcd4b0 msgr2=0x564eacbd0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:45.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.507+0000 7f8a9cc00700 1 --2- 172.21.15.2:0/3374727393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbcd4b0 0x564eacbd0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.507+0000 7f8a9cc00700 1 -- 172.21.15.2:0/3374727393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eaca678d0 con 0x564eacbc7240 2024-06-13T11:27:45.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.507+0000 7f8a9cc00700 1 --2- 172.21.15.2:0/3374727393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbc7240 0x564eacbd32b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c09b160 tx=0x7f8a8c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1737ae4e344ae7a9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:45.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.507+0000 7f8a7ea00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:27:45.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.507+0000 7f8a7ea00700 1 -- 172.21.15.2:0/3374727393 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c0b3020 con 0x564eacbc7240 2024-06-13T11:27:45.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.507+0000 7f8a7ea00700 1 -- 172.21.15.2:0/3374727393 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f8a8c09f320 con 0x564eacbc7240 2024-06-13T11:27:45.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.507+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3374727393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a8c09b8d0 con 0x564eacbc7240 2024-06-13T11:27:45.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.508+0000 7f8a7ea00700 1 -- 172.21.15.2:0/3374727393 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8a8c09f580 con 0x564eacbc7240 2024-06-13T11:27:45.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.508+0000 7f8aaa044b80 10 client.15654 fetch_fsmap learned FSMap version 29 2024-06-13T11:27:45.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.508+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3374727393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564eacbde600 con 0x564eacbc7240 2024-06-13T11:27:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.508+0000 7f8a7ea00700 1 -- 172.21.15.2:0/3374727393 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a8c09b8d0 con 0x564eacbc7240 2024-06-13T11:27:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.508+0000 7f8a7ea00700 1 -- 172.21.15.2:0/3374727393 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f8a8c0a39b0 con 0x564eacbc7240 2024-06-13T11:27:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.508+0000 7f8aaa044b80 10 client.15654 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:27:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.508+0000 7f8aaa044b80 10 client.15654 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:27:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.508+0000 7f8aaa044b80 20 client.15654 populate_metadata read hostname 'smithi002' 2024-06-13T11:27:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.508+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/3374727393 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x564eacbe0ad0 0x564eacbe2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.508+0000 7f8aaa044b80 4 client.15654 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:27:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.508+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3374727393 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564eacb26000 con 0x564eacbe0ad0 2024-06-13T11:27:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.509+0000 7f8a97e00700 1 --2- 172.21.15.2:0/3374727393 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x564eacbe0ad0 0x564eacbe2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.509+0000 7f8a97e00700 1 --2- 172.21.15.2:0/3374727393 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x564eacbe0ad0 0x564eacbe2ec0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=36d2ee72c8fe81c7 server_cookie=70728d821f88292a in_seq=0 out_seq=0 2024-06-13T11:27:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.509+0000 7f8a7ea00700 10 client.15654 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:27:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.510+0000 7f8a7ea00700 1 -- 172.21.15.2:0/3374727393 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564eacb26000 con 0x564eacbe0ad0 2024-06-13T11:27:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.510+0000 7f8a7ea00700 10 client.15654 handle_command_reply: tid=0 2024-06-13T11:27:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.510+0000 7f8aaa044b80 1 client.15654 shutdown 2024-06-13T11:27:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.511+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3374727393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbc7240 msgr2=0x564eacbd32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.511+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/3374727393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbc7240 0x564eacbd32b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c09b160 tx=0x7f8a8c00cbb0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.511+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3374727393 shutdown_connections 2024-06-13T11:27:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.511+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/3374727393 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x564eacbe0ad0 0x564eacbe2ec0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.511+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/3374727393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbc7240 0x564eacbd32b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.511+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/3374727393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbcd4b0 0x564eacbd0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.511+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/3374727393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbccb90 0x564eacbd05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.511+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3374727393 >> 172.21.15.2:0/3374727393 conn(0x564eacaf3170 msgr2=0x564eacbbb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.511+0000 7f8a7ea00700 0 client.15654 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:27:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.511+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3374727393 shutdown_connections 2024-06-13T11:27:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.511+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3374727393 wait complete. 2024-06-13T11:27:45.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.511+0000 7f8aaa044b80 20 client.15654 trim_cache size 0 max 16384 2024-06-13T11:27:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.528+0000 7f8aaa044b80 1 Processor -- start 2024-06-13T11:27:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.528+0000 7f8aaa044b80 1 -- start start 2024-06-13T11:27:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.528+0000 7f8aaa044b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 0x564eacbc6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.528+0000 7f8aaa044b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbcdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.529+0000 7f8aaa044b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbcd4b0 0x564eacbbc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.529+0000 7f8aaa044b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981b3050 con 0x564eacbccb90 2024-06-13T11:27:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.529+0000 7f8aaa044b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981b08e0 con 0x564eacbc7240 2024-06-13T11:27:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.529+0000 7f8aaa044b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981ae730 con 0x564eacbcd4b0 2024-06-13T11:27:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.529+0000 7f8a97e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbcdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.529+0000 7f8a9d600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbcd4b0 0x564eacbbc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.529+0000 7f8a9cc00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 0x564eacbc6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.529+0000 7f8a97e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbcdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43484/0 (socket says 172.21.15.2:43484) 2024-06-13T11:27:45.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.529+0000 7f8a97e00700 1 -- 172.21.15.2:0/3906127302 learned_addr learned my addr 172.21.15.2:0/3906127302 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:45.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.530+0000 7f8a9d600700 1 -- 172.21.15.2:0/3906127302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 msgr2=0x564eacbc6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:45.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.530+0000 7f8a9d600700 1 --2- 172.21.15.2:0/3906127302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 0x564eacbc6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.530+0000 7f8a9d600700 1 -- 172.21.15.2:0/3906127302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 msgr2=0x564eacbcdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:45.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.530+0000 7f8a9d600700 1 --2- 172.21.15.2:0/3906127302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbcdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.530+0000 7f8a9d600700 1 -- 172.21.15.2:0/3906127302 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eacbcd1c0 con 0x564eacbcd4b0 2024-06-13T11:27:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.530+0000 7f8a97e00700 1 --2- 172.21.15.2:0/3906127302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbcdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:27:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.530+0000 7f8a9cc00700 1 --2- 172.21.15.2:0/3906127302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 0x564eacbc6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:27:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.530+0000 7f8a9d600700 1 --2- 172.21.15.2:0/3906127302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbcd4b0 0x564eacbbc130 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8a90007d60 tx=0x7f8a90012730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c80396a7a73cfd3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.530+0000 7f8a89600700 1 -- 172.21.15.2:0/3906127302 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a90012b90 con 0x564eacbcd4b0 2024-06-13T11:27:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.530+0000 7f8a89600700 1 -- 172.21.15.2:0/3906127302 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a90012d30 con 0x564eacbcd4b0 2024-06-13T11:27:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.530+0000 7f8a89600700 1 -- 172.21.15.2:0/3906127302 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9001c470 con 0x564eacbcd4b0 2024-06-13T11:27:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.531+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3906127302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbcd4b0 msgr2=0x564eacbbc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.531+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/3906127302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbcd4b0 0x564eacbbc130 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8a90007d60 tx=0x7f8a90012730 comp rx=0 tx=0).stop 2024-06-13T11:27:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.531+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3906127302 shutdown_connections 2024-06-13T11:27:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.531+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/3906127302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbcd4b0 0x564eacbbc130 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.531+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/3906127302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 0x564eacbc6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.531+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/3906127302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbcdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.531+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3906127302 >> 172.21.15.2:0/3906127302 conn(0x564eacaf3170 msgr2=0x564eacbcbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:45.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.531+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3906127302 shutdown_connections 2024-06-13T11:27:45.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.531+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3906127302 wait complete. 2024-06-13T11:27:45.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.532+0000 7f8aaa044b80 1 -- start start 2024-06-13T11:27:45.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.532+0000 7f8aaa044b80 1 Processor -- start 2024-06-13T11:27:45.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.532+0000 7f8aaa044b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 0x564eacbe6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.532+0000 7f8aaa044b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbe3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.532+0000 7f8aaa044b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbcd4b0 0x564eacbe4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.532+0000 7f8aaa044b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981aeda0 con 0x564eacbccb90 2024-06-13T11:27:45.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.532+0000 7f8aaa044b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981b0210 con 0x564eacbc7240 2024-06-13T11:27:45.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.532+0000 7f8aaa044b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981af470 con 0x564eacbcd4b0 2024-06-13T11:27:45.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.533+0000 7f8aaa044b80 10 client.0 _ll_register_callbacks cb 0x564eacaae380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:27:45.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.533+0000 7f8a97e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbe3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.533+0000 7f8a97e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbe3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43486/0 (socket says 172.21.15.2:43486) 2024-06-13T11:27:45.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.533+0000 7f8a97e00700 1 -- 172.21.15.2:0/3259200033 learned_addr learned my addr 172.21.15.2:0/3259200033 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:45.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.533+0000 7f8a9cc00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 0x564eacbe6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.533+0000 7f8a9d600700 1 --2- 172.21.15.2:0/3259200033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbcd4b0 0x564eacbe4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.533+0000 7f8a97e00700 1 -- 172.21.15.2:0/3259200033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbcd4b0 msgr2=0x564eacbe4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:45.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.533+0000 7f8a97e00700 1 --2- 172.21.15.2:0/3259200033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbcd4b0 0x564eacbe4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.533+0000 7f8a97e00700 1 -- 172.21.15.2:0/3259200033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 msgr2=0x564eacbe6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:45.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.533+0000 7f8a97e00700 1 --2- 172.21.15.2:0/3259200033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 0x564eacbe6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.533+0000 7f8a97e00700 1 -- 172.21.15.2:0/3259200033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eacc4a410 con 0x564eacbccb90 2024-06-13T11:27:45.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.533+0000 7f8a9cc00700 1 --2- 172.21.15.2:0/3259200033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 0x564eacbe6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:27:45.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.534+0000 7f8a97e00700 1 --2- 172.21.15.2:0/3259200033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbe3af0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8a84000c00 tx=0x7f8a84009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d0e1be89e92446 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:45.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.534+0000 7f8a7ea00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:27:45.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.534+0000 7f8a7ea00700 1 -- 172.21.15.2:0/3259200033 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8400f460 con 0x564eacbccb90 2024-06-13T11:27:45.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.534+0000 7f8a7ea00700 1 -- 172.21.15.2:0/3259200033 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f8a8400f600 con 0x564eacbccb90 2024-06-13T11:27:45.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.534+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3259200033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a90012d30 con 0x564eacbccb90 2024-06-13T11:27:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.534+0000 7f8a7ea00700 1 -- 172.21.15.2:0/3259200033 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8a8400f800 con 0x564eacbccb90 2024-06-13T11:27:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.534+0000 7f8aaa044b80 10 client.15660 fetch_fsmap learned FSMap version 29 2024-06-13T11:27:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.534+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3259200033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564eacc4b550 con 0x564eacbccb90 2024-06-13T11:27:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.535+0000 7f8a7ea00700 1 -- 172.21.15.2:0/3259200033 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a90012d30 con 0x564eacbccb90 2024-06-13T11:27:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.535+0000 7f8a7ea00700 1 -- 172.21.15.2:0/3259200033 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f8a8403c990 con 0x564eacbccb90 2024-06-13T11:27:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.535+0000 7f8aaa044b80 10 client.15660 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:27:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.535+0000 7f8aaa044b80 10 client.15660 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:27:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.535+0000 7f8aaa044b80 20 client.15660 populate_metadata read hostname 'smithi002' 2024-06-13T11:27:45.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.535+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/3259200033 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x564eacc4bc40 0x564eacc4e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:45.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.535+0000 7f8aaa044b80 4 client.15660 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:27:45.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.535+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3259200033 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564eacb20580 con 0x564eacc4bc40 2024-06-13T11:27:45.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:45 smithi077 ceph-mon[36410]: pgmap v122: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-06-13T11:27:45.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.535+0000 7f8a9cc00700 1 --2- 172.21.15.2:0/3259200033 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x564eacc4bc40 0x564eacc4e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.536+0000 7f8a9cc00700 1 --2- 172.21.15.2:0/3259200033 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x564eacc4bc40 0x564eacc4e060 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b8b2df59ec0268a9 server_cookie=419a9d05950c7dfb in_seq=0 out_seq=0 2024-06-13T11:27:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.536+0000 7f8a7ea00700 10 client.15660 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:27:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.536+0000 7f8a7ea00700 1 -- 172.21.15.2:0/3259200033 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564eacb20580 con 0x564eacc4bc40 2024-06-13T11:27:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.536+0000 7f8a7ea00700 10 client.15660 handle_command_reply: tid=0 2024-06-13T11:27:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.536+0000 7f8aaa044b80 1 client.15660 shutdown 2024-06-13T11:27:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.536+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3259200033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 msgr2=0x564eacbe3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:45.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.536+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/3259200033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbe3af0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8a84000c00 tx=0x7f8a84009ca0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.536+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3259200033 shutdown_connections 2024-06-13T11:27:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.536+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/3259200033 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x564eacc4bc40 0x564eacc4e060 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.536+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/3259200033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564eacbcd4b0 0x564eacbe4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.536+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/3259200033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564eacbc7240 0x564eacbe6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.536+0000 7f8aaa044b80 1 --2- 172.21.15.2:0/3259200033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564eacbccb90 0x564eacbe3af0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.536+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3259200033 >> 172.21.15.2:0/3259200033 conn(0x564eacaf3170 msgr2=0x564eacbceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.536+0000 7f8a7ea00700 0 client.15660 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:27:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.536+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3259200033 shutdown_connections 2024-06-13T11:27:45.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.537+0000 7f8aaa044b80 1 -- 172.21.15.2:0/3259200033 wait complete. 2024-06-13T11:27:45.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.537+0000 7f8aaa044b80 20 client.15660 trim_cache size 0 max 16384 2024-06-13T11:27:45.544 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:27:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.537+0000 7f8a9f600700 1 -- 172.21.15.2:0/178488760 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8a800a2e10 msgr2=0x7f8a800a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.537+0000 7f8a9f600700 1 --2- 172.21.15.2:0/178488760 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8a800a2e10 0x7f8a800a52d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8a98109cb0 tx=0x7f8a8400b260 comp rx=0 tx=0).stop 2024-06-13T11:27:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.537+0000 7f8a9f600700 1 -- 172.21.15.2:0/178488760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a981046b0 msgr2=0x7f8a9819aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.537+0000 7f8a9f600700 1 --2- 172.21.15.2:0/178488760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a981046b0 0x7f8a9819aed0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00c370 tx=0x7f8a8c00c680 comp rx=0 tx=0).stop 2024-06-13T11:27:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.538+0000 7f8a9f600700 1 -- 172.21.15.2:0/178488760 shutdown_connections 2024-06-13T11:27:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.538+0000 7f8a9f600700 1 --2- 172.21.15.2:0/178488760 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8a800a2e10 0x7f8a800a52d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.538+0000 7f8a9f600700 1 --2- 172.21.15.2:0/178488760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a981046b0 0x7f8a9819aed0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.538+0000 7f8a9f600700 1 --2- 172.21.15.2:0/178488760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a9810a6b0 0x7f8a9819f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.538+0000 7f8a9f600700 1 --2- 172.21.15.2:0/178488760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a98105070 0x7f8a9819b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.538+0000 7f8a9f600700 1 -- 172.21.15.2:0/178488760 >> 172.21.15.2:0/178488760 conn(0x7f8a981001a0 msgr2=0x7f8a98100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.538+0000 7f8a9f600700 1 -- 172.21.15.2:0/178488760 shutdown_connections 2024-06-13T11:27:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:45.538+0000 7f8a9f600700 1 -- 172.21.15.2:0/178488760 wait complete. 2024-06-13T11:27:46.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-13T11:27:47.013 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:27:47.521 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:47 smithi002 ceph-mon[32210]: pgmap v123: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-06-13T11:27:47.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:47 smithi178 ceph-mon[36913]: pgmap v123: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-06-13T11:27:47.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:47 smithi077 ceph-mon[36410]: pgmap v123: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-06-13T11:27:49.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.318+0000 7f8dbc800700 1 -- 172.21.15.2:0/64051409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8db4105020 msgr2=0x7f8db4111530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.318+0000 7f8dbc800700 1 --2- 172.21.15.2:0/64051409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8db4105020 0x7f8db4111530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8db000b0a0 tx=0x7f8db000b3b0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.318+0000 7f8dbc800700 1 -- 172.21.15.2:0/64051409 shutdown_connections 2024-06-13T11:27:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.318+0000 7f8dbc800700 1 --2- 172.21.15.2:0/64051409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8db4105020 0x7f8db4111530 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.318+0000 7f8dbc800700 1 --2- 172.21.15.2:0/64051409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8db410a660 0x7f8db410aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.318+0000 7f8dbc800700 1 --2- 172.21.15.2:0/64051409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8db4104660 0x7f8db4104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.318+0000 7f8dbc800700 1 -- 172.21.15.2:0/64051409 >> 172.21.15.2:0/64051409 conn(0x7f8db4100130 msgr2=0x7f8db4102550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.318+0000 7f8dbc800700 1 -- 172.21.15.2:0/64051409 shutdown_connections 2024-06-13T11:27:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.318+0000 7f8dbc800700 1 -- 172.21.15.2:0/64051409 wait complete. 2024-06-13T11:27:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.320+0000 7f8dbc800700 1 Processor -- start 2024-06-13T11:27:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.321+0000 7f8dbc800700 1 -- start start 2024-06-13T11:27:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.321+0000 7f8dbc800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8db4104660 0x7f8db419adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.321+0000 7f8dbc800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8db4105020 0x7f8db419b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.321+0000 7f8dbc800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8db410a660 0x7f8db419f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.321+0000 7f8dbc800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8db4114a40 con 0x7f8db410a660 2024-06-13T11:27:49.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.321+0000 7f8dbc800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8db41148c0 con 0x7f8db4104660 2024-06-13T11:27:49.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.321+0000 7f8dbc800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8db4114bc0 con 0x7f8db4105020 2024-06-13T11:27:49.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.322+0000 7f8dba800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8db410a660 0x7f8db419f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.322+0000 7f8db9400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8db4105020 0x7f8db419b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.322+0000 7f8dba800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8db410a660 0x7f8db419f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43728/0 (socket says 172.21.15.2:43728) 2024-06-13T11:27:49.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.322+0000 7f8dba800700 1 -- 172.21.15.2:0/1576345241 learned_addr learned my addr 172.21.15.2:0/1576345241 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.322+0000 7f8db9e00700 1 --2- 172.21.15.2:0/1576345241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8db4104660 0x7f8db419adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.322+0000 7f8db9400700 1 -- 172.21.15.2:0/1576345241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8db4104660 msgr2=0x7f8db419adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.322+0000 7f8db9400700 1 --2- 172.21.15.2:0/1576345241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8db4104660 0x7f8db419adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.322+0000 7f8db9400700 1 -- 172.21.15.2:0/1576345241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8db410a660 msgr2=0x7f8db419f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.322+0000 7f8db9400700 1 --2- 172.21.15.2:0/1576345241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8db410a660 0x7f8db419f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.322+0000 7f8db9400700 1 -- 172.21.15.2:0/1576345241 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db419fe00 con 0x7f8db4105020 2024-06-13T11:27:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.322+0000 7f8dba800700 1 --2- 172.21.15.2:0/1576345241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8db410a660 0x7f8db419f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:27:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.323+0000 7f8db9400700 1 --2- 172.21.15.2:0/1576345241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8db4105020 0x7f8db419b330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8da400e9f0 tx=0x7f8da400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.323+0000 7f8daea00700 1 -- 172.21.15.2:0/1576345241 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da400cb70 con 0x7f8db4105020 2024-06-13T11:27:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.323+0000 7f8dbc800700 1 -- 172.21.15.2:0/1576345241 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db41a00f0 con 0x7f8db4105020 2024-06-13T11:27:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.323+0000 7f8daea00700 1 -- 172.21.15.2:0/1576345241 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8da400ee90 con 0x7f8db4105020 2024-06-13T11:27:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.323+0000 7f8daea00700 1 -- 172.21.15.2:0/1576345241 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4003d60 con 0x7f8db4105020 2024-06-13T11:27:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.323+0000 7f8dbc800700 1 -- 172.21.15.2:0/1576345241 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db41a7970 con 0x7f8db4105020 2024-06-13T11:27:49.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.330+0000 7f8daea00700 1 -- 172.21.15.2:0/1576345241 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f8da4004020 con 0x7f8db4105020 2024-06-13T11:27:49.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.330+0000 7f8dc711db80 1 Processor -- start 2024-06-13T11:27:49.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.330+0000 7f8dc711db80 1 -- start start 2024-06-13T11:27:49.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.330+0000 7f8dc711db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c091f9ae40 0x55c09201e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.330+0000 7f8dc711db80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c09201e5b0 0x55c09201ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.330+0000 7f8dc711db80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c092029300 0x55c09202b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.330+0000 7f8dc711db80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c091f2da10 con 0x55c092029300 2024-06-13T11:27:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.330+0000 7f8dc711db80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c091f70b00 con 0x55c09201e5b0 2024-06-13T11:27:49.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.330+0000 7f8dc711db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c091f2b8f0 con 0x55c091f9ae40 2024-06-13T11:27:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.331+0000 7f8dba800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c091f9ae40 0x55c09201e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.331+0000 7f8db9e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c09201e5b0 0x55c09201ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.331+0000 7f8dba800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c091f9ae40 0x55c09201e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56198/0 (socket says 172.21.15.2:56198) 2024-06-13T11:27:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.331+0000 7f8dba800700 1 -- 172.21.15.2:0/4066035682 learned_addr learned my addr 172.21.15.2:0/4066035682 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.331+0000 7f8db9400700 1 --2- 172.21.15.2:0/4066035682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c092029300 0x55c09202b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.331+0000 7f8dba800700 1 -- 172.21.15.2:0/4066035682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c09201e5b0 msgr2=0x55c09201ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.331+0000 7f8dba800700 1 --2- 172.21.15.2:0/4066035682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c09201e5b0 0x55c09201ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.331+0000 7f8dba800700 1 -- 172.21.15.2:0/4066035682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c092029300 msgr2=0x55c09202b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.331+0000 7f8dba800700 1 --2- 172.21.15.2:0/4066035682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c092029300 0x55c09202b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.331+0000 7f8dba800700 1 -- 172.21.15.2:0/4066035682 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c091f18f90 con 0x55c091f9ae40 2024-06-13T11:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.331+0000 7f8db9400700 1 --2- 172.21.15.2:0/4066035682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c092029300 0x55c09202b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:27:49.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.332+0000 7f8daea00700 1 --2- 172.21.15.2:0/1576345241 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8d9c0a2e10 0x7f8d9c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.332+0000 7f8dba800700 1 --2- 172.21.15.2:0/4066035682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c091f9ae40 0x55c09201e070 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009e40 tx=0x7f8db000cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecadbbd15158c75 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.332+0000 7f8daea00700 1 -- 172.21.15.2:0/1576345241 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f8da40cf7f0 con 0x7f8db4105020 2024-06-13T11:27:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.332+0000 7f8db9e00700 1 --2- 172.21.15.2:0/1576345241 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8d9c0a2e10 0x7f8d9c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.333+0000 7f8db9e00700 1 --2- 172.21.15.2:0/1576345241 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8d9c0a2e10 0x7f8d9c0a52d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55c09201b920 tx=0x7f8da8009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.333+0000 7f8da3400700 1 -- 172.21.15.2:0/4066035682 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db0021070 con 0x55c091f9ae40 2024-06-13T11:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.333+0000 7f8da3400700 1 -- 172.21.15.2:0/4066035682 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8db0009460 con 0x55c091f9ae40 2024-06-13T11:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.333+0000 7f8da3400700 1 -- 172.21.15.2:0/4066035682 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db00256b0 con 0x55c091f9ae40 2024-06-13T11:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.334+0000 7f8dc711db80 1 -- 172.21.15.2:0/4066035682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c091f9ae40 msgr2=0x55c09201e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.334+0000 7f8dc711db80 1 --2- 172.21.15.2:0/4066035682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c091f9ae40 0x55c09201e070 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009e40 tx=0x7f8db000cf30 comp rx=0 tx=0).stop 2024-06-13T11:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.334+0000 7f8dc711db80 1 -- 172.21.15.2:0/4066035682 shutdown_connections 2024-06-13T11:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.334+0000 7f8dc711db80 1 --2- 172.21.15.2:0/4066035682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c092029300 0x55c09202b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.334+0000 7f8dc711db80 1 --2- 172.21.15.2:0/4066035682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c091f9ae40 0x55c09201e070 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.334+0000 7f8dc711db80 1 --2- 172.21.15.2:0/4066035682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c09201e5b0 0x55c09201ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.334+0000 7f8dc711db80 1 -- 172.21.15.2:0/4066035682 >> 172.21.15.2:0/4066035682 conn(0x55c091f4b170 msgr2=0x55c09201a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.334+0000 7f8dc711db80 1 -- 172.21.15.2:0/4066035682 shutdown_connections 2024-06-13T11:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.334+0000 7f8dc711db80 1 -- 172.21.15.2:0/4066035682 wait complete. 2024-06-13T11:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.335+0000 7f8dc711db80 1 -- start start 2024-06-13T11:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.335+0000 7f8dc711db80 1 Processor -- start 2024-06-13T11:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.335+0000 7f8dc711db80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c091f9ae40 0x55c092028a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.335+0000 7f8dc711db80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c09201e5b0 0x55c092025d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.335+0000 7f8dc711db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c092029300 0x55c0920262d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.335+0000 7f8dc711db80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c091f0cf60 con 0x55c09201e5b0 2024-06-13T11:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.335+0000 7f8dc711db80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c091f6cac0 con 0x55c091f9ae40 2024-06-13T11:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.335+0000 7f8dc711db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c09202bf60 con 0x55c092029300 2024-06-13T11:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.336+0000 7f8dc711db80 10 client.0 _ll_register_callbacks cb 0x55c091f0a720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.336+0000 7f8db9e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c091f9ae40 0x55c092028a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.336+0000 7f8db9e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c091f9ae40 0x55c092028a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:36376/0 (socket says 172.21.15.2:36376) 2024-06-13T11:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.336+0000 7f8db9e00700 1 -- 172.21.15.2:0/1045497688 learned_addr learned my addr 172.21.15.2:0/1045497688 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.336+0000 7f8db9400700 1 --2- 172.21.15.2:0/1045497688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c09201e5b0 0x55c092025d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.336+0000 7f8db9e00700 1 -- 172.21.15.2:0/1045497688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c092029300 msgr2=0x55c0920262d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.336+0000 7f8db9e00700 1 --2- 172.21.15.2:0/1045497688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c092029300 0x55c0920262d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.336+0000 7f8db9e00700 1 -- 172.21.15.2:0/1045497688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c09201e5b0 msgr2=0x55c092025d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.336+0000 7f8db9e00700 1 --2- 172.21.15.2:0/1045497688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c09201e5b0 0x55c092025d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.336+0000 7f8db9e00700 1 -- 172.21.15.2:0/1045497688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c091ebf8d0 con 0x55c091f9ae40 2024-06-13T11:27:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.337+0000 7f8db9e00700 1 --2- 172.21.15.2:0/1045497688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c091f9ae40 0x55c092028a90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8da80042e0 tx=0x7f8da80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58347d145b2fcb8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.337+0000 7f8d97e00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:27:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.337+0000 7f8d97e00700 1 -- 172.21.15.2:0/1045497688 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da802c060 con 0x55c091f9ae40 2024-06-13T11:27:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.337+0000 7f8dc711db80 1 -- 172.21.15.2:0/1045497688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8db0009460 con 0x55c091f9ae40 2024-06-13T11:27:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.337+0000 7f8d97e00700 1 -- 172.21.15.2:0/1045497688 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f8da8003ca0 con 0x55c091f9ae40 2024-06-13T11:27:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.337+0000 7f8d97e00700 1 -- 172.21.15.2:0/1045497688 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8da8033050 con 0x55c091f9ae40 2024-06-13T11:27:49.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.337+0000 7f8dc711db80 10 client.25781 fetch_fsmap learned FSMap version 29 2024-06-13T11:27:49.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.337+0000 7f8dc711db80 1 -- 172.21.15.2:0/1045497688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c0920366d0 con 0x55c091f9ae40 2024-06-13T11:27:49.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.338+0000 7f8d97e00700 1 -- 172.21.15.2:0/1045497688 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8db0009460 con 0x55c091f9ae40 2024-06-13T11:27:49.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.338+0000 7f8d97e00700 1 -- 172.21.15.2:0/1045497688 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f8da8026030 con 0x55c091f9ae40 2024-06-13T11:27:49.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.338+0000 7f8dc711db80 10 client.25781 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:27:49.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.338+0000 7f8dc711db80 10 client.25781 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:27:49.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.338+0000 7f8dc711db80 20 client.25781 populate_metadata read hostname 'smithi002' 2024-06-13T11:27:49.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.338+0000 7f8dc711db80 1 --2- 172.21.15.2:0/1045497688 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55c092038cb0 0x55c09203b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.338+0000 7f8dc711db80 4 client.25781 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:27:49.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.338+0000 7f8dc711db80 1 -- 172.21.15.2:0/1045497688 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c091f7e000 con 0x55c092038cb0 2024-06-13T11:27:49.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.339+0000 7f8db9400700 1 --2- 172.21.15.2:0/1045497688 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55c092038cb0 0x55c09203b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.339+0000 7f8db9400700 1 --2- 172.21.15.2:0/1045497688 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55c092038cb0 0x55c09203b0a0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=646e38c8eeecf45d server_cookie=c2b043ed79b98358 in_seq=0 out_seq=0 2024-06-13T11:27:49.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.339+0000 7f8d97e00700 10 client.25781 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:27:49.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.341+0000 7f8d97e00700 1 -- 172.21.15.2:0/1045497688 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c091f7e000 con 0x55c092038cb0 2024-06-13T11:27:49.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.341+0000 7f8d97e00700 10 client.25781 handle_command_reply: tid=0 2024-06-13T11:27:49.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.341+0000 7f8dc711db80 1 client.25781 shutdown 2024-06-13T11:27:49.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.341+0000 7f8dc711db80 1 -- 172.21.15.2:0/1045497688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c091f9ae40 msgr2=0x55c092028a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:49.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.341+0000 7f8dc711db80 1 --2- 172.21.15.2:0/1045497688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c091f9ae40 0x55c092028a90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8da80042e0 tx=0x7f8da80047c0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.341+0000 7f8dc711db80 1 -- 172.21.15.2:0/1045497688 shutdown_connections 2024-06-13T11:27:49.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.341+0000 7f8dc711db80 1 --2- 172.21.15.2:0/1045497688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c092029300 0x55c0920262d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.341+0000 7f8dc711db80 1 --2- 172.21.15.2:0/1045497688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c091f9ae40 0x55c092028a90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.341+0000 7f8dc711db80 1 --2- 172.21.15.2:0/1045497688 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55c092038cb0 0x55c09203b0a0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.341+0000 7f8dc711db80 1 --2- 172.21.15.2:0/1045497688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c09201e5b0 0x55c092025d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.341+0000 7f8dc711db80 1 -- 172.21.15.2:0/1045497688 >> 172.21.15.2:0/1045497688 conn(0x55c091f4b170 msgr2=0x55c092019740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:49.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.341+0000 7f8d97e00700 0 client.25781 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:27:49.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.341+0000 7f8dc711db80 1 -- 172.21.15.2:0/1045497688 shutdown_connections 2024-06-13T11:27:49.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.341+0000 7f8dc711db80 1 -- 172.21.15.2:0/1045497688 wait complete. 2024-06-13T11:27:49.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.341+0000 7f8dc711db80 20 client.25781 trim_cache size 0 max 16384 2024-06-13T11:27:49.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.359+0000 7f8dc711db80 1 Processor -- start 2024-06-13T11:27:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.359+0000 7f8dc711db80 1 -- start start 2024-06-13T11:27:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.359+0000 7f8dc711db80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c091f9ae40 0x55c09202a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.359+0000 7f8dc711db80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c09201e5b0 0x55c0920285d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.359+0000 7f8dc711db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c092029300 0x55c09201ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.359+0000 7f8dc711db80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8db41b2f50 con 0x55c09201e5b0 2024-06-13T11:27:49.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.359+0000 7f8dc711db80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8db41b07e0 con 0x55c091f9ae40 2024-06-13T11:27:49.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.359+0000 7f8dc711db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8db41ae630 con 0x55c092029300 2024-06-13T11:27:49.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.360+0000 7f8db9e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c091f9ae40 0x55c09202a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.360+0000 7f8db9400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c09201e5b0 0x55c0920285d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.360+0000 7f8db9e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c091f9ae40 0x55c09202a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:36380/0 (socket says 172.21.15.2:36380) 2024-06-13T11:27:49.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.360+0000 7f8db9400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c09201e5b0 0x55c0920285d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43748/0 (socket says 172.21.15.2:43748) 2024-06-13T11:27:49.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.360+0000 7f8db9e00700 1 -- 172.21.15.2:0/4046270823 learned_addr learned my addr 172.21.15.2:0/4046270823 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:49.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.360+0000 7f8dba800700 1 --2- 172.21.15.2:0/4046270823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c092029300 0x55c09201ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.360+0000 7f8db9e00700 1 -- 172.21.15.2:0/4046270823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c092029300 msgr2=0x55c09201ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:49.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.360+0000 7f8db9e00700 1 --2- 172.21.15.2:0/4046270823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c092029300 0x55c09201ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.360+0000 7f8db9e00700 1 -- 172.21.15.2:0/4046270823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c09201e5b0 msgr2=0x55c0920285d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:49.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.360+0000 7f8db9e00700 1 --2- 172.21.15.2:0/4046270823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c09201e5b0 0x55c0920285d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.360+0000 7f8db9e00700 1 -- 172.21.15.2:0/4046270823 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c09201fbd0 con 0x55c091f9ae40 2024-06-13T11:27:49.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.360+0000 7f8db9e00700 1 --2- 172.21.15.2:0/4046270823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c091f9ae40 0x55c09202a6f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8da80097a0 tx=0x7f8da8003960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73d685f1c28f4d05 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:49.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.361+0000 7f8da2a00700 1 -- 172.21.15.2:0/4046270823 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da803c070 con 0x55c091f9ae40 2024-06-13T11:27:49.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.361+0000 7f8da2a00700 1 -- 172.21.15.2:0/4046270823 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8da801ed60 con 0x55c091f9ae40 2024-06-13T11:27:49.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.361+0000 7f8da2a00700 1 -- 172.21.15.2:0/4046270823 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8020970 con 0x55c091f9ae40 2024-06-13T11:27:49.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.361+0000 7f8dc711db80 1 -- 172.21.15.2:0/4046270823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c091f9ae40 msgr2=0x55c09202a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:49.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.361+0000 7f8dc711db80 1 --2- 172.21.15.2:0/4046270823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c091f9ae40 0x55c09202a6f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8da80097a0 tx=0x7f8da8003960 comp rx=0 tx=0).stop 2024-06-13T11:27:49.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.362+0000 7f8dc711db80 1 -- 172.21.15.2:0/4046270823 shutdown_connections 2024-06-13T11:27:49.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.362+0000 7f8dc711db80 1 --2- 172.21.15.2:0/4046270823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c092029300 0x55c09201ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.362+0000 7f8dc711db80 1 --2- 172.21.15.2:0/4046270823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c091f9ae40 0x55c09202a6f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.362+0000 7f8dc711db80 1 --2- 172.21.15.2:0/4046270823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c09201e5b0 0x55c0920285d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.362+0000 7f8dc711db80 1 -- 172.21.15.2:0/4046270823 >> 172.21.15.2:0/4046270823 conn(0x55c091f4b170 msgr2=0x55c092024680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:49.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.362+0000 7f8dc711db80 1 -- 172.21.15.2:0/4046270823 shutdown_connections 2024-06-13T11:27:49.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.362+0000 7f8dc711db80 1 -- 172.21.15.2:0/4046270823 wait complete. 2024-06-13T11:27:49.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.362+0000 7f8dc711db80 1 -- start start 2024-06-13T11:27:49.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.362+0000 7f8dc711db80 1 Processor -- start 2024-06-13T11:27:49.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.363+0000 7f8dc711db80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c091f9ae40 0x55c0920314c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.363+0000 7f8dc711db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c09201e5b0 0x55c092031a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.363+0000 7f8dc711db80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c092029300 0x55c09203ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.363+0000 7f8dc711db80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8db41aeca0 con 0x55c091f9ae40 2024-06-13T11:27:49.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.363+0000 7f8dc711db80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8db41b0110 con 0x55c092029300 2024-06-13T11:27:49.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.363+0000 7f8dc711db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8db41af370 con 0x55c09201e5b0 2024-06-13T11:27:49.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.363+0000 7f8dc711db80 10 client.0 _ll_register_callbacks cb 0x55c091f0a720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:27:49.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.363+0000 7f8db9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c091f9ae40 0x55c0920314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.363+0000 7f8db9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c091f9ae40 0x55c0920314c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43750/0 (socket says 172.21.15.2:43750) 2024-06-13T11:27:49.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.363+0000 7f8db9e00700 1 -- 172.21.15.2:0/1362495260 learned_addr learned my addr 172.21.15.2:0/1362495260 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:49.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.363+0000 7f8db9400700 1 --2- 172.21.15.2:0/1362495260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c09201e5b0 0x55c092031a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.363+0000 7f8dba800700 1 --2- 172.21.15.2:0/1362495260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c092029300 0x55c09203ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.364+0000 7f8db9400700 1 -- 172.21.15.2:0/1362495260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c092029300 msgr2=0x55c09203ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:49.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.364+0000 7f8db9400700 1 --2- 172.21.15.2:0/1362495260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c092029300 0x55c09203ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.364+0000 7f8db9400700 1 -- 172.21.15.2:0/1362495260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c091f9ae40 msgr2=0x55c0920314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:49.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.364+0000 7f8db9400700 1 --2- 172.21.15.2:0/1362495260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c091f9ae40 0x55c0920314c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.364+0000 7f8db9400700 1 -- 172.21.15.2:0/1362495260 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c092040820 con 0x55c09201e5b0 2024-06-13T11:27:49.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.364+0000 7f8dba800700 1 --2- 172.21.15.2:0/1362495260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c092029300 0x55c09203ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:27:49.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.364+0000 7f8db9400700 1 --2- 172.21.15.2:0/1362495260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c09201e5b0 0x55c092031a00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8da40ccbd0 tx=0x7f8da400c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eab793d7c9bd4fa server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:49.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.364+0000 7f8d97e00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:27:49.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.364+0000 7f8d97e00700 1 -- 172.21.15.2:0/1362495260 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da409c0a0 con 0x55c09201e5b0 2024-06-13T11:27:49.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.364+0000 7f8d97e00700 1 -- 172.21.15.2:0/1362495260 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f8da4004310 con 0x55c09201e5b0 2024-06-13T11:27:49.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.364+0000 7f8dc711db80 1 -- 172.21.15.2:0/1362495260 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8da801ed60 con 0x55c09201e5b0 2024-06-13T11:27:49.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.365+0000 7f8d97e00700 1 -- 172.21.15.2:0/1362495260 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8da409b9a0 con 0x55c09201e5b0 2024-06-13T11:27:49.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.365+0000 7f8dc711db80 10 client.25825 fetch_fsmap learned FSMap version 29 2024-06-13T11:27:49.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.365+0000 7f8dc711db80 1 -- 172.21.15.2:0/1362495260 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c092030e50 con 0x55c09201e5b0 2024-06-13T11:27:49.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.365+0000 7f8d97e00700 1 -- 172.21.15.2:0/1362495260 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8da801ed60 con 0x55c09201e5b0 2024-06-13T11:27:49.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.365+0000 7f8d97e00700 1 -- 172.21.15.2:0/1362495260 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f8da409bc90 con 0x55c09201e5b0 2024-06-13T11:27:49.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.365+0000 7f8dc711db80 10 client.25825 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:27:49.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.365+0000 7f8dc711db80 10 client.25825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:27:49.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.365+0000 7f8dc711db80 20 client.25825 populate_metadata read hostname 'smithi002' 2024-06-13T11:27:49.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.365+0000 7f8dc711db80 1 --2- 172.21.15.2:0/1362495260 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55c0920a3c10 0x55c0920a6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:49.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.365+0000 7f8dc711db80 4 client.25825 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:27:49.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.365+0000 7f8dc711db80 1 -- 172.21.15.2:0/1362495260 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c091f78580 con 0x55c0920a3c10 2024-06-13T11:27:49.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.366+0000 7f8db9e00700 1 --2- 172.21.15.2:0/1362495260 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55c0920a3c10 0x55c0920a6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:49.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.366+0000 7f8db9e00700 1 --2- 172.21.15.2:0/1362495260 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55c0920a3c10 0x55c0920a6030 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ee869ea9d63a95a server_cookie=a85986ce79e22f4 in_seq=0 out_seq=0 2024-06-13T11:27:49.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.366+0000 7f8d97e00700 10 client.25825 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:27:49.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.366+0000 7f8d97e00700 1 -- 172.21.15.2:0/1362495260 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c091f78580 con 0x55c0920a3c10 2024-06-13T11:27:49.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.366+0000 7f8d97e00700 10 client.25825 handle_command_reply: tid=0 2024-06-13T11:27:49.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.366+0000 7f8dc711db80 1 client.25825 shutdown 2024-06-13T11:27:49.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.367+0000 7f8dc711db80 1 -- 172.21.15.2:0/1362495260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c09201e5b0 msgr2=0x55c092031a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:49.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.367+0000 7f8dc711db80 1 --2- 172.21.15.2:0/1362495260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c09201e5b0 0x55c092031a00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8da40ccbd0 tx=0x7f8da400c6e0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.367+0000 7f8dc711db80 1 -- 172.21.15.2:0/1362495260 shutdown_connections 2024-06-13T11:27:49.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.367+0000 7f8dc711db80 1 --2- 172.21.15.2:0/1362495260 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55c0920a3c10 0x55c0920a6030 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.367+0000 7f8dc711db80 1 --2- 172.21.15.2:0/1362495260 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c091f9ae40 0x55c0920314c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.367+0000 7f8dc711db80 1 --2- 172.21.15.2:0/1362495260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c092029300 0x55c09203ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.367+0000 7f8dc711db80 1 --2- 172.21.15.2:0/1362495260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c09201e5b0 0x55c092031a00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.367+0000 7f8dc711db80 1 -- 172.21.15.2:0/1362495260 >> 172.21.15.2:0/1362495260 conn(0x55c091f4b170 msgr2=0x55c092018eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:49.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.367+0000 7f8d97e00700 0 client.25825 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:27:49.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.367+0000 7f8dc711db80 1 -- 172.21.15.2:0/1362495260 shutdown_connections 2024-06-13T11:27:49.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.367+0000 7f8dc711db80 1 -- 172.21.15.2:0/1362495260 wait complete. 2024-06-13T11:27:49.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.367+0000 7f8dc711db80 20 client.25825 trim_cache size 0 max 16384 2024-06-13T11:27:49.373 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:27:49.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.368+0000 7f8dbc800700 1 -- 172.21.15.2:0/1576345241 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8d9c0a2e10 msgr2=0x7f8d9c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:49.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.368+0000 7f8dbc800700 1 --2- 172.21.15.2:0/1576345241 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8d9c0a2e10 0x7f8d9c0a52d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55c09201b920 tx=0x7f8da8009260 comp rx=0 tx=0).stop 2024-06-13T11:27:49.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.368+0000 7f8dbc800700 1 -- 172.21.15.2:0/1576345241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8db4105020 msgr2=0x7f8db419b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:49.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.368+0000 7f8dbc800700 1 --2- 172.21.15.2:0/1576345241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8db4105020 0x7f8db419b330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8da400e9f0 tx=0x7f8da400ed00 comp rx=0 tx=0).stop 2024-06-13T11:27:49.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.368+0000 7f8dbc800700 1 -- 172.21.15.2:0/1576345241 shutdown_connections 2024-06-13T11:27:49.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.368+0000 7f8dbc800700 1 --2- 172.21.15.2:0/1576345241 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8d9c0a2e10 0x7f8d9c0a52d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.368+0000 7f8dbc800700 1 --2- 172.21.15.2:0/1576345241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8db410a660 0x7f8db419f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.368+0000 7f8dbc800700 1 --2- 172.21.15.2:0/1576345241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8db4104660 0x7f8db419adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.368+0000 7f8dbc800700 1 --2- 172.21.15.2:0/1576345241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8db4105020 0x7f8db419b330 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:49.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.368+0000 7f8dbc800700 1 -- 172.21.15.2:0/1576345241 >> 172.21.15.2:0/1576345241 conn(0x7f8db4100130 msgr2=0x7f8db41006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:49.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.368+0000 7f8dbc800700 1 -- 172.21.15.2:0/1576345241 shutdown_connections 2024-06-13T11:27:49.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:49.368+0000 7f8dbc800700 1 -- 172.21.15.2:0/1576345241 wait complete. 2024-06-13T11:27:49.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:49 smithi002 ceph-mon[32210]: pgmap v124: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-06-13T11:27:49.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:49 smithi178 ceph-mon[36913]: pgmap v124: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-06-13T11:27:49.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:49 smithi077 ceph-mon[36410]: pgmap v124: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-06-13T11:27:51.322 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-13T11:27:51.322 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-13T11:27:51.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:51 smithi002 ceph-mon[32210]: pgmap v125: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:27:51.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:51 smithi178 ceph-mon[36913]: pgmap v125: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:27:51.784 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:27:51.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:51 smithi077 ceph-mon[36410]: pgmap v125: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:27:53.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:53 smithi002 ceph-mon[32210]: pgmap v126: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:27:53.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:53 smithi178 ceph-mon[36913]: pgmap v126: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:27:53.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:53 smithi077 ceph-mon[36410]: pgmap v126: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:27:54.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.180+0000 7fa113200700 1 -- 172.21.15.2:0/1127225071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa114103ef0 msgr2=0x7fa1141083a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:54.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.180+0000 7fa113200700 1 --2- 172.21.15.2:0/1127225071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa114103ef0 0x7fa1141083a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0099c0 tx=0x7fa0fc009cd0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.180+0000 7fa113200700 1 -- 172.21.15.2:0/1127225071 shutdown_connections 2024-06-13T11:27:54.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.180+0000 7fa113200700 1 --2- 172.21.15.2:0/1127225071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa114108ad0 0x7fa11410f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.180+0000 7fa113200700 1 --2- 172.21.15.2:0/1127225071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa114103540 0x7fa114103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.180+0000 7fa113200700 1 --2- 172.21.15.2:0/1127225071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa114103ef0 0x7fa1141083a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.180+0000 7fa113200700 1 -- 172.21.15.2:0/1127225071 >> 172.21.15.2:0/1127225071 conn(0x7fa1140fcd70 msgr2=0x7fa1140ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:54.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.180+0000 7fa113200700 1 -- 172.21.15.2:0/1127225071 shutdown_connections 2024-06-13T11:27:54.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.181+0000 7fa113200700 1 -- 172.21.15.2:0/1127225071 wait complete. 2024-06-13T11:27:54.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.182+0000 7fa113200700 1 Processor -- start 2024-06-13T11:27:54.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.182+0000 7fa113200700 1 -- start start 2024-06-13T11:27:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.182+0000 7fa113200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa114103540 0x7fa1141011a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.182+0000 7fa113200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa114103ef0 0x7fa1141016e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.182+0000 7fa113200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa114108ad0 0x7fa114101c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.182+0000 7fa113200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141127f0 con 0x7fa114103540 2024-06-13T11:27:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.182+0000 7fa113200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa114112670 con 0x7fa114103ef0 2024-06-13T11:27:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.182+0000 7fa113200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa114112970 con 0x7fa114108ad0 2024-06-13T11:27:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.183+0000 7fa111e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa114103540 0x7fa1141011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.183+0000 7fa10be00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa114103ef0 0x7fa1141016e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.183+0000 7fa10be00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa114103ef0 0x7fa1141016e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:36404/0 (socket says 172.21.15.2:36404) 2024-06-13T11:27:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.183+0000 7fa111e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa114103540 0x7fa1141011a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43770/0 (socket says 172.21.15.2:43770) 2024-06-13T11:27:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.183+0000 7fa10be00700 1 -- 172.21.15.2:0/3109692820 learned_addr learned my addr 172.21.15.2:0/3109692820 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.183+0000 7fa112800700 1 --2- 172.21.15.2:0/3109692820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa114108ad0 0x7fa114101c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.183+0000 7fa111e00700 1 -- 172.21.15.2:0/3109692820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa114108ad0 msgr2=0x7fa114101c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.183+0000 7fa111e00700 1 --2- 172.21.15.2:0/3109692820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa114108ad0 0x7fa114101c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.183+0000 7fa111e00700 1 -- 172.21.15.2:0/3109692820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa114103ef0 msgr2=0x7fa1141016e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:54.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.183+0000 7fa111e00700 1 --2- 172.21.15.2:0/3109692820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa114103ef0 0x7fa1141016e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.183+0000 7fa111e00700 1 -- 172.21.15.2:0/3109692820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1141a7270 con 0x7fa114103540 2024-06-13T11:27:54.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.183+0000 7fa10be00700 1 --2- 172.21.15.2:0/3109692820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa114103ef0 0x7fa1141016e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:27:54.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.184+0000 7fa111e00700 1 --2- 172.21.15.2:0/3109692820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa114103540 0x7fa1141011a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa10400e9c0 tx=0x7fa10400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:54.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.184+0000 7fa10aa00700 1 -- 172.21.15.2:0/3109692820 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa104004220 con 0x7fa114103540 2024-06-13T11:27:54.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.184+0000 7fa113200700 1 -- 172.21.15.2:0/3109692820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1141a7560 con 0x7fa114103540 2024-06-13T11:27:54.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.184+0000 7fa10aa00700 1 -- 172.21.15.2:0/3109692820 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1040043c0 con 0x7fa114103540 2024-06-13T11:27:54.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.184+0000 7fa10aa00700 1 -- 172.21.15.2:0/3109692820 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa104003cc0 con 0x7fa114103540 2024-06-13T11:27:54.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.184+0000 7fa113200700 1 -- 172.21.15.2:0/3109692820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1141a7af0 con 0x7fa114103540 2024-06-13T11:27:54.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.187+0000 7fa10aa00700 1 -- 172.21.15.2:0/3109692820 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fa10400c7c0 con 0x7fa114103540 2024-06-13T11:27:54.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.189+0000 7fa123807b80 1 Processor -- start 2024-06-13T11:27:54.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.189+0000 7fa10aa00700 1 --2- 172.21.15.2:0/3109692820 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fa0f80a2e10 0x7fa0f80a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.189+0000 7fa123807b80 1 -- start start 2024-06-13T11:27:54.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.189+0000 7fa10aa00700 1 -- 172.21.15.2:0/3109692820 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fa1040cf9f0 con 0x7fa114103540 2024-06-13T11:27:54.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.189+0000 7fa112800700 1 --2- 172.21.15.2:0/3109692820 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fa0f80a2e10 0x7fa0f80a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.189+0000 7fa123807b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbbd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.190+0000 7fa123807b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbd700 0x55ed2fbc8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.190+0000 7fa123807b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbc85b0 0x55ed2fbca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.190+0000 7fa123807b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ed2facca90 con 0x55ed2fbbd700 2024-06-13T11:27:54.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.190+0000 7fa123807b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ed2fb0fb80 con 0x55ed2fbbcde0 2024-06-13T11:27:54.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.190+0000 7fa123807b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55ed2faca970 con 0x55ed2fbc85b0 2024-06-13T11:27:54.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.190+0000 7fa111e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbbd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.190+0000 7fa111e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbbd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:36408/0 (socket says 172.21.15.2:36408) 2024-06-13T11:27:54.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.190+0000 7fa111e00700 1 -- 172.21.15.2:0/147190901 learned_addr learned my addr 172.21.15.2:0/147190901 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.190+0000 7fa10be00700 1 --2- 172.21.15.2:0/147190901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbd700 0x55ed2fbc8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.190+0000 7fa112800700 1 --2- 172.21.15.2:0/147190901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbc85b0 0x55ed2fbca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.190+0000 7fa111e00700 1 -- 172.21.15.2:0/147190901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbc85b0 msgr2=0x55ed2fbca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.190+0000 7fa111e00700 1 --2- 172.21.15.2:0/147190901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbc85b0 0x55ed2fbca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.190+0000 7fa111e00700 1 -- 172.21.15.2:0/147190901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbd700 msgr2=0x55ed2fbc8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.190+0000 7fa111e00700 1 --2- 172.21.15.2:0/147190901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbd700 0x55ed2fbc8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.190+0000 7fa111e00700 1 -- 172.21.15.2:0/147190901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed2fab8010 con 0x55ed2fbbcde0 2024-06-13T11:27:54.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.191+0000 7fa112800700 1 --2- 172.21.15.2:0/3109692820 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fa0f80a2e10 0x7fa0f80a52d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009550 tx=0x7fa10c009130 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:54.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.191+0000 7fa111e00700 1 --2- 172.21.15.2:0/147190901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbbd1c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa1040a4280 tx=0x7fa10409b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e73458ae1e866b97 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:54.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.191+0000 7fa103400700 1 -- 172.21.15.2:0/147190901 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10409bb40 con 0x55ed2fbbcde0 2024-06-13T11:27:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.191+0000 7fa103400700 1 -- 172.21.15.2:0/147190901 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa10409fef0 con 0x55ed2fbbcde0 2024-06-13T11:27:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.191+0000 7fa103400700 1 -- 172.21.15.2:0/147190901 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10400ce30 con 0x55ed2fbbcde0 2024-06-13T11:27:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.192+0000 7fa123807b80 1 -- 172.21.15.2:0/147190901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbbcde0 msgr2=0x55ed2fbbd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.192+0000 7fa123807b80 1 --2- 172.21.15.2:0/147190901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbbd1c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa1040a4280 tx=0x7fa10409b910 comp rx=0 tx=0).stop 2024-06-13T11:27:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.192+0000 7fa123807b80 1 -- 172.21.15.2:0/147190901 shutdown_connections 2024-06-13T11:27:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.192+0000 7fa123807b80 1 --2- 172.21.15.2:0/147190901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbc85b0 0x55ed2fbca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.192+0000 7fa123807b80 1 --2- 172.21.15.2:0/147190901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbbd1c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.192+0000 7fa123807b80 1 --2- 172.21.15.2:0/147190901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbd700 0x55ed2fbc8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.192+0000 7fa123807b80 1 -- 172.21.15.2:0/147190901 >> 172.21.15.2:0/147190901 conn(0x55ed2faea1f0 msgr2=0x55ed2fbb9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.192+0000 7fa123807b80 1 -- 172.21.15.2:0/147190901 shutdown_connections 2024-06-13T11:27:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.192+0000 7fa123807b80 1 -- 172.21.15.2:0/147190901 wait complete. 2024-06-13T11:27:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.193+0000 7fa123807b80 1 -- start start 2024-06-13T11:27:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.193+0000 7fa123807b80 1 Processor -- start 2024-06-13T11:27:54.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.193+0000 7fa123807b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbc7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.193+0000 7fa123807b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbd700 0x55ed2fbc50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.193+0000 7fa123807b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbc85b0 0x55ed2fbc5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.193+0000 7fa123807b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ed2faabfe0 con 0x55ed2fbbd700 2024-06-13T11:27:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.193+0000 7fa123807b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ed2fb0bb40 con 0x55ed2fbc85b0 2024-06-13T11:27:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.193+0000 7fa123807b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55ed2fbcb040 con 0x55ed2fbbcde0 2024-06-13T11:27:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.194+0000 7fa123807b80 10 client.0 _ll_register_callbacks cb 0x55ed2faa5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:27:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.194+0000 7fa111e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbc7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.194+0000 7fa10be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbd700 0x55ed2fbc50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.194+0000 7fa112800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbc85b0 0x55ed2fbc5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.194+0000 7fa111e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbc7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56250/0 (socket says 172.21.15.2:56250) 2024-06-13T11:27:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.194+0000 7fa111e00700 1 -- 172.21.15.2:0/1804320929 learned_addr learned my addr 172.21.15.2:0/1804320929 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.194+0000 7fa111e00700 1 -- 172.21.15.2:0/1804320929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbc85b0 msgr2=0x55ed2fbc5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.194+0000 7fa111e00700 1 --2- 172.21.15.2:0/1804320929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbc85b0 0x55ed2fbc5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.194+0000 7fa111e00700 1 -- 172.21.15.2:0/1804320929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbd700 msgr2=0x55ed2fbc50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:54.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.194+0000 7fa111e00700 1 --2- 172.21.15.2:0/1804320929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbd700 0x55ed2fbc50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.194+0000 7fa111e00700 1 -- 172.21.15.2:0/1804320929 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed2fa5e950 con 0x55ed2fbbcde0 2024-06-13T11:27:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.195+0000 7fa111e00700 1 --2- 172.21.15.2:0/1804320929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbc7de0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa10409bad0 tx=0x7fa1040ccce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f94b2e278876815 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.195+0000 7fa0f7e00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:27:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.195+0000 7fa0f7e00700 1 -- 172.21.15.2:0/1804320929 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10409bb40 con 0x55ed2fbbcde0 2024-06-13T11:27:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.195+0000 7fa0f7e00700 1 -- 172.21.15.2:0/1804320929 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fa10400cd30 con 0x55ed2fbbcde0 2024-06-13T11:27:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.195+0000 7fa123807b80 1 -- 172.21.15.2:0/1804320929 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa10409fef0 con 0x55ed2fbbcde0 2024-06-13T11:27:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.195+0000 7fa0f7e00700 1 -- 172.21.15.2:0/1804320929 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa1040ba350 con 0x55ed2fbbcde0 2024-06-13T11:27:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.195+0000 7fa123807b80 10 client.25837 fetch_fsmap learned FSMap version 29 2024-06-13T11:27:54.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.195+0000 7fa123807b80 1 -- 172.21.15.2:0/1804320929 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ed2fbd5800 con 0x55ed2fbbcde0 2024-06-13T11:27:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.195+0000 7fa0f7e00700 1 -- 172.21.15.2:0/1804320929 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa10409fef0 con 0x55ed2fbbcde0 2024-06-13T11:27:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.196+0000 7fa0f7e00700 1 -- 172.21.15.2:0/1804320929 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa1040a4320 con 0x55ed2fbbcde0 2024-06-13T11:27:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.196+0000 7fa123807b80 10 client.25837 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:27:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.196+0000 7fa123807b80 10 client.25837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:27:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.196+0000 7fa123807b80 20 client.25837 populate_metadata read hostname 'smithi002' 2024-06-13T11:27:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.196+0000 7fa123807b80 1 --2- 172.21.15.2:0/1804320929 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ed2fbd7cd0 0x55ed2fbda0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.196+0000 7fa123807b80 4 client.25837 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:27:54.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.196+0000 7fa123807b80 1 -- 172.21.15.2:0/1804320929 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed2fb1d080 con 0x55ed2fbd7cd0 2024-06-13T11:27:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.196+0000 7fa10be00700 1 --2- 172.21.15.2:0/1804320929 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ed2fbd7cd0 0x55ed2fbda0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.197+0000 7fa10be00700 1 --2- 172.21.15.2:0/1804320929 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ed2fbd7cd0 0x55ed2fbda0c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=519bb33d43bba296 server_cookie=fbe192513d17d490 in_seq=0 out_seq=0 2024-06-13T11:27:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.197+0000 7fa0f7e00700 10 client.25837 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:27:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.198+0000 7fa0f7e00700 1 -- 172.21.15.2:0/1804320929 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ed2fb1d080 con 0x55ed2fbd7cd0 2024-06-13T11:27:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.198+0000 7fa0f7e00700 10 client.25837 handle_command_reply: tid=0 2024-06-13T11:27:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.198+0000 7fa123807b80 1 client.25837 shutdown 2024-06-13T11:27:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.198+0000 7fa123807b80 1 -- 172.21.15.2:0/1804320929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbcde0 msgr2=0x55ed2fbc7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.198+0000 7fa123807b80 1 --2- 172.21.15.2:0/1804320929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbc7de0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa10409bad0 tx=0x7fa1040ccce0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.198+0000 7fa123807b80 1 -- 172.21.15.2:0/1804320929 shutdown_connections 2024-06-13T11:27:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.198+0000 7fa123807b80 1 --2- 172.21.15.2:0/1804320929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbc85b0 0x55ed2fbc5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.198+0000 7fa123807b80 1 --2- 172.21.15.2:0/1804320929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbc7de0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.198+0000 7fa123807b80 1 --2- 172.21.15.2:0/1804320929 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ed2fbd7cd0 0x55ed2fbda0c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.198+0000 7fa123807b80 1 --2- 172.21.15.2:0/1804320929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbd700 0x55ed2fbc50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.198+0000 7fa0f7e00700 0 client.25837 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:27:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.198+0000 7fa123807b80 1 -- 172.21.15.2:0/1804320929 >> 172.21.15.2:0/1804320929 conn(0x55ed2faea1f0 msgr2=0x55ed2fbb8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:54.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.199+0000 7fa123807b80 1 -- 172.21.15.2:0/1804320929 shutdown_connections 2024-06-13T11:27:54.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.199+0000 7fa123807b80 1 -- 172.21.15.2:0/1804320929 wait complete. 2024-06-13T11:27:54.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.199+0000 7fa123807b80 20 client.25837 trim_cache size 0 max 16384 2024-06-13T11:27:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.223+0000 7fa123807b80 1 Processor -- start 2024-06-13T11:27:54.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.223+0000 7fa123807b80 1 -- start start 2024-06-13T11:27:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.223+0000 7fa123807b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbb9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.223+0000 7fa123807b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbd700 0x55ed2fbd39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.223+0000 7fa123807b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbc85b0 0x55ed2fbd3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.224+0000 7fa123807b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141b2f20 con 0x55ed2fbbcde0 2024-06-13T11:27:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.224+0000 7fa123807b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141b07b0 con 0x55ed2fbc85b0 2024-06-13T11:27:54.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.224+0000 7fa123807b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141ae600 con 0x55ed2fbbd700 2024-06-13T11:27:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.224+0000 7fa111e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbb9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.224+0000 7fa10be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbd700 0x55ed2fbd39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.224+0000 7fa10be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbd700 0x55ed2fbd39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56252/0 (socket says 172.21.15.2:56252) 2024-06-13T11:27:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.224+0000 7fa10be00700 1 -- 172.21.15.2:0/1360367983 learned_addr learned my addr 172.21.15.2:0/1360367983 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:54.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.224+0000 7fa112800700 1 --2- 172.21.15.2:0/1360367983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbc85b0 0x55ed2fbd3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.224+0000 7fa10be00700 1 -- 172.21.15.2:0/1360367983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbc85b0 msgr2=0x55ed2fbd3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:54.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.224+0000 7fa10be00700 1 --2- 172.21.15.2:0/1360367983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbc85b0 0x55ed2fbd3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.224+0000 7fa10be00700 1 -- 172.21.15.2:0/1360367983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbcde0 msgr2=0x55ed2fbb9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:54.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.224+0000 7fa10be00700 1 --2- 172.21.15.2:0/1360367983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbb9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.224+0000 7fa10be00700 1 -- 172.21.15.2:0/1360367983 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed2fbbe840 con 0x55ed2fbbd700 2024-06-13T11:27:54.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.225+0000 7fa10be00700 1 --2- 172.21.15.2:0/1360367983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbd700 0x55ed2fbd39a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009990 tx=0x7fa0fc005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0173af5a9e55cde server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:54.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.225+0000 7fa102a00700 1 -- 172.21.15.2:0/1360367983 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc003860 con 0x55ed2fbbd700 2024-06-13T11:27:54.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.225+0000 7fa102a00700 1 -- 172.21.15.2:0/1360367983 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0fc0050b0 con 0x55ed2fbbd700 2024-06-13T11:27:54.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.225+0000 7fa102a00700 1 -- 172.21.15.2:0/1360367983 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc00f6c0 con 0x55ed2fbbd700 2024-06-13T11:27:54.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.226+0000 7fa123807b80 1 -- 172.21.15.2:0/1360367983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbd700 msgr2=0x55ed2fbd39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:54.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.226+0000 7fa123807b80 1 --2- 172.21.15.2:0/1360367983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbd700 0x55ed2fbd39a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009990 tx=0x7fa0fc005040 comp rx=0 tx=0).stop 2024-06-13T11:27:54.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.226+0000 7fa123807b80 1 -- 172.21.15.2:0/1360367983 shutdown_connections 2024-06-13T11:27:54.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.226+0000 7fa123807b80 1 --2- 172.21.15.2:0/1360367983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbb9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.226+0000 7fa123807b80 1 --2- 172.21.15.2:0/1360367983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbc85b0 0x55ed2fbd3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.226+0000 7fa123807b80 1 --2- 172.21.15.2:0/1360367983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbd700 0x55ed2fbd39a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.226+0000 7fa123807b80 1 -- 172.21.15.2:0/1360367983 >> 172.21.15.2:0/1360367983 conn(0x55ed2faea1f0 msgr2=0x55ed2fbd3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:54.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.226+0000 7fa123807b80 1 -- 172.21.15.2:0/1360367983 shutdown_connections 2024-06-13T11:27:54.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.226+0000 7fa123807b80 1 -- 172.21.15.2:0/1360367983 wait complete. 2024-06-13T11:27:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.227+0000 7fa123807b80 1 -- start start 2024-06-13T11:27:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.227+0000 7fa123807b80 1 Processor -- start 2024-06-13T11:27:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.227+0000 7fa123807b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbdd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.227+0000 7fa123807b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbd700 0x55ed2fbdbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.227+0000 7fa123807b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbc85b0 0x55ed2fbdc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.227+0000 7fa123807b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141aec70 con 0x55ed2fbbcde0 2024-06-13T11:27:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.227+0000 7fa123807b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141b00e0 con 0x55ed2fbc85b0 2024-06-13T11:27:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.227+0000 7fa123807b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa1141af340 con 0x55ed2fbbd700 2024-06-13T11:27:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.227+0000 7fa123807b80 10 client.0 _ll_register_callbacks cb 0x55ed2faa5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:27:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.228+0000 7fa111e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbdd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.228+0000 7fa10be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbd700 0x55ed2fbdbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.228+0000 7fa111e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbdd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43824/0 (socket says 172.21.15.2:43824) 2024-06-13T11:27:54.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.228+0000 7fa10be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbd700 0x55ed2fbdbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56268/0 (socket says 172.21.15.2:56268) 2024-06-13T11:27:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.228+0000 7fa111e00700 1 -- 172.21.15.2:0/1786076159 learned_addr learned my addr 172.21.15.2:0/1786076159 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.228+0000 7fa112800700 1 --2- 172.21.15.2:0/1786076159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbc85b0 0x55ed2fbdc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.228+0000 7fa10be00700 1 -- 172.21.15.2:0/1786076159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbc85b0 msgr2=0x55ed2fbdc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.228+0000 7fa10be00700 1 --2- 172.21.15.2:0/1786076159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbc85b0 0x55ed2fbdc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.228+0000 7fa10be00700 1 -- 172.21.15.2:0/1786076159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbcde0 msgr2=0x55ed2fbdd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.228+0000 7fa10be00700 1 --2- 172.21.15.2:0/1786076159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbdd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.228+0000 7fa10be00700 1 -- 172.21.15.2:0/1786076159 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed2fc42620 con 0x55ed2fbbd700 2024-06-13T11:27:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.228+0000 7fa111e00700 1 --2- 172.21.15.2:0/1786076159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbdd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:27:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.229+0000 7fa10be00700 1 --2- 172.21.15.2:0/1786076159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbd700 0x55ed2fbdbcb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55ed2fbb36f0 tx=0x7fa0fc00b6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2945318a565a9d85 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.229+0000 7fa0f7e00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:27:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.229+0000 7fa0f7e00700 1 -- 172.21.15.2:0/1786076159 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc005260 con 0x55ed2fbbd700 2024-06-13T11:27:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.229+0000 7fa123807b80 1 -- 172.21.15.2:0/1786076159 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0fc0050b0 con 0x55ed2fbbd700 2024-06-13T11:27:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.229+0000 7fa0f7e00700 1 -- 172.21.15.2:0/1786076159 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fa0fc005400 con 0x55ed2fbbd700 2024-06-13T11:27:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.229+0000 7fa0f7e00700 1 -- 172.21.15.2:0/1786076159 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa0fc046050 con 0x55ed2fbbd700 2024-06-13T11:27:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.229+0000 7fa123807b80 10 client.25843 fetch_fsmap learned FSMap version 29 2024-06-13T11:27:54.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.229+0000 7fa123807b80 1 -- 172.21.15.2:0/1786076159 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ed2fc437c0 con 0x55ed2fbbd700 2024-06-13T11:27:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.230+0000 7fa0f7e00700 1 -- 172.21.15.2:0/1786076159 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0fc0050b0 con 0x55ed2fbbd700 2024-06-13T11:27:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.230+0000 7fa0f7e00700 1 -- 172.21.15.2:0/1786076159 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa0fc00fa30 con 0x55ed2fbbd700 2024-06-13T11:27:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.230+0000 7fa123807b80 10 client.25843 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:27:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.230+0000 7fa123807b80 10 client.25843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:27:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.230+0000 7fa123807b80 20 client.25843 populate_metadata read hostname 'smithi002' 2024-06-13T11:27:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.230+0000 7fa123807b80 1 --2- 172.21.15.2:0/1786076159 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ed2fc43e40 0x55ed2fc46260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.230+0000 7fa123807b80 4 client.25843 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-13T11:27:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.230+0000 7fa123807b80 1 -- 172.21.15.2:0/1786076159 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ed2fb17600 con 0x55ed2fc43e40 2024-06-13T11:27:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.231+0000 7fa111e00700 1 --2- 172.21.15.2:0/1786076159 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ed2fc43e40 0x55ed2fc46260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.231+0000 7fa111e00700 1 --2- 172.21.15.2:0/1786076159 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ed2fc43e40 0x55ed2fc46260 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f31ad7e1823e972f server_cookie=8b0b1e1e61a2aa7c in_seq=0 out_seq=0 2024-06-13T11:27:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.231+0000 7fa0f7e00700 10 client.25843 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:27:54.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.232+0000 7fa0f7e00700 1 -- 172.21.15.2:0/1786076159 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ed2fb17600 con 0x55ed2fc43e40 2024-06-13T11:27:54.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.232+0000 7fa0f7e00700 10 client.25843 handle_command_reply: tid=0 2024-06-13T11:27:54.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.232+0000 7fa123807b80 1 client.25843 shutdown 2024-06-13T11:27:54.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.233+0000 7fa123807b80 1 -- 172.21.15.2:0/1786076159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbd700 msgr2=0x55ed2fbdbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:54.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.233+0000 7fa123807b80 1 --2- 172.21.15.2:0/1786076159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbd700 0x55ed2fbdbcb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55ed2fbb36f0 tx=0x7fa0fc00b6b0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.233+0000 7fa123807b80 1 -- 172.21.15.2:0/1786076159 shutdown_connections 2024-06-13T11:27:54.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.233+0000 7fa123807b80 1 --2- 172.21.15.2:0/1786076159 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55ed2fc43e40 0x55ed2fc46260 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.233+0000 7fa123807b80 1 --2- 172.21.15.2:0/1786076159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ed2fbbcde0 0x55ed2fbdd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.233+0000 7fa123807b80 1 --2- 172.21.15.2:0/1786076159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ed2fbc85b0 0x55ed2fbdc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.233+0000 7fa123807b80 1 --2- 172.21.15.2:0/1786076159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ed2fbbd700 0x55ed2fbdbcb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.233+0000 7fa0f7e00700 0 client.25843 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:27:54.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.233+0000 7fa123807b80 1 -- 172.21.15.2:0/1786076159 >> 172.21.15.2:0/1786076159 conn(0x55ed2faea1f0 msgr2=0x55ed2fbd3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:54.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.233+0000 7fa123807b80 1 -- 172.21.15.2:0/1786076159 shutdown_connections 2024-06-13T11:27:54.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.233+0000 7fa123807b80 1 -- 172.21.15.2:0/1786076159 wait complete. 2024-06-13T11:27:54.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.233+0000 7fa123807b80 20 client.25843 trim_cache size 0 max 16384 2024-06-13T11:27:54.238 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:27:54.238 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-06-13T11:27:54.238 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "8acc392e-eada-45cd-8374-db880015303c", 2024-06-13T11:27:54.239 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-06-13T11:27:54.239 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:27:54.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.234+0000 7fa113200700 1 -- 172.21.15.2:0/3109692820 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fa0f80a2e10 msgr2=0x7fa0f80a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:54.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.234+0000 7fa113200700 1 --2- 172.21.15.2:0/3109692820 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fa0f80a2e10 0x7fa0f80a52d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009550 tx=0x7fa10c009130 comp rx=0 tx=0).stop 2024-06-13T11:27:54.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.234+0000 7fa113200700 1 -- 172.21.15.2:0/3109692820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa114103540 msgr2=0x7fa1141011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.234+0000 7fa113200700 1 --2- 172.21.15.2:0/3109692820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa114103540 0x7fa1141011a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa10400e9c0 tx=0x7fa10400ecd0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.234+0000 7fa113200700 1 -- 172.21.15.2:0/3109692820 shutdown_connections 2024-06-13T11:27:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.234+0000 7fa113200700 1 --2- 172.21.15.2:0/3109692820 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fa0f80a2e10 0x7fa0f80a52d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.234+0000 7fa113200700 1 --2- 172.21.15.2:0/3109692820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa114103540 0x7fa1141011a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.234+0000 7fa113200700 1 --2- 172.21.15.2:0/3109692820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa114108ad0 0x7fa114101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.234+0000 7fa113200700 1 --2- 172.21.15.2:0/3109692820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa114103ef0 0x7fa1141016e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.234+0000 7fa113200700 1 -- 172.21.15.2:0/3109692820 >> 172.21.15.2:0/3109692820 conn(0x7fa1140fcd70 msgr2=0x7fa1140fea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.234+0000 7fa113200700 1 -- 172.21.15.2:0/3109692820 shutdown_connections 2024-06-13T11:27:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:54.234+0000 7fa113200700 1 -- 172.21.15.2:0/3109692820 wait complete. 2024-06-13T11:27:55.318 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:27:55.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:55 smithi002 ceph-mon[32210]: scrub queued for path: / 2024-06-13T11:27:55.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:55 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:27:55.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:55 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:27:55.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:55 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:27:55.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:55 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:27:55.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:55 smithi002 ceph-mon[32210]: pgmap v127: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:27:55.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:55 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:27:55.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:55 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:27:55.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:55 smithi178 ceph-mon[36913]: scrub queued for path: / 2024-06-13T11:27:55.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:55 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:27:55.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:55 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:27:55.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:55 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:27:55.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:55 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:27:55.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:55 smithi178 ceph-mon[36913]: pgmap v127: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:27:55.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:55 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:27:55.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:55 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:27:55.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:55 smithi077 ceph-mon[36410]: scrub queued for path: / 2024-06-13T11:27:55.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:55 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:27:55.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:55 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:27:55.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:55 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:27:55.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:55 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:27:55.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:55 smithi077 ceph-mon[36410]: pgmap v127: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:27:55.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:55 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:27:55.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:55 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:27:55.809 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:27:56.478 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:56 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:27:56.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:56 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:27:56.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:56 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:27:57.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:57 smithi002 ceph-mon[32210]: pgmap v128: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:27:57.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:57 smithi178 ceph-mon[36913]: pgmap v128: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:27:57.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:57 smithi077 ceph-mon[36410]: pgmap v128: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:27:58.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.153+0000 7f2faca00700 1 -- 172.21.15.2:0/691444761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fa81045c0 msgr2=0x7f2fa8104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:58.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.153+0000 7f2faca00700 1 --2- 172.21.15.2:0/691444761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fa81045c0 0x7f2fa8104a40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2f940098f0 tx=0x7f2f94009c00 comp rx=0 tx=0).stop 2024-06-13T11:27:58.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.153+0000 7f2faca00700 1 -- 172.21.15.2:0/691444761 shutdown_connections 2024-06-13T11:27:58.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.153+0000 7f2faca00700 1 --2- 172.21.15.2:0/691444761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fa810a650 0x7f2fa810aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.153+0000 7f2faca00700 1 --2- 172.21.15.2:0/691444761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fa8104f80 0x7f2fa8111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.153+0000 7f2faca00700 1 --2- 172.21.15.2:0/691444761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fa81045c0 0x7f2fa8104a40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.153+0000 7f2faca00700 1 -- 172.21.15.2:0/691444761 >> 172.21.15.2:0/691444761 conn(0x7f2fa81000b0 msgr2=0x7f2fa81024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:58.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.153+0000 7f2faca00700 1 -- 172.21.15.2:0/691444761 shutdown_connections 2024-06-13T11:27:58.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.153+0000 7f2faca00700 1 -- 172.21.15.2:0/691444761 wait complete. 2024-06-13T11:27:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.155+0000 7f2faca00700 1 Processor -- start 2024-06-13T11:27:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.155+0000 7f2faca00700 1 -- start start 2024-06-13T11:27:58.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.156+0000 7f2faca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fa81045c0 0x7f2fa819ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.156+0000 7f2faca00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fa8104f80 0x7f2fa819b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.156+0000 7f2faca00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fa810a650 0x7f2fa819f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.156+0000 7f2faca00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa8114960 con 0x7f2fa8104f80 2024-06-13T11:27:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.156+0000 7f2faca00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa81147e0 con 0x7f2fa810a650 2024-06-13T11:27:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.156+0000 7f2faca00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa8114ae0 con 0x7f2fa81045c0 2024-06-13T11:27:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.156+0000 7f2fa7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fa81045c0 0x7f2fa819ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.156+0000 7f2fa7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fa81045c0 0x7f2fa819ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56916/0 (socket says 172.21.15.2:56916) 2024-06-13T11:27:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.156+0000 7f2fa7400700 1 -- 172.21.15.2:0/602686987 learned_addr learned my addr 172.21.15.2:0/602686987 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.156+0000 7f2fa6a00700 1 --2- 172.21.15.2:0/602686987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fa8104f80 0x7f2fa819b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.157+0000 7f2fa7e00700 1 --2- 172.21.15.2:0/602686987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fa810a650 0x7f2fa819f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.157+0000 7f2fa7400700 1 -- 172.21.15.2:0/602686987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fa810a650 msgr2=0x7f2fa819f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.157+0000 7f2fa7400700 1 --2- 172.21.15.2:0/602686987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fa810a650 0x7f2fa819f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.157+0000 7f2fa7400700 1 -- 172.21.15.2:0/602686987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fa8104f80 msgr2=0x7f2fa819b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.157+0000 7f2fa7400700 1 --2- 172.21.15.2:0/602686987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fa8104f80 0x7f2fa819b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.157+0000 7f2fa7400700 1 -- 172.21.15.2:0/602686987 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa819fd60 con 0x7f2fa81045c0 2024-06-13T11:27:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.157+0000 7f2fa7e00700 1 --2- 172.21.15.2:0/602686987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fa810a650 0x7f2fa819f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:27:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.157+0000 7f2fa7400700 1 --2- 172.21.15.2:0/602686987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fa81045c0 0x7f2fa819ad50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800ebf0 tx=0x7f2f9800ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.157+0000 7f2f9fe00700 1 -- 172.21.15.2:0/602686987 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9800cd40 con 0x7f2fa81045c0 2024-06-13T11:27:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.157+0000 7f2f9fe00700 1 -- 172.21.15.2:0/602686987 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f98010910 con 0x7f2fa81045c0 2024-06-13T11:27:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.158+0000 7f2f9fe00700 1 -- 172.21.15.2:0/602686987 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f980189c0 con 0x7f2fa81045c0 2024-06-13T11:27:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.158+0000 7f2faca00700 1 -- 172.21.15.2:0/602686987 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa81a0050 con 0x7f2fa81045c0 2024-06-13T11:27:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.158+0000 7f2faca00700 1 -- 172.21.15.2:0/602686987 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa81a78d0 con 0x7f2fa81045c0 2024-06-13T11:27:58.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.161+0000 7f2f9fe00700 1 -- 172.21.15.2:0/602686987 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f2f9801f020 con 0x7f2fa81045c0 2024-06-13T11:27:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.162+0000 7f2fb89abb80 1 Processor -- start 2024-06-13T11:27:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.162+0000 7f2fb89abb80 1 -- start start 2024-06-13T11:27:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.163+0000 7f2f9fe00700 1 --2- 172.21.15.2:0/602686987 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2f8c0a2e10 0x7f2f8c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.163+0000 7f2fb89abb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999ce8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.163+0000 7f2fb89abb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 0x556999ce8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.163+0000 7f2fb89abb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999cf1570 0x556999cf3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.163+0000 7f2fb89abb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556999bf5a10 con 0x556999ce8960 2024-06-13T11:27:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.163+0000 7f2fb89abb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556999c38b00 con 0x556999cf1570 2024-06-13T11:27:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.163+0000 7f2fb89abb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556999bf38f0 con 0x556999c62e40 2024-06-13T11:27:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.163+0000 7f2f9fe00700 1 -- 172.21.15.2:0/602686987 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f2f980cfa40 con 0x7f2fa81045c0 2024-06-13T11:27:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.163+0000 7f2fa7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999ce8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.163+0000 7f2fa7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999ce8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56922/0 (socket says 172.21.15.2:56922) 2024-06-13T11:27:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.163+0000 7f2fa7400700 1 -- 172.21.15.2:0/1901957206 learned_addr learned my addr 172.21.15.2:0/1901957206 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:58.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.163+0000 7f2fa6a00700 1 --2- 172.21.15.2:0/1901957206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 0x556999ce8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.163+0000 7f2fa7e00700 1 --2- 172.21.15.2:0/602686987 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2f8c0a2e10 0x7f2f8c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.164+0000 7f2fa7e00700 1 --2- 172.21.15.2:0/1901957206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999cf1570 0x556999cf3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.164+0000 7f2fa7400700 1 -- 172.21.15.2:0/1901957206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999cf1570 msgr2=0x556999cf3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:58.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.164+0000 7f2fa7400700 1 --2- 172.21.15.2:0/1901957206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999cf1570 0x556999cf3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.164+0000 7f2fa7400700 1 -- 172.21.15.2:0/1901957206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 msgr2=0x556999ce8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:58.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.164+0000 7f2fa7400700 1 --2- 172.21.15.2:0/1901957206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 0x556999ce8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.164+0000 7f2fa7400700 1 -- 172.21.15.2:0/1901957206 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556999be0f90 con 0x556999c62e40 2024-06-13T11:27:58.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.164+0000 7f2fa7400700 1 --2- 172.21.15.2:0/1901957206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999ce8420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2f98098560 tx=0x7f2f9809ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac4e695b6e9704e2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.164+0000 7f2fa7e00700 1 --2- 172.21.15.2:0/602686987 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2f8c0a2e10 0x7f2f8c0a52d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0015b80 tx=0x7f2fa0009920 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.164+0000 7f2f9cc00700 1 -- 172.21.15.2:0/1901957206 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9809ff40 con 0x556999c62e40 2024-06-13T11:27:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.165+0000 7f2f9cc00700 1 -- 172.21.15.2:0/1901957206 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f980a4800 con 0x556999c62e40 2024-06-13T11:27:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.165+0000 7f2f9cc00700 1 -- 172.21.15.2:0/1901957206 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98095a50 con 0x556999c62e40 2024-06-13T11:27:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.165+0000 7f2fb89abb80 1 -- 172.21.15.2:0/1901957206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 msgr2=0x556999ce8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.165+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/1901957206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999ce8420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2f98098560 tx=0x7f2f9809ba90 comp rx=0 tx=0).stop 2024-06-13T11:27:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.165+0000 7f2fb89abb80 1 -- 172.21.15.2:0/1901957206 shutdown_connections 2024-06-13T11:27:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.165+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/1901957206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999cf1570 0x556999cf3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.165+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/1901957206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999ce8420 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.165+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/1901957206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 0x556999ce8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.165+0000 7f2fb89abb80 1 -- 172.21.15.2:0/1901957206 >> 172.21.15.2:0/1901957206 conn(0x556999c13170 msgr2=0x556999ce2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:58.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.166+0000 7f2fb89abb80 1 -- 172.21.15.2:0/1901957206 shutdown_connections 2024-06-13T11:27:58.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.166+0000 7f2fb89abb80 1 -- 172.21.15.2:0/1901957206 wait complete. 2024-06-13T11:27:58.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.166+0000 7f2fb89abb80 1 -- start start 2024-06-13T11:27:58.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.167+0000 7f2fb89abb80 1 Processor -- start 2024-06-13T11:27:58.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.167+0000 7f2fb89abb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999cf0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.167+0000 7f2fb89abb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 0x556999cee090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.167+0000 7f2fb89abb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999cf1570 0x556999cee5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.167+0000 7f2fb89abb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556999bd4f60 con 0x556999ce8960 2024-06-13T11:27:58.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.167+0000 7f2fb89abb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556999c34ac0 con 0x556999cf1570 2024-06-13T11:27:58.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.167+0000 7f2fb89abb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556999cf4120 con 0x556999c62e40 2024-06-13T11:27:58.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.167+0000 7f2fb89abb80 10 client.0 _ll_register_callbacks cb 0x556999bd2720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:27:58.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.168+0000 7f2fa6a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 0x556999cee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.168+0000 7f2fa6a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 0x556999cee090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59250/0 (socket says 172.21.15.2:59250) 2024-06-13T11:27:58.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.168+0000 7f2fa6a00700 1 -- 172.21.15.2:0/1261469231 learned_addr learned my addr 172.21.15.2:0/1261469231 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:58.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.168+0000 7f2fa7e00700 1 --2- 172.21.15.2:0/1261469231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999cf1570 0x556999cee5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.168+0000 7f2fa7400700 1 --2- 172.21.15.2:0/1261469231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999cf0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.168+0000 7f2fa6a00700 1 -- 172.21.15.2:0/1261469231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 msgr2=0x556999cf0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:58.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.168+0000 7f2fa6a00700 1 --2- 172.21.15.2:0/1261469231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999cf0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.168+0000 7f2fa6a00700 1 -- 172.21.15.2:0/1261469231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999cf1570 msgr2=0x556999cee5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:58.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.168+0000 7f2fa6a00700 1 --2- 172.21.15.2:0/1261469231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999cf1570 0x556999cee5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.168+0000 7f2fa6a00700 1 -- 172.21.15.2:0/1261469231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556999b878d0 con 0x556999ce8960 2024-06-13T11:27:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.168+0000 7f2fa7e00700 1 --2- 172.21.15.2:0/1261469231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999cf1570 0x556999cee5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:27:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.169+0000 7f2fa6a00700 1 --2- 172.21.15.2:0/1261469231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 0x556999cee090 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2f940098f0 tx=0x7f2f9400f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c56ef070d740885 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.169+0000 7f2f91600700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:27:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.169+0000 7f2f91600700 1 -- 172.21.15.2:0/1261469231 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94005450 con 0x556999ce8960 2024-06-13T11:27:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.169+0000 7f2fb89abb80 1 -- 172.21.15.2:0/1261469231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f980a4800 con 0x556999ce8960 2024-06-13T11:27:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.169+0000 7f2f91600700 1 -- 172.21.15.2:0/1261469231 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f2f940055f0 con 0x556999ce8960 2024-06-13T11:27:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.169+0000 7f2f91600700 1 -- 172.21.15.2:0/1261469231 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2f9402f050 con 0x556999ce8960 2024-06-13T11:27:58.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.169+0000 7f2fb89abb80 10 client.15705 fetch_fsmap learned FSMap version 29 2024-06-13T11:27:58.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.169+0000 7f2fb89abb80 1 -- 172.21.15.2:0/1261469231 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556999cfe940 con 0x556999ce8960 2024-06-13T11:27:58.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.170+0000 7f2f91600700 1 -- 172.21.15.2:0/1261469231 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f980a4800 con 0x556999ce8960 2024-06-13T11:27:58.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.170+0000 7f2f91600700 1 -- 172.21.15.2:0/1261469231 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2f9402a030 con 0x556999ce8960 2024-06-13T11:27:58.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.170+0000 7f2fb89abb80 10 client.15705 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:27:58.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.170+0000 7f2fb89abb80 10 client.15705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:27:58.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.170+0000 7f2fb89abb80 20 client.15705 populate_metadata read hostname 'smithi002' 2024-06-13T11:27:58.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.170+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/1261469231 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x556999d01010 0x556999d03430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.170+0000 7f2fb89abb80 4 client.15705 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:27:58.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.170+0000 7f2fb89abb80 1 -- 172.21.15.2:0/1261469231 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556999c46000 con 0x556999d01010 2024-06-13T11:27:58.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.170+0000 7f2fa7400700 1 --2- 172.21.15.2:0/1261469231 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x556999d01010 0x556999d03430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.171+0000 7f2fa7400700 1 --2- 172.21.15.2:0/1261469231 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x556999d01010 0x556999d03430 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2f506d19d54f868 server_cookie=48093f118df3800c in_seq=0 out_seq=0 2024-06-13T11:27:58.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.171+0000 7f2f91600700 10 client.15705 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:27:58.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.172+0000 7f2f91600700 1 -- 172.21.15.2:0/1261469231 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556999c46000 con 0x556999d01010 2024-06-13T11:27:58.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.172+0000 7f2f91600700 10 client.15705 handle_command_reply: tid=0 2024-06-13T11:27:58.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.172+0000 7f2fb89abb80 1 client.15705 shutdown 2024-06-13T11:27:58.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.172+0000 7f2fb89abb80 1 -- 172.21.15.2:0/1261469231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 msgr2=0x556999cee090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:58.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.172+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/1261469231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 0x556999cee090 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2f940098f0 tx=0x7f2f9400f9a0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.172+0000 7f2fb89abb80 1 -- 172.21.15.2:0/1261469231 shutdown_connections 2024-06-13T11:27:58.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.172+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/1261469231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999cf1570 0x556999cee5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.172+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/1261469231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999cf0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.172+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/1261469231 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x556999d01010 0x556999d03430 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.172+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/1261469231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 0x556999cee090 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.172+0000 7f2fb89abb80 1 -- 172.21.15.2:0/1261469231 >> 172.21.15.2:0/1261469231 conn(0x556999c13170 msgr2=0x556999ce2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:58.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.172+0000 7f2f91600700 0 client.15705 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:27:58.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.173+0000 7f2fb89abb80 1 -- 172.21.15.2:0/1261469231 shutdown_connections 2024-06-13T11:27:58.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.173+0000 7f2fb89abb80 1 -- 172.21.15.2:0/1261469231 wait complete. 2024-06-13T11:27:58.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.173+0000 7f2fb89abb80 20 client.15705 trim_cache size 0 max 16384 2024-06-13T11:27:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.196+0000 7f2fb89abb80 1 Processor -- start 2024-06-13T11:27:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.197+0000 7f2fb89abb80 1 -- start start 2024-06-13T11:27:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.197+0000 7f2fb89abb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999ce2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.197+0000 7f2fb89abb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 0x556999ceffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.197+0000 7f2fb89abb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999cf1570 0x556999d08d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.197+0000 7f2fb89abb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa81b2c80 con 0x556999ce8960 2024-06-13T11:27:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.197+0000 7f2fb89abb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa81b0510 con 0x556999cf1570 2024-06-13T11:27:58.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.197+0000 7f2fb89abb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa81ae360 con 0x556999c62e40 2024-06-13T11:27:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.197+0000 7f2fa6a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 0x556999ceffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.197+0000 7f2fa6a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 0x556999ceffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59258/0 (socket says 172.21.15.2:59258) 2024-06-13T11:27:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.197+0000 7f2fa6a00700 1 -- 172.21.15.2:0/847817879 learned_addr learned my addr 172.21.15.2:0/847817879 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.197+0000 7f2fa7400700 1 --2- 172.21.15.2:0/847817879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999ce2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.198+0000 7f2fa7e00700 1 --2- 172.21.15.2:0/847817879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999cf1570 0x556999d08d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.198+0000 7f2fa6a00700 1 -- 172.21.15.2:0/847817879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 msgr2=0x556999ce2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.198+0000 7f2fa6a00700 1 --2- 172.21.15.2:0/847817879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999ce2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.198+0000 7f2fa6a00700 1 -- 172.21.15.2:0/847817879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999cf1570 msgr2=0x556999d08d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.198+0000 7f2fa6a00700 1 --2- 172.21.15.2:0/847817879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999cf1570 0x556999d08d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.198+0000 7f2fa6a00700 1 -- 172.21.15.2:0/847817879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556999d03ab0 con 0x556999ce8960 2024-06-13T11:27:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.198+0000 7f2fa6a00700 1 --2- 172.21.15.2:0/847817879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 0x556999ceffd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009c40 tx=0x7f2f94009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47529200de95c566 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.199+0000 7f2f93e00700 1 -- 172.21.15.2:0/847817879 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9400bc20 con 0x556999ce8960 2024-06-13T11:27:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.199+0000 7f2f93e00700 1 -- 172.21.15.2:0/847817879 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f9400bdc0 con 0x556999ce8960 2024-06-13T11:27:58.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.199+0000 7f2f93e00700 1 -- 172.21.15.2:0/847817879 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94003b20 con 0x556999ce8960 2024-06-13T11:27:58.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.199+0000 7f2fb89abb80 1 -- 172.21.15.2:0/847817879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 msgr2=0x556999ceffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:58.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.199+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/847817879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 0x556999ceffd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009c40 tx=0x7f2f94009fd0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.200+0000 7f2fb89abb80 1 -- 172.21.15.2:0/847817879 shutdown_connections 2024-06-13T11:27:58.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.200+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/847817879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999cf1570 0x556999d08d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.200+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/847817879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999ce2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.200+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/847817879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999ce8960 0x556999ceffd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.200+0000 7f2fb89abb80 1 -- 172.21.15.2:0/847817879 >> 172.21.15.2:0/847817879 conn(0x556999c13170 msgr2=0x556999cef8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:58.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.200+0000 7f2fb89abb80 1 -- 172.21.15.2:0/847817879 shutdown_connections 2024-06-13T11:27:58.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.200+0000 7f2fb89abb80 1 -- 172.21.15.2:0/847817879 wait complete. 2024-06-13T11:27:58.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.200+0000 7f2fb89abb80 1 -- start start 2024-06-13T11:27:58.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.201+0000 7f2fb89abb80 1 Processor -- start 2024-06-13T11:27:58.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.201+0000 7f2fb89abb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999cf4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.201+0000 7f2fb89abb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999ce8960 0x556999cf4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.201+0000 7f2fb89abb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999cf1570 0x556999d72510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.201+0000 7f2fb89abb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa81ae9d0 con 0x556999cf1570 2024-06-13T11:27:58.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.201+0000 7f2fb89abb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa81afe40 con 0x556999ce8960 2024-06-13T11:27:58.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.201+0000 7f2fb89abb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa81af0a0 con 0x556999c62e40 2024-06-13T11:27:58.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.201+0000 7f2fb89abb80 10 client.0 _ll_register_callbacks cb 0x556999bd2720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:27:58.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.202+0000 7f2fa6a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999ce8960 0x556999cf4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.202+0000 7f2fa7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999cf1570 0x556999d72510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.202+0000 7f2fa7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999cf4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.202+0000 7f2fa6a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999ce8960 0x556999cf4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:41112/0 (socket says 172.21.15.2:41112) 2024-06-13T11:27:58.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.202+0000 7f2fa6a00700 1 -- 172.21.15.2:0/2390780775 learned_addr learned my addr 172.21.15.2:0/2390780775 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:27:58.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.202+0000 7f2fa6a00700 1 -- 172.21.15.2:0/2390780775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 msgr2=0x556999cf4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:58.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.202+0000 7f2fa6a00700 1 --2- 172.21.15.2:0/2390780775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999cf4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.202+0000 7f2fa6a00700 1 -- 172.21.15.2:0/2390780775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999cf1570 msgr2=0x556999d72510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:27:58.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.202+0000 7f2fa6a00700 1 --2- 172.21.15.2:0/2390780775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999cf1570 0x556999d72510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.202+0000 7f2fa6a00700 1 -- 172.21.15.2:0/2390780775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556999d72ad0 con 0x556999ce8960 2024-06-13T11:27:58.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.203+0000 7f2fa6a00700 1 --2- 172.21.15.2:0/2390780775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999ce8960 0x556999cf4e90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009810 tx=0x7f2f94005c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8514ab240bc6df server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:27:58.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.203+0000 7f2f91600700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:27:58.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.203+0000 7f2f91600700 1 -- 172.21.15.2:0/2390780775 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94005450 con 0x556999ce8960 2024-06-13T11:27:58.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.203+0000 7f2fb89abb80 1 -- 172.21.15.2:0/2390780775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f9400bdc0 con 0x556999ce8960 2024-06-13T11:27:58.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.203+0000 7f2f91600700 1 -- 172.21.15.2:0/2390780775 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f2f940055f0 con 0x556999ce8960 2024-06-13T11:27:58.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.203+0000 7f2f91600700 1 -- 172.21.15.2:0/2390780775 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2f94049050 con 0x556999ce8960 2024-06-13T11:27:58.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.203+0000 7f2fb89abb80 10 client.25823 fetch_fsmap learned FSMap version 29 2024-06-13T11:27:58.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.203+0000 7f2fb89abb80 1 -- 172.21.15.2:0/2390780775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556999d73dc0 con 0x556999ce8960 2024-06-13T11:27:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.203+0000 7f2f91600700 1 -- 172.21.15.2:0/2390780775 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f9400bdc0 con 0x556999ce8960 2024-06-13T11:27:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.204+0000 7f2f91600700 1 -- 172.21.15.2:0/2390780775 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2f94044030 con 0x556999ce8960 2024-06-13T11:27:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.204+0000 7f2fb89abb80 10 client.25823 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:27:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.204+0000 7f2fb89abb80 10 client.25823 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:27:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.204+0000 7f2fb89abb80 20 client.25823 populate_metadata read hostname 'smithi002' 2024-06-13T11:27:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.204+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/2390780775 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x556999d74470 0x556999d76890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:27:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.204+0000 7f2fb89abb80 4 client.25823 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:27:58.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.204+0000 7f2fb89abb80 1 -- 172.21.15.2:0/2390780775 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556999c40580 con 0x556999d74470 2024-06-13T11:27:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.204+0000 7f2fa7400700 1 --2- 172.21.15.2:0/2390780775 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x556999d74470 0x556999d76890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:27:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.205+0000 7f2fa7400700 1 --2- 172.21.15.2:0/2390780775 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x556999d74470 0x556999d76890 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98326802c9ce0187 server_cookie=a3965f503c40321d in_seq=0 out_seq=0 2024-06-13T11:27:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.205+0000 7f2f91600700 10 client.25823 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:27:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.205+0000 7f2f91600700 1 -- 172.21.15.2:0/2390780775 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556999c40580 con 0x556999d74470 2024-06-13T11:27:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.205+0000 7f2f91600700 10 client.25823 handle_command_reply: tid=0 2024-06-13T11:27:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.205+0000 7f2fb89abb80 1 client.25823 shutdown 2024-06-13T11:27:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.205+0000 7f2fb89abb80 1 -- 172.21.15.2:0/2390780775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999ce8960 msgr2=0x556999cf4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:58.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.205+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/2390780775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999ce8960 0x556999cf4e90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009810 tx=0x7f2f94005c10 comp rx=0 tx=0).stop 2024-06-13T11:27:58.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.205+0000 7f2fb89abb80 1 -- 172.21.15.2:0/2390780775 shutdown_connections 2024-06-13T11:27:58.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.205+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/2390780775 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x556999d74470 0x556999d76890 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.205+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/2390780775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556999cf1570 0x556999d72510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.205+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/2390780775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556999c62e40 0x556999cf4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.205+0000 7f2fb89abb80 1 --2- 172.21.15.2:0/2390780775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556999ce8960 0x556999cf4e90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.205+0000 7f2f91600700 0 client.25823 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:27:58.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.205+0000 7f2fb89abb80 1 -- 172.21.15.2:0/2390780775 >> 172.21.15.2:0/2390780775 conn(0x556999c13170 msgr2=0x556999cf0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:58.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.205+0000 7f2fb89abb80 1 -- 172.21.15.2:0/2390780775 shutdown_connections 2024-06-13T11:27:58.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.205+0000 7f2fb89abb80 1 -- 172.21.15.2:0/2390780775 wait complete. 2024-06-13T11:27:58.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.206+0000 7f2fb89abb80 20 client.25823 trim_cache size 0 max 16384 2024-06-13T11:27:58.211 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:27:58.211 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-13T11:27:58.211 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-06-13T11:27:58.212 INFO:teuthology.orchestra.run.smithi002.stdout: "8acc392e-eada-45cd-8374-db880015303c": { 2024-06-13T11:27:58.212 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-06-13T11:27:58.212 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "8acc392e-eada-45cd-8374-db880015303c", 2024-06-13T11:27:58.212 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-06-13T11:27:58.212 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:27:58.212 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:27:58.212 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:27:58.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.206+0000 7f2faca00700 1 -- 172.21.15.2:0/602686987 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2f8c0a2e10 msgr2=0x7f2f8c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:58.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.206+0000 7f2faca00700 1 --2- 172.21.15.2:0/602686987 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2f8c0a2e10 0x7f2f8c0a52d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0015b80 tx=0x7f2fa0009920 comp rx=0 tx=0).stop 2024-06-13T11:27:58.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.206+0000 7f2faca00700 1 -- 172.21.15.2:0/602686987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fa81045c0 msgr2=0x7f2fa819ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:27:58.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.206+0000 7f2faca00700 1 --2- 172.21.15.2:0/602686987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fa81045c0 0x7f2fa819ad50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800ebf0 tx=0x7f2f9800ef00 comp rx=0 tx=0).stop 2024-06-13T11:27:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.206+0000 7f2faca00700 1 -- 172.21.15.2:0/602686987 shutdown_connections 2024-06-13T11:27:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.207+0000 7f2faca00700 1 --2- 172.21.15.2:0/602686987 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2f8c0a2e10 0x7f2f8c0a52d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.207+0000 7f2faca00700 1 --2- 172.21.15.2:0/602686987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fa810a650 0x7f2fa819f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.207+0000 7f2faca00700 1 --2- 172.21.15.2:0/602686987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fa81045c0 0x7f2fa819ad50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.207+0000 7f2faca00700 1 --2- 172.21.15.2:0/602686987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fa8104f80 0x7f2fa819b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:27:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.207+0000 7f2faca00700 1 -- 172.21.15.2:0/602686987 >> 172.21.15.2:0/602686987 conn(0x7f2fa81000b0 msgr2=0x7f2fa8101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:27:58.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.207+0000 7f2faca00700 1 -- 172.21.15.2:0/602686987 shutdown_connections 2024-06-13T11:27:58.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:27:58.207+0000 7f2faca00700 1 -- 172.21.15.2:0/602686987 wait complete. 2024-06-13T11:27:59.254 INFO:tasks.cephfs.filesystem:scrub status for tag:8acc392e-eada-45cd-8374-db880015303c - {'path': '/', 'tag': '8acc392e-eada-45cd-8374-db880015303c', 'options': 'recursive,force'} 2024-06-13T11:27:59.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:27:59 smithi002 ceph-mon[32210]: pgmap v129: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:27:59.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:27:59 smithi178 ceph-mon[36913]: pgmap v129: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:27:59.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:27:59 smithi077 ceph-mon[36410]: pgmap v129: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:28:01.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:01 smithi002 ceph-mon[32210]: pgmap v130: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:28:01.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:01 smithi178 ceph-mon[36913]: pgmap v130: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:28:01.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:01 smithi077 ceph-mon[36410]: pgmap v130: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:28:02.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:02 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:28:02.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:02 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:28:02.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:02 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:28:02.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:02 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:28:02.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:02 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:28:02.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:02 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:28:02.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:02 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:28:02.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:02 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:28:02.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:02 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:28:03.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:03 smithi002 ceph-mon[32210]: pgmap v131: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:28:03.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:03 smithi178 ceph-mon[36913]: pgmap v131: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:28:03.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:03 smithi077 ceph-mon[36410]: pgmap v131: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:28:05.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:05 smithi002 ceph-mon[32210]: pgmap v132: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:28:05.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:05 smithi178 ceph-mon[36913]: pgmap v132: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:28:05.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:05 smithi077 ceph-mon[36410]: pgmap v132: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:28:07.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:07 smithi178 ceph-mon[36913]: pgmap v133: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:28:07.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:07 smithi077 ceph-mon[36410]: pgmap v133: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:28:07.894 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:07 smithi002 ceph-mon[32210]: pgmap v133: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:28:08.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:08 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:28:08.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:08 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:28:08.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:08 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:28:09.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:09 smithi178 ceph-mon[36913]: pgmap v134: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:28:09.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:09 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:28:09.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:09 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:28:09.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:09 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:28:09.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:09 smithi077 ceph-mon[36410]: pgmap v134: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:28:09.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:09 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:28:09.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:09 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:28:09.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:09 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:28:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:09 smithi002 ceph-mon[32210]: pgmap v134: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:28:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:09 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:28:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:09 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:28:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:09 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:28:11.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:11 smithi178 ceph-mon[36913]: pgmap v135: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:28:11.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:11 smithi077 ceph-mon[36410]: pgmap v135: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:28:11.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:11 smithi002 ceph-mon[32210]: pgmap v135: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:28:13.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:13 smithi002 ceph-mon[32210]: pgmap v136: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:28:13.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:13 smithi178 ceph-mon[36913]: pgmap v136: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:28:13.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:13 smithi077 ceph-mon[36410]: pgmap v136: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:28:15.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:15 smithi178 ceph-mon[36913]: pgmap v137: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:28:15.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:15 smithi077 ceph-mon[36410]: pgmap v137: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:28:15.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:15 smithi002 ceph-mon[32210]: pgmap v137: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:28:17.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:17 smithi178 ceph-mon[36913]: pgmap v138: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:28:17.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:17 smithi077 ceph-mon[36410]: pgmap v138: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:28:17.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:17 smithi002 ceph-mon[32210]: pgmap v138: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:28:19.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:19 smithi178 ceph-mon[36913]: pgmap v139: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:28:19.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:19 smithi077 ceph-mon[36410]: pgmap v139: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:28:19.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:19 smithi002 ceph-mon[32210]: pgmap v139: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:28:21.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:21 smithi178 ceph-mon[36913]: pgmap v140: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:21.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:21 smithi077 ceph-mon[36410]: pgmap v140: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:21.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:21 smithi002 ceph-mon[32210]: pgmap v140: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:23.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:23 smithi077 ceph-mon[36410]: pgmap v141: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:23.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:23 smithi002 ceph-mon[32210]: pgmap v141: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:23.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:23 smithi178 ceph-mon[36913]: pgmap v141: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:25.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:25 smithi077 ceph-mon[36410]: pgmap v142: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:25.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:25 smithi002 ceph-mon[32210]: pgmap v142: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:25.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:25 smithi178 ceph-mon[36913]: pgmap v142: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:27.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:27 smithi077 ceph-mon[36410]: pgmap v143: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:27.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:27 smithi002 ceph-mon[32210]: pgmap v143: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:27.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:27 smithi178 ceph-mon[36913]: pgmap v143: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:29.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:28:29.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:29 smithi002 ceph-mon[32210]: pgmap v144: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:29.736 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:28:29.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:29 smithi077 ceph-mon[36410]: pgmap v144: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:29.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:29 smithi178 ceph-mon[36913]: pgmap v144: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:31.773 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:31 smithi002 ceph-mon[32210]: pgmap v145: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:31.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:31 smithi077 ceph-mon[36410]: pgmap v145: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:31.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:31 smithi178 ceph-mon[36913]: pgmap v145: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:32.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.112+0000 7f310f200700 1 -- 172.21.15.2:0/2589076918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31081076f0 msgr2=0x7f310810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:32.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.112+0000 7f310f200700 1 --2- 172.21.15.2:0/2589076918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31081076f0 0x7f310810f2c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3104009fc0 tx=0x7f310400b330 comp rx=0 tx=0).stop 2024-06-13T11:28:32.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.112+0000 7f310f200700 1 -- 172.21.15.2:0/2589076918 shutdown_connections 2024-06-13T11:28:32.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.112+0000 7f310f200700 1 --2- 172.21.15.2:0/2589076918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31081076f0 0x7f310810f2c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.112+0000 7f310f200700 1 --2- 172.21.15.2:0/2589076918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3108102610 0x7f31081029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.112+0000 7f310f200700 1 --2- 172.21.15.2:0/2589076918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3108102fc0 0x7f3108107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.112+0000 7f310f200700 1 -- 172.21.15.2:0/2589076918 >> 172.21.15.2:0/2589076918 conn(0x7f31080fdee0 msgr2=0x7f3108100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:32.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.112+0000 7f310f200700 1 -- 172.21.15.2:0/2589076918 shutdown_connections 2024-06-13T11:28:32.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.112+0000 7f310f200700 1 -- 172.21.15.2:0/2589076918 wait complete. 2024-06-13T11:28:32.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.113+0000 7f310f200700 1 Processor -- start 2024-06-13T11:28:32.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.113+0000 7f310f200700 1 -- start start 2024-06-13T11:28:32.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.114+0000 7f310f200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3108102610 0x7f310819ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.114+0000 7f310f200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3108102fc0 0x7f310819b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.114+0000 7f310f200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31081076f0 0x7f310819f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.114+0000 7f310f200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3108112730 con 0x7f3108102610 2024-06-13T11:28:32.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.114+0000 7f310f200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f31081125b0 con 0x7f3108102fc0 2024-06-13T11:28:32.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.114+0000 7f310f200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f31081128b0 con 0x7f31081076f0 2024-06-13T11:28:32.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.114+0000 7f310e800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31081076f0 0x7f310819f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.114+0000 7f310de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3108102610 0x7f310819ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.114+0000 7f310e800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31081076f0 0x7f310819f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:40616/0 (socket says 172.21.15.2:40616) 2024-06-13T11:28:32.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.114+0000 7f310e800700 1 -- 172.21.15.2:0/1173165289 learned_addr learned my addr 172.21.15.2:0/1173165289 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:32.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.114+0000 7f310d400700 1 --2- 172.21.15.2:0/1173165289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3108102fc0 0x7f310819b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.115+0000 7f310e800700 1 -- 172.21.15.2:0/1173165289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3108102fc0 msgr2=0x7f310819b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:32.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.115+0000 7f310e800700 1 --2- 172.21.15.2:0/1173165289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3108102fc0 0x7f310819b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.115+0000 7f310e800700 1 -- 172.21.15.2:0/1173165289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3108102610 msgr2=0x7f310819ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:32.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.115+0000 7f310e800700 1 --2- 172.21.15.2:0/1173165289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3108102610 0x7f310819ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.115+0000 7f310e800700 1 -- 172.21.15.2:0/1173165289 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310819fd30 con 0x7f31081076f0 2024-06-13T11:28:32.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.115+0000 7f310e800700 1 --2- 172.21.15.2:0/1173165289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31081076f0 0x7f310819f5f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f310400cfa0 tx=0x7f310400cfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:32.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.115+0000 7f3102a00700 1 -- 172.21.15.2:0/1173165289 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3104021070 con 0x7f31081076f0 2024-06-13T11:28:32.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.115+0000 7f310f200700 1 -- 172.21.15.2:0/1173165289 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f310819ffc0 con 0x7f31081076f0 2024-06-13T11:28:32.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.115+0000 7f3102a00700 1 -- 172.21.15.2:0/1173165289 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3104007ac0 con 0x7f31081076f0 2024-06-13T11:28:32.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.115+0000 7f3102a00700 1 -- 172.21.15.2:0/1173165289 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31040052a0 con 0x7f31081076f0 2024-06-13T11:28:32.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.116+0000 7f310f200700 1 -- 172.21.15.2:0/1173165289 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31081a78a0 con 0x7f31081076f0 2024-06-13T11:28:32.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.119+0000 7f3102a00700 1 -- 172.21.15.2:0/1173165289 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f3104024070 con 0x7f31081076f0 2024-06-13T11:28:32.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.120+0000 7f311b236b80 1 Processor -- start 2024-06-13T11:28:32.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.120+0000 7f311b236b80 1 -- start start 2024-06-13T11:28:32.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.120+0000 7f3102a00700 1 --2- 172.21.15.2:0/1173165289 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f30f00a2e10 0x7f30f00a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.121+0000 7f3102a00700 1 -- 172.21.15.2:0/1173165289 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f310400f020 con 0x7f31081076f0 2024-06-13T11:28:32.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.121+0000 7f311b236b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea3bee40 0x5567ea444420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.121+0000 7f311b236b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea444960 0x5567ea444de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.121+0000 7f311b236b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea44d570 0x5567ea44f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.121+0000 7f311b236b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5567ea351a10 con 0x5567ea444960 2024-06-13T11:28:32.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.121+0000 7f311b236b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5567ea394b00 con 0x5567ea3bee40 2024-06-13T11:28:32.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.121+0000 7f311b236b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5567ea34f8f0 con 0x5567ea44d570 2024-06-13T11:28:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.121+0000 7f310d400700 1 --2- 172.21.15.2:0/1173165289 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f30f00a2e10 0x7f30f00a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.121+0000 7f310de00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea3bee40 0x5567ea444420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.121+0000 7f310d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea444960 0x5567ea444de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.121+0000 7f310de00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea3bee40 0x5567ea444420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:55932/0 (socket says 172.21.15.2:55932) 2024-06-13T11:28:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.121+0000 7f310de00700 1 -- 172.21.15.2:0/171396932 learned_addr learned my addr 172.21.15.2:0/171396932 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.121+0000 7f310e800700 1 --2- 172.21.15.2:0/171396932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea44d570 0x5567ea44f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.122+0000 7f310de00700 1 -- 172.21.15.2:0/171396932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea44d570 msgr2=0x5567ea44f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:32.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.122+0000 7f310de00700 1 --2- 172.21.15.2:0/171396932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea44d570 0x5567ea44f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.122+0000 7f310de00700 1 -- 172.21.15.2:0/171396932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea444960 msgr2=0x5567ea444de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:32.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.122+0000 7f310de00700 1 --2- 172.21.15.2:0/171396932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea444960 0x5567ea444de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.122+0000 7f310de00700 1 -- 172.21.15.2:0/171396932 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567ea33cf90 con 0x5567ea3bee40 2024-06-13T11:28:32.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.122+0000 7f310d400700 1 --2- 172.21.15.2:0/1173165289 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f30f00a2e10 0x7f30f00a52d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f30f8009680 tx=0x7f30f8009b50 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:32.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.122+0000 7f310de00700 1 --2- 172.21.15.2:0/171396932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea3bee40 0x5567ea444420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009d60 tx=0x7f30fc011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=971c6452b58ddf8a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:32.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.122+0000 7f30f7400700 1 -- 172.21.15.2:0/171396932 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc01e070 con 0x5567ea3bee40 2024-06-13T11:28:32.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.123+0000 7f30f7400700 1 -- 172.21.15.2:0/171396932 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30fc019b10 con 0x5567ea3bee40 2024-06-13T11:28:32.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.123+0000 7f30f7400700 1 -- 172.21.15.2:0/171396932 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc00eb30 con 0x5567ea3bee40 2024-06-13T11:28:32.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.123+0000 7f311b236b80 1 -- 172.21.15.2:0/171396932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea3bee40 msgr2=0x5567ea444420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:32.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.123+0000 7f311b236b80 1 --2- 172.21.15.2:0/171396932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea3bee40 0x5567ea444420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009d60 tx=0x7f30fc011720 comp rx=0 tx=0).stop 2024-06-13T11:28:32.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.123+0000 7f311b236b80 1 -- 172.21.15.2:0/171396932 shutdown_connections 2024-06-13T11:28:32.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.123+0000 7f311b236b80 1 --2- 172.21.15.2:0/171396932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea44d570 0x5567ea44f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.123+0000 7f311b236b80 1 --2- 172.21.15.2:0/171396932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea3bee40 0x5567ea444420 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.123+0000 7f311b236b80 1 --2- 172.21.15.2:0/171396932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea444960 0x5567ea444de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.123+0000 7f311b236b80 1 -- 172.21.15.2:0/171396932 >> 172.21.15.2:0/171396932 conn(0x5567ea36f170 msgr2=0x5567ea43e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:32.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.124+0000 7f311b236b80 1 -- 172.21.15.2:0/171396932 shutdown_connections 2024-06-13T11:28:32.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.124+0000 7f311b236b80 1 -- 172.21.15.2:0/171396932 wait complete. 2024-06-13T11:28:32.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.124+0000 7f311b236b80 1 -- start start 2024-06-13T11:28:32.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.124+0000 7f311b236b80 1 Processor -- start 2024-06-13T11:28:32.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.125+0000 7f311b236b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea3bee40 0x5567ea44cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.125+0000 7f311b236b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea444960 0x5567ea44a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.125+0000 7f311b236b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea44d570 0x5567ea44a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.125+0000 7f311b236b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5567ea330f60 con 0x5567ea44d570 2024-06-13T11:28:32.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.125+0000 7f311b236b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5567ea390ac0 con 0x5567ea444960 2024-06-13T11:28:32.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.125+0000 7f311b236b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5567ea4501e0 con 0x5567ea3bee40 2024-06-13T11:28:32.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.125+0000 7f311b236b80 10 client.0 _ll_register_callbacks cb 0x5567ea32e720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:28:32.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.125+0000 7f310d400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea444960 0x5567ea44a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.125+0000 7f310e800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea44d570 0x5567ea44a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.125+0000 7f310d400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea444960 0x5567ea44a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:55938/0 (socket says 172.21.15.2:55938) 2024-06-13T11:28:32.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.125+0000 7f310d400700 1 -- 172.21.15.2:0/1011565693 learned_addr learned my addr 172.21.15.2:0/1011565693 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:32.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.125+0000 7f310de00700 1 --2- 172.21.15.2:0/1011565693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea3bee40 0x5567ea44cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.126+0000 7f310d400700 1 -- 172.21.15.2:0/1011565693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea3bee40 msgr2=0x5567ea44cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:32.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.126+0000 7f310d400700 1 --2- 172.21.15.2:0/1011565693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea3bee40 0x5567ea44cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.126+0000 7f310d400700 1 -- 172.21.15.2:0/1011565693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea44d570 msgr2=0x5567ea44a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:32.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.126+0000 7f310d400700 1 --2- 172.21.15.2:0/1011565693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea44d570 0x5567ea44a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.126+0000 7f310d400700 1 -- 172.21.15.2:0/1011565693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567ea2e38d0 con 0x5567ea444960 2024-06-13T11:28:32.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.126+0000 7f310d400700 1 --2- 172.21.15.2:0/1011565693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea444960 0x5567ea44a060 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f30f80042b0 tx=0x7f30f8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15f18a35718bac20 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:32.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.126+0000 7f30ebe00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:28:32.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.126+0000 7f30ebe00700 1 -- 172.21.15.2:0/1011565693 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f8011e40 con 0x5567ea444960 2024-06-13T11:28:32.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.127+0000 7f311b236b80 1 -- 172.21.15.2:0/1011565693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30fc019b10 con 0x5567ea444960 2024-06-13T11:28:32.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.127+0000 7f30ebe00700 1 -- 172.21.15.2:0/1011565693 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f30f8009040 con 0x5567ea444960 2024-06-13T11:28:32.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.127+0000 7f30ebe00700 1 -- 172.21.15.2:0/1011565693 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f30f8032050 con 0x5567ea444960 2024-06-13T11:28:32.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.127+0000 7f311b236b80 10 client.25835 fetch_fsmap learned FSMap version 29 2024-06-13T11:28:32.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.127+0000 7f311b236b80 1 -- 172.21.15.2:0/1011565693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5567ea45a9e0 con 0x5567ea444960 2024-06-13T11:28:32.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.127+0000 7f30ebe00700 1 -- 172.21.15.2:0/1011565693 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30fc019b10 con 0x5567ea444960 2024-06-13T11:28:32.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.128+0000 7f30ebe00700 1 -- 172.21.15.2:0/1011565693 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f30f8020070 con 0x5567ea444960 2024-06-13T11:28:32.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.128+0000 7f311b236b80 10 client.25835 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:28:32.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.128+0000 7f311b236b80 10 client.25835 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:28:32.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.128+0000 7f311b236b80 20 client.25835 populate_metadata read hostname 'smithi002' 2024-06-13T11:28:32.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.128+0000 7f311b236b80 1 --2- 172.21.15.2:0/1011565693 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5567ea45d0c0 0x5567ea45f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.128+0000 7f311b236b80 4 client.25835 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:28:32.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.128+0000 7f311b236b80 1 -- 172.21.15.2:0/1011565693 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567ea3a2000 con 0x5567ea45d0c0 2024-06-13T11:28:32.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.128+0000 7f310de00700 1 --2- 172.21.15.2:0/1011565693 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5567ea45d0c0 0x5567ea45f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.129+0000 7f310de00700 1 --2- 172.21.15.2:0/1011565693 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5567ea45d0c0 0x5567ea45f4e0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cbd5a22d3dca84f server_cookie=532ac394ec7323fa in_seq=0 out_seq=0 2024-06-13T11:28:32.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.129+0000 7f30ebe00700 10 client.25835 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:28:32.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.130+0000 7f30ebe00700 1 -- 172.21.15.2:0/1011565693 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5567ea3a2000 con 0x5567ea45d0c0 2024-06-13T11:28:32.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.130+0000 7f30ebe00700 10 client.25835 handle_command_reply: tid=0 2024-06-13T11:28:32.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.130+0000 7f311b236b80 1 client.25835 shutdown 2024-06-13T11:28:32.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.130+0000 7f311b236b80 1 -- 172.21.15.2:0/1011565693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea444960 msgr2=0x5567ea44a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:32.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.130+0000 7f311b236b80 1 --2- 172.21.15.2:0/1011565693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea444960 0x5567ea44a060 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f30f80042b0 tx=0x7f30f8009260 comp rx=0 tx=0).stop 2024-06-13T11:28:32.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.130+0000 7f311b236b80 1 -- 172.21.15.2:0/1011565693 shutdown_connections 2024-06-13T11:28:32.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.130+0000 7f311b236b80 1 --2- 172.21.15.2:0/1011565693 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5567ea45d0c0 0x5567ea45f4e0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.130+0000 7f311b236b80 1 --2- 172.21.15.2:0/1011565693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea44d570 0x5567ea44a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.130+0000 7f311b236b80 1 --2- 172.21.15.2:0/1011565693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea3bee40 0x5567ea44cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.130+0000 7f30ebe00700 0 client.25835 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:28:32.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.130+0000 7f311b236b80 1 --2- 172.21.15.2:0/1011565693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea444960 0x5567ea44a060 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.130+0000 7f311b236b80 1 -- 172.21.15.2:0/1011565693 >> 172.21.15.2:0/1011565693 conn(0x5567ea36f170 msgr2=0x5567ea43e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:32.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.130+0000 7f311b236b80 1 -- 172.21.15.2:0/1011565693 shutdown_connections 2024-06-13T11:28:32.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.130+0000 7f311b236b80 1 -- 172.21.15.2:0/1011565693 wait complete. 2024-06-13T11:28:32.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.131+0000 7f311b236b80 20 client.25835 trim_cache size 0 max 16384 2024-06-13T11:28:32.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.153+0000 7f311b236b80 1 Processor -- start 2024-06-13T11:28:32.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.153+0000 7f311b236b80 1 -- start start 2024-06-13T11:28:32.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.154+0000 7f311b236b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea3bee40 0x5567ea449020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.154+0000 7f311b236b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea444960 0x5567ea43e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.154+0000 7f311b236b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea44d570 0x5567ea44c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.154+0000 7f311b236b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31081b2d10 con 0x5567ea3bee40 2024-06-13T11:28:32.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.154+0000 7f311b236b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f31081b05a0 con 0x5567ea44d570 2024-06-13T11:28:32.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.154+0000 7f311b236b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f31081ae3f0 con 0x5567ea444960 2024-06-13T11:28:32.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.154+0000 7f310de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea3bee40 0x5567ea449020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.154+0000 7f310de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea3bee40 0x5567ea449020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50938/0 (socket says 172.21.15.2:50938) 2024-06-13T11:28:32.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.154+0000 7f310de00700 1 -- 172.21.15.2:0/3393580732 learned_addr learned my addr 172.21.15.2:0/3393580732 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:32.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.154+0000 7f310e800700 1 --2- 172.21.15.2:0/3393580732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea44d570 0x5567ea44c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.154+0000 7f310d400700 1 --2- 172.21.15.2:0/3393580732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea444960 0x5567ea43e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.155+0000 7f310de00700 1 -- 172.21.15.2:0/3393580732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea444960 msgr2=0x5567ea43e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.155+0000 7f310de00700 1 --2- 172.21.15.2:0/3393580732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea444960 0x5567ea43e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.155+0000 7f310de00700 1 -- 172.21.15.2:0/3393580732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea44d570 msgr2=0x5567ea44c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.155+0000 7f310de00700 1 --2- 172.21.15.2:0/3393580732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea44d570 0x5567ea44c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.155+0000 7f310de00700 1 -- 172.21.15.2:0/3393580732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567ea44afa0 con 0x5567ea3bee40 2024-06-13T11:28:32.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.155+0000 7f310e800700 1 --2- 172.21.15.2:0/3393580732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea44d570 0x5567ea44c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:28:32.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.155+0000 7f310de00700 1 --2- 172.21.15.2:0/3393580732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea3bee40 0x5567ea449020 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009350 tx=0x7f30fc00e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49dfa84ecdeedd8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:32.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.155+0000 7f30f6a00700 1 -- 172.21.15.2:0/3393580732 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc033070 con 0x5567ea3bee40 2024-06-13T11:28:32.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.155+0000 7f30f6a00700 1 -- 172.21.15.2:0/3393580732 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30fc02b070 con 0x5567ea3bee40 2024-06-13T11:28:32.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.155+0000 7f30f6a00700 1 -- 172.21.15.2:0/3393580732 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc01e040 con 0x5567ea3bee40 2024-06-13T11:28:32.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.156+0000 7f311b236b80 1 -- 172.21.15.2:0/3393580732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea3bee40 msgr2=0x5567ea449020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:32.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.156+0000 7f311b236b80 1 --2- 172.21.15.2:0/3393580732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea3bee40 0x5567ea449020 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009350 tx=0x7f30fc00e6b0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.156+0000 7f311b236b80 1 -- 172.21.15.2:0/3393580732 shutdown_connections 2024-06-13T11:28:32.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.156+0000 7f311b236b80 1 --2- 172.21.15.2:0/3393580732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea3bee40 0x5567ea449020 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.156+0000 7f311b236b80 1 --2- 172.21.15.2:0/3393580732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea44d570 0x5567ea44c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.156+0000 7f311b236b80 1 --2- 172.21.15.2:0/3393580732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea444960 0x5567ea43e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.156+0000 7f311b236b80 1 -- 172.21.15.2:0/3393580732 >> 172.21.15.2:0/3393580732 conn(0x5567ea36f170 msgr2=0x5567ea4582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:32.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.156+0000 7f311b236b80 1 -- 172.21.15.2:0/3393580732 shutdown_connections 2024-06-13T11:28:32.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.156+0000 7f311b236b80 1 -- 172.21.15.2:0/3393580732 wait complete. 2024-06-13T11:28:32.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.157+0000 7f311b236b80 1 -- start start 2024-06-13T11:28:32.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.157+0000 7f311b236b80 1 Processor -- start 2024-06-13T11:28:32.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.157+0000 7f311b236b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea3bee40 0x5567ea455bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.157+0000 7f311b236b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea444960 0x5567ea450f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.158+0000 7f311b236b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea44d570 0x5567ea4514c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.158+0000 7f311b236b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31081aea60 con 0x5567ea44d570 2024-06-13T11:28:32.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.158+0000 7f311b236b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f31081afed0 con 0x5567ea444960 2024-06-13T11:28:32.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.158+0000 7f311b236b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f31081af130 con 0x5567ea3bee40 2024-06-13T11:28:32.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.158+0000 7f311b236b80 10 client.0 _ll_register_callbacks cb 0x5567ea32e720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:28:32.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.158+0000 7f310d400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea444960 0x5567ea450f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.158+0000 7f310d400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea444960 0x5567ea450f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:55944/0 (socket says 172.21.15.2:55944) 2024-06-13T11:28:32.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.158+0000 7f310d400700 1 -- 172.21.15.2:0/2332292156 learned_addr learned my addr 172.21.15.2:0/2332292156 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:32.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.158+0000 7f310e800700 1 --2- 172.21.15.2:0/2332292156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea44d570 0x5567ea4514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.158+0000 7f310de00700 1 --2- 172.21.15.2:0/2332292156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea3bee40 0x5567ea455bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.158+0000 7f310d400700 1 -- 172.21.15.2:0/2332292156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea3bee40 msgr2=0x5567ea455bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:32.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.158+0000 7f310d400700 1 --2- 172.21.15.2:0/2332292156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea3bee40 0x5567ea455bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.158+0000 7f310d400700 1 -- 172.21.15.2:0/2332292156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea44d570 msgr2=0x5567ea4514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:32.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.158+0000 7f310d400700 1 --2- 172.21.15.2:0/2332292156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea44d570 0x5567ea4514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.158+0000 7f310d400700 1 -- 172.21.15.2:0/2332292156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567ea451cd0 con 0x5567ea444960 2024-06-13T11:28:32.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.159+0000 7f310d400700 1 --2- 172.21.15.2:0/2332292156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea444960 0x5567ea450f80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x5567ea43f460 tx=0x7f30f8009520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ac10fa146cfef58 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:32.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.159+0000 7f30ebe00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:28:32.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.159+0000 7f30ebe00700 1 -- 172.21.15.2:0/2332292156 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f803d060 con 0x5567ea444960 2024-06-13T11:28:32.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.159+0000 7f30ebe00700 1 -- 172.21.15.2:0/2332292156 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f30f80135d0 con 0x5567ea444960 2024-06-13T11:28:32.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.159+0000 7f311b236b80 1 -- 172.21.15.2:0/2332292156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30fc02b070 con 0x5567ea444960 2024-06-13T11:28:32.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.159+0000 7f30ebe00700 1 -- 172.21.15.2:0/2332292156 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f30f8044050 con 0x5567ea444960 2024-06-13T11:28:32.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.159+0000 7f311b236b80 10 client.25841 fetch_fsmap learned FSMap version 29 2024-06-13T11:28:32.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.159+0000 7f311b236b80 1 -- 172.21.15.2:0/2332292156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5567ea4d05a0 con 0x5567ea444960 2024-06-13T11:28:32.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.160+0000 7f30ebe00700 1 -- 172.21.15.2:0/2332292156 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30fc02b070 con 0x5567ea444960 2024-06-13T11:28:32.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.160+0000 7f30ebe00700 1 -- 172.21.15.2:0/2332292156 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f30f8035030 con 0x5567ea444960 2024-06-13T11:28:32.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.160+0000 7f311b236b80 10 client.25841 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:28:32.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.160+0000 7f311b236b80 10 client.25841 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:28:32.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.160+0000 7f311b236b80 20 client.25841 populate_metadata read hostname 'smithi002' 2024-06-13T11:28:32.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.160+0000 7f311b236b80 1 --2- 172.21.15.2:0/2332292156 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5567ea4d0c60 0x5567ea4d3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:32.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.160+0000 7f311b236b80 4 client.25841 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:28:32.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.160+0000 7f311b236b80 1 -- 172.21.15.2:0/2332292156 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5567ea39c580 con 0x5567ea4d0c60 2024-06-13T11:28:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.161+0000 7f310de00700 1 --2- 172.21.15.2:0/2332292156 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5567ea4d0c60 0x5567ea4d3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.161+0000 7f310de00700 1 --2- 172.21.15.2:0/2332292156 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5567ea4d0c60 0x5567ea4d3080 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=540257357b4ef2bc server_cookie=5be493088754110 in_seq=0 out_seq=0 2024-06-13T11:28:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.161+0000 7f30ebe00700 10 client.25841 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:28:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.161+0000 7f30ebe00700 1 -- 172.21.15.2:0/2332292156 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5567ea39c580 con 0x5567ea4d0c60 2024-06-13T11:28:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.161+0000 7f30ebe00700 10 client.25841 handle_command_reply: tid=0 2024-06-13T11:28:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.161+0000 7f311b236b80 1 client.25841 shutdown 2024-06-13T11:28:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.162+0000 7f311b236b80 1 -- 172.21.15.2:0/2332292156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea444960 msgr2=0x5567ea450f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.162+0000 7f311b236b80 1 --2- 172.21.15.2:0/2332292156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea444960 0x5567ea450f80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x5567ea43f460 tx=0x7f30f8009520 comp rx=0 tx=0).stop 2024-06-13T11:28:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.162+0000 7f311b236b80 1 -- 172.21.15.2:0/2332292156 shutdown_connections 2024-06-13T11:28:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.162+0000 7f311b236b80 1 --2- 172.21.15.2:0/2332292156 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5567ea4d0c60 0x5567ea4d3080 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.162+0000 7f311b236b80 1 --2- 172.21.15.2:0/2332292156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5567ea44d570 0x5567ea4514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.162+0000 7f311b236b80 1 --2- 172.21.15.2:0/2332292156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5567ea3bee40 0x5567ea455bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.162+0000 7f311b236b80 1 --2- 172.21.15.2:0/2332292156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5567ea444960 0x5567ea450f80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.162+0000 7f30ebe00700 0 client.25841 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:28:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.162+0000 7f311b236b80 1 -- 172.21.15.2:0/2332292156 >> 172.21.15.2:0/2332292156 conn(0x5567ea36f170 msgr2=0x5567ea43e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:32.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.162+0000 7f311b236b80 1 -- 172.21.15.2:0/2332292156 shutdown_connections 2024-06-13T11:28:32.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.162+0000 7f311b236b80 1 -- 172.21.15.2:0/2332292156 wait complete. 2024-06-13T11:28:32.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.162+0000 7f311b236b80 20 client.25841 trim_cache size 0 max 16384 2024-06-13T11:28:32.169 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:28:32.170 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-06-13T11:28:32.170 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-06-13T11:28:32.170 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:28:32.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.163+0000 7f310f200700 1 -- 172.21.15.2:0/1173165289 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f30f00a2e10 msgr2=0x7f30f00a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:32.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.163+0000 7f310f200700 1 --2- 172.21.15.2:0/1173165289 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f30f00a2e10 0x7f30f00a52d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f30f8009680 tx=0x7f30f8009b50 comp rx=0 tx=0).stop 2024-06-13T11:28:32.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.163+0000 7f310f200700 1 -- 172.21.15.2:0/1173165289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31081076f0 msgr2=0x7f310819f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:32.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.163+0000 7f310f200700 1 --2- 172.21.15.2:0/1173165289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31081076f0 0x7f310819f5f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f310400cfa0 tx=0x7f310400cfd0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.163+0000 7f310f200700 1 -- 172.21.15.2:0/1173165289 shutdown_connections 2024-06-13T11:28:32.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.163+0000 7f310f200700 1 --2- 172.21.15.2:0/1173165289 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f30f00a2e10 0x7f30f00a52d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.163+0000 7f310f200700 1 --2- 172.21.15.2:0/1173165289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3108102610 0x7f310819ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.163+0000 7f310f200700 1 --2- 172.21.15.2:0/1173165289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31081076f0 0x7f310819f5f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.163+0000 7f310f200700 1 --2- 172.21.15.2:0/1173165289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3108102fc0 0x7f310819b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:32.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.163+0000 7f310f200700 1 -- 172.21.15.2:0/1173165289 >> 172.21.15.2:0/1173165289 conn(0x7f31080fdee0 msgr2=0x7f310810dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:32.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.163+0000 7f310f200700 1 -- 172.21.15.2:0/1173165289 shutdown_connections 2024-06-13T11:28:32.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:32.163+0000 7f310f200700 1 -- 172.21.15.2:0/1173165289 wait complete. 2024-06-13T11:28:33.123 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-13T11:28:33.124 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:28:33.566 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:28:33.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:33 smithi002 ceph-mon[32210]: pgmap v146: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:33.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:33 smithi077 ceph-mon[36410]: pgmap v146: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:33.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:33 smithi178 ceph-mon[36913]: pgmap v146: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:35.691 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:35 smithi002 ceph-mon[32210]: pgmap v147: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:35.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:35 smithi077 ceph-mon[36410]: pgmap v147: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:35.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:35 smithi178 ceph-mon[36913]: pgmap v147: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:35.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.987+0000 7ff965000700 1 -- 172.21.15.2:0/1550697331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff960108500 msgr2=0x7ff9601088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:35.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.987+0000 7ff965000700 1 --2- 172.21.15.2:0/1550697331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff960108500 0x7ff9601088e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff950009990 tx=0x7ff950009ca0 comp rx=0 tx=0).stop 2024-06-13T11:28:35.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.987+0000 7ff965000700 1 -- 172.21.15.2:0/1550697331 shutdown_connections 2024-06-13T11:28:35.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.987+0000 7ff965000700 1 --2- 172.21.15.2:0/1550697331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff960108500 0x7ff9601088e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:35.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.987+0000 7ff965000700 1 --2- 172.21.15.2:0/1550697331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff96006ab30 0x7ff96010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:35.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.987+0000 7ff965000700 1 --2- 172.21.15.2:0/1550697331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff96006a170 0x7ff96006a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:35.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.987+0000 7ff965000700 1 -- 172.21.15.2:0/1550697331 >> 172.21.15.2:0/1550697331 conn(0x7ff960078340 msgr2=0x7ff960078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:35.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.987+0000 7ff965000700 1 -- 172.21.15.2:0/1550697331 shutdown_connections 2024-06-13T11:28:35.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.987+0000 7ff965000700 1 -- 172.21.15.2:0/1550697331 wait complete. 2024-06-13T11:28:35.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.989+0000 7ff965000700 1 Processor -- start 2024-06-13T11:28:35.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.989+0000 7ff965000700 1 -- start start 2024-06-13T11:28:35.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.989+0000 7ff965000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff96006a170 0x7ff96019aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:35.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.989+0000 7ff965000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff96006ab30 0x7ff96019b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:35.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.989+0000 7ff965000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960108500 0x7ff96019f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:35.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.989+0000 7ff965000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff9601127d0 con 0x7ff96006ab30 2024-06-13T11:28:35.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.989+0000 7ff965000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff960112650 con 0x7ff960108500 2024-06-13T11:28:35.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.989+0000 7ff965000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff960112950 con 0x7ff96006a170 2024-06-13T11:28:35.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.990+0000 7ff955400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff96006ab30 0x7ff96019b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:35.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.990+0000 7ff95e800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960108500 0x7ff96019f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:35.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.990+0000 7ff95de00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff96006a170 0x7ff96019aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:35.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.990+0000 7ff95e800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960108500 0x7ff96019f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:34382/0 (socket says 172.21.15.2:34382) 2024-06-13T11:28:35.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.990+0000 7ff95e800700 1 -- 172.21.15.2:0/1897519035 learned_addr learned my addr 172.21.15.2:0/1897519035 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:35.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.990+0000 7ff95e800700 1 -- 172.21.15.2:0/1897519035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff96006a170 msgr2=0x7ff96019aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:35.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.990+0000 7ff95e800700 1 --2- 172.21.15.2:0/1897519035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff96006a170 0x7ff96019aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:35.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.990+0000 7ff95e800700 1 -- 172.21.15.2:0/1897519035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff96006ab30 msgr2=0x7ff96019b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:35.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.990+0000 7ff95e800700 1 --2- 172.21.15.2:0/1897519035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff96006ab30 0x7ff96019b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:35.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.990+0000 7ff95e800700 1 -- 172.21.15.2:0/1897519035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96019fee0 con 0x7ff960108500 2024-06-13T11:28:35.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.990+0000 7ff95de00700 1 --2- 172.21.15.2:0/1897519035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff96006a170 0x7ff96019aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:28:35.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.991+0000 7ff95e800700 1 --2- 172.21.15.2:0/1897519035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960108500 0x7ff96019f7a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff95800ef30 tx=0x7ff95800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:35.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.991+0000 7ff957400700 1 -- 172.21.15.2:0/1897519035 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9580092e0 con 0x7ff960108500 2024-06-13T11:28:35.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.991+0000 7ff957400700 1 -- 172.21.15.2:0/1897519035 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff958004bb0 con 0x7ff960108500 2024-06-13T11:28:35.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.991+0000 7ff965000700 1 -- 172.21.15.2:0/1897519035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9601a0170 con 0x7ff960108500 2024-06-13T11:28:35.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.991+0000 7ff957400700 1 -- 172.21.15.2:0/1897519035 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff958004280 con 0x7ff960108500 2024-06-13T11:28:35.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.991+0000 7ff965000700 1 -- 172.21.15.2:0/1897519035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9601a7a50 con 0x7ff960108500 2024-06-13T11:28:35.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.992+0000 7ff965000700 1 -- 172.21.15.2:0/1897519035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff960069180 con 0x7ff960108500 2024-06-13T11:28:35.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.994+0000 7ff957400700 1 -- 172.21.15.2:0/1897519035 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7ff95801b030 con 0x7ff960108500 2024-06-13T11:28:35.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.996+0000 7ff957400700 1 --2- 172.21.15.2:0/1897519035 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff9440a2e10 0x7ff9440a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:35.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.996+0000 7ff957400700 1 -- 172.21.15.2:0/1897519035 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7ff9580cf5b0 con 0x7ff960108500 2024-06-13T11:28:35.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.996+0000 7ff95de00700 1 --2- 172.21.15.2:0/1897519035 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff9440a2e10 0x7ff9440a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:35.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.997+0000 7ff95de00700 1 --2- 172.21.15.2:0/1897519035 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff9440a2e10 0x7ff9440a52d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff95000b2e0 tx=0x7ff950005fd0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:35.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:35.998+0000 7ff957400700 1 -- 172.21.15.2:0/1897519035 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff958022020 con 0x7ff960108500 2024-06-13T11:28:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:36.279+0000 7ff965000700 1 -- 172.21.15.2:0/1897519035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9601a7c20 con 0x7ff960108500 2024-06-13T11:28:36.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:36.280+0000 7ff957400700 1 -- 172.21.15.2:0/1897519035 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11856 (secure 0 0 0) 0x7ff958010040 con 0x7ff960108500 2024-06-13T11:28:36.280 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:28:36.280 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:25:36.301244+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24509,24511,24493]},"id":1}]} 2024-06-13T11:28:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:36.283+0000 7ff965000700 1 -- 172.21.15.2:0/1897519035 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff9440a2e10 msgr2=0x7ff9440a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:36.283+0000 7ff965000700 1 --2- 172.21.15.2:0/1897519035 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff9440a2e10 0x7ff9440a52d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff95000b2e0 tx=0x7ff950005fd0 comp rx=0 tx=0).stop 2024-06-13T11:28:36.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:36.283+0000 7ff965000700 1 -- 172.21.15.2:0/1897519035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960108500 msgr2=0x7ff96019f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:36.283+0000 7ff965000700 1 --2- 172.21.15.2:0/1897519035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960108500 0x7ff96019f7a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff95800ef30 tx=0x7ff95800c3a0 comp rx=0 tx=0).stop 2024-06-13T11:28:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:36.284+0000 7ff965000700 1 -- 172.21.15.2:0/1897519035 shutdown_connections 2024-06-13T11:28:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:36.284+0000 7ff965000700 1 --2- 172.21.15.2:0/1897519035 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff9440a2e10 0x7ff9440a52d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:36.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:36.284+0000 7ff965000700 1 --2- 172.21.15.2:0/1897519035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960108500 0x7ff96019f7a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:36.284+0000 7ff965000700 1 --2- 172.21.15.2:0/1897519035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff96006a170 0x7ff96019aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:36.284+0000 7ff965000700 1 --2- 172.21.15.2:0/1897519035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff96006ab30 0x7ff96019b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:36.284+0000 7ff965000700 1 -- 172.21.15.2:0/1897519035 >> 172.21.15.2:0/1897519035 conn(0x7ff960078340 msgr2=0x7ff96010d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:36.284+0000 7ff965000700 1 -- 172.21.15.2:0/1897519035 shutdown_connections 2024-06-13T11:28:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:36.284+0000 7ff965000700 1 -- 172.21.15.2:0/1897519035 wait complete. 2024-06-13T11:28:36.285 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 29 2024-06-13T11:28:36.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:36 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1897519035' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:28:36.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:36 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1897519035' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:28:36.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:36 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1897519035' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:28:37.150 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-13T11:28:37.629 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:28:37.780 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:37 smithi002 ceph-mon[32210]: pgmap v148: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:37.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:37 smithi077 ceph-mon[36410]: pgmap v148: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:37.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:37 smithi178 ceph-mon[36913]: pgmap v148: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:39.720 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:39 smithi002 ceph-mon[32210]: pgmap v149: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:39.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:39 smithi077 ceph-mon[36410]: pgmap v149: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:39.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:39 smithi178 ceph-mon[36913]: pgmap v149: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.018+0000 7fdd67e00700 1 -- 172.21.15.2:0/2187661701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd68106140 msgr2=0x7fdd68106520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.018+0000 7fdd67e00700 1 --2- 172.21.15.2:0/2187661701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd68106140 0x7fdd68106520 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdd58009990 tx=0x7fdd58009ca0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.018+0000 7fdd67e00700 1 -- 172.21.15.2:0/2187661701 shutdown_connections 2024-06-13T11:28:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.018+0000 7fdd67e00700 1 --2- 172.21.15.2:0/2187661701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd681012e0 0x7fdd68101760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.018+0000 7fdd67e00700 1 --2- 172.21.15.2:0/2187661701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd68106140 0x7fdd68106520 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.018+0000 7fdd67e00700 1 --2- 172.21.15.2:0/2187661701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd68106af0 0x7fdd68100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.018+0000 7fdd67e00700 1 -- 172.21.15.2:0/2187661701 >> 172.21.15.2:0/2187661701 conn(0x7fdd68076640 msgr2=0x7fdd68076a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:40.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.019+0000 7fdd67e00700 1 -- 172.21.15.2:0/2187661701 shutdown_connections 2024-06-13T11:28:40.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.019+0000 7fdd67e00700 1 -- 172.21.15.2:0/2187661701 wait complete. 2024-06-13T11:28:40.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.020+0000 7fdd67e00700 1 Processor -- start 2024-06-13T11:28:40.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.020+0000 7fdd67e00700 1 -- start start 2024-06-13T11:28:40.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.020+0000 7fdd67e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd681012e0 0x7fdd6819f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.020+0000 7fdd67e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd68106140 0x7fdd6819f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.020+0000 7fdd67e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd68106af0 0x7fdd681a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.020+0000 7fdd67e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdd68118e20 con 0x7fdd68106af0 2024-06-13T11:28:40.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.020+0000 7fdd67e00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd68118ca0 con 0x7fdd68106140 2024-06-13T11:28:40.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.020+0000 7fdd67e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdd68118fa0 con 0x7fdd681012e0 2024-06-13T11:28:40.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.021+0000 7fdd67400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd68106af0 0x7fdd681a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.021+0000 7fdd66a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd681012e0 0x7fdd6819f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.021+0000 7fdd5e000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd68106140 0x7fdd6819f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.021+0000 7fdd67400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd68106af0 0x7fdd681a3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47152/0 (socket says 172.21.15.2:47152) 2024-06-13T11:28:40.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.021+0000 7fdd67400700 1 -- 172.21.15.2:0/319120771 learned_addr learned my addr 172.21.15.2:0/319120771 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:40.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.021+0000 7fdd5e000700 1 -- 172.21.15.2:0/319120771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd681012e0 msgr2=0x7fdd6819f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:40.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.021+0000 7fdd5e000700 1 --2- 172.21.15.2:0/319120771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd681012e0 0x7fdd6819f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.021+0000 7fdd5e000700 1 -- 172.21.15.2:0/319120771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd68106af0 msgr2=0x7fdd681a3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:40.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.021+0000 7fdd5e000700 1 --2- 172.21.15.2:0/319120771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd68106af0 0x7fdd681a3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.021+0000 7fdd5e000700 1 -- 172.21.15.2:0/319120771 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd681a4360 con 0x7fdd68106140 2024-06-13T11:28:40.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.022+0000 7fdd5e000700 1 --2- 172.21.15.2:0/319120771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd68106140 0x7fdd6819f890 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000e9f0 tx=0x7fdd5000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:40.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.022+0000 7fdd5fe00700 1 -- 172.21.15.2:0/319120771 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000c9c0 con 0x7fdd68106140 2024-06-13T11:28:40.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.022+0000 7fdd67e00700 1 -- 172.21.15.2:0/319120771 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd681a4650 con 0x7fdd68106140 2024-06-13T11:28:40.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.022+0000 7fdd5fe00700 1 -- 172.21.15.2:0/319120771 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd5000cb60 con 0x7fdd68106140 2024-06-13T11:28:40.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.022+0000 7fdd5fe00700 1 -- 172.21.15.2:0/319120771 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd50018680 con 0x7fdd68106140 2024-06-13T11:28:40.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.022+0000 7fdd67e00700 1 -- 172.21.15.2:0/319120771 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd681abed0 con 0x7fdd68106140 2024-06-13T11:28:40.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.026+0000 7fdd5fe00700 1 -- 172.21.15.2:0/319120771 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fdd50010430 con 0x7fdd68106140 2024-06-13T11:28:40.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.027+0000 7fdd5fe00700 1 --2- 172.21.15.2:0/319120771 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdd4c0a2d90 0x7fdd4c0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.027+0000 7fdd782c6b80 1 Processor -- start 2024-06-13T11:28:40.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.027+0000 7fdd5fe00700 1 -- 172.21.15.2:0/319120771 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fdd500cf8b0 con 0x7fdd68106140 2024-06-13T11:28:40.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.027+0000 7fdd782c6b80 1 -- start start 2024-06-13T11:28:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.027+0000 7fdd66a00700 1 --2- 172.21.15.2:0/319120771 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdd4c0a2d90 0x7fdd4c0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.028+0000 7fdd782c6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e21d60 0x558dd3e22140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.028+0000 7fdd782c6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e22680 0x558dd3e2cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.028+0000 7fdd782c6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e2d530 0x558dd3e2f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.028+0000 7fdd782c6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558dd3d31a10 con 0x558dd3e21d60 2024-06-13T11:28:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.028+0000 7fdd782c6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558dd3d74b00 con 0x558dd3e22680 2024-06-13T11:28:40.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.028+0000 7fdd782c6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x558dd3d2f8f0 con 0x558dd3e2d530 2024-06-13T11:28:40.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.028+0000 7fdd66a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e21d60 0x558dd3e22140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.028+0000 7fdd66a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e21d60 0x558dd3e22140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47164/0 (socket says 172.21.15.2:47164) 2024-06-13T11:28:40.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.028+0000 7fdd66a00700 1 -- 172.21.15.2:0/25773254 learned_addr learned my addr 172.21.15.2:0/25773254 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:40.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.028+0000 7fdd5e000700 1 --2- 172.21.15.2:0/25773254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e22680 0x558dd3e2cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.028+0000 7fdd67400700 1 --2- 172.21.15.2:0/25773254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e2d530 0x558dd3e2f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.028+0000 7fdd66a00700 1 --2- 172.21.15.2:0/319120771 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdd4c0a2d90 0x7fdd4c0a5250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800b2e0 tx=0x7fdd5800b660 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:40.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.029+0000 7fdd5e000700 1 -- 172.21.15.2:0/25773254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e2d530 msgr2=0x558dd3e2f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:40.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.029+0000 7fdd5e000700 1 --2- 172.21.15.2:0/25773254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e2d530 0x558dd3e2f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.029+0000 7fdd5e000700 1 -- 172.21.15.2:0/25773254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e21d60 msgr2=0x558dd3e22140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:40.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.029+0000 7fdd5e000700 1 --2- 172.21.15.2:0/25773254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e21d60 0x558dd3e22140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.029+0000 7fdd5e000700 1 -- 172.21.15.2:0/25773254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dd3d1cf90 con 0x558dd3e22680 2024-06-13T11:28:40.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.029+0000 7fdd66a00700 1 --2- 172.21.15.2:0/25773254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e21d60 0x558dd3e22140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:28:40.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.029+0000 7fdd5e000700 1 --2- 172.21.15.2:0/25773254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e22680 0x558dd3e2cff0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdd500ccc30 tx=0x7fdd50097dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d94e87c500307d56 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:40.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.029+0000 7fdd57e00700 1 -- 172.21.15.2:0/25773254 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5009ba00 con 0x558dd3e22680 2024-06-13T11:28:40.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.029+0000 7fdd57e00700 1 -- 172.21.15.2:0/25773254 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd5009fdb0 con 0x558dd3e22680 2024-06-13T11:28:40.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.029+0000 7fdd57e00700 1 -- 172.21.15.2:0/25773254 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd50010720 con 0x558dd3e22680 2024-06-13T11:28:40.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.030+0000 7fdd782c6b80 1 -- 172.21.15.2:0/25773254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e22680 msgr2=0x558dd3e2cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:40.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.030+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/25773254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e22680 0x558dd3e2cff0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdd500ccc30 tx=0x7fdd50097dd0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.030+0000 7fdd782c6b80 1 -- 172.21.15.2:0/25773254 shutdown_connections 2024-06-13T11:28:40.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.030+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/25773254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e21d60 0x558dd3e22140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.030+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/25773254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e2d530 0x558dd3e2f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.030+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/25773254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e22680 0x558dd3e2cff0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.030+0000 7fdd782c6b80 1 -- 172.21.15.2:0/25773254 >> 172.21.15.2:0/25773254 conn(0x558dd3d4f170 msgr2=0x558dd3e1e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:40.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.030+0000 7fdd782c6b80 1 -- 172.21.15.2:0/25773254 shutdown_connections 2024-06-13T11:28:40.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.030+0000 7fdd782c6b80 1 -- 172.21.15.2:0/25773254 wait complete. 2024-06-13T11:28:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.031+0000 7fdd782c6b80 1 -- start start 2024-06-13T11:28:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.031+0000 7fdd782c6b80 1 Processor -- start 2024-06-13T11:28:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.032+0000 7fdd782c6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e21d60 0x558dd3e2cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.032+0000 7fdd782c6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e22680 0x558dd3e2a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.032+0000 7fdd782c6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e2d530 0x558dd3e2a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.032+0000 7fdd782c6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558dd3d10f60 con 0x558dd3e22680 2024-06-13T11:28:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.032+0000 7fdd782c6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558dd3d70ac0 con 0x558dd3e21d60 2024-06-13T11:28:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.032+0000 7fdd782c6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x558dd3e2ff00 con 0x558dd3e2d530 2024-06-13T11:28:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.032+0000 7fdd782c6b80 10 client.0 _ll_register_callbacks cb 0x558dd3d0a380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:28:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.032+0000 7fdd66a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e21d60 0x558dd3e2cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.032+0000 7fdd5e000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e22680 0x558dd3e2a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.032+0000 7fdd66a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e21d60 0x558dd3e2cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:34408/0 (socket says 172.21.15.2:34408) 2024-06-13T11:28:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.032+0000 7fdd66a00700 1 -- 172.21.15.2:0/3865330781 learned_addr learned my addr 172.21.15.2:0/3865330781 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.032+0000 7fdd67400700 1 --2- 172.21.15.2:0/3865330781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e2d530 0x558dd3e2a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.033+0000 7fdd66a00700 1 -- 172.21.15.2:0/3865330781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e2d530 msgr2=0x558dd3e2a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.033+0000 7fdd66a00700 1 --2- 172.21.15.2:0/3865330781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e2d530 0x558dd3e2a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.033+0000 7fdd66a00700 1 -- 172.21.15.2:0/3865330781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e22680 msgr2=0x558dd3e2a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.033+0000 7fdd66a00700 1 --2- 172.21.15.2:0/3865330781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e22680 0x558dd3e2a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.033+0000 7fdd66a00700 1 -- 172.21.15.2:0/3865330781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dd3cc38d0 con 0x558dd3e21d60 2024-06-13T11:28:40.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.033+0000 7fdd5e000700 1 --2- 172.21.15.2:0/3865330781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e22680 0x558dd3e2a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:28:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.033+0000 7fdd66a00700 1 --2- 172.21.15.2:0/3865330781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e21d60 0x558dd3e2cd60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdd58006010 tx=0x7fdd58009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac6d2dfd361a8030 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.033+0000 7fdd54c00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:28:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.033+0000 7fdd54c00700 1 -- 172.21.15.2:0/3865330781 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58036060 con 0x558dd3e21d60 2024-06-13T11:28:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.034+0000 7fdd782c6b80 1 -- 172.21.15.2:0/3865330781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd5009fdb0 con 0x558dd3e21d60 2024-06-13T11:28:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.034+0000 7fdd54c00700 1 -- 172.21.15.2:0/3865330781 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fdd58021070 con 0x558dd3e21d60 2024-06-13T11:28:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.034+0000 7fdd54c00700 1 -- 172.21.15.2:0/3865330781 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdd5803d050 con 0x558dd3e21d60 2024-06-13T11:28:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.034+0000 7fdd782c6b80 10 client.25859 fetch_fsmap learned FSMap version 29 2024-06-13T11:28:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.034+0000 7fdd782c6b80 1 -- 172.21.15.2:0/3865330781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558dd3e3a710 con 0x558dd3e21d60 2024-06-13T11:28:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.034+0000 7fdd54c00700 1 -- 172.21.15.2:0/3865330781 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd5009fdb0 con 0x558dd3e21d60 2024-06-13T11:28:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.034+0000 7fdd54c00700 1 -- 172.21.15.2:0/3865330781 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fdd58031b20 con 0x558dd3e21d60 2024-06-13T11:28:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.035+0000 7fdd782c6b80 10 client.25859 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:28:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.035+0000 7fdd782c6b80 10 client.25859 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:28:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.035+0000 7fdd782c6b80 20 client.25859 populate_metadata read hostname 'smithi002' 2024-06-13T11:28:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.035+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/3865330781 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x558dd3e3cca0 0x558dd3e3f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.035+0000 7fdd782c6b80 4 client.25859 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:28:40.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.035+0000 7fdd782c6b80 1 -- 172.21.15.2:0/3865330781 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558dd3d82000 con 0x558dd3e3cca0 2024-06-13T11:28:40.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.035+0000 7fdd5e000700 1 --2- 172.21.15.2:0/3865330781 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x558dd3e3cca0 0x558dd3e3f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.036+0000 7fdd5e000700 1 --2- 172.21.15.2:0/3865330781 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x558dd3e3cca0 0x558dd3e3f090 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5b4cea9d404bce47 server_cookie=f31d919be812b69b in_seq=0 out_seq=0 2024-06-13T11:28:40.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.036+0000 7fdd54c00700 10 client.25859 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:28:40.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.036+0000 7fdd54c00700 1 -- 172.21.15.2:0/3865330781 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558dd3d82000 con 0x558dd3e3cca0 2024-06-13T11:28:40.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.037+0000 7fdd54c00700 10 client.25859 handle_command_reply: tid=0 2024-06-13T11:28:40.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.037+0000 7fdd782c6b80 1 client.25859 shutdown 2024-06-13T11:28:40.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.037+0000 7fdd782c6b80 1 -- 172.21.15.2:0/3865330781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e21d60 msgr2=0x558dd3e2cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:40.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.037+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/3865330781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e21d60 0x558dd3e2cd60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdd58006010 tx=0x7fdd58009ca0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.037+0000 7fdd782c6b80 1 -- 172.21.15.2:0/3865330781 shutdown_connections 2024-06-13T11:28:40.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.037+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/3865330781 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x558dd3e3cca0 0x558dd3e3f090 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.037+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/3865330781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e2d530 0x558dd3e2a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.037+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/3865330781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e21d60 0x558dd3e2cd60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.037+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/3865330781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e22680 0x558dd3e2a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.037+0000 7fdd54c00700 0 client.25859 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:28:40.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.037+0000 7fdd782c6b80 1 -- 172.21.15.2:0/3865330781 >> 172.21.15.2:0/3865330781 conn(0x558dd3d4f170 msgr2=0x558dd3e1de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:40.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.037+0000 7fdd782c6b80 1 -- 172.21.15.2:0/3865330781 shutdown_connections 2024-06-13T11:28:40.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.037+0000 7fdd782c6b80 1 -- 172.21.15.2:0/3865330781 wait complete. 2024-06-13T11:28:40.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.037+0000 7fdd782c6b80 20 client.25859 trim_cache size 0 max 16384 2024-06-13T11:28:40.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.054+0000 7fdd782c6b80 1 Processor -- start 2024-06-13T11:28:40.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.055+0000 7fdd782c6b80 1 -- start start 2024-06-13T11:28:40.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.055+0000 7fdd782c6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e21d60 0x558dd3e258d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.055+0000 7fdd782c6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e22680 0x558dd3e291e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.055+0000 7fdd782c6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e2d530 0x558dd3e24510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.055+0000 7fdd782c6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdd681b71a0 con 0x558dd3e22680 2024-06-13T11:28:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.055+0000 7fdd782c6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd681b4a30 con 0x558dd3e2d530 2024-06-13T11:28:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.055+0000 7fdd782c6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdd681b2880 con 0x558dd3e21d60 2024-06-13T11:28:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.055+0000 7fdd5e000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e22680 0x558dd3e291e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.055+0000 7fdd5e000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e22680 0x558dd3e291e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47184/0 (socket says 172.21.15.2:47184) 2024-06-13T11:28:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.055+0000 7fdd5e000700 1 -- 172.21.15.2:0/2363564651 learned_addr learned my addr 172.21.15.2:0/2363564651 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.055+0000 7fdd66a00700 1 --2- 172.21.15.2:0/2363564651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e21d60 0x558dd3e258d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.055+0000 7fdd67400700 1 --2- 172.21.15.2:0/2363564651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e2d530 0x558dd3e24510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.056+0000 7fdd66a00700 1 -- 172.21.15.2:0/2363564651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e2d530 msgr2=0x558dd3e24510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:40.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.056+0000 7fdd66a00700 1 --2- 172.21.15.2:0/2363564651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e2d530 0x558dd3e24510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.056+0000 7fdd66a00700 1 -- 172.21.15.2:0/2363564651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e22680 msgr2=0x558dd3e291e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:40.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.056+0000 7fdd66a00700 1 --2- 172.21.15.2:0/2363564651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e22680 0x558dd3e291e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.056+0000 7fdd66a00700 1 -- 172.21.15.2:0/2363564651 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dd3e285d0 con 0x558dd3e21d60 2024-06-13T11:28:40.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.056+0000 7fdd66a00700 1 --2- 172.21.15.2:0/2363564651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e21d60 0x558dd3e258d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdd58031ef0 tx=0x7fdd5800b3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43fe8adee8a50a9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:40.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.056+0000 7fdd57400700 1 -- 172.21.15.2:0/2363564651 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58036030 con 0x558dd3e21d60 2024-06-13T11:28:40.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.057+0000 7fdd57400700 1 -- 172.21.15.2:0/2363564651 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd580058e0 con 0x558dd3e21d60 2024-06-13T11:28:40.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.057+0000 7fdd57400700 1 -- 172.21.15.2:0/2363564651 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd580316e0 con 0x558dd3e21d60 2024-06-13T11:28:40.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.057+0000 7fdd782c6b80 1 -- 172.21.15.2:0/2363564651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e21d60 msgr2=0x558dd3e258d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:40.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.057+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/2363564651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e21d60 0x558dd3e258d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdd58031ef0 tx=0x7fdd5800b3f0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.057+0000 7fdd782c6b80 1 -- 172.21.15.2:0/2363564651 shutdown_connections 2024-06-13T11:28:40.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.057+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/2363564651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e2d530 0x558dd3e24510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.057+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/2363564651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e21d60 0x558dd3e258d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.057+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/2363564651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e22680 0x558dd3e291e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.057+0000 7fdd782c6b80 1 -- 172.21.15.2:0/2363564651 >> 172.21.15.2:0/2363564651 conn(0x558dd3d4f170 msgr2=0x558dd3e23e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:40.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.057+0000 7fdd782c6b80 1 -- 172.21.15.2:0/2363564651 shutdown_connections 2024-06-13T11:28:40.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.057+0000 7fdd782c6b80 1 -- 172.21.15.2:0/2363564651 wait complete. 2024-06-13T11:28:40.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.058+0000 7fdd782c6b80 1 -- start start 2024-06-13T11:28:40.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.058+0000 7fdd782c6b80 1 Processor -- start 2024-06-13T11:28:40.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.059+0000 7fdd782c6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e21d60 0x558dd3e359b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.059+0000 7fdd782c6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e22680 0x558dd3e30d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.059+0000 7fdd782c6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e2d530 0x558dd3e31340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.059+0000 7fdd782c6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdd681b2ef0 con 0x558dd3e21d60 2024-06-13T11:28:40.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.059+0000 7fdd782c6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd681b4360 con 0x558dd3e22680 2024-06-13T11:28:40.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.059+0000 7fdd782c6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdd681b35c0 con 0x558dd3e2d530 2024-06-13T11:28:40.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.059+0000 7fdd782c6b80 10 client.0 _ll_register_callbacks cb 0x558dd3d0a380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:28:40.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.059+0000 7fdd66a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e21d60 0x558dd3e359b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.059+0000 7fdd67400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e2d530 0x558dd3e31340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.059+0000 7fdd66a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e21d60 0x558dd3e359b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47188/0 (socket says 172.21.15.2:47188) 2024-06-13T11:28:40.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.059+0000 7fdd66a00700 1 -- 172.21.15.2:0/2296028858 learned_addr learned my addr 172.21.15.2:0/2296028858 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:40.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.059+0000 7fdd5e000700 1 --2- 172.21.15.2:0/2296028858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e22680 0x558dd3e30d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.060+0000 7fdd66a00700 1 -- 172.21.15.2:0/2296028858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e2d530 msgr2=0x558dd3e31340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:40.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.060+0000 7fdd66a00700 1 --2- 172.21.15.2:0/2296028858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e2d530 0x558dd3e31340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.060+0000 7fdd66a00700 1 -- 172.21.15.2:0/2296028858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e22680 msgr2=0x558dd3e30d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:40.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.060+0000 7fdd66a00700 1 --2- 172.21.15.2:0/2296028858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e22680 0x558dd3e30d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.060+0000 7fdd66a00700 1 -- 172.21.15.2:0/2296028858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dd3ea6910 con 0x558dd3e21d60 2024-06-13T11:28:40.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.060+0000 7fdd67400700 1 --2- 172.21.15.2:0/2296028858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e2d530 0x558dd3e31340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:28:40.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.060+0000 7fdd66a00700 1 --2- 172.21.15.2:0/2296028858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e21d60 0x558dd3e359b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdd580098e0 tx=0x7fdd58004de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb142912e4db6594 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:40.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.060+0000 7fdd54c00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:28:40.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.060+0000 7fdd54c00700 1 -- 172.21.15.2:0/2296028858 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58003c20 con 0x558dd3e21d60 2024-06-13T11:28:40.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.060+0000 7fdd54c00700 1 -- 172.21.15.2:0/2296028858 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fdd58003dc0 con 0x558dd3e21d60 2024-06-13T11:28:40.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.060+0000 7fdd782c6b80 1 -- 172.21.15.2:0/2296028858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd580058e0 con 0x558dd3e21d60 2024-06-13T11:28:40.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.061+0000 7fdd54c00700 1 -- 172.21.15.2:0/2296028858 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdd58054050 con 0x558dd3e21d60 2024-06-13T11:28:40.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.061+0000 7fdd782c6b80 10 client.15753 fetch_fsmap learned FSMap version 29 2024-06-13T11:28:40.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.061+0000 7fdd782c6b80 1 -- 172.21.15.2:0/2296028858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558dd3ea7a50 con 0x558dd3e21d60 2024-06-13T11:28:40.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.061+0000 7fdd54c00700 1 -- 172.21.15.2:0/2296028858 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd580058e0 con 0x558dd3e21d60 2024-06-13T11:28:40.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.061+0000 7fdd54c00700 1 -- 172.21.15.2:0/2296028858 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fdd58031880 con 0x558dd3e21d60 2024-06-13T11:28:40.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.061+0000 7fdd782c6b80 10 client.15753 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:28:40.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.061+0000 7fdd782c6b80 10 client.15753 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:28:40.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.062+0000 7fdd782c6b80 20 client.15753 populate_metadata read hostname 'smithi002' 2024-06-13T11:28:40.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.062+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/2296028858 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x558dd3ea7fe0 0x558dd3eaa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:40.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.062+0000 7fdd782c6b80 4 client.15753 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:28:40.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.062+0000 7fdd782c6b80 1 -- 172.21.15.2:0/2296028858 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558dd3d7c580 con 0x558dd3ea7fe0 2024-06-13T11:28:40.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.062+0000 7fdd5e000700 1 --2- 172.21.15.2:0/2296028858 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x558dd3ea7fe0 0x558dd3eaa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:40.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.063+0000 7fdd5e000700 1 --2- 172.21.15.2:0/2296028858 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x558dd3ea7fe0 0x558dd3eaa3d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f532928dc1a0d4b2 server_cookie=140e7db136828009 in_seq=0 out_seq=0 2024-06-13T11:28:40.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.063+0000 7fdd54c00700 10 client.15753 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:28:40.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.063+0000 7fdd54c00700 1 -- 172.21.15.2:0/2296028858 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558dd3d7c580 con 0x558dd3ea7fe0 2024-06-13T11:28:40.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.063+0000 7fdd54c00700 10 client.15753 handle_command_reply: tid=0 2024-06-13T11:28:40.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.063+0000 7fdd782c6b80 1 client.15753 shutdown 2024-06-13T11:28:40.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.063+0000 7fdd782c6b80 1 -- 172.21.15.2:0/2296028858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e21d60 msgr2=0x558dd3e359b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:40.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.063+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/2296028858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e21d60 0x558dd3e359b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdd580098e0 tx=0x7fdd58004de0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.063+0000 7fdd782c6b80 1 -- 172.21.15.2:0/2296028858 shutdown_connections 2024-06-13T11:28:40.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.063+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/2296028858 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x558dd3ea7fe0 0x558dd3eaa3d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.063+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/2296028858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558dd3e21d60 0x558dd3e359b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.063+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/2296028858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558dd3e2d530 0x558dd3e31340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.063+0000 7fdd782c6b80 1 --2- 172.21.15.2:0/2296028858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558dd3e22680 0x558dd3e30d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.063+0000 7fdd782c6b80 1 -- 172.21.15.2:0/2296028858 >> 172.21.15.2:0/2296028858 conn(0x558dd3d4f170 msgr2=0x558dd3e23dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:40.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.063+0000 7fdd54c00700 0 client.15753 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:28:40.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.063+0000 7fdd782c6b80 1 -- 172.21.15.2:0/2296028858 shutdown_connections 2024-06-13T11:28:40.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.063+0000 7fdd782c6b80 1 -- 172.21.15.2:0/2296028858 wait complete. 2024-06-13T11:28:40.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.064+0000 7fdd782c6b80 20 client.15753 trim_cache size 0 max 16384 2024-06-13T11:28:40.069 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:28:40.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.064+0000 7fdd67e00700 1 -- 172.21.15.2:0/319120771 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdd4c0a2d90 msgr2=0x7fdd4c0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:40.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.064+0000 7fdd67e00700 1 --2- 172.21.15.2:0/319120771 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdd4c0a2d90 0x7fdd4c0a5250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800b2e0 tx=0x7fdd5800b660 comp rx=0 tx=0).stop 2024-06-13T11:28:40.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.064+0000 7fdd67e00700 1 -- 172.21.15.2:0/319120771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd68106140 msgr2=0x7fdd6819f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:40.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.064+0000 7fdd67e00700 1 --2- 172.21.15.2:0/319120771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd68106140 0x7fdd6819f890 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000e9f0 tx=0x7fdd5000ed00 comp rx=0 tx=0).stop 2024-06-13T11:28:40.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.064+0000 7fdd67e00700 1 -- 172.21.15.2:0/319120771 shutdown_connections 2024-06-13T11:28:40.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.064+0000 7fdd67e00700 1 --2- 172.21.15.2:0/319120771 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdd4c0a2d90 0x7fdd4c0a5250 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.064+0000 7fdd67e00700 1 --2- 172.21.15.2:0/319120771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd68106af0 0x7fdd681a3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.064+0000 7fdd67e00700 1 --2- 172.21.15.2:0/319120771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd681012e0 0x7fdd6819f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.064+0000 7fdd67e00700 1 --2- 172.21.15.2:0/319120771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd68106140 0x7fdd6819f890 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:40.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.064+0000 7fdd67e00700 1 -- 172.21.15.2:0/319120771 >> 172.21.15.2:0/319120771 conn(0x7fdd68076640 msgr2=0x7fdd68101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:40.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.065+0000 7fdd67e00700 1 -- 172.21.15.2:0/319120771 shutdown_connections 2024-06-13T11:28:40.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:40.065+0000 7fdd67e00700 1 -- 172.21.15.2:0/319120771 wait complete. 2024-06-13T11:28:41.235 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-13T11:28:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:28:41.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:41 smithi077 ceph-mon[36410]: pgmap v150: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:41.876 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:41 smithi002 ceph-mon[32210]: pgmap v150: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:41.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:41 smithi178 ceph-mon[36913]: pgmap v150: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:43.752 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:43 smithi002 ceph-mon[32210]: pgmap v151: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:43.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:43 smithi077 ceph-mon[36410]: pgmap v151: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:43.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:43 smithi178 ceph-mon[36913]: pgmap v151: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.050+0000 7f405f200700 1 -- 172.21.15.2:0/2595495102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4060101ac0 msgr2=0x7f406010e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.050+0000 7f405f200700 1 --2- 172.21.15.2:0/2595495102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4060101ac0 0x7f406010e780 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4048009990 tx=0x7f4048009ca0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.050+0000 7f405f200700 1 -- 172.21.15.2:0/2595495102 shutdown_connections 2024-06-13T11:28:44.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.050+0000 7f405f200700 1 --2- 172.21.15.2:0/2595495102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f406010ecc0 0x7f40601110b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.050+0000 7f405f200700 1 --2- 172.21.15.2:0/2595495102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4060101110 0x7f40601014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.050+0000 7f405f200700 1 --2- 172.21.15.2:0/2595495102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4060101ac0 0x7f406010e780 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.050+0000 7f405f200700 1 -- 172.21.15.2:0/2595495102 >> 172.21.15.2:0/2595495102 conn(0x7f40600fcdb0 msgr2=0x7f40600ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:44.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.050+0000 7f405f200700 1 -- 172.21.15.2:0/2595495102 shutdown_connections 2024-06-13T11:28:44.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.050+0000 7f405f200700 1 -- 172.21.15.2:0/2595495102 wait complete. 2024-06-13T11:28:44.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.051+0000 7f405f200700 1 Processor -- start 2024-06-13T11:28:44.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.051+0000 7f405f200700 1 -- start start 2024-06-13T11:28:44.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.052+0000 7f405f200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4060101110 0x7f406019ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.052+0000 7f405f200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4060101ac0 0x7f406019b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.052+0000 7f405f200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f406010ecc0 0x7f406019f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.052+0000 7f405f200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4060114970 con 0x7f4060101ac0 2024-06-13T11:28:44.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.052+0000 7f405f200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f40601147f0 con 0x7f406010ecc0 2024-06-13T11:28:44.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.052+0000 7f405f200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4060114af0 con 0x7f4060101110 2024-06-13T11:28:44.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.052+0000 7f4055400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4060101ac0 0x7f406019b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.052+0000 7f405de00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4060101110 0x7f406019ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.052+0000 7f4055400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4060101ac0 0x7f406019b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47204/0 (socket says 172.21.15.2:47204) 2024-06-13T11:28:44.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.052+0000 7f4055400700 1 -- 172.21.15.2:0/1150030464 learned_addr learned my addr 172.21.15.2:0/1150030464 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:44.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.052+0000 7f405e800700 1 --2- 172.21.15.2:0/1150030464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f406010ecc0 0x7f406019f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.052+0000 7f4055400700 1 -- 172.21.15.2:0/1150030464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4060101110 msgr2=0x7f406019ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:44.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.052+0000 7f4055400700 1 --2- 172.21.15.2:0/1150030464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4060101110 0x7f406019ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.052+0000 7f4055400700 1 -- 172.21.15.2:0/1150030464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f406010ecc0 msgr2=0x7f406019f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:44.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.052+0000 7f4055400700 1 --2- 172.21.15.2:0/1150030464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f406010ecc0 0x7f406019f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.052+0000 7f4055400700 1 -- 172.21.15.2:0/1150030464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f406019fe20 con 0x7f4060101ac0 2024-06-13T11:28:44.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.053+0000 7f405de00700 1 --2- 172.21.15.2:0/1150030464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4060101110 0x7f406019ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:28:44.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.053+0000 7f4055400700 1 --2- 172.21.15.2:0/1150030464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4060101ac0 0x7f406019b3a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4048005910 tx=0x7f404800bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:44.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.053+0000 7f4057400700 1 -- 172.21.15.2:0/1150030464 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4048027070 con 0x7f4060101ac0 2024-06-13T11:28:44.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.053+0000 7f405f200700 1 -- 172.21.15.2:0/1150030464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40601a00b0 con 0x7f4060101ac0 2024-06-13T11:28:44.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.053+0000 7f4057400700 1 -- 172.21.15.2:0/1150030464 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4048004650 con 0x7f4060101ac0 2024-06-13T11:28:44.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.053+0000 7f4057400700 1 -- 172.21.15.2:0/1150030464 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404800f460 con 0x7f4060101ac0 2024-06-13T11:28:44.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.054+0000 7f405f200700 1 -- 172.21.15.2:0/1150030464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40601a7990 con 0x7f4060101ac0 2024-06-13T11:28:44.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.057+0000 7f4057400700 1 -- 172.21.15.2:0/1150030464 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f404802a070 con 0x7f4060101ac0 2024-06-13T11:28:44.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.058+0000 7f406f8b0b80 1 Processor -- start 2024-06-13T11:28:44.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.058+0000 7f406f8b0b80 1 -- start start 2024-06-13T11:28:44.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.058+0000 7f4057400700 1 --2- 172.21.15.2:0/1150030464 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f40440a2d90 0x7f40440a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.059+0000 7f4057400700 1 -- 172.21.15.2:0/1150030464 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f40480d06f0 con 0x7f4060101ac0 2024-06-13T11:28:44.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.059+0000 7f406f8b0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfcfdd60 0x55e0bfcfe140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.059+0000 7f405e800700 1 --2- 172.21.15.2:0/1150030464 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f40440a2d90 0x7f40440a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.059+0000 7f406f8b0b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfe680 0x55e0bfd08ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.059+0000 7f406f8b0b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfd09530 0x55e0bfd0b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.059+0000 7f406f8b0b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e0bfc0da10 con 0x55e0bfcfe680 2024-06-13T11:28:44.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.059+0000 7f406f8b0b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e0bfc50b00 con 0x55e0bfd09530 2024-06-13T11:28:44.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.059+0000 7f406f8b0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e0bfc0b8f0 con 0x55e0bfcfdd60 2024-06-13T11:28:44.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.059+0000 7f4055400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfe680 0x55e0bfd08ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.059+0000 7f405de00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfcfdd60 0x55e0bfcfe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.059+0000 7f405de00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfcfdd60 0x55e0bfcfe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:43166/0 (socket says 172.21.15.2:43166) 2024-06-13T11:28:44.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.059+0000 7f405de00700 1 -- 172.21.15.2:0/3500334865 learned_addr learned my addr 172.21.15.2:0/3500334865 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:44.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.060+0000 7f405e800700 1 --2- 172.21.15.2:0/3500334865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfd09530 0x55e0bfd0b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.060+0000 7f405de00700 1 -- 172.21.15.2:0/3500334865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfd09530 msgr2=0x55e0bfd0b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:44.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.060+0000 7f405de00700 1 --2- 172.21.15.2:0/3500334865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfd09530 0x55e0bfd0b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.060+0000 7f405de00700 1 -- 172.21.15.2:0/3500334865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfe680 msgr2=0x55e0bfd08ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:44.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.060+0000 7f405de00700 1 --2- 172.21.15.2:0/3500334865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfe680 0x55e0bfd08ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.060+0000 7f405de00700 1 -- 172.21.15.2:0/3500334865 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0bfbf8f90 con 0x55e0bfcfdd60 2024-06-13T11:28:44.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.060+0000 7f405e800700 1 --2- 172.21.15.2:0/3500334865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfd09530 0x55e0bfd0b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:28:44.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.060+0000 7f405e800700 1 --2- 172.21.15.2:0/1150030464 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f40440a2d90 0x7f40440a5250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4060069d90 tx=0x7f4058009920 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:44.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.060+0000 7f405de00700 1 --2- 172.21.15.2:0/3500334865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfcfdd60 0x55e0bfcfe140 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f40500115c0 tx=0x7f40500118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=669d62dab3161429 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:44.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.061+0000 7f404f400700 1 -- 172.21.15.2:0/3500334865 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405001e070 con 0x55e0bfcfdd60 2024-06-13T11:28:44.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.061+0000 7f404f400700 1 -- 172.21.15.2:0/3500334865 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4050019b10 con 0x55e0bfcfdd60 2024-06-13T11:28:44.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.061+0000 7f404f400700 1 -- 172.21.15.2:0/3500334865 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405000ebc0 con 0x55e0bfcfdd60 2024-06-13T11:28:44.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.061+0000 7f406f8b0b80 1 -- 172.21.15.2:0/3500334865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfcfdd60 msgr2=0x55e0bfcfe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:44.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.061+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/3500334865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfcfdd60 0x55e0bfcfe140 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f40500115c0 tx=0x7f40500118d0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.061+0000 7f406f8b0b80 1 -- 172.21.15.2:0/3500334865 shutdown_connections 2024-06-13T11:28:44.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.062+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/3500334865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfd09530 0x55e0bfd0b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.062+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/3500334865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfcfdd60 0x55e0bfcfe140 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.062+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/3500334865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfe680 0x55e0bfd08ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.062+0000 7f406f8b0b80 1 -- 172.21.15.2:0/3500334865 >> 172.21.15.2:0/3500334865 conn(0x55e0bfc2b170 msgr2=0x55e0bfcfa280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:44.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.062+0000 7f406f8b0b80 1 -- 172.21.15.2:0/3500334865 shutdown_connections 2024-06-13T11:28:44.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.062+0000 7f406f8b0b80 1 -- 172.21.15.2:0/3500334865 wait complete. 2024-06-13T11:28:44.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.062+0000 7f406f8b0b80 1 -- start start 2024-06-13T11:28:44.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.063+0000 7f406f8b0b80 1 Processor -- start 2024-06-13T11:28:44.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.063+0000 7f406f8b0b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd08d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.063+0000 7f406f8b0b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfe680 0x55e0bfd06020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.063+0000 7f406f8b0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfd09530 0x55e0bfd06560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.063+0000 7f406f8b0b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e0bfbecf60 con 0x55e0bfcfe680 2024-06-13T11:28:44.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.063+0000 7f406f8b0b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e0bfc4cac0 con 0x55e0bfcfdd60 2024-06-13T11:28:44.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.063+0000 7f406f8b0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e0bfd0bfc0 con 0x55e0bfd09530 2024-06-13T11:28:44.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.063+0000 7f406f8b0b80 10 client.0 _ll_register_callbacks cb 0x55e0bfbe6380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:28:44.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.064+0000 7f405de00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd08d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.064+0000 7f4055400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfe680 0x55e0bfd06020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.064+0000 7f405e800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfd09530 0x55e0bfd06560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.064+0000 7f405de00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd08d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:34456/0 (socket says 172.21.15.2:34456) 2024-06-13T11:28:44.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.064+0000 7f405de00700 1 -- 172.21.15.2:0/412353743 learned_addr learned my addr 172.21.15.2:0/412353743 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:44.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.064+0000 7f405de00700 1 -- 172.21.15.2:0/412353743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfd09530 msgr2=0x55e0bfd06560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.064+0000 7f405de00700 1 --2- 172.21.15.2:0/412353743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfd09530 0x55e0bfd06560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.064+0000 7f405de00700 1 -- 172.21.15.2:0/412353743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfe680 msgr2=0x55e0bfd06020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.064+0000 7f405de00700 1 --2- 172.21.15.2:0/412353743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfe680 0x55e0bfd06020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.064+0000 7f405de00700 1 -- 172.21.15.2:0/412353743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0bfb9f8d0 con 0x55e0bfcfdd60 2024-06-13T11:28:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.064+0000 7f4055400700 1 --2- 172.21.15.2:0/412353743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfe680 0x55e0bfd06020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:28:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.065+0000 7f405de00700 1 --2- 172.21.15.2:0/412353743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd08d20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4050011c20 tx=0x7f405000e4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfc384807b56ac2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.065+0000 7f4043e00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:28:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.065+0000 7f4043e00700 1 -- 172.21.15.2:0/412353743 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050027070 con 0x55e0bfcfdd60 2024-06-13T11:28:44.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.065+0000 7f4043e00700 1 -- 172.21.15.2:0/412353743 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f4050019840 con 0x55e0bfcfdd60 2024-06-13T11:28:44.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.065+0000 7f406f8b0b80 1 -- 172.21.15.2:0/412353743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4050019b10 con 0x55e0bfcfdd60 2024-06-13T11:28:44.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.065+0000 7f4043e00700 1 -- 172.21.15.2:0/412353743 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4050033050 con 0x55e0bfcfdd60 2024-06-13T11:28:44.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.066+0000 7f406f8b0b80 10 client.25874 fetch_fsmap learned FSMap version 29 2024-06-13T11:28:44.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.066+0000 7f406f8b0b80 1 -- 172.21.15.2:0/412353743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e0bfd166f0 con 0x55e0bfcfdd60 2024-06-13T11:28:44.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.066+0000 7f4043e00700 1 -- 172.21.15.2:0/412353743 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4050019b10 con 0x55e0bfcfdd60 2024-06-13T11:28:44.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.066+0000 7f4043e00700 1 -- 172.21.15.2:0/412353743 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4050004750 con 0x55e0bfcfdd60 2024-06-13T11:28:44.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.066+0000 7f406f8b0b80 10 client.25874 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:28:44.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.066+0000 7f406f8b0b80 10 client.25874 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:28:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.066+0000 7f406f8b0b80 20 client.25874 populate_metadata read hostname 'smithi002' 2024-06-13T11:28:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.066+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/412353743 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55e0bfd18c20 0x55e0bfd1b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.066+0000 7f406f8b0b80 4 client.25874 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:28:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.066+0000 7f406f8b0b80 1 -- 172.21.15.2:0/412353743 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0bfc5e000 con 0x55e0bfd18c20 2024-06-13T11:28:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.067+0000 7f4055400700 1 --2- 172.21.15.2:0/412353743 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55e0bfd18c20 0x55e0bfd1b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.067+0000 7f4055400700 1 --2- 172.21.15.2:0/412353743 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55e0bfd18c20 0x55e0bfd1b010 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=409f877bd072a515 server_cookie=7f7ebec13641f375 in_seq=0 out_seq=0 2024-06-13T11:28:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.067+0000 7f4043e00700 10 client.25874 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:28:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.068+0000 7f4043e00700 1 -- 172.21.15.2:0/412353743 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55e0bfc5e000 con 0x55e0bfd18c20 2024-06-13T11:28:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.068+0000 7f4043e00700 10 client.25874 handle_command_reply: tid=0 2024-06-13T11:28:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.068+0000 7f406f8b0b80 1 client.25874 shutdown 2024-06-13T11:28:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.069+0000 7f406f8b0b80 1 -- 172.21.15.2:0/412353743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfcfdd60 msgr2=0x55e0bfd08d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.069+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/412353743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd08d20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4050011c20 tx=0x7f405000e4a0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.069+0000 7f406f8b0b80 1 -- 172.21.15.2:0/412353743 shutdown_connections 2024-06-13T11:28:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.069+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/412353743 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55e0bfd18c20 0x55e0bfd1b010 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.069+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/412353743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfd09530 0x55e0bfd06560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.069+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/412353743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd08d20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.069+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/412353743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfe680 0x55e0bfd06020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.069+0000 7f4043e00700 0 client.25874 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:28:44.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.069+0000 7f406f8b0b80 1 -- 172.21.15.2:0/412353743 >> 172.21.15.2:0/412353743 conn(0x55e0bfc2b170 msgr2=0x55e0bfcf9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:44.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.069+0000 7f406f8b0b80 1 -- 172.21.15.2:0/412353743 shutdown_connections 2024-06-13T11:28:44.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.069+0000 7f406f8b0b80 1 -- 172.21.15.2:0/412353743 wait complete. 2024-06-13T11:28:44.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.069+0000 7f406f8b0b80 20 client.25874 trim_cache size 0 max 16384 2024-06-13T11:28:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.086+0000 7f406f8b0b80 1 Processor -- start 2024-06-13T11:28:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.087+0000 7f406f8b0b80 1 -- start start 2024-06-13T11:28:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.087+0000 7f406f8b0b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd147a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.087+0000 7f406f8b0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfcfe680 0x55e0bfd14ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.087+0000 7f406f8b0b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfd09530 0x55e0bfd207a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.087+0000 7f406f8b0b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f40601b2c70 con 0x55e0bfcfdd60 2024-06-13T11:28:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.087+0000 7f406f8b0b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f40601b0500 con 0x55e0bfd09530 2024-06-13T11:28:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.087+0000 7f406f8b0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f40601ae350 con 0x55e0bfcfe680 2024-06-13T11:28:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.087+0000 7f405de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd147a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.087+0000 7f405de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd147a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47238/0 (socket says 172.21.15.2:47238) 2024-06-13T11:28:44.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.087+0000 7f405de00700 1 -- 172.21.15.2:0/2704473091 learned_addr learned my addr 172.21.15.2:0/2704473091 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:44.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.087+0000 7f405e800700 1 --2- 172.21.15.2:0/2704473091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfd09530 0x55e0bfd207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.087+0000 7f4055400700 1 --2- 172.21.15.2:0/2704473091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfcfe680 0x55e0bfd14ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.088+0000 7f405de00700 1 -- 172.21.15.2:0/2704473091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfcfe680 msgr2=0x55e0bfd14ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:44.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.088+0000 7f405de00700 1 --2- 172.21.15.2:0/2704473091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfcfe680 0x55e0bfd14ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.088+0000 7f405de00700 1 -- 172.21.15.2:0/2704473091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfd09530 msgr2=0x55e0bfd207a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:44.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.088+0000 7f405de00700 1 --2- 172.21.15.2:0/2704473091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfd09530 0x55e0bfd207a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.088+0000 7f405de00700 1 -- 172.21.15.2:0/2704473091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0bfd05df0 con 0x55e0bfcfdd60 2024-06-13T11:28:44.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.088+0000 7f405de00700 1 --2- 172.21.15.2:0/2704473091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd147a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f40500115c0 tx=0x7f405000e3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74c863b84d2ff17 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:44.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.088+0000 7f404ea00700 1 -- 172.21.15.2:0/2704473091 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050027070 con 0x55e0bfcfdd60 2024-06-13T11:28:44.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.088+0000 7f404ea00700 1 -- 172.21.15.2:0/2704473091 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4050005520 con 0x55e0bfcfdd60 2024-06-13T11:28:44.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.088+0000 7f404ea00700 1 -- 172.21.15.2:0/2704473091 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405001e040 con 0x55e0bfcfdd60 2024-06-13T11:28:44.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.089+0000 7f406f8b0b80 1 -- 172.21.15.2:0/2704473091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfdd60 msgr2=0x55e0bfd147a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:44.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.089+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/2704473091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd147a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f40500115c0 tx=0x7f405000e3b0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.089+0000 7f406f8b0b80 1 -- 172.21.15.2:0/2704473091 shutdown_connections 2024-06-13T11:28:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.089+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/2704473091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd147a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.089+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/2704473091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfd09530 0x55e0bfd207a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.089+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/2704473091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfcfe680 0x55e0bfd14ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.089+0000 7f406f8b0b80 1 -- 172.21.15.2:0/2704473091 >> 172.21.15.2:0/2704473091 conn(0x55e0bfc2b170 msgr2=0x55e0bfd14090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.089+0000 7f406f8b0b80 1 -- 172.21.15.2:0/2704473091 shutdown_connections 2024-06-13T11:28:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.089+0000 7f406f8b0b80 1 -- 172.21.15.2:0/2704473091 wait complete. 2024-06-13T11:28:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.090+0000 7f406f8b0b80 1 -- start start 2024-06-13T11:28:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.090+0000 7f406f8b0b80 1 Processor -- start 2024-06-13T11:28:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f406f8b0b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd116e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f406f8b0b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfcfe680 0x55e0bfd0ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f406f8b0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfd09530 0x55e0bfd0efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f406f8b0b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f40601ae9c0 con 0x55e0bfcfdd60 2024-06-13T11:28:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f406f8b0b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f40601afe30 con 0x55e0bfcfe680 2024-06-13T11:28:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f406f8b0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f40601af090 con 0x55e0bfd09530 2024-06-13T11:28:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f406f8b0b80 10 client.0 _ll_register_callbacks cb 0x55e0bfbe6380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:28:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f405de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd116e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f4055400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfcfe680 0x55e0bfd0ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f405de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd116e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47246/0 (socket says 172.21.15.2:47246) 2024-06-13T11:28:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f405de00700 1 -- 172.21.15.2:0/2107097803 learned_addr learned my addr 172.21.15.2:0/2107097803 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f405e800700 1 --2- 172.21.15.2:0/2107097803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfd09530 0x55e0bfd0efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f405de00700 1 -- 172.21.15.2:0/2107097803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfd09530 msgr2=0x55e0bfd0efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f405de00700 1 --2- 172.21.15.2:0/2107097803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfd09530 0x55e0bfd0efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f405de00700 1 -- 172.21.15.2:0/2107097803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfcfe680 msgr2=0x55e0bfd0ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f405de00700 1 --2- 172.21.15.2:0/2107097803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfcfe680 0x55e0bfd0ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.091+0000 7f405de00700 1 -- 172.21.15.2:0/2107097803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0bfd0f580 con 0x55e0bfcfdd60 2024-06-13T11:28:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.092+0000 7f405de00700 1 --2- 172.21.15.2:0/2107097803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd116e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4050006010 tx=0x7f4050004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cfc8a809beb729 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.092+0000 7f4043e00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:28:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.092+0000 7f4043e00700 1 -- 172.21.15.2:0/2107097803 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050027070 con 0x55e0bfcfdd60 2024-06-13T11:28:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.092+0000 7f4043e00700 1 -- 172.21.15.2:0/2107097803 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f4050019640 con 0x55e0bfcfdd60 2024-06-13T11:28:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.092+0000 7f406f8b0b80 1 -- 172.21.15.2:0/2107097803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4050005520 con 0x55e0bfcfdd60 2024-06-13T11:28:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.092+0000 7f4043e00700 1 -- 172.21.15.2:0/2107097803 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4050048050 con 0x55e0bfcfdd60 2024-06-13T11:28:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.092+0000 7f406f8b0b80 10 client.15771 fetch_fsmap learned FSMap version 29 2024-06-13T11:28:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.093+0000 7f406f8b0b80 1 -- 172.21.15.2:0/2107097803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e0bfd83530 con 0x55e0bfcfdd60 2024-06-13T11:28:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.093+0000 7f4043e00700 1 -- 172.21.15.2:0/2107097803 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4050005520 con 0x55e0bfcfdd60 2024-06-13T11:28:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.093+0000 7f4043e00700 1 -- 172.21.15.2:0/2107097803 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f40500239d0 con 0x55e0bfcfdd60 2024-06-13T11:28:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.093+0000 7f406f8b0b80 10 client.15771 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:28:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.093+0000 7f406f8b0b80 10 client.15771 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:28:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.093+0000 7f406f8b0b80 20 client.15771 populate_metadata read hostname 'smithi002' 2024-06-13T11:28:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.093+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/2107097803 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55e0bfd83b20 0x55e0bfd85f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.093+0000 7f406f8b0b80 4 client.15771 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:28:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.093+0000 7f406f8b0b80 1 -- 172.21.15.2:0/2107097803 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e0bfc58580 con 0x55e0bfd83b20 2024-06-13T11:28:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.094+0000 7f4055400700 1 --2- 172.21.15.2:0/2107097803 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55e0bfd83b20 0x55e0bfd85f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.094+0000 7f4055400700 1 --2- 172.21.15.2:0/2107097803 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55e0bfd83b20 0x55e0bfd85f40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=24a6f6178831d230 server_cookie=390d6695595ee589 in_seq=0 out_seq=0 2024-06-13T11:28:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.094+0000 7f4043e00700 10 client.15771 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:28:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.094+0000 7f4043e00700 1 -- 172.21.15.2:0/2107097803 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e0bfc58580 con 0x55e0bfd83b20 2024-06-13T11:28:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.094+0000 7f4043e00700 10 client.15771 handle_command_reply: tid=0 2024-06-13T11:28:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.094+0000 7f406f8b0b80 1 client.15771 shutdown 2024-06-13T11:28:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.095+0000 7f406f8b0b80 1 -- 172.21.15.2:0/2107097803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfdd60 msgr2=0x55e0bfd116e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:44.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.095+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/2107097803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd116e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4050006010 tx=0x7f4050004920 comp rx=0 tx=0).stop 2024-06-13T11:28:44.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.095+0000 7f406f8b0b80 1 -- 172.21.15.2:0/2107097803 shutdown_connections 2024-06-13T11:28:44.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.095+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/2107097803 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55e0bfd83b20 0x55e0bfd85f40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.095+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/2107097803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e0bfcfdd60 0x55e0bfd116e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.095+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/2107097803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e0bfd09530 0x55e0bfd0efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.095+0000 7f406f8b0b80 1 --2- 172.21.15.2:0/2107097803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e0bfcfe680 0x55e0bfd0ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.095+0000 7f406f8b0b80 1 -- 172.21.15.2:0/2107097803 >> 172.21.15.2:0/2107097803 conn(0x55e0bfc2b170 msgr2=0x55e0bfcf9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:44.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.095+0000 7f4043e00700 0 client.15771 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:28:44.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.095+0000 7f406f8b0b80 1 -- 172.21.15.2:0/2107097803 shutdown_connections 2024-06-13T11:28:44.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.095+0000 7f406f8b0b80 1 -- 172.21.15.2:0/2107097803 wait complete. 2024-06-13T11:28:44.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.095+0000 7f406f8b0b80 20 client.15771 trim_cache size 0 max 16384 2024-06-13T11:28:44.101 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:28:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.096+0000 7f405f200700 1 -- 172.21.15.2:0/1150030464 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f40440a2d90 msgr2=0x7f40440a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.096+0000 7f405f200700 1 --2- 172.21.15.2:0/1150030464 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f40440a2d90 0x7f40440a5250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4060069d90 tx=0x7f4058009920 comp rx=0 tx=0).stop 2024-06-13T11:28:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.096+0000 7f405f200700 1 -- 172.21.15.2:0/1150030464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4060101ac0 msgr2=0x7f406019b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.096+0000 7f405f200700 1 --2- 172.21.15.2:0/1150030464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4060101ac0 0x7f406019b3a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4048005910 tx=0x7f404800bab0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.096+0000 7f405f200700 1 -- 172.21.15.2:0/1150030464 shutdown_connections 2024-06-13T11:28:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.096+0000 7f405f200700 1 --2- 172.21.15.2:0/1150030464 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f40440a2d90 0x7f40440a5250 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.096+0000 7f405f200700 1 --2- 172.21.15.2:0/1150030464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f406010ecc0 0x7f406019f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.096+0000 7f405f200700 1 --2- 172.21.15.2:0/1150030464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4060101110 0x7f406019ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.096+0000 7f405f200700 1 --2- 172.21.15.2:0/1150030464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4060101ac0 0x7f406019b3a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.096+0000 7f405f200700 1 -- 172.21.15.2:0/1150030464 >> 172.21.15.2:0/1150030464 conn(0x7f40600fcdb0 msgr2=0x7f406010ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.096+0000 7f405f200700 1 -- 172.21.15.2:0/1150030464 shutdown_connections 2024-06-13T11:28:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:44.096+0000 7f405f200700 1 -- 172.21.15.2:0/1150030464 wait complete. 2024-06-13T11:28:45.071 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-13T11:28:45.395 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:45 smithi002 ceph-mon[32210]: pgmap v152: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:45.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:45 smithi178 ceph-mon[36913]: pgmap v152: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:45.539 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:45 smithi077 ceph-mon[36410]: pgmap v152: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:45.548 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:28:47.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:47 smithi002 ceph-mon[32210]: pgmap v153: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:47.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:47 smithi178 ceph-mon[36913]: pgmap v153: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:47.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:47 smithi077 ceph-mon[36410]: pgmap v153: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:47.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.811+0000 7f994ac00700 1 -- 172.21.15.2:0/4112598049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f994410c9b0 msgr2=0x7f994410ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:47.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.811+0000 7f994ac00700 1 --2- 172.21.15.2:0/4112598049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f994410c9b0 0x7f994410ee70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f993c00b0a0 tx=0x7f993c00b3b0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.811+0000 7f994ac00700 1 -- 172.21.15.2:0/4112598049 shutdown_connections 2024-06-13T11:28:47.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.811+0000 7f994ac00700 1 --2- 172.21.15.2:0/4112598049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f994410c9b0 0x7f994410ee70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.811+0000 7f994ac00700 1 --2- 172.21.15.2:0/4112598049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944103580 0x7f9944103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.811+0000 7f994ac00700 1 --2- 172.21.15.2:0/4112598049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9944103ea0 0x7f994410c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.811+0000 7f994ac00700 1 -- 172.21.15.2:0/4112598049 >> 172.21.15.2:0/4112598049 conn(0x7f99440fcdb0 msgr2=0x7f99440ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:47.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.811+0000 7f994ac00700 1 -- 172.21.15.2:0/4112598049 shutdown_connections 2024-06-13T11:28:47.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.811+0000 7f994ac00700 1 -- 172.21.15.2:0/4112598049 wait complete. 2024-06-13T11:28:47.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.812+0000 7f994ac00700 1 Processor -- start 2024-06-13T11:28:47.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.812+0000 7f994ac00700 1 -- start start 2024-06-13T11:28:47.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.813+0000 7f994ac00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944103580 0x7f9944198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.813+0000 7f994ac00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9944103ea0 0x7f9944199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.813+0000 7f994ac00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f994410c9b0 0x7f994419d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.813+0000 7f994ac00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9944112770 con 0x7f994410c9b0 2024-06-13T11:28:47.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.813+0000 7f994ac00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f99441125f0 con 0x7f9944103580 2024-06-13T11:28:47.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.813+0000 7f994ac00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f99441128f0 con 0x7f9944103ea0 2024-06-13T11:28:47.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.813+0000 7f9949800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944103580 0x7f9944198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.813+0000 7f9949800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944103580 0x7f9944198c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:57364/0 (socket says 172.21.15.2:57364) 2024-06-13T11:28:47.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.813+0000 7f9949800700 1 -- 172.21.15.2:0/3401770419 learned_addr learned my addr 172.21.15.2:0/3401770419 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:47.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.813+0000 7f9948e00700 1 --2- 172.21.15.2:0/3401770419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9944103ea0 0x7f9944199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.813+0000 7f994a200700 1 --2- 172.21.15.2:0/3401770419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f994410c9b0 0x7f994419d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.813+0000 7f9949800700 1 -- 172.21.15.2:0/3401770419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9944103ea0 msgr2=0x7f9944199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:47.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.813+0000 7f9949800700 1 --2- 172.21.15.2:0/3401770419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9944103ea0 0x7f9944199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.813+0000 7f9949800700 1 -- 172.21.15.2:0/3401770419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f994410c9b0 msgr2=0x7f994419d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:47.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.813+0000 7f9949800700 1 --2- 172.21.15.2:0/3401770419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f994410c9b0 0x7f994419d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.813+0000 7f9949800700 1 -- 172.21.15.2:0/3401770419 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994419dc40 con 0x7f9944103580 2024-06-13T11:28:47.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.814+0000 7f994a200700 1 --2- 172.21.15.2:0/3401770419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f994410c9b0 0x7f994419d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:28:47.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.814+0000 7f9949800700 1 --2- 172.21.15.2:0/3401770419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944103580 0x7f9944198c40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f993800e9a0 tx=0x7f993800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:47.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.814+0000 7f9942000700 1 -- 172.21.15.2:0/3401770419 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993800cbd0 con 0x7f9944103580 2024-06-13T11:28:47.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.814+0000 7f994ac00700 1 -- 172.21.15.2:0/3401770419 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994419df30 con 0x7f9944103580 2024-06-13T11:28:47.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.814+0000 7f9942000700 1 -- 172.21.15.2:0/3401770419 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f993800cd70 con 0x7f9944103580 2024-06-13T11:28:47.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.814+0000 7f9942000700 1 -- 172.21.15.2:0/3401770419 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938018750 con 0x7f9944103580 2024-06-13T11:28:47.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.814+0000 7f994ac00700 1 -- 172.21.15.2:0/3401770419 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99441a57f0 con 0x7f9944103580 2024-06-13T11:28:47.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.818+0000 7f9942000700 1 -- 172.21.15.2:0/3401770419 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f9938010430 con 0x7f9944103580 2024-06-13T11:28:47.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.819+0000 7f9942000700 1 --2- 172.21.15.2:0/3401770419 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f992c0a2d90 0x7f992c0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.819+0000 7f9956ad1b80 1 Processor -- start 2024-06-13T11:28:47.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.819+0000 7f9942000700 1 -- 172.21.15.2:0/3401770419 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f99380cfae0 con 0x7f9944103580 2024-06-13T11:28:47.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.819+0000 7f9956ad1b80 1 -- start start 2024-06-13T11:28:47.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.819+0000 7f9948e00700 1 --2- 172.21.15.2:0/3401770419 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f992c0a2d90 0x7f992c0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.820+0000 7f9956ad1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1da1cc0 0x55fbe1da0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.820+0000 7f9956ad1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da06b0 0x55fbe1da0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.820+0000 7f9956ad1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1dafbd0 0x55fbe1db1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.820+0000 7f9956ad1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fbe1caba10 con 0x55fbe1da06b0 2024-06-13T11:28:47.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.820+0000 7f9956ad1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fbe1ceeb00 con 0x55fbe1da1cc0 2024-06-13T11:28:47.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.820+0000 7f9956ad1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55fbe1ca98f0 con 0x55fbe1dafbd0 2024-06-13T11:28:47.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.820+0000 7f9949800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1da1cc0 0x55fbe1da0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.820+0000 7f9949800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1da1cc0 0x55fbe1da0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:57366/0 (socket says 172.21.15.2:57366) 2024-06-13T11:28:47.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.820+0000 7f9949800700 1 -- 172.21.15.2:0/1797956036 learned_addr learned my addr 172.21.15.2:0/1797956036 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:47.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.820+0000 7f9948e00700 1 --2- 172.21.15.2:0/1797956036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da06b0 0x55fbe1da0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.820+0000 7f994a200700 1 --2- 172.21.15.2:0/1797956036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1dafbd0 0x55fbe1db1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.820+0000 7f9949800700 1 -- 172.21.15.2:0/1797956036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1dafbd0 msgr2=0x55fbe1db1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.820+0000 7f9949800700 1 --2- 172.21.15.2:0/1797956036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1dafbd0 0x55fbe1db1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.820+0000 7f9949800700 1 -- 172.21.15.2:0/1797956036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da06b0 msgr2=0x55fbe1da0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.821+0000 7f9949800700 1 --2- 172.21.15.2:0/1797956036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da06b0 0x55fbe1da0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.821+0000 7f9949800700 1 -- 172.21.15.2:0/1797956036 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbe1c96f90 con 0x55fbe1da1cc0 2024-06-13T11:28:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.821+0000 7f9948e00700 1 --2- 172.21.15.2:0/3401770419 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f992c0a2d90 0x7f992c0a5250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9944100870 tx=0x7f9930011440 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:47.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.821+0000 7f9949800700 1 --2- 172.21.15.2:0/1797956036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1da1cc0 0x55fbe1da0170 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f99380a4370 tx=0x7f993809b590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b2e525caf89d3d4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.821+0000 7f9936a00700 1 -- 172.21.15.2:0/1797956036 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938086050 con 0x55fbe1da1cc0 2024-06-13T11:28:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.821+0000 7f9936a00700 1 -- 172.21.15.2:0/1797956036 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f993809ffe0 con 0x55fbe1da1cc0 2024-06-13T11:28:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.821+0000 7f9936a00700 1 -- 172.21.15.2:0/1797956036 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99380a4410 con 0x55fbe1da1cc0 2024-06-13T11:28:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.822+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1797956036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1da1cc0 msgr2=0x55fbe1da0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.822+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/1797956036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1da1cc0 0x55fbe1da0170 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f99380a4370 tx=0x7f993809b590 comp rx=0 tx=0).stop 2024-06-13T11:28:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.822+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1797956036 shutdown_connections 2024-06-13T11:28:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.822+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/1797956036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1dafbd0 0x55fbe1db1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.822+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/1797956036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1da1cc0 0x55fbe1da0170 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.822+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/1797956036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da06b0 0x55fbe1da0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.822+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1797956036 >> 172.21.15.2:0/1797956036 conn(0x55fbe1cc9170 msgr2=0x55fbe1d98190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:47.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.822+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1797956036 shutdown_connections 2024-06-13T11:28:47.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.822+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1797956036 wait complete. 2024-06-13T11:28:47.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.823+0000 7f9956ad1b80 1 -- start start 2024-06-13T11:28:47.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.823+0000 7f9956ad1b80 1 Processor -- start 2024-06-13T11:28:47.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f9956ad1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1da06b0 0x55fbe1d9d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f9956ad1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1da1cc0 0x55fbe1d9a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f9956ad1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1dafbd0 0x55fbe1d9aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f9956ad1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fbe1c8af60 con 0x55fbe1dafbd0 2024-06-13T11:28:47.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f9956ad1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fbe1ceaac0 con 0x55fbe1da06b0 2024-06-13T11:28:47.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f9956ad1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55fbe1db2840 con 0x55fbe1da1cc0 2024-06-13T11:28:47.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f9956ad1b80 10 client.0 _ll_register_callbacks cb 0x55fbe1c84380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:28:47.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f9949800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1da06b0 0x55fbe1d9d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f994a200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1dafbd0 0x55fbe1d9aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f9948e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1da1cc0 0x55fbe1d9a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f9949800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1da06b0 0x55fbe1d9d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:57376/0 (socket says 172.21.15.2:57376) 2024-06-13T11:28:47.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f9949800700 1 -- 172.21.15.2:0/1200194271 learned_addr learned my addr 172.21.15.2:0/1200194271 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:47.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f9949800700 1 -- 172.21.15.2:0/1200194271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1da1cc0 msgr2=0x55fbe1d9a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:47.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f9949800700 1 --2- 172.21.15.2:0/1200194271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1da1cc0 0x55fbe1d9a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f9949800700 1 -- 172.21.15.2:0/1200194271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1dafbd0 msgr2=0x55fbe1d9aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:47.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f9949800700 1 --2- 172.21.15.2:0/1200194271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1dafbd0 0x55fbe1d9aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.824+0000 7f9949800700 1 -- 172.21.15.2:0/1200194271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbe1c3d8d0 con 0x55fbe1da06b0 2024-06-13T11:28:47.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.825+0000 7f9948e00700 1 --2- 172.21.15.2:0/1200194271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1da1cc0 0x55fbe1d9a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:28:47.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.825+0000 7f9949800700 1 --2- 172.21.15.2:0/1200194271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1da06b0 0x55fbe1d9d690 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f993800c5b0 tx=0x7f993809bd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eccee5d2d36d2d09 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:47.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.825+0000 7f992b400700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:28:47.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.825+0000 7f992b400700 1 -- 172.21.15.2:0/1200194271 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99380b8030 con 0x55fbe1da06b0 2024-06-13T11:28:47.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.825+0000 7f992b400700 1 -- 172.21.15.2:0/1200194271 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f9938099f30 con 0x55fbe1da06b0 2024-06-13T11:28:47.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.825+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1200194271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f993809ffe0 con 0x55fbe1da06b0 2024-06-13T11:28:47.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.825+0000 7f992b400700 1 -- 172.21.15.2:0/1200194271 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f99380a48a0 con 0x55fbe1da06b0 2024-06-13T11:28:47.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.825+0000 7f9956ad1b80 10 client.25892 fetch_fsmap learned FSMap version 29 2024-06-13T11:28:47.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.825+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1200194271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fbe1dbd010 con 0x55fbe1da06b0 2024-06-13T11:28:47.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.826+0000 7f992b400700 1 -- 172.21.15.2:0/1200194271 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f993809ffe0 con 0x55fbe1da06b0 2024-06-13T11:28:47.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.826+0000 7f992b400700 1 -- 172.21.15.2:0/1200194271 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f99380ba2c0 con 0x55fbe1da06b0 2024-06-13T11:28:47.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.826+0000 7f9956ad1b80 10 client.25892 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:28:47.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.826+0000 7f9956ad1b80 10 client.25892 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:28:47.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.826+0000 7f9956ad1b80 20 client.25892 populate_metadata read hostname 'smithi002' 2024-06-13T11:28:47.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.826+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/1200194271 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55fbe1dbf310 0x55fbe1dc1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.826+0000 7f9956ad1b80 4 client.25892 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:28:47.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.826+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1200194271 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbe1cfc000 con 0x55fbe1dbf310 2024-06-13T11:28:47.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.826+0000 7f9948e00700 1 --2- 172.21.15.2:0/1200194271 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55fbe1dbf310 0x55fbe1dc1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.827+0000 7f9948e00700 1 --2- 172.21.15.2:0/1200194271 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55fbe1dbf310 0x55fbe1dc1700 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d43db411ecfead66 server_cookie=2dd6eb3aba7fa0ba in_seq=0 out_seq=0 2024-06-13T11:28:47.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.827+0000 7f992b400700 10 client.25892 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:28:47.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.828+0000 7f992b400700 1 -- 172.21.15.2:0/1200194271 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fbe1cfc000 con 0x55fbe1dbf310 2024-06-13T11:28:47.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.828+0000 7f992b400700 10 client.25892 handle_command_reply: tid=0 2024-06-13T11:28:47.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.828+0000 7f9956ad1b80 1 client.25892 shutdown 2024-06-13T11:28:47.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.828+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1200194271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1da06b0 msgr2=0x55fbe1d9d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:47.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.828+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/1200194271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1da06b0 0x55fbe1d9d690 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f993800c5b0 tx=0x7f993809bd60 comp rx=0 tx=0).stop 2024-06-13T11:28:47.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.828+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1200194271 shutdown_connections 2024-06-13T11:28:47.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.828+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/1200194271 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55fbe1dbf310 0x55fbe1dc1700 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.828+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/1200194271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1dafbd0 0x55fbe1d9aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.828+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/1200194271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1da06b0 0x55fbe1d9d690 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.828+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/1200194271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1da1cc0 0x55fbe1d9a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.828+0000 7f992b400700 0 client.25892 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:28:47.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.828+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1200194271 >> 172.21.15.2:0/1200194271 conn(0x55fbe1cc9170 msgr2=0x55fbe1d97d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:47.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.829+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1200194271 shutdown_connections 2024-06-13T11:28:47.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.829+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1200194271 wait complete. 2024-06-13T11:28:47.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.829+0000 7f9956ad1b80 20 client.25892 trim_cache size 0 max 16384 2024-06-13T11:28:47.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.846+0000 7f9956ad1b80 1 Processor -- start 2024-06-13T11:28:47.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.846+0000 7f9956ad1b80 1 -- start start 2024-06-13T11:28:47.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.846+0000 7f9956ad1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da06b0 0x55fbe1dadb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.846+0000 7f9956ad1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1da1cc0 0x55fbe1dae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.846+0000 7f9956ad1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1dafbd0 0x55fbe1d973b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.846+0000 7f9956ad1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f99441aea10 con 0x55fbe1da06b0 2024-06-13T11:28:47.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.846+0000 7f9956ad1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f99441ac2a0 con 0x55fbe1dafbd0 2024-06-13T11:28:47.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.847+0000 7f9956ad1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f99441aa0f0 con 0x55fbe1da1cc0 2024-06-13T11:28:47.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.847+0000 7f9949800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da06b0 0x55fbe1dadb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.847+0000 7f9949800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da06b0 0x55fbe1dadb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58364/0 (socket says 172.21.15.2:58364) 2024-06-13T11:28:47.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.847+0000 7f9949800700 1 -- 172.21.15.2:0/1117294199 learned_addr learned my addr 172.21.15.2:0/1117294199 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:47.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.847+0000 7f994a200700 1 --2- 172.21.15.2:0/1117294199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1dafbd0 0x55fbe1d973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.847+0000 7f9949800700 1 -- 172.21.15.2:0/1117294199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1da1cc0 msgr2=0x55fbe1dae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:47.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.847+0000 7f9949800700 1 --2- 172.21.15.2:0/1117294199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1da1cc0 0x55fbe1dae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.847+0000 7f9949800700 1 -- 172.21.15.2:0/1117294199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1dafbd0 msgr2=0x55fbe1d973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:47.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.847+0000 7f9949800700 1 --2- 172.21.15.2:0/1117294199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1dafbd0 0x55fbe1d973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.847+0000 7f9949800700 1 -- 172.21.15.2:0/1117294199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbe1d96f80 con 0x55fbe1da06b0 2024-06-13T11:28:47.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.848+0000 7f9949800700 1 --2- 172.21.15.2:0/1117294199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da06b0 0x55fbe1dadb00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9938098600 tx=0x7f993809b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64adedb81b18620 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:47.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.848+0000 7f9936000700 1 -- 172.21.15.2:0/1117294199 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938086040 con 0x55fbe1da06b0 2024-06-13T11:28:47.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.848+0000 7f9936000700 1 -- 172.21.15.2:0/1117294199 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99380ba2c0 con 0x55fbe1da06b0 2024-06-13T11:28:47.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.848+0000 7f9936000700 1 -- 172.21.15.2:0/1117294199 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993809b080 con 0x55fbe1da06b0 2024-06-13T11:28:47.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.849+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1117294199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da06b0 msgr2=0x55fbe1dadb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:47.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.849+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/1117294199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da06b0 0x55fbe1dadb00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9938098600 tx=0x7f993809b590 comp rx=0 tx=0).stop 2024-06-13T11:28:47.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.849+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1117294199 shutdown_connections 2024-06-13T11:28:47.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.849+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/1117294199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da06b0 0x55fbe1dadb00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.849+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/1117294199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1dafbd0 0x55fbe1d973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.849+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/1117294199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1da1cc0 0x55fbe1dae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.849+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1117294199 >> 172.21.15.2:0/1117294199 conn(0x55fbe1cc9170 msgr2=0x55fbe1dabbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:47.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.849+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1117294199 shutdown_connections 2024-06-13T11:28:47.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.849+0000 7f9956ad1b80 1 -- 172.21.15.2:0/1117294199 wait complete. 2024-06-13T11:28:47.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.850+0000 7f9956ad1b80 1 -- start start 2024-06-13T11:28:47.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.850+0000 7f9956ad1b80 1 Processor -- start 2024-06-13T11:28:47.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.850+0000 7f9956ad1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1da06b0 0x55fbe1dc1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.850+0000 7f9956ad1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da1cc0 0x55fbe1dc1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.850+0000 7f9956ad1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1dafbd0 0x55fbe1dc1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.851+0000 7f9956ad1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f99441aa760 con 0x55fbe1da1cc0 2024-06-13T11:28:47.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.851+0000 7f9956ad1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f99441abbd0 con 0x55fbe1dafbd0 2024-06-13T11:28:47.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.851+0000 7f9956ad1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f99441aae30 con 0x55fbe1da06b0 2024-06-13T11:28:47.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.851+0000 7f9956ad1b80 10 client.0 _ll_register_callbacks cb 0x55fbe1db24e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:28:47.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.851+0000 7f9948e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da1cc0 0x55fbe1dc1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.851+0000 7f994a200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1dafbd0 0x55fbe1dc1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.851+0000 7f9949800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1da06b0 0x55fbe1dc1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.851+0000 7f9948e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da1cc0 0x55fbe1dc1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58380/0 (socket says 172.21.15.2:58380) 2024-06-13T11:28:47.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.851+0000 7f9948e00700 1 -- 172.21.15.2:0/2003171288 learned_addr learned my addr 172.21.15.2:0/2003171288 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:47.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.851+0000 7f994a200700 1 -- 172.21.15.2:0/2003171288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1da06b0 msgr2=0x55fbe1dc1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:47.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.851+0000 7f994a200700 1 --2- 172.21.15.2:0/2003171288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1da06b0 0x55fbe1dc1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.851+0000 7f994a200700 1 -- 172.21.15.2:0/2003171288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da1cc0 msgr2=0x55fbe1dc1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.851+0000 7f994a200700 1 --2- 172.21.15.2:0/2003171288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da1cc0 0x55fbe1dc1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.851+0000 7f994a200700 1 -- 172.21.15.2:0/2003171288 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbe1e27c40 con 0x55fbe1dafbd0 2024-06-13T11:28:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.851+0000 7f9949800700 1 --2- 172.21.15.2:0/2003171288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1da06b0 0x55fbe1dc1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:28:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.851+0000 7f9948e00700 1 --2- 172.21.15.2:0/2003171288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da1cc0 0x55fbe1dc1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:28:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.852+0000 7f994a200700 1 --2- 172.21.15.2:0/2003171288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1dafbd0 0x55fbe1dc1f80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f993c009fd0 tx=0x7f993c004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f06896fb03819cb server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.852+0000 7f992b400700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:28:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.852+0000 7f992b400700 1 -- 172.21.15.2:0/2003171288 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c004dd0 con 0x55fbe1dafbd0 2024-06-13T11:28:47.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.852+0000 7f9956ad1b80 1 -- 172.21.15.2:0/2003171288 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99380ba2c0 con 0x55fbe1dafbd0 2024-06-13T11:28:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.852+0000 7f992b400700 1 -- 172.21.15.2:0/2003171288 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f993c0074e0 con 0x55fbe1dafbd0 2024-06-13T11:28:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.852+0000 7f992b400700 1 -- 172.21.15.2:0/2003171288 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f993c007700 con 0x55fbe1dafbd0 2024-06-13T11:28:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.852+0000 7f9956ad1b80 10 client.25898 fetch_fsmap learned FSMap version 29 2024-06-13T11:28:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.852+0000 7f9956ad1b80 1 -- 172.21.15.2:0/2003171288 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fbe1e28f90 con 0x55fbe1dafbd0 2024-06-13T11:28:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.853+0000 7f992b400700 1 -- 172.21.15.2:0/2003171288 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99380ba2c0 con 0x55fbe1dafbd0 2024-06-13T11:28:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.853+0000 7f992b400700 1 -- 172.21.15.2:0/2003171288 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f993c011070 con 0x55fbe1dafbd0 2024-06-13T11:28:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.853+0000 7f9956ad1b80 10 client.25898 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:28:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.853+0000 7f9956ad1b80 10 client.25898 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:28:47.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.853+0000 7f9956ad1b80 20 client.25898 populate_metadata read hostname 'smithi002' 2024-06-13T11:28:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.853+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/2003171288 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55fbe1e29730 0x55fbe1e2bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.853+0000 7f9956ad1b80 4 client.25898 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:28:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.853+0000 7f9956ad1b80 1 -- 172.21.15.2:0/2003171288 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fbe1cf6580 con 0x55fbe1e29730 2024-06-13T11:28:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.853+0000 7f9949800700 1 --2- 172.21.15.2:0/2003171288 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55fbe1e29730 0x55fbe1e2bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.854+0000 7f9949800700 1 --2- 172.21.15.2:0/2003171288 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55fbe1e29730 0x55fbe1e2bb50 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5611b8797286de81 server_cookie=a3230bc29728a240 in_seq=0 out_seq=0 2024-06-13T11:28:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.854+0000 7f992b400700 10 client.25898 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:28:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.854+0000 7f992b400700 1 -- 172.21.15.2:0/2003171288 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fbe1cf6580 con 0x55fbe1e29730 2024-06-13T11:28:47.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.854+0000 7f992b400700 10 client.25898 handle_command_reply: tid=0 2024-06-13T11:28:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.854+0000 7f9956ad1b80 1 client.25898 shutdown 2024-06-13T11:28:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.854+0000 7f9956ad1b80 1 -- 172.21.15.2:0/2003171288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1dafbd0 msgr2=0x55fbe1dc1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.854+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/2003171288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1dafbd0 0x55fbe1dc1f80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f993c009fd0 tx=0x7f993c004a50 comp rx=0 tx=0).stop 2024-06-13T11:28:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.854+0000 7f9956ad1b80 1 -- 172.21.15.2:0/2003171288 shutdown_connections 2024-06-13T11:28:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.854+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/2003171288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbe1dafbd0 0x55fbe1dc1f80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.854+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/2003171288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fbe1da06b0 0x55fbe1dc1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.854+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/2003171288 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55fbe1e29730 0x55fbe1e2bb50 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.854+0000 7f9956ad1b80 1 --2- 172.21.15.2:0/2003171288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fbe1da1cc0 0x55fbe1dc1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.854+0000 7f992b400700 0 client.25898 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:28:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.854+0000 7f9956ad1b80 1 -- 172.21.15.2:0/2003171288 >> 172.21.15.2:0/2003171288 conn(0x55fbe1cc9170 msgr2=0x55fbe1d9c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.855+0000 7f9956ad1b80 1 -- 172.21.15.2:0/2003171288 shutdown_connections 2024-06-13T11:28:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.855+0000 7f9956ad1b80 1 -- 172.21.15.2:0/2003171288 wait complete. 2024-06-13T11:28:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.855+0000 7f9956ad1b80 20 client.25898 trim_cache size 0 max 16384 2024-06-13T11:28:47.860 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:28:47.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.856+0000 7f994ac00700 1 -- 172.21.15.2:0/3401770419 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f992c0a2d90 msgr2=0x7f992c0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:47.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.856+0000 7f994ac00700 1 --2- 172.21.15.2:0/3401770419 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f992c0a2d90 0x7f992c0a5250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9944100870 tx=0x7f9930011440 comp rx=0 tx=0).stop 2024-06-13T11:28:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.856+0000 7f994ac00700 1 -- 172.21.15.2:0/3401770419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944103580 msgr2=0x7f9944198c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.856+0000 7f994ac00700 1 --2- 172.21.15.2:0/3401770419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944103580 0x7f9944198c40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f993800e9a0 tx=0x7f993800ecb0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.856+0000 7f994ac00700 1 -- 172.21.15.2:0/3401770419 shutdown_connections 2024-06-13T11:28:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.856+0000 7f994ac00700 1 --2- 172.21.15.2:0/3401770419 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f992c0a2d90 0x7f992c0a5250 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.856+0000 7f994ac00700 1 --2- 172.21.15.2:0/3401770419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f994410c9b0 0x7f994419d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.856+0000 7f994ac00700 1 --2- 172.21.15.2:0/3401770419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9944103580 0x7f9944198c40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.856+0000 7f994ac00700 1 --2- 172.21.15.2:0/3401770419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9944103ea0 0x7f9944199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.856+0000 7f994ac00700 1 -- 172.21.15.2:0/3401770419 >> 172.21.15.2:0/3401770419 conn(0x7f99440fcdb0 msgr2=0x7f994410e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:47.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.856+0000 7f994ac00700 1 -- 172.21.15.2:0/3401770419 shutdown_connections 2024-06-13T11:28:47.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:47.856+0000 7f994ac00700 1 -- 172.21.15.2:0/3401770419 wait complete. 2024-06-13T11:28:49.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:49 smithi002 ceph-mon[32210]: pgmap v154: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:49.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:49 smithi178 ceph-mon[36913]: pgmap v154: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:49.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:49 smithi077 ceph-mon[36410]: pgmap v154: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:49.903 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-13T11:28:49.904 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-13T11:28:50.399 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:28:51.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:51 smithi002 ceph-mon[32210]: pgmap v155: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:51.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:51 smithi178 ceph-mon[36913]: pgmap v155: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:51.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:51 smithi077 ceph-mon[36410]: pgmap v155: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.770+0000 7fecb1400700 1 -- 172.21.15.2:0/2455277385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecac1046b0 msgr2=0x7fecac104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.770+0000 7fecb1400700 1 --2- 172.21.15.2:0/2455277385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecac1046b0 0x7fecac104b30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fec98009990 tx=0x7fec98009ca0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.771+0000 7fecb1400700 1 -- 172.21.15.2:0/2455277385 shutdown_connections 2024-06-13T11:28:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.771+0000 7fecb1400700 1 --2- 172.21.15.2:0/2455277385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecac105070 0x7fecac111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.771+0000 7fecb1400700 1 --2- 172.21.15.2:0/2455277385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecac10a6b0 0x7fecac10aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.771+0000 7fecb1400700 1 --2- 172.21.15.2:0/2455277385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecac1046b0 0x7fecac104b30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.771+0000 7fecb1400700 1 -- 172.21.15.2:0/2455277385 >> 172.21.15.2:0/2455277385 conn(0x7fecac1001a0 msgr2=0x7fecac1025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.771+0000 7fecb1400700 1 -- 172.21.15.2:0/2455277385 shutdown_connections 2024-06-13T11:28:52.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.771+0000 7fecb1400700 1 -- 172.21.15.2:0/2455277385 wait complete. 2024-06-13T11:28:52.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.772+0000 7fecb1400700 1 Processor -- start 2024-06-13T11:28:52.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.772+0000 7fecb1400700 1 -- start start 2024-06-13T11:28:52.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.772+0000 7fecb1400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecac1046b0 0x7fecac19ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.772+0000 7fecb1400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecac105070 0x7fecac19b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.772+0000 7fecb1400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecac10a6b0 0x7fecac19f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.772+0000 7fecb1400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fecac114a50 con 0x7fecac105070 2024-06-13T11:28:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.772+0000 7fecb1400700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fecac1148d0 con 0x7fecac1046b0 2024-06-13T11:28:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.772+0000 7fecb1400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fecac114bd0 con 0x7fecac10a6b0 2024-06-13T11:28:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.773+0000 7feca9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecac105070 0x7fecac19b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.773+0000 7fecaa800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecac1046b0 0x7fecac19ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.773+0000 7feca9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecac105070 0x7fecac19b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58400/0 (socket says 172.21.15.2:58400) 2024-06-13T11:28:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.773+0000 7feca9e00700 1 -- 172.21.15.2:0/2131654830 learned_addr learned my addr 172.21.15.2:0/2131654830 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.773+0000 7fecab200700 1 --2- 172.21.15.2:0/2131654830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecac10a6b0 0x7fecac19f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.773+0000 7fecaa800700 1 -- 172.21.15.2:0/2131654830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecac10a6b0 msgr2=0x7fecac19f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:52.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.773+0000 7fecaa800700 1 --2- 172.21.15.2:0/2131654830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecac10a6b0 0x7fecac19f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.773+0000 7fecaa800700 1 -- 172.21.15.2:0/2131654830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecac105070 msgr2=0x7fecac19b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:52.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.773+0000 7fecaa800700 1 --2- 172.21.15.2:0/2131654830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecac105070 0x7fecac19b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.773+0000 7fecaa800700 1 -- 172.21.15.2:0/2131654830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecac19fe70 con 0x7fecac1046b0 2024-06-13T11:28:52.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.773+0000 7feca9e00700 1 --2- 172.21.15.2:0/2131654830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecac105070 0x7fecac19b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:28:52.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.774+0000 7fecab200700 1 --2- 172.21.15.2:0/2131654830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecac10a6b0 0x7fecac19f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:28:52.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.774+0000 7fecaa800700 1 --2- 172.21.15.2:0/2131654830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecac1046b0 0x7fecac19ae60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00e9f0 tx=0x7fec9c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:52.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.774+0000 7feca3400700 1 -- 172.21.15.2:0/2131654830 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c00cbd0 con 0x7fecac1046b0 2024-06-13T11:28:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.774+0000 7fecb1400700 1 -- 172.21.15.2:0/2131654830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecac1a0160 con 0x7fecac1046b0 2024-06-13T11:28:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.774+0000 7feca3400700 1 -- 172.21.15.2:0/2131654830 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec9c00cd70 con 0x7fecac1046b0 2024-06-13T11:28:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.774+0000 7feca3400700 1 -- 172.21.15.2:0/2131654830 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c018760 con 0x7fecac1046b0 2024-06-13T11:28:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.774+0000 7fecb1400700 1 -- 172.21.15.2:0/2131654830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecac1a79e0 con 0x7fecac1046b0 2024-06-13T11:28:52.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.778+0000 7feca3400700 1 -- 172.21.15.2:0/2131654830 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fec9c010430 con 0x7fecac1046b0 2024-06-13T11:28:52.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.779+0000 7feca3400700 1 --2- 172.21.15.2:0/2131654830 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fec900a2d90 0x7fec900a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.779+0000 7fecbbcc5b80 1 Processor -- start 2024-06-13T11:28:52.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.779+0000 7feca3400700 1 -- 172.21.15.2:0/2131654830 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fec9c0cf970 con 0x7fecac1046b0 2024-06-13T11:28:52.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.779+0000 7fecbbcc5b80 1 -- start start 2024-06-13T11:28:52.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.779+0000 7feca9e00700 1 --2- 172.21.15.2:0/2131654830 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fec900a2d90 0x7fec900a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.780+0000 7fecbbcc5b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5023ffec0 0x55d5024830f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.780+0000 7fecbbcc5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d502483630 0x55d502483ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.780+0000 7fecbbcc5b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d50248e380 0x55d502490770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.780+0000 7fecbbcc5b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d502392a90 con 0x55d5023ffec0 2024-06-13T11:28:52.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.780+0000 7fecbbcc5b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d5023d5b80 con 0x55d50248e380 2024-06-13T11:28:52.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.780+0000 7fecbbcc5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d502390970 con 0x55d502483630 2024-06-13T11:28:52.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.780+0000 7fecaa800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5023ffec0 0x55d5024830f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.780+0000 7fecaa800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5023ffec0 0x55d5024830f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58406/0 (socket says 172.21.15.2:58406) 2024-06-13T11:28:52.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.780+0000 7fecaa800700 1 -- 172.21.15.2:0/2690428916 learned_addr learned my addr 172.21.15.2:0/2690428916 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:52.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.780+0000 7fecab200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d50248e380 0x55d502490770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.780+0000 7feca9e00700 1 --2- 172.21.15.2:0/2690428916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d502483630 0x55d502483ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.780+0000 7feca9e00700 1 --2- 172.21.15.2:0/2131654830 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fec900a2d90 0x7fec900a5250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fecac109c70 tx=0x7fec9801a040 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.781+0000 7fecab200700 1 -- 172.21.15.2:0/2690428916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d502483630 msgr2=0x55d502483ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.781+0000 7fecab200700 1 --2- 172.21.15.2:0/2690428916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d502483630 0x55d502483ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.781+0000 7fecab200700 1 -- 172.21.15.2:0/2690428916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5023ffec0 msgr2=0x55d5024830f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.781+0000 7fecab200700 1 --2- 172.21.15.2:0/2690428916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5023ffec0 0x55d5024830f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.781+0000 7fecab200700 1 -- 172.21.15.2:0/2690428916 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d50237e010 con 0x55d50248e380 2024-06-13T11:28:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.781+0000 7fecab200700 1 --2- 172.21.15.2:0/2690428916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d50248e380 0x55d502490770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7feca4009420 tx=0x7feca4009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5acc98877132d167 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:52.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.781+0000 7fec97e00700 1 -- 172.21.15.2:0/2690428916 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4014610 con 0x55d50248e380 2024-06-13T11:28:52.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.781+0000 7fec97e00700 1 -- 172.21.15.2:0/2690428916 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca4019070 con 0x55d50248e380 2024-06-13T11:28:52.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.781+0000 7fec97e00700 1 -- 172.21.15.2:0/2690428916 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4013b40 con 0x55d50248e380 2024-06-13T11:28:52.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.782+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/2690428916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d50248e380 msgr2=0x55d502490770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:52.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.782+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/2690428916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d50248e380 0x55d502490770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7feca4009420 tx=0x7feca4009920 comp rx=0 tx=0).stop 2024-06-13T11:28:52.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.782+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/2690428916 shutdown_connections 2024-06-13T11:28:52.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.782+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/2690428916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5023ffec0 0x55d5024830f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.782+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/2690428916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d50248e380 0x55d502490770 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.782+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/2690428916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d502483630 0x55d502483ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.782+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/2690428916 >> 172.21.15.2:0/2690428916 conn(0x55d5023b01f0 msgr2=0x55d50247f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:52.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.782+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/2690428916 shutdown_connections 2024-06-13T11:28:52.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.782+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/2690428916 wait complete. 2024-06-13T11:28:52.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.783+0000 7fecbbcc5b80 1 -- start start 2024-06-13T11:28:52.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.783+0000 7fecbbcc5b80 1 Processor -- start 2024-06-13T11:28:52.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7fecbbcc5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d5023ffec0 0x55d50248d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7fecbbcc5b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d502483630 0x55d50248acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7fecbbcc5b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d50248e380 0x55d50248b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7fecbbcc5b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d502371fe0 con 0x55d502483630 2024-06-13T11:28:52.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7fecbbcc5b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d5023d1b40 con 0x55d50248e380 2024-06-13T11:28:52.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7fecbbcc5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d502491040 con 0x55d5023ffec0 2024-06-13T11:28:52.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7fecbbcc5b80 10 client.0 _ll_register_callbacks cb 0x55d50236f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:28:52.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7fecaa800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d5023ffec0 0x55d50248d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7fecaa800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d5023ffec0 0x55d50248d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55212/0 (socket says 172.21.15.2:55212) 2024-06-13T11:28:52.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7fecaa800700 1 -- 172.21.15.2:0/929506883 learned_addr learned my addr 172.21.15.2:0/929506883 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:52.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7feca9e00700 1 --2- 172.21.15.2:0/929506883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d502483630 0x55d50248acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7fecab200700 1 --2- 172.21.15.2:0/929506883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d50248e380 0x55d50248b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7fecaa800700 1 -- 172.21.15.2:0/929506883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d50248e380 msgr2=0x55d50248b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:52.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7fecaa800700 1 --2- 172.21.15.2:0/929506883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d50248e380 0x55d50248b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7fecaa800700 1 -- 172.21.15.2:0/929506883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d502483630 msgr2=0x55d50248acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:52.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7fecaa800700 1 --2- 172.21.15.2:0/929506883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d502483630 0x55d50248acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7fecaa800700 1 -- 172.21.15.2:0/929506883 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d502324950 con 0x55d5023ffec0 2024-06-13T11:28:52.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.784+0000 7feca9e00700 1 --2- 172.21.15.2:0/929506883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d502483630 0x55d50248acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:28:52.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.785+0000 7fecaa800700 1 --2- 172.21.15.2:0/929506883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d5023ffec0 0x55d50248d9f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fec9c09b7c0 tx=0x7fec9c09b6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b4df765ca2419bd server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:52.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.785+0000 7fec94c00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:28:52.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.785+0000 7fec94c00700 1 -- 172.21.15.2:0/929506883 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c0b4060 con 0x55d5023ffec0 2024-06-13T11:28:52.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.785+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/929506883 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feca4019070 con 0x55d5023ffec0 2024-06-13T11:28:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.785+0000 7fec94c00700 1 -- 172.21.15.2:0/929506883 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fec9c09bd20 con 0x55d5023ffec0 2024-06-13T11:28:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.785+0000 7fec94c00700 1 -- 172.21.15.2:0/929506883 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fec9c09bac0 con 0x55d5023ffec0 2024-06-13T11:28:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.785+0000 7fecbbcc5b80 10 client.25945 fetch_fsmap learned FSMap version 29 2024-06-13T11:28:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.785+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/929506883 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d50249b710 con 0x55d5023ffec0 2024-06-13T11:28:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.786+0000 7fec94c00700 1 -- 172.21.15.2:0/929506883 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca4019070 con 0x55d5023ffec0 2024-06-13T11:28:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.786+0000 7fec94c00700 1 -- 172.21.15.2:0/929506883 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fec9c0a42a0 con 0x55d5023ffec0 2024-06-13T11:28:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.786+0000 7fecbbcc5b80 10 client.25945 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:28:52.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.786+0000 7fecbbcc5b80 10 client.25945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:28:52.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.786+0000 7fecbbcc5b80 20 client.25945 populate_metadata read hostname 'smithi002' 2024-06-13T11:28:52.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.786+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/929506883 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d50249dca0 0x55d5024a0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.786+0000 7fecbbcc5b80 4 client.25945 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:28:52.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.786+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/929506883 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5023e3080 con 0x55d50249dca0 2024-06-13T11:28:52.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.786+0000 7feca9e00700 1 --2- 172.21.15.2:0/929506883 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d50249dca0 0x55d5024a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.787+0000 7feca9e00700 1 --2- 172.21.15.2:0/929506883 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d50249dca0 0x55d5024a0110 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=739cd337ab6c3360 server_cookie=aac83a79d3cfcffd in_seq=0 out_seq=0 2024-06-13T11:28:52.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.787+0000 7fec94c00700 10 client.25945 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:28:52.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.788+0000 7fec94c00700 1 -- 172.21.15.2:0/929506883 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d5023e3080 con 0x55d50249dca0 2024-06-13T11:28:52.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.788+0000 7fec94c00700 10 client.25945 handle_command_reply: tid=0 2024-06-13T11:28:52.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.788+0000 7fecbbcc5b80 1 client.25945 shutdown 2024-06-13T11:28:52.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.788+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/929506883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d5023ffec0 msgr2=0x55d50248d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:52.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.788+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/929506883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d5023ffec0 0x55d50248d9f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fec9c09b7c0 tx=0x7fec9c09b6b0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.788+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/929506883 shutdown_connections 2024-06-13T11:28:52.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.788+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/929506883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d50248e380 0x55d50248b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.788+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/929506883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d5023ffec0 0x55d50248d9f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.788+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/929506883 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d50249dca0 0x55d5024a0110 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.788+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/929506883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d502483630 0x55d50248acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.788+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/929506883 >> 172.21.15.2:0/929506883 conn(0x55d5023b01f0 msgr2=0x55d502485190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:52.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.788+0000 7fec94c00700 0 client.25945 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:28:52.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.789+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/929506883 shutdown_connections 2024-06-13T11:28:52.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.789+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/929506883 wait complete. 2024-06-13T11:28:52.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.789+0000 7fecbbcc5b80 20 client.25945 trim_cache size 0 max 16384 2024-06-13T11:28:52.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.812+0000 7fecbbcc5b80 1 Processor -- start 2024-06-13T11:28:52.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.812+0000 7fecbbcc5b80 1 -- start start 2024-06-13T11:28:52.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.812+0000 7fecbbcc5b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5023ffec0 0x55d50248cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.812+0000 7fecbbcc5b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d502483630 0x55d50248f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.812+0000 7fecbbcc5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d50248e380 0x55d5024a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.812+0000 7fecbbcc5b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fecac1b3010 con 0x55d5023ffec0 2024-06-13T11:28:52.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.812+0000 7fecbbcc5b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fecac1b08a0 con 0x55d502483630 2024-06-13T11:28:52.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.812+0000 7fecbbcc5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fecac1ae6f0 con 0x55d50248e380 2024-06-13T11:28:52.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.813+0000 7fecab200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d50248e380 0x55d5024a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.813+0000 7feca9e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d502483630 0x55d50248f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.813+0000 7fecab200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d50248e380 0x55d5024a59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55222/0 (socket says 172.21.15.2:55222) 2024-06-13T11:28:52.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.813+0000 7fecab200700 1 -- 172.21.15.2:0/597181103 learned_addr learned my addr 172.21.15.2:0/597181103 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:52.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.813+0000 7fecaa800700 1 --2- 172.21.15.2:0/597181103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5023ffec0 0x55d50248cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.813+0000 7feca9e00700 1 -- 172.21.15.2:0/597181103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d50248e380 msgr2=0x55d5024a59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:52.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.813+0000 7feca9e00700 1 --2- 172.21.15.2:0/597181103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d50248e380 0x55d5024a59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.813+0000 7feca9e00700 1 -- 172.21.15.2:0/597181103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5023ffec0 msgr2=0x55d50248cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:52.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.813+0000 7feca9e00700 1 --2- 172.21.15.2:0/597181103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5023ffec0 0x55d50248cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.813+0000 7feca9e00700 1 -- 172.21.15.2:0/597181103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d50249b520 con 0x55d502483630 2024-06-13T11:28:52.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.813+0000 7fecaa800700 1 --2- 172.21.15.2:0/597181103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5023ffec0 0x55d50248cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:28:52.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.813+0000 7fecab200700 1 --2- 172.21.15.2:0/597181103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d50248e380 0x55d5024a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:28:52.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.814+0000 7feca9e00700 1 --2- 172.21.15.2:0/597181103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d502483630 0x55d50248f770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55d5024809a0 tx=0x7fec98024000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8310e87609d9e618 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:52.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.814+0000 7fec97400700 1 -- 172.21.15.2:0/597181103 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9802a040 con 0x55d502483630 2024-06-13T11:28:52.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.814+0000 7fec97400700 1 -- 172.21.15.2:0/597181103 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec98004660 con 0x55d502483630 2024-06-13T11:28:52.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.814+0000 7fec97400700 1 -- 172.21.15.2:0/597181103 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9803a420 con 0x55d502483630 2024-06-13T11:28:52.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.815+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/597181103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d502483630 msgr2=0x55d50248f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:52.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.815+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/597181103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d502483630 0x55d50248f770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55d5024809a0 tx=0x7fec98024000 comp rx=0 tx=0).stop 2024-06-13T11:28:52.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.815+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/597181103 shutdown_connections 2024-06-13T11:28:52.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.815+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/597181103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d5023ffec0 0x55d50248cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.815+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/597181103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d50248e380 0x55d5024a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.815+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/597181103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d502483630 0x55d50248f770 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.815+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/597181103 >> 172.21.15.2:0/597181103 conn(0x55d5023b01f0 msgr2=0x55d50248c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:52.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.815+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/597181103 shutdown_connections 2024-06-13T11:28:52.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.815+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/597181103 wait complete. 2024-06-13T11:28:52.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.816+0000 7fecbbcc5b80 1 -- start start 2024-06-13T11:28:52.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.816+0000 7fecbbcc5b80 1 Processor -- start 2024-06-13T11:28:52.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.816+0000 7fecbbcc5b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5023ffec0 0x55d502491290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.816+0000 7fecbbcc5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d502483630 0x55d5024917d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.816+0000 7fecbbcc5b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d50248e380 0x55d502491d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.816+0000 7fecbbcc5b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fecac1aed60 con 0x55d50248e380 2024-06-13T11:28:52.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.816+0000 7fecbbcc5b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fecac1b01d0 con 0x55d5023ffec0 2024-06-13T11:28:52.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.816+0000 7fecbbcc5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fecac1af430 con 0x55d502483630 2024-06-13T11:28:52.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.816+0000 7fecbbcc5b80 10 client.0 _ll_register_callbacks cb 0x55d50236f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:28:52.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.817+0000 7fecab200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d50248e380 0x55d502491d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.817+0000 7fecab200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d50248e380 0x55d502491d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58434/0 (socket says 172.21.15.2:58434) 2024-06-13T11:28:52.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.817+0000 7fecab200700 1 -- 172.21.15.2:0/1018517915 learned_addr learned my addr 172.21.15.2:0/1018517915 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:52.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.817+0000 7fecaa800700 1 --2- 172.21.15.2:0/1018517915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5023ffec0 0x55d502491290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.817+0000 7feca9e00700 1 --2- 172.21.15.2:0/1018517915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d502483630 0x55d5024917d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.817+0000 7fecab200700 1 -- 172.21.15.2:0/1018517915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d502483630 msgr2=0x55d5024917d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:52.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.817+0000 7fecab200700 1 --2- 172.21.15.2:0/1018517915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d502483630 0x55d5024917d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.817+0000 7fecab200700 1 -- 172.21.15.2:0/1018517915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5023ffec0 msgr2=0x55d502491290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:52.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.817+0000 7fecab200700 1 --2- 172.21.15.2:0/1018517915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5023ffec0 0x55d502491290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.817+0000 7fecab200700 1 -- 172.21.15.2:0/1018517915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5025089b0 con 0x55d50248e380 2024-06-13T11:28:52.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.817+0000 7feca9e00700 1 --2- 172.21.15.2:0/1018517915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d502483630 0x55d5024917d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:28:52.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.817+0000 7fecab200700 1 --2- 172.21.15.2:0/1018517915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d50248e380 0x55d502491d10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feca4008fd0 tx=0x7feca4004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af040a4e2873a542 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:52.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.817+0000 7fec94c00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:28:52.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.818+0000 7fec94c00700 1 -- 172.21.15.2:0/1018517915 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4013af0 con 0x55d50248e380 2024-06-13T11:28:52.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.818+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/1018517915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec98004660 con 0x55d50248e380 2024-06-13T11:28:52.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.818+0000 7fec94c00700 1 -- 172.21.15.2:0/1018517915 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7feca4013c90 con 0x55d50248e380 2024-06-13T11:28:52.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.818+0000 7fec94c00700 1 -- 172.21.15.2:0/1018517915 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feca4031050 con 0x55d50248e380 2024-06-13T11:28:52.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.818+0000 7fecbbcc5b80 10 client.15807 fetch_fsmap learned FSMap version 29 2024-06-13T11:28:52.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.818+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/1018517915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d502509d00 con 0x55d50248e380 2024-06-13T11:28:52.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.818+0000 7fec94c00700 1 -- 172.21.15.2:0/1018517915 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec98004660 con 0x55d50248e380 2024-06-13T11:28:52.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.819+0000 7fec94c00700 1 -- 172.21.15.2:0/1018517915 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7feca4014410 con 0x55d50248e380 2024-06-13T11:28:52.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.819+0000 7fecbbcc5b80 10 client.15807 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:28:52.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.819+0000 7fecbbcc5b80 10 client.15807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:28:52.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.819+0000 7fecbbcc5b80 20 client.15807 populate_metadata read hostname 'smithi002' 2024-06-13T11:28:52.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.819+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/1018517915 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d50250a130 0x55d50250c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:52.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.819+0000 7fecbbcc5b80 4 client.15807 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-13T11:28:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.819+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/1018517915 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d5023dd600 con 0x55d50250a130 2024-06-13T11:28:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.819+0000 7fecaa800700 1 --2- 172.21.15.2:0/1018517915 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d50250a130 0x55d50250c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.820+0000 7fecaa800700 1 --2- 172.21.15.2:0/1018517915 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d50250a130 0x55d50250c550 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f249cb11cc63c89 server_cookie=c6df44043c5b11a3 in_seq=0 out_seq=0 2024-06-13T11:28:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.820+0000 7fec94c00700 10 client.15807 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:28:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.821+0000 7fec94c00700 1 -- 172.21.15.2:0/1018517915 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d5023dd600 con 0x55d50250a130 2024-06-13T11:28:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.821+0000 7fec94c00700 10 client.15807 handle_command_reply: tid=0 2024-06-13T11:28:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.821+0000 7fecbbcc5b80 1 client.15807 shutdown 2024-06-13T11:28:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.821+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/1018517915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d50248e380 msgr2=0x55d502491d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.821+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/1018517915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d50248e380 0x55d502491d10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feca4008fd0 tx=0x7feca4004f90 comp rx=0 tx=0).stop 2024-06-13T11:28:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.821+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/1018517915 shutdown_connections 2024-06-13T11:28:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.821+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/1018517915 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d50250a130 0x55d50250c550 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.821+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/1018517915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d50248e380 0x55d502491d10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.821+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/1018517915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5023ffec0 0x55d502491290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.821+0000 7fecbbcc5b80 1 --2- 172.21.15.2:0/1018517915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d502483630 0x55d5024917d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.821+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/1018517915 >> 172.21.15.2:0/1018517915 conn(0x55d5023b01f0 msgr2=0x55d50247e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.821+0000 7fec94c00700 0 client.15807 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:28:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.822+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/1018517915 shutdown_connections 2024-06-13T11:28:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.822+0000 7fecbbcc5b80 1 -- 172.21.15.2:0/1018517915 wait complete. 2024-06-13T11:28:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.822+0000 7fecbbcc5b80 20 client.15807 trim_cache size 0 max 16384 2024-06-13T11:28:52.826 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:28:52.826 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-06-13T11:28:52.826 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "7ae31895-a6d0-4d5f-80d8-43ceb3d810ee", 2024-06-13T11:28:52.826 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-06-13T11:28:52.826 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:28:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.822+0000 7fecb1400700 1 -- 172.21.15.2:0/2131654830 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fec900a2d90 msgr2=0x7fec900a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.822+0000 7fecb1400700 1 --2- 172.21.15.2:0/2131654830 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fec900a2d90 0x7fec900a5250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fecac109c70 tx=0x7fec9801a040 comp rx=0 tx=0).stop 2024-06-13T11:28:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.822+0000 7fecb1400700 1 -- 172.21.15.2:0/2131654830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecac1046b0 msgr2=0x7fecac19ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.822+0000 7fecb1400700 1 --2- 172.21.15.2:0/2131654830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecac1046b0 0x7fecac19ae60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00e9f0 tx=0x7fec9c00ed00 comp rx=0 tx=0).stop 2024-06-13T11:28:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.823+0000 7fecb1400700 1 -- 172.21.15.2:0/2131654830 shutdown_connections 2024-06-13T11:28:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.823+0000 7fecb1400700 1 --2- 172.21.15.2:0/2131654830 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fec900a2d90 0x7fec900a5250 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.823+0000 7fecb1400700 1 --2- 172.21.15.2:0/2131654830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecac10a6b0 0x7fecac19f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.823+0000 7fecb1400700 1 --2- 172.21.15.2:0/2131654830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecac1046b0 0x7fecac19ae60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.823+0000 7fecb1400700 1 --2- 172.21.15.2:0/2131654830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecac105070 0x7fecac19b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.823+0000 7fecb1400700 1 -- 172.21.15.2:0/2131654830 >> 172.21.15.2:0/2131654830 conn(0x7fecac1001a0 msgr2=0x7fecac1006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.823+0000 7fecb1400700 1 -- 172.21.15.2:0/2131654830 shutdown_connections 2024-06-13T11:28:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:52.823+0000 7fecb1400700 1 -- 172.21.15.2:0/2131654830 wait complete. 2024-06-13T11:28:53.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:53 smithi002 ceph-mon[32210]: pgmap v156: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:53.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:53 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:28:53.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:53 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:28:53.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:53 smithi178 ceph-mon[36913]: pgmap v156: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:53.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:53 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:28:53.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:53 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:28:53.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:53 smithi077 ceph-mon[36410]: pgmap v156: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:28:53.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:53 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:28:53.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:53 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:28:53.826 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:28:54.288 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:28:54.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:54 smithi002 ceph-mon[32210]: scrub queued for path: / 2024-06-13T11:28:54.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:54 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:28:54.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:54 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:28:54.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:54 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:28:54.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:54 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:28:54.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:54 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:28:54.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:54 smithi178 ceph-mon[36913]: scrub queued for path: / 2024-06-13T11:28:54.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:54 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:28:54.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:54 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:28:54.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:54 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:28:54.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:54 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:28:54.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:54 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:28:54.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:54 smithi077 ceph-mon[36410]: scrub queued for path: / 2024-06-13T11:28:54.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:54 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:28:54.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:54 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:28:54.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:54 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:28:54.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:54 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:28:54.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:54 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:28:55.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:55 smithi002 ceph-mon[32210]: pgmap v157: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:55.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:55 smithi178 ceph-mon[36913]: pgmap v157: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:55.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:55 smithi077 ceph-mon[36410]: pgmap v157: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.803+0000 7fe606200700 1 -- 172.21.15.2:0/2488125461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe600102620 msgr2=0x7fe600102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.803+0000 7fe606200700 1 --2- 172.21.15.2:0/2488125461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe600102620 0x7fe600102a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00099c0 tx=0x7fe5f0009cd0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.803+0000 7fe606200700 1 -- 172.21.15.2:0/2488125461 shutdown_connections 2024-06-13T11:28:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.803+0000 7fe606200700 1 --2- 172.21.15.2:0/2488125461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe600107700 0x7fe60010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.803+0000 7fe606200700 1 --2- 172.21.15.2:0/2488125461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe600102620 0x7fe600102a00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.803+0000 7fe606200700 1 --2- 172.21.15.2:0/2488125461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe600102fd0 0x7fe600107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.803+0000 7fe606200700 1 -- 172.21.15.2:0/2488125461 >> 172.21.15.2:0/2488125461 conn(0x7fe6000fdf10 msgr2=0x7fe600100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.803+0000 7fe606200700 1 -- 172.21.15.2:0/2488125461 shutdown_connections 2024-06-13T11:28:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.803+0000 7fe606200700 1 -- 172.21.15.2:0/2488125461 wait complete. 2024-06-13T11:28:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.804+0000 7fe606200700 1 Processor -- start 2024-06-13T11:28:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.804+0000 7fe606200700 1 -- start start 2024-06-13T11:28:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.805+0000 7fe606200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe600102620 0x7fe60019ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.805+0000 7fe606200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe600102fd0 0x7fe60019b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.805+0000 7fe606200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe600107700 0x7fe60019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.805+0000 7fe606200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe600112700 con 0x7fe600102620 2024-06-13T11:28:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.805+0000 7fe606200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe600112580 con 0x7fe600102fd0 2024-06-13T11:28:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.805+0000 7fe606200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe600112880 con 0x7fe600107700 2024-06-13T11:28:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.805+0000 7fe604e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe600102620 0x7fe60019ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.805+0000 7fe604e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe600102620 0x7fe60019ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58742/0 (socket says 172.21.15.2:58742) 2024-06-13T11:28:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.805+0000 7fe604e00700 1 -- 172.21.15.2:0/2762717848 learned_addr learned my addr 172.21.15.2:0/2762717848 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.805+0000 7fe605800700 1 --2- 172.21.15.2:0/2762717848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe600107700 0x7fe60019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.805+0000 7fe5f7e00700 1 --2- 172.21.15.2:0/2762717848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe600102fd0 0x7fe60019b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.806+0000 7fe605800700 1 -- 172.21.15.2:0/2762717848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe600102fd0 msgr2=0x7fe60019b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.806+0000 7fe605800700 1 --2- 172.21.15.2:0/2762717848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe600102fd0 0x7fe60019b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.806+0000 7fe605800700 1 -- 172.21.15.2:0/2762717848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe600102620 msgr2=0x7fe60019ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.806+0000 7fe605800700 1 --2- 172.21.15.2:0/2762717848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe600102620 0x7fe60019ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.806+0000 7fe605800700 1 -- 172.21.15.2:0/2762717848 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60019fd60 con 0x7fe600107700 2024-06-13T11:28:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.806+0000 7fe604e00700 1 --2- 172.21.15.2:0/2762717848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe600102620 0x7fe60019ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:28:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.806+0000 7fe605800700 1 --2- 172.21.15.2:0/2762717848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe600107700 0x7fe60019f620 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800efc0 tx=0x7fe5f800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.806+0000 7fe5fe000700 1 -- 172.21.15.2:0/2762717848 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80092e0 con 0x7fe600107700 2024-06-13T11:28:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.806+0000 7fe5fe000700 1 -- 172.21.15.2:0/2762717848 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5f8004bb0 con 0x7fe600107700 2024-06-13T11:28:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.806+0000 7fe606200700 1 -- 172.21.15.2:0/2762717848 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60019fff0 con 0x7fe600107700 2024-06-13T11:28:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.807+0000 7fe5fe000700 1 -- 172.21.15.2:0/2762717848 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8004280 con 0x7fe600107700 2024-06-13T11:28:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.807+0000 7fe606200700 1 -- 172.21.15.2:0/2762717848 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6001a78d0 con 0x7fe600107700 2024-06-13T11:28:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.810+0000 7fe5fe000700 1 -- 172.21.15.2:0/2762717848 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fe5f801b030 con 0x7fe600107700 2024-06-13T11:28:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.811+0000 7fe5fe000700 1 --2- 172.21.15.2:0/2762717848 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe5e40a2d90 0x7fe5e40a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.811+0000 7fe5fe000700 1 -- 172.21.15.2:0/2762717848 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fe5f80cf2e0 con 0x7fe600107700 2024-06-13T11:28:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.811+0000 7fe6120e7b80 1 Processor -- start 2024-06-13T11:28:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.812+0000 7fe604e00700 1 --2- 172.21.15.2:0/2762717848 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe5e40a2d90 0x7fe5e40a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.812+0000 7fe6120e7b80 1 -- start start 2024-06-13T11:28:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.812+0000 7fe6120e7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8acd60 0x555a7e8ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.812+0000 7fe6120e7b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 0x555a7e8b7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.812+0000 7fe6120e7b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8b8530 0x555a7e8ba920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.812+0000 7fe6120e7b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555a7e7bca10 con 0x555a7e8ad680 2024-06-13T11:28:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.812+0000 7fe6120e7b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555a7e7ffb00 con 0x555a7e8b8530 2024-06-13T11:28:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.812+0000 7fe6120e7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x555a7e7ba8f0 con 0x555a7e8acd60 2024-06-13T11:28:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.812+0000 7fe604e00700 1 --2- 172.21.15.2:0/2762717848 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe5e40a2d90 0x7fe5e40a5250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009990 tx=0x7fe5f0005960 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.812+0000 7fe604e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8acd60 0x555a7e8ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.813+0000 7fe604e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8acd60 0x555a7e8ad140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56844/0 (socket says 172.21.15.2:56844) 2024-06-13T11:28:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.813+0000 7fe604e00700 1 -- 172.21.15.2:0/3455500948 learned_addr learned my addr 172.21.15.2:0/3455500948 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.813+0000 7fe5f7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 0x555a7e8b7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.813+0000 7fe605800700 1 --2- 172.21.15.2:0/3455500948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8b8530 0x555a7e8ba920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.813+0000 7fe604e00700 1 -- 172.21.15.2:0/3455500948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8b8530 msgr2=0x555a7e8ba920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.813+0000 7fe604e00700 1 --2- 172.21.15.2:0/3455500948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8b8530 0x555a7e8ba920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.813+0000 7fe604e00700 1 -- 172.21.15.2:0/3455500948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 msgr2=0x555a7e8b7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.813+0000 7fe604e00700 1 --2- 172.21.15.2:0/3455500948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 0x555a7e8b7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.813+0000 7fe604e00700 1 -- 172.21.15.2:0/3455500948 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7e7a7f90 con 0x555a7e8acd60 2024-06-13T11:28:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.813+0000 7fe605800700 1 --2- 172.21.15.2:0/3455500948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8b8530 0x555a7e8ba920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:28:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.813+0000 7fe604e00700 1 --2- 172.21.15.2:0/3455500948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8acd60 0x555a7e8ad140 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0005910 tx=0x7fe5f0020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2707c516c21a2756 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.814+0000 7fe5f6000700 1 -- 172.21.15.2:0/3455500948 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f000fb50 con 0x555a7e8acd60 2024-06-13T11:28:56.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.814+0000 7fe5f6000700 1 -- 172.21.15.2:0/3455500948 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5f0003d40 con 0x555a7e8acd60 2024-06-13T11:28:56.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.814+0000 7fe5f6000700 1 -- 172.21.15.2:0/3455500948 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0005650 con 0x555a7e8acd60 2024-06-13T11:28:56.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.814+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3455500948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8acd60 msgr2=0x555a7e8ad140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:56.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.814+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/3455500948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8acd60 0x555a7e8ad140 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0005910 tx=0x7fe5f0020000 comp rx=0 tx=0).stop 2024-06-13T11:28:56.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.815+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3455500948 shutdown_connections 2024-06-13T11:28:56.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.815+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/3455500948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8b8530 0x555a7e8ba920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.815+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/3455500948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8acd60 0x555a7e8ad140 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.815+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/3455500948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 0x555a7e8b7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.815+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3455500948 >> 172.21.15.2:0/3455500948 conn(0x555a7e7da170 msgr2=0x555a7e8a9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:56.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.815+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3455500948 shutdown_connections 2024-06-13T11:28:56.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.815+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3455500948 wait complete. 2024-06-13T11:28:56.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.815+0000 7fe6120e7b80 1 -- start start 2024-06-13T11:28:56.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.816+0000 7fe6120e7b80 1 Processor -- start 2024-06-13T11:28:56.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.816+0000 7fe6120e7b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8acd60 0x555a7e8b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.816+0000 7fe6120e7b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 0x555a7e8b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.816+0000 7fe6120e7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8b8530 0x555a7e8b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.816+0000 7fe6120e7b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x555a7e79bf60 con 0x555a7e8ad680 2024-06-13T11:28:56.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.816+0000 7fe6120e7b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555a7e7fbac0 con 0x555a7e8acd60 2024-06-13T11:28:56.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.816+0000 7fe6120e7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x555a7e8baf60 con 0x555a7e8b8530 2024-06-13T11:28:56.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.816+0000 7fe6120e7b80 10 client.0 _ll_register_callbacks cb 0x555a7e795380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:28:56.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.817+0000 7fe5f7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 0x555a7e8b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.817+0000 7fe604e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8acd60 0x555a7e8b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.817+0000 7fe605800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8b8530 0x555a7e8b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.817+0000 7fe604e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8acd60 0x555a7e8b7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:35714/0 (socket says 172.21.15.2:35714) 2024-06-13T11:28:56.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.817+0000 7fe604e00700 1 -- 172.21.15.2:0/2295869621 learned_addr learned my addr 172.21.15.2:0/2295869621 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:56.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.817+0000 7fe604e00700 1 -- 172.21.15.2:0/2295869621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8b8530 msgr2=0x555a7e8b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:56.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.817+0000 7fe604e00700 1 --2- 172.21.15.2:0/2295869621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8b8530 0x555a7e8b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.817+0000 7fe604e00700 1 -- 172.21.15.2:0/2295869621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 msgr2=0x555a7e8b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:56.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.817+0000 7fe604e00700 1 --2- 172.21.15.2:0/2295869621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 0x555a7e8b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.817+0000 7fe604e00700 1 -- 172.21.15.2:0/2295869621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a7e74e8d0 con 0x555a7e8acd60 2024-06-13T11:28:56.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.817+0000 7fe605800700 1 --2- 172.21.15.2:0/2295869621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8b8530 0x555a7e8b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:28:56.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.818+0000 7fe604e00700 1 --2- 172.21.15.2:0/2295869621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8acd60 0x555a7e8b7d20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0005f50 tx=0x7fe5f0003cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d27f02b3d73c9c3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:56.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.818+0000 7fe5eea00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:28:56.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.818+0000 7fe5eea00700 1 -- 172.21.15.2:0/2295869621 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f000be60 con 0x555a7e8acd60 2024-06-13T11:28:56.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.818+0000 7fe6120e7b80 1 -- 172.21.15.2:0/2295869621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5f0003d40 con 0x555a7e8acd60 2024-06-13T11:28:56.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.818+0000 7fe5eea00700 1 -- 172.21.15.2:0/2295869621 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fe5f0005330 con 0x555a7e8acd60 2024-06-13T11:28:56.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.818+0000 7fe5eea00700 1 -- 172.21.15.2:0/2295869621 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe5f0041050 con 0x555a7e8acd60 2024-06-13T11:28:56.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.819+0000 7fe6120e7b80 10 client.25928 fetch_fsmap learned FSMap version 29 2024-06-13T11:28:56.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.819+0000 7fe6120e7b80 1 -- 172.21.15.2:0/2295869621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555a7e8c56d0 con 0x555a7e8acd60 2024-06-13T11:28:56.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.819+0000 7fe5eea00700 1 -- 172.21.15.2:0/2295869621 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5f0003d40 con 0x555a7e8acd60 2024-06-13T11:28:56.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.819+0000 7fe5eea00700 1 -- 172.21.15.2:0/2295869621 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fe5f002d030 con 0x555a7e8acd60 2024-06-13T11:28:56.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.819+0000 7fe6120e7b80 10 client.25928 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:28:56.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.819+0000 7fe6120e7b80 10 client.25928 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:28:56.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.819+0000 7fe6120e7b80 20 client.25928 populate_metadata read hostname 'smithi002' 2024-06-13T11:28:56.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.819+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/2295869621 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x555a7e8c7ba0 0x555a7e8c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.819+0000 7fe6120e7b80 4 client.25928 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:28:56.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.819+0000 7fe6120e7b80 1 -- 172.21.15.2:0/2295869621 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a7e80d000 con 0x555a7e8c7ba0 2024-06-13T11:28:56.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.820+0000 7fe5f7e00700 1 --2- 172.21.15.2:0/2295869621 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x555a7e8c7ba0 0x555a7e8c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.820+0000 7fe5f7e00700 1 --2- 172.21.15.2:0/2295869621 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x555a7e8c7ba0 0x555a7e8c9f90 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17c8dd38294435e2 server_cookie=6daa8a65f81fec38 in_seq=0 out_seq=0 2024-06-13T11:28:56.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.820+0000 7fe5eea00700 10 client.25928 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:28:56.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.821+0000 7fe5eea00700 1 -- 172.21.15.2:0/2295869621 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x555a7e80d000 con 0x555a7e8c7ba0 2024-06-13T11:28:56.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.821+0000 7fe5eea00700 10 client.25928 handle_command_reply: tid=0 2024-06-13T11:28:56.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.821+0000 7fe6120e7b80 1 client.25928 shutdown 2024-06-13T11:28:56.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.821+0000 7fe6120e7b80 1 -- 172.21.15.2:0/2295869621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8acd60 msgr2=0x555a7e8b7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:56.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.821+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/2295869621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8acd60 0x555a7e8b7d20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0005f50 tx=0x7fe5f0003cb0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.822+0000 7fe6120e7b80 1 -- 172.21.15.2:0/2295869621 shutdown_connections 2024-06-13T11:28:56.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.822+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/2295869621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8b8530 0x555a7e8b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.822+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/2295869621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8acd60 0x555a7e8b7d20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.822+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/2295869621 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x555a7e8c7ba0 0x555a7e8c9f90 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.822+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/2295869621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 0x555a7e8b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.822+0000 7fe6120e7b80 1 -- 172.21.15.2:0/2295869621 >> 172.21.15.2:0/2295869621 conn(0x555a7e7da170 msgr2=0x555a7e8a8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:56.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.822+0000 7fe5eea00700 0 client.25928 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:28:56.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.822+0000 7fe6120e7b80 1 -- 172.21.15.2:0/2295869621 shutdown_connections 2024-06-13T11:28:56.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.822+0000 7fe6120e7b80 1 -- 172.21.15.2:0/2295869621 wait complete. 2024-06-13T11:28:56.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.822+0000 7fe6120e7b80 20 client.25928 trim_cache size 0 max 16384 2024-06-13T11:28:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.844+0000 7fe6120e7b80 1 Processor -- start 2024-06-13T11:28:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.844+0000 7fe6120e7b80 1 -- start start 2024-06-13T11:28:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.845+0000 7fe6120e7b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8acd60 0x555a7e8b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.845+0000 7fe6120e7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8ad680 0x555a7e8b7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.845+0000 7fe6120e7b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8b8530 0x555a7e8a8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.845+0000 7fe6120e7b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6001b2d00 con 0x555a7e8b8530 2024-06-13T11:28:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.845+0000 7fe6120e7b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6001b0590 con 0x555a7e8acd60 2024-06-13T11:28:56.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.845+0000 7fe6120e7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe6001ae3e0 con 0x555a7e8ad680 2024-06-13T11:28:56.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.845+0000 7fe605800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8b8530 0x555a7e8a8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.845+0000 7fe605800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8b8530 0x555a7e8a8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58778/0 (socket says 172.21.15.2:58778) 2024-06-13T11:28:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.845+0000 7fe605800700 1 -- 172.21.15.2:0/3063767370 learned_addr learned my addr 172.21.15.2:0/3063767370 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.845+0000 7fe604e00700 1 --2- 172.21.15.2:0/3063767370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8acd60 0x555a7e8b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.845+0000 7fe5f7e00700 1 --2- 172.21.15.2:0/3063767370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8ad680 0x555a7e8b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.846+0000 7fe605800700 1 -- 172.21.15.2:0/3063767370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8ad680 msgr2=0x555a7e8b7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.846+0000 7fe605800700 1 --2- 172.21.15.2:0/3063767370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8ad680 0x555a7e8b7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.846+0000 7fe605800700 1 -- 172.21.15.2:0/3063767370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8acd60 msgr2=0x555a7e8b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:56.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.846+0000 7fe605800700 1 --2- 172.21.15.2:0/3063767370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8acd60 0x555a7e8b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.846+0000 7fe605800700 1 -- 172.21.15.2:0/3063767370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7e8aa520 con 0x555a7e8b8530 2024-06-13T11:28:56.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.846+0000 7fe605800700 1 --2- 172.21.15.2:0/3063767370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8b8530 0x555a7e8a8ac0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80090a0 tx=0x7fe5f80cf0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6551fed8419db4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:56.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.846+0000 7fe5f5600700 1 -- 172.21.15.2:0/3063767370 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f809b4c0 con 0x555a7e8b8530 2024-06-13T11:28:56.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.846+0000 7fe5f5600700 1 -- 172.21.15.2:0/3063767370 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5f809f870 con 0x555a7e8b8530 2024-06-13T11:28:56.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.846+0000 7fe5f5600700 1 -- 172.21.15.2:0/3063767370 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80a3e50 con 0x555a7e8b8530 2024-06-13T11:28:56.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.847+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3063767370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8b8530 msgr2=0x555a7e8a8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:56.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.847+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/3063767370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8b8530 0x555a7e8a8ac0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80090a0 tx=0x7fe5f80cf0c0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.847+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3063767370 shutdown_connections 2024-06-13T11:28:56.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.847+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/3063767370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8b8530 0x555a7e8a8ac0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.847+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/3063767370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8acd60 0x555a7e8b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.847+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/3063767370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8ad680 0x555a7e8b7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.847+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3063767370 >> 172.21.15.2:0/3063767370 conn(0x555a7e7da170 msgr2=0x555a7e8a83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:56.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.847+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3063767370 shutdown_connections 2024-06-13T11:28:56.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.847+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3063767370 wait complete. 2024-06-13T11:28:56.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.848+0000 7fe6120e7b80 1 -- start start 2024-06-13T11:28:56.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.848+0000 7fe6120e7b80 1 Processor -- start 2024-06-13T11:28:56.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.848+0000 7fe6120e7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8acd60 0x555a7e92ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.848+0000 7fe6120e7b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 0x555a7e92f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.848+0000 7fe6120e7b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8b8530 0x555a7e92f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.848+0000 7fe6120e7b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6001aea50 con 0x555a7e8ad680 2024-06-13T11:28:56.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.848+0000 7fe6120e7b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6001afec0 con 0x555a7e8b8530 2024-06-13T11:28:56.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.848+0000 7fe6120e7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe6001af120 con 0x555a7e8acd60 2024-06-13T11:28:56.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.848+0000 7fe6120e7b80 10 client.0 _ll_register_callbacks cb 0x555a7e795380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:28:56.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.849+0000 7fe5f7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 0x555a7e92f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.849+0000 7fe5f7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 0x555a7e92f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58790/0 (socket says 172.21.15.2:58790) 2024-06-13T11:28:56.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.849+0000 7fe5f7e00700 1 -- 172.21.15.2:0/3162521034 learned_addr learned my addr 172.21.15.2:0/3162521034 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:28:56.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.849+0000 7fe604e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8acd60 0x555a7e92ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.849+0000 7fe605800700 1 --2- 172.21.15.2:0/3162521034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8b8530 0x555a7e92f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.849+0000 7fe5f7e00700 1 -- 172.21.15.2:0/3162521034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8acd60 msgr2=0x555a7e92ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:56.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.849+0000 7fe5f7e00700 1 --2- 172.21.15.2:0/3162521034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8acd60 0x555a7e92ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.849+0000 7fe5f7e00700 1 -- 172.21.15.2:0/3162521034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8b8530 msgr2=0x555a7e92f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:28:56.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.849+0000 7fe5f7e00700 1 --2- 172.21.15.2:0/3162521034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8b8530 0x555a7e92f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.849+0000 7fe5f7e00700 1 -- 172.21.15.2:0/3162521034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a7e939f30 con 0x555a7e8ad680 2024-06-13T11:28:56.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.850+0000 7fe5f7e00700 1 --2- 172.21.15.2:0/3162521034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 0x555a7e92f1c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x555a7e8b65f0 tx=0x7fe5e8009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7281a8fb73454c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:28:56.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.850+0000 7fe5eea00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:28:56.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.850+0000 7fe5eea00700 1 -- 172.21.15.2:0/3162521034 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8022070 con 0x555a7e8ad680 2024-06-13T11:28:56.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.850+0000 7fe5eea00700 1 -- 172.21.15.2:0/3162521034 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fe5e8004230 con 0x555a7e8ad680 2024-06-13T11:28:56.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.850+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3162521034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5f809f870 con 0x555a7e8ad680 2024-06-13T11:28:56.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.850+0000 7fe5eea00700 1 -- 172.21.15.2:0/3162521034 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe5e8004430 con 0x555a7e8ad680 2024-06-13T11:28:56.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.850+0000 7fe6120e7b80 10 client.15825 fetch_fsmap learned FSMap version 29 2024-06-13T11:28:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.850+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3162521034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555a7e93b2a0 con 0x555a7e8ad680 2024-06-13T11:28:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.851+0000 7fe5eea00700 1 -- 172.21.15.2:0/3162521034 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5f809f870 con 0x555a7e8ad680 2024-06-13T11:28:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.851+0000 7fe5eea00700 1 -- 172.21.15.2:0/3162521034 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fe5e801f610 con 0x555a7e8ad680 2024-06-13T11:28:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.851+0000 7fe6120e7b80 10 client.15825 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T11:28:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.851+0000 7fe6120e7b80 10 client.15825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:28:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.851+0000 7fe6120e7b80 20 client.15825 populate_metadata read hostname 'smithi002' 2024-06-13T11:28:56.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.851+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/3162521034 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x555a7e93ba90 0x555a7e93deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:28:56.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.851+0000 7fe6120e7b80 4 client.15825 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:28:56.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.851+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3162521034 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555a7e807580 con 0x555a7e93ba90 2024-06-13T11:28:56.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.851+0000 7fe604e00700 1 --2- 172.21.15.2:0/3162521034 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x555a7e93ba90 0x555a7e93deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:28:56.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.852+0000 7fe604e00700 1 --2- 172.21.15.2:0/3162521034 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x555a7e93ba90 0x555a7e93deb0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4192e8f9a1b04e7b server_cookie=fe1e4e44f6d3c5be in_seq=0 out_seq=0 2024-06-13T11:28:56.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.852+0000 7fe5eea00700 10 client.15825 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:28:56.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.852+0000 7fe5eea00700 1 -- 172.21.15.2:0/3162521034 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x555a7e807580 con 0x555a7e93ba90 2024-06-13T11:28:56.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.852+0000 7fe5eea00700 10 client.15825 handle_command_reply: tid=0 2024-06-13T11:28:56.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.852+0000 7fe6120e7b80 1 client.15825 shutdown 2024-06-13T11:28:56.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.852+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3162521034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 msgr2=0x555a7e92f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:56.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.852+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/3162521034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 0x555a7e92f1c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x555a7e8b65f0 tx=0x7fe5e8009fd0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.852+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3162521034 shutdown_connections 2024-06-13T11:28:56.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.852+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/3162521034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555a7e8b8530 0x555a7e92f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.852+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/3162521034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a7e8acd60 0x555a7e92ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.852+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/3162521034 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x555a7e93ba90 0x555a7e93deb0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.853+0000 7fe6120e7b80 1 --2- 172.21.15.2:0/3162521034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555a7e8ad680 0x555a7e92f1c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.853+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3162521034 >> 172.21.15.2:0/3162521034 conn(0x555a7e7da170 msgr2=0x555a7e8c3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.853+0000 7fe5eea00700 0 client.15825 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:28:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.853+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3162521034 shutdown_connections 2024-06-13T11:28:56.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.853+0000 7fe6120e7b80 1 -- 172.21.15.2:0/3162521034 wait complete. 2024-06-13T11:28:56.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.853+0000 7fe6120e7b80 20 client.15825 trim_cache size 0 max 16384 2024-06-13T11:28:56.861 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:28:56.861 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-13T11:28:56.861 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-06-13T11:28:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: "7ae31895-a6d0-4d5f-80d8-43ceb3d810ee": { 2024-06-13T11:28:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-06-13T11:28:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "7ae31895-a6d0-4d5f-80d8-43ceb3d810ee", 2024-06-13T11:28:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-06-13T11:28:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:28:56.862 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:28:56.863 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:28:56.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.854+0000 7fe606200700 1 -- 172.21.15.2:0/2762717848 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe5e40a2d90 msgr2=0x7fe5e40a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:56.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.854+0000 7fe606200700 1 --2- 172.21.15.2:0/2762717848 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe5e40a2d90 0x7fe5e40a5250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009990 tx=0x7fe5f0005960 comp rx=0 tx=0).stop 2024-06-13T11:28:56.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.854+0000 7fe606200700 1 -- 172.21.15.2:0/2762717848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe600107700 msgr2=0x7fe60019f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:28:56.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.854+0000 7fe606200700 1 --2- 172.21.15.2:0/2762717848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe600107700 0x7fe60019f620 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800efc0 tx=0x7fe5f800c3a0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.854+0000 7fe606200700 1 -- 172.21.15.2:0/2762717848 shutdown_connections 2024-06-13T11:28:56.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.854+0000 7fe606200700 1 --2- 172.21.15.2:0/2762717848 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe5e40a2d90 0x7fe5e40a5250 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.854+0000 7fe606200700 1 --2- 172.21.15.2:0/2762717848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe600102620 0x7fe60019ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.854+0000 7fe606200700 1 --2- 172.21.15.2:0/2762717848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe600107700 0x7fe60019f620 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.854+0000 7fe606200700 1 --2- 172.21.15.2:0/2762717848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe600102fd0 0x7fe60019b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:28:56.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.854+0000 7fe606200700 1 -- 172.21.15.2:0/2762717848 >> 172.21.15.2:0/2762717848 conn(0x7fe6000fdf10 msgr2=0x7fe60010e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:28:56.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.854+0000 7fe606200700 1 -- 172.21.15.2:0/2762717848 shutdown_connections 2024-06-13T11:28:56.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:28:56.854+0000 7fe606200700 1 -- 172.21.15.2:0/2762717848 wait complete. 2024-06-13T11:28:57.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:57 smithi002 ceph-mon[32210]: pgmap v158: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:57.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:57 smithi178 ceph-mon[36913]: pgmap v158: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:57.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:57 smithi077 ceph-mon[36410]: pgmap v158: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:28:57.884 INFO:tasks.cephfs.filesystem:scrub status for tag:7ae31895-a6d0-4d5f-80d8-43ceb3d810ee - {'path': '/', 'tag': '7ae31895-a6d0-4d5f-80d8-43ceb3d810ee', 'options': 'recursive,force'} 2024-06-13T11:28:59.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:28:59 smithi002 ceph-mon[32210]: pgmap v159: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:28:59.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:28:59 smithi178 ceph-mon[36913]: pgmap v159: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:28:59.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:28:59 smithi077 ceph-mon[36410]: pgmap v159: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:29:01.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:01 smithi002 ceph-mon[32210]: pgmap v160: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:29:01.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:01 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:29:01.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:01 smithi178 ceph-mon[36913]: pgmap v160: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:29:01.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:01 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:29:01.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:01 smithi077 ceph-mon[36410]: pgmap v160: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:29:01.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:01 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:29:02.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:02 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:29:02.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:02 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:29:02.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:02 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:29:02.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:02 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:29:02.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:02 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:29:02.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:02 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:29:03.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:03 smithi178 ceph-mon[36913]: pgmap v161: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:29:03.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:03 smithi077 ceph-mon[36410]: pgmap v161: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:29:03.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:03 smithi002 ceph-mon[32210]: pgmap v161: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:29:05.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:05 smithi178 ceph-mon[36913]: pgmap v162: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:29:05.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:05 smithi077 ceph-mon[36410]: pgmap v162: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:29:05.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:05 smithi002 ceph-mon[32210]: pgmap v162: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:29:07.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:07 smithi178 ceph-mon[36913]: pgmap v163: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:29:07.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:07 smithi077 ceph-mon[36410]: pgmap v163: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:29:07.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:07 smithi002 ceph-mon[32210]: pgmap v163: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:29:09.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:09 smithi178 ceph-mon[36913]: pgmap v164: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:29:09.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:09 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:29:09.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:09 smithi077 ceph-mon[36410]: pgmap v164: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:29:09.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:09 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:29:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:09 smithi002 ceph-mon[32210]: pgmap v164: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:29:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:09 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:29:11.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:11 smithi178 ceph-mon[36913]: pgmap v165: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:29:11.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:11 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:29:11.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:11 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:29:11.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:11 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:29:11.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:11 smithi077 ceph-mon[36410]: pgmap v165: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:29:11.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:11 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:29:11.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:11 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:29:11.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:11 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:29:11.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:11 smithi002 ceph-mon[32210]: pgmap v165: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:29:11.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:11 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:29:11.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:11 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:29:11.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:11 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:29:13.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:13 smithi178 ceph-mon[36913]: pgmap v166: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:29:13.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:13 smithi077 ceph-mon[36410]: pgmap v166: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:29:13.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:13 smithi002 ceph-mon[32210]: pgmap v166: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:29:15.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:15 smithi178 ceph-mon[36913]: pgmap v167: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:29:15.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:15 smithi077 ceph-mon[36410]: pgmap v167: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:29:15.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:15 smithi002 ceph-mon[32210]: pgmap v167: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:29:17.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:17 smithi077 ceph-mon[36410]: pgmap v168: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:29:17.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:17 smithi077 ceph-mon[36410]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:29:17.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:17 smithi002 ceph-mon[32210]: pgmap v168: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:29:17.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:17 smithi002 ceph-mon[32210]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:29:17.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:17 smithi178 ceph-mon[36913]: pgmap v168: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:29:17.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:17 smithi178 ceph-mon[36913]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:29:19.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:19 smithi077 ceph-mon[36410]: pgmap v169: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:29:19.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:19 smithi002 ceph-mon[32210]: pgmap v169: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:29:19.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:19 smithi178 ceph-mon[36913]: pgmap v169: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:29:21.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:21 smithi077 ceph-mon[36410]: pgmap v170: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:21.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:21 smithi002 ceph-mon[32210]: pgmap v170: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:21.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:21 smithi178 ceph-mon[36913]: pgmap v170: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:22.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:22 smithi077 ceph-mon[36410]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:29:22.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:22 smithi002 ceph-mon[32210]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:29:22.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:22 smithi178 ceph-mon[36913]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T11:29:23.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:23 smithi077 ceph-mon[36410]: pgmap v171: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:23.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:23 smithi002 ceph-mon[32210]: pgmap v171: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:23.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:23 smithi178 ceph-mon[36913]: pgmap v171: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:25.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:25 smithi077 ceph-mon[36410]: pgmap v172: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:25.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:25 smithi002 ceph-mon[32210]: pgmap v172: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:25.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:25 smithi178 ceph-mon[36913]: pgmap v172: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:27.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:27 smithi002 ceph-mon[32210]: pgmap v173: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:27.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:27 smithi077 ceph-mon[36410]: pgmap v173: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:27.885 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:29:27.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:27 smithi178 ceph-mon[36913]: pgmap v173: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:28.372 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:29:29.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:29 smithi077 ceph-mon[36410]: pgmap v174: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:29.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:29 smithi002 ceph-mon[32210]: pgmap v174: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:29.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:29 smithi178 ceph-mon[36913]: pgmap v174: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:30.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.806+0000 7f352c800700 1 -- 172.21.15.2:0/2605942601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f352410a6d0 msgr2=0x7f352410aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:30.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.806+0000 7f352c800700 1 --2- 172.21.15.2:0/2605942601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f352410a6d0 0x7f352410aab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f351c009990 tx=0x7f351c009ca0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.806+0000 7f352c800700 1 -- 172.21.15.2:0/2605942601 shutdown_connections 2024-06-13T11:29:30.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.806+0000 7f352c800700 1 --2- 172.21.15.2:0/2605942601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3524105090 0x7f35241115a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.806+0000 7f352c800700 1 --2- 172.21.15.2:0/2605942601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f352410a6d0 0x7f352410aab0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.806+0000 7f352c800700 1 --2- 172.21.15.2:0/2605942601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35241046d0 0x7f3524104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.806+0000 7f352c800700 1 -- 172.21.15.2:0/2605942601 >> 172.21.15.2:0/2605942601 conn(0x7f35241001c0 msgr2=0x7f35241025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:30.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.807+0000 7f352c800700 1 -- 172.21.15.2:0/2605942601 shutdown_connections 2024-06-13T11:29:30.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.807+0000 7f352c800700 1 -- 172.21.15.2:0/2605942601 wait complete. 2024-06-13T11:29:30.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.808+0000 7f352c800700 1 Processor -- start 2024-06-13T11:29:30.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.808+0000 7f352c800700 1 -- start start 2024-06-13T11:29:30.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.809+0000 7f352c800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35241046d0 0x7f352419ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.809+0000 7f352c800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3524105090 0x7f352419b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.809+0000 7f352c800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f352410a6d0 0x7f352419f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.809+0000 7f352c800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3524114a00 con 0x7f352410a6d0 2024-06-13T11:29:30.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.809+0000 7f352c800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3524114880 con 0x7f35241046d0 2024-06-13T11:29:30.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.809+0000 7f352c800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3524114b80 con 0x7f3524105090 2024-06-13T11:29:30.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.809+0000 7f3529e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35241046d0 0x7f352419ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.809+0000 7f352a800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f352410a6d0 0x7f352419f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.809+0000 7f3529e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35241046d0 0x7f352419ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:59306/0 (socket says 172.21.15.2:59306) 2024-06-13T11:29:30.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.809+0000 7f3529400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3524105090 0x7f352419b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.809+0000 7f3529e00700 1 -- 172.21.15.2:0/2301873572 learned_addr learned my addr 172.21.15.2:0/2301873572 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:30.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.810+0000 7f3529e00700 1 -- 172.21.15.2:0/2301873572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3524105090 msgr2=0x7f352419b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:30.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.810+0000 7f3529e00700 1 --2- 172.21.15.2:0/2301873572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3524105090 0x7f352419b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.810+0000 7f3529e00700 1 -- 172.21.15.2:0/2301873572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f352410a6d0 msgr2=0x7f352419f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:30.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.810+0000 7f3529e00700 1 --2- 172.21.15.2:0/2301873572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f352410a6d0 0x7f352419f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.810+0000 7f3529e00700 1 -- 172.21.15.2:0/2301873572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352419fe50 con 0x7f35241046d0 2024-06-13T11:29:30.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.810+0000 7f352a800700 1 --2- 172.21.15.2:0/2301873572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f352410a6d0 0x7f352419f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:29:30.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.810+0000 7f3529e00700 1 --2- 172.21.15.2:0/2301873572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35241046d0 0x7f352419ae90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f351c000c00 tx=0x7f351c00bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:30.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.810+0000 7f351aa00700 1 -- 172.21.15.2:0/2301873572 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c027070 con 0x7f35241046d0 2024-06-13T11:29:30.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.810+0000 7f352c800700 1 -- 172.21.15.2:0/2301873572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35241a00e0 con 0x7f35241046d0 2024-06-13T11:29:30.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.810+0000 7f351aa00700 1 -- 172.21.15.2:0/2301873572 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f351c003d70 con 0x7f35241046d0 2024-06-13T11:29:30.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.810+0000 7f351aa00700 1 -- 172.21.15.2:0/2301873572 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c00f460 con 0x7f35241046d0 2024-06-13T11:29:30.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.811+0000 7f352c800700 1 -- 172.21.15.2:0/2301873572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35241a79c0 con 0x7f35241046d0 2024-06-13T11:29:30.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.814+0000 7f351aa00700 1 -- 172.21.15.2:0/2301873572 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f351c02a070 con 0x7f35241046d0 2024-06-13T11:29:30.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.816+0000 7f35370b1b80 1 Processor -- start 2024-06-13T11:29:30.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.816+0000 7f35370b1b80 1 -- start start 2024-06-13T11:29:30.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.816+0000 7f35370b1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 0x564d0b32bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.816+0000 7f35370b1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b32c4b0 0x564d0b325d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.816+0000 7f35370b1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b326240 0x564d0b326680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f35370b1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564d0b234a10 con 0x564d0b32bb90 2024-06-13T11:29:30.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f351aa00700 1 --2- 172.21.15.2:0/2301873572 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f35100a2d90 0x7f35100a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f35370b1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564d0b277b00 con 0x564d0b32c4b0 2024-06-13T11:29:30.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f35370b1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x564d0b2328f0 con 0x564d0b326240 2024-06-13T11:29:30.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f351aa00700 1 -- 172.21.15.2:0/2301873572 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f351c0d05f0 con 0x7f35241046d0 2024-06-13T11:29:30.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f352a800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 0x564d0b32bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f3529e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b32c4b0 0x564d0b325d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f352a800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 0x564d0b32bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39866/0 (socket says 172.21.15.2:39866) 2024-06-13T11:29:30.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f352a800700 1 -- 172.21.15.2:0/2347406227 learned_addr learned my addr 172.21.15.2:0/2347406227 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:30.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f3529e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b32c4b0 0x564d0b325d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:59318/0 (socket says 172.21.15.2:59318) 2024-06-13T11:29:30.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f3529400700 1 --2- 172.21.15.2:0/2301873572 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f35100a2d90 0x7f35100a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f352a800700 1 --2- 172.21.15.2:0/2347406227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b326240 0x564d0b326680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f3529e00700 1 -- 172.21.15.2:0/2347406227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b326240 msgr2=0x564d0b326680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:30.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f3529e00700 1 --2- 172.21.15.2:0/2347406227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b326240 0x564d0b326680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f3529e00700 1 -- 172.21.15.2:0/2347406227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 msgr2=0x564d0b32bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:30.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f3529e00700 1 --2- 172.21.15.2:0/2347406227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 0x564d0b32bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.817+0000 7f3529e00700 1 -- 172.21.15.2:0/2347406227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d0b21ff90 con 0x564d0b32c4b0 2024-06-13T11:29:30.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.818+0000 7f3529e00700 1 --2- 172.21.15.2:0/2347406227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b32c4b0 0x564d0b325d00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f351c0cd970 tx=0x7f351c09c1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a1ebd05079df7f4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:30.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.818+0000 7f350f400700 1 -- 172.21.15.2:0/2347406227 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c0a30c0 con 0x564d0b32c4b0 2024-06-13T11:29:30.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.818+0000 7f3529400700 1 --2- 172.21.15.2:0/2301873572 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f35100a2d90 0x7f35100a5250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3524109cd0 tx=0x7f351400b410 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:30.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.818+0000 7f350f400700 1 -- 172.21.15.2:0/2347406227 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f351c09c7d0 con 0x564d0b32c4b0 2024-06-13T11:29:30.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.818+0000 7f350f400700 1 -- 172.21.15.2:0/2347406227 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c0cdbf0 con 0x564d0b32c4b0 2024-06-13T11:29:30.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.819+0000 7f35370b1b80 1 -- 172.21.15.2:0/2347406227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b32c4b0 msgr2=0x564d0b325d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:30.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.819+0000 7f35370b1b80 1 --2- 172.21.15.2:0/2347406227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b32c4b0 0x564d0b325d00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f351c0cd970 tx=0x7f351c09c1b0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.819+0000 7f35370b1b80 1 -- 172.21.15.2:0/2347406227 shutdown_connections 2024-06-13T11:29:30.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.819+0000 7f35370b1b80 1 --2- 172.21.15.2:0/2347406227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 0x564d0b32bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.819+0000 7f35370b1b80 1 --2- 172.21.15.2:0/2347406227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b326240 0x564d0b326680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.819+0000 7f35370b1b80 1 --2- 172.21.15.2:0/2347406227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b32c4b0 0x564d0b325d00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.819+0000 7f35370b1b80 1 -- 172.21.15.2:0/2347406227 >> 172.21.15.2:0/2347406227 conn(0x564d0b252170 msgr2=0x564d0b320ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:30.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.819+0000 7f35370b1b80 1 -- 172.21.15.2:0/2347406227 shutdown_connections 2024-06-13T11:29:30.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.819+0000 7f35370b1b80 1 -- 172.21.15.2:0/2347406227 wait complete. 2024-06-13T11:29:30.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.820+0000 7f35370b1b80 1 -- start start 2024-06-13T11:29:30.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.820+0000 7f35370b1b80 1 Processor -- start 2024-06-13T11:29:30.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.820+0000 7f35370b1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b332230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.821+0000 7f35370b1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 0x564d0b32f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.821+0000 7f35370b1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b32c4b0 0x564d0b32fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.821+0000 7f35370b1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564d0b213f60 con 0x564d0b32bb90 2024-06-13T11:29:30.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.821+0000 7f35370b1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564d0b273ac0 con 0x564d0b326240 2024-06-13T11:29:30.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.821+0000 7f35370b1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x564d0b332c40 con 0x564d0b32c4b0 2024-06-13T11:29:30.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.821+0000 7f35370b1b80 10 client.0 _ll_register_callbacks cb 0x564d0b20d380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:29:30.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.821+0000 7f3529e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b332230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.821+0000 7f3529400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 0x564d0b32f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.821+0000 7f3529e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b332230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:59328/0 (socket says 172.21.15.2:59328) 2024-06-13T11:29:30.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.821+0000 7f3529e00700 1 -- 172.21.15.2:0/1680349666 learned_addr learned my addr 172.21.15.2:0/1680349666 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:30.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.821+0000 7f352a800700 1 --2- 172.21.15.2:0/1680349666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b32c4b0 0x564d0b32fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.821+0000 7f3529e00700 1 -- 172.21.15.2:0/1680349666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b32c4b0 msgr2=0x564d0b32fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:30.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.821+0000 7f3529e00700 1 --2- 172.21.15.2:0/1680349666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b32c4b0 0x564d0b32fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.821+0000 7f3529e00700 1 -- 172.21.15.2:0/1680349666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 msgr2=0x564d0b32f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:30.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.821+0000 7f3529e00700 1 --2- 172.21.15.2:0/1680349666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 0x564d0b32f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.821+0000 7f3529e00700 1 -- 172.21.15.2:0/1680349666 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d0b1c68d0 con 0x564d0b326240 2024-06-13T11:29:30.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.822+0000 7f3529e00700 1 --2- 172.21.15.2:0/1680349666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b332230 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f351c00b2e0 tx=0x7f351c0cd960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bda608764855e57a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:30.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.822+0000 7f3503e00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:29:30.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.822+0000 7f3503e00700 1 -- 172.21.15.2:0/1680349666 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c0094b0 con 0x564d0b326240 2024-06-13T11:29:30.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.822+0000 7f3503e00700 1 -- 172.21.15.2:0/1680349666 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f351c0d01c0 con 0x564d0b326240 2024-06-13T11:29:30.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.822+0000 7f35370b1b80 1 -- 172.21.15.2:0/1680349666 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f351c09c7d0 con 0x564d0b326240 2024-06-13T11:29:30.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.822+0000 7f3503e00700 1 -- 172.21.15.2:0/1680349666 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f351c0d03c0 con 0x564d0b326240 2024-06-13T11:29:30.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.822+0000 7f35370b1b80 10 client.25946 fetch_fsmap learned FSMap version 31 2024-06-13T11:29:30.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.822+0000 7f35370b1b80 1 -- 172.21.15.2:0/1680349666 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564d0b33d360 con 0x564d0b326240 2024-06-13T11:29:30.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.823+0000 7f3503e00700 1 -- 172.21.15.2:0/1680349666 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f351c09c7d0 con 0x564d0b326240 2024-06-13T11:29:30.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.823+0000 7f3503e00700 1 -- 172.21.15.2:0/1680349666 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f351c09bc20 con 0x564d0b326240 2024-06-13T11:29:30.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.823+0000 7f35370b1b80 10 client.25946 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:29:30.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.823+0000 7f35370b1b80 10 client.25946 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:29:30.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.823+0000 7f35370b1b80 20 client.25946 populate_metadata read hostname 'smithi002' 2024-06-13T11:29:30.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.823+0000 7f35370b1b80 1 --2- 172.21.15.2:0/1680349666 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x564d0b33f830 0x564d0b341c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.823+0000 7f35370b1b80 4 client.25946 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:29:30.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.823+0000 7f35370b1b80 1 -- 172.21.15.2:0/1680349666 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d0b285000 con 0x564d0b33f830 2024-06-13T11:29:30.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.824+0000 7f3529400700 1 --2- 172.21.15.2:0/1680349666 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x564d0b33f830 0x564d0b341c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.824+0000 7f3529400700 1 --2- 172.21.15.2:0/1680349666 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x564d0b33f830 0x564d0b341c20 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b18bafb64d4df190 server_cookie=6b8f4c57eb7ed003 in_seq=0 out_seq=0 2024-06-13T11:29:30.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.824+0000 7f3503e00700 10 client.25946 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:29:30.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.825+0000 7f3503e00700 1 -- 172.21.15.2:0/1680349666 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564d0b285000 con 0x564d0b33f830 2024-06-13T11:29:30.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.825+0000 7f3503e00700 10 client.25946 handle_command_reply: tid=0 2024-06-13T11:29:30.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.825+0000 7f35370b1b80 1 client.25946 shutdown 2024-06-13T11:29:30.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.825+0000 7f35370b1b80 1 -- 172.21.15.2:0/1680349666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 msgr2=0x564d0b332230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:30.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.825+0000 7f35370b1b80 1 --2- 172.21.15.2:0/1680349666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b332230 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f351c00b2e0 tx=0x7f351c0cd960 comp rx=0 tx=0).stop 2024-06-13T11:29:30.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.825+0000 7f35370b1b80 1 -- 172.21.15.2:0/1680349666 shutdown_connections 2024-06-13T11:29:30.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.825+0000 7f35370b1b80 1 --2- 172.21.15.2:0/1680349666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b32c4b0 0x564d0b32fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.825+0000 7f35370b1b80 1 --2- 172.21.15.2:0/1680349666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b332230 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.825+0000 7f35370b1b80 1 --2- 172.21.15.2:0/1680349666 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x564d0b33f830 0x564d0b341c20 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.825+0000 7f35370b1b80 1 --2- 172.21.15.2:0/1680349666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 0x564d0b32f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.825+0000 7f35370b1b80 1 -- 172.21.15.2:0/1680349666 >> 172.21.15.2:0/1680349666 conn(0x564d0b252170 msgr2=0x564d0b31a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:30.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.825+0000 7f3503e00700 0 client.25946 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:29:30.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.826+0000 7f35370b1b80 1 -- 172.21.15.2:0/1680349666 shutdown_connections 2024-06-13T11:29:30.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.826+0000 7f35370b1b80 1 -- 172.21.15.2:0/1680349666 wait complete. 2024-06-13T11:29:30.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.826+0000 7f35370b1b80 20 client.25946 trim_cache size 0 max 16384 2024-06-13T11:29:30.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.849+0000 7f35370b1b80 1 Processor -- start 2024-06-13T11:29:30.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.849+0000 7f35370b1b80 1 -- start start 2024-06-13T11:29:30.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.849+0000 7f35370b1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b325d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.849+0000 7f35370b1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 0x564d0b31b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.849+0000 7f35370b1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b32c4b0 0x564d0b32e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.850+0000 7f35370b1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35241b2e60 con 0x564d0b32bb90 2024-06-13T11:29:30.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.850+0000 7f35370b1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f35241b06f0 con 0x564d0b326240 2024-06-13T11:29:30.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.850+0000 7f35370b1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f35241ae540 con 0x564d0b32c4b0 2024-06-13T11:29:30.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.850+0000 7f3529e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b325d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.850+0000 7f3529e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b325d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:59334/0 (socket says 172.21.15.2:59334) 2024-06-13T11:29:30.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.850+0000 7f3529e00700 1 -- 172.21.15.2:0/429007021 learned_addr learned my addr 172.21.15.2:0/429007021 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:30.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.850+0000 7f3529400700 1 --2- 172.21.15.2:0/429007021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 0x564d0b31b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.850+0000 7f352a800700 1 --2- 172.21.15.2:0/429007021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b32c4b0 0x564d0b32e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.850+0000 7f3529e00700 1 -- 172.21.15.2:0/429007021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b32c4b0 msgr2=0x564d0b32e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:30.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.850+0000 7f3529e00700 1 --2- 172.21.15.2:0/429007021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b32c4b0 0x564d0b32e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.850+0000 7f3529e00700 1 -- 172.21.15.2:0/429007021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 msgr2=0x564d0b31b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:30.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.850+0000 7f3529e00700 1 --2- 172.21.15.2:0/429007021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 0x564d0b31b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.851+0000 7f3529e00700 1 -- 172.21.15.2:0/429007021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d0b32db40 con 0x564d0b326240 2024-06-13T11:29:30.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.851+0000 7f3529400700 1 --2- 172.21.15.2:0/429007021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 0x564d0b31b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:29:30.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.851+0000 7f3529e00700 1 --2- 172.21.15.2:0/429007021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b325d00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f351c0098e0 tx=0x7f351c09c1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=744fd5d2798045e6 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:30.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.851+0000 7f350ea00700 1 -- 172.21.15.2:0/429007021 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c080080 con 0x564d0b326240 2024-06-13T11:29:30.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.851+0000 7f350ea00700 1 -- 172.21.15.2:0/429007021 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f351c0a0b80 con 0x564d0b326240 2024-06-13T11:29:30.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.851+0000 7f350ea00700 1 -- 172.21.15.2:0/429007021 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c0a5180 con 0x564d0b326240 2024-06-13T11:29:30.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.852+0000 7f35370b1b80 1 -- 172.21.15.2:0/429007021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 msgr2=0x564d0b325d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:30.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.852+0000 7f35370b1b80 1 --2- 172.21.15.2:0/429007021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b325d00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f351c0098e0 tx=0x7f351c09c1b0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.852+0000 7f35370b1b80 1 -- 172.21.15.2:0/429007021 shutdown_connections 2024-06-13T11:29:30.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.852+0000 7f35370b1b80 1 --2- 172.21.15.2:0/429007021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b32c4b0 0x564d0b32e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.852+0000 7f35370b1b80 1 --2- 172.21.15.2:0/429007021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b325d00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.852+0000 7f35370b1b80 1 --2- 172.21.15.2:0/429007021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32bb90 0x564d0b31b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.852+0000 7f35370b1b80 1 -- 172.21.15.2:0/429007021 >> 172.21.15.2:0/429007021 conn(0x564d0b252170 msgr2=0x564d0b32dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:30.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.852+0000 7f35370b1b80 1 -- 172.21.15.2:0/429007021 shutdown_connections 2024-06-13T11:29:30.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.852+0000 7f35370b1b80 1 -- 172.21.15.2:0/429007021 wait complete. 2024-06-13T11:29:30.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.853+0000 7f35370b1b80 1 -- start start 2024-06-13T11:29:30.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.853+0000 7f35370b1b80 1 Processor -- start 2024-06-13T11:29:30.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.853+0000 7f35370b1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b338460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.853+0000 7f35370b1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b32bb90 0x564d0b346ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.853+0000 7f35370b1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32c4b0 0x564d0b347000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.853+0000 7f35370b1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35241aebb0 con 0x564d0b32c4b0 2024-06-13T11:29:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.853+0000 7f35370b1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f35241b0020 con 0x564d0b326240 2024-06-13T11:29:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.853+0000 7f35370b1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f35241af280 con 0x564d0b32bb90 2024-06-13T11:29:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.854+0000 7f35370b1b80 10 client.0 _ll_register_callbacks cb 0x564d0b20d380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:29:30.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.854+0000 7f3529e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b338460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.854+0000 7f3529e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b338460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:59350/0 (socket says 172.21.15.2:59350) 2024-06-13T11:29:30.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.854+0000 7f352a800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32c4b0 0x564d0b347000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.854+0000 7f3529e00700 1 -- 172.21.15.2:0/3746839887 learned_addr learned my addr 172.21.15.2:0/3746839887 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:30.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.854+0000 7f3529400700 1 --2- 172.21.15.2:0/3746839887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b32bb90 0x564d0b346ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.854+0000 7f3529e00700 1 -- 172.21.15.2:0/3746839887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b32bb90 msgr2=0x564d0b346ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:30.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.854+0000 7f3529e00700 1 --2- 172.21.15.2:0/3746839887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b32bb90 0x564d0b346ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.854+0000 7f3529e00700 1 -- 172.21.15.2:0/3746839887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32c4b0 msgr2=0x564d0b347000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:30.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.854+0000 7f3529e00700 1 --2- 172.21.15.2:0/3746839887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32c4b0 0x564d0b347000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.854+0000 7f3529e00700 1 -- 172.21.15.2:0/3746839887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d0b3476e0 con 0x564d0b326240 2024-06-13T11:29:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.855+0000 7f3529e00700 1 --2- 172.21.15.2:0/3746839887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b338460 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f351c006010 tx=0x7f351c09db50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e785e808f2756d39 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.855+0000 7f3503e00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:29:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.855+0000 7f3503e00700 1 -- 172.21.15.2:0/3746839887 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c080070 con 0x564d0b326240 2024-06-13T11:29:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.855+0000 7f3503e00700 1 -- 172.21.15.2:0/3746839887 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f351c0a4f20 con 0x564d0b326240 2024-06-13T11:29:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.855+0000 7f35370b1b80 1 -- 172.21.15.2:0/3746839887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f351c0a0b80 con 0x564d0b326240 2024-06-13T11:29:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.855+0000 7f3503e00700 1 -- 172.21.15.2:0/3746839887 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f351c0a5140 con 0x564d0b326240 2024-06-13T11:29:30.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.855+0000 7f35370b1b80 10 client.25952 fetch_fsmap learned FSMap version 31 2024-06-13T11:29:30.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.855+0000 7f35370b1b80 1 -- 172.21.15.2:0/3746839887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564d0b3476e0 con 0x564d0b326240 2024-06-13T11:29:30.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.855+0000 7f3503e00700 1 -- 172.21.15.2:0/3746839887 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f351c0a0b80 con 0x564d0b326240 2024-06-13T11:29:30.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.855+0000 7f3503e00700 1 -- 172.21.15.2:0/3746839887 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f351c09b690 con 0x564d0b326240 2024-06-13T11:29:30.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.856+0000 7f35370b1b80 10 client.25952 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:29:30.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.856+0000 7f35370b1b80 10 client.25952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:29:30.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.856+0000 7f35370b1b80 20 client.25952 populate_metadata read hostname 'smithi002' 2024-06-13T11:29:30.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.856+0000 7f35370b1b80 1 --2- 172.21.15.2:0/3746839887 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x564d0b3aa4d0 0x564d0b3ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:30.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.856+0000 7f35370b1b80 4 client.25952 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:29:30.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.856+0000 7f35370b1b80 1 -- 172.21.15.2:0/3746839887 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564d0b27f580 con 0x564d0b3aa4d0 2024-06-13T11:29:30.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.856+0000 7f3529400700 1 --2- 172.21.15.2:0/3746839887 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x564d0b3aa4d0 0x564d0b3ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:30.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.856+0000 7f3529400700 1 --2- 172.21.15.2:0/3746839887 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x564d0b3aa4d0 0x564d0b3ac8f0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54052b25ee9447c4 server_cookie=9bbd8186fe14c38 in_seq=0 out_seq=0 2024-06-13T11:29:30.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.856+0000 7f3503e00700 10 client.25952 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:29:30.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.857+0000 7f3503e00700 1 -- 172.21.15.2:0/3746839887 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564d0b27f580 con 0x564d0b3aa4d0 2024-06-13T11:29:30.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.857+0000 7f3503e00700 10 client.25952 handle_command_reply: tid=0 2024-06-13T11:29:30.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.857+0000 7f35370b1b80 1 client.25952 shutdown 2024-06-13T11:29:30.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.857+0000 7f35370b1b80 1 -- 172.21.15.2:0/3746839887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 msgr2=0x564d0b338460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:30.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.857+0000 7f35370b1b80 1 --2- 172.21.15.2:0/3746839887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b338460 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f351c006010 tx=0x7f351c09db50 comp rx=0 tx=0).stop 2024-06-13T11:29:30.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.857+0000 7f35370b1b80 1 -- 172.21.15.2:0/3746839887 shutdown_connections 2024-06-13T11:29:30.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.857+0000 7f35370b1b80 1 --2- 172.21.15.2:0/3746839887 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x564d0b3aa4d0 0x564d0b3ac8f0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.857+0000 7f35370b1b80 1 --2- 172.21.15.2:0/3746839887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564d0b32c4b0 0x564d0b347000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.857+0000 7f35370b1b80 1 --2- 172.21.15.2:0/3746839887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564d0b326240 0x564d0b338460 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.857+0000 7f3503e00700 0 client.25952 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:29:30.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.857+0000 7f35370b1b80 1 --2- 172.21.15.2:0/3746839887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d0b32bb90 0x564d0b346ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.857+0000 7f35370b1b80 1 -- 172.21.15.2:0/3746839887 >> 172.21.15.2:0/3746839887 conn(0x564d0b252170 msgr2=0x564d0b32a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:30.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.857+0000 7f35370b1b80 1 -- 172.21.15.2:0/3746839887 shutdown_connections 2024-06-13T11:29:30.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.857+0000 7f35370b1b80 1 -- 172.21.15.2:0/3746839887 wait complete. 2024-06-13T11:29:30.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.857+0000 7f35370b1b80 20 client.25952 trim_cache size 0 max 16384 2024-06-13T11:29:30.864 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:29:30.865 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-06-13T11:29:30.865 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-06-13T11:29:30.865 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:29:30.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.858+0000 7f352c800700 1 -- 172.21.15.2:0/2301873572 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f35100a2d90 msgr2=0x7f35100a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:30.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.858+0000 7f352c800700 1 --2- 172.21.15.2:0/2301873572 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f35100a2d90 0x7f35100a5250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3524109cd0 tx=0x7f351400b410 comp rx=0 tx=0).stop 2024-06-13T11:29:30.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.858+0000 7f352c800700 1 -- 172.21.15.2:0/2301873572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35241046d0 msgr2=0x7f352419ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:30.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.858+0000 7f352c800700 1 --2- 172.21.15.2:0/2301873572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35241046d0 0x7f352419ae90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f351c000c00 tx=0x7f351c00bab0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.858+0000 7f352c800700 1 -- 172.21.15.2:0/2301873572 shutdown_connections 2024-06-13T11:29:30.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.858+0000 7f352c800700 1 --2- 172.21.15.2:0/2301873572 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f35100a2d90 0x7f35100a5250 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.858+0000 7f352c800700 1 --2- 172.21.15.2:0/2301873572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f352410a6d0 0x7f352419f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.858+0000 7f352c800700 1 --2- 172.21.15.2:0/2301873572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35241046d0 0x7f352419ae90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.858+0000 7f352c800700 1 --2- 172.21.15.2:0/2301873572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3524105090 0x7f352419b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:30.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.858+0000 7f352c800700 1 -- 172.21.15.2:0/2301873572 >> 172.21.15.2:0/2301873572 conn(0x7f35241001c0 msgr2=0x7f35241007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:30.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.858+0000 7f352c800700 1 -- 172.21.15.2:0/2301873572 shutdown_connections 2024-06-13T11:29:30.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:30.858+0000 7f352c800700 1 -- 172.21.15.2:0/2301873572 wait complete. 2024-06-13T11:29:31.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:31 smithi002 ceph-mon[32210]: pgmap v175: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:31.718 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-13T11:29:31.719 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:29:31.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:31 smithi077 ceph-mon[36410]: pgmap v175: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:31.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:31 smithi178 ceph-mon[36913]: pgmap v175: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:29:33.600 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:33 smithi002 ceph-mon[32210]: pgmap v176: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:33.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:33 smithi077 ceph-mon[36410]: pgmap v176: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:33.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:33 smithi178 ceph-mon[36913]: pgmap v176: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:34.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.535+0000 7fcc94e00700 1 -- 172.21.15.2:0/1940113905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc90103580 msgr2=0x7fcc90103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:34.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.535+0000 7fcc94e00700 1 --2- 172.21.15.2:0/1940113905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc90103580 0x7fcc90103960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009990 tx=0x7fcc80009ca0 comp rx=0 tx=0).stop 2024-06-13T11:29:34.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.536+0000 7fcc94e00700 1 -- 172.21.15.2:0/1940113905 shutdown_connections 2024-06-13T11:29:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.536+0000 7fcc94e00700 1 --2- 172.21.15.2:0/1940113905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9010c9b0 0x7fcc9010ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.536+0000 7fcc94e00700 1 --2- 172.21.15.2:0/1940113905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc90103580 0x7fcc90103960 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.536+0000 7fcc94e00700 1 --2- 172.21.15.2:0/1940113905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc90103ea0 0x7fcc9010c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.536+0000 7fcc94e00700 1 -- 172.21.15.2:0/1940113905 >> 172.21.15.2:0/1940113905 conn(0x7fcc900fcdb0 msgr2=0x7fcc900ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.536+0000 7fcc94e00700 1 -- 172.21.15.2:0/1940113905 shutdown_connections 2024-06-13T11:29:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.536+0000 7fcc94e00700 1 -- 172.21.15.2:0/1940113905 wait complete. 2024-06-13T11:29:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.537+0000 7fcc94e00700 1 Processor -- start 2024-06-13T11:29:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.537+0000 7fcc94e00700 1 -- start start 2024-06-13T11:29:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.538+0000 7fcc94e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc90103580 0x7fcc901011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.538+0000 7fcc94e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc90103ea0 0x7fcc90101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:34.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.538+0000 7fcc94e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9010c9b0 0x7fcc90101c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.538+0000 7fcc94e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcc90112760 con 0x7fcc90103ea0 2024-06-13T11:29:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.538+0000 7fcc94e00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcc901125e0 con 0x7fcc9010c9b0 2024-06-13T11:29:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.538+0000 7fcc94e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcc901128e0 con 0x7fcc90103580 2024-06-13T11:29:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.538+0000 7fcc8f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc90103580 0x7fcc901011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.538+0000 7fcc8f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc90103580 0x7fcc901011e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:35560/0 (socket says 172.21.15.2:35560) 2024-06-13T11:29:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.538+0000 7fcc8f400700 1 -- 172.21.15.2:0/1512074550 learned_addr learned my addr 172.21.15.2:0/1512074550 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.538+0000 7fcc8ea00700 1 --2- 172.21.15.2:0/1512074550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc90103ea0 0x7fcc90101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:34.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.538+0000 7fcc8fe00700 1 --2- 172.21.15.2:0/1512074550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9010c9b0 0x7fcc90101c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.539+0000 7fcc8f400700 1 -- 172.21.15.2:0/1512074550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9010c9b0 msgr2=0x7fcc90101c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.539+0000 7fcc8f400700 1 --2- 172.21.15.2:0/1512074550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9010c9b0 0x7fcc90101c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.539+0000 7fcc8f400700 1 -- 172.21.15.2:0/1512074550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc90103ea0 msgr2=0x7fcc90101720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.539+0000 7fcc8f400700 1 --2- 172.21.15.2:0/1512074550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc90103ea0 0x7fcc90101720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.539+0000 7fcc8f400700 1 -- 172.21.15.2:0/1512074550 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc901a70f0 con 0x7fcc90103580 2024-06-13T11:29:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.539+0000 7fcc8f400700 1 --2- 172.21.15.2:0/1512074550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc90103580 0x7fcc901011e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcc80005910 tx=0x7fcc8000bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.539+0000 7fcc87e00700 1 -- 172.21.15.2:0/1512074550 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc80027070 con 0x7fcc90103580 2024-06-13T11:29:34.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.539+0000 7fcc87e00700 1 -- 172.21.15.2:0/1512074550 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc80003d70 con 0x7fcc90103580 2024-06-13T11:29:34.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.539+0000 7fcc87e00700 1 -- 172.21.15.2:0/1512074550 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8000f460 con 0x7fcc90103580 2024-06-13T11:29:34.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.539+0000 7fcc94e00700 1 -- 172.21.15.2:0/1512074550 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc901a7380 con 0x7fcc90103580 2024-06-13T11:29:34.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.539+0000 7fcc94e00700 1 -- 172.21.15.2:0/1512074550 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc901a78b0 con 0x7fcc90103580 2024-06-13T11:29:34.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.540+0000 7fcc94e00700 1 -- 172.21.15.2:0/1512074550 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc90069180 con 0x7fcc90103580 2024-06-13T11:29:34.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.542+0000 7fcc87e00700 1 -- 172.21.15.2:0/1512074550 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fcc8002a070 con 0x7fcc90103580 2024-06-13T11:29:34.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.544+0000 7fcc87e00700 1 --2- 172.21.15.2:0/1512074550 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fcc740a2e10 0x7fcc740a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:34.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.544+0000 7fcc87e00700 1 -- 172.21.15.2:0/1512074550 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fcc800d0a20 con 0x7fcc90103580 2024-06-13T11:29:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.544+0000 7fcc8ea00700 1 --2- 172.21.15.2:0/1512074550 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fcc740a2e10 0x7fcc740a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:34.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.545+0000 7fcc8ea00700 1 --2- 172.21.15.2:0/1512074550 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fcc740a2e10 0x7fcc740a52d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c009680 tx=0x7fcc7c009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:34.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.546+0000 7fcc87e00700 1 -- 172.21.15.2:0/1512074550 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcc80013070 con 0x7fcc90103580 2024-06-13T11:29:34.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.823+0000 7fcc94e00700 1 -- 172.21.15.2:0/1512074550 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc901026c0 con 0x7fcc90103580 2024-06-13T11:29:34.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.824+0000 7fcc87e00700 1 -- 172.21.15.2:0/1512074550 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11853 (secure 0 0 0) 0x7fcc8009d300 con 0x7fcc90103580 2024-06-13T11:29:34.824 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:29:34.824 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:29:21.309310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24511,24493,24509]},"id":1}]} 2024-06-13T11:29:34.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.828+0000 7fcc94e00700 1 -- 172.21.15.2:0/1512074550 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fcc740a2e10 msgr2=0x7fcc740a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:34.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.828+0000 7fcc94e00700 1 --2- 172.21.15.2:0/1512074550 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fcc740a2e10 0x7fcc740a52d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c009680 tx=0x7fcc7c009260 comp rx=0 tx=0).stop 2024-06-13T11:29:34.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.828+0000 7fcc94e00700 1 -- 172.21.15.2:0/1512074550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc90103580 msgr2=0x7fcc901011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:34.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.828+0000 7fcc94e00700 1 --2- 172.21.15.2:0/1512074550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc90103580 0x7fcc901011e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcc80005910 tx=0x7fcc8000bab0 comp rx=0 tx=0).stop 2024-06-13T11:29:34.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.828+0000 7fcc94e00700 1 -- 172.21.15.2:0/1512074550 shutdown_connections 2024-06-13T11:29:34.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.828+0000 7fcc94e00700 1 --2- 172.21.15.2:0/1512074550 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fcc740a2e10 0x7fcc740a52d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:34.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.828+0000 7fcc94e00700 1 --2- 172.21.15.2:0/1512074550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9010c9b0 0x7fcc90101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:34.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.828+0000 7fcc94e00700 1 --2- 172.21.15.2:0/1512074550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc90103580 0x7fcc901011e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:34.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.828+0000 7fcc94e00700 1 --2- 172.21.15.2:0/1512074550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc90103ea0 0x7fcc90101720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:34.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.828+0000 7fcc94e00700 1 -- 172.21.15.2:0/1512074550 >> 172.21.15.2:0/1512074550 conn(0x7fcc900fcdb0 msgr2=0x7fcc900fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:34.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.828+0000 7fcc94e00700 1 -- 172.21.15.2:0/1512074550 shutdown_connections 2024-06-13T11:29:34.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:34.828+0000 7fcc94e00700 1 -- 172.21.15.2:0/1512074550 wait complete. 2024-06-13T11:29:34.829 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 31 2024-06-13T11:29:35.675 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-13T11:29:35.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:35 smithi002 ceph-mon[32210]: pgmap v177: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:35.765 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:35 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1512074550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:29:35.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:35 smithi077 ceph-mon[36410]: pgmap v177: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:35.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:35 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1512074550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:29:35.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:35 smithi178 ceph-mon[36913]: pgmap v177: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:35.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:35 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1512074550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:29:36.156 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:29:37.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:37 smithi077 ceph-mon[36410]: pgmap v178: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:37.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:37 smithi002 ceph-mon[32210]: pgmap v178: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:37.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:37 smithi178 ceph-mon[36913]: pgmap v178: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:38.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.447+0000 7f8a0d600700 1 -- 172.21.15.2:0/1117591776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a080772e0 msgr2=0x7f8a08112d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:38.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.447+0000 7f8a0d600700 1 --2- 172.21.15.2:0/1117591776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a080772e0 0x7f8a08112d00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009990 tx=0x7f89f4009ca0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.447+0000 7f8a0d600700 1 -- 172.21.15.2:0/1117591776 shutdown_connections 2024-06-13T11:29:38.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.447+0000 7f8a0d600700 1 --2- 172.21.15.2:0/1117591776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a08113240 0x7f8a08115630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.447+0000 7f8a0d600700 1 --2- 172.21.15.2:0/1117591776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a080769c0 0x7f8a08076da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.447+0000 7f8a0d600700 1 --2- 172.21.15.2:0/1117591776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a080772e0 0x7f8a08112d00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.447+0000 7f8a0d600700 1 -- 172.21.15.2:0/1117591776 >> 172.21.15.2:0/1117591776 conn(0x7f8a081000d0 msgr2=0x7f8a081024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:38.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.447+0000 7f8a0d600700 1 -- 172.21.15.2:0/1117591776 shutdown_connections 2024-06-13T11:29:38.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.447+0000 7f8a0d600700 1 -- 172.21.15.2:0/1117591776 wait complete. 2024-06-13T11:29:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.448+0000 7f8a0d600700 1 Processor -- start 2024-06-13T11:29:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.449+0000 7f8a0d600700 1 -- start start 2024-06-13T11:29:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.449+0000 7f8a0d600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a080769c0 0x7f8a0819f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.449+0000 7f8a0d600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a080772e0 0x7f8a0819f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.449+0000 7f8a0d600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a08113240 0x7f8a081a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.449+0000 7f8a0d600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a08118d60 con 0x7f8a080769c0 2024-06-13T11:29:38.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.449+0000 7f8a0d600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a08118be0 con 0x7f8a080772e0 2024-06-13T11:29:38.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.449+0000 7f8a0d600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8a08118ee0 con 0x7f8a08113240 2024-06-13T11:29:38.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.450+0000 7f8a07e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a080769c0 0x7f8a0819f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.450+0000 7f8a07400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a080772e0 0x7f8a0819f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.450+0000 7f8a07400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a080772e0 0x7f8a0819f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:46348/0 (socket says 172.21.15.2:46348) 2024-06-13T11:29:38.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.450+0000 7f8a07400700 1 -- 172.21.15.2:0/2844791319 learned_addr learned my addr 172.21.15.2:0/2844791319 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:38.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.450+0000 7f8a0cc00700 1 --2- 172.21.15.2:0/2844791319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a08113240 0x7f8a081a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.450+0000 7f8a07400700 1 -- 172.21.15.2:0/2844791319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a08113240 msgr2=0x7f8a081a3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:38.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.450+0000 7f8a07400700 1 --2- 172.21.15.2:0/2844791319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a08113240 0x7f8a081a3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.450+0000 7f8a07400700 1 -- 172.21.15.2:0/2844791319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a080769c0 msgr2=0x7f8a0819f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:38.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.450+0000 7f8a07400700 1 --2- 172.21.15.2:0/2844791319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a080769c0 0x7f8a0819f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.450+0000 7f8a07400700 1 -- 172.21.15.2:0/2844791319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a081a4280 con 0x7f8a080772e0 2024-06-13T11:29:38.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.450+0000 7f8a0cc00700 1 --2- 172.21.15.2:0/2844791319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a08113240 0x7f8a081a3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:29:38.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.451+0000 7f8a07400700 1 --2- 172.21.15.2:0/2844791319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a080772e0 0x7f8a0819f7b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f89f4000c00 tx=0x7f89f400bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:38.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.451+0000 7f8a04c00700 1 -- 172.21.15.2:0/2844791319 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4027070 con 0x7f8a080772e0 2024-06-13T11:29:38.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.451+0000 7f8a04c00700 1 -- 172.21.15.2:0/2844791319 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89f4003d70 con 0x7f8a080772e0 2024-06-13T11:29:38.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.451+0000 7f8a0d600700 1 -- 172.21.15.2:0/2844791319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a081a4510 con 0x7f8a080772e0 2024-06-13T11:29:38.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.451+0000 7f8a04c00700 1 -- 172.21.15.2:0/2844791319 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f400f460 con 0x7f8a080772e0 2024-06-13T11:29:38.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.452+0000 7f8a0d600700 1 -- 172.21.15.2:0/2844791319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a081abdf0 con 0x7f8a080772e0 2024-06-13T11:29:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.456+0000 7f8a04c00700 1 -- 172.21.15.2:0/2844791319 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f89f402a070 con 0x7f8a080772e0 2024-06-13T11:29:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.456+0000 7f8a194e6b80 1 Processor -- start 2024-06-13T11:29:38.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.456+0000 7f8a194e6b80 1 -- start start 2024-06-13T11:29:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.457+0000 7f8a194e6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be19e40 0x55a46be9f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.457+0000 7f8a194e6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46be9f960 0x55a46be9fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.457+0000 7f8a194e6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46bea8570 0x55a46beaa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.457+0000 7f8a194e6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a46bdaca10 con 0x55a46bea8570 2024-06-13T11:29:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.457+0000 7f8a194e6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a46bdefb00 con 0x55a46be9f960 2024-06-13T11:29:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.457+0000 7f8a194e6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a46bdaa8f0 con 0x55a46be19e40 2024-06-13T11:29:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.457+0000 7f8a0cc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be19e40 0x55a46be9f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.457+0000 7f8a0cc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be19e40 0x55a46be9f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55060/0 (socket says 172.21.15.2:55060) 2024-06-13T11:29:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.457+0000 7f8a0cc00700 1 -- 172.21.15.2:0/53410162 learned_addr learned my addr 172.21.15.2:0/53410162 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.457+0000 7f8a07e00700 1 --2- 172.21.15.2:0/53410162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46be9f960 0x55a46be9fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.458+0000 7f8a07400700 1 --2- 172.21.15.2:0/53410162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46bea8570 0x55a46beaa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.458+0000 7f8a0cc00700 1 -- 172.21.15.2:0/53410162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46be9f960 msgr2=0x55a46be9fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:38.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.458+0000 7f8a0cc00700 1 --2- 172.21.15.2:0/53410162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46be9f960 0x55a46be9fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.458+0000 7f8a0cc00700 1 -- 172.21.15.2:0/53410162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46bea8570 msgr2=0x55a46beaa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:38.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.458+0000 7f8a0cc00700 1 --2- 172.21.15.2:0/53410162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46bea8570 0x55a46beaa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.458+0000 7f8a0cc00700 1 -- 172.21.15.2:0/53410162 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a46bd97f90 con 0x55a46be19e40 2024-06-13T11:29:38.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.458+0000 7f8a04c00700 1 --2- 172.21.15.2:0/2844791319 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f89ec0a2e90 0x7f89ec0a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.458+0000 7f8a0cc00700 1 --2- 172.21.15.2:0/53410162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be19e40 0x55a46be9f420 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009470 tx=0x7f8a00009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=148ee88f9250feb8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:38.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.458+0000 7f8a04c00700 1 -- 172.21.15.2:0/2844791319 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f89f40d0620 con 0x7f8a080772e0 2024-06-13T11:29:38.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.458+0000 7f8a07e00700 1 --2- 172.21.15.2:0/2844791319 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f89ec0a2e90 0x7f89ec0a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.459+0000 7f89fd600700 1 -- 172.21.15.2:0/53410162 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a00019070 con 0x55a46be19e40 2024-06-13T11:29:38.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.459+0000 7f89fd600700 1 -- 172.21.15.2:0/53410162 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a0000ebd0 con 0x55a46be19e40 2024-06-13T11:29:38.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.459+0000 7f89fd600700 1 -- 172.21.15.2:0/53410162 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a00015d10 con 0x55a46be19e40 2024-06-13T11:29:38.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.459+0000 7f8a07e00700 1 --2- 172.21.15.2:0/2844791319 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f89ec0a2e90 0x7f89ec0a5350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55a46be9a590 tx=0x7f89f8009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:38.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.459+0000 7f8a194e6b80 1 -- 172.21.15.2:0/53410162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be19e40 msgr2=0x55a46be9f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:38.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.459+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/53410162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be19e40 0x55a46be9f420 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009470 tx=0x7f8a00009920 comp rx=0 tx=0).stop 2024-06-13T11:29:38.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.460+0000 7f8a194e6b80 1 -- 172.21.15.2:0/53410162 shutdown_connections 2024-06-13T11:29:38.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.460+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/53410162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46bea8570 0x55a46beaa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.460+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/53410162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be19e40 0x55a46be9f420 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.460+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/53410162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46be9f960 0x55a46be9fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.460+0000 7f8a194e6b80 1 -- 172.21.15.2:0/53410162 >> 172.21.15.2:0/53410162 conn(0x55a46bdca170 msgr2=0x55a46be99820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:38.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.460+0000 7f8a194e6b80 1 -- 172.21.15.2:0/53410162 shutdown_connections 2024-06-13T11:29:38.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.460+0000 7f8a194e6b80 1 -- 172.21.15.2:0/53410162 wait complete. 2024-06-13T11:29:38.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.460+0000 7f8a194e6b80 1 -- start start 2024-06-13T11:29:38.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.461+0000 7f8a194e6b80 1 Processor -- start 2024-06-13T11:29:38.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.461+0000 7f8a194e6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46be19e40 0x55a46bea7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.461+0000 7f8a194e6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be9f960 0x55a46bea5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.461+0000 7f8a194e6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46bea8570 0x55a46bea55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.461+0000 7f8a194e6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a46bd8bf60 con 0x55a46be19e40 2024-06-13T11:29:38.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.461+0000 7f8a194e6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a46bdebac0 con 0x55a46bea8570 2024-06-13T11:29:38.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.461+0000 7f8a194e6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a46beab180 con 0x55a46be9f960 2024-06-13T11:29:38.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.461+0000 7f8a194e6b80 10 client.0 _ll_register_callbacks cb 0x55a46bd89720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:29:38.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.462+0000 7f8a07e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46be19e40 0x55a46bea7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.462+0000 7f8a07e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46be19e40 0x55a46bea7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60624/0 (socket says 172.21.15.2:60624) 2024-06-13T11:29:38.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.462+0000 7f8a07e00700 1 -- 172.21.15.2:0/1907979756 learned_addr learned my addr 172.21.15.2:0/1907979756 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:38.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.462+0000 7f8a07400700 1 --2- 172.21.15.2:0/1907979756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be9f960 0x55a46bea5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.462+0000 7f8a0cc00700 1 --2- 172.21.15.2:0/1907979756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46bea8570 0x55a46bea55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.462+0000 7f8a07400700 1 -- 172.21.15.2:0/1907979756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46bea8570 msgr2=0x55a46bea55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:38.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.462+0000 7f8a07400700 1 --2- 172.21.15.2:0/1907979756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46bea8570 0x55a46bea55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.462+0000 7f8a07400700 1 -- 172.21.15.2:0/1907979756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46be19e40 msgr2=0x55a46bea7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:38.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.462+0000 7f8a07400700 1 --2- 172.21.15.2:0/1907979756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46be19e40 0x55a46bea7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.462+0000 7f8a07400700 1 -- 172.21.15.2:0/1907979756 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a46bd3e8d0 con 0x55a46be9f960 2024-06-13T11:29:38.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.462+0000 7f8a07400700 1 --2- 172.21.15.2:0/1907979756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be9f960 0x55a46bea5090 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f89f40cd9a0 tx=0x7f89f4005c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cccfe1e694b3a2b4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:38.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.462+0000 7f89f2000700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:29:38.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.463+0000 7f89f2000700 1 -- 172.21.15.2:0/1907979756 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4098aa0 con 0x55a46be9f960 2024-06-13T11:29:38.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.463+0000 7f89f2000700 1 -- 172.21.15.2:0/1907979756 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f89f40d01f0 con 0x55a46be9f960 2024-06-13T11:29:38.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.463+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1907979756 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a0000ebd0 con 0x55a46be9f960 2024-06-13T11:29:38.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.463+0000 7f89f2000700 1 -- 172.21.15.2:0/1907979756 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f89f409c160 con 0x55a46be9f960 2024-06-13T11:29:38.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.463+0000 7f8a194e6b80 10 client.26005 fetch_fsmap learned FSMap version 31 2024-06-13T11:29:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.463+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1907979756 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a46beb5950 con 0x55a46be9f960 2024-06-13T11:29:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.463+0000 7f89f2000700 1 -- 172.21.15.2:0/1907979756 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a0000ebd0 con 0x55a46be9f960 2024-06-13T11:29:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.463+0000 7f89f2000700 1 -- 172.21.15.2:0/1907979756 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f89f409ca60 con 0x55a46be9f960 2024-06-13T11:29:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.463+0000 7f8a194e6b80 10 client.26005 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:29:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.464+0000 7f8a194e6b80 10 client.26005 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:29:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.464+0000 7f8a194e6b80 20 client.26005 populate_metadata read hostname 'smithi002' 2024-06-13T11:29:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.464+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/1907979756 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55a46beb7e20 0x55a46beba250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.464+0000 7f8a194e6b80 4 client.26005 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:29:38.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.464+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1907979756 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a46bdfd000 con 0x55a46beb7e20 2024-06-13T11:29:38.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.464+0000 7f8a07e00700 1 --2- 172.21.15.2:0/1907979756 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55a46beb7e20 0x55a46beba250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.465+0000 7f8a07e00700 1 --2- 172.21.15.2:0/1907979756 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55a46beb7e20 0x55a46beba250 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dd3dfcddac54259a server_cookie=a621c9efd01ca554 in_seq=0 out_seq=0 2024-06-13T11:29:38.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.465+0000 7f89f2000700 10 client.26005 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:29:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.466+0000 7f89f2000700 1 -- 172.21.15.2:0/1907979756 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a46bdfd000 con 0x55a46beb7e20 2024-06-13T11:29:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.466+0000 7f89f2000700 10 client.26005 handle_command_reply: tid=0 2024-06-13T11:29:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.466+0000 7f8a194e6b80 1 client.26005 shutdown 2024-06-13T11:29:38.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.466+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1907979756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be9f960 msgr2=0x55a46bea5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.466+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/1907979756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be9f960 0x55a46bea5090 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f89f40cd9a0 tx=0x7f89f4005c70 comp rx=0 tx=0).stop 2024-06-13T11:29:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.466+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1907979756 shutdown_connections 2024-06-13T11:29:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.466+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/1907979756 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55a46beb7e20 0x55a46beba250 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.466+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/1907979756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46be19e40 0x55a46bea7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.466+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/1907979756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46bea8570 0x55a46bea55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.466+0000 7f89f2000700 0 client.26005 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:29:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.466+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/1907979756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be9f960 0x55a46bea5090 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.466+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1907979756 >> 172.21.15.2:0/1907979756 conn(0x55a46bdca170 msgr2=0x55a46be99410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:38.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.466+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1907979756 shutdown_connections 2024-06-13T11:29:38.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.466+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1907979756 wait complete. 2024-06-13T11:29:38.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.467+0000 7f8a194e6b80 20 client.26005 trim_cache size 0 max 16384 2024-06-13T11:29:38.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.483+0000 7f8a194e6b80 1 Processor -- start 2024-06-13T11:29:38.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.483+0000 7f8a194e6b80 1 -- start start 2024-06-13T11:29:38.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.484+0000 7f8a194e6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be19e40 0x55a46bea4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.484+0000 7f8a194e6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46be9f960 0x55a46bea5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.484+0000 7f8a194e6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46bea8570 0x55a46bea5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.484+0000 7f8a194e6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a081b7110 con 0x55a46bea8570 2024-06-13T11:29:38.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.484+0000 7f8a194e6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a081b49a0 con 0x55a46be9f960 2024-06-13T11:29:38.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.484+0000 7f8a194e6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8a081b27f0 con 0x55a46be19e40 2024-06-13T11:29:38.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.484+0000 7f8a0cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46bea8570 0x55a46bea5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.484+0000 7f8a0cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46bea8570 0x55a46bea5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60630/0 (socket says 172.21.15.2:60630) 2024-06-13T11:29:38.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.484+0000 7f8a0cc00700 1 -- 172.21.15.2:0/1113203042 learned_addr learned my addr 172.21.15.2:0/1113203042 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:38.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.484+0000 7f8a07e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be19e40 0x55a46bea4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.484+0000 7f8a07400700 1 --2- 172.21.15.2:0/1113203042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46be9f960 0x55a46bea5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.485+0000 7f8a07e00700 1 -- 172.21.15.2:0/1113203042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46be9f960 msgr2=0x55a46bea5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:38.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.485+0000 7f8a07e00700 1 --2- 172.21.15.2:0/1113203042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46be9f960 0x55a46bea5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.485+0000 7f8a07e00700 1 -- 172.21.15.2:0/1113203042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46bea8570 msgr2=0x55a46bea5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:38.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.485+0000 7f8a07e00700 1 --2- 172.21.15.2:0/1113203042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46bea8570 0x55a46bea5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.485+0000 7f8a07e00700 1 -- 172.21.15.2:0/1113203042 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a46be97eb0 con 0x55a46be19e40 2024-06-13T11:29:38.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.485+0000 7f8a07e00700 1 --2- 172.21.15.2:0/1113203042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be19e40 0x55a46bea4940 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55a46bea5c70 tx=0x7f89f801b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=538a47b668ac7a8b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:38.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.485+0000 7f89fcc00700 1 -- 172.21.15.2:0/1113203042 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8003a60 con 0x55a46be19e40 2024-06-13T11:29:38.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.485+0000 7f89fcc00700 1 -- 172.21.15.2:0/1113203042 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89f8004d10 con 0x55a46be19e40 2024-06-13T11:29:38.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.485+0000 7f89fcc00700 1 -- 172.21.15.2:0/1113203042 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f802a420 con 0x55a46be19e40 2024-06-13T11:29:38.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.486+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1113203042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be19e40 msgr2=0x55a46bea4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:38.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.486+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/1113203042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be19e40 0x55a46bea4940 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55a46bea5c70 tx=0x7f89f801b000 comp rx=0 tx=0).stop 2024-06-13T11:29:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.486+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1113203042 shutdown_connections 2024-06-13T11:29:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.486+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/1113203042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46bea8570 0x55a46bea5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.486+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/1113203042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be19e40 0x55a46bea4940 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.486+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/1113203042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46be9f960 0x55a46bea5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.486+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1113203042 >> 172.21.15.2:0/1113203042 conn(0x55a46bdca170 msgr2=0x55a46be992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.486+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1113203042 shutdown_connections 2024-06-13T11:29:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.486+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1113203042 wait complete. 2024-06-13T11:29:38.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.487+0000 7f8a194e6b80 1 -- start start 2024-06-13T11:29:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.487+0000 7f8a194e6b80 1 Processor -- start 2024-06-13T11:29:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.487+0000 7f8a194e6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46be19e40 0x55a46beab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.487+0000 7f8a194e6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be9f960 0x55a46beabb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.487+0000 7f8a194e6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46bea8570 0x55a46bf20b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.488+0000 7f8a194e6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a081b2e60 con 0x55a46bea8570 2024-06-13T11:29:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.488+0000 7f8a194e6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a081b42d0 con 0x55a46be19e40 2024-06-13T11:29:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.488+0000 7f8a194e6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8a081b3530 con 0x55a46be9f960 2024-06-13T11:29:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.488+0000 7f8a194e6b80 10 client.0 _ll_register_callbacks cb 0x55a46bd89720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:29:38.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.488+0000 7f8a07e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46be19e40 0x55a46beab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.488+0000 7f8a07e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46be19e40 0x55a46beab5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:46376/0 (socket says 172.21.15.2:46376) 2024-06-13T11:29:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.488+0000 7f8a07e00700 1 -- 172.21.15.2:0/1471604356 learned_addr learned my addr 172.21.15.2:0/1471604356 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.488+0000 7f8a0cc00700 1 --2- 172.21.15.2:0/1471604356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46bea8570 0x55a46bf20b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.488+0000 7f8a07400700 1 --2- 172.21.15.2:0/1471604356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be9f960 0x55a46beabb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.488+0000 7f8a07400700 1 -- 172.21.15.2:0/1471604356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46be19e40 msgr2=0x55a46beab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.488+0000 7f8a07400700 1 --2- 172.21.15.2:0/1471604356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46be19e40 0x55a46beab5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.488+0000 7f8a07400700 1 -- 172.21.15.2:0/1471604356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46bea8570 msgr2=0x55a46bf20b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.488+0000 7f8a07400700 1 --2- 172.21.15.2:0/1471604356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46bea8570 0x55a46bf20b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.488+0000 7f8a07400700 1 -- 172.21.15.2:0/1471604356 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a46bf21070 con 0x55a46be9f960 2024-06-13T11:29:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.489+0000 7f8a07400700 1 --2- 172.21.15.2:0/1471604356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be9f960 0x55a46beabb30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f89f409c500 tx=0x7f89f40d04a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f8da7331b821168 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.489+0000 7f89f2000700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:29:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.489+0000 7f89f2000700 1 -- 172.21.15.2:0/1471604356 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f409c340 con 0x55a46be9f960 2024-06-13T11:29:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.489+0000 7f89f2000700 1 -- 172.21.15.2:0/1471604356 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f89f409db30 con 0x55a46be9f960 2024-06-13T11:29:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.489+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1471604356 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89f8004d10 con 0x55a46be9f960 2024-06-13T11:29:38.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.489+0000 7f89f2000700 1 -- 172.21.15.2:0/1471604356 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f89f409c5d0 con 0x55a46be9f960 2024-06-13T11:29:38.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.489+0000 7f8a194e6b80 10 client.26011 fetch_fsmap learned FSMap version 31 2024-06-13T11:29:38.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.489+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1471604356 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a46bf22260 con 0x55a46be9f960 2024-06-13T11:29:38.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.489+0000 7f89f2000700 1 -- 172.21.15.2:0/1471604356 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89f8004d10 con 0x55a46be9f960 2024-06-13T11:29:38.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.490+0000 7f89f2000700 1 -- 172.21.15.2:0/1471604356 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f89f409bc50 con 0x55a46be9f960 2024-06-13T11:29:38.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.490+0000 7f8a194e6b80 10 client.26011 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:29:38.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.490+0000 7f8a194e6b80 10 client.26011 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:29:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.490+0000 7f8a194e6b80 20 client.26011 populate_metadata read hostname 'smithi002' 2024-06-13T11:29:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.490+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/1471604356 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55a46bf22830 0x55a46bf24c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.490+0000 7f8a194e6b80 4 client.26011 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:29:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.490+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1471604356 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a46bdf7580 con 0x55a46bf22830 2024-06-13T11:29:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.490+0000 7f8a07e00700 1 --2- 172.21.15.2:0/1471604356 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55a46bf22830 0x55a46bf24c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.491+0000 7f8a07e00700 1 --2- 172.21.15.2:0/1471604356 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55a46bf22830 0x55a46bf24c50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f3b8de128d1774fb server_cookie=f0ec057d6b0c980a in_seq=0 out_seq=0 2024-06-13T11:29:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.491+0000 7f89f2000700 10 client.26011 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:29:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.491+0000 7f89f2000700 1 -- 172.21.15.2:0/1471604356 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a46bdf7580 con 0x55a46bf22830 2024-06-13T11:29:38.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.491+0000 7f89f2000700 10 client.26011 handle_command_reply: tid=0 2024-06-13T11:29:38.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.491+0000 7f8a194e6b80 1 client.26011 shutdown 2024-06-13T11:29:38.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.491+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1471604356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be9f960 msgr2=0x55a46beabb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:38.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.491+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/1471604356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be9f960 0x55a46beabb30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f89f409c500 tx=0x7f89f40d04a0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.491+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1471604356 shutdown_connections 2024-06-13T11:29:38.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.491+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/1471604356 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55a46bf22830 0x55a46bf24c50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.491+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/1471604356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a46bea8570 0x55a46bf20b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.491+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/1471604356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a46be19e40 0x55a46beab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.491+0000 7f8a194e6b80 1 --2- 172.21.15.2:0/1471604356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a46be9f960 0x55a46beabb30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.491+0000 7f89f2000700 0 client.26011 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:29:38.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.491+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1471604356 >> 172.21.15.2:0/1471604356 conn(0x55a46bdca170 msgr2=0x55a46be99200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:38.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.491+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1471604356 shutdown_connections 2024-06-13T11:29:38.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.491+0000 7f8a194e6b80 1 -- 172.21.15.2:0/1471604356 wait complete. 2024-06-13T11:29:38.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.492+0000 7f8a194e6b80 20 client.26011 trim_cache size 0 max 16384 2024-06-13T11:29:38.497 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:29:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.492+0000 7f8a0d600700 1 -- 172.21.15.2:0/2844791319 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f89ec0a2e90 msgr2=0x7f89ec0a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.492+0000 7f8a0d600700 1 --2- 172.21.15.2:0/2844791319 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f89ec0a2e90 0x7f89ec0a5350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55a46be9a590 tx=0x7f89f8009260 comp rx=0 tx=0).stop 2024-06-13T11:29:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.492+0000 7f8a0d600700 1 -- 172.21.15.2:0/2844791319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a080772e0 msgr2=0x7f8a0819f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.492+0000 7f8a0d600700 1 --2- 172.21.15.2:0/2844791319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a080772e0 0x7f8a0819f7b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f89f4000c00 tx=0x7f89f400bab0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.492+0000 7f8a0d600700 1 -- 172.21.15.2:0/2844791319 shutdown_connections 2024-06-13T11:29:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.492+0000 7f8a0d600700 1 --2- 172.21.15.2:0/2844791319 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f89ec0a2e90 0x7f89ec0a5350 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.492+0000 7f8a0d600700 1 --2- 172.21.15.2:0/2844791319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a080769c0 0x7f8a0819f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.492+0000 7f8a0d600700 1 --2- 172.21.15.2:0/2844791319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a08113240 0x7f8a081a3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.492+0000 7f8a0d600700 1 --2- 172.21.15.2:0/2844791319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a080772e0 0x7f8a0819f7b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:38.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.492+0000 7f8a0d600700 1 -- 172.21.15.2:0/2844791319 >> 172.21.15.2:0/2844791319 conn(0x7f8a081000d0 msgr2=0x7f8a081024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:38.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.493+0000 7f8a0d600700 1 -- 172.21.15.2:0/2844791319 shutdown_connections 2024-06-13T11:29:38.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:38.493+0000 7f8a0d600700 1 -- 172.21.15.2:0/2844791319 wait complete. 2024-06-13T11:29:39.592 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-13T11:29:39.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:39 smithi077 ceph-mon[36410]: pgmap v179: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:39.894 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:39 smithi002 ceph-mon[32210]: pgmap v179: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:39.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:39 smithi178 ceph-mon[36913]: pgmap v179: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:40.093 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:29:41.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:41 smithi077 ceph-mon[36410]: pgmap v180: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:41.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:41 smithi002 ceph-mon[32210]: pgmap v180: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:41.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:41 smithi178 ceph-mon[36913]: pgmap v180: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:42.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.488+0000 7f586ec00700 1 -- 172.21.15.2:0/981921184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5868105070 msgr2=0x7f5868111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:42.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.488+0000 7f586ec00700 1 --2- 172.21.15.2:0/981921184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5868105070 0x7f5868111580 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5860009f90 tx=0x7f586000b330 comp rx=0 tx=0).stop 2024-06-13T11:29:42.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.488+0000 7f586ec00700 1 -- 172.21.15.2:0/981921184 shutdown_connections 2024-06-13T11:29:42.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.488+0000 7f586ec00700 1 --2- 172.21.15.2:0/981921184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5868105070 0x7f5868111580 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.488+0000 7f586ec00700 1 --2- 172.21.15.2:0/981921184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f586810a6b0 0x7f586810aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.488+0000 7f586ec00700 1 --2- 172.21.15.2:0/981921184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58681046b0 0x7f5868104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.488+0000 7f586ec00700 1 -- 172.21.15.2:0/981921184 >> 172.21.15.2:0/981921184 conn(0x7f58681001a0 msgr2=0x7f58681025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:42.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.489+0000 7f586ec00700 1 -- 172.21.15.2:0/981921184 shutdown_connections 2024-06-13T11:29:42.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.489+0000 7f586ec00700 1 -- 172.21.15.2:0/981921184 wait complete. 2024-06-13T11:29:42.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.490+0000 7f586ec00700 1 Processor -- start 2024-06-13T11:29:42.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.490+0000 7f586ec00700 1 -- start start 2024-06-13T11:29:42.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.490+0000 7f586ec00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58681046b0 0x7f586819adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.490+0000 7f586ec00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5868105070 0x7f586819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.490+0000 7f586ec00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f586810a6b0 0x7f586819f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.490+0000 7f586ec00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5868114a40 con 0x7f5868105070 2024-06-13T11:29:42.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.490+0000 7f586ec00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f58681148c0 con 0x7f58681046b0 2024-06-13T11:29:42.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.490+0000 7f586ec00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5868114bc0 con 0x7f586810a6b0 2024-06-13T11:29:42.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.491+0000 7f5867400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5868105070 0x7f586819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.491+0000 7f5867e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58681046b0 0x7f586819adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.491+0000 7f5867e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58681046b0 0x7f586819adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:46402/0 (socket says 172.21.15.2:46402) 2024-06-13T11:29:42.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.491+0000 7f5867e00700 1 -- 172.21.15.2:0/2828689633 learned_addr learned my addr 172.21.15.2:0/2828689633 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:42.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.491+0000 7f586cc00700 1 --2- 172.21.15.2:0/2828689633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f586810a6b0 0x7f586819f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.491+0000 7f5867e00700 1 -- 172.21.15.2:0/2828689633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f586810a6b0 msgr2=0x7f586819f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:42.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.491+0000 7f5867e00700 1 --2- 172.21.15.2:0/2828689633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f586810a6b0 0x7f586819f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.491+0000 7f5867e00700 1 -- 172.21.15.2:0/2828689633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5868105070 msgr2=0x7f586819b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:42.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.491+0000 7f5867e00700 1 --2- 172.21.15.2:0/2828689633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5868105070 0x7f586819b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.491+0000 7f5867e00700 1 -- 172.21.15.2:0/2828689633 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586819fdc0 con 0x7f58681046b0 2024-06-13T11:29:42.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.492+0000 7f5867e00700 1 --2- 172.21.15.2:0/2828689633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58681046b0 0x7f586819adb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f585800e9a0 tx=0x7f585800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:42.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.492+0000 7f5864c00700 1 -- 172.21.15.2:0/2828689633 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585800cbd0 con 0x7f58681046b0 2024-06-13T11:29:42.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.492+0000 7f5864c00700 1 -- 172.21.15.2:0/2828689633 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f585800cd70 con 0x7f58681046b0 2024-06-13T11:29:42.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.492+0000 7f5864c00700 1 -- 172.21.15.2:0/2828689633 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858018710 con 0x7f58681046b0 2024-06-13T11:29:42.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.492+0000 7f586ec00700 1 -- 172.21.15.2:0/2828689633 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58681a00b0 con 0x7f58681046b0 2024-06-13T11:29:42.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.492+0000 7f586ec00700 1 -- 172.21.15.2:0/2828689633 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58681a7930 con 0x7f58681046b0 2024-06-13T11:29:42.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.495+0000 7f5864c00700 1 -- 172.21.15.2:0/2828689633 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f5858010430 con 0x7f58681046b0 2024-06-13T11:29:42.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.497+0000 7f58794afb80 1 Processor -- start 2024-06-13T11:29:42.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.497+0000 7f5864c00700 1 --2- 172.21.15.2:0/2828689633 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f584c0a2e10 0x7f584c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.497+0000 7f58794afb80 1 -- start start 2024-06-13T11:29:42.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.497+0000 7f5864c00700 1 -- 172.21.15.2:0/2828689633 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f58580cfa10 con 0x7f58681046b0 2024-06-13T11:29:42.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.497+0000 7f586cc00700 1 --2- 172.21.15.2:0/2828689633 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f584c0a2e10 0x7f584c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.497+0000 7f58794afb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79ccb90 0x55cde79ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.497+0000 7f58794afb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.497+0000 7f58794afb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 0x55cde79c7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.497+0000 7f58794afb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cde78d5a10 con 0x55cde79c7240 2024-06-13T11:29:42.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.497+0000 7f58794afb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cde7918b00 con 0x55cde79cd4b0 2024-06-13T11:29:42.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.497+0000 7f58794afb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55cde78d38f0 con 0x55cde79ccb90 2024-06-13T11:29:42.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.498+0000 7f5867400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.498+0000 7f5867e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79ccb90 0x55cde79ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.498+0000 7f5867400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:46416/0 (socket says 172.21.15.2:46416) 2024-06-13T11:29:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.498+0000 7f5867400700 1 -- 172.21.15.2:0/4184322777 learned_addr learned my addr 172.21.15.2:0/4184322777 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.498+0000 7f5867e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79ccb90 0x55cde79ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55114/0 (socket says 172.21.15.2:55114) 2024-06-13T11:29:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.498+0000 7f586cc00700 1 --2- 172.21.15.2:0/4184322777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 0x55cde79c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.498+0000 7f5867400700 1 -- 172.21.15.2:0/4184322777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79ccb90 msgr2=0x55cde79ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.498+0000 7f5867400700 1 --2- 172.21.15.2:0/4184322777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79ccb90 0x55cde79ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.498+0000 7f5867400700 1 -- 172.21.15.2:0/4184322777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 msgr2=0x55cde79c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.498+0000 7f5867400700 1 --2- 172.21.15.2:0/4184322777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 0x55cde79c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.498+0000 7f5867400700 1 -- 172.21.15.2:0/4184322777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cde78c0f90 con 0x55cde79cd4b0 2024-06-13T11:29:42.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.499+0000 7f586cc00700 1 --2- 172.21.15.2:0/2828689633 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f584c0a2e10 0x7f584c0a52d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f586000b6c0 tx=0x7f5860009d00 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:42.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.499+0000 7f5867400700 1 --2- 172.21.15.2:0/4184322777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79c6d00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5854009d30 tx=0x7f5854011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39bf513a17dee74c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:42.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.499+0000 7f585d600700 1 -- 172.21.15.2:0/4184322777 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5854004250 con 0x55cde79cd4b0 2024-06-13T11:29:42.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.499+0000 7f585d600700 1 -- 172.21.15.2:0/4184322777 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5854004d10 con 0x55cde79cd4b0 2024-06-13T11:29:42.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.499+0000 7f585d600700 1 -- 172.21.15.2:0/4184322777 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5854003680 con 0x55cde79cd4b0 2024-06-13T11:29:42.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.500+0000 7f58794afb80 1 -- 172.21.15.2:0/4184322777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 msgr2=0x55cde79c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:42.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.500+0000 7f58794afb80 1 --2- 172.21.15.2:0/4184322777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79c6d00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5854009d30 tx=0x7f5854011720 comp rx=0 tx=0).stop 2024-06-13T11:29:42.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.500+0000 7f58794afb80 1 -- 172.21.15.2:0/4184322777 shutdown_connections 2024-06-13T11:29:42.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.500+0000 7f58794afb80 1 --2- 172.21.15.2:0/4184322777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 0x55cde79c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.500+0000 7f58794afb80 1 --2- 172.21.15.2:0/4184322777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79ccb90 0x55cde79ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.500+0000 7f58794afb80 1 --2- 172.21.15.2:0/4184322777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79c6d00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.500+0000 7f58794afb80 1 -- 172.21.15.2:0/4184322777 >> 172.21.15.2:0/4184322777 conn(0x55cde78f3170 msgr2=0x55cde79c1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:42.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.500+0000 7f58794afb80 1 -- 172.21.15.2:0/4184322777 shutdown_connections 2024-06-13T11:29:42.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.500+0000 7f58794afb80 1 -- 172.21.15.2:0/4184322777 wait complete. 2024-06-13T11:29:42.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.501+0000 7f58794afb80 1 -- start start 2024-06-13T11:29:42.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.501+0000 7f58794afb80 1 Processor -- start 2024-06-13T11:29:42.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.501+0000 7f58794afb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 0x55cde79d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.501+0000 7f58794afb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79ccb90 0x55cde79d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.501+0000 7f58794afb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.501+0000 7f58794afb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cde78b4f60 con 0x55cde79c7240 2024-06-13T11:29:42.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.501+0000 7f58794afb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cde7914ac0 con 0x55cde79cd4b0 2024-06-13T11:29:42.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.501+0000 7f58794afb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55cde79d3e90 con 0x55cde79ccb90 2024-06-13T11:29:42.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.502+0000 7f58794afb80 10 client.0 _ll_register_callbacks cb 0x55cde78ae380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:29:42.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.502+0000 7f586cc00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.502+0000 7f586cc00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79d0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:46430/0 (socket says 172.21.15.2:46430) 2024-06-13T11:29:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.502+0000 7f586cc00700 1 -- 172.21.15.2:0/82159700 learned_addr learned my addr 172.21.15.2:0/82159700 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.502+0000 7f5867400700 1 --2- 172.21.15.2:0/82159700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79ccb90 0x55cde79d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.502+0000 7f5867e00700 1 --2- 172.21.15.2:0/82159700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 0x55cde79d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.502+0000 7f586cc00700 1 -- 172.21.15.2:0/82159700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79ccb90 msgr2=0x55cde79d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.502+0000 7f586cc00700 1 --2- 172.21.15.2:0/82159700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79ccb90 0x55cde79d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.502+0000 7f586cc00700 1 -- 172.21.15.2:0/82159700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 msgr2=0x55cde79d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.502+0000 7f586cc00700 1 --2- 172.21.15.2:0/82159700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 0x55cde79d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.502+0000 7f586cc00700 1 -- 172.21.15.2:0/82159700 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cde78678d0 con 0x55cde79cd4b0 2024-06-13T11:29:42.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.503+0000 7f586cc00700 1 --2- 172.21.15.2:0/82159700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79d0a80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f586000bd70 tx=0x7f586000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64c8aa7ad13fa688 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:42.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.503+0000 7f5852000700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:29:42.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.503+0000 7f5852000700 1 -- 172.21.15.2:0/82159700 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860025070 con 0x55cde79cd4b0 2024-06-13T11:29:42.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.503+0000 7f58794afb80 1 -- 172.21.15.2:0/82159700 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5854004d10 con 0x55cde79cd4b0 2024-06-13T11:29:42.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.503+0000 7f5852000700 1 -- 172.21.15.2:0/82159700 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f58600059e0 con 0x55cde79cd4b0 2024-06-13T11:29:42.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.503+0000 7f5852000700 1 -- 172.21.15.2:0/82159700 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5860037050 con 0x55cde79cd4b0 2024-06-13T11:29:42.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.503+0000 7f58794afb80 10 client.25988 fetch_fsmap learned FSMap version 31 2024-06-13T11:29:42.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.503+0000 7f58794afb80 1 -- 172.21.15.2:0/82159700 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cde79de670 con 0x55cde79cd4b0 2024-06-13T11:29:42.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.504+0000 7f5852000700 1 -- 172.21.15.2:0/82159700 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5854004d10 con 0x55cde79cd4b0 2024-06-13T11:29:42.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.504+0000 7f5852000700 1 -- 172.21.15.2:0/82159700 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f5860011070 con 0x55cde79cd4b0 2024-06-13T11:29:42.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.504+0000 7f58794afb80 10 client.25988 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:29:42.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.504+0000 7f58794afb80 10 client.25988 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:29:42.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.504+0000 7f58794afb80 20 client.25988 populate_metadata read hostname 'smithi002' 2024-06-13T11:29:42.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.504+0000 7f58794afb80 1 --2- 172.21.15.2:0/82159700 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55cde79e0cb0 0x55cde79e30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.504+0000 7f58794afb80 4 client.25988 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:29:42.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.504+0000 7f58794afb80 1 -- 172.21.15.2:0/82159700 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cde7926000 con 0x55cde79e0cb0 2024-06-13T11:29:42.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.505+0000 7f5867e00700 1 --2- 172.21.15.2:0/82159700 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55cde79e0cb0 0x55cde79e30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.505+0000 7f5867e00700 1 --2- 172.21.15.2:0/82159700 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55cde79e0cb0 0x55cde79e30a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f570d6063026ff47 server_cookie=cdfa7eb0b940544a in_seq=0 out_seq=0 2024-06-13T11:29:42.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.505+0000 7f5852000700 10 client.25988 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:29:42.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.506+0000 7f5852000700 1 -- 172.21.15.2:0/82159700 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55cde7926000 con 0x55cde79e0cb0 2024-06-13T11:29:42.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.506+0000 7f5852000700 10 client.25988 handle_command_reply: tid=0 2024-06-13T11:29:42.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.506+0000 7f58794afb80 1 client.25988 shutdown 2024-06-13T11:29:42.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.506+0000 7f58794afb80 1 -- 172.21.15.2:0/82159700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 msgr2=0x55cde79d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:42.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.506+0000 7f58794afb80 1 --2- 172.21.15.2:0/82159700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79d0a80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f586000bd70 tx=0x7f586000b330 comp rx=0 tx=0).stop 2024-06-13T11:29:42.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.506+0000 7f58794afb80 1 -- 172.21.15.2:0/82159700 shutdown_connections 2024-06-13T11:29:42.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.506+0000 7f58794afb80 1 --2- 172.21.15.2:0/82159700 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55cde79e0cb0 0x55cde79e30a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.506+0000 7f58794afb80 1 --2- 172.21.15.2:0/82159700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 0x55cde79d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.506+0000 7f58794afb80 1 --2- 172.21.15.2:0/82159700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79d0a80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.506+0000 7f58794afb80 1 --2- 172.21.15.2:0/82159700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79ccb90 0x55cde79d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.506+0000 7f5852000700 0 client.25988 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:29:42.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.506+0000 7f58794afb80 1 -- 172.21.15.2:0/82159700 >> 172.21.15.2:0/82159700 conn(0x55cde78f3170 msgr2=0x55cde79bb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:42.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.506+0000 7f58794afb80 1 -- 172.21.15.2:0/82159700 shutdown_connections 2024-06-13T11:29:42.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.506+0000 7f58794afb80 1 -- 172.21.15.2:0/82159700 wait complete. 2024-06-13T11:29:42.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.507+0000 7f58794afb80 20 client.25988 trim_cache size 0 max 16384 2024-06-13T11:29:42.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.524+0000 7f58794afb80 1 Processor -- start 2024-06-13T11:29:42.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.524+0000 7f58794afb80 1 -- start start 2024-06-13T11:29:42.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.525+0000 7f58794afb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79c7240 0x55cde79c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.525+0000 7f58794afb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79ccb90 0x55cde79c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.525+0000 7f58794afb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79cd4b0 0x55cde79bc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.525+0000 7f58794afb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f58681b2f40 con 0x55cde79cd4b0 2024-06-13T11:29:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.525+0000 7f58794afb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f58681b07d0 con 0x55cde79ccb90 2024-06-13T11:29:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.525+0000 7f58794afb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f58681ae620 con 0x55cde79c7240 2024-06-13T11:29:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.525+0000 7f586cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79cd4b0 0x55cde79bc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.525+0000 7f5867e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79c7240 0x55cde79c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.525+0000 7f586cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79cd4b0 0x55cde79bc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60680/0 (socket says 172.21.15.2:60680) 2024-06-13T11:29:42.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.525+0000 7f5867e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79c7240 0x55cde79c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55128/0 (socket says 172.21.15.2:55128) 2024-06-13T11:29:42.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.525+0000 7f586cc00700 1 -- 172.21.15.2:0/3939219347 learned_addr learned my addr 172.21.15.2:0/3939219347 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:42.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.525+0000 7f5867400700 1 --2- 172.21.15.2:0/3939219347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79ccb90 0x55cde79c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.526+0000 7f5867e00700 1 -- 172.21.15.2:0/3939219347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79ccb90 msgr2=0x55cde79c21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:42.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.526+0000 7f5867e00700 1 --2- 172.21.15.2:0/3939219347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79ccb90 0x55cde79c21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.526+0000 7f5867e00700 1 -- 172.21.15.2:0/3939219347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79cd4b0 msgr2=0x55cde79bc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:42.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.526+0000 7f5867e00700 1 --2- 172.21.15.2:0/3939219347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79cd4b0 0x55cde79bc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.526+0000 7f5867e00700 1 -- 172.21.15.2:0/3939219347 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cde79d0310 con 0x55cde79c7240 2024-06-13T11:29:42.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.526+0000 7f586cc00700 1 --2- 172.21.15.2:0/3939219347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79cd4b0 0x55cde79bc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:29:42.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.526+0000 7f5867e00700 1 --2- 172.21.15.2:0/3939219347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79c7240 0x55cde79c6d00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f58580ccd90 tx=0x7f58580cf040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4d5caba0c8d84a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.526+0000 7f585cc00700 1 -- 172.21.15.2:0/3939219347 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58580b9070 con 0x55cde79c7240 2024-06-13T11:29:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.526+0000 7f585cc00700 1 -- 172.21.15.2:0/3939219347 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58580b3070 con 0x55cde79c7240 2024-06-13T11:29:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.526+0000 7f585cc00700 1 -- 172.21.15.2:0/3939219347 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585809bdc0 con 0x55cde79c7240 2024-06-13T11:29:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.527+0000 7f58794afb80 1 -- 172.21.15.2:0/3939219347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79c7240 msgr2=0x55cde79c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.527+0000 7f58794afb80 1 --2- 172.21.15.2:0/3939219347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79c7240 0x55cde79c6d00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f58580ccd90 tx=0x7f58580cf040 comp rx=0 tx=0).stop 2024-06-13T11:29:42.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.527+0000 7f58794afb80 1 -- 172.21.15.2:0/3939219347 shutdown_connections 2024-06-13T11:29:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.527+0000 7f58794afb80 1 --2- 172.21.15.2:0/3939219347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79cd4b0 0x55cde79bc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.527+0000 7f58794afb80 1 --2- 172.21.15.2:0/3939219347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79c7240 0x55cde79c6d00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.527+0000 7f58794afb80 1 --2- 172.21.15.2:0/3939219347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79ccb90 0x55cde79c21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.527+0000 7f58794afb80 1 -- 172.21.15.2:0/3939219347 >> 172.21.15.2:0/3939219347 conn(0x55cde78f3170 msgr2=0x55cde79c1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.527+0000 7f58794afb80 1 -- 172.21.15.2:0/3939219347 shutdown_connections 2024-06-13T11:29:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.527+0000 7f58794afb80 1 -- 172.21.15.2:0/3939219347 wait complete. 2024-06-13T11:29:42.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.528+0000 7f58794afb80 1 -- start start 2024-06-13T11:29:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.528+0000 7f58794afb80 1 Processor -- start 2024-06-13T11:29:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.528+0000 7f58794afb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 0x55cde79d9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.528+0000 7f58794afb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79ccb90 0x55cde79d96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.528+0000 7f58794afb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79e79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.529+0000 7f58794afb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f58681aec90 con 0x55cde79c7240 2024-06-13T11:29:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.529+0000 7f58794afb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f58681b0100 con 0x55cde79cd4b0 2024-06-13T11:29:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.529+0000 7f58794afb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f58681af360 con 0x55cde79ccb90 2024-06-13T11:29:42.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.529+0000 7f58794afb80 10 client.0 _ll_register_callbacks cb 0x55cde78ae380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:29:42.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.529+0000 7f5867e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 0x55cde79d9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.529+0000 7f5867e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 0x55cde79d9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60690/0 (socket says 172.21.15.2:60690) 2024-06-13T11:29:42.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.529+0000 7f5867e00700 1 -- 172.21.15.2:0/2121577959 learned_addr learned my addr 172.21.15.2:0/2121577959 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:42.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.529+0000 7f586cc00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79e79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.529+0000 7f5867400700 1 --2- 172.21.15.2:0/2121577959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79ccb90 0x55cde79d96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.529+0000 7f586cc00700 1 -- 172.21.15.2:0/2121577959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79ccb90 msgr2=0x55cde79d96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.529+0000 7f586cc00700 1 --2- 172.21.15.2:0/2121577959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79ccb90 0x55cde79d96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.529+0000 7f586cc00700 1 -- 172.21.15.2:0/2121577959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 msgr2=0x55cde79d9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.529+0000 7f586cc00700 1 --2- 172.21.15.2:0/2121577959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 0x55cde79d9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.529+0000 7f586cc00700 1 -- 172.21.15.2:0/2121577959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cde79e7ee0 con 0x55cde79cd4b0 2024-06-13T11:29:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.529+0000 7f5867e00700 1 --2- 172.21.15.2:0/2121577959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 0x55cde79d9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:29:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.530+0000 7f586cc00700 1 --2- 172.21.15.2:0/2121577959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79e79a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5860005010 tx=0x7f586001eb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ee27bf092e4ea78 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.530+0000 7f5852000700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:29:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.530+0000 7f5852000700 1 -- 172.21.15.2:0/2121577959 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586003f070 con 0x55cde79cd4b0 2024-06-13T11:29:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.530+0000 7f5852000700 1 -- 172.21.15.2:0/2121577959 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f58600058b0 con 0x55cde79cd4b0 2024-06-13T11:29:42.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.530+0000 7f58794afb80 1 -- 172.21.15.2:0/2121577959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58580b3070 con 0x55cde79cd4b0 2024-06-13T11:29:42.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.534+0000 7f5852000700 1 -- 172.21.15.2:0/2121577959 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f586004b050 con 0x55cde79cd4b0 2024-06-13T11:29:42.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.534+0000 7f58794afb80 10 client.25994 fetch_fsmap learned FSMap version 31 2024-06-13T11:29:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.534+0000 7f58794afb80 1 -- 172.21.15.2:0/2121577959 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cde7a4b040 con 0x55cde79cd4b0 2024-06-13T11:29:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.534+0000 7f5852000700 1 -- 172.21.15.2:0/2121577959 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58580b3070 con 0x55cde79cd4b0 2024-06-13T11:29:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.534+0000 7f5852000700 1 -- 172.21.15.2:0/2121577959 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f5860011040 con 0x55cde79cd4b0 2024-06-13T11:29:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.534+0000 7f58794afb80 10 client.25994 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:29:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.534+0000 7f58794afb80 10 client.25994 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:29:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.534+0000 7f58794afb80 20 client.25994 populate_metadata read hostname 'smithi002' 2024-06-13T11:29:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.534+0000 7f58794afb80 1 --2- 172.21.15.2:0/2121577959 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55cde7a4b630 0x55cde7a4da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:42.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.534+0000 7f58794afb80 4 client.25994 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:29:42.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.534+0000 7f58794afb80 1 -- 172.21.15.2:0/2121577959 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cde7920580 con 0x55cde7a4b630 2024-06-13T11:29:42.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.535+0000 7f5867e00700 1 --2- 172.21.15.2:0/2121577959 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55cde7a4b630 0x55cde7a4da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:42.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.535+0000 7f5867e00700 1 --2- 172.21.15.2:0/2121577959 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55cde7a4b630 0x55cde7a4da20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fa457e15e79f8736 server_cookie=25d94b28a2461d54 in_seq=0 out_seq=0 2024-06-13T11:29:42.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.535+0000 7f5852000700 10 client.25994 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:29:42.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.535+0000 7f5852000700 1 -- 172.21.15.2:0/2121577959 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cde7920580 con 0x55cde7a4b630 2024-06-13T11:29:42.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.535+0000 7f5852000700 10 client.25994 handle_command_reply: tid=0 2024-06-13T11:29:42.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.536+0000 7f58794afb80 1 client.25994 shutdown 2024-06-13T11:29:42.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.536+0000 7f58794afb80 1 -- 172.21.15.2:0/2121577959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 msgr2=0x55cde79e79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.536+0000 7f58794afb80 1 --2- 172.21.15.2:0/2121577959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79e79a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5860005010 tx=0x7f586001eb40 comp rx=0 tx=0).stop 2024-06-13T11:29:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.536+0000 7f58794afb80 1 -- 172.21.15.2:0/2121577959 shutdown_connections 2024-06-13T11:29:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.536+0000 7f58794afb80 1 --2- 172.21.15.2:0/2121577959 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55cde7a4b630 0x55cde7a4da20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.536+0000 7f58794afb80 1 --2- 172.21.15.2:0/2121577959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cde79c7240 0x55cde79d9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.536+0000 7f58794afb80 1 --2- 172.21.15.2:0/2121577959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cde79cd4b0 0x55cde79e79a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.536+0000 7f5852000700 0 client.25994 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:29:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.536+0000 7f58794afb80 1 --2- 172.21.15.2:0/2121577959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cde79ccb90 0x55cde79d96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.536+0000 7f58794afb80 1 -- 172.21.15.2:0/2121577959 >> 172.21.15.2:0/2121577959 conn(0x55cde78f3170 msgr2=0x55cde79cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:42.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.536+0000 7f58794afb80 1 -- 172.21.15.2:0/2121577959 shutdown_connections 2024-06-13T11:29:42.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.536+0000 7f58794afb80 1 -- 172.21.15.2:0/2121577959 wait complete. 2024-06-13T11:29:42.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.536+0000 7f58794afb80 20 client.25994 trim_cache size 0 max 16384 2024-06-13T11:29:42.539 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:29:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.537+0000 7f586ec00700 1 -- 172.21.15.2:0/2828689633 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f584c0a2e10 msgr2=0x7f584c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.537+0000 7f586ec00700 1 --2- 172.21.15.2:0/2828689633 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f584c0a2e10 0x7f584c0a52d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f586000b6c0 tx=0x7f5860009d00 comp rx=0 tx=0).stop 2024-06-13T11:29:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.537+0000 7f586ec00700 1 -- 172.21.15.2:0/2828689633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58681046b0 msgr2=0x7f586819adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.537+0000 7f586ec00700 1 --2- 172.21.15.2:0/2828689633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58681046b0 0x7f586819adb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f585800e9a0 tx=0x7f585800ed60 comp rx=0 tx=0).stop 2024-06-13T11:29:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.537+0000 7f586ec00700 1 -- 172.21.15.2:0/2828689633 shutdown_connections 2024-06-13T11:29:42.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.537+0000 7f586ec00700 1 --2- 172.21.15.2:0/2828689633 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f584c0a2e10 0x7f584c0a52d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.537+0000 7f586ec00700 1 --2- 172.21.15.2:0/2828689633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f586810a6b0 0x7f586819f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.537+0000 7f586ec00700 1 --2- 172.21.15.2:0/2828689633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58681046b0 0x7f586819adb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.537+0000 7f586ec00700 1 --2- 172.21.15.2:0/2828689633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5868105070 0x7f586819b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.537+0000 7f586ec00700 1 -- 172.21.15.2:0/2828689633 >> 172.21.15.2:0/2828689633 conn(0x7f58681001a0 msgr2=0x7f5868100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.537+0000 7f586ec00700 1 -- 172.21.15.2:0/2828689633 shutdown_connections 2024-06-13T11:29:42.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:42.537+0000 7f586ec00700 1 -- 172.21.15.2:0/2828689633 wait complete. 2024-06-13T11:29:43.541 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-13T11:29:43.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:43 smithi077 ceph-mon[36410]: pgmap v181: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:43.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:43 smithi002 ceph-mon[32210]: pgmap v181: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:43.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:43 smithi178 ceph-mon[36913]: pgmap v181: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:44.007 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:29:45.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:45 smithi002 ceph-mon[32210]: pgmap v182: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:45.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:45 smithi077 ceph-mon[36410]: pgmap v182: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:45.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:45 smithi178 ceph-mon[36913]: pgmap v182: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.283+0000 7fb230c00700 1 -- 172.21.15.2:0/3207754183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb22c113660 msgr2=0x7fb22c115a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.283+0000 7fb230c00700 1 --2- 172.21.15.2:0/3207754183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb22c113660 0x7fb22c115a50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb224009f90 tx=0x7fb22400b330 comp rx=0 tx=0).stop 2024-06-13T11:29:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.284+0000 7fb230c00700 1 -- 172.21.15.2:0/3207754183 shutdown_connections 2024-06-13T11:29:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.284+0000 7fb230c00700 1 --2- 172.21.15.2:0/3207754183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb22c0746c0 0x7fb22c074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.284+0000 7fb230c00700 1 --2- 172.21.15.2:0/3207754183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb22c113660 0x7fb22c115a50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.284+0000 7fb230c00700 1 --2- 172.21.15.2:0/3207754183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb22c074fe0 0x7fb22c113120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.284+0000 7fb230c00700 1 -- 172.21.15.2:0/3207754183 >> 172.21.15.2:0/3207754183 conn(0x7fb22c0795f0 msgr2=0x7fb22c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.284+0000 7fb230c00700 1 -- 172.21.15.2:0/3207754183 shutdown_connections 2024-06-13T11:29:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.284+0000 7fb230c00700 1 -- 172.21.15.2:0/3207754183 wait complete. 2024-06-13T11:29:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.286+0000 7fb230c00700 1 Processor -- start 2024-06-13T11:29:46.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.286+0000 7fb230c00700 1 -- start start 2024-06-13T11:29:46.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.287+0000 7fb230c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb22c0746c0 0x7fb22c19f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.287+0000 7fb230c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb22c074fe0 0x7fb22c19f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.287+0000 7fb230c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb22c113660 0x7fb22c1a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.287+0000 7fb230c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c118df0 con 0x7fb22c0746c0 2024-06-13T11:29:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.287+0000 7fb230c00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c118c70 con 0x7fb22c074fe0 2024-06-13T11:29:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.287+0000 7fb230c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c118f70 con 0x7fb22c113660 2024-06-13T11:29:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.287+0000 7fb229e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb22c0746c0 0x7fb22c19f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.287+0000 7fb22a800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb22c113660 0x7fb22c1a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.287+0000 7fb22a800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb22c113660 0x7fb22c1a3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:44472/0 (socket says 172.21.15.2:44472) 2024-06-13T11:29:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.287+0000 7fb22a800700 1 -- 172.21.15.2:0/1361720979 learned_addr learned my addr 172.21.15.2:0/1361720979 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.287+0000 7fb229400700 1 --2- 172.21.15.2:0/1361720979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb22c074fe0 0x7fb22c19f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.288+0000 7fb22a800700 1 -- 172.21.15.2:0/1361720979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb22c074fe0 msgr2=0x7fb22c19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.288+0000 7fb22a800700 1 --2- 172.21.15.2:0/1361720979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb22c074fe0 0x7fb22c19f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.288+0000 7fb22a800700 1 -- 172.21.15.2:0/1361720979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb22c0746c0 msgr2=0x7fb22c19f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.288+0000 7fb22a800700 1 --2- 172.21.15.2:0/1361720979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb22c0746c0 0x7fb22c19f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.288+0000 7fb22a800700 1 -- 172.21.15.2:0/1361720979 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c1a4270 con 0x7fb22c113660 2024-06-13T11:29:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.288+0000 7fb22a800700 1 --2- 172.21.15.2:0/1361720979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb22c113660 0x7fb22c1a3b30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb22400b6c0 tx=0x7fb22400cfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.288+0000 7fb222a00700 1 -- 172.21.15.2:0/1361720979 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224021070 con 0x7fb22c113660 2024-06-13T11:29:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.289+0000 7fb230c00700 1 -- 172.21.15.2:0/1361720979 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22c1a4500 con 0x7fb22c113660 2024-06-13T11:29:46.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.289+0000 7fb222a00700 1 -- 172.21.15.2:0/1361720979 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb224007ac0 con 0x7fb22c113660 2024-06-13T11:29:46.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.289+0000 7fb222a00700 1 -- 172.21.15.2:0/1361720979 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22401de60 con 0x7fb22c113660 2024-06-13T11:29:46.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.289+0000 7fb230c00700 1 -- 172.21.15.2:0/1361720979 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22c1abde0 con 0x7fb22c113660 2024-06-13T11:29:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.292+0000 7fb222a00700 1 -- 172.21.15.2:0/1361720979 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fb224024070 con 0x7fb22c113660 2024-06-13T11:29:46.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.293+0000 7fb23b52db80 1 Processor -- start 2024-06-13T11:29:46.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.294+0000 7fb222a00700 1 --2- 172.21.15.2:0/1361720979 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb2100a2e10 0x7fb2100a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.294+0000 7fb23b52db80 1 -- start start 2024-06-13T11:29:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.294+0000 7fb222a00700 1 -- 172.21.15.2:0/1361720979 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fb2240d06f0 con 0x7fb22c113660 2024-06-13T11:29:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.294+0000 7fb229400700 1 --2- 172.21.15.2:0/1361720979 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb2100a2e10 0x7fb2100a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.294+0000 7fb23b52db80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaeb90 0x560301aaef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.294+0000 7fb23b52db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aaf4b0 0x560301aa8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.294+0000 7fb23b52db80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aa9240 0x560301aa9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.294+0000 7fb23b52db80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5603019b7a10 con 0x560301aaeb90 2024-06-13T11:29:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.294+0000 7fb23b52db80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5603019fab00 con 0x560301aa9240 2024-06-13T11:29:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.294+0000 7fb23b52db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5603019b58f0 con 0x560301aaf4b0 2024-06-13T11:29:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.295+0000 7fb229e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaeb90 0x560301aaef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.295+0000 7fb229e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaeb90 0x560301aaef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43616/0 (socket says 172.21.15.2:43616) 2024-06-13T11:29:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.295+0000 7fb229e00700 1 -- 172.21.15.2:0/466740587 learned_addr learned my addr 172.21.15.2:0/466740587 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.295+0000 7fb229400700 1 --2- 172.21.15.2:0/466740587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aaf4b0 0x560301aa8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.295+0000 7fb22a800700 1 --2- 172.21.15.2:0/466740587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aa9240 0x560301aa9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.295+0000 7fb229e00700 1 -- 172.21.15.2:0/466740587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aaf4b0 msgr2=0x560301aa8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.295+0000 7fb229e00700 1 --2- 172.21.15.2:0/466740587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aaf4b0 0x560301aa8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.295+0000 7fb229e00700 1 -- 172.21.15.2:0/466740587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aa9240 msgr2=0x560301aa9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.295+0000 7fb229e00700 1 --2- 172.21.15.2:0/466740587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aa9240 0x560301aa9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.295+0000 7fb229e00700 1 -- 172.21.15.2:0/466740587 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603019a2f90 con 0x560301aaeb90 2024-06-13T11:29:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.295+0000 7fb22a800700 1 --2- 172.21.15.2:0/466740587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aa9240 0x560301aa9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:29:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.296+0000 7fb229e00700 1 --2- 172.21.15.2:0/466740587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaeb90 0x560301aaef70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009d60 tx=0x7fb21c011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c712a5981c3cc server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.296+0000 7fb229400700 1 --2- 172.21.15.2:0/1361720979 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb2100a2e10 0x7fb2100a52d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb22c10ff70 tx=0x7fb2180118e0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.296+0000 7fb217400700 1 -- 172.21.15.2:0/466740587 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c01e070 con 0x560301aaeb90 2024-06-13T11:29:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.296+0000 7fb217400700 1 -- 172.21.15.2:0/466740587 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb21c019b10 con 0x560301aaeb90 2024-06-13T11:29:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.296+0000 7fb217400700 1 -- 172.21.15.2:0/466740587 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c00ebf0 con 0x560301aaeb90 2024-06-13T11:29:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.297+0000 7fb23b52db80 1 -- 172.21.15.2:0/466740587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaeb90 msgr2=0x560301aaef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.297+0000 7fb23b52db80 1 --2- 172.21.15.2:0/466740587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaeb90 0x560301aaef70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009d60 tx=0x7fb21c011720 comp rx=0 tx=0).stop 2024-06-13T11:29:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.297+0000 7fb23b52db80 1 -- 172.21.15.2:0/466740587 shutdown_connections 2024-06-13T11:29:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.297+0000 7fb23b52db80 1 --2- 172.21.15.2:0/466740587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaeb90 0x560301aaef70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.297+0000 7fb23b52db80 1 --2- 172.21.15.2:0/466740587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aa9240 0x560301aa9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.297+0000 7fb23b52db80 1 --2- 172.21.15.2:0/466740587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aaf4b0 0x560301aa8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.297+0000 7fb23b52db80 1 -- 172.21.15.2:0/466740587 >> 172.21.15.2:0/466740587 conn(0x5603019d5170 msgr2=0x560301aa3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:46.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.297+0000 7fb23b52db80 1 -- 172.21.15.2:0/466740587 shutdown_connections 2024-06-13T11:29:46.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.297+0000 7fb23b52db80 1 -- 172.21.15.2:0/466740587 wait complete. 2024-06-13T11:29:46.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.298+0000 7fb23b52db80 1 -- start start 2024-06-13T11:29:46.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.298+0000 7fb23b52db80 1 Processor -- start 2024-06-13T11:29:46.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.298+0000 7fb23b52db80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aa9240 0x560301ab5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.298+0000 7fb23b52db80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aaeb90 0x560301ab2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.298+0000 7fb23b52db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aaf4b0 0x560301ab2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.298+0000 7fb23b52db80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560301996f60 con 0x560301aa9240 2024-06-13T11:29:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.298+0000 7fb23b52db80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5603019f6ac0 con 0x560301aaeb90 2024-06-13T11:29:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.298+0000 7fb23b52db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560301ab5e90 con 0x560301aaf4b0 2024-06-13T11:29:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.298+0000 7fb23b52db80 10 client.0 _ll_register_callbacks cb 0x560301990380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:29:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.299+0000 7fb229e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aa9240 0x560301ab5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.299+0000 7fb229e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aa9240 0x560301ab5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43626/0 (socket says 172.21.15.2:43626) 2024-06-13T11:29:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.299+0000 7fb229e00700 1 -- 172.21.15.2:0/188982869 learned_addr learned my addr 172.21.15.2:0/188982869 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.299+0000 7fb229400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aaeb90 0x560301ab2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.299+0000 7fb22a800700 1 --2- 172.21.15.2:0/188982869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aaf4b0 0x560301ab2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.299+0000 7fb229e00700 1 -- 172.21.15.2:0/188982869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aaf4b0 msgr2=0x560301ab2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.299+0000 7fb229e00700 1 --2- 172.21.15.2:0/188982869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aaf4b0 0x560301ab2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.299+0000 7fb229e00700 1 -- 172.21.15.2:0/188982869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aaeb90 msgr2=0x560301ab2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.299+0000 7fb229e00700 1 --2- 172.21.15.2:0/188982869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aaeb90 0x560301ab2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.299+0000 7fb229e00700 1 -- 172.21.15.2:0/188982869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603019498d0 con 0x560301aa9240 2024-06-13T11:29:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.299+0000 7fb229400700 1 --2- 172.21.15.2:0/188982869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aaeb90 0x560301ab2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:29:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.300+0000 7fb229e00700 1 --2- 172.21.15.2:0/188982869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aa9240 0x560301ab5210 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00a010 tx=0x7fb21c00e3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f7b6e54432ab21 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.300+0000 7fb20be00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:29:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.300+0000 7fb20be00700 1 -- 172.21.15.2:0/188982869 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c027070 con 0x560301aa9240 2024-06-13T11:29:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.300+0000 7fb20be00700 1 -- 172.21.15.2:0/188982869 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fb21c019840 con 0x560301aa9240 2024-06-13T11:29:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.300+0000 7fb23b52db80 1 -- 172.21.15.2:0/188982869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb21c019b10 con 0x560301aa9240 2024-06-13T11:29:46.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.300+0000 7fb20be00700 1 -- 172.21.15.2:0/188982869 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb21c033050 con 0x560301aa9240 2024-06-13T11:29:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.300+0000 7fb23b52db80 10 client.15897 fetch_fsmap learned FSMap version 31 2024-06-13T11:29:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.300+0000 7fb23b52db80 1 -- 172.21.15.2:0/188982869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560301ac0610 con 0x560301aa9240 2024-06-13T11:29:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.301+0000 7fb20be00700 1 -- 172.21.15.2:0/188982869 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb21c019b10 con 0x560301aa9240 2024-06-13T11:29:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.301+0000 7fb20be00700 1 -- 172.21.15.2:0/188982869 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fb21c004bd0 con 0x560301aa9240 2024-06-13T11:29:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.301+0000 7fb23b52db80 10 client.15897 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:29:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.301+0000 7fb23b52db80 10 client.15897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:29:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.301+0000 7fb23b52db80 20 client.15897 populate_metadata read hostname 'smithi002' 2024-06-13T11:29:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.301+0000 7fb23b52db80 1 --2- 172.21.15.2:0/188982869 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x560301ac2b40 0x560301ac4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.301+0000 7fb23b52db80 4 client.15897 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:29:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.301+0000 7fb23b52db80 1 -- 172.21.15.2:0/188982869 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560301a08000 con 0x560301ac2b40 2024-06-13T11:29:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.302+0000 7fb229400700 1 --2- 172.21.15.2:0/188982869 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x560301ac2b40 0x560301ac4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.302+0000 7fb229400700 1 --2- 172.21.15.2:0/188982869 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x560301ac2b40 0x560301ac4f30 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2804f4501a743b79 server_cookie=d6a4d2f0e399b953 in_seq=0 out_seq=0 2024-06-13T11:29:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.302+0000 7fb20be00700 10 client.15897 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:29:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.303+0000 7fb20be00700 1 -- 172.21.15.2:0/188982869 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560301a08000 con 0x560301ac2b40 2024-06-13T11:29:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.303+0000 7fb20be00700 10 client.15897 handle_command_reply: tid=0 2024-06-13T11:29:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.303+0000 7fb23b52db80 1 client.15897 shutdown 2024-06-13T11:29:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.303+0000 7fb23b52db80 1 -- 172.21.15.2:0/188982869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aa9240 msgr2=0x560301ab5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.303+0000 7fb23b52db80 1 --2- 172.21.15.2:0/188982869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aa9240 0x560301ab5210 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00a010 tx=0x7fb21c00e3b0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.303+0000 7fb23b52db80 1 -- 172.21.15.2:0/188982869 shutdown_connections 2024-06-13T11:29:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.303+0000 7fb23b52db80 1 --2- 172.21.15.2:0/188982869 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x560301ac2b40 0x560301ac4f30 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.303+0000 7fb23b52db80 1 --2- 172.21.15.2:0/188982869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aa9240 0x560301ab5210 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.303+0000 7fb23b52db80 1 --2- 172.21.15.2:0/188982869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aaf4b0 0x560301ab2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.303+0000 7fb23b52db80 1 --2- 172.21.15.2:0/188982869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aaeb90 0x560301ab2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.303+0000 7fb23b52db80 1 -- 172.21.15.2:0/188982869 >> 172.21.15.2:0/188982869 conn(0x5603019d5170 msgr2=0x560301a9d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.303+0000 7fb20be00700 0 client.15897 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:29:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.304+0000 7fb23b52db80 1 -- 172.21.15.2:0/188982869 shutdown_connections 2024-06-13T11:29:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.304+0000 7fb23b52db80 1 -- 172.21.15.2:0/188982869 wait complete. 2024-06-13T11:29:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.304+0000 7fb23b52db80 20 client.15897 trim_cache size 0 max 16384 2024-06-13T11:29:46.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.321+0000 7fb23b52db80 1 Processor -- start 2024-06-13T11:29:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.321+0000 7fb23b52db80 1 -- start start 2024-06-13T11:29:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.321+0000 7fb23b52db80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aa9240 0x560301aa8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.321+0000 7fb23b52db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aaeb90 0x560301aa41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.321+0000 7fb23b52db80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaf4b0 0x560301a9e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.321+0000 7fb23b52db80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c1b71c0 con 0x560301aaf4b0 2024-06-13T11:29:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.321+0000 7fb23b52db80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c1b4a50 con 0x560301aa9240 2024-06-13T11:29:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.321+0000 7fb23b52db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c1b28a0 con 0x560301aaeb90 2024-06-13T11:29:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.322+0000 7fb229e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aa9240 0x560301aa8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.322+0000 7fb229400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aaeb90 0x560301aa41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.322+0000 7fb22a800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaf4b0 0x560301a9e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.322+0000 7fb229e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aa9240 0x560301aa8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:57182/0 (socket says 172.21.15.2:57182) 2024-06-13T11:29:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.322+0000 7fb229400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aaeb90 0x560301aa41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:44504/0 (socket says 172.21.15.2:44504) 2024-06-13T11:29:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.322+0000 7fb229e00700 1 -- 172.21.15.2:0/3955794055 learned_addr learned my addr 172.21.15.2:0/3955794055 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.322+0000 7fb229e00700 1 -- 172.21.15.2:0/3955794055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aaeb90 msgr2=0x560301aa41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.322+0000 7fb229e00700 1 --2- 172.21.15.2:0/3955794055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aaeb90 0x560301aa41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.322+0000 7fb229e00700 1 -- 172.21.15.2:0/3955794055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaf4b0 msgr2=0x560301a9e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.322+0000 7fb229e00700 1 --2- 172.21.15.2:0/3955794055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaf4b0 0x560301a9e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.322+0000 7fb229e00700 1 -- 172.21.15.2:0/3955794055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560301ab5a10 con 0x560301aa9240 2024-06-13T11:29:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.323+0000 7fb229e00700 1 --2- 172.21.15.2:0/3955794055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aa9240 0x560301aa8d00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb21c000c00 tx=0x7fb21c009690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f25a53a9c6eff7df server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.323+0000 7fb216a00700 1 -- 172.21.15.2:0/3955794055 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c027040 con 0x560301aa9240 2024-06-13T11:29:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.323+0000 7fb216a00700 1 -- 172.21.15.2:0/3955794055 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb21c019640 con 0x560301aa9240 2024-06-13T11:29:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.323+0000 7fb216a00700 1 -- 172.21.15.2:0/3955794055 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c01e040 con 0x560301aa9240 2024-06-13T11:29:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.324+0000 7fb23b52db80 1 -- 172.21.15.2:0/3955794055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aa9240 msgr2=0x560301aa8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.324+0000 7fb23b52db80 1 --2- 172.21.15.2:0/3955794055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aa9240 0x560301aa8d00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb21c000c00 tx=0x7fb21c009690 comp rx=0 tx=0).stop 2024-06-13T11:29:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.324+0000 7fb23b52db80 1 -- 172.21.15.2:0/3955794055 shutdown_connections 2024-06-13T11:29:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.324+0000 7fb23b52db80 1 --2- 172.21.15.2:0/3955794055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaf4b0 0x560301a9e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.324+0000 7fb23b52db80 1 --2- 172.21.15.2:0/3955794055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aa9240 0x560301aa8d00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.324+0000 7fb23b52db80 1 --2- 172.21.15.2:0/3955794055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aaeb90 0x560301aa41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.324+0000 7fb23b52db80 1 -- 172.21.15.2:0/3955794055 >> 172.21.15.2:0/3955794055 conn(0x5603019d5170 msgr2=0x560301aa3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.324+0000 7fb23b52db80 1 -- 172.21.15.2:0/3955794055 shutdown_connections 2024-06-13T11:29:46.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.324+0000 7fb23b52db80 1 -- 172.21.15.2:0/3955794055 wait complete. 2024-06-13T11:29:46.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.324+0000 7fb23b52db80 1 -- start start 2024-06-13T11:29:46.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.325+0000 7fb23b52db80 1 Processor -- start 2024-06-13T11:29:46.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.325+0000 7fb23b52db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aa9240 0x560301abb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.325+0000 7fb23b52db80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aaeb90 0x560301abb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.325+0000 7fb23b52db80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaf4b0 0x560301ac9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.325+0000 7fb23b52db80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c1b2f10 con 0x560301aaf4b0 2024-06-13T11:29:46.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.325+0000 7fb23b52db80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c1b4380 con 0x560301aaeb90 2024-06-13T11:29:46.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.325+0000 7fb23b52db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c1b35e0 con 0x560301aa9240 2024-06-13T11:29:46.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.325+0000 7fb23b52db80 10 client.0 _ll_register_callbacks cb 0x560301990380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:29:46.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.325+0000 7fb229400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aaeb90 0x560301abb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.325+0000 7fb229400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aaeb90 0x560301abb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:57198/0 (socket says 172.21.15.2:57198) 2024-06-13T11:29:46.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.326+0000 7fb229400700 1 -- 172.21.15.2:0/2429646172 learned_addr learned my addr 172.21.15.2:0/2429646172 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:46.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.326+0000 7fb22a800700 1 --2- 172.21.15.2:0/2429646172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaf4b0 0x560301ac9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.326+0000 7fb229e00700 1 --2- 172.21.15.2:0/2429646172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aa9240 0x560301abb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.326+0000 7fb229400700 1 -- 172.21.15.2:0/2429646172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aa9240 msgr2=0x560301abb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:46.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.326+0000 7fb229400700 1 --2- 172.21.15.2:0/2429646172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aa9240 0x560301abb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.326+0000 7fb229400700 1 -- 172.21.15.2:0/2429646172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaf4b0 msgr2=0x560301ac9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:46.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.326+0000 7fb229400700 1 --2- 172.21.15.2:0/2429646172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaf4b0 0x560301ac9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.326+0000 7fb229400700 1 -- 172.21.15.2:0/2429646172 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560301acb0c0 con 0x560301aaeb90 2024-06-13T11:29:46.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.326+0000 7fb229400700 1 --2- 172.21.15.2:0/2429646172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aaeb90 0x560301abb690 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x560301ab3ae0 tx=0x7fb21801b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3501e27f49a8865 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:46.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.326+0000 7fb20be00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:29:46.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.327+0000 7fb20be00700 1 -- 172.21.15.2:0/2429646172 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21801a040 con 0x560301aaeb90 2024-06-13T11:29:46.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.327+0000 7fb20be00700 1 -- 172.21.15.2:0/2429646172 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fb218009040 con 0x560301aaeb90 2024-06-13T11:29:46.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.327+0000 7fb23b52db80 1 -- 172.21.15.2:0/2429646172 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb21c019640 con 0x560301aaeb90 2024-06-13T11:29:46.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.327+0000 7fb20be00700 1 -- 172.21.15.2:0/2429646172 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb21800fe40 con 0x560301aaeb90 2024-06-13T11:29:46.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.327+0000 7fb23b52db80 10 client.26012 fetch_fsmap learned FSMap version 31 2024-06-13T11:29:46.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.327+0000 7fb23b52db80 1 -- 172.21.15.2:0/2429646172 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560301b2cb30 con 0x560301aaeb90 2024-06-13T11:29:46.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.327+0000 7fb20be00700 1 -- 172.21.15.2:0/2429646172 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb21c019640 con 0x560301aaeb90 2024-06-13T11:29:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.327+0000 7fb20be00700 1 -- 172.21.15.2:0/2429646172 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fb218005020 con 0x560301aaeb90 2024-06-13T11:29:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.327+0000 7fb23b52db80 10 client.26012 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:29:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.328+0000 7fb23b52db80 10 client.26012 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:29:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.328+0000 7fb23b52db80 20 client.26012 populate_metadata read hostname 'smithi002' 2024-06-13T11:29:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.328+0000 7fb23b52db80 1 --2- 172.21.15.2:0/2429646172 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x560301b2d220 0x560301b2f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.328+0000 7fb23b52db80 4 client.26012 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:29:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.328+0000 7fb23b52db80 1 -- 172.21.15.2:0/2429646172 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560301a02580 con 0x560301b2d220 2024-06-13T11:29:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.328+0000 7fb229e00700 1 --2- 172.21.15.2:0/2429646172 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x560301b2d220 0x560301b2f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:46.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.328+0000 7fb229e00700 1 --2- 172.21.15.2:0/2429646172 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x560301b2d220 0x560301b2f640 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f0290e246e22a6f server_cookie=74fd7f69897b913e in_seq=0 out_seq=0 2024-06-13T11:29:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.328+0000 7fb20be00700 10 client.26012 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:29:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.329+0000 7fb20be00700 1 -- 172.21.15.2:0/2429646172 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560301a02580 con 0x560301b2d220 2024-06-13T11:29:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.329+0000 7fb20be00700 10 client.26012 handle_command_reply: tid=0 2024-06-13T11:29:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.329+0000 7fb23b52db80 1 client.26012 shutdown 2024-06-13T11:29:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.329+0000 7fb23b52db80 1 -- 172.21.15.2:0/2429646172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aaeb90 msgr2=0x560301abb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.329+0000 7fb23b52db80 1 --2- 172.21.15.2:0/2429646172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aaeb90 0x560301abb690 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x560301ab3ae0 tx=0x7fb21801b000 comp rx=0 tx=0).stop 2024-06-13T11:29:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.329+0000 7fb23b52db80 1 -- 172.21.15.2:0/2429646172 shutdown_connections 2024-06-13T11:29:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.329+0000 7fb23b52db80 1 --2- 172.21.15.2:0/2429646172 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x560301b2d220 0x560301b2f640 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.329+0000 7fb23b52db80 1 --2- 172.21.15.2:0/2429646172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560301aaf4b0 0x560301ac9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.329+0000 7fb23b52db80 1 --2- 172.21.15.2:0/2429646172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560301aa9240 0x560301abb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.329+0000 7fb23b52db80 1 --2- 172.21.15.2:0/2429646172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560301aaeb90 0x560301abb690 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.329+0000 7fb23b52db80 1 -- 172.21.15.2:0/2429646172 >> 172.21.15.2:0/2429646172 conn(0x5603019d5170 msgr2=0x560301aaf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.329+0000 7fb20be00700 0 client.26012 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:29:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.329+0000 7fb23b52db80 1 -- 172.21.15.2:0/2429646172 shutdown_connections 2024-06-13T11:29:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.329+0000 7fb23b52db80 1 -- 172.21.15.2:0/2429646172 wait complete. 2024-06-13T11:29:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.329+0000 7fb23b52db80 20 client.26012 trim_cache size 0 max 16384 2024-06-13T11:29:46.336 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:29:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.330+0000 7fb230c00700 1 -- 172.21.15.2:0/1361720979 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb2100a2e10 msgr2=0x7fb2100a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.330+0000 7fb230c00700 1 --2- 172.21.15.2:0/1361720979 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb2100a2e10 0x7fb2100a52d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb22c10ff70 tx=0x7fb2180118e0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.330+0000 7fb230c00700 1 -- 172.21.15.2:0/1361720979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb22c113660 msgr2=0x7fb22c1a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.330+0000 7fb230c00700 1 --2- 172.21.15.2:0/1361720979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb22c113660 0x7fb22c1a3b30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb22400b6c0 tx=0x7fb22400cfa0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.330+0000 7fb230c00700 1 -- 172.21.15.2:0/1361720979 shutdown_connections 2024-06-13T11:29:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.330+0000 7fb230c00700 1 --2- 172.21.15.2:0/1361720979 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb2100a2e10 0x7fb2100a52d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.330+0000 7fb230c00700 1 --2- 172.21.15.2:0/1361720979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb22c0746c0 0x7fb22c19f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.330+0000 7fb230c00700 1 --2- 172.21.15.2:0/1361720979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb22c113660 0x7fb22c1a3b30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.330+0000 7fb230c00700 1 --2- 172.21.15.2:0/1361720979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb22c074fe0 0x7fb22c19f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.330+0000 7fb230c00700 1 -- 172.21.15.2:0/1361720979 >> 172.21.15.2:0/1361720979 conn(0x7fb22c0795f0 msgr2=0x7fb22c112420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.330+0000 7fb230c00700 1 -- 172.21.15.2:0/1361720979 shutdown_connections 2024-06-13T11:29:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:46.330+0000 7fb230c00700 1 -- 172.21.15.2:0/1361720979 wait complete. 2024-06-13T11:29:47.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:47 smithi002 ceph-mon[32210]: pgmap v183: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:47.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:47 smithi178 ceph-mon[36913]: pgmap v183: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:48.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:47 smithi077 ceph-mon[36410]: pgmap v183: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:48.403 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-13T11:29:48.404 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-13T11:29:48.866 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:29:49.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:49 smithi002 ceph-mon[32210]: pgmap v184: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:49.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:49 smithi178 ceph-mon[36913]: pgmap v184: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:50.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:49 smithi077 ceph-mon[36410]: pgmap v184: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:29:51.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.303+0000 7f534be00700 1 -- 172.21.15.2:0/353663741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f534c102fd0 msgr2=0x7f534c107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:51.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.303+0000 7f534be00700 1 --2- 172.21.15.2:0/353663741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f534c102fd0 0x7f534c107020 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5334009990 tx=0x7f5334009ca0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.303+0000 7f534be00700 1 -- 172.21.15.2:0/353663741 shutdown_connections 2024-06-13T11:29:51.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.303+0000 7f534be00700 1 --2- 172.21.15.2:0/353663741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534c107700 0x7f534c10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.303+0000 7f534be00700 1 --2- 172.21.15.2:0/353663741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f534c102620 0x7f534c102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.303+0000 7f534be00700 1 --2- 172.21.15.2:0/353663741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f534c102fd0 0x7f534c107020 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.303+0000 7f534be00700 1 -- 172.21.15.2:0/353663741 >> 172.21.15.2:0/353663741 conn(0x7f534c0fdf10 msgr2=0x7f534c100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:51.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.303+0000 7f534be00700 1 -- 172.21.15.2:0/353663741 shutdown_connections 2024-06-13T11:29:51.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.303+0000 7f534be00700 1 -- 172.21.15.2:0/353663741 wait complete. 2024-06-13T11:29:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.304+0000 7f534be00700 1 Processor -- start 2024-06-13T11:29:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.304+0000 7f534be00700 1 -- start start 2024-06-13T11:29:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.305+0000 7f534be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f534c102620 0x7f534c074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.305+0000 7f534be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534c102fd0 0x7f534c074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.305+0000 7f534be00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f534c107700 0x7f534c075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.305+0000 7f534be00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1126e0 con 0x7f534c102fd0 2024-06-13T11:29:51.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.305+0000 7f534be00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f534c112560 con 0x7f534c107700 2024-06-13T11:29:51.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.305+0000 7f534be00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f534c112860 con 0x7f534c102620 2024-06-13T11:29:51.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.305+0000 7f5343e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534c102fd0 0x7f534c074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.305+0000 7f5343e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534c102fd0 0x7f534c074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43664/0 (socket says 172.21.15.2:43664) 2024-06-13T11:29:51.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.305+0000 7f5343e00700 1 -- 172.21.15.2:0/2457014641 learned_addr learned my addr 172.21.15.2:0/2457014641 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:51.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.305+0000 7f534aa00700 1 --2- 172.21.15.2:0/2457014641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f534c102620 0x7f534c074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.305+0000 7f534b400700 1 --2- 172.21.15.2:0/2457014641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f534c107700 0x7f534c075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.306+0000 7f534aa00700 1 -- 172.21.15.2:0/2457014641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f534c107700 msgr2=0x7f534c075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:51.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.306+0000 7f534aa00700 1 --2- 172.21.15.2:0/2457014641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f534c107700 0x7f534c075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.306+0000 7f534aa00700 1 -- 172.21.15.2:0/2457014641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534c102fd0 msgr2=0x7f534c074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:51.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.306+0000 7f534aa00700 1 --2- 172.21.15.2:0/2457014641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534c102fd0 0x7f534c074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.306+0000 7f534aa00700 1 -- 172.21.15.2:0/2457014641 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534c1a70c0 con 0x7f534c102620 2024-06-13T11:29:51.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.306+0000 7f5343e00700 1 --2- 172.21.15.2:0/2457014641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534c102fd0 0x7f534c074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:29:51.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.306+0000 7f534aa00700 1 --2- 172.21.15.2:0/2457014641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f534c102620 0x7f534c074790 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f533c00e9f0 tx=0x7f533c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:51.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.307+0000 7f5343400700 1 -- 172.21.15.2:0/2457014641 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c004220 con 0x7f534c102620 2024-06-13T11:29:51.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.307+0000 7f5343400700 1 -- 172.21.15.2:0/2457014641 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f533c004d10 con 0x7f534c102620 2024-06-13T11:29:51.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.307+0000 7f534be00700 1 -- 172.21.15.2:0/2457014641 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534c1a73b0 con 0x7f534c102620 2024-06-13T11:29:51.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.307+0000 7f5343400700 1 -- 172.21.15.2:0/2457014641 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c005020 con 0x7f534c102620 2024-06-13T11:29:51.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.307+0000 7f534be00700 1 -- 172.21.15.2:0/2457014641 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f534c1a78a0 con 0x7f534c102620 2024-06-13T11:29:51.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.310+0000 7f5343400700 1 -- 172.21.15.2:0/2457014641 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f533c004750 con 0x7f534c102620 2024-06-13T11:29:51.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.311+0000 7f535c4a7b80 1 Processor -- start 2024-06-13T11:29:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.312+0000 7f535c4a7b80 1 -- start start 2024-06-13T11:29:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.312+0000 7f5343400700 1 --2- 172.21.15.2:0/2457014641 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f53300a2d90 0x7f53300a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.312+0000 7f535c4a7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb64355ec0 0x55fb643db4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.312+0000 7f535c4a7b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb643db9e0 0x55fb643dbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.312+0000 7f535c4a7b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643e45f0 0x55fb643e69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.312+0000 7f535c4a7b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fb642e8a90 con 0x55fb643e45f0 2024-06-13T11:29:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.312+0000 7f535c4a7b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fb6432bb80 con 0x55fb643db9e0 2024-06-13T11:29:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.312+0000 7f535c4a7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55fb642e6970 con 0x55fb64355ec0 2024-06-13T11:29:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.312+0000 7f5343400700 1 -- 172.21.15.2:0/2457014641 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f533c0cf6d0 con 0x7f534c102620 2024-06-13T11:29:51.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.312+0000 7f534b400700 1 --2- 172.21.15.2:0/2457014641 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f53300a2d90 0x7f53300a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.312+0000 7f534aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb64355ec0 0x55fb643db4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.312+0000 7f534aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb64355ec0 0x55fb643db4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:44526/0 (socket says 172.21.15.2:44526) 2024-06-13T11:29:51.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.312+0000 7f534aa00700 1 -- 172.21.15.2:0/1128912249 learned_addr learned my addr 172.21.15.2:0/1128912249 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:51.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.313+0000 7f5343e00700 1 --2- 172.21.15.2:0/1128912249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb643db9e0 0x55fb643dbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.313+0000 7f534b400700 1 --2- 172.21.15.2:0/1128912249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643e45f0 0x55fb643e69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.313+0000 7f534aa00700 1 -- 172.21.15.2:0/1128912249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb643db9e0 msgr2=0x55fb643dbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:51.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.313+0000 7f534aa00700 1 --2- 172.21.15.2:0/1128912249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb643db9e0 0x55fb643dbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.313+0000 7f534aa00700 1 -- 172.21.15.2:0/1128912249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643e45f0 msgr2=0x55fb643e69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.313+0000 7f534aa00700 1 --2- 172.21.15.2:0/1128912249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643e45f0 0x55fb643e69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.313+0000 7f534aa00700 1 -- 172.21.15.2:0/1128912249 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb642d4010 con 0x55fb64355ec0 2024-06-13T11:29:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.313+0000 7f534b400700 1 --2- 172.21.15.2:0/2457014641 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f53300a2d90 0x7f53300a5250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5344009ec0 tx=0x7f5344008ad0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.313+0000 7f534aa00700 1 --2- 172.21.15.2:0/1128912249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb64355ec0 0x55fb643db4a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f533c0981f0 tx=0x7f533c097bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8105f2ec57094c1b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.314+0000 7f533be00700 1 -- 172.21.15.2:0/1128912249 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c01c040 con 0x55fb64355ec0 2024-06-13T11:29:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.314+0000 7f533be00700 1 -- 172.21.15.2:0/1128912249 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f533c09bf20 con 0x55fb64355ec0 2024-06-13T11:29:51.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.314+0000 7f533be00700 1 -- 172.21.15.2:0/1128912249 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c00c760 con 0x55fb64355ec0 2024-06-13T11:29:51.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.314+0000 7f535c4a7b80 1 -- 172.21.15.2:0/1128912249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb64355ec0 msgr2=0x55fb643db4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:51.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.314+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/1128912249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb64355ec0 0x55fb643db4a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f533c0981f0 tx=0x7f533c097bf0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.315+0000 7f535c4a7b80 1 -- 172.21.15.2:0/1128912249 shutdown_connections 2024-06-13T11:29:51.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.315+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/1128912249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643e45f0 0x55fb643e69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.315+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/1128912249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb64355ec0 0x55fb643db4a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.315+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/1128912249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb643db9e0 0x55fb643dbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.315+0000 7f535c4a7b80 1 -- 172.21.15.2:0/1128912249 >> 172.21.15.2:0/1128912249 conn(0x55fb643061f0 msgr2=0x55fb643d58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:51.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.315+0000 7f535c4a7b80 1 -- 172.21.15.2:0/1128912249 shutdown_connections 2024-06-13T11:29:51.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.315+0000 7f535c4a7b80 1 -- 172.21.15.2:0/1128912249 wait complete. 2024-06-13T11:29:51.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.315+0000 7f535c4a7b80 1 -- start start 2024-06-13T11:29:51.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.316+0000 7f535c4a7b80 1 Processor -- start 2024-06-13T11:29:51.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.316+0000 7f535c4a7b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 0x55fb643e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.316+0000 7f535c4a7b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643e1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.316+0000 7f535c4a7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 0x55fb643e1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.316+0000 7f535c4a7b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fb642c7fe0 con 0x55fb643db9e0 2024-06-13T11:29:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.316+0000 7f535c4a7b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fb64327b40 con 0x55fb64355ec0 2024-06-13T11:29:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.316+0000 7f535c4a7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55fb643e7200 con 0x55fb643e45f0 2024-06-13T11:29:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.316+0000 7f535c4a7b80 10 client.0 _ll_register_callbacks cb 0x55fb642c57a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:29:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.317+0000 7f5343e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.317+0000 7f5343e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643e1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43672/0 (socket says 172.21.15.2:43672) 2024-06-13T11:29:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.317+0000 7f5343e00700 1 -- 172.21.15.2:0/2394346394 learned_addr learned my addr 172.21.15.2:0/2394346394 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:51.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.317+0000 7f534aa00700 1 --2- 172.21.15.2:0/2394346394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 0x55fb643e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.317+0000 7f534b400700 1 --2- 172.21.15.2:0/2394346394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 0x55fb643e1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.317+0000 7f534b400700 1 -- 172.21.15.2:0/2394346394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 msgr2=0x55fb643e3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.317+0000 7f534b400700 1 --2- 172.21.15.2:0/2394346394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 0x55fb643e3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.317+0000 7f534b400700 1 -- 172.21.15.2:0/2394346394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 msgr2=0x55fb643e1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.317+0000 7f534b400700 1 --2- 172.21.15.2:0/2394346394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643e1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.317+0000 7f534b400700 1 -- 172.21.15.2:0/2394346394 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb6427a950 con 0x55fb643e45f0 2024-06-13T11:29:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.317+0000 7f5343e00700 1 --2- 172.21.15.2:0/2394346394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643e1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:29:51.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.317+0000 7f534aa00700 1 --2- 172.21.15.2:0/2394346394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 0x55fb643e3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:29:51.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.318+0000 7f534b400700 1 --2- 172.21.15.2:0/2394346394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 0x55fb643e1650 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5344009fd0 tx=0x7f534400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3bd1d60fab68ab8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:51.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.318+0000 7f5338c00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:29:51.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.318+0000 7f5338c00700 1 -- 172.21.15.2:0/2394346394 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534401a650 con 0x55fb643e45f0 2024-06-13T11:29:51.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.318+0000 7f535c4a7b80 1 -- 172.21.15.2:0/2394346394 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f533c09bf20 con 0x55fb643e45f0 2024-06-13T11:29:51.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.318+0000 7f5338c00700 1 -- 172.21.15.2:0/2394346394 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f534401a7f0 con 0x55fb643e45f0 2024-06-13T11:29:51.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.319+0000 7f5338c00700 1 -- 172.21.15.2:0/2394346394 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5344032050 con 0x55fb643e45f0 2024-06-13T11:29:51.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.319+0000 7f535c4a7b80 10 client.26059 fetch_fsmap learned FSMap version 31 2024-06-13T11:29:51.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.319+0000 7f535c4a7b80 1 -- 172.21.15.2:0/2394346394 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55fb643f19d0 con 0x55fb643e45f0 2024-06-13T11:29:51.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.319+0000 7f5338c00700 1 -- 172.21.15.2:0/2394346394 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f533c09bf20 con 0x55fb643e45f0 2024-06-13T11:29:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.319+0000 7f5338c00700 1 -- 172.21.15.2:0/2394346394 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f5344024c30 con 0x55fb643e45f0 2024-06-13T11:29:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.319+0000 7f535c4a7b80 10 client.26059 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:29:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.319+0000 7f535c4a7b80 10 client.26059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:29:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.319+0000 7f535c4a7b80 20 client.26059 populate_metadata read hostname 'smithi002' 2024-06-13T11:29:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.319+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/2394346394 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55fb643f4060 0x55fb643f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.319+0000 7f535c4a7b80 4 client.26059 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:29:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.319+0000 7f535c4a7b80 1 -- 172.21.15.2:0/2394346394 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb64339080 con 0x55fb643f4060 2024-06-13T11:29:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.320+0000 7f534aa00700 1 --2- 172.21.15.2:0/2394346394 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55fb643f4060 0x55fb643f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.320+0000 7f534aa00700 1 --2- 172.21.15.2:0/2394346394 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55fb643f4060 0x55fb643f64a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd62f408a17e992e server_cookie=ab17927f84ca540b in_seq=0 out_seq=0 2024-06-13T11:29:51.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.320+0000 7f5338c00700 10 client.26059 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:29:51.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.321+0000 7f5338c00700 1 -- 172.21.15.2:0/2394346394 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fb64339080 con 0x55fb643f4060 2024-06-13T11:29:51.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.321+0000 7f5338c00700 10 client.26059 handle_command_reply: tid=0 2024-06-13T11:29:51.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.321+0000 7f535c4a7b80 1 client.26059 shutdown 2024-06-13T11:29:51.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.321+0000 7f535c4a7b80 1 -- 172.21.15.2:0/2394346394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 msgr2=0x55fb643e1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:51.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.321+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/2394346394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 0x55fb643e1650 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5344009fd0 tx=0x7f534400b040 comp rx=0 tx=0).stop 2024-06-13T11:29:51.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.321+0000 7f535c4a7b80 1 -- 172.21.15.2:0/2394346394 shutdown_connections 2024-06-13T11:29:51.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.321+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/2394346394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 0x55fb643e1650 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.321+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/2394346394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 0x55fb643e3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.321+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/2394346394 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55fb643f4060 0x55fb643f64a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.321+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/2394346394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643e1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.321+0000 7f535c4a7b80 1 -- 172.21.15.2:0/2394346394 >> 172.21.15.2:0/2394346394 conn(0x55fb643061f0 msgr2=0x55fb643d5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.321+0000 7f5338c00700 0 client.26059 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:29:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.322+0000 7f535c4a7b80 1 -- 172.21.15.2:0/2394346394 shutdown_connections 2024-06-13T11:29:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.322+0000 7f535c4a7b80 1 -- 172.21.15.2:0/2394346394 wait complete. 2024-06-13T11:29:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.322+0000 7f535c4a7b80 20 client.26059 trim_cache size 0 max 16384 2024-06-13T11:29:51.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.345+0000 7f535c4a7b80 1 Processor -- start 2024-06-13T11:29:51.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.345+0000 7f535c4a7b80 1 -- start start 2024-06-13T11:29:51.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.345+0000 7f535c4a7b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 0x55fb643fbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.345+0000 7f535c4a7b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643fc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.345+0000 7f535c4a7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 0x55fb643de390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.345+0000 7f535c4a7b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1b2df0 con 0x55fb643db9e0 2024-06-13T11:29:51.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.345+0000 7f535c4a7b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1b0680 con 0x55fb64355ec0 2024-06-13T11:29:51.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.345+0000 7f535c4a7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1ae4d0 con 0x55fb643e45f0 2024-06-13T11:29:51.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.346+0000 7f5343e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643fc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.346+0000 7f5343e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643fc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43682/0 (socket says 172.21.15.2:43682) 2024-06-13T11:29:51.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.346+0000 7f5343e00700 1 -- 172.21.15.2:0/4142136805 learned_addr learned my addr 172.21.15.2:0/4142136805 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:51.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.346+0000 7f534aa00700 1 --2- 172.21.15.2:0/4142136805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 0x55fb643fbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.346+0000 7f534b400700 1 --2- 172.21.15.2:0/4142136805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 0x55fb643de390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.346+0000 7f534aa00700 1 -- 172.21.15.2:0/4142136805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 msgr2=0x55fb643de390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:51.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.346+0000 7f534aa00700 1 --2- 172.21.15.2:0/4142136805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 0x55fb643de390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.346+0000 7f534aa00700 1 -- 172.21.15.2:0/4142136805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 msgr2=0x55fb643fc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:51.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.346+0000 7f534aa00700 1 --2- 172.21.15.2:0/4142136805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643fc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.346+0000 7f534aa00700 1 -- 172.21.15.2:0/4142136805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb643df680 con 0x55fb64355ec0 2024-06-13T11:29:51.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.347+0000 7f5343e00700 1 --2- 172.21.15.2:0/4142136805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643fc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:29:51.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.347+0000 7f534b400700 1 --2- 172.21.15.2:0/4142136805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 0x55fb643de390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:29:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.347+0000 7f534aa00700 1 --2- 172.21.15.2:0/4142136805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 0x55fb643fbd70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f533c0981f0 tx=0x7f533c086040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69f01759fb5b82ed server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.347+0000 7f533b400700 1 -- 172.21.15.2:0/4142136805 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c07e040 con 0x55fb64355ec0 2024-06-13T11:29:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.347+0000 7f533b400700 1 -- 172.21.15.2:0/4142136805 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f533c09b820 con 0x55fb64355ec0 2024-06-13T11:29:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.347+0000 7f533b400700 1 -- 172.21.15.2:0/4142136805 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c01c040 con 0x55fb64355ec0 2024-06-13T11:29:51.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.348+0000 7f535c4a7b80 1 -- 172.21.15.2:0/4142136805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 msgr2=0x55fb643fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:51.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.348+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/4142136805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 0x55fb643fbd70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f533c0981f0 tx=0x7f533c086040 comp rx=0 tx=0).stop 2024-06-13T11:29:51.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.348+0000 7f535c4a7b80 1 -- 172.21.15.2:0/4142136805 shutdown_connections 2024-06-13T11:29:51.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.348+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/4142136805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 0x55fb643de390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.348+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/4142136805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 0x55fb643fbd70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.348+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/4142136805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643fc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.348+0000 7f535c4a7b80 1 -- 172.21.15.2:0/4142136805 >> 172.21.15.2:0/4142136805 conn(0x55fb643061f0 msgr2=0x55fb643e31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:51.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.348+0000 7f535c4a7b80 1 -- 172.21.15.2:0/4142136805 shutdown_connections 2024-06-13T11:29:51.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.348+0000 7f535c4a7b80 1 -- 172.21.15.2:0/4142136805 wait complete. 2024-06-13T11:29:51.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.349+0000 7f535c4a7b80 1 -- start start 2024-06-13T11:29:51.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.349+0000 7f535c4a7b80 1 Processor -- start 2024-06-13T11:29:51.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.349+0000 7f535c4a7b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 0x55fb643e8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.349+0000 7f535c4a7b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643e8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.349+0000 7f535c4a7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 0x55fb6445dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.349+0000 7f535c4a7b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1aeb40 con 0x55fb643db9e0 2024-06-13T11:29:51.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.349+0000 7f535c4a7b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1affb0 con 0x55fb64355ec0 2024-06-13T11:29:51.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.349+0000 7f535c4a7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1af210 con 0x55fb643e45f0 2024-06-13T11:29:51.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.349+0000 7f535c4a7b80 10 client.0 _ll_register_callbacks cb 0x55fb642c57a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:29:51.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.350+0000 7f534b400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 0x55fb6445dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.350+0000 7f534aa00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 0x55fb643e8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.350+0000 7f534b400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 0x55fb6445dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:44546/0 (socket says 172.21.15.2:44546) 2024-06-13T11:29:51.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.350+0000 7f534b400700 1 -- 172.21.15.2:0/126364997 learned_addr learned my addr 172.21.15.2:0/126364997 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:51.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.350+0000 7f5343e00700 1 --2- 172.21.15.2:0/126364997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643e8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.350+0000 7f534b400700 1 -- 172.21.15.2:0/126364997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 msgr2=0x55fb643e8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:51.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.350+0000 7f534b400700 1 --2- 172.21.15.2:0/126364997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 0x55fb643e8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.350+0000 7f534b400700 1 -- 172.21.15.2:0/126364997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 msgr2=0x55fb643e8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:51.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.350+0000 7f534b400700 1 --2- 172.21.15.2:0/126364997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643e8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.350+0000 7f534b400700 1 -- 172.21.15.2:0/126364997 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb6445e280 con 0x55fb643e45f0 2024-06-13T11:29:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.350+0000 7f5343e00700 1 --2- 172.21.15.2:0/126364997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643e8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:29:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.351+0000 7f534b400700 1 --2- 172.21.15.2:0/126364997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 0x55fb6445dd40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5344024fd0 tx=0x7f5344005e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfb5cab7b14c3726 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:51.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.351+0000 7f5338c00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:29:51.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.351+0000 7f5338c00700 1 -- 172.21.15.2:0/126364997 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344044060 con 0x55fb643e45f0 2024-06-13T11:29:51.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.351+0000 7f535c4a7b80 1 -- 172.21.15.2:0/126364997 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f533c09b820 con 0x55fb643e45f0 2024-06-13T11:29:51.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.351+0000 7f5338c00700 1 -- 172.21.15.2:0/126364997 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f5344012040 con 0x55fb643e45f0 2024-06-13T11:29:51.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.351+0000 7f5338c00700 1 -- 172.21.15.2:0/126364997 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f534404b050 con 0x55fb643e45f0 2024-06-13T11:29:51.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.351+0000 7f535c4a7b80 10 client.26065 fetch_fsmap learned FSMap version 31 2024-06-13T11:29:51.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.351+0000 7f535c4a7b80 1 -- 172.21.15.2:0/126364997 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55fb6445f4b0 con 0x55fb643e45f0 2024-06-13T11:29:51.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.352+0000 7f5338c00700 1 -- 172.21.15.2:0/126364997 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f533c09b820 con 0x55fb643e45f0 2024-06-13T11:29:51.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.352+0000 7f5338c00700 1 -- 172.21.15.2:0/126364997 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f5344004190 con 0x55fb643e45f0 2024-06-13T11:29:51.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.352+0000 7f535c4a7b80 10 client.26065 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:29:51.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.352+0000 7f535c4a7b80 10 client.26065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:29:51.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.352+0000 7f535c4a7b80 20 client.26065 populate_metadata read hostname 'smithi002' 2024-06-13T11:29:51.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.352+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/126364997 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55fb6445fbc0 0x55fb64461fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:51.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.352+0000 7f535c4a7b80 4 client.26065 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-13T11:29:51.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.352+0000 7f535c4a7b80 1 -- 172.21.15.2:0/126364997 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fb64333600 con 0x55fb6445fbc0 2024-06-13T11:29:51.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.353+0000 7f534aa00700 1 --2- 172.21.15.2:0/126364997 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55fb6445fbc0 0x55fb64461fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:51.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.353+0000 7f534aa00700 1 --2- 172.21.15.2:0/126364997 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55fb6445fbc0 0x55fb64461fe0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=775b6db4c99317ff server_cookie=eab33c110f8fd2cb in_seq=0 out_seq=0 2024-06-13T11:29:51.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.353+0000 7f5338c00700 10 client.26065 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:29:51.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.354+0000 7f5338c00700 1 -- 172.21.15.2:0/126364997 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fb64333600 con 0x55fb6445fbc0 2024-06-13T11:29:51.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.354+0000 7f5338c00700 10 client.26065 handle_command_reply: tid=0 2024-06-13T11:29:51.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.354+0000 7f535c4a7b80 1 client.26065 shutdown 2024-06-13T11:29:51.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.355+0000 7f535c4a7b80 1 -- 172.21.15.2:0/126364997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 msgr2=0x55fb6445dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:51.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.355+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/126364997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 0x55fb6445dd40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5344024fd0 tx=0x7f5344005e90 comp rx=0 tx=0).stop 2024-06-13T11:29:51.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.355+0000 7f535c4a7b80 1 -- 172.21.15.2:0/126364997 shutdown_connections 2024-06-13T11:29:51.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.355+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/126364997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb643e45f0 0x55fb6445dd40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.355+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/126364997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fb64355ec0 0x55fb643e8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.355+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/126364997 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55fb6445fbc0 0x55fb64461fe0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.355+0000 7f535c4a7b80 1 --2- 172.21.15.2:0/126364997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fb643db9e0 0x55fb643e8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.355+0000 7f535c4a7b80 1 -- 172.21.15.2:0/126364997 >> 172.21.15.2:0/126364997 conn(0x55fb643061f0 msgr2=0x55fb643e2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:51.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.355+0000 7f5338c00700 0 client.26065 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:29:51.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.355+0000 7f535c4a7b80 1 -- 172.21.15.2:0/126364997 shutdown_connections 2024-06-13T11:29:51.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.355+0000 7f535c4a7b80 1 -- 172.21.15.2:0/126364997 wait complete. 2024-06-13T11:29:51.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.355+0000 7f535c4a7b80 20 client.26065 trim_cache size 0 max 16384 2024-06-13T11:29:51.359 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:29:51.359 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-06-13T11:29:51.359 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "ea5f53a1-f4c9-41d4-b66f-ee634344afd3", 2024-06-13T11:29:51.359 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-06-13T11:29:51.359 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:29:51.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.356+0000 7f534be00700 1 -- 172.21.15.2:0/2457014641 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f53300a2d90 msgr2=0x7f53300a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:51.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.356+0000 7f534be00700 1 --2- 172.21.15.2:0/2457014641 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f53300a2d90 0x7f53300a5250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5344009ec0 tx=0x7f5344008ad0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.356+0000 7f534be00700 1 -- 172.21.15.2:0/2457014641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f534c102620 msgr2=0x7f534c074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:51.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.356+0000 7f534be00700 1 --2- 172.21.15.2:0/2457014641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f534c102620 0x7f534c074790 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f533c00e9f0 tx=0x7f533c00ed00 comp rx=0 tx=0).stop 2024-06-13T11:29:51.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.356+0000 7f534be00700 1 -- 172.21.15.2:0/2457014641 shutdown_connections 2024-06-13T11:29:51.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.356+0000 7f534be00700 1 --2- 172.21.15.2:0/2457014641 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f53300a2d90 0x7f53300a5250 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.356+0000 7f534be00700 1 --2- 172.21.15.2:0/2457014641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f534c107700 0x7f534c075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.356+0000 7f534be00700 1 --2- 172.21.15.2:0/2457014641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f534c102620 0x7f534c074790 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.356+0000 7f534be00700 1 --2- 172.21.15.2:0/2457014641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534c102fd0 0x7f534c074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.356+0000 7f534be00700 1 -- 172.21.15.2:0/2457014641 >> 172.21.15.2:0/2457014641 conn(0x7f534c0fdf10 msgr2=0x7f534c1001c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.356+0000 7f534be00700 1 -- 172.21.15.2:0/2457014641 shutdown_connections 2024-06-13T11:29:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:51.357+0000 7f534be00700 1 -- 172.21.15.2:0/2457014641 wait complete. 2024-06-13T11:29:51.802 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:51 smithi002 ceph-mon[32210]: pgmap v185: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:51.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:51 smithi002 ceph-mon[32210]: scrub queued for path: / 2024-06-13T11:29:51.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:51 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:29:51.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:51 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:29:51.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:51 smithi178 ceph-mon[36913]: pgmap v185: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:51.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:51 smithi178 ceph-mon[36913]: scrub queued for path: / 2024-06-13T11:29:51.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:51 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:29:51.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:51 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:29:52.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:51 smithi077 ceph-mon[36410]: pgmap v185: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:29:52.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:51 smithi077 ceph-mon[36410]: scrub queued for path: / 2024-06-13T11:29:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:51 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:29:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:51 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:29:52.352 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:29:52.829 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:29:52.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:52 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:29:52.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:52 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:29:52.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:52 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:29:52.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:52 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:29:52.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:52 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:29:52.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:52 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:29:52.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:52 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:29:52.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:52 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:29:52.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:52 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:29:52.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:52 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:29:53.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:52 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:29:53.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:52 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:29:53.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:52 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:29:53.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:52 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:29:53.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:52 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:29:53.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:53 smithi002 ceph-mon[32210]: pgmap v186: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:29:53.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:53 smithi178 ceph-mon[36913]: pgmap v186: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:29:54.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:53 smithi077 ceph-mon[36410]: pgmap v186: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:29:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.207+0000 7fe441c00700 1 -- 172.21.15.2:0/3369492452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43c1084f0 msgr2=0x7fe43c1088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.207+0000 7fe441c00700 1 --2- 172.21.15.2:0/3369492452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43c1084f0 0x7fe43c1088d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009990 tx=0x7fe42c009ca0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.207+0000 7fe441c00700 1 -- 172.21.15.2:0/3369492452 shutdown_connections 2024-06-13T11:29:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.207+0000 7fe441c00700 1 --2- 172.21.15.2:0/3369492452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43c1084f0 0x7fe43c1088d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.207+0000 7fe441c00700 1 --2- 172.21.15.2:0/3369492452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c102f10 0x7fe43c10f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.207+0000 7fe441c00700 1 --2- 172.21.15.2:0/3369492452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe43c102550 0x7fe43c1029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.207+0000 7fe441c00700 1 -- 172.21.15.2:0/3369492452 >> 172.21.15.2:0/3369492452 conn(0x7fe43c079650 msgr2=0x7fe43c079a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.207+0000 7fe441c00700 1 -- 172.21.15.2:0/3369492452 shutdown_connections 2024-06-13T11:29:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.207+0000 7fe441c00700 1 -- 172.21.15.2:0/3369492452 wait complete. 2024-06-13T11:29:55.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.208+0000 7fe441c00700 1 Processor -- start 2024-06-13T11:29:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.208+0000 7fe441c00700 1 -- start start 2024-06-13T11:29:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.209+0000 7fe441c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43c102550 0x7fe43c19ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.209+0000 7fe441c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c102f10 0x7fe43c19b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.209+0000 7fe441c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe43c1084f0 0x7fe43c19f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.209+0000 7fe441c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c1127a0 con 0x7fe43c102550 2024-06-13T11:29:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.209+0000 7fe441c00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c112620 con 0x7fe43c102f10 2024-06-13T11:29:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.209+0000 7fe441c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c112920 con 0x7fe43c1084f0 2024-06-13T11:29:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.209+0000 7fe43aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43c102550 0x7fe43c19ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.209+0000 7fe43b400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe43c1084f0 0x7fe43c19f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.209+0000 7fe43a000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c102f10 0x7fe43c19b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.209+0000 7fe43aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43c102550 0x7fe43c19ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43710/0 (socket says 172.21.15.2:43710) 2024-06-13T11:29:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.209+0000 7fe43aa00700 1 -- 172.21.15.2:0/1058951469 learned_addr learned my addr 172.21.15.2:0/1058951469 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.210+0000 7fe43aa00700 1 -- 172.21.15.2:0/1058951469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe43c1084f0 msgr2=0x7fe43c19f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.210+0000 7fe43aa00700 1 --2- 172.21.15.2:0/1058951469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe43c1084f0 0x7fe43c19f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.210+0000 7fe43aa00700 1 -- 172.21.15.2:0/1058951469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c102f10 msgr2=0x7fe43c19b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.210+0000 7fe43aa00700 1 --2- 172.21.15.2:0/1058951469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c102f10 0x7fe43c19b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.210+0000 7fe43aa00700 1 -- 172.21.15.2:0/1058951469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43c19fe30 con 0x7fe43c102550 2024-06-13T11:29:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.210+0000 7fe43b400700 1 --2- 172.21.15.2:0/1058951469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe43c1084f0 0x7fe43c19f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:29:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.210+0000 7fe43a000700 1 --2- 172.21.15.2:0/1058951469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c102f10 0x7fe43c19b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:29:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.210+0000 7fe43aa00700 1 --2- 172.21.15.2:0/1058951469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43c102550 0x7fe43c19ae20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe42c005910 tx=0x7fe42c00bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.210+0000 7fe433400700 1 -- 172.21.15.2:0/1058951469 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c027070 con 0x7fe43c102550 2024-06-13T11:29:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.210+0000 7fe433400700 1 -- 172.21.15.2:0/1058951469 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe42c003d70 con 0x7fe43c102550 2024-06-13T11:29:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.210+0000 7fe441c00700 1 -- 172.21.15.2:0/1058951469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe43c1a00c0 con 0x7fe43c102550 2024-06-13T11:29:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.211+0000 7fe433400700 1 -- 172.21.15.2:0/1058951469 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c00f460 con 0x7fe43c102550 2024-06-13T11:29:55.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.211+0000 7fe441c00700 1 -- 172.21.15.2:0/1058951469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe43c1a79a0 con 0x7fe43c102550 2024-06-13T11:29:55.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.214+0000 7fe433400700 1 -- 172.21.15.2:0/1058951469 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fe42c02a070 con 0x7fe43c102550 2024-06-13T11:29:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.215+0000 7fe44c5b1b80 1 Processor -- start 2024-06-13T11:29:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.215+0000 7fe433400700 1 --2- 172.21.15.2:0/1058951469 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe4200a2e10 0x7fe4200a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.216+0000 7fe44c5b1b80 1 -- start start 2024-06-13T11:29:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.216+0000 7fe433400700 1 -- 172.21.15.2:0/1058951469 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fe42c0d05f0 con 0x7fe43c102550 2024-06-13T11:29:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.216+0000 7fe43b400700 1 --2- 172.21.15.2:0/1058951469 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe4200a2e10 0x7fe4200a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.216+0000 7fe44c5b1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41f4b90 0x55a5d41f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.216+0000 7fe44c5b1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d41f54b0 0x55a5d41eed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.216+0000 7fe44c5b1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41ef240 0x55a5d41ef680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.216+0000 7fe44c5b1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a5d40fda10 con 0x55a5d41f4b90 2024-06-13T11:29:55.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.216+0000 7fe44c5b1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a5d4140b00 con 0x55a5d41f54b0 2024-06-13T11:29:55.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.216+0000 7fe44c5b1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a5d40fb8f0 con 0x55a5d41ef240 2024-06-13T11:29:55.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.216+0000 7fe43aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41f4b90 0x55a5d41f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.217+0000 7fe43aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41f4b90 0x55a5d41f4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43722/0 (socket says 172.21.15.2:43722) 2024-06-13T11:29:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.217+0000 7fe43aa00700 1 -- 172.21.15.2:0/4283489065 learned_addr learned my addr 172.21.15.2:0/4283489065 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.217+0000 7fe43b400700 1 --2- 172.21.15.2:0/4283489065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41ef240 0x55a5d41ef680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.217+0000 7fe43a000700 1 --2- 172.21.15.2:0/4283489065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d41f54b0 0x55a5d41eed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.217+0000 7fe43b400700 1 --2- 172.21.15.2:0/1058951469 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe4200a2e10 0x7fe4200a52d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe434003e80 tx=0x7fe43400b040 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.217+0000 7fe43b400700 1 -- 172.21.15.2:0/4283489065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d41f54b0 msgr2=0x55a5d41eed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.217+0000 7fe43b400700 1 --2- 172.21.15.2:0/4283489065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d41f54b0 0x55a5d41eed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.217+0000 7fe43b400700 1 -- 172.21.15.2:0/4283489065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41f4b90 msgr2=0x55a5d41f4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.217+0000 7fe43b400700 1 --2- 172.21.15.2:0/4283489065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41f4b90 0x55a5d41f4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.217+0000 7fe43b400700 1 -- 172.21.15.2:0/4283489065 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d40e8f90 con 0x55a5d41ef240 2024-06-13T11:29:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.218+0000 7fe43b400700 1 --2- 172.21.15.2:0/4283489065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41ef240 0x55a5d41ef680 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe4340046b0 tx=0x7fe43401c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4c1468126f52ae3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.218+0000 7fe427e00700 1 -- 172.21.15.2:0/4283489065 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe434026070 con 0x55a5d41ef240 2024-06-13T11:29:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.218+0000 7fe427e00700 1 -- 172.21.15.2:0/4283489065 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe434019d50 con 0x55a5d41ef240 2024-06-13T11:29:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.218+0000 7fe427e00700 1 -- 172.21.15.2:0/4283489065 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43401d070 con 0x55a5d41ef240 2024-06-13T11:29:55.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.219+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/4283489065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41ef240 msgr2=0x55a5d41ef680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:55.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.219+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/4283489065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41ef240 0x55a5d41ef680 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe4340046b0 tx=0x7fe43401c000 comp rx=0 tx=0).stop 2024-06-13T11:29:55.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.219+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/4283489065 shutdown_connections 2024-06-13T11:29:55.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.219+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/4283489065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41f4b90 0x55a5d41f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.219+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/4283489065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41ef240 0x55a5d41ef680 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.219+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/4283489065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d41f54b0 0x55a5d41eed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.219+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/4283489065 >> 172.21.15.2:0/4283489065 conn(0x55a5d411b170 msgr2=0x55a5d41e9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:55.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.219+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/4283489065 shutdown_connections 2024-06-13T11:29:55.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.219+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/4283489065 wait complete. 2024-06-13T11:29:55.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.220+0000 7fe44c5b1b80 1 -- start start 2024-06-13T11:29:55.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.220+0000 7fe44c5b1b80 1 Processor -- start 2024-06-13T11:29:55.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.220+0000 7fe44c5b1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d41ef240 0x55a5d41fb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.220+0000 7fe44c5b1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41f4b90 0x55a5d41f8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.221+0000 7fe44c5b1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41f54b0 0x55a5d41f8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.221+0000 7fe44c5b1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a5d40dcf60 con 0x55a5d41f4b90 2024-06-13T11:29:55.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.221+0000 7fe44c5b1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a5d413cac0 con 0x55a5d41ef240 2024-06-13T11:29:55.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.221+0000 7fe44c5b1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a5d41fbe90 con 0x55a5d41f54b0 2024-06-13T11:29:55.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.221+0000 7fe44c5b1b80 10 client.0 _ll_register_callbacks cb 0x55a5d40d6380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:29:55.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.221+0000 7fe43a000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41f4b90 0x55a5d41f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.221+0000 7fe43aa00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d41ef240 0x55a5d41fb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.221+0000 7fe43a000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41f4b90 0x55a5d41f8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43738/0 (socket says 172.21.15.2:43738) 2024-06-13T11:29:55.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.221+0000 7fe43a000700 1 -- 172.21.15.2:0/2267324702 learned_addr learned my addr 172.21.15.2:0/2267324702 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:55.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.221+0000 7fe43b400700 1 --2- 172.21.15.2:0/2267324702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41f54b0 0x55a5d41f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.221+0000 7fe43a000700 1 -- 172.21.15.2:0/2267324702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41f54b0 msgr2=0x55a5d41f8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:55.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.221+0000 7fe43a000700 1 --2- 172.21.15.2:0/2267324702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41f54b0 0x55a5d41f8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.221+0000 7fe43a000700 1 -- 172.21.15.2:0/2267324702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d41ef240 msgr2=0x55a5d41fb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:55.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.221+0000 7fe43a000700 1 --2- 172.21.15.2:0/2267324702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d41ef240 0x55a5d41fb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.221+0000 7fe43a000700 1 -- 172.21.15.2:0/2267324702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d408f8d0 con 0x55a5d41f4b90 2024-06-13T11:29:55.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.221+0000 7fe43aa00700 1 --2- 172.21.15.2:0/2267324702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d41ef240 0x55a5d41fb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:29:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.222+0000 7fe43a000700 1 --2- 172.21.15.2:0/2267324702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41f4b90 0x55a5d41f8560 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe428011800 tx=0x7fe428011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d0b0b302bf57db server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.222+0000 7fe424c00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:29:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.222+0000 7fe424c00700 1 -- 172.21.15.2:0/2267324702 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe428004320 con 0x55a5d41f4b90 2024-06-13T11:29:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.222+0000 7fe424c00700 1 -- 172.21.15.2:0/2267324702 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fe4280044c0 con 0x55a5d41f4b90 2024-06-13T11:29:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.222+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/2267324702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe434019d50 con 0x55a5d41f4b90 2024-06-13T11:29:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.222+0000 7fe424c00700 1 -- 172.21.15.2:0/2267324702 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe428024050 con 0x55a5d41f4b90 2024-06-13T11:29:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.223+0000 7fe44c5b1b80 10 client.15933 fetch_fsmap learned FSMap version 31 2024-06-13T11:29:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.223+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/2267324702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a5d42066b0 con 0x55a5d41f4b90 2024-06-13T11:29:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.223+0000 7fe424c00700 1 -- 172.21.15.2:0/2267324702 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe434019d50 con 0x55a5d41f4b90 2024-06-13T11:29:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.223+0000 7fe424c00700 1 -- 172.21.15.2:0/2267324702 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fe428010ab0 con 0x55a5d41f4b90 2024-06-13T11:29:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.223+0000 7fe44c5b1b80 10 client.15933 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:29:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.223+0000 7fe44c5b1b80 10 client.15933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:29:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.223+0000 7fe44c5b1b80 20 client.15933 populate_metadata read hostname 'smithi002' 2024-06-13T11:29:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.223+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/2267324702 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a5d4208d40 0x55a5d420b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.223+0000 7fe44c5b1b80 4 client.15933 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:29:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.223+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/2267324702 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5d414e000 con 0x55a5d4208d40 2024-06-13T11:29:55.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.224+0000 7fe43aa00700 1 --2- 172.21.15.2:0/2267324702 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a5d4208d40 0x55a5d420b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.224+0000 7fe43aa00700 1 --2- 172.21.15.2:0/2267324702 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a5d4208d40 0x55a5d420b130 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de8d51c025b297eb server_cookie=73b9c35002a62413 in_seq=0 out_seq=0 2024-06-13T11:29:55.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.224+0000 7fe424c00700 10 client.15933 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:29:55.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.225+0000 7fe424c00700 1 -- 172.21.15.2:0/2267324702 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a5d414e000 con 0x55a5d4208d40 2024-06-13T11:29:55.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.225+0000 7fe424c00700 10 client.15933 handle_command_reply: tid=0 2024-06-13T11:29:55.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.225+0000 7fe44c5b1b80 1 client.15933 shutdown 2024-06-13T11:29:55.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.226+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/2267324702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41f4b90 msgr2=0x55a5d41f8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:55.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.226+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/2267324702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41f4b90 0x55a5d41f8560 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe428011800 tx=0x7fe428011b10 comp rx=0 tx=0).stop 2024-06-13T11:29:55.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.226+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/2267324702 shutdown_connections 2024-06-13T11:29:55.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.226+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/2267324702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41f54b0 0x55a5d41f8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.226+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/2267324702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d41ef240 0x55a5d41fb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.226+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/2267324702 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a5d4208d40 0x55a5d420b130 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.226+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/2267324702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41f4b90 0x55a5d41f8560 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.226+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/2267324702 >> 172.21.15.2:0/2267324702 conn(0x55a5d411b170 msgr2=0x55a5d41e3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:55.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.226+0000 7fe424c00700 0 client.15933 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:29:55.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.226+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/2267324702 shutdown_connections 2024-06-13T11:29:55.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.226+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/2267324702 wait complete. 2024-06-13T11:29:55.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.226+0000 7fe44c5b1b80 20 client.15933 trim_cache size 0 max 16384 2024-06-13T11:29:55.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.250+0000 7fe44c5b1b80 1 Processor -- start 2024-06-13T11:29:55.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.250+0000 7fe44c5b1b80 1 -- start start 2024-06-13T11:29:55.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.250+0000 7fe44c5b1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d411b170 0x55a5d4204fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.251+0000 7fe44c5b1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41ef240 0x55a5d41f8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.251+0000 7fe44c5b1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d41f4b90 0x55a5d41e4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.251+0000 7fe44c5b1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c1b2e70 con 0x55a5d411b170 2024-06-13T11:29:55.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.251+0000 7fe44c5b1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c1b0700 con 0x55a5d41f4b90 2024-06-13T11:29:55.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.251+0000 7fe44c5b1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c1ae550 con 0x55a5d41ef240 2024-06-13T11:29:55.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.251+0000 7fe43aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d411b170 0x55a5d4204fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.251+0000 7fe43aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d411b170 0x55a5d4204fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43740/0 (socket says 172.21.15.2:43740) 2024-06-13T11:29:55.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.251+0000 7fe43b400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d41f4b90 0x55a5d41e4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.251+0000 7fe43aa00700 1 -- 172.21.15.2:0/3096318732 learned_addr learned my addr 172.21.15.2:0/3096318732 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:55.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.251+0000 7fe43a000700 1 --2- 172.21.15.2:0/3096318732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41ef240 0x55a5d41f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.252+0000 7fe43aa00700 1 -- 172.21.15.2:0/3096318732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41ef240 msgr2=0x55a5d41f8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:55.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.252+0000 7fe43aa00700 1 --2- 172.21.15.2:0/3096318732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41ef240 0x55a5d41f8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.252+0000 7fe43aa00700 1 -- 172.21.15.2:0/3096318732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d41f4b90 msgr2=0x55a5d41e4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.252+0000 7fe43aa00700 1 --2- 172.21.15.2:0/3096318732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d41f4b90 0x55a5d41e4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.252+0000 7fe43aa00700 1 -- 172.21.15.2:0/3096318732 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d41f8330 con 0x55a5d411b170 2024-06-13T11:29:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.252+0000 7fe43aa00700 1 --2- 172.21.15.2:0/3096318732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d411b170 0x55a5d4204fe0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0229d0 tx=0x7fe42c0a3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab65e62eb04111f1 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.252+0000 7fe427400700 1 -- 172.21.15.2:0/3096318732 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0043d0 con 0x55a5d411b170 2024-06-13T11:29:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.252+0000 7fe427400700 1 -- 172.21.15.2:0/3096318732 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe42c0ba070 con 0x55a5d411b170 2024-06-13T11:29:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.252+0000 7fe427400700 1 -- 172.21.15.2:0/3096318732 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0a0b80 con 0x55a5d411b170 2024-06-13T11:29:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.253+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/3096318732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d411b170 msgr2=0x55a5d4204fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.253+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/3096318732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d411b170 0x55a5d4204fe0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0229d0 tx=0x7fe42c0a3040 comp rx=0 tx=0).stop 2024-06-13T11:29:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.253+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/3096318732 shutdown_connections 2024-06-13T11:29:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.253+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/3096318732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d411b170 0x55a5d4204fe0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.253+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/3096318732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d41f4b90 0x55a5d41e4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.253+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/3096318732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41ef240 0x55a5d41f8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.253+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/3096318732 >> 172.21.15.2:0/3096318732 conn(0x55a5d41efbd0 msgr2=0x55a5d41f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.253+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/3096318732 shutdown_connections 2024-06-13T11:29:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.253+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/3096318732 wait complete. 2024-06-13T11:29:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.254+0000 7fe44c5b1b80 1 -- start start 2024-06-13T11:29:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.254+0000 7fe44c5b1b80 1 Processor -- start 2024-06-13T11:29:55.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.254+0000 7fe44c5b1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d411b170 0x55a5d4201330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.255+0000 7fe44c5b1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41ef240 0x55a5d4201870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.255+0000 7fe44c5b1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41f4b90 0x55a5d420fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.255+0000 7fe44c5b1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c1aebc0 con 0x55a5d41ef240 2024-06-13T11:29:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.255+0000 7fe44c5b1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c1b0030 con 0x55a5d411b170 2024-06-13T11:29:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.255+0000 7fe44c5b1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c1af290 con 0x55a5d41f4b90 2024-06-13T11:29:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.255+0000 7fe44c5b1b80 10 client.0 _ll_register_callbacks cb 0x55a5d40d6380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:29:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.255+0000 7fe43aa00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d411b170 0x55a5d4201330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.255+0000 7fe43a000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41ef240 0x55a5d4201870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.255+0000 7fe43aa00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d411b170 0x55a5d4201330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:57300/0 (socket says 172.21.15.2:57300) 2024-06-13T11:29:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.255+0000 7fe43aa00700 1 -- 172.21.15.2:0/3388181176 learned_addr learned my addr 172.21.15.2:0/3388181176 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:29:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.255+0000 7fe43b400700 1 --2- 172.21.15.2:0/3388181176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41f4b90 0x55a5d420fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.255+0000 7fe43aa00700 1 -- 172.21.15.2:0/3388181176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41f4b90 msgr2=0x55a5d420fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.255+0000 7fe43aa00700 1 --2- 172.21.15.2:0/3388181176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41f4b90 0x55a5d420fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.255+0000 7fe43aa00700 1 -- 172.21.15.2:0/3388181176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41ef240 msgr2=0x55a5d4201870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:29:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.255+0000 7fe43aa00700 1 --2- 172.21.15.2:0/3388181176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41ef240 0x55a5d4201870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.255+0000 7fe43aa00700 1 -- 172.21.15.2:0/3388181176 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d42104c0 con 0x55a5d411b170 2024-06-13T11:29:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.256+0000 7fe43aa00700 1 --2- 172.21.15.2:0/3388181176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d411b170 0x55a5d4201330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0a3010 tx=0x7fe42c09c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bab9d4ef91b0e874 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:29:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.256+0000 7fe424c00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:29:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.256+0000 7fe424c00700 1 -- 172.21.15.2:0/3388181176 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0043d0 con 0x55a5d411b170 2024-06-13T11:29:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.256+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/3388181176 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe42c0ba070 con 0x55a5d411b170 2024-06-13T11:29:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.256+0000 7fe424c00700 1 -- 172.21.15.2:0/3388181176 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fe42c0a4f20 con 0x55a5d411b170 2024-06-13T11:29:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.256+0000 7fe424c00700 1 -- 172.21.15.2:0/3388181176 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe42c022470 con 0x55a5d411b170 2024-06-13T11:29:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.256+0000 7fe44c5b1b80 10 client.26048 fetch_fsmap learned FSMap version 31 2024-06-13T11:29:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.256+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/3388181176 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a5d42733b0 con 0x55a5d411b170 2024-06-13T11:29:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.257+0000 7fe424c00700 1 -- 172.21.15.2:0/3388181176 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe42c0ba070 con 0x55a5d411b170 2024-06-13T11:29:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.257+0000 7fe424c00700 1 -- 172.21.15.2:0/3388181176 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fe42c0d0260 con 0x55a5d411b170 2024-06-13T11:29:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.257+0000 7fe44c5b1b80 10 client.26048 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:29:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.257+0000 7fe44c5b1b80 10 client.26048 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:29:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.257+0000 7fe44c5b1b80 20 client.26048 populate_metadata read hostname 'smithi002' 2024-06-13T11:29:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.257+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/3388181176 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a5d41f54b0 0x55a5d4275a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:29:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.257+0000 7fe44c5b1b80 4 client.26048 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:29:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.257+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/3388181176 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a5d4148580 con 0x55a5d41f54b0 2024-06-13T11:29:55.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.257+0000 7fe43a000700 1 --2- 172.21.15.2:0/3388181176 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a5d41f54b0 0x55a5d4275a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:29:55.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.258+0000 7fe43a000700 1 --2- 172.21.15.2:0/3388181176 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a5d41f54b0 0x55a5d4275a80 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e72e88a223622419 server_cookie=f1ce147a5a10652 in_seq=0 out_seq=0 2024-06-13T11:29:55.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.258+0000 7fe424c00700 10 client.26048 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:29:55.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.258+0000 7fe424c00700 1 -- 172.21.15.2:0/3388181176 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a5d4148580 con 0x55a5d41f54b0 2024-06-13T11:29:55.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.258+0000 7fe424c00700 10 client.26048 handle_command_reply: tid=0 2024-06-13T11:29:55.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.258+0000 7fe44c5b1b80 1 client.26048 shutdown 2024-06-13T11:29:55.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.258+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/3388181176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d411b170 msgr2=0x55a5d4201330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:55.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.258+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/3388181176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d411b170 0x55a5d4201330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0a3010 tx=0x7fe42c09c440 comp rx=0 tx=0).stop 2024-06-13T11:29:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.258+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/3388181176 shutdown_connections 2024-06-13T11:29:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.258+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/3388181176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5d41f4b90 0x55a5d420fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.258+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/3388181176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5d411b170 0x55a5d4201330 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.258+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/3388181176 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a5d41f54b0 0x55a5d4275a80 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.258+0000 7fe44c5b1b80 1 --2- 172.21.15.2:0/3388181176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5d41ef240 0x55a5d4201870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.259+0000 7fe424c00700 0 client.26048 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:29:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.259+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/3388181176 >> 172.21.15.2:0/3388181176 conn(0x55a5d41efbd0 msgr2=0x55a5d41f3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.259+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/3388181176 shutdown_connections 2024-06-13T11:29:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.259+0000 7fe44c5b1b80 1 -- 172.21.15.2:0/3388181176 wait complete. 2024-06-13T11:29:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.259+0000 7fe44c5b1b80 20 client.26048 trim_cache size 0 max 16384 2024-06-13T11:29:55.264 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:29:55.264 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-13T11:29:55.264 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-06-13T11:29:55.265 INFO:teuthology.orchestra.run.smithi002.stdout: "ea5f53a1-f4c9-41d4-b66f-ee634344afd3": { 2024-06-13T11:29:55.265 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-06-13T11:29:55.265 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "ea5f53a1-f4c9-41d4-b66f-ee634344afd3", 2024-06-13T11:29:55.265 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-06-13T11:29:55.265 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:29:55.265 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:29:55.265 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:29:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.260+0000 7fe441c00700 1 -- 172.21.15.2:0/1058951469 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe4200a2e10 msgr2=0x7fe4200a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.260+0000 7fe441c00700 1 --2- 172.21.15.2:0/1058951469 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe4200a2e10 0x7fe4200a52d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe434003e80 tx=0x7fe43400b040 comp rx=0 tx=0).stop 2024-06-13T11:29:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.260+0000 7fe441c00700 1 -- 172.21.15.2:0/1058951469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43c102550 msgr2=0x7fe43c19ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:29:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.260+0000 7fe441c00700 1 --2- 172.21.15.2:0/1058951469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43c102550 0x7fe43c19ae20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe42c005910 tx=0x7fe42c00bab0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.260+0000 7fe441c00700 1 -- 172.21.15.2:0/1058951469 shutdown_connections 2024-06-13T11:29:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.260+0000 7fe441c00700 1 --2- 172.21.15.2:0/1058951469 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe4200a2e10 0x7fe4200a52d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.260+0000 7fe441c00700 1 --2- 172.21.15.2:0/1058951469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43c102550 0x7fe43c19ae20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.260+0000 7fe441c00700 1 --2- 172.21.15.2:0/1058951469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe43c1084f0 0x7fe43c19f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.260+0000 7fe441c00700 1 --2- 172.21.15.2:0/1058951469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c102f10 0x7fe43c19b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:29:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.260+0000 7fe441c00700 1 -- 172.21.15.2:0/1058951469 >> 172.21.15.2:0/1058951469 conn(0x7fe43c079650 msgr2=0x7fe43c1003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:29:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.260+0000 7fe441c00700 1 -- 172.21.15.2:0/1058951469 shutdown_connections 2024-06-13T11:29:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:29:55.260+0000 7fe441c00700 1 -- 172.21.15.2:0/1058951469 wait complete. 2024-06-13T11:29:55.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:55 smithi002 ceph-mon[32210]: pgmap v187: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:29:55.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:55 smithi178 ceph-mon[36913]: pgmap v187: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:29:56.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:55 smithi077 ceph-mon[36410]: pgmap v187: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:29:56.241 INFO:tasks.cephfs.filesystem:scrub status for tag:ea5f53a1-f4c9-41d4-b66f-ee634344afd3 - {'path': '/', 'tag': 'ea5f53a1-f4c9-41d4-b66f-ee634344afd3', 'options': 'recursive,force'} 2024-06-13T11:29:57.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:57 smithi002 ceph-mon[32210]: pgmap v188: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:29:57.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:57 smithi178 ceph-mon[36913]: pgmap v188: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:29:58.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:57 smithi077 ceph-mon[36410]: pgmap v188: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:29:59.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:29:59 smithi002 ceph-mon[32210]: pgmap v189: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:29:59.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:29:59 smithi178 ceph-mon[36913]: pgmap v189: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:30:00.043 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:29:59 smithi077 ceph-mon[36410]: pgmap v189: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:30:00.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:00 smithi002 ceph-mon[32210]: overall HEALTH_OK 2024-06-13T11:30:00.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:00 smithi178 ceph-mon[36913]: overall HEALTH_OK 2024-06-13T11:30:01.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:00 smithi077 ceph-mon[36410]: overall HEALTH_OK 2024-06-13T11:30:01.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:01 smithi002 ceph-mon[32210]: pgmap v190: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:30:01.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:01 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:30:01.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:01 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:30:01.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:01 smithi178 ceph-mon[36913]: pgmap v190: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:30:01.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:01 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:30:01.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:01 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:30:02.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:01 smithi077 ceph-mon[36410]: pgmap v190: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:30:02.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:01 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:30:02.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:01 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:30:02.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:02 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:30:02.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:02 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:30:03.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:02 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:30:03.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:03 smithi002 ceph-mon[32210]: pgmap v191: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:30:03.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:03 smithi178 ceph-mon[36913]: pgmap v191: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:30:04.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:03 smithi077 ceph-mon[36410]: pgmap v191: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:30:05.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:05 smithi002 ceph-mon[32210]: pgmap v192: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:30:05.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:05 smithi178 ceph-mon[36913]: pgmap v192: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:30:06.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:05 smithi077 ceph-mon[36410]: pgmap v192: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:30:07.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:07 smithi002 ceph-mon[32210]: pgmap v193: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:30:07.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:07 smithi178 ceph-mon[36913]: pgmap v193: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:30:08.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:07 smithi077 ceph-mon[36410]: pgmap v193: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:30:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:09 smithi002 ceph-mon[32210]: pgmap v194: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:30:09.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:09 smithi178 ceph-mon[36913]: pgmap v194: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:30:10.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:09 smithi077 ceph-mon[36410]: pgmap v194: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:30:11.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:11 smithi002 ceph-mon[32210]: pgmap v195: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:30:11.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:11 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:30:11.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:11 smithi178 ceph-mon[36913]: pgmap v195: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:30:11.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:11 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:30:12.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:11 smithi077 ceph-mon[36410]: pgmap v195: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-06-13T11:30:12.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:11 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:30:12.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:12 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:30:12.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:12 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:30:12.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:12 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:30:12.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:12 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:30:12.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:12 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:30:12.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:12 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:30:13.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:12 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:30:13.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:12 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:30:13.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:12 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:30:13.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:13 smithi002 ceph-mon[32210]: pgmap v196: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:30:13.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:13 smithi178 ceph-mon[36913]: pgmap v196: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:30:14.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:13 smithi077 ceph-mon[36410]: pgmap v196: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-06-13T11:30:15.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:15 smithi178 ceph-mon[36913]: pgmap v197: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:30:16.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:15 smithi077 ceph-mon[36410]: pgmap v197: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:30:16.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:15 smithi002 ceph-mon[32210]: pgmap v197: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:30:17.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:17 smithi178 ceph-mon[36913]: pgmap v198: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:30:18.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:17 smithi077 ceph-mon[36410]: pgmap v198: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:30:18.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:17 smithi002 ceph-mon[32210]: pgmap v198: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-13T11:30:19.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:19 smithi178 ceph-mon[36913]: pgmap v199: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:30:20.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:19 smithi077 ceph-mon[36410]: pgmap v199: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:30:20.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:19 smithi002 ceph-mon[32210]: pgmap v199: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:30:21.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:21 smithi178 ceph-mon[36913]: pgmap v200: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:22.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:21 smithi077 ceph-mon[36410]: pgmap v200: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:22.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:21 smithi002 ceph-mon[32210]: pgmap v200: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:23.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:23 smithi178 ceph-mon[36913]: pgmap v201: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:24.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:23 smithi077 ceph-mon[36410]: pgmap v201: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:24.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:23 smithi002 ceph-mon[32210]: pgmap v201: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:25.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:25 smithi178 ceph-mon[36913]: pgmap v202: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:25.948 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:25 smithi002 ceph-mon[32210]: pgmap v202: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:26.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:25 smithi077 ceph-mon[36410]: pgmap v202: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:26.242 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:30:26.725 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:30:27.942 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:27 smithi002 ceph-mon[32210]: pgmap v203: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:27.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:27 smithi178 ceph-mon[36913]: pgmap v203: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:28.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:27 smithi077 ceph-mon[36410]: pgmap v203: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:29.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.129+0000 7f8d88e00700 1 -- 172.21.15.2:0/2959609749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d840746c0 msgr2=0x7f8d84074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:29.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.129+0000 7f8d88e00700 1 --2- 172.21.15.2:0/2959609749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d840746c0 0x7f8d84074aa0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8d74009990 tx=0x7f8d74009ca0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.129+0000 7f8d88e00700 1 -- 172.21.15.2:0/2959609749 shutdown_connections 2024-06-13T11:30:29.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.129+0000 7f8d88e00700 1 --2- 172.21.15.2:0/2959609749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d840746c0 0x7f8d84074aa0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.129+0000 7f8d88e00700 1 --2- 172.21.15.2:0/2959609749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d8410ee90 0x7f8d84111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.129+0000 7f8d88e00700 1 --2- 172.21.15.2:0/2959609749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d84074fe0 0x7f8d8410e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.129+0000 7f8d88e00700 1 -- 172.21.15.2:0/2959609749 >> 172.21.15.2:0/2959609749 conn(0x7f8d840795f0 msgr2=0x7f8d84079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:29.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.129+0000 7f8d88e00700 1 -- 172.21.15.2:0/2959609749 shutdown_connections 2024-06-13T11:30:29.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.129+0000 7f8d88e00700 1 -- 172.21.15.2:0/2959609749 wait complete. 2024-06-13T11:30:29.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.131+0000 7f8d88e00700 1 Processor -- start 2024-06-13T11:30:29.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.131+0000 7f8d88e00700 1 -- start start 2024-06-13T11:30:29.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.131+0000 7f8d88e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d840746c0 0x7f8d8419ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.131+0000 7f8d88e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d84074fe0 0x7f8d8419b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.131+0000 7f8d88e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d8410ee90 0x7f8d8419f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.132+0000 7f8d88e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84114a10 con 0x7f8d8410ee90 2024-06-13T11:30:29.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.132+0000 7f8d88e00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84114890 con 0x7f8d84074fe0 2024-06-13T11:30:29.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.132+0000 7f8d88e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84114b90 con 0x7f8d840746c0 2024-06-13T11:30:29.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.132+0000 7f8d81400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d84074fe0 0x7f8d8419b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.132+0000 7f8d81400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d84074fe0 0x7f8d8419b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:34332/0 (socket says 172.21.15.2:34332) 2024-06-13T11:30:29.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.132+0000 7f8d81400700 1 -- 172.21.15.2:0/3025059706 learned_addr learned my addr 172.21.15.2:0/3025059706 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:29.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.132+0000 7f8d81e00700 1 --2- 172.21.15.2:0/3025059706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d840746c0 0x7f8d8419ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.132+0000 7f8d82800700 1 --2- 172.21.15.2:0/3025059706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d8410ee90 0x7f8d8419f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.132+0000 7f8d81400700 1 -- 172.21.15.2:0/3025059706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d840746c0 msgr2=0x7f8d8419ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:29.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.132+0000 7f8d81400700 1 --2- 172.21.15.2:0/3025059706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d840746c0 0x7f8d8419ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.132+0000 7f8d81400700 1 -- 172.21.15.2:0/3025059706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d8410ee90 msgr2=0x7f8d8419f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:29.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.132+0000 7f8d81400700 1 --2- 172.21.15.2:0/3025059706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d8410ee90 0x7f8d8419f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.132+0000 7f8d81400700 1 -- 172.21.15.2:0/3025059706 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8419fe30 con 0x7f8d84074fe0 2024-06-13T11:30:29.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.133+0000 7f8d81400700 1 --2- 172.21.15.2:0/3025059706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d84074fe0 0x7f8d8419b360 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000eb30 tx=0x7f8d7000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:29.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.133+0000 7f8d7aa00700 1 -- 172.21.15.2:0/3025059706 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7000cc90 con 0x7f8d84074fe0 2024-06-13T11:30:29.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.133+0000 7f8d88e00700 1 -- 172.21.15.2:0/3025059706 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d841a0120 con 0x7f8d84074fe0 2024-06-13T11:30:29.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.133+0000 7f8d7aa00700 1 -- 172.21.15.2:0/3025059706 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d70004500 con 0x7f8d84074fe0 2024-06-13T11:30:29.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.133+0000 7f8d7aa00700 1 -- 172.21.15.2:0/3025059706 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d70010430 con 0x7f8d84074fe0 2024-06-13T11:30:29.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.133+0000 7f8d88e00700 1 -- 172.21.15.2:0/3025059706 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d841a79a0 con 0x7f8d84074fe0 2024-06-13T11:30:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.140+0000 7f8d7aa00700 1 -- 172.21.15.2:0/3025059706 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f8d70003f70 con 0x7f8d84074fe0 2024-06-13T11:30:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.140+0000 7f8d936dbb80 1 Processor -- start 2024-06-13T11:30:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.140+0000 7f8d936dbb80 1 -- start start 2024-06-13T11:30:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.140+0000 7f8d936dbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b30ce40 0x561d3b390070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.140+0000 7f8d936dbb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b3905b0 0x561d3b390a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.140+0000 7f8d936dbb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b39b300 0x561d3b39d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.140+0000 7f8d936dbb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561d3b29fa10 con 0x561d3b39b300 2024-06-13T11:30:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.140+0000 7f8d936dbb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561d3b2e2b00 con 0x561d3b3905b0 2024-06-13T11:30:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.140+0000 7f8d936dbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561d3b29d8f0 con 0x561d3b30ce40 2024-06-13T11:30:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.141+0000 7f8d81400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b39b300 0x561d3b39d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.141+0000 7f8d81400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b39b300 0x561d3b39d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54830/0 (socket says 172.21.15.2:54830) 2024-06-13T11:30:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.141+0000 7f8d81400700 1 -- 172.21.15.2:0/1857439311 learned_addr learned my addr 172.21.15.2:0/1857439311 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.141+0000 7f8d81e00700 1 --2- 172.21.15.2:0/1857439311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b3905b0 0x561d3b390a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.141+0000 7f8d82800700 1 --2- 172.21.15.2:0/1857439311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b30ce40 0x561d3b390070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.141+0000 7f8d81e00700 1 -- 172.21.15.2:0/1857439311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b30ce40 msgr2=0x561d3b390070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.141+0000 7f8d81e00700 1 --2- 172.21.15.2:0/1857439311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b30ce40 0x561d3b390070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.141+0000 7f8d81e00700 1 -- 172.21.15.2:0/1857439311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b39b300 msgr2=0x561d3b39d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.141+0000 7f8d81e00700 1 --2- 172.21.15.2:0/1857439311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b39b300 0x561d3b39d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.141+0000 7f8d81e00700 1 -- 172.21.15.2:0/1857439311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3b28af90 con 0x561d3b3905b0 2024-06-13T11:30:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.141+0000 7f8d7aa00700 1 --2- 172.21.15.2:0/3025059706 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8d680a2e10 0x7f8d680a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.142+0000 7f8d81e00700 1 --2- 172.21.15.2:0/1857439311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b3905b0 0x561d3b390a30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8d74000c00 tx=0x7f8d7400b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dc38378e6cbaea1 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.142+0000 7f8d7aa00700 1 -- 172.21.15.2:0/3025059706 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f8d700cfaf0 con 0x7f8d84074fe0 2024-06-13T11:30:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.142+0000 7f8d82800700 1 --2- 172.21.15.2:0/3025059706 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8d680a2e10 0x7f8d680a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.142+0000 7f8d6f400700 1 -- 172.21.15.2:0/1857439311 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74027070 con 0x561d3b3905b0 2024-06-13T11:30:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.142+0000 7f8d6f400700 1 -- 172.21.15.2:0/1857439311 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d74005550 con 0x561d3b3905b0 2024-06-13T11:30:29.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.142+0000 7f8d6f400700 1 -- 172.21.15.2:0/1857439311 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74003bb0 con 0x561d3b3905b0 2024-06-13T11:30:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.143+0000 7f8d82800700 1 --2- 172.21.15.2:0/3025059706 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8d680a2e10 0x7f8d680a52d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009fd0 tx=0x7f8d7c009040 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.143+0000 7f8d936dbb80 1 -- 172.21.15.2:0/1857439311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b3905b0 msgr2=0x561d3b390a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.143+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/1857439311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b3905b0 0x561d3b390a30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8d74000c00 tx=0x7f8d7400b7a0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.143+0000 7f8d936dbb80 1 -- 172.21.15.2:0/1857439311 shutdown_connections 2024-06-13T11:30:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.143+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/1857439311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b39b300 0x561d3b39d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.143+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/1857439311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b30ce40 0x561d3b390070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.143+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/1857439311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b3905b0 0x561d3b390a30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.143+0000 7f8d936dbb80 1 -- 172.21.15.2:0/1857439311 >> 172.21.15.2:0/1857439311 conn(0x561d3b2bd170 msgr2=0x561d3b38c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.143+0000 7f8d936dbb80 1 -- 172.21.15.2:0/1857439311 shutdown_connections 2024-06-13T11:30:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.143+0000 7f8d936dbb80 1 -- 172.21.15.2:0/1857439311 wait complete. 2024-06-13T11:30:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.144+0000 7f8d936dbb80 1 -- start start 2024-06-13T11:30:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.144+0000 7f8d936dbb80 1 Processor -- start 2024-06-13T11:30:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.144+0000 7f8d936dbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b30ce40 0x561d3b39aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.144+0000 7f8d936dbb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b3905b0 0x561d3b397d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.144+0000 7f8d936dbb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b39b300 0x561d3b398270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.144+0000 7f8d936dbb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561d3b27ef60 con 0x561d3b3905b0 2024-06-13T11:30:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.144+0000 7f8d936dbb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561d3b2deac0 con 0x561d3b39b300 2024-06-13T11:30:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.144+0000 7f8d936dbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561d3b39df60 con 0x561d3b30ce40 2024-06-13T11:30:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.144+0000 7f8d936dbb80 10 client.0 _ll_register_callbacks cb 0x561d3b27c720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:30:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.145+0000 7f8d81400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b3905b0 0x561d3b397d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.145+0000 7f8d82800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b39b300 0x561d3b398270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.145+0000 7f8d81400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b3905b0 0x561d3b397d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54834/0 (socket says 172.21.15.2:54834) 2024-06-13T11:30:29.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.145+0000 7f8d81400700 1 -- 172.21.15.2:0/3295667738 learned_addr learned my addr 172.21.15.2:0/3295667738 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:29.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.145+0000 7f8d82800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b39b300 0x561d3b398270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:34354/0 (socket says 172.21.15.2:34354) 2024-06-13T11:30:29.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.145+0000 7f8d81e00700 1 --2- 172.21.15.2:0/3295667738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b30ce40 0x561d3b39aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.145+0000 7f8d81400700 1 -- 172.21.15.2:0/3295667738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b30ce40 msgr2=0x561d3b39aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:29.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.145+0000 7f8d81400700 1 --2- 172.21.15.2:0/3295667738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b30ce40 0x561d3b39aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.145+0000 7f8d81400700 1 -- 172.21.15.2:0/3295667738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b39b300 msgr2=0x561d3b398270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:29.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.145+0000 7f8d81400700 1 --2- 172.21.15.2:0/3295667738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b39b300 0x561d3b398270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.145+0000 7f8d81400700 1 -- 172.21.15.2:0/3295667738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d3b2318d0 con 0x561d3b3905b0 2024-06-13T11:30:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.146+0000 7f8d81400700 1 --2- 172.21.15.2:0/3295667738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b3905b0 0x561d3b397d30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8d70098610 tx=0x7f8d700d30d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b854423d6643688b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.146+0000 7f8d63e00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:30:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.146+0000 7f8d63e00700 1 -- 172.21.15.2:0/3295667738 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d70097ee0 con 0x561d3b3905b0 2024-06-13T11:30:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.146+0000 7f8d63e00700 1 -- 172.21.15.2:0/3295667738 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f8d70099f40 con 0x561d3b3905b0 2024-06-13T11:30:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.146+0000 7f8d936dbb80 1 -- 172.21.15.2:0/3295667738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d74005550 con 0x561d3b3905b0 2024-06-13T11:30:29.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.146+0000 7f8d63e00700 1 -- 172.21.15.2:0/3295667738 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8d7009b5a0 con 0x561d3b3905b0 2024-06-13T11:30:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.146+0000 7f8d936dbb80 10 client.15951 fetch_fsmap learned FSMap version 31 2024-06-13T11:30:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.146+0000 7f8d936dbb80 1 -- 172.21.15.2:0/3295667738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561d3b3a86d0 con 0x561d3b3905b0 2024-06-13T11:30:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.146+0000 7f8d63e00700 1 -- 172.21.15.2:0/3295667738 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d74005550 con 0x561d3b3905b0 2024-06-13T11:30:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.147+0000 7f8d63e00700 1 -- 172.21.15.2:0/3295667738 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f8d700cd0f0 con 0x561d3b3905b0 2024-06-13T11:30:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.147+0000 7f8d936dbb80 10 client.15951 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:30:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.147+0000 7f8d936dbb80 10 client.15951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:30:29.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.147+0000 7f8d936dbb80 20 client.15951 populate_metadata read hostname 'smithi002' 2024-06-13T11:30:29.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.147+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/3295667738 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561d3b3aac60 0x561d3b3ad050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.147+0000 7f8d936dbb80 4 client.15951 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:30:29.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.147+0000 7f8d936dbb80 1 -- 172.21.15.2:0/3295667738 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d3b2f0000 con 0x561d3b3aac60 2024-06-13T11:30:29.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.147+0000 7f8d81e00700 1 --2- 172.21.15.2:0/3295667738 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561d3b3aac60 0x561d3b3ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.148+0000 7f8d81e00700 1 --2- 172.21.15.2:0/3295667738 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561d3b3aac60 0x561d3b3ad050 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7916aeca9c022c22 server_cookie=4cbaaeae355add99 in_seq=0 out_seq=0 2024-06-13T11:30:29.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.148+0000 7f8d63e00700 10 client.15951 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:30:29.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.149+0000 7f8d63e00700 1 -- 172.21.15.2:0/3295667738 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561d3b2f0000 con 0x561d3b3aac60 2024-06-13T11:30:29.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.149+0000 7f8d63e00700 10 client.15951 handle_command_reply: tid=0 2024-06-13T11:30:29.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.149+0000 7f8d936dbb80 1 client.15951 shutdown 2024-06-13T11:30:29.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.149+0000 7f8d936dbb80 1 -- 172.21.15.2:0/3295667738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b3905b0 msgr2=0x561d3b397d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:29.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.149+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/3295667738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b3905b0 0x561d3b397d30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8d70098610 tx=0x7f8d700d30d0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.149+0000 7f8d936dbb80 1 -- 172.21.15.2:0/3295667738 shutdown_connections 2024-06-13T11:30:29.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.149+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/3295667738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b39b300 0x561d3b398270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.149+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/3295667738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b30ce40 0x561d3b39aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.149+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/3295667738 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561d3b3aac60 0x561d3b3ad050 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.149+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/3295667738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b3905b0 0x561d3b397d30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.149+0000 7f8d936dbb80 1 -- 172.21.15.2:0/3295667738 >> 172.21.15.2:0/3295667738 conn(0x561d3b2bd170 msgr2=0x561d3b38b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:29.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.149+0000 7f8d63e00700 0 client.15951 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:30:29.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.149+0000 7f8d936dbb80 1 -- 172.21.15.2:0/3295667738 shutdown_connections 2024-06-13T11:30:29.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.149+0000 7f8d936dbb80 1 -- 172.21.15.2:0/3295667738 wait complete. 2024-06-13T11:30:29.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.150+0000 7f8d936dbb80 20 client.15951 trim_cache size 0 max 16384 2024-06-13T11:30:29.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.173+0000 7f8d936dbb80 1 Processor -- start 2024-06-13T11:30:29.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.173+0000 7f8d936dbb80 1 -- start start 2024-06-13T11:30:29.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.174+0000 7f8d936dbb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b30ce40 0x561d3b39c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.174+0000 7f8d936dbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b3905b0 0x561d3b392fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.174+0000 7f8d936dbb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b39b300 0x561d3b393510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.174+0000 7f8d936dbb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841b2ed0 con 0x561d3b30ce40 2024-06-13T11:30:29.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.174+0000 7f8d936dbb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841b0760 con 0x561d3b39b300 2024-06-13T11:30:29.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.174+0000 7f8d936dbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841ae5b0 con 0x561d3b3905b0 2024-06-13T11:30:29.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.174+0000 7f8d82800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b39b300 0x561d3b393510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.174+0000 7f8d81e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b30ce40 0x561d3b39c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.174+0000 7f8d81400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b3905b0 0x561d3b392fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.174+0000 7f8d82800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b39b300 0x561d3b393510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:34364/0 (socket says 172.21.15.2:34364) 2024-06-13T11:30:29.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.174+0000 7f8d82800700 1 -- 172.21.15.2:0/3763358558 learned_addr learned my addr 172.21.15.2:0/3763358558 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:29.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.175+0000 7f8d82800700 1 -- 172.21.15.2:0/3763358558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b3905b0 msgr2=0x561d3b392fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:29.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.175+0000 7f8d82800700 1 --2- 172.21.15.2:0/3763358558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b3905b0 0x561d3b392fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.175+0000 7f8d82800700 1 -- 172.21.15.2:0/3763358558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b30ce40 msgr2=0x561d3b39c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.175+0000 7f8d82800700 1 --2- 172.21.15.2:0/3763358558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b30ce40 0x561d3b39c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.175+0000 7f8d82800700 1 -- 172.21.15.2:0/3763358558 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3b397b00 con 0x561d3b39b300 2024-06-13T11:30:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.175+0000 7f8d82800700 1 --2- 172.21.15.2:0/3763358558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b39b300 0x561d3b393510 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c007f60 tx=0x7f8d7c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92a4d0c93a7dd8b6 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.175+0000 7f8d6ea00700 1 -- 172.21.15.2:0/3763358558 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c028070 con 0x561d3b39b300 2024-06-13T11:30:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.175+0000 7f8d6ea00700 1 -- 172.21.15.2:0/3763358558 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d7c004bb0 con 0x561d3b39b300 2024-06-13T11:30:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.175+0000 7f8d6ea00700 1 -- 172.21.15.2:0/3763358558 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c01c070 con 0x561d3b39b300 2024-06-13T11:30:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.176+0000 7f8d936dbb80 1 -- 172.21.15.2:0/3763358558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b39b300 msgr2=0x561d3b393510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.176+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/3763358558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b39b300 0x561d3b393510 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c007f60 tx=0x7f8d7c004ad0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.176+0000 7f8d936dbb80 1 -- 172.21.15.2:0/3763358558 shutdown_connections 2024-06-13T11:30:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.176+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/3763358558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b30ce40 0x561d3b39c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.176+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/3763358558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b39b300 0x561d3b393510 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.176+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/3763358558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b3905b0 0x561d3b392fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.176+0000 7f8d936dbb80 1 -- 172.21.15.2:0/3763358558 >> 172.21.15.2:0/3763358558 conn(0x561d3b2bd170 msgr2=0x561d3b38bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.176+0000 7f8d936dbb80 1 -- 172.21.15.2:0/3763358558 shutdown_connections 2024-06-13T11:30:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.177+0000 7f8d936dbb80 1 -- 172.21.15.2:0/3763358558 wait complete. 2024-06-13T11:30:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.177+0000 7f8d936dbb80 1 -- start start 2024-06-13T11:30:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.177+0000 7f8d936dbb80 1 Processor -- start 2024-06-13T11:30:29.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.178+0000 7f8d936dbb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b30ce40 0x561d3b3a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.178+0000 7f8d936dbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b3905b0 0x561d3b3b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.178+0000 7f8d936dbb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b39b300 0x561d3b3b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.178+0000 7f8d936dbb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841aec20 con 0x561d3b39b300 2024-06-13T11:30:29.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.178+0000 7f8d936dbb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841b0090 con 0x561d3b30ce40 2024-06-13T11:30:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.178+0000 7f8d936dbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841af2f0 con 0x561d3b3905b0 2024-06-13T11:30:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.178+0000 7f8d936dbb80 10 client.0 _ll_register_callbacks cb 0x561d3b27c720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:30:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.178+0000 7f8d81400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b3905b0 0x561d3b3b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.178+0000 7f8d81400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b3905b0 0x561d3b3b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:58694/0 (socket says 172.21.15.2:58694) 2024-06-13T11:30:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.178+0000 7f8d82800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b39b300 0x561d3b3b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.178+0000 7f8d81400700 1 -- 172.21.15.2:0/1424512860 learned_addr learned my addr 172.21.15.2:0/1424512860 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.178+0000 7f8d81e00700 1 --2- 172.21.15.2:0/1424512860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b30ce40 0x561d3b3a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.179+0000 7f8d81400700 1 -- 172.21.15.2:0/1424512860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b30ce40 msgr2=0x561d3b3a36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.179+0000 7f8d81400700 1 --2- 172.21.15.2:0/1424512860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b30ce40 0x561d3b3a36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.179+0000 7f8d81400700 1 -- 172.21.15.2:0/1424512860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b39b300 msgr2=0x561d3b3b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.179+0000 7f8d81400700 1 --2- 172.21.15.2:0/1424512860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b39b300 0x561d3b3b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.179+0000 7f8d81400700 1 -- 172.21.15.2:0/1424512860 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d3b3b2960 con 0x561d3b3905b0 2024-06-13T11:30:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.179+0000 7f8d82800700 1 --2- 172.21.15.2:0/1424512860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b39b300 0x561d3b3b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:30:29.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.179+0000 7f8d81400700 1 --2- 172.21.15.2:0/1424512860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b3905b0 0x561d3b3b1ee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8d70005bf0 tx=0x7f8d700d33c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=989aae29c3d83e38 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:29.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.179+0000 7f8d63e00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:30:29.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.179+0000 7f8d63e00700 1 -- 172.21.15.2:0/1424512860 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7009b780 con 0x561d3b3905b0 2024-06-13T11:30:29.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.179+0000 7f8d936dbb80 1 -- 172.21.15.2:0/1424512860 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d7c004bb0 con 0x561d3b3905b0 2024-06-13T11:30:29.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.179+0000 7f8d63e00700 1 -- 172.21.15.2:0/1424512860 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f8d700a4420 con 0x561d3b3905b0 2024-06-13T11:30:29.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.180+0000 7f8d63e00700 1 -- 172.21.15.2:0/1424512860 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8d7009ba10 con 0x561d3b3905b0 2024-06-13T11:30:29.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.180+0000 7f8d936dbb80 10 client.26101 fetch_fsmap learned FSMap version 31 2024-06-13T11:30:29.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.180+0000 7f8d936dbb80 1 -- 172.21.15.2:0/1424512860 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561d3b3a1f30 con 0x561d3b3905b0 2024-06-13T11:30:29.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.180+0000 7f8d63e00700 1 -- 172.21.15.2:0/1424512860 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d7c004bb0 con 0x561d3b3905b0 2024-06-13T11:30:29.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.180+0000 7f8d63e00700 1 -- 172.21.15.2:0/1424512860 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f8d7009b090 con 0x561d3b3905b0 2024-06-13T11:30:29.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.180+0000 7f8d936dbb80 10 client.26101 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:30:29.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.180+0000 7f8d936dbb80 10 client.26101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:30:29.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.180+0000 7f8d936dbb80 20 client.26101 populate_metadata read hostname 'smithi002' 2024-06-13T11:30:29.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.180+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/1424512860 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561d3b41e320 0x561d3b420740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:29.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.180+0000 7f8d936dbb80 4 client.26101 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:30:29.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.180+0000 7f8d936dbb80 1 -- 172.21.15.2:0/1424512860 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561d3b2ea580 con 0x561d3b41e320 2024-06-13T11:30:29.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.181+0000 7f8d81e00700 1 --2- 172.21.15.2:0/1424512860 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561d3b41e320 0x561d3b420740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:29.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.181+0000 7f8d81e00700 1 --2- 172.21.15.2:0/1424512860 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561d3b41e320 0x561d3b420740 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3594579e65efcf5 server_cookie=516670b4734a4bc5 in_seq=0 out_seq=0 2024-06-13T11:30:29.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.181+0000 7f8d63e00700 10 client.26101 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:30:29.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.182+0000 7f8d63e00700 1 -- 172.21.15.2:0/1424512860 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561d3b2ea580 con 0x561d3b41e320 2024-06-13T11:30:29.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.182+0000 7f8d63e00700 10 client.26101 handle_command_reply: tid=0 2024-06-13T11:30:29.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.182+0000 7f8d936dbb80 1 client.26101 shutdown 2024-06-13T11:30:29.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.182+0000 7f8d936dbb80 1 -- 172.21.15.2:0/1424512860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b3905b0 msgr2=0x561d3b3b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:29.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.182+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/1424512860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b3905b0 0x561d3b3b1ee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8d70005bf0 tx=0x7f8d700d33c0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.182+0000 7f8d936dbb80 1 -- 172.21.15.2:0/1424512860 shutdown_connections 2024-06-13T11:30:29.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.182+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/1424512860 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561d3b41e320 0x561d3b420740 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.182+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/1424512860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561d3b39b300 0x561d3b3b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.182+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/1424512860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d3b30ce40 0x561d3b3a36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.182+0000 7f8d936dbb80 1 --2- 172.21.15.2:0/1424512860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3b3905b0 0x561d3b3b1ee0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.182+0000 7f8d63e00700 0 client.26101 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:30:29.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.182+0000 7f8d936dbb80 1 -- 172.21.15.2:0/1424512860 >> 172.21.15.2:0/1424512860 conn(0x561d3b2bd170 msgr2=0x561d3b396480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:29.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.182+0000 7f8d936dbb80 1 -- 172.21.15.2:0/1424512860 shutdown_connections 2024-06-13T11:30:29.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.182+0000 7f8d936dbb80 1 -- 172.21.15.2:0/1424512860 wait complete. 2024-06-13T11:30:29.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.182+0000 7f8d936dbb80 20 client.26101 trim_cache size 0 max 16384 2024-06-13T11:30:29.190 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:30:29.190 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-06-13T11:30:29.190 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-06-13T11:30:29.190 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:30:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.183+0000 7f8d88e00700 1 -- 172.21.15.2:0/3025059706 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8d680a2e10 msgr2=0x7f8d680a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.183+0000 7f8d88e00700 1 --2- 172.21.15.2:0/3025059706 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8d680a2e10 0x7f8d680a52d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009fd0 tx=0x7f8d7c009040 comp rx=0 tx=0).stop 2024-06-13T11:30:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.183+0000 7f8d88e00700 1 -- 172.21.15.2:0/3025059706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d84074fe0 msgr2=0x7f8d8419b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.183+0000 7f8d88e00700 1 --2- 172.21.15.2:0/3025059706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d84074fe0 0x7f8d8419b360 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000eb30 tx=0x7f8d7000ee40 comp rx=0 tx=0).stop 2024-06-13T11:30:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.183+0000 7f8d88e00700 1 -- 172.21.15.2:0/3025059706 shutdown_connections 2024-06-13T11:30:29.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.183+0000 7f8d88e00700 1 --2- 172.21.15.2:0/3025059706 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f8d680a2e10 0x7f8d680a52d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.183+0000 7f8d88e00700 1 --2- 172.21.15.2:0/3025059706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d8410ee90 0x7f8d8419f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.183+0000 7f8d88e00700 1 --2- 172.21.15.2:0/3025059706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d840746c0 0x7f8d8419ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.183+0000 7f8d88e00700 1 --2- 172.21.15.2:0/3025059706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d84074fe0 0x7f8d8419b360 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:29.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.183+0000 7f8d88e00700 1 -- 172.21.15.2:0/3025059706 >> 172.21.15.2:0/3025059706 conn(0x7f8d840795f0 msgr2=0x7f8d840ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:29.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.183+0000 7f8d88e00700 1 -- 172.21.15.2:0/3025059706 shutdown_connections 2024-06-13T11:30:29.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:29.183+0000 7f8d88e00700 1 -- 172.21.15.2:0/3025059706 wait complete. 2024-06-13T11:30:29.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:29 smithi002 ceph-mon[32210]: pgmap v204: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:29.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:29 smithi178 ceph-mon[36913]: pgmap v204: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:30.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:29 smithi077 ceph-mon[36410]: pgmap v204: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:30.099 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-13T11:30:30.101 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:30:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:30:31.792 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:31 smithi002 ceph-mon[32210]: pgmap v205: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:31.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:31 smithi178 ceph-mon[36913]: pgmap v205: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:32.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:31 smithi077 ceph-mon[36410]: pgmap v205: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:32.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.852+0000 7fc190000700 1 -- 172.21.15.2:0/231221687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc18810ee90 msgr2=0x7fc188111280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:32.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.852+0000 7fc190000700 1 --2- 172.21.15.2:0/231221687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc18810ee90 0x7fc188111280 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc18000b0a0 tx=0x7fc18000b3b0 comp rx=0 tx=0).stop 2024-06-13T11:30:32.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.852+0000 7fc190000700 1 -- 172.21.15.2:0/231221687 shutdown_connections 2024-06-13T11:30:32.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.852+0000 7fc190000700 1 --2- 172.21.15.2:0/231221687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc18810ee90 0x7fc188111280 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:32.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.852+0000 7fc190000700 1 --2- 172.21.15.2:0/231221687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1880746c0 0x7fc188074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:32.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.852+0000 7fc190000700 1 --2- 172.21.15.2:0/231221687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc188074fe0 0x7fc18810e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:32.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.852+0000 7fc190000700 1 -- 172.21.15.2:0/231221687 >> 172.21.15.2:0/231221687 conn(0x7fc1880795f0 msgr2=0x7fc188079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:32.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.852+0000 7fc190000700 1 -- 172.21.15.2:0/231221687 shutdown_connections 2024-06-13T11:30:32.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.852+0000 7fc190000700 1 -- 172.21.15.2:0/231221687 wait complete. 2024-06-13T11:30:32.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.853+0000 7fc190000700 1 Processor -- start 2024-06-13T11:30:32.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.854+0000 7fc190000700 1 -- start start 2024-06-13T11:30:32.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.854+0000 7fc190000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1880746c0 0x7fc18819ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:32.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.854+0000 7fc190000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc188074fe0 0x7fc18819b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:32.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.854+0000 7fc190000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc18810ee90 0x7fc18819f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.854+0000 7fc190000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1881149e0 con 0x7fc18810ee90 2024-06-13T11:30:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.854+0000 7fc190000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc188114860 con 0x7fc1880746c0 2024-06-13T11:30:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.854+0000 7fc190000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc188114b60 con 0x7fc188074fe0 2024-06-13T11:30:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.854+0000 7fc18e000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc18810ee90 0x7fc18819f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.855+0000 7fc18d600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1880746c0 0x7fc18819ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.855+0000 7fc18cc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc188074fe0 0x7fc18819b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.855+0000 7fc18e000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc18810ee90 0x7fc18819f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54860/0 (socket says 172.21.15.2:54860) 2024-06-13T11:30:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.855+0000 7fc18e000700 1 -- 172.21.15.2:0/3753932209 learned_addr learned my addr 172.21.15.2:0/3753932209 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:32.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.855+0000 7fc18cc00700 1 -- 172.21.15.2:0/3753932209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1880746c0 msgr2=0x7fc18819ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:32.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.855+0000 7fc18cc00700 1 --2- 172.21.15.2:0/3753932209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1880746c0 0x7fc18819ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:32.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.855+0000 7fc18cc00700 1 -- 172.21.15.2:0/3753932209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc18810ee90 msgr2=0x7fc18819f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:32.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.855+0000 7fc18cc00700 1 --2- 172.21.15.2:0/3753932209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc18810ee90 0x7fc18819f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:32.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.855+0000 7fc18cc00700 1 -- 172.21.15.2:0/3753932209 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18819fdd0 con 0x7fc188074fe0 2024-06-13T11:30:32.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.855+0000 7fc18e000700 1 --2- 172.21.15.2:0/3753932209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc18810ee90 0x7fc18819f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:30:32.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.855+0000 7fc18cc00700 1 --2- 172.21.15.2:0/3753932209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc188074fe0 0x7fc18819b350 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc17400e9c0 tx=0x7fc17400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:32.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.856+0000 7fc186000700 1 -- 172.21.15.2:0/3753932209 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174004230 con 0x7fc188074fe0 2024-06-13T11:30:32.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.856+0000 7fc190000700 1 -- 172.21.15.2:0/3753932209 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1881a00c0 con 0x7fc188074fe0 2024-06-13T11:30:32.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.856+0000 7fc186000700 1 -- 172.21.15.2:0/3753932209 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1740043d0 con 0x7fc188074fe0 2024-06-13T11:30:32.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.856+0000 7fc186000700 1 -- 172.21.15.2:0/3753932209 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174010430 con 0x7fc188074fe0 2024-06-13T11:30:32.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.856+0000 7fc190000700 1 -- 172.21.15.2:0/3753932209 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1881a7940 con 0x7fc188074fe0 2024-06-13T11:30:32.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.857+0000 7fc190000700 1 -- 172.21.15.2:0/3753932209 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc188069180 con 0x7fc188074fe0 2024-06-13T11:30:32.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.859+0000 7fc186000700 1 -- 172.21.15.2:0/3753932209 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fc17400c7c0 con 0x7fc188074fe0 2024-06-13T11:30:32.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.860+0000 7fc186000700 1 --2- 172.21.15.2:0/3753932209 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc1700a2d90 0x7fc1700a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:32.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.860+0000 7fc186000700 1 -- 172.21.15.2:0/3753932209 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fc1740cfb60 con 0x7fc188074fe0 2024-06-13T11:30:32.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.860+0000 7fc18d600700 1 --2- 172.21.15.2:0/3753932209 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc1700a2d90 0x7fc1700a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:32.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.861+0000 7fc18d600700 1 --2- 172.21.15.2:0/3753932209 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc1700a2d90 0x7fc1700a5250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009c60 tx=0x7fc17c009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:32.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:32.864+0000 7fc186000700 1 -- 172.21.15.2:0/3753932209 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc17409c3b0 con 0x7fc188074fe0 2024-06-13T11:30:33.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:33.148+0000 7fc190000700 1 -- 172.21.15.2:0/3753932209 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1881a7b10 con 0x7fc188074fe0 2024-06-13T11:30:33.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:33.149+0000 7fc186000700 1 -- 172.21.15.2:0/3753932209 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11853 (secure 0 0 0) 0x7fc17409bcb0 con 0x7fc188074fe0 2024-06-13T11:30:33.149 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:30:33.149 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:29:21.309310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24511,24493,24509]},"id":1}]} 2024-06-13T11:30:33.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:33.152+0000 7fc190000700 1 -- 172.21.15.2:0/3753932209 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc1700a2d90 msgr2=0x7fc1700a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:33.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:33.152+0000 7fc190000700 1 --2- 172.21.15.2:0/3753932209 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc1700a2d90 0x7fc1700a5250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009c60 tx=0x7fc17c009260 comp rx=0 tx=0).stop 2024-06-13T11:30:33.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:33.152+0000 7fc190000700 1 -- 172.21.15.2:0/3753932209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc188074fe0 msgr2=0x7fc18819b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:33.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:33.152+0000 7fc190000700 1 --2- 172.21.15.2:0/3753932209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc188074fe0 0x7fc18819b350 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc17400e9c0 tx=0x7fc17400ecd0 comp rx=0 tx=0).stop 2024-06-13T11:30:33.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:33.152+0000 7fc190000700 1 -- 172.21.15.2:0/3753932209 shutdown_connections 2024-06-13T11:30:33.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:33.152+0000 7fc190000700 1 --2- 172.21.15.2:0/3753932209 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fc1700a2d90 0x7fc1700a5250 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:33.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:33.152+0000 7fc190000700 1 --2- 172.21.15.2:0/3753932209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc18810ee90 0x7fc18819f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:33.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:33.152+0000 7fc190000700 1 --2- 172.21.15.2:0/3753932209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1880746c0 0x7fc18819ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:33.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:33.152+0000 7fc190000700 1 --2- 172.21.15.2:0/3753932209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc188074fe0 0x7fc18819b350 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:33.152+0000 7fc190000700 1 -- 172.21.15.2:0/3753932209 >> 172.21.15.2:0/3753932209 conn(0x7fc1880795f0 msgr2=0x7fc1880ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:33.153+0000 7fc190000700 1 -- 172.21.15.2:0/3753932209 shutdown_connections 2024-06-13T11:30:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:33.153+0000 7fc190000700 1 -- 172.21.15.2:0/3753932209 wait complete. 2024-06-13T11:30:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 31 2024-06-13T11:30:33.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:33 smithi002 ceph-mon[32210]: pgmap v206: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:33.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:33 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3753932209' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:30:33.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:33 smithi178 ceph-mon[36913]: pgmap v206: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:33.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:33 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3753932209' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:30:34.037 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-13T11:30:34.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:33 smithi077 ceph-mon[36410]: pgmap v206: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:34.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:33 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3753932209' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:30:34.509 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:30:35.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:35 smithi002 ceph-mon[32210]: pgmap v207: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:35.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:35 smithi178 ceph-mon[36913]: pgmap v207: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:36.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:35 smithi077 ceph-mon[36410]: pgmap v207: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:36.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.925+0000 7f9aaae00700 1 -- 172.21.15.2:0/477425750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9aa40772e0 msgr2=0x7f9aa4112e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:36.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.925+0000 7f9aaae00700 1 --2- 172.21.15.2:0/477425750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9aa40772e0 0x7f9aa4112e00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009990 tx=0x7f9a8c009ca0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.925+0000 7f9aaae00700 1 -- 172.21.15.2:0/477425750 shutdown_connections 2024-06-13T11:30:36.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.925+0000 7f9aaae00700 1 --2- 172.21.15.2:0/477425750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9aa4113340 0x7f9aa4115730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.925+0000 7f9aaae00700 1 --2- 172.21.15.2:0/477425750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa40769c0 0x7f9aa4076da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.925+0000 7f9aaae00700 1 --2- 172.21.15.2:0/477425750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9aa40772e0 0x7f9aa4112e00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.925+0000 7f9aaae00700 1 -- 172.21.15.2:0/477425750 >> 172.21.15.2:0/477425750 conn(0x7f9aa4100190 msgr2=0x7f9aa41025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:36.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.925+0000 7f9aaae00700 1 -- 172.21.15.2:0/477425750 shutdown_connections 2024-06-13T11:30:36.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.925+0000 7f9aaae00700 1 -- 172.21.15.2:0/477425750 wait complete. 2024-06-13T11:30:36.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.926+0000 7f9aaae00700 1 Processor -- start 2024-06-13T11:30:36.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.926+0000 7f9aaae00700 1 -- start start 2024-06-13T11:30:36.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.927+0000 7f9aaae00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9aa40769c0 0x7f9aa419f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.927+0000 7f9aaae00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa40772e0 0x7f9aa419f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.927+0000 7f9aaae00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9aa4113340 0x7f9aa41a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.927+0000 7f9aaae00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa4118e70 con 0x7f9aa4113340 2024-06-13T11:30:36.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.927+0000 7f9aaae00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa4118cf0 con 0x7f9aa40769c0 2024-06-13T11:30:36.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.927+0000 7f9aaae00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa4118ff0 con 0x7f9aa40772e0 2024-06-13T11:30:36.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.927+0000 7f9a9b400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa40772e0 0x7f9aa419f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.927+0000 7f9aa3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9aa40769c0 0x7f9aa419f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.927+0000 7f9aa8e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9aa4113340 0x7f9aa41a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.927+0000 7f9a9b400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa40772e0 0x7f9aa419f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:46168/0 (socket says 172.21.15.2:46168) 2024-06-13T11:30:36.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.927+0000 7f9a9b400700 1 -- 172.21.15.2:0/3932898286 learned_addr learned my addr 172.21.15.2:0/3932898286 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:36.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.927+0000 7f9aa3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9aa40769c0 0x7f9aa419f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:34066/0 (socket says 172.21.15.2:34066) 2024-06-13T11:30:36.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.928+0000 7f9a9b400700 1 -- 172.21.15.2:0/3932898286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9aa40769c0 msgr2=0x7f9aa419f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:36.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.928+0000 7f9a9b400700 1 --2- 172.21.15.2:0/3932898286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9aa40769c0 0x7f9aa419f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.928+0000 7f9a9b400700 1 -- 172.21.15.2:0/3932898286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9aa4113340 msgr2=0x7f9aa41a3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.928+0000 7f9a9b400700 1 --2- 172.21.15.2:0/3932898286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9aa4113340 0x7f9aa41a3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.928+0000 7f9a9b400700 1 -- 172.21.15.2:0/3932898286 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa41a4330 con 0x7f9aa40772e0 2024-06-13T11:30:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.928+0000 7f9a9b400700 1 --2- 172.21.15.2:0/3932898286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa40772e0 0x7f9aa419f860 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c005910 tx=0x7f9a8c00bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.928+0000 7f9aa1600700 1 -- 172.21.15.2:0/3932898286 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c027070 con 0x7f9aa40772e0 2024-06-13T11:30:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.929+0000 7f9aaae00700 1 -- 172.21.15.2:0/3932898286 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa41a45c0 con 0x7f9aa40772e0 2024-06-13T11:30:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.929+0000 7f9aa1600700 1 -- 172.21.15.2:0/3932898286 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a8c004650 con 0x7f9aa40772e0 2024-06-13T11:30:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.929+0000 7f9aa1600700 1 -- 172.21.15.2:0/3932898286 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c00f460 con 0x7f9aa40772e0 2024-06-13T11:30:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.929+0000 7f9aaae00700 1 -- 172.21.15.2:0/3932898286 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa41abea0 con 0x7f9aa40772e0 2024-06-13T11:30:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.932+0000 7f9aa1600700 1 -- 172.21.15.2:0/3932898286 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f9a8c02a070 con 0x7f9aa40772e0 2024-06-13T11:30:36.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.934+0000 7f9ab579ab80 1 Processor -- start 2024-06-13T11:30:36.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.934+0000 7f9ab579ab80 1 -- start start 2024-06-13T11:30:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.934+0000 7f9aa1600700 1 --2- 172.21.15.2:0/3932898286 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f9a880a2d90 0x7f9a880a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.935+0000 7f9ab579ab80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f30cb90 0x564b6f30cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.935+0000 7f9ab579ab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30d4b0 0x564b6f306d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.935+0000 7f9ab579ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f307240 0x564b6f307680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.935+0000 7f9ab579ab80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564b6f215a10 con 0x564b6f30cb90 2024-06-13T11:30:36.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.935+0000 7f9ab579ab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564b6f258b00 con 0x564b6f30d4b0 2024-06-13T11:30:36.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.935+0000 7f9ab579ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x564b6f2138f0 con 0x564b6f307240 2024-06-13T11:30:36.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.935+0000 7f9aa1600700 1 -- 172.21.15.2:0/3932898286 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f9a8c0d06b0 con 0x7f9aa40772e0 2024-06-13T11:30:36.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.935+0000 7f9aa8e00700 1 --2- 172.21.15.2:0/3932898286 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f9a880a2d90 0x7f9a880a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.935+0000 7f9aa3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f30cb90 0x564b6f30cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.935+0000 7f9aa3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f30cb90 0x564b6f30cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47696/0 (socket says 172.21.15.2:47696) 2024-06-13T11:30:36.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.935+0000 7f9aa3e00700 1 -- 172.21.15.2:0/3839938099 learned_addr learned my addr 172.21.15.2:0/3839938099 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:36.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.935+0000 7f9a9b400700 1 --2- 172.21.15.2:0/3839938099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30d4b0 0x564b6f306d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.935+0000 7f9aa8e00700 1 --2- 172.21.15.2:0/3839938099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f307240 0x564b6f307680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.936+0000 7f9a9b400700 1 -- 172.21.15.2:0/3839938099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f307240 msgr2=0x564b6f307680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:36.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.936+0000 7f9a9b400700 1 --2- 172.21.15.2:0/3839938099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f307240 0x564b6f307680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.936+0000 7f9a9b400700 1 -- 172.21.15.2:0/3839938099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f30cb90 msgr2=0x564b6f30cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:36.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.936+0000 7f9a9b400700 1 --2- 172.21.15.2:0/3839938099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f30cb90 0x564b6f30cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.936+0000 7f9a9b400700 1 -- 172.21.15.2:0/3839938099 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b6f200f90 con 0x564b6f30d4b0 2024-06-13T11:30:36.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.936+0000 7f9aa8e00700 1 --2- 172.21.15.2:0/3839938099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f307240 0x564b6f307680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:30:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.936+0000 7f9aa8e00700 1 --2- 172.21.15.2:0/3932898286 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f9a880a2d90 0x7f9a880a5250 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009ec0 tx=0x7f9a9c00fc40 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.936+0000 7f9a9b400700 1 --2- 172.21.15.2:0/3839938099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30d4b0 0x564b6f306d00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0cda30 tx=0x7f9a8c09c570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20fa0264f77ec3ac server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.936+0000 7f9a99600700 1 -- 172.21.15.2:0/3839938099 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c09d0b0 con 0x564b6f30d4b0 2024-06-13T11:30:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.937+0000 7f9a99600700 1 -- 172.21.15.2:0/3839938099 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a8c0cf070 con 0x564b6f30d4b0 2024-06-13T11:30:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.937+0000 7f9a99600700 1 -- 172.21.15.2:0/3839938099 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c0a30c0 con 0x564b6f30d4b0 2024-06-13T11:30:36.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.937+0000 7f9ab579ab80 1 -- 172.21.15.2:0/3839938099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30d4b0 msgr2=0x564b6f306d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:36.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.937+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/3839938099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30d4b0 0x564b6f306d00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0cda30 tx=0x7f9a8c09c570 comp rx=0 tx=0).stop 2024-06-13T11:30:36.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.937+0000 7f9ab579ab80 1 -- 172.21.15.2:0/3839938099 shutdown_connections 2024-06-13T11:30:36.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.937+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/3839938099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f30cb90 0x564b6f30cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.937+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/3839938099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f307240 0x564b6f307680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.937+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/3839938099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30d4b0 0x564b6f306d00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.937+0000 7f9ab579ab80 1 -- 172.21.15.2:0/3839938099 >> 172.21.15.2:0/3839938099 conn(0x564b6f233170 msgr2=0x564b6f301ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:36.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.938+0000 7f9ab579ab80 1 -- 172.21.15.2:0/3839938099 shutdown_connections 2024-06-13T11:30:36.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.938+0000 7f9ab579ab80 1 -- 172.21.15.2:0/3839938099 wait complete. 2024-06-13T11:30:36.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.938+0000 7f9ab579ab80 1 -- start start 2024-06-13T11:30:36.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.938+0000 7f9ab579ab80 1 Processor -- start 2024-06-13T11:30:36.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.939+0000 7f9ab579ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f307240 0x564b6f313130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.939+0000 7f9ab579ab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 0x564b6f3104d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.939+0000 7f9ab579ab80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f30d4b0 0x564b6f310a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.939+0000 7f9ab579ab80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564b6f1f4f60 con 0x564b6f30d4b0 2024-06-13T11:30:36.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.939+0000 7f9ab579ab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564b6f254ac0 con 0x564b6f30cb90 2024-06-13T11:30:36.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.939+0000 7f9ab579ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x564b6f313c40 con 0x564b6f307240 2024-06-13T11:30:36.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.939+0000 7f9ab579ab80 10 client.0 _ll_register_callbacks cb 0x564b6f1ee380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:30:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.939+0000 7f9aa3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f307240 0x564b6f313130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.939+0000 7f9aa3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f307240 0x564b6f313130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:46186/0 (socket says 172.21.15.2:46186) 2024-06-13T11:30:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.939+0000 7f9aa3e00700 1 -- 172.21.15.2:0/3181404919 learned_addr learned my addr 172.21.15.2:0/3181404919 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.939+0000 7f9a9b400700 1 --2- 172.21.15.2:0/3181404919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 0x564b6f3104d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.939+0000 7f9aa8e00700 1 --2- 172.21.15.2:0/3181404919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f30d4b0 0x564b6f310a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.940+0000 7f9aa3e00700 1 -- 172.21.15.2:0/3181404919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 msgr2=0x564b6f3104d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.940+0000 7f9aa3e00700 1 --2- 172.21.15.2:0/3181404919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 0x564b6f3104d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.940+0000 7f9aa3e00700 1 -- 172.21.15.2:0/3181404919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f30d4b0 msgr2=0x564b6f310a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.940+0000 7f9aa3e00700 1 --2- 172.21.15.2:0/3181404919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f30d4b0 0x564b6f310a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.940+0000 7f9aa3e00700 1 -- 172.21.15.2:0/3181404919 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b6f1a78d0 con 0x564b6f307240 2024-06-13T11:30:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.940+0000 7f9a9b400700 1 --2- 172.21.15.2:0/3181404919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 0x564b6f3104d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:30:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.940+0000 7f9aa3e00700 1 --2- 172.21.15.2:0/3181404919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f307240 0x564b6f313130 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9a94012900 tx=0x7f9a94012c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b31ecd1889f5f42 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.940+0000 7f9a92000700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:30:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.940+0000 7f9a92000700 1 -- 172.21.15.2:0/3181404919 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9400f5e0 con 0x564b6f307240 2024-06-13T11:30:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.940+0000 7f9a92000700 1 -- 172.21.15.2:0/3181404919 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f9a9400f780 con 0x564b6f307240 2024-06-13T11:30:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.940+0000 7f9ab579ab80 1 -- 172.21.15.2:0/3181404919 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a8c0cf070 con 0x564b6f307240 2024-06-13T11:30:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.941+0000 7f9a92000700 1 -- 172.21.15.2:0/3181404919 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9a9400f980 con 0x564b6f307240 2024-06-13T11:30:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.941+0000 7f9ab579ab80 10 client.26119 fetch_fsmap learned FSMap version 31 2024-06-13T11:30:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.941+0000 7f9ab579ab80 1 -- 172.21.15.2:0/3181404919 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564b6f31e2e0 con 0x564b6f307240 2024-06-13T11:30:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.941+0000 7f9a92000700 1 -- 172.21.15.2:0/3181404919 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a8c0cf070 con 0x564b6f307240 2024-06-13T11:30:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.941+0000 7f9a92000700 1 -- 172.21.15.2:0/3181404919 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f9a94010b70 con 0x564b6f307240 2024-06-13T11:30:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.941+0000 7f9ab579ab80 10 client.26119 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:30:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.941+0000 7f9ab579ab80 10 client.26119 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:30:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.942+0000 7f9ab579ab80 20 client.26119 populate_metadata read hostname 'smithi002' 2024-06-13T11:30:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.942+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/3181404919 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x564b6f320920 0x564b6f322d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.942+0000 7f9ab579ab80 4 client.26119 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:30:36.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.942+0000 7f9ab579ab80 1 -- 172.21.15.2:0/3181404919 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b6f266000 con 0x564b6f320920 2024-06-13T11:30:36.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.942+0000 7f9a9b400700 1 --2- 172.21.15.2:0/3181404919 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x564b6f320920 0x564b6f322d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.943+0000 7f9a9b400700 1 --2- 172.21.15.2:0/3181404919 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x564b6f320920 0x564b6f322d10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d6526da621f31050 server_cookie=d2746aed6861d984 in_seq=0 out_seq=0 2024-06-13T11:30:36.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.943+0000 7f9a92000700 10 client.26119 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:30:36.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.943+0000 7f9a92000700 1 -- 172.21.15.2:0/3181404919 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564b6f266000 con 0x564b6f320920 2024-06-13T11:30:36.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.944+0000 7f9a92000700 10 client.26119 handle_command_reply: tid=0 2024-06-13T11:30:36.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.944+0000 7f9ab579ab80 1 client.26119 shutdown 2024-06-13T11:30:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.944+0000 7f9ab579ab80 1 -- 172.21.15.2:0/3181404919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f307240 msgr2=0x564b6f313130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.944+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/3181404919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f307240 0x564b6f313130 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9a94012900 tx=0x7f9a94012c10 comp rx=0 tx=0).stop 2024-06-13T11:30:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.944+0000 7f9ab579ab80 1 -- 172.21.15.2:0/3181404919 shutdown_connections 2024-06-13T11:30:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.944+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/3181404919 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x564b6f320920 0x564b6f322d10 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.944+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/3181404919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f30d4b0 0x564b6f310a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.944+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/3181404919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f307240 0x564b6f313130 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.944+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/3181404919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 0x564b6f3104d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.944+0000 7f9a92000700 0 client.26119 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:30:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.944+0000 7f9ab579ab80 1 -- 172.21.15.2:0/3181404919 >> 172.21.15.2:0/3181404919 conn(0x564b6f233170 msgr2=0x564b6f2fb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:36.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.944+0000 7f9ab579ab80 1 -- 172.21.15.2:0/3181404919 shutdown_connections 2024-06-13T11:30:36.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.944+0000 7f9ab579ab80 1 -- 172.21.15.2:0/3181404919 wait complete. 2024-06-13T11:30:36.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.944+0000 7f9ab579ab80 20 client.26119 trim_cache size 0 max 16384 2024-06-13T11:30:36.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.961+0000 7f9ab579ab80 1 Processor -- start 2024-06-13T11:30:36.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.962+0000 7f9ab579ab80 1 -- start start 2024-06-13T11:30:36.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.962+0000 7f9ab579ab80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f307240 0x564b6f306d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.962+0000 7f9ab579ab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 0x564b6f3021a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.962+0000 7f9ab579ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f30d4b0 0x564b6f2fc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.962+0000 7f9ab579ab80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa41b7340 con 0x564b6f307240 2024-06-13T11:30:36.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.962+0000 7f9ab579ab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa41b4bd0 con 0x564b6f30cb90 2024-06-13T11:30:36.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.962+0000 7f9ab579ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa41b2a20 con 0x564b6f30d4b0 2024-06-13T11:30:36.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.962+0000 7f9aa3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f307240 0x564b6f306d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.962+0000 7f9a9b400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 0x564b6f3021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.962+0000 7f9a9b400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 0x564b6f3021a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:34096/0 (socket says 172.21.15.2:34096) 2024-06-13T11:30:36.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.962+0000 7f9a9b400700 1 -- 172.21.15.2:0/1785498015 learned_addr learned my addr 172.21.15.2:0/1785498015 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:36.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.962+0000 7f9aa8e00700 1 --2- 172.21.15.2:0/1785498015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f30d4b0 0x564b6f2fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.963+0000 7f9a9b400700 1 -- 172.21.15.2:0/1785498015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f30d4b0 msgr2=0x564b6f2fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:36.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.963+0000 7f9a9b400700 1 --2- 172.21.15.2:0/1785498015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f30d4b0 0x564b6f2fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.963+0000 7f9a9b400700 1 -- 172.21.15.2:0/1785498015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f307240 msgr2=0x564b6f306d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:36.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.963+0000 7f9a9b400700 1 --2- 172.21.15.2:0/1785498015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f307240 0x564b6f306d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.963+0000 7f9a9b400700 1 -- 172.21.15.2:0/1785498015 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b6f30c5b0 con 0x564b6f30cb90 2024-06-13T11:30:36.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.963+0000 7f9a9b400700 1 --2- 172.21.15.2:0/1785498015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 0x564b6f3021a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00be00 tx=0x7f9a8c0224f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96b8cdc1a2b7e494 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:36.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.963+0000 7f9a98c00700 1 -- 172.21.15.2:0/1785498015 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c09c310 con 0x564b6f30cb90 2024-06-13T11:30:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.964+0000 7f9a98c00700 1 -- 172.21.15.2:0/1785498015 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a8c0cf040 con 0x564b6f30cb90 2024-06-13T11:30:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.964+0000 7f9a98c00700 1 -- 172.21.15.2:0/1785498015 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c09cc10 con 0x564b6f30cb90 2024-06-13T11:30:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.964+0000 7f9ab579ab80 1 -- 172.21.15.2:0/1785498015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 msgr2=0x564b6f3021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.964+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/1785498015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 0x564b6f3021a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00be00 tx=0x7f9a8c0224f0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.964+0000 7f9ab579ab80 1 -- 172.21.15.2:0/1785498015 shutdown_connections 2024-06-13T11:30:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.964+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/1785498015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f307240 0x564b6f306d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.964+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/1785498015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f30d4b0 0x564b6f2fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.964+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/1785498015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 0x564b6f3021a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.964+0000 7f9ab579ab80 1 -- 172.21.15.2:0/1785498015 >> 172.21.15.2:0/1785498015 conn(0x564b6f233170 msgr2=0x564b6f301a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.964+0000 7f9ab579ab80 1 -- 172.21.15.2:0/1785498015 shutdown_connections 2024-06-13T11:30:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.965+0000 7f9ab579ab80 1 -- 172.21.15.2:0/1785498015 wait complete. 2024-06-13T11:30:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.965+0000 7f9ab579ab80 1 -- start start 2024-06-13T11:30:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.965+0000 7f9ab579ab80 1 Processor -- start 2024-06-13T11:30:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.966+0000 7f9ab579ab80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f307240 0x564b6f319140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.966+0000 7f9ab579ab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 0x564b6f319680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.966+0000 7f9ab579ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f30d4b0 0x564b6f327cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.966+0000 7f9ab579ab80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa41b3090 con 0x564b6f307240 2024-06-13T11:30:36.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.966+0000 7f9ab579ab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa41b4500 con 0x564b6f30cb90 2024-06-13T11:30:36.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.966+0000 7f9ab579ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa41b3760 con 0x564b6f30d4b0 2024-06-13T11:30:36.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.966+0000 7f9ab579ab80 10 client.0 _ll_register_callbacks cb 0x564b6f1ee380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:30:36.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.966+0000 7f9aa3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f307240 0x564b6f319140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.966+0000 7f9aa3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f307240 0x564b6f319140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47732/0 (socket says 172.21.15.2:47732) 2024-06-13T11:30:36.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.966+0000 7f9aa3e00700 1 -- 172.21.15.2:0/1221032233 learned_addr learned my addr 172.21.15.2:0/1221032233 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:36.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.966+0000 7f9a9b400700 1 --2- 172.21.15.2:0/1221032233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 0x564b6f319680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.966+0000 7f9aa8e00700 1 --2- 172.21.15.2:0/1221032233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f30d4b0 0x564b6f327cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.966+0000 7f9aa3e00700 1 -- 172.21.15.2:0/1221032233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f30d4b0 msgr2=0x564b6f327cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:36.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.966+0000 7f9aa3e00700 1 --2- 172.21.15.2:0/1221032233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f30d4b0 0x564b6f327cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.966+0000 7f9aa3e00700 1 -- 172.21.15.2:0/1221032233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 msgr2=0x564b6f319680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:36.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.966+0000 7f9aa3e00700 1 --2- 172.21.15.2:0/1221032233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 0x564b6f319680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.967+0000 7f9aa3e00700 1 -- 172.21.15.2:0/1221032233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b6f328500 con 0x564b6f307240 2024-06-13T11:30:36.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.967+0000 7f9a9b400700 1 --2- 172.21.15.2:0/1221032233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 0x564b6f319680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:30:36.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.967+0000 7f9aa3e00700 1 --2- 172.21.15.2:0/1221032233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f307240 0x564b6f319140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9a94005e90 tx=0x7f9a9400fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19686e1bc8c1b37 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:36.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.967+0000 7f9a92000700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:30:36.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.967+0000 7f9a92000700 1 -- 172.21.15.2:0/1221032233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9402f060 con 0x564b6f307240 2024-06-13T11:30:36.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.967+0000 7f9a92000700 1 -- 172.21.15.2:0/1221032233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f9a940122e0 con 0x564b6f307240 2024-06-13T11:30:36.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.967+0000 7f9ab579ab80 1 -- 172.21.15.2:0/1221032233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a8c0cf040 con 0x564b6f307240 2024-06-13T11:30:36.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.967+0000 7f9a92000700 1 -- 172.21.15.2:0/1221032233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9a94005250 con 0x564b6f307240 2024-06-13T11:30:36.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.967+0000 7f9ab579ab80 10 client.15981 fetch_fsmap learned FSMap version 31 2024-06-13T11:30:36.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.967+0000 7f9ab579ab80 1 -- 172.21.15.2:0/1221032233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564b6f38b1b0 con 0x564b6f307240 2024-06-13T11:30:36.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.968+0000 7f9a92000700 1 -- 172.21.15.2:0/1221032233 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a8c0cf040 con 0x564b6f307240 2024-06-13T11:30:36.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.968+0000 7f9a92000700 1 -- 172.21.15.2:0/1221032233 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f9a9401c610 con 0x564b6f307240 2024-06-13T11:30:36.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.968+0000 7f9ab579ab80 10 client.15981 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:30:36.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.968+0000 7f9ab579ab80 10 client.15981 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:30:36.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.968+0000 7f9ab579ab80 20 client.15981 populate_metadata read hostname 'smithi002' 2024-06-13T11:30:36.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.968+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/1221032233 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x564b6f38b8f0 0x564b6f38dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:36.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.968+0000 7f9ab579ab80 4 client.15981 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:30:36.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.968+0000 7f9ab579ab80 1 -- 172.21.15.2:0/1221032233 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564b6f260580 con 0x564b6f38b8f0 2024-06-13T11:30:36.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.969+0000 7f9a9b400700 1 --2- 172.21.15.2:0/1221032233 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x564b6f38b8f0 0x564b6f38dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:36.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.969+0000 7f9a9b400700 1 --2- 172.21.15.2:0/1221032233 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x564b6f38b8f0 0x564b6f38dd10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=df39032c331e25d3 server_cookie=dee86460da8e1c2d in_seq=0 out_seq=0 2024-06-13T11:30:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.969+0000 7f9a92000700 10 client.15981 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:30:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.969+0000 7f9a92000700 1 -- 172.21.15.2:0/1221032233 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564b6f260580 con 0x564b6f38b8f0 2024-06-13T11:30:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.969+0000 7f9a92000700 10 client.15981 handle_command_reply: tid=0 2024-06-13T11:30:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.969+0000 7f9ab579ab80 1 client.15981 shutdown 2024-06-13T11:30:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.969+0000 7f9ab579ab80 1 -- 172.21.15.2:0/1221032233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f307240 msgr2=0x564b6f319140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.969+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/1221032233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f307240 0x564b6f319140 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9a94005e90 tx=0x7f9a9400fd50 comp rx=0 tx=0).stop 2024-06-13T11:30:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.970+0000 7f9ab579ab80 1 -- 172.21.15.2:0/1221032233 shutdown_connections 2024-06-13T11:30:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.970+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/1221032233 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x564b6f38b8f0 0x564b6f38dd10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.970+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/1221032233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564b6f307240 0x564b6f319140 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.970+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/1221032233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564b6f30d4b0 0x564b6f327cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.970+0000 7f9ab579ab80 1 --2- 172.21.15.2:0/1221032233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564b6f30cb90 0x564b6f319680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.970+0000 7f9a92000700 0 client.15981 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:30:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.970+0000 7f9ab579ab80 1 -- 172.21.15.2:0/1221032233 >> 172.21.15.2:0/1221032233 conn(0x564b6f233170 msgr2=0x564b6f30d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.970+0000 7f9ab579ab80 1 -- 172.21.15.2:0/1221032233 shutdown_connections 2024-06-13T11:30:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.970+0000 7f9ab579ab80 1 -- 172.21.15.2:0/1221032233 wait complete. 2024-06-13T11:30:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.970+0000 7f9ab579ab80 20 client.15981 trim_cache size 0 max 16384 2024-06-13T11:30:36.976 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:30:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.971+0000 7f9aaae00700 1 -- 172.21.15.2:0/3932898286 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f9a880a2d90 msgr2=0x7f9a880a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.971+0000 7f9aaae00700 1 --2- 172.21.15.2:0/3932898286 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f9a880a2d90 0x7f9a880a5250 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009ec0 tx=0x7f9a9c00fc40 comp rx=0 tx=0).stop 2024-06-13T11:30:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.971+0000 7f9aaae00700 1 -- 172.21.15.2:0/3932898286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa40772e0 msgr2=0x7f9aa419f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.971+0000 7f9aaae00700 1 --2- 172.21.15.2:0/3932898286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa40772e0 0x7f9aa419f860 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c005910 tx=0x7f9a8c00bab0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.971+0000 7f9aaae00700 1 -- 172.21.15.2:0/3932898286 shutdown_connections 2024-06-13T11:30:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.971+0000 7f9aaae00700 1 --2- 172.21.15.2:0/3932898286 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f9a880a2d90 0x7f9a880a5250 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.971+0000 7f9aaae00700 1 --2- 172.21.15.2:0/3932898286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9aa4113340 0x7f9aa41a3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.971+0000 7f9aaae00700 1 --2- 172.21.15.2:0/3932898286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9aa40769c0 0x7f9aa419f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.971+0000 7f9aaae00700 1 --2- 172.21.15.2:0/3932898286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa40772e0 0x7f9aa419f860 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.971+0000 7f9aaae00700 1 -- 172.21.15.2:0/3932898286 >> 172.21.15.2:0/3932898286 conn(0x7f9aa4100190 msgr2=0x7f9aa4102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.971+0000 7f9aaae00700 1 -- 172.21.15.2:0/3932898286 shutdown_connections 2024-06-13T11:30:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:36.971+0000 7f9aaae00700 1 -- 172.21.15.2:0/3932898286 wait complete. 2024-06-13T11:30:37.986 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:37 smithi002 ceph-mon[32210]: pgmap v208: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:37.990 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-13T11:30:38.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:37 smithi077 ceph-mon[36410]: pgmap v208: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:38.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:37 smithi178 ceph-mon[36913]: pgmap v208: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:38.482 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:30:39.893 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:39 smithi002 ceph-mon[32210]: pgmap v209: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:40.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:39 smithi077 ceph-mon[36410]: pgmap v209: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:40.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:39 smithi178 ceph-mon[36913]: pgmap v209: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:40.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.822+0000 7fb050800700 1 -- 172.21.15.2:0/972317078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04806a170 msgr2=0x7fb04806a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:40.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.822+0000 7fb050800700 1 --2- 172.21.15.2:0/972317078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04806a170 0x7fb04806a5f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb038009990 tx=0x7fb038009ca0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.822+0000 7fb050800700 1 -- 172.21.15.2:0/972317078 shutdown_connections 2024-06-13T11:30:40.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.822+0000 7fb050800700 1 --2- 172.21.15.2:0/972317078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb048108500 0x7fb0481088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.822+0000 7fb050800700 1 --2- 172.21.15.2:0/972317078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb04806ab30 0x7fb04810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.822+0000 7fb050800700 1 --2- 172.21.15.2:0/972317078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04806a170 0x7fb04806a5f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.822+0000 7fb050800700 1 -- 172.21.15.2:0/972317078 >> 172.21.15.2:0/972317078 conn(0x7fb048078340 msgr2=0x7fb048078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:40.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.822+0000 7fb050800700 1 -- 172.21.15.2:0/972317078 shutdown_connections 2024-06-13T11:30:40.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.822+0000 7fb050800700 1 -- 172.21.15.2:0/972317078 wait complete. 2024-06-13T11:30:40.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.824+0000 7fb050800700 1 Processor -- start 2024-06-13T11:30:40.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.824+0000 7fb050800700 1 -- start start 2024-06-13T11:30:40.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.824+0000 7fb050800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb04806a170 0x7fb048101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.824+0000 7fb050800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04806ab30 0x7fb0481019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.824+0000 7fb050800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb048108500 0x7fb048101ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.824+0000 7fb050800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb0481127b0 con 0x7fb04806a170 2024-06-13T11:30:40.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.824+0000 7fb050800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb048112630 con 0x7fb04806ab30 2024-06-13T11:30:40.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.824+0000 7fb050800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb048112930 con 0x7fb048108500 2024-06-13T11:30:40.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.825+0000 7fb04de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb04806a170 0x7fb048101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.825+0000 7fb04de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb04806a170 0x7fb048101460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47754/0 (socket says 172.21.15.2:47754) 2024-06-13T11:30:40.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.825+0000 7fb04de00700 1 -- 172.21.15.2:0/424075096 learned_addr learned my addr 172.21.15.2:0/424075096 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:40.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.825+0000 7fb04d400700 1 --2- 172.21.15.2:0/424075096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04806ab30 0x7fb0481019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.825+0000 7fb04e800700 1 --2- 172.21.15.2:0/424075096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb048108500 0x7fb048101ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.825+0000 7fb04de00700 1 -- 172.21.15.2:0/424075096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb048108500 msgr2=0x7fb048101ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:40.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.825+0000 7fb04de00700 1 --2- 172.21.15.2:0/424075096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb048108500 0x7fb048101ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.825+0000 7fb04de00700 1 -- 172.21.15.2:0/424075096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04806ab30 msgr2=0x7fb0481019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:40.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.825+0000 7fb04de00700 1 --2- 172.21.15.2:0/424075096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04806ab30 0x7fb0481019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.825+0000 7fb04de00700 1 -- 172.21.15.2:0/424075096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0481a7230 con 0x7fb04806a170 2024-06-13T11:30:40.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.825+0000 7fb04d400700 1 --2- 172.21.15.2:0/424075096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04806ab30 0x7fb0481019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:30:40.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.826+0000 7fb04de00700 1 --2- 172.21.15.2:0/424075096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb04806a170 0x7fb048101460 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00e9a0 tx=0x7fb03c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:40.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.826+0000 7fb042a00700 1 -- 172.21.15.2:0/424075096 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00ca10 con 0x7fb04806a170 2024-06-13T11:30:40.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.826+0000 7fb042a00700 1 -- 172.21.15.2:0/424075096 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb03c00cbb0 con 0x7fb04806a170 2024-06-13T11:30:40.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.826+0000 7fb042a00700 1 -- 172.21.15.2:0/424075096 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c018680 con 0x7fb04806a170 2024-06-13T11:30:40.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.826+0000 7fb050800700 1 -- 172.21.15.2:0/424075096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0481a7520 con 0x7fb04806a170 2024-06-13T11:30:40.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.826+0000 7fb050800700 1 -- 172.21.15.2:0/424075096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0481a7a10 con 0x7fb04806a170 2024-06-13T11:30:40.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.831+0000 7fb042a00700 1 -- 172.21.15.2:0/424075096 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fb03c010430 con 0x7fb04806a170 2024-06-13T11:30:40.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.832+0000 7fb05b19ab80 1 Processor -- start 2024-06-13T11:30:40.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.832+0000 7fb05b19ab80 1 -- start start 2024-06-13T11:30:40.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.833+0000 7fb05b19ab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961ae4b90 0x55d961ae4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.833+0000 7fb05b19ab80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae54b0 0x55d961aded00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.833+0000 7fb042a00700 1 --2- 172.21.15.2:0/424075096 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb0300a2d90 0x7fb0300a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.833+0000 7fb05b19ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961adf240 0x55d961adf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.833+0000 7fb05b19ab80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d9619eda10 con 0x55d961ae54b0 2024-06-13T11:30:40.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.833+0000 7fb05b19ab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d961a30b00 con 0x55d961ae4b90 2024-06-13T11:30:40.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.833+0000 7fb05b19ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d9619eb8f0 con 0x55d961adf240 2024-06-13T11:30:40.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.833+0000 7fb042a00700 1 -- 172.21.15.2:0/424075096 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fb03c0cf9d0 con 0x7fb04806a170 2024-06-13T11:30:40.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.833+0000 7fb04de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae54b0 0x55d961aded00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.833+0000 7fb04d400700 1 --2- 172.21.15.2:0/424075096 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb0300a2d90 0x7fb0300a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.833+0000 7fb04de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae54b0 0x55d961aded00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47770/0 (socket says 172.21.15.2:47770) 2024-06-13T11:30:40.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.833+0000 7fb04de00700 1 -- 172.21.15.2:0/712751832 learned_addr learned my addr 172.21.15.2:0/712751832 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:40.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.833+0000 7fb04e800700 1 --2- 172.21.15.2:0/712751832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961ae4b90 0x55d961ae4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.833+0000 7fb04e800700 1 --2- 172.21.15.2:0/712751832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961adf240 0x55d961adf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.834+0000 7fb04de00700 1 -- 172.21.15.2:0/712751832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961adf240 msgr2=0x55d961adf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:40.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.834+0000 7fb04de00700 1 --2- 172.21.15.2:0/712751832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961adf240 0x55d961adf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.834+0000 7fb04de00700 1 -- 172.21.15.2:0/712751832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961ae4b90 msgr2=0x55d961ae4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:40.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.834+0000 7fb04de00700 1 --2- 172.21.15.2:0/712751832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961ae4b90 0x55d961ae4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.834+0000 7fb04de00700 1 -- 172.21.15.2:0/712751832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9619d8f90 con 0x55d961ae54b0 2024-06-13T11:30:40.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.834+0000 7fb04e800700 1 --2- 172.21.15.2:0/712751832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961adf240 0x55d961adf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:30:40.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.834+0000 7fb04de00700 1 --2- 172.21.15.2:0/712751832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae54b0 0x55d961aded00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0a4260 tx=0x7fb03c09c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164f62fb12996617 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:40.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.834+0000 7fb04d400700 1 --2- 172.21.15.2:0/424075096 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb0300a2d90 0x7fb0300a5250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb0480789d0 tx=0x7fb03800b260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:40.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.834+0000 7fb037400700 1 -- 172.21.15.2:0/712751832 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0a4790 con 0x55d961ae54b0 2024-06-13T11:30:40.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.835+0000 7fb037400700 1 -- 172.21.15.2:0/712751832 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb03c09ce50 con 0x55d961ae54b0 2024-06-13T11:30:40.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.835+0000 7fb037400700 1 -- 172.21.15.2:0/712751832 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0a4300 con 0x55d961ae54b0 2024-06-13T11:30:40.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.836+0000 7fb05b19ab80 1 -- 172.21.15.2:0/712751832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae54b0 msgr2=0x55d961aded00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:40.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.836+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/712751832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae54b0 0x55d961aded00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0a4260 tx=0x7fb03c09c220 comp rx=0 tx=0).stop 2024-06-13T11:30:40.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.836+0000 7fb05b19ab80 1 -- 172.21.15.2:0/712751832 shutdown_connections 2024-06-13T11:30:40.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.836+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/712751832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961adf240 0x55d961adf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.836+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/712751832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961ae4b90 0x55d961ae4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.836+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/712751832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae54b0 0x55d961aded00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.836+0000 7fb05b19ab80 1 -- 172.21.15.2:0/712751832 >> 172.21.15.2:0/712751832 conn(0x55d961a0b170 msgr2=0x55d961ad9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:40.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.836+0000 7fb05b19ab80 1 -- 172.21.15.2:0/712751832 shutdown_connections 2024-06-13T11:30:40.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.836+0000 7fb05b19ab80 1 -- 172.21.15.2:0/712751832 wait complete. 2024-06-13T11:30:40.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.837+0000 7fb05b19ab80 1 -- start start 2024-06-13T11:30:40.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.837+0000 7fb05b19ab80 1 Processor -- start 2024-06-13T11:30:40.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.837+0000 7fb05b19ab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961adf240 0x55d961aeb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.837+0000 7fb05b19ab80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae4b90 0x55d961ae8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.837+0000 7fb05b19ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae54b0 0x55d961ae8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.837+0000 7fb05b19ab80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d9619ccf60 con 0x55d961ae4b90 2024-06-13T11:30:40.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.837+0000 7fb05b19ab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d961a2cac0 con 0x55d961adf240 2024-06-13T11:30:40.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.837+0000 7fb05b19ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d961aebe90 con 0x55d961ae54b0 2024-06-13T11:30:40.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.838+0000 7fb05b19ab80 10 client.0 _ll_register_callbacks cb 0x55d9619c6380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:30:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.838+0000 7fb04d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae4b90 0x55d961ae8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.838+0000 7fb04d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae4b90 0x55d961ae8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47780/0 (socket says 172.21.15.2:47780) 2024-06-13T11:30:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.838+0000 7fb04e800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae54b0 0x55d961ae8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.838+0000 7fb04d400700 1 -- 172.21.15.2:0/1949603493 learned_addr learned my addr 172.21.15.2:0/1949603493 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.838+0000 7fb04de00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961adf240 0x55d961aeb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.838+0000 7fb04de00700 1 -- 172.21.15.2:0/1949603493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae54b0 msgr2=0x55d961ae8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.838+0000 7fb04de00700 1 --2- 172.21.15.2:0/1949603493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae54b0 0x55d961ae8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.838+0000 7fb04de00700 1 -- 172.21.15.2:0/1949603493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae4b90 msgr2=0x55d961ae8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:40.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.838+0000 7fb04de00700 1 --2- 172.21.15.2:0/1949603493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae4b90 0x55d961ae8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.838+0000 7fb04de00700 1 -- 172.21.15.2:0/1949603493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d96197f8d0 con 0x55d961adf240 2024-06-13T11:30:40.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.838+0000 7fb04e800700 1 --2- 172.21.15.2:0/1949603493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae54b0 0x55d961ae8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:30:40.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.839+0000 7fb04de00700 1 --2- 172.21.15.2:0/1949603493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961adf240 0x55d961aeb240 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55d961aeba50 tx=0x7fb03c0cd2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c45dcf48c4335e5e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:40.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.839+0000 7fb02be00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:30:40.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.839+0000 7fb02be00700 1 -- 172.21.15.2:0/1949603493 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0a4500 con 0x55d961adf240 2024-06-13T11:30:40.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.839+0000 7fb02be00700 1 -- 172.21.15.2:0/1949603493 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fb03c010720 con 0x55d961adf240 2024-06-13T11:30:40.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.839+0000 7fb05b19ab80 1 -- 172.21.15.2:0/1949603493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb03c09ce50 con 0x55d961adf240 2024-06-13T11:30:40.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.839+0000 7fb02be00700 1 -- 172.21.15.2:0/1949603493 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb03c0a4790 con 0x55d961adf240 2024-06-13T11:30:40.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.839+0000 7fb05b19ab80 10 client.26102 fetch_fsmap learned FSMap version 31 2024-06-13T11:30:40.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.839+0000 7fb05b19ab80 1 -- 172.21.15.2:0/1949603493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d961af6640 con 0x55d961adf240 2024-06-13T11:30:40.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.840+0000 7fb02be00700 1 -- 172.21.15.2:0/1949603493 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb03c09ce50 con 0x55d961adf240 2024-06-13T11:30:40.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.840+0000 7fb02be00700 1 -- 172.21.15.2:0/1949603493 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fb03c097870 con 0x55d961adf240 2024-06-13T11:30:40.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.840+0000 7fb05b19ab80 10 client.26102 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:30:40.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.840+0000 7fb05b19ab80 10 client.26102 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:30:40.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.840+0000 7fb05b19ab80 20 client.26102 populate_metadata read hostname 'smithi002' 2024-06-13T11:30:40.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.840+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/1949603493 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55d961af8b10 0x55d961afaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.840+0000 7fb05b19ab80 4 client.26102 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:30:40.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.840+0000 7fb05b19ab80 1 -- 172.21.15.2:0/1949603493 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d961a3e000 con 0x55d961af8b10 2024-06-13T11:30:40.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.841+0000 7fb04d400700 1 --2- 172.21.15.2:0/1949603493 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55d961af8b10 0x55d961afaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.841+0000 7fb04d400700 1 --2- 172.21.15.2:0/1949603493 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55d961af8b10 0x55d961afaf00 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e55d3bdf829a6a83 server_cookie=7af4604e97ee0a34 in_seq=0 out_seq=0 2024-06-13T11:30:40.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.841+0000 7fb02be00700 10 client.26102 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:30:40.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.842+0000 7fb02be00700 1 -- 172.21.15.2:0/1949603493 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d961a3e000 con 0x55d961af8b10 2024-06-13T11:30:40.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.842+0000 7fb02be00700 10 client.26102 handle_command_reply: tid=0 2024-06-13T11:30:40.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.842+0000 7fb05b19ab80 1 client.26102 shutdown 2024-06-13T11:30:40.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.842+0000 7fb05b19ab80 1 -- 172.21.15.2:0/1949603493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961adf240 msgr2=0x55d961aeb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:40.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.842+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/1949603493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961adf240 0x55d961aeb240 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55d961aeba50 tx=0x7fb03c0cd2b0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.842+0000 7fb05b19ab80 1 -- 172.21.15.2:0/1949603493 shutdown_connections 2024-06-13T11:30:40.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.842+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/1949603493 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55d961af8b10 0x55d961afaf00 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.842+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/1949603493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae54b0 0x55d961ae8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.843+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/1949603493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961adf240 0x55d961aeb240 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.843+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/1949603493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae4b90 0x55d961ae8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.843+0000 7fb05b19ab80 1 -- 172.21.15.2:0/1949603493 >> 172.21.15.2:0/1949603493 conn(0x55d961a0b170 msgr2=0x55d961ad3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:40.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.843+0000 7fb02be00700 0 client.26102 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:30:40.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.843+0000 7fb05b19ab80 1 -- 172.21.15.2:0/1949603493 shutdown_connections 2024-06-13T11:30:40.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.843+0000 7fb05b19ab80 1 -- 172.21.15.2:0/1949603493 wait complete. 2024-06-13T11:30:40.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.843+0000 7fb05b19ab80 20 client.26102 trim_cache size 0 max 16384 2024-06-13T11:30:40.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.860+0000 7fb05b19ab80 1 Processor -- start 2024-06-13T11:30:40.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.860+0000 7fb05b19ab80 1 -- start start 2024-06-13T11:30:40.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.860+0000 7fb05b19ab80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961adf240 0x55d961aded00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.860+0000 7fb05b19ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae4b90 0x55d961ae6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.860+0000 7fb05b19ab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961ae54b0 0x55d961ad4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.860+0000 7fb05b19ab80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb0481b2fe0 con 0x55d961adf240 2024-06-13T11:30:40.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.860+0000 7fb05b19ab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0481b0870 con 0x55d961ae54b0 2024-06-13T11:30:40.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.860+0000 7fb05b19ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb0481ae6c0 con 0x55d961ae4b90 2024-06-13T11:30:40.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.861+0000 7fb04de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961adf240 0x55d961aded00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.861+0000 7fb04e800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961ae54b0 0x55d961ad4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.861+0000 7fb04e800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961ae54b0 0x55d961ad4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:34138/0 (socket says 172.21.15.2:34138) 2024-06-13T11:30:40.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.861+0000 7fb04de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961adf240 0x55d961aded00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47788/0 (socket says 172.21.15.2:47788) 2024-06-13T11:30:40.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.861+0000 7fb04e800700 1 -- 172.21.15.2:0/4229719374 learned_addr learned my addr 172.21.15.2:0/4229719374 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:40.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.861+0000 7fb04d400700 1 --2- 172.21.15.2:0/4229719374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae4b90 0x55d961ae6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.861+0000 7fb04e800700 1 -- 172.21.15.2:0/4229719374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae4b90 msgr2=0x55d961ae6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:40.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.861+0000 7fb04e800700 1 --2- 172.21.15.2:0/4229719374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae4b90 0x55d961ae6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.861+0000 7fb04e800700 1 -- 172.21.15.2:0/4229719374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961adf240 msgr2=0x55d961aded00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:40.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.861+0000 7fb04e800700 1 --2- 172.21.15.2:0/4229719374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961adf240 0x55d961aded00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.861+0000 7fb04e800700 1 -- 172.21.15.2:0/4229719374 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d961ae9480 con 0x55d961ae54b0 2024-06-13T11:30:40.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.861+0000 7fb04e800700 1 --2- 172.21.15.2:0/4229719374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961ae54b0 0x55d961ad4130 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb0440075e0 tx=0x7fb044004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b0ed65629f9fefa server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:40.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.862+0000 7fb036a00700 1 -- 172.21.15.2:0/4229719374 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04401e070 con 0x55d961ae54b0 2024-06-13T11:30:40.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.862+0000 7fb036a00700 1 -- 172.21.15.2:0/4229719374 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb044007dc0 con 0x55d961ae54b0 2024-06-13T11:30:40.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.862+0000 7fb036a00700 1 -- 172.21.15.2:0/4229719374 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04401a470 con 0x55d961ae54b0 2024-06-13T11:30:40.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.862+0000 7fb05b19ab80 1 -- 172.21.15.2:0/4229719374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961ae54b0 msgr2=0x55d961ad4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:40.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.862+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/4229719374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961ae54b0 0x55d961ad4130 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb0440075e0 tx=0x7fb044004b40 comp rx=0 tx=0).stop 2024-06-13T11:30:40.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.863+0000 7fb05b19ab80 1 -- 172.21.15.2:0/4229719374 shutdown_connections 2024-06-13T11:30:40.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.863+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/4229719374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961adf240 0x55d961aded00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.863+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/4229719374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961ae54b0 0x55d961ad4130 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.863+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/4229719374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae4b90 0x55d961ae6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.863+0000 7fb05b19ab80 1 -- 172.21.15.2:0/4229719374 >> 172.21.15.2:0/4229719374 conn(0x55d961a0b170 msgr2=0x55d961ae5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:40.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.863+0000 7fb05b19ab80 1 -- 172.21.15.2:0/4229719374 shutdown_connections 2024-06-13T11:30:40.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.863+0000 7fb05b19ab80 1 -- 172.21.15.2:0/4229719374 wait complete. 2024-06-13T11:30:40.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.863+0000 7fb05b19ab80 1 -- start start 2024-06-13T11:30:40.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.864+0000 7fb05b19ab80 1 Processor -- start 2024-06-13T11:30:40.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.864+0000 7fb05b19ab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961adf240 0x55d961afe290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.864+0000 7fb05b19ab80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae4b90 0x55d961afab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.864+0000 7fb05b19ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae54b0 0x55d961afb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.864+0000 7fb05b19ab80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb0481aed30 con 0x55d961ae4b90 2024-06-13T11:30:40.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.864+0000 7fb05b19ab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0481b01a0 con 0x55d961adf240 2024-06-13T11:30:40.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.864+0000 7fb05b19ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb0481af400 con 0x55d961ae54b0 2024-06-13T11:30:40.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.864+0000 7fb05b19ab80 10 client.0 _ll_register_callbacks cb 0x55d9619c6380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:30:40.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.864+0000 7fb04d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae4b90 0x55d961afab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.865+0000 7fb04de00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961adf240 0x55d961afe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.865+0000 7fb04e800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae54b0 0x55d961afb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.865+0000 7fb04d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae4b90 0x55d961afab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47800/0 (socket says 172.21.15.2:47800) 2024-06-13T11:30:40.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.865+0000 7fb04d400700 1 -- 172.21.15.2:0/2258646883 learned_addr learned my addr 172.21.15.2:0/2258646883 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:40.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.865+0000 7fb04de00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961adf240 0x55d961afe290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:34150/0 (socket says 172.21.15.2:34150) 2024-06-13T11:30:40.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.865+0000 7fb04e800700 1 -- 172.21.15.2:0/2258646883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961adf240 msgr2=0x55d961afe290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:40.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.865+0000 7fb04e800700 1 --2- 172.21.15.2:0/2258646883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961adf240 0x55d961afe290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.865+0000 7fb04e800700 1 -- 172.21.15.2:0/2258646883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae4b90 msgr2=0x55d961afab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:40.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.865+0000 7fb04e800700 1 --2- 172.21.15.2:0/2258646883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae4b90 0x55d961afab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.865+0000 7fb04e800700 1 -- 172.21.15.2:0/2258646883 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d961afb8b0 con 0x55d961ae54b0 2024-06-13T11:30:40.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.865+0000 7fb04e800700 1 --2- 172.21.15.2:0/2258646883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae54b0 0x55d961afb060 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb044004b10 tx=0x7fb044003c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=232715722946304f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:40.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.865+0000 7fb02be00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:30:40.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.866+0000 7fb02be00700 1 -- 172.21.15.2:0/2258646883 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04401e070 con 0x55d961ae54b0 2024-06-13T11:30:40.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.866+0000 7fb05b19ab80 1 -- 172.21.15.2:0/2258646883 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb044007dc0 con 0x55d961ae54b0 2024-06-13T11:30:40.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.866+0000 7fb02be00700 1 -- 172.21.15.2:0/2258646883 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7fb044004270 con 0x55d961ae54b0 2024-06-13T11:30:40.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.866+0000 7fb02be00700 1 -- 172.21.15.2:0/2258646883 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb044035050 con 0x55d961ae54b0 2024-06-13T11:30:40.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.866+0000 7fb05b19ab80 10 client.26143 fetch_fsmap learned FSMap version 31 2024-06-13T11:30:40.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.866+0000 7fb05b19ab80 1 -- 172.21.15.2:0/2258646883 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d961b623f0 con 0x55d961ae54b0 2024-06-13T11:30:40.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.866+0000 7fb02be00700 1 -- 172.21.15.2:0/2258646883 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb044007dc0 con 0x55d961ae54b0 2024-06-13T11:30:40.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.866+0000 7fb02be00700 1 -- 172.21.15.2:0/2258646883 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fb04402a020 con 0x55d961ae54b0 2024-06-13T11:30:40.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.867+0000 7fb05b19ab80 10 client.26143 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:30:40.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.867+0000 7fb05b19ab80 10 client.26143 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:30:40.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.867+0000 7fb05b19ab80 20 client.26143 populate_metadata read hostname 'smithi002' 2024-06-13T11:30:40.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.867+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/2258646883 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55d961b629d0 0x55d961b64df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:40.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.867+0000 7fb05b19ab80 4 client.26143 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:30:40.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.867+0000 7fb05b19ab80 1 -- 172.21.15.2:0/2258646883 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d961a38580 con 0x55d961b629d0 2024-06-13T11:30:40.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.867+0000 7fb04de00700 1 --2- 172.21.15.2:0/2258646883 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55d961b629d0 0x55d961b64df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:40.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.868+0000 7fb04de00700 1 --2- 172.21.15.2:0/2258646883 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55d961b629d0 0x55d961b64df0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c40ad95038733c4 server_cookie=31069ebc8f250d93 in_seq=0 out_seq=0 2024-06-13T11:30:40.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.868+0000 7fb02be00700 10 client.26143 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:30:40.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.868+0000 7fb02be00700 1 -- 172.21.15.2:0/2258646883 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d961a38580 con 0x55d961b629d0 2024-06-13T11:30:40.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.868+0000 7fb02be00700 10 client.26143 handle_command_reply: tid=0 2024-06-13T11:30:40.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.868+0000 7fb05b19ab80 1 client.26143 shutdown 2024-06-13T11:30:40.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.868+0000 7fb05b19ab80 1 -- 172.21.15.2:0/2258646883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae54b0 msgr2=0x55d961afb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:40.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.868+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/2258646883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae54b0 0x55d961afb060 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb044004b10 tx=0x7fb044003c30 comp rx=0 tx=0).stop 2024-06-13T11:30:40.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.868+0000 7fb05b19ab80 1 -- 172.21.15.2:0/2258646883 shutdown_connections 2024-06-13T11:30:40.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.868+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/2258646883 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55d961b629d0 0x55d961b64df0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.868+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/2258646883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d961ae54b0 0x55d961afb060 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.868+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/2258646883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d961adf240 0x55d961afe290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.868+0000 7fb05b19ab80 1 --2- 172.21.15.2:0/2258646883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d961ae4b90 0x55d961afab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.868+0000 7fb02be00700 0 client.26143 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:30:40.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.868+0000 7fb05b19ab80 1 -- 172.21.15.2:0/2258646883 >> 172.21.15.2:0/2258646883 conn(0x55d961a0b170 msgr2=0x55d961ae3610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:40.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.868+0000 7fb05b19ab80 1 -- 172.21.15.2:0/2258646883 shutdown_connections 2024-06-13T11:30:40.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.868+0000 7fb05b19ab80 1 -- 172.21.15.2:0/2258646883 wait complete. 2024-06-13T11:30:40.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.869+0000 7fb05b19ab80 20 client.26143 trim_cache size 0 max 16384 2024-06-13T11:30:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:30:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.869+0000 7fb050800700 1 -- 172.21.15.2:0/424075096 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb0300a2d90 msgr2=0x7fb0300a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.869+0000 7fb050800700 1 --2- 172.21.15.2:0/424075096 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb0300a2d90 0x7fb0300a5250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb0480789d0 tx=0x7fb03800b260 comp rx=0 tx=0).stop 2024-06-13T11:30:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.869+0000 7fb050800700 1 -- 172.21.15.2:0/424075096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb04806a170 msgr2=0x7fb048101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.869+0000 7fb050800700 1 --2- 172.21.15.2:0/424075096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb04806a170 0x7fb048101460 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00e9a0 tx=0x7fb03c00ecb0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.869+0000 7fb050800700 1 -- 172.21.15.2:0/424075096 shutdown_connections 2024-06-13T11:30:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.869+0000 7fb050800700 1 --2- 172.21.15.2:0/424075096 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb0300a2d90 0x7fb0300a5250 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.869+0000 7fb050800700 1 --2- 172.21.15.2:0/424075096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb04806a170 0x7fb048101460 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.869+0000 7fb050800700 1 --2- 172.21.15.2:0/424075096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb048108500 0x7fb048101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.869+0000 7fb050800700 1 --2- 172.21.15.2:0/424075096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04806ab30 0x7fb0481019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:40.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.869+0000 7fb050800700 1 -- 172.21.15.2:0/424075096 >> 172.21.15.2:0/424075096 conn(0x7fb048078340 msgr2=0x7fb0481000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:40.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.870+0000 7fb050800700 1 -- 172.21.15.2:0/424075096 shutdown_connections 2024-06-13T11:30:40.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:40.870+0000 7fb050800700 1 -- 172.21.15.2:0/424075096 wait complete. 2024-06-13T11:30:41.721 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-13T11:30:42.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:41 smithi077 ceph-mon[36410]: pgmap v210: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:42.144 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:41 smithi002 ceph-mon[32210]: pgmap v210: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:42.182 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:30:42.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:41 smithi178 ceph-mon[36913]: pgmap v210: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:43.998 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:43 smithi178 ceph-mon[36913]: pgmap v211: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:44.016 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:43 smithi002 ceph-mon[32210]: pgmap v211: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:44.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:43 smithi077 ceph-mon[36410]: pgmap v211: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:44.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.560+0000 7f2cb9c00700 1 -- 172.21.15.2:0/3419563155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb410c980 msgr2=0x7f2cb410ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:44.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.560+0000 7f2cb9c00700 1 --2- 172.21.15.2:0/3419563155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb410c980 0x7f2cb410ee20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00b0a0 tx=0x7f2cac00b3b0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.560+0000 7f2cb9c00700 1 -- 172.21.15.2:0/3419563155 shutdown_connections 2024-06-13T11:30:44.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.560+0000 7f2cb9c00700 1 --2- 172.21.15.2:0/3419563155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb410c980 0x7f2cb410ee20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.560+0000 7f2cb9c00700 1 --2- 172.21.15.2:0/3419563155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cb41035a0 0x7f2cb4103980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.560+0000 7f2cb9c00700 1 --2- 172.21.15.2:0/3419563155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cb4103ec0 0x7f2cb410c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.560+0000 7f2cb9c00700 1 -- 172.21.15.2:0/3419563155 >> 172.21.15.2:0/3419563155 conn(0x7f2cb40fcd70 msgr2=0x7f2cb40ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:44.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.560+0000 7f2cb9c00700 1 -- 172.21.15.2:0/3419563155 shutdown_connections 2024-06-13T11:30:44.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.560+0000 7f2cb9c00700 1 -- 172.21.15.2:0/3419563155 wait complete. 2024-06-13T11:30:44.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.561+0000 7f2cb9c00700 1 Processor -- start 2024-06-13T11:30:44.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.561+0000 7f2cb9c00700 1 -- start start 2024-06-13T11:30:44.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.562+0000 7f2cb9c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cb41035a0 0x7f2cb419ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.562+0000 7f2cb9c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cb4103ec0 0x7f2cb419b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.562+0000 7f2cb9c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb410c980 0x7f2cb419f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.562+0000 7f2cb9c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb4112700 con 0x7f2cb410c980 2024-06-13T11:30:44.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.562+0000 7f2cb9c00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb4112580 con 0x7f2cb4103ec0 2024-06-13T11:30:44.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.562+0000 7f2cb9c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb4112880 con 0x7f2cb41035a0 2024-06-13T11:30:44.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.562+0000 7f2cb3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cb41035a0 0x7f2cb419ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.562+0000 7f2cb9200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb410c980 0x7f2cb419f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.562+0000 7f2cb3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cb41035a0 0x7f2cb419ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:46292/0 (socket says 172.21.15.2:46292) 2024-06-13T11:30:44.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.562+0000 7f2cabe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cb4103ec0 0x7f2cb419b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.562+0000 7f2cb3e00700 1 -- 172.21.15.2:0/3076861926 learned_addr learned my addr 172.21.15.2:0/3076861926 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:44.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.563+0000 7f2cb3e00700 1 -- 172.21.15.2:0/3076861926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cb4103ec0 msgr2=0x7f2cb419b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:44.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.563+0000 7f2cb3e00700 1 --2- 172.21.15.2:0/3076861926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cb4103ec0 0x7f2cb419b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.563+0000 7f2cb3e00700 1 -- 172.21.15.2:0/3076861926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb410c980 msgr2=0x7f2cb419f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:44.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.563+0000 7f2cb3e00700 1 --2- 172.21.15.2:0/3076861926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb410c980 0x7f2cb419f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.563+0000 7f2cb3e00700 1 -- 172.21.15.2:0/3076861926 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb419fd30 con 0x7f2cb41035a0 2024-06-13T11:30:44.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.563+0000 7f2cb3e00700 1 --2- 172.21.15.2:0/3076861926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cb41035a0 0x7f2cb419ad20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400e9a0 tx=0x7f2ca400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:44.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.563+0000 7f2cb1600700 1 -- 172.21.15.2:0/3076861926 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca400ca10 con 0x7f2cb41035a0 2024-06-13T11:30:44.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.564+0000 7f2cb1600700 1 -- 172.21.15.2:0/3076861926 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ca400cbb0 con 0x7f2cb41035a0 2024-06-13T11:30:44.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.564+0000 7f2cb1600700 1 -- 172.21.15.2:0/3076861926 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4018680 con 0x7f2cb41035a0 2024-06-13T11:30:44.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.564+0000 7f2cb9c00700 1 -- 172.21.15.2:0/3076861926 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb41a0020 con 0x7f2cb41035a0 2024-06-13T11:30:44.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.564+0000 7f2cb9c00700 1 -- 172.21.15.2:0/3076861926 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb41a78a0 con 0x7f2cb41035a0 2024-06-13T11:30:44.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.567+0000 7f2cb1600700 1 -- 172.21.15.2:0/3076861926 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f2ca4010430 con 0x7f2cb41035a0 2024-06-13T11:30:44.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.568+0000 7f2cc5b24b80 1 Processor -- start 2024-06-13T11:30:44.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.569+0000 7f2cc5b24b80 1 -- start start 2024-06-13T11:30:44.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.569+0000 7f2cc5b24b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2743d60 0x55a0e2744140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.569+0000 7f2cc5b24b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e2744680 0x55a0e274eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.569+0000 7f2cc5b24b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e274f530 0x55a0e2751920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.569+0000 7f2cc5b24b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a0e2653a10 con 0x55a0e274f530 2024-06-13T11:30:44.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.569+0000 7f2cc5b24b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a0e2696b00 con 0x55a0e2744680 2024-06-13T11:30:44.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.569+0000 7f2cc5b24b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a0e26518f0 con 0x55a0e2743d60 2024-06-13T11:30:44.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.570+0000 7f2cb1600700 1 --2- 172.21.15.2:0/3076861926 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2c980a2e10 0x7f2c980a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.570+0000 7f2cb1600700 1 -- 172.21.15.2:0/3076861926 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f2ca40cf9a0 con 0x7f2cb41035a0 2024-06-13T11:30:44.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.570+0000 7f2cb3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e2744680 0x55a0e274eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.570+0000 7f2cb9200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2743d60 0x55a0e2744140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.570+0000 7f2cb9200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2743d60 0x55a0e2744140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:46306/0 (socket says 172.21.15.2:46306) 2024-06-13T11:30:44.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.570+0000 7f2cb9200700 1 -- 172.21.15.2:0/2760157359 learned_addr learned my addr 172.21.15.2:0/2760157359 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:44.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.570+0000 7f2cb3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e2744680 0x55a0e274eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:34170/0 (socket says 172.21.15.2:34170) 2024-06-13T11:30:44.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.570+0000 7f2cabe00700 1 --2- 172.21.15.2:0/2760157359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e274f530 0x55a0e2751920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.570+0000 7f2cb9200700 1 --2- 172.21.15.2:0/3076861926 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2c980a2e10 0x7f2c980a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.570+0000 7f2cb3e00700 1 -- 172.21.15.2:0/2760157359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2743d60 msgr2=0x55a0e2744140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:44.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.570+0000 7f2cb3e00700 1 --2- 172.21.15.2:0/2760157359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2743d60 0x55a0e2744140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.570+0000 7f2cb3e00700 1 -- 172.21.15.2:0/2760157359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e274f530 msgr2=0x55a0e2751920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:44.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.570+0000 7f2cb3e00700 1 --2- 172.21.15.2:0/2760157359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e274f530 0x55a0e2751920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.570+0000 7f2cb3e00700 1 -- 172.21.15.2:0/2760157359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e263ef90 con 0x55a0e2744680 2024-06-13T11:30:44.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.571+0000 7f2cabe00700 1 --2- 172.21.15.2:0/2760157359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e274f530 0x55a0e2751920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:30:44.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.571+0000 7f2cb3e00700 1 --2- 172.21.15.2:0/2760157359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e2744680 0x55a0e274eff0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40ccd20 tx=0x7f2ca409b560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10a1ec482ab77786 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:44.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.571+0000 7f2cb9200700 1 --2- 172.21.15.2:0/3076861926 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2c980a2e10 0x7f2c980a52d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009e60 tx=0x7f2cac006210 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:44.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.571+0000 7f2ca9600700 1 -- 172.21.15.2:0/2760157359 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca40a4760 con 0x55a0e2744680 2024-06-13T11:30:44.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.571+0000 7f2ca9600700 1 -- 172.21.15.2:0/2760157359 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ca4099df0 con 0x55a0e2744680 2024-06-13T11:30:44.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.571+0000 7f2ca9600700 1 -- 172.21.15.2:0/2760157359 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4010980 con 0x55a0e2744680 2024-06-13T11:30:44.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.572+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2760157359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e2744680 msgr2=0x55a0e274eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:44.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.572+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/2760157359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e2744680 0x55a0e274eff0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40ccd20 tx=0x7f2ca409b560 comp rx=0 tx=0).stop 2024-06-13T11:30:44.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.572+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2760157359 shutdown_connections 2024-06-13T11:30:44.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.572+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/2760157359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e274f530 0x55a0e2751920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.572+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/2760157359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2743d60 0x55a0e2744140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.572+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/2760157359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e2744680 0x55a0e274eff0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.572+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2760157359 >> 172.21.15.2:0/2760157359 conn(0x55a0e2671170 msgr2=0x55a0e2740280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:44.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.572+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2760157359 shutdown_connections 2024-06-13T11:30:44.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.572+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2760157359 wait complete. 2024-06-13T11:30:44.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.573+0000 7f2cc5b24b80 1 -- start start 2024-06-13T11:30:44.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.573+0000 7f2cc5b24b80 1 Processor -- start 2024-06-13T11:30:44.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.574+0000 7f2cc5b24b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e2743d60 0x55a0e274edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.574+0000 7f2cc5b24b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2744680 0x55a0e274c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.574+0000 7f2cc5b24b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e274f530 0x55a0e274c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.574+0000 7f2cc5b24b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a0e2632f60 con 0x55a0e274f530 2024-06-13T11:30:44.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.574+0000 7f2cc5b24b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a0e2692ac0 con 0x55a0e2743d60 2024-06-13T11:30:44.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.574+0000 7f2cc5b24b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a0e2751f00 con 0x55a0e2744680 2024-06-13T11:30:44.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.574+0000 7f2cc5b24b80 10 client.0 _ll_register_callbacks cb 0x55a0e262c380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:30:44.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.574+0000 7f2cb3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e2743d60 0x55a0e274edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.574+0000 7f2cb9200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e274f530 0x55a0e274c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.574+0000 7f2cb3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e2743d60 0x55a0e274edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:34178/0 (socket says 172.21.15.2:34178) 2024-06-13T11:30:44.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.574+0000 7f2cb3e00700 1 -- 172.21.15.2:0/2720753862 learned_addr learned my addr 172.21.15.2:0/2720753862 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:44.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.574+0000 7f2cabe00700 1 --2- 172.21.15.2:0/2720753862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2744680 0x55a0e274c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.575+0000 7f2cb3e00700 1 -- 172.21.15.2:0/2720753862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2744680 msgr2=0x55a0e274c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:44.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.575+0000 7f2cb3e00700 1 --2- 172.21.15.2:0/2720753862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2744680 0x55a0e274c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.575+0000 7f2cb3e00700 1 -- 172.21.15.2:0/2720753862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e274f530 msgr2=0x55a0e274c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:44.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.575+0000 7f2cb3e00700 1 --2- 172.21.15.2:0/2720753862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e274f530 0x55a0e274c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.575+0000 7f2cb3e00700 1 -- 172.21.15.2:0/2720753862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e25e58d0 con 0x55a0e2743d60 2024-06-13T11:30:44.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.575+0000 7f2cb3e00700 1 --2- 172.21.15.2:0/2720753862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e2743d60 0x55a0e274edd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40ccd80 tx=0x7f2ca4099fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f51c0a25334fece6 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:44.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.575+0000 7f2ca2000700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:30:44.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.575+0000 7f2ca2000700 1 -- 172.21.15.2:0/2720753862 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca40b4030 con 0x55a0e2743d60 2024-06-13T11:30:44.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.575+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2720753862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ca4099df0 con 0x55a0e2743d60 2024-06-13T11:30:44.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.575+0000 7f2ca2000700 1 -- 172.21.15.2:0/2720753862 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f2ca40ba2a0 con 0x55a0e2743d60 2024-06-13T11:30:44.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.576+0000 7f2ca2000700 1 -- 172.21.15.2:0/2720753862 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2ca40a4760 con 0x55a0e2743d60 2024-06-13T11:30:44.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.576+0000 7f2cc5b24b80 10 client.26120 fetch_fsmap learned FSMap version 31 2024-06-13T11:30:44.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.576+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2720753862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a0e275c720 con 0x55a0e2743d60 2024-06-13T11:30:44.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.576+0000 7f2ca2000700 1 -- 172.21.15.2:0/2720753862 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ca4099df0 con 0x55a0e2743d60 2024-06-13T11:30:44.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.576+0000 7f2ca2000700 1 -- 172.21.15.2:0/2720753862 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f2ca409a9b0 con 0x55a0e2743d60 2024-06-13T11:30:44.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.576+0000 7f2cc5b24b80 10 client.26120 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:30:44.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.576+0000 7f2cc5b24b80 10 client.26120 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:30:44.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.576+0000 7f2cc5b24b80 20 client.26120 populate_metadata read hostname 'smithi002' 2024-06-13T11:30:44.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.576+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/2720753862 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a0e275ebf0 0x55a0e2760fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.576+0000 7f2cc5b24b80 4 client.26120 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:30:44.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.576+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2720753862 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0e26a4000 con 0x55a0e275ebf0 2024-06-13T11:30:44.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.577+0000 7f2cabe00700 1 --2- 172.21.15.2:0/2720753862 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a0e275ebf0 0x55a0e2760fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.578+0000 7f2cabe00700 1 --2- 172.21.15.2:0/2720753862 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a0e275ebf0 0x55a0e2760fe0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daedf9de0faa453a server_cookie=13874b9be0cd04c7 in_seq=0 out_seq=0 2024-06-13T11:30:44.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.578+0000 7f2ca2000700 10 client.26120 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:30:44.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.578+0000 7f2ca2000700 1 -- 172.21.15.2:0/2720753862 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a0e26a4000 con 0x55a0e275ebf0 2024-06-13T11:30:44.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.578+0000 7f2ca2000700 10 client.26120 handle_command_reply: tid=0 2024-06-13T11:30:44.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.578+0000 7f2cc5b24b80 1 client.26120 shutdown 2024-06-13T11:30:44.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.579+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2720753862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e2743d60 msgr2=0x55a0e274edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:44.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.579+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/2720753862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e2743d60 0x55a0e274edd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40ccd80 tx=0x7f2ca4099fa0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.579+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2720753862 shutdown_connections 2024-06-13T11:30:44.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.579+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/2720753862 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a0e275ebf0 0x55a0e2760fe0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.579+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/2720753862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e274f530 0x55a0e274c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.579+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/2720753862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e2743d60 0x55a0e274edd0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.579+0000 7f2ca2000700 0 client.26120 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:30:44.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.579+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/2720753862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2744680 0x55a0e274c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.579+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2720753862 >> 172.21.15.2:0/2720753862 conn(0x55a0e2671170 msgr2=0x55a0e273fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.579+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2720753862 shutdown_connections 2024-06-13T11:30:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.579+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2720753862 wait complete. 2024-06-13T11:30:44.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.579+0000 7f2cc5b24b80 20 client.26120 trim_cache size 0 max 16384 2024-06-13T11:30:44.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.596+0000 7f2cc5b24b80 1 Processor -- start 2024-06-13T11:30:44.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.596+0000 7f2cc5b24b80 1 -- start start 2024-06-13T11:30:44.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.597+0000 7f2cc5b24b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2743d60 0x55a0e27403c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.597+0000 7f2cc5b24b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e2744680 0x55a0e275a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.597+0000 7f2cc5b24b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e274f530 0x55a0e275ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.597+0000 7f2cc5b24b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb41b2e30 con 0x55a0e2744680 2024-06-13T11:30:44.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.597+0000 7f2cc5b24b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb41b06c0 con 0x55a0e274f530 2024-06-13T11:30:44.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.597+0000 7f2cc5b24b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb41ae510 con 0x55a0e2743d60 2024-06-13T11:30:44.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.597+0000 7f2cabe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e2744680 0x55a0e275a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.597+0000 7f2cabe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e2744680 0x55a0e275a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47832/0 (socket says 172.21.15.2:47832) 2024-06-13T11:30:44.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.597+0000 7f2cabe00700 1 -- 172.21.15.2:0/2000201625 learned_addr learned my addr 172.21.15.2:0/2000201625 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:44.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.597+0000 7f2cb3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2743d60 0x55a0e27403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.597+0000 7f2cb9200700 1 --2- 172.21.15.2:0/2000201625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e274f530 0x55a0e275ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.598+0000 7f2cb9200700 1 -- 172.21.15.2:0/2000201625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2743d60 msgr2=0x55a0e27403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:44.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.598+0000 7f2cb9200700 1 --2- 172.21.15.2:0/2000201625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2743d60 0x55a0e27403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.598+0000 7f2cb9200700 1 -- 172.21.15.2:0/2000201625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e2744680 msgr2=0x55a0e275a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.598+0000 7f2cb9200700 1 --2- 172.21.15.2:0/2000201625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e2744680 0x55a0e275a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.598+0000 7f2cb9200700 1 -- 172.21.15.2:0/2000201625 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e2744cd0 con 0x55a0e274f530 2024-06-13T11:30:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.598+0000 7f2cabe00700 1 --2- 172.21.15.2:0/2000201625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e2744680 0x55a0e275a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:30:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.598+0000 7f2cb3e00700 1 --2- 172.21.15.2:0/2000201625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2743d60 0x55a0e27403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:30:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.598+0000 7f2cb9200700 1 --2- 172.21.15.2:0/2000201625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e274f530 0x55a0e275ada0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00d010 tx=0x7f2cac009be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c005885556603d06 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.598+0000 7f2ca8c00700 1 -- 172.21.15.2:0/2000201625 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0076e0 con 0x55a0e274f530 2024-06-13T11:30:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.598+0000 7f2ca8c00700 1 -- 172.21.15.2:0/2000201625 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cac007d60 con 0x55a0e274f530 2024-06-13T11:30:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.598+0000 7f2ca8c00700 1 -- 172.21.15.2:0/2000201625 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac005a10 con 0x55a0e274f530 2024-06-13T11:30:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.599+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2000201625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e274f530 msgr2=0x55a0e275ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.599+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/2000201625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e274f530 0x55a0e275ada0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00d010 tx=0x7f2cac009be0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.599+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2000201625 shutdown_connections 2024-06-13T11:30:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.599+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/2000201625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e274f530 0x55a0e275ada0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.599+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/2000201625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2743d60 0x55a0e27403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.599+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/2000201625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e2744680 0x55a0e275a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.599+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2000201625 >> 172.21.15.2:0/2000201625 conn(0x55a0e2671170 msgr2=0x55a0e275a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.599+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2000201625 shutdown_connections 2024-06-13T11:30:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.599+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/2000201625 wait complete. 2024-06-13T11:30:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.600+0000 7f2cc5b24b80 1 -- start start 2024-06-13T11:30:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.600+0000 7f2cc5b24b80 1 Processor -- start 2024-06-13T11:30:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.600+0000 7f2cc5b24b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e2743d60 0x55a0e27635f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.600+0000 7f2cc5b24b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2744680 0x55a0e2763b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.600+0000 7f2cc5b24b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e274f530 0x55a0e27c7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.601+0000 7f2cc5b24b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb41aeb80 con 0x55a0e2743d60 2024-06-13T11:30:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.601+0000 7f2cc5b24b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb41afff0 con 0x55a0e274f530 2024-06-13T11:30:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.601+0000 7f2cc5b24b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb41af250 con 0x55a0e2744680 2024-06-13T11:30:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.601+0000 7f2cc5b24b80 10 client.0 _ll_register_callbacks cb 0x55a0e262c380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:30:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.601+0000 7f2cb3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e2743d60 0x55a0e27635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.601+0000 7f2cb3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e2743d60 0x55a0e27635f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47840/0 (socket says 172.21.15.2:47840) 2024-06-13T11:30:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.601+0000 7f2cb3e00700 1 -- 172.21.15.2:0/3773345263 learned_addr learned my addr 172.21.15.2:0/3773345263 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.601+0000 7f2cb9200700 1 --2- 172.21.15.2:0/3773345263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e274f530 0x55a0e27c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.601+0000 7f2cabe00700 1 --2- 172.21.15.2:0/3773345263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2744680 0x55a0e2763b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.601+0000 7f2cb3e00700 1 -- 172.21.15.2:0/3773345263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2744680 msgr2=0x55a0e2763b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.601+0000 7f2cb3e00700 1 --2- 172.21.15.2:0/3773345263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2744680 0x55a0e2763b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.601+0000 7f2cb3e00700 1 -- 172.21.15.2:0/3773345263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e274f530 msgr2=0x55a0e27c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.601+0000 7f2cb3e00700 1 --2- 172.21.15.2:0/3773345263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e274f530 0x55a0e27c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.601+0000 7f2cb3e00700 1 -- 172.21.15.2:0/3773345263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e27c7b70 con 0x55a0e2743d60 2024-06-13T11:30:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.602+0000 7f2cb3e00700 1 --2- 172.21.15.2:0/3773345263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e2743d60 0x55a0e27635f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2ca409b7f0 tx=0x7f2ca409c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8612ce706375da server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.602+0000 7f2ca2000700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:30:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.602+0000 7f2ca2000700 1 -- 172.21.15.2:0/3773345263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca40b4070 con 0x55a0e2743d60 2024-06-13T11:30:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.602+0000 7f2ca2000700 1 -- 172.21.15.2:0/3773345263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f2ca409a9b0 con 0x55a0e2743d60 2024-06-13T11:30:44.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.602+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/3773345263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cac007d60 con 0x55a0e2743d60 2024-06-13T11:30:44.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.602+0000 7f2ca2000700 1 -- 172.21.15.2:0/3773345263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2ca409abb0 con 0x55a0e2743d60 2024-06-13T11:30:44.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.602+0000 7f2cc5b24b80 10 client.16017 fetch_fsmap learned FSMap version 31 2024-06-13T11:30:44.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.602+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/3773345263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a0e27c7b70 con 0x55a0e2743d60 2024-06-13T11:30:44.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.603+0000 7f2ca2000700 1 -- 172.21.15.2:0/3773345263 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cac007d60 con 0x55a0e2743d60 2024-06-13T11:30:44.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.603+0000 7f2ca2000700 1 -- 172.21.15.2:0/3773345263 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f2ca4010720 con 0x55a0e2743d60 2024-06-13T11:30:44.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.603+0000 7f2cc5b24b80 10 client.16017 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:30:44.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.603+0000 7f2cc5b24b80 10 client.16017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:30:44.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.603+0000 7f2cc5b24b80 20 client.16017 populate_metadata read hostname 'smithi002' 2024-06-13T11:30:44.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.603+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/3773345263 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a0e27c9190 0x55a0e27cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:44.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.603+0000 7f2cc5b24b80 4 client.16017 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:30:44.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.603+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/3773345263 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a0e269e580 con 0x55a0e27c9190 2024-06-13T11:30:44.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.603+0000 7f2cabe00700 1 --2- 172.21.15.2:0/3773345263 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a0e27c9190 0x55a0e27cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:44.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.604+0000 7f2cabe00700 1 --2- 172.21.15.2:0/3773345263 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a0e27c9190 0x55a0e27cb580 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2af04f096213315 server_cookie=1d3c2afe3d658d in_seq=0 out_seq=0 2024-06-13T11:30:44.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.604+0000 7f2ca2000700 10 client.16017 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:30:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.604+0000 7f2ca2000700 1 -- 172.21.15.2:0/3773345263 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a0e269e580 con 0x55a0e27c9190 2024-06-13T11:30:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.604+0000 7f2ca2000700 10 client.16017 handle_command_reply: tid=0 2024-06-13T11:30:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.604+0000 7f2cc5b24b80 1 client.16017 shutdown 2024-06-13T11:30:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.604+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/3773345263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e2743d60 msgr2=0x55a0e27635f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.604+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/3773345263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e2743d60 0x55a0e27635f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2ca409b7f0 tx=0x7f2ca409c310 comp rx=0 tx=0).stop 2024-06-13T11:30:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.604+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/3773345263 shutdown_connections 2024-06-13T11:30:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.604+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/3773345263 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a0e27c9190 0x55a0e27cb580 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.604+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/3773345263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a0e2743d60 0x55a0e27635f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.605+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/3773345263 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a0e274f530 0x55a0e27c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.605+0000 7f2cc5b24b80 1 --2- 172.21.15.2:0/3773345263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0e2744680 0x55a0e2763b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.605+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/3773345263 >> 172.21.15.2:0/3773345263 conn(0x55a0e2671170 msgr2=0x55a0e273fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.605+0000 7f2ca2000700 0 client.16017 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:30:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.605+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/3773345263 shutdown_connections 2024-06-13T11:30:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.605+0000 7f2cc5b24b80 1 -- 172.21.15.2:0/3773345263 wait complete. 2024-06-13T11:30:44.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.605+0000 7f2cc5b24b80 20 client.16017 trim_cache size 0 max 16384 2024-06-13T11:30:44.612 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:30:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.606+0000 7f2cb9c00700 1 -- 172.21.15.2:0/3076861926 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2c980a2e10 msgr2=0x7f2c980a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.606+0000 7f2cb9c00700 1 --2- 172.21.15.2:0/3076861926 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2c980a2e10 0x7f2c980a52d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009e60 tx=0x7f2cac006210 comp rx=0 tx=0).stop 2024-06-13T11:30:44.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.606+0000 7f2cb9c00700 1 -- 172.21.15.2:0/3076861926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cb41035a0 msgr2=0x7f2cb419ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.606+0000 7f2cb9c00700 1 --2- 172.21.15.2:0/3076861926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cb41035a0 0x7f2cb419ad20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400e9a0 tx=0x7f2ca400ecb0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.606+0000 7f2cb9c00700 1 -- 172.21.15.2:0/3076861926 shutdown_connections 2024-06-13T11:30:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.606+0000 7f2cb9c00700 1 --2- 172.21.15.2:0/3076861926 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2c980a2e10 0x7f2c980a52d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.606+0000 7f2cb9c00700 1 --2- 172.21.15.2:0/3076861926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb410c980 0x7f2cb419f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.606+0000 7f2cb9c00700 1 --2- 172.21.15.2:0/3076861926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cb41035a0 0x7f2cb419ad20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.606+0000 7f2cb9c00700 1 --2- 172.21.15.2:0/3076861926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cb4103ec0 0x7f2cb419b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.606+0000 7f2cb9c00700 1 -- 172.21.15.2:0/3076861926 >> 172.21.15.2:0/3076861926 conn(0x7f2cb40fcd70 msgr2=0x7f2cb410ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.606+0000 7f2cb9c00700 1 -- 172.21.15.2:0/3076861926 shutdown_connections 2024-06-13T11:30:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:44.606+0000 7f2cb9c00700 1 -- 172.21.15.2:0/3076861926 wait complete. 2024-06-13T11:30:45.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:45 smithi002 ceph-mon[32210]: pgmap v212: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:46.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:45 smithi077 ceph-mon[36410]: pgmap v212: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:46.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:45 smithi178 ceph-mon[36913]: pgmap v212: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:46.608 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-13T11:30:46.608 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-13T11:30:47.090 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:30:47.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:47 smithi002 ceph-mon[32210]: pgmap v213: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:48.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:47 smithi077 ceph-mon[36410]: pgmap v213: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:48.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:47 smithi178 ceph-mon[36913]: pgmap v213: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:49.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.397+0000 7faf8a800700 1 -- 172.21.15.2:0/729841685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf84102540 msgr2=0x7faf841029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.397+0000 7faf8a800700 1 --2- 172.21.15.2:0/729841685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf84102540 0x7faf841029a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faf700098f0 tx=0x7faf70009c00 comp rx=0 tx=0).stop 2024-06-13T11:30:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.397+0000 7faf8a800700 1 -- 172.21.15.2:0/729841685 shutdown_connections 2024-06-13T11:30:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.397+0000 7faf8a800700 1 --2- 172.21.15.2:0/729841685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf84107450 0x7faf84107830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.397+0000 7faf8a800700 1 --2- 172.21.15.2:0/729841685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf84102ee0 0x7faf8410f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.397+0000 7faf8a800700 1 --2- 172.21.15.2:0/729841685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf84102540 0x7faf841029a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.397+0000 7faf8a800700 1 -- 172.21.15.2:0/729841685 >> 172.21.15.2:0/729841685 conn(0x7faf840795f0 msgr2=0x7faf84079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:49.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.397+0000 7faf8a800700 1 -- 172.21.15.2:0/729841685 shutdown_connections 2024-06-13T11:30:49.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.397+0000 7faf8a800700 1 -- 172.21.15.2:0/729841685 wait complete. 2024-06-13T11:30:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.399+0000 7faf8a800700 1 Processor -- start 2024-06-13T11:30:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.399+0000 7faf8a800700 1 -- start start 2024-06-13T11:30:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.399+0000 7faf8a800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf84102540 0x7faf8419af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.399+0000 7faf8a800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf84102ee0 0x7faf8419b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.400+0000 7faf8a800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf84107450 0x7faf8419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.400+0000 7faf8a800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faf84112830 con 0x7faf84107450 2024-06-13T11:30:49.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.400+0000 7faf8a800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf841126b0 con 0x7faf84102ee0 2024-06-13T11:30:49.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.400+0000 7faf8a800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7faf841129b0 con 0x7faf84102540 2024-06-13T11:30:49.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.400+0000 7faf82a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf84102ee0 0x7faf8419b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.400+0000 7faf83e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf84107450 0x7faf8419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.400+0000 7faf82a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf84102ee0 0x7faf8419b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:44738/0 (socket says 172.21.15.2:44738) 2024-06-13T11:30:49.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.400+0000 7faf82a00700 1 -- 172.21.15.2:0/3439960506 learned_addr learned my addr 172.21.15.2:0/3439960506 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:49.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.400+0000 7faf83400700 1 --2- 172.21.15.2:0/3439960506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf84102540 0x7faf8419af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.401+0000 7faf82a00700 1 -- 172.21.15.2:0/3439960506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf84102540 msgr2=0x7faf8419af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:49.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.401+0000 7faf82a00700 1 --2- 172.21.15.2:0/3439960506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf84102540 0x7faf8419af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.401+0000 7faf82a00700 1 -- 172.21.15.2:0/3439960506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf84107450 msgr2=0x7faf8419f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:49.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.401+0000 7faf82a00700 1 --2- 172.21.15.2:0/3439960506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf84107450 0x7faf8419f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.401+0000 7faf82a00700 1 -- 172.21.15.2:0/3439960506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8419ff10 con 0x7faf84102ee0 2024-06-13T11:30:49.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.401+0000 7faf82a00700 1 --2- 172.21.15.2:0/3439960506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf84102ee0 0x7faf8419b440 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faf70005950 tx=0x7faf7000fb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:49.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.402+0000 7faf7be00700 1 -- 172.21.15.2:0/3439960506 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf700051f0 con 0x7faf84102ee0 2024-06-13T11:30:49.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.402+0000 7faf8a800700 1 -- 172.21.15.2:0/3439960506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf841a01a0 con 0x7faf84102ee0 2024-06-13T11:30:49.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.402+0000 7faf8a800700 1 -- 172.21.15.2:0/3439960506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf841a7a80 con 0x7faf84102ee0 2024-06-13T11:30:49.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.402+0000 7faf7be00700 1 -- 172.21.15.2:0/3439960506 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf70009400 con 0x7faf84102ee0 2024-06-13T11:30:49.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.402+0000 7faf7be00700 1 -- 172.21.15.2:0/3439960506 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7000b7c0 con 0x7faf84102ee0 2024-06-13T11:30:49.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.407+0000 7faf950f2b80 1 Processor -- start 2024-06-13T11:30:49.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.407+0000 7faf950f2b80 1 -- start start 2024-06-13T11:30:49.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.408+0000 7faf950f2b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d643a4ec0 0x563d644280f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.408+0000 7faf950f2b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 0x563d64428ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.408+0000 7faf950f2b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64433380 0x563d64435770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.408+0000 7faf950f2b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563d64337a90 con 0x563d643a4ec0 2024-06-13T11:30:49.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.408+0000 7faf950f2b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563d6437ab80 con 0x563d64433380 2024-06-13T11:30:49.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.408+0000 7faf950f2b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563d64335970 con 0x563d64428630 2024-06-13T11:30:49.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.408+0000 7faf83e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d643a4ec0 0x563d644280f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.408+0000 7faf83e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d643a4ec0 0x563d644280f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56930/0 (socket says 172.21.15.2:56930) 2024-06-13T11:30:49.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.408+0000 7faf83e00700 1 -- 172.21.15.2:0/442151890 learned_addr learned my addr 172.21.15.2:0/442151890 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:49.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.408+0000 7faf83400700 1 --2- 172.21.15.2:0/442151890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 0x563d64428ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.408+0000 7faf7be00700 1 -- 172.21.15.2:0/3439960506 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7faf70003680 con 0x7faf84102ee0 2024-06-13T11:30:49.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.409+0000 7faf83400700 1 -- 172.21.15.2:0/442151890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64433380 msgr2=0x563d64435770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:49.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.409+0000 7faf82a00700 1 --2- 172.21.15.2:0/442151890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64433380 0x563d64435770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.409+0000 7faf83400700 1 --2- 172.21.15.2:0/442151890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64433380 0x563d64435770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.409+0000 7faf83400700 1 -- 172.21.15.2:0/442151890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d643a4ec0 msgr2=0x563d644280f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.409+0000 7faf83400700 1 --2- 172.21.15.2:0/442151890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d643a4ec0 0x563d644280f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.409+0000 7faf83400700 1 -- 172.21.15.2:0/442151890 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d64323010 con 0x563d64428630 2024-06-13T11:30:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.409+0000 7faf83e00700 1 --2- 172.21.15.2:0/442151890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d643a4ec0 0x563d644280f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:30:49.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.409+0000 7faf82a00700 1 --2- 172.21.15.2:0/442151890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64433380 0x563d64435770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:30:49.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.409+0000 7faf83400700 1 --2- 172.21.15.2:0/442151890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 0x563d64428ab0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faf74005fd0 tx=0x7faf740058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e84c7afe492827c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:49.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.410+0000 7faf78c00700 1 -- 172.21.15.2:0/442151890 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74011c80 con 0x563d64428630 2024-06-13T11:30:49.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.410+0000 7faf78c00700 1 -- 172.21.15.2:0/442151890 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf74011e20 con 0x563d64428630 2024-06-13T11:30:49.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.410+0000 7faf78c00700 1 -- 172.21.15.2:0/442151890 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74005280 con 0x563d64428630 2024-06-13T11:30:49.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.410+0000 7faf7be00700 1 --2- 172.21.15.2:0/3439960506 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7faf680a2e10 0x7faf680a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.411+0000 7faf950f2b80 1 -- 172.21.15.2:0/442151890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 msgr2=0x563d64428ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:49.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.411+0000 7faf7be00700 1 -- 172.21.15.2:0/3439960506 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7faf700d05d0 con 0x7faf84102ee0 2024-06-13T11:30:49.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.411+0000 7faf950f2b80 1 --2- 172.21.15.2:0/442151890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 0x563d64428ab0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faf74005fd0 tx=0x7faf740058e0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.411+0000 7faf83e00700 1 --2- 172.21.15.2:0/3439960506 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7faf680a2e10 0x7faf680a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.411+0000 7faf950f2b80 1 -- 172.21.15.2:0/442151890 shutdown_connections 2024-06-13T11:30:49.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.411+0000 7faf950f2b80 1 --2- 172.21.15.2:0/442151890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d643a4ec0 0x563d644280f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.411+0000 7faf950f2b80 1 --2- 172.21.15.2:0/442151890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64433380 0x563d64435770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.411+0000 7faf950f2b80 1 --2- 172.21.15.2:0/442151890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 0x563d64428ab0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.411+0000 7faf950f2b80 1 -- 172.21.15.2:0/442151890 >> 172.21.15.2:0/442151890 conn(0x563d643551f0 msgr2=0x563d64424530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.411+0000 7faf950f2b80 1 -- 172.21.15.2:0/442151890 shutdown_connections 2024-06-13T11:30:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.411+0000 7faf950f2b80 1 -- 172.21.15.2:0/442151890 wait complete. 2024-06-13T11:30:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.412+0000 7faf83e00700 1 --2- 172.21.15.2:0/3439960506 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7faf680a2e10 0x7faf680a52d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x563d64425430 tx=0x7faf7c00b040 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.412+0000 7faf950f2b80 1 -- start start 2024-06-13T11:30:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.412+0000 7faf950f2b80 1 Processor -- start 2024-06-13T11:30:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.413+0000 7faf950f2b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d643a4ec0 0x563d644329d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.413+0000 7faf950f2b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64428630 0x563d6442fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.413+0000 7faf950f2b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d64433380 0x563d64430210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.413+0000 7faf950f2b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563d64316fe0 con 0x563d64433380 2024-06-13T11:30:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.413+0000 7faf950f2b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563d64376b40 con 0x563d64428630 2024-06-13T11:30:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.413+0000 7faf950f2b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563d64436040 con 0x563d643a4ec0 2024-06-13T11:30:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.413+0000 7faf950f2b80 10 client.0 _ll_register_callbacks cb 0x563d643147a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:30:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.413+0000 7faf83e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d64433380 0x563d64430210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.413+0000 7faf83400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d643a4ec0 0x563d644329d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.413+0000 7faf83e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d64433380 0x563d64430210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56942/0 (socket says 172.21.15.2:56942) 2024-06-13T11:30:49.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.413+0000 7faf83e00700 1 -- 172.21.15.2:0/3750665391 learned_addr learned my addr 172.21.15.2:0/3750665391 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:49.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.413+0000 7faf82a00700 1 --2- 172.21.15.2:0/3750665391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64428630 0x563d6442fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.414+0000 7faf83400700 1 -- 172.21.15.2:0/3750665391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64428630 msgr2=0x563d6442fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:49.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.414+0000 7faf83400700 1 --2- 172.21.15.2:0/3750665391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64428630 0x563d6442fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.414+0000 7faf83400700 1 -- 172.21.15.2:0/3750665391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d64433380 msgr2=0x563d64430210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:49.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.414+0000 7faf83400700 1 --2- 172.21.15.2:0/3750665391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d64433380 0x563d64430210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.414+0000 7faf83400700 1 -- 172.21.15.2:0/3750665391 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d642c9950 con 0x563d643a4ec0 2024-06-13T11:30:49.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.414+0000 7faf83e00700 1 --2- 172.21.15.2:0/3750665391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d64433380 0x563d64430210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:30:49.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.414+0000 7faf83400700 1 --2- 172.21.15.2:0/3750665391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d643a4ec0 0x563d644329d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faf74000c00 tx=0x7faf74004c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f62bfb3baa4a21fe server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:49.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.414+0000 7faf6d600700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:30:49.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.415+0000 7faf6d600700 1 -- 172.21.15.2:0/3750665391 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74026070 con 0x563d643a4ec0 2024-06-13T11:30:49.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.415+0000 7faf6d600700 1 -- 172.21.15.2:0/3750665391 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7faf74004e80 con 0x563d643a4ec0 2024-06-13T11:30:49.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.415+0000 7faf950f2b80 1 -- 172.21.15.2:0/3750665391 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf74011e20 con 0x563d643a4ec0 2024-06-13T11:30:49.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.415+0000 7faf6d600700 1 -- 172.21.15.2:0/3750665391 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7faf74032050 con 0x563d643a4ec0 2024-06-13T11:30:49.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.415+0000 7faf950f2b80 10 client.26173 fetch_fsmap learned FSMap version 31 2024-06-13T11:30:49.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.415+0000 7faf950f2b80 1 -- 172.21.15.2:0/3750665391 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563d64440640 con 0x563d643a4ec0 2024-06-13T11:30:49.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.415+0000 7faf6d600700 1 -- 172.21.15.2:0/3750665391 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf74011e20 con 0x563d643a4ec0 2024-06-13T11:30:49.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.416+0000 7faf6d600700 1 -- 172.21.15.2:0/3750665391 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7faf74019980 con 0x563d643a4ec0 2024-06-13T11:30:49.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.416+0000 7faf950f2b80 10 client.26173 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:30:49.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.416+0000 7faf950f2b80 10 client.26173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:30:49.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.416+0000 7faf950f2b80 20 client.26173 populate_metadata read hostname 'smithi002' 2024-06-13T11:30:49.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.416+0000 7faf950f2b80 1 --2- 172.21.15.2:0/3750665391 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x563d64442b10 0x563d64444f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.416+0000 7faf950f2b80 4 client.26173 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:30:49.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.416+0000 7faf950f2b80 1 -- 172.21.15.2:0/3750665391 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d64388080 con 0x563d64442b10 2024-06-13T11:30:49.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.416+0000 7faf82a00700 1 --2- 172.21.15.2:0/3750665391 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x563d64442b10 0x563d64444f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.417+0000 7faf82a00700 1 --2- 172.21.15.2:0/3750665391 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x563d64442b10 0x563d64444f00 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67a6107e707332a1 server_cookie=e525de209da09414 in_seq=0 out_seq=0 2024-06-13T11:30:49.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.417+0000 7faf6d600700 10 client.26173 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:30:49.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.418+0000 7faf6d600700 1 -- 172.21.15.2:0/3750665391 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563d64388080 con 0x563d64442b10 2024-06-13T11:30:49.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.418+0000 7faf6d600700 10 client.26173 handle_command_reply: tid=0 2024-06-13T11:30:49.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.418+0000 7faf950f2b80 1 client.26173 shutdown 2024-06-13T11:30:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.418+0000 7faf950f2b80 1 -- 172.21.15.2:0/3750665391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d643a4ec0 msgr2=0x563d644329d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.418+0000 7faf950f2b80 1 --2- 172.21.15.2:0/3750665391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d643a4ec0 0x563d644329d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faf74000c00 tx=0x7faf74004c90 comp rx=0 tx=0).stop 2024-06-13T11:30:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.418+0000 7faf950f2b80 1 -- 172.21.15.2:0/3750665391 shutdown_connections 2024-06-13T11:30:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.418+0000 7faf950f2b80 1 --2- 172.21.15.2:0/3750665391 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x563d64442b10 0x563d64444f00 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.418+0000 7faf950f2b80 1 --2- 172.21.15.2:0/3750665391 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d64433380 0x563d64430210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.418+0000 7faf950f2b80 1 --2- 172.21.15.2:0/3750665391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d643a4ec0 0x563d644329d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.418+0000 7faf950f2b80 1 --2- 172.21.15.2:0/3750665391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64428630 0x563d6442fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.418+0000 7faf6d600700 0 client.26173 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:30:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.418+0000 7faf950f2b80 1 -- 172.21.15.2:0/3750665391 >> 172.21.15.2:0/3750665391 conn(0x563d643551f0 msgr2=0x563d644237c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.418+0000 7faf950f2b80 1 -- 172.21.15.2:0/3750665391 shutdown_connections 2024-06-13T11:30:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.418+0000 7faf950f2b80 1 -- 172.21.15.2:0/3750665391 wait complete. 2024-06-13T11:30:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.418+0000 7faf950f2b80 20 client.26173 trim_cache size 0 max 16384 2024-06-13T11:30:49.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.441+0000 7faf950f2b80 1 Processor -- start 2024-06-13T11:30:49.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.442+0000 7faf950f2b80 1 -- start start 2024-06-13T11:30:49.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.442+0000 7faf950f2b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d643a4ec0 0x563d64435800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.442+0000 7faf950f2b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 0x563d64434770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.442+0000 7faf950f2b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d64433380 0x563d64431500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.442+0000 7faf950f2b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faf640114e0 con 0x563d64433380 2024-06-13T11:30:49.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.442+0000 7faf950f2b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf6400ed70 con 0x563d643a4ec0 2024-06-13T11:30:49.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.442+0000 7faf950f2b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7faf6400cbc0 con 0x563d64428630 2024-06-13T11:30:49.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.442+0000 7faf83e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d64433380 0x563d64431500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.442+0000 7faf83e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d64433380 0x563d64431500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56956/0 (socket says 172.21.15.2:56956) 2024-06-13T11:30:49.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.442+0000 7faf83e00700 1 -- 172.21.15.2:0/4033479918 learned_addr learned my addr 172.21.15.2:0/4033479918 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:49.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.442+0000 7faf82a00700 1 --2- 172.21.15.2:0/4033479918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 0x563d64434770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.442+0000 7faf83400700 1 --2- 172.21.15.2:0/4033479918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d643a4ec0 0x563d64435800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.443+0000 7faf83400700 1 -- 172.21.15.2:0/4033479918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 msgr2=0x563d64434770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:49.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.443+0000 7faf83400700 1 --2- 172.21.15.2:0/4033479918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 0x563d64434770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.443+0000 7faf83400700 1 -- 172.21.15.2:0/4033479918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d64433380 msgr2=0x563d64431500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:49.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.443+0000 7faf83400700 1 --2- 172.21.15.2:0/4033479918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d64433380 0x563d64431500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.443+0000 7faf83400700 1 -- 172.21.15.2:0/4033479918 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d64429c50 con 0x563d643a4ec0 2024-06-13T11:30:49.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.443+0000 7faf82a00700 1 --2- 172.21.15.2:0/4033479918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 0x563d64434770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:30:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.443+0000 7faf83400700 1 --2- 172.21.15.2:0/4033479918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d643a4ec0 0x563d64435800 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faf74009c10 tx=0x7faf74009690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=752e2331fb5a82e5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.443+0000 7faf6fe00700 1 -- 172.21.15.2:0/4033479918 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7402f030 con 0x563d643a4ec0 2024-06-13T11:30:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.444+0000 7faf6fe00700 1 -- 172.21.15.2:0/4033479918 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf740225e0 con 0x563d643a4ec0 2024-06-13T11:30:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.444+0000 7faf6fe00700 1 -- 172.21.15.2:0/4033479918 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74000e60 con 0x563d643a4ec0 2024-06-13T11:30:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.444+0000 7faf950f2b80 1 -- 172.21.15.2:0/4033479918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d643a4ec0 msgr2=0x563d64435800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.444+0000 7faf950f2b80 1 --2- 172.21.15.2:0/4033479918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d643a4ec0 0x563d64435800 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faf74009c10 tx=0x7faf74009690 comp rx=0 tx=0).stop 2024-06-13T11:30:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.444+0000 7faf950f2b80 1 -- 172.21.15.2:0/4033479918 shutdown_connections 2024-06-13T11:30:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.444+0000 7faf950f2b80 1 --2- 172.21.15.2:0/4033479918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d64433380 0x563d64431500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.444+0000 7faf950f2b80 1 --2- 172.21.15.2:0/4033479918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d643a4ec0 0x563d64435800 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.444+0000 7faf950f2b80 1 --2- 172.21.15.2:0/4033479918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 0x563d64434770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.444+0000 7faf950f2b80 1 -- 172.21.15.2:0/4033479918 >> 172.21.15.2:0/4033479918 conn(0x563d643551f0 msgr2=0x563d644350f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:49.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.445+0000 7faf950f2b80 1 -- 172.21.15.2:0/4033479918 shutdown_connections 2024-06-13T11:30:49.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.445+0000 7faf950f2b80 1 -- 172.21.15.2:0/4033479918 wait complete. 2024-06-13T11:30:49.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.445+0000 7faf950f2b80 1 -- start start 2024-06-13T11:30:49.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.445+0000 7faf950f2b80 1 Processor -- start 2024-06-13T11:30:49.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.446+0000 7faf950f2b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d643a4ec0 0x563d6443b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.446+0000 7faf950f2b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 0x563d6443bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.446+0000 7faf950f2b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64433380 0x563d6442c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.446+0000 7faf950f2b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faf6400d230 con 0x563d643a4ec0 2024-06-13T11:30:49.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.446+0000 7faf950f2b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf6400e6a0 con 0x563d64433380 2024-06-13T11:30:49.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.446+0000 7faf950f2b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7faf6400d900 con 0x563d64428630 2024-06-13T11:30:49.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.446+0000 7faf950f2b80 10 client.0 _ll_register_callbacks cb 0x563d643147a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:30:49.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.446+0000 7faf83400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d643a4ec0 0x563d6443b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.446+0000 7faf82a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 0x563d6443bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.446+0000 7faf83400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d643a4ec0 0x563d6443b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56958/0 (socket says 172.21.15.2:56958) 2024-06-13T11:30:49.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.446+0000 7faf83400700 1 -- 172.21.15.2:0/4118661137 learned_addr learned my addr 172.21.15.2:0/4118661137 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:49.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.446+0000 7faf83e00700 1 --2- 172.21.15.2:0/4118661137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64433380 0x563d6442c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.447+0000 7faf82a00700 1 -- 172.21.15.2:0/4118661137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64433380 msgr2=0x563d6442c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.447+0000 7faf82a00700 1 --2- 172.21.15.2:0/4118661137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64433380 0x563d6442c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.447+0000 7faf82a00700 1 -- 172.21.15.2:0/4118661137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d643a4ec0 msgr2=0x563d6443b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.447+0000 7faf82a00700 1 --2- 172.21.15.2:0/4118661137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d643a4ec0 0x563d6443b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.447+0000 7faf82a00700 1 -- 172.21.15.2:0/4118661137 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d6442cf50 con 0x563d64428630 2024-06-13T11:30:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.447+0000 7faf83e00700 1 --2- 172.21.15.2:0/4118661137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64433380 0x563d6442c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:30:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.447+0000 7faf83400700 1 --2- 172.21.15.2:0/4118661137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d643a4ec0 0x563d6443b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:30:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.447+0000 7faf82a00700 1 --2- 172.21.15.2:0/4118661137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 0x563d6443bb70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faf700cd950 tx=0x7faf70011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e83c42fd77b6d621 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.447+0000 7faf6d600700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:30:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.447+0000 7faf6d600700 1 -- 172.21.15.2:0/4118661137 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf70003970 con 0x563d64428630 2024-06-13T11:30:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.447+0000 7faf6d600700 1 -- 172.21.15.2:0/4118661137 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7faf70098e20 con 0x563d64428630 2024-06-13T11:30:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.447+0000 7faf950f2b80 1 -- 172.21.15.2:0/4118661137 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563d64382600 con 0x563d64428630 2024-06-13T11:30:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.448+0000 7faf6d600700 1 -- 172.21.15.2:0/4118661137 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7faf7009ceb0 con 0x563d64428630 2024-06-13T11:30:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.448+0000 7faf950f2b80 10 client.26179 fetch_fsmap learned FSMap version 31 2024-06-13T11:30:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.448+0000 7faf950f2b80 1 -- 172.21.15.2:0/4118661137 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563d6443b090 con 0x563d64428630 2024-06-13T11:30:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.448+0000 7faf6d600700 1 -- 172.21.15.2:0/4118661137 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563d64382600 con 0x563d64428630 2024-06-13T11:30:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.448+0000 7faf6d600700 1 -- 172.21.15.2:0/4118661137 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7faf700cdbd0 con 0x563d64428630 2024-06-13T11:30:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.448+0000 7faf950f2b80 10 client.26179 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:30:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.448+0000 7faf950f2b80 10 client.26179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:30:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.448+0000 7faf950f2b80 20 client.26179 populate_metadata read hostname 'smithi002' 2024-06-13T11:30:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.448+0000 7faf950f2b80 1 --2- 172.21.15.2:0/4118661137 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x563d644ad9c0 0x563d644afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.448+0000 7faf950f2b80 4 client.26179 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-13T11:30:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.448+0000 7faf950f2b80 1 -- 172.21.15.2:0/4118661137 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563d641fc2d0 con 0x563d644ad9c0 2024-06-13T11:30:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.449+0000 7faf83400700 1 --2- 172.21.15.2:0/4118661137 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x563d644ad9c0 0x563d644afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.449+0000 7faf83400700 1 --2- 172.21.15.2:0/4118661137 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x563d644ad9c0 0x563d644afde0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0e99424ca56d66b server_cookie=5eb23daa15157a85 in_seq=0 out_seq=0 2024-06-13T11:30:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.449+0000 7faf6d600700 10 client.26179 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:30:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.450+0000 7faf6d600700 1 -- 172.21.15.2:0/4118661137 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563d641fc2d0 con 0x563d644ad9c0 2024-06-13T11:30:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.450+0000 7faf6d600700 10 client.26179 handle_command_reply: tid=0 2024-06-13T11:30:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.450+0000 7faf950f2b80 1 client.26179 shutdown 2024-06-13T11:30:49.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.450+0000 7faf950f2b80 1 -- 172.21.15.2:0/4118661137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 msgr2=0x563d6443bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:49.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.450+0000 7faf950f2b80 1 --2- 172.21.15.2:0/4118661137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 0x563d6443bb70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faf700cd950 tx=0x7faf70011000 comp rx=0 tx=0).stop 2024-06-13T11:30:49.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.451+0000 7faf950f2b80 1 -- 172.21.15.2:0/4118661137 shutdown_connections 2024-06-13T11:30:49.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.451+0000 7faf950f2b80 1 --2- 172.21.15.2:0/4118661137 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x563d644ad9c0 0x563d644afde0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.451+0000 7faf950f2b80 1 --2- 172.21.15.2:0/4118661137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d643a4ec0 0x563d6443b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.451+0000 7faf950f2b80 1 --2- 172.21.15.2:0/4118661137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563d64433380 0x563d6442c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.451+0000 7faf950f2b80 1 --2- 172.21.15.2:0/4118661137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d64428630 0x563d6443bb70 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.451+0000 7faf6d600700 0 client.26179 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:30:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.451+0000 7faf950f2b80 1 -- 172.21.15.2:0/4118661137 >> 172.21.15.2:0/4118661137 conn(0x563d643551f0 msgr2=0x563d644237c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.451+0000 7faf950f2b80 1 -- 172.21.15.2:0/4118661137 shutdown_connections 2024-06-13T11:30:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.451+0000 7faf950f2b80 1 -- 172.21.15.2:0/4118661137 wait complete. 2024-06-13T11:30:49.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.451+0000 7faf950f2b80 20 client.26179 trim_cache size 0 max 16384 2024-06-13T11:30:49.456 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:30:49.457 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-06-13T11:30:49.457 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "dc3029e8-42ba-4fa7-a160-546b5d242a15", 2024-06-13T11:30:49.457 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-06-13T11:30:49.457 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:30:49.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.452+0000 7faf8a800700 1 -- 172.21.15.2:0/3439960506 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7faf680a2e10 msgr2=0x7faf680a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.452+0000 7faf8a800700 1 --2- 172.21.15.2:0/3439960506 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7faf680a2e10 0x7faf680a52d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x563d64425430 tx=0x7faf7c00b040 comp rx=0 tx=0).stop 2024-06-13T11:30:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.452+0000 7faf8a800700 1 -- 172.21.15.2:0/3439960506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf84102ee0 msgr2=0x7faf8419b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.452+0000 7faf8a800700 1 --2- 172.21.15.2:0/3439960506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf84102ee0 0x7faf8419b440 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faf70005950 tx=0x7faf7000fb20 comp rx=0 tx=0).stop 2024-06-13T11:30:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.452+0000 7faf8a800700 1 -- 172.21.15.2:0/3439960506 shutdown_connections 2024-06-13T11:30:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.452+0000 7faf8a800700 1 --2- 172.21.15.2:0/3439960506 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7faf680a2e10 0x7faf680a52d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.452+0000 7faf8a800700 1 --2- 172.21.15.2:0/3439960506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf84107450 0x7faf8419f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.452+0000 7faf8a800700 1 --2- 172.21.15.2:0/3439960506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf84102540 0x7faf8419af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.452+0000 7faf8a800700 1 --2- 172.21.15.2:0/3439960506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf84102ee0 0x7faf8419b440 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:49.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.452+0000 7faf8a800700 1 -- 172.21.15.2:0/3439960506 >> 172.21.15.2:0/3439960506 conn(0x7faf840795f0 msgr2=0x7faf841003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:49.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.452+0000 7faf8a800700 1 -- 172.21.15.2:0/3439960506 shutdown_connections 2024-06-13T11:30:49.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:49.452+0000 7faf8a800700 1 -- 172.21.15.2:0/3439960506 wait complete. 2024-06-13T11:30:50.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:49 smithi077 ceph-mon[36410]: pgmap v214: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:50.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:49 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:30:50.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:49 smithi002 ceph-mon[32210]: pgmap v214: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:50.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:49 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:30:50.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:49 smithi178 ceph-mon[36913]: pgmap v214: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:30:50.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:49 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:30:50.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:30:50.791 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:30:51.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:50 smithi077 ceph-mon[36410]: scrub queued for path: / 2024-06-13T11:30:51.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:50 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:30:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:50 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:30:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:50 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:30:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:50 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:30:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:50 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:30:51.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:50 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:30:51.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:50 smithi002 ceph-mon[32210]: scrub queued for path: / 2024-06-13T11:30:51.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:50 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:30:51.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:50 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:30:51.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:50 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:30:51.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:50 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:30:51.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:50 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:30:51.090 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:50 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:30:51.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:50 smithi178 ceph-mon[36913]: scrub queued for path: / 2024-06-13T11:30:51.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:50 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:30:51.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:50 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:30:51.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:50 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:30:51.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:50 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:30:51.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:50 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:30:51.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:50 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:30:52.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:51 smithi077 ceph-mon[36410]: pgmap v215: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:52.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:51 smithi002 ceph-mon[32210]: pgmap v215: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:52.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:51 smithi178 ceph-mon[36913]: pgmap v215: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:30:53.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.102+0000 7f0c9de00700 1 -- 172.21.15.2:0/691616376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9810a6b0 msgr2=0x7f0c9810aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:53.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.102+0000 7f0c9de00700 1 --2- 172.21.15.2:0/691616376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9810a6b0 0x7f0c9810aa90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009990 tx=0x7f0c88009ca0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.102+0000 7f0c9de00700 1 -- 172.21.15.2:0/691616376 shutdown_connections 2024-06-13T11:30:53.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.102+0000 7f0c9de00700 1 --2- 172.21.15.2:0/691616376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9810a6b0 0x7f0c9810aa90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.102+0000 7f0c9de00700 1 --2- 172.21.15.2:0/691616376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c98105070 0x7f0c98111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.102+0000 7f0c9de00700 1 --2- 172.21.15.2:0/691616376 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c981046b0 0x7f0c98104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.102+0000 7f0c9de00700 1 -- 172.21.15.2:0/691616376 >> 172.21.15.2:0/691616376 conn(0x7f0c981001a0 msgr2=0x7f0c981025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:53.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.102+0000 7f0c9de00700 1 -- 172.21.15.2:0/691616376 shutdown_connections 2024-06-13T11:30:53.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.102+0000 7f0c9de00700 1 -- 172.21.15.2:0/691616376 wait complete. 2024-06-13T11:30:53.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.103+0000 7f0c9de00700 1 Processor -- start 2024-06-13T11:30:53.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.103+0000 7f0c9de00700 1 -- start start 2024-06-13T11:30:53.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.103+0000 7f0c9de00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c981046b0 0x7f0c9819af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.103+0000 7f0c9de00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c98105070 0x7f0c9819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.103+0000 7f0c9de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9810a6b0 0x7f0c9819f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.104+0000 7f0c9de00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0c98114a50 con 0x7f0c9810a6b0 2024-06-13T11:30:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.104+0000 7f0c9de00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981148d0 con 0x7f0c981046b0 2024-06-13T11:30:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.104+0000 7f0c9de00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0c98114bd0 con 0x7f0c98105070 2024-06-13T11:30:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.104+0000 7f0c96a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c981046b0 0x7f0c9819af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.104+0000 7f0c96a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c981046b0 0x7f0c9819af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:44784/0 (socket says 172.21.15.2:44784) 2024-06-13T11:30:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.104+0000 7f0c96a00700 1 -- 172.21.15.2:0/2339059203 learned_addr learned my addr 172.21.15.2:0/2339059203 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.104+0000 7f0c97400700 1 --2- 172.21.15.2:0/2339059203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9810a6b0 0x7f0c9819f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.104+0000 7f0c96000700 1 --2- 172.21.15.2:0/2339059203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c98105070 0x7f0c9819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.104+0000 7f0c96a00700 1 -- 172.21.15.2:0/2339059203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c98105070 msgr2=0x7f0c9819b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.104+0000 7f0c96a00700 1 --2- 172.21.15.2:0/2339059203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c98105070 0x7f0c9819b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.104+0000 7f0c96a00700 1 -- 172.21.15.2:0/2339059203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9810a6b0 msgr2=0x7f0c9819f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.104+0000 7f0c96a00700 1 --2- 172.21.15.2:0/2339059203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9810a6b0 0x7f0c9819f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.104+0000 7f0c96a00700 1 -- 172.21.15.2:0/2339059203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9819ff30 con 0x7f0c981046b0 2024-06-13T11:30:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.104+0000 7f0c97400700 1 --2- 172.21.15.2:0/2339059203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9810a6b0 0x7f0c9819f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:30:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.105+0000 7f0c96a00700 1 --2- 172.21.15.2:0/2339059203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c981046b0 0x7f0c9819af20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0c88005910 tx=0x7f0c8800bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.105+0000 7f0c9ca00700 1 -- 172.21.15.2:0/2339059203 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c88027070 con 0x7f0c981046b0 2024-06-13T11:30:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.105+0000 7f0c9ca00700 1 -- 172.21.15.2:0/2339059203 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c88003d70 con 0x7f0c981046b0 2024-06-13T11:30:53.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.105+0000 7f0c9de00700 1 -- 172.21.15.2:0/2339059203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c981a01c0 con 0x7f0c981046b0 2024-06-13T11:30:53.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.105+0000 7f0c9ca00700 1 -- 172.21.15.2:0/2339059203 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8800f6c0 con 0x7f0c981046b0 2024-06-13T11:30:53.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.105+0000 7f0c9de00700 1 -- 172.21.15.2:0/2339059203 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c981a7aa0 con 0x7f0c981046b0 2024-06-13T11:30:53.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.108+0000 7f0c9ca00700 1 -- 172.21.15.2:0/2339059203 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f0c8802a070 con 0x7f0c981046b0 2024-06-13T11:30:53.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.111+0000 7f0ca86d1b80 1 Processor -- start 2024-06-13T11:30:53.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.111+0000 7f0c9ca00700 1 --2- 172.21.15.2:0/2339059203 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0c7c0a2e10 0x7f0c7c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.111+0000 7f0ca86d1b80 1 -- start start 2024-06-13T11:30:53.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.111+0000 7f0c9ca00700 1 -- 172.21.15.2:0/2339059203 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f0c880d08b0 con 0x7f0c981046b0 2024-06-13T11:30:53.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.111+0000 7f0c97400700 1 --2- 172.21.15.2:0/2339059203 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0c7c0a2e10 0x7f0c7c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.111+0000 7f0ca86d1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f7ab90 0x55a144f7af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.111+0000 7f0ca86d1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7b4b0 0x55a144f74d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.111+0000 7f0ca86d1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f75240 0x55a144f75680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.111+0000 7f0ca86d1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a144e83a10 con 0x55a144f7b4b0 2024-06-13T11:30:53.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.111+0000 7f0ca86d1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a144ec6b00 con 0x55a144f75240 2024-06-13T11:30:53.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.111+0000 7f0ca86d1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a144e818f0 con 0x55a144f7ab90 2024-06-13T11:30:53.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.112+0000 7f0c96000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7b4b0 0x55a144f74d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.112+0000 7f0c96000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7b4b0 0x55a144f74d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56976/0 (socket says 172.21.15.2:56976) 2024-06-13T11:30:53.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.112+0000 7f0c96000700 1 -- 172.21.15.2:0/2278510222 learned_addr learned my addr 172.21.15.2:0/2278510222 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:53.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.112+0000 7f0c96a00700 1 --2- 172.21.15.2:0/2278510222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f7ab90 0x55a144f7af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.112+0000 7f0c97400700 1 --2- 172.21.15.2:0/2278510222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f75240 0x55a144f75680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.112+0000 7f0c97400700 1 --2- 172.21.15.2:0/2339059203 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0c7c0a2e10 0x7f0c7c0a52d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009d20 tx=0x7f0c90009040 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:53.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.112+0000 7f0c96000700 1 -- 172.21.15.2:0/2278510222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f7ab90 msgr2=0x55a144f7af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:53.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.112+0000 7f0c96000700 1 --2- 172.21.15.2:0/2278510222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f7ab90 0x55a144f7af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.112+0000 7f0c96000700 1 -- 172.21.15.2:0/2278510222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f75240 msgr2=0x55a144f75680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:53.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.112+0000 7f0c96000700 1 --2- 172.21.15.2:0/2278510222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f75240 0x55a144f75680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.112+0000 7f0c96000700 1 -- 172.21.15.2:0/2278510222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a144e6ef90 con 0x55a144f7b4b0 2024-06-13T11:30:53.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.113+0000 7f0c96000700 1 --2- 172.21.15.2:0/2278510222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7b4b0 0x55a144f74d00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009d30 tx=0x7f0c84011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7281789ada25eb81 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:53.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.113+0000 7f0c8cc00700 1 -- 172.21.15.2:0/2278510222 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8401e070 con 0x55a144f7b4b0 2024-06-13T11:30:53.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.113+0000 7f0c8cc00700 1 -- 172.21.15.2:0/2278510222 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c84019b10 con 0x55a144f7b4b0 2024-06-13T11:30:53.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.113+0000 7f0c8cc00700 1 -- 172.21.15.2:0/2278510222 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8400eb10 con 0x55a144f7b4b0 2024-06-13T11:30:53.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.114+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/2278510222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7b4b0 msgr2=0x55a144f74d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:53.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.114+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/2278510222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7b4b0 0x55a144f74d00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009d30 tx=0x7f0c84011720 comp rx=0 tx=0).stop 2024-06-13T11:30:53.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.114+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/2278510222 shutdown_connections 2024-06-13T11:30:53.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.114+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/2278510222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f75240 0x55a144f75680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.114+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/2278510222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f7ab90 0x55a144f7af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.114+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/2278510222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7b4b0 0x55a144f74d00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.114+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/2278510222 >> 172.21.15.2:0/2278510222 conn(0x55a144ea1170 msgr2=0x55a144f6fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:53.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.114+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/2278510222 shutdown_connections 2024-06-13T11:30:53.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.114+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/2278510222 wait complete. 2024-06-13T11:30:53.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.115+0000 7f0ca86d1b80 1 -- start start 2024-06-13T11:30:53.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.115+0000 7f0ca86d1b80 1 Processor -- start 2024-06-13T11:30:53.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.115+0000 7f0ca86d1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f75240 0x55a144f81220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.115+0000 7f0ca86d1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f7ab90 0x55a144f7e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.115+0000 7f0ca86d1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f7b4b0 0x55a144f7ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.115+0000 7f0ca86d1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a144e62f60 con 0x55a144f75240 2024-06-13T11:30:53.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.115+0000 7f0ca86d1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a144ec2ac0 con 0x55a144f7b4b0 2024-06-13T11:30:53.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.115+0000 7f0ca86d1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a144f81e90 con 0x55a144f7ab90 2024-06-13T11:30:53.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.115+0000 7f0ca86d1b80 10 client.0 _ll_register_callbacks cb 0x55a144e5c380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:30:53.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.116+0000 7f0c96a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f75240 0x55a144f81220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.116+0000 7f0c97400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f7b4b0 0x55a144f7ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.116+0000 7f0c96a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f75240 0x55a144f81220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56986/0 (socket says 172.21.15.2:56986) 2024-06-13T11:30:53.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.116+0000 7f0c96a00700 1 -- 172.21.15.2:0/2426118441 learned_addr learned my addr 172.21.15.2:0/2426118441 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:53.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.116+0000 7f0c96000700 1 --2- 172.21.15.2:0/2426118441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f7ab90 0x55a144f7e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.116+0000 7f0c96a00700 1 -- 172.21.15.2:0/2426118441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f7ab90 msgr2=0x55a144f7e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:53.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.116+0000 7f0c96a00700 1 --2- 172.21.15.2:0/2426118441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f7ab90 0x55a144f7e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.116+0000 7f0c96a00700 1 -- 172.21.15.2:0/2426118441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f7b4b0 msgr2=0x55a144f7ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:53.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.116+0000 7f0c96a00700 1 --2- 172.21.15.2:0/2426118441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f7b4b0 0x55a144f7ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.116+0000 7f0c96a00700 1 -- 172.21.15.2:0/2426118441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a144e158d0 con 0x55a144f75240 2024-06-13T11:30:53.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.116+0000 7f0c97400700 1 --2- 172.21.15.2:0/2426118441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f7b4b0 0x55a144f7ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:30:53.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.116+0000 7f0c96000700 1 --2- 172.21.15.2:0/2426118441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f7ab90 0x55a144f7e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:30:53.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.117+0000 7f0c96a00700 1 --2- 172.21.15.2:0/2426118441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f75240 0x55a144f81220 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0c88000c00 tx=0x7f0c8809c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506a9ee4ce227648 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:53.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.117+0000 7f0c81600700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:30:53.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.117+0000 7f0c81600700 1 -- 172.21.15.2:0/2426118441 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8809d190 con 0x55a144f75240 2024-06-13T11:30:53.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.117+0000 7f0c81600700 1 -- 172.21.15.2:0/2426118441 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f0c88022470 con 0x55a144f75240 2024-06-13T11:30:53.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.117+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/2426118441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c84019b10 con 0x55a144f75240 2024-06-13T11:30:53.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.117+0000 7f0c81600700 1 -- 172.21.15.2:0/2426118441 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0c8809ca90 con 0x55a144f75240 2024-06-13T11:30:53.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.117+0000 7f0ca86d1b80 10 client.16047 fetch_fsmap learned FSMap version 31 2024-06-13T11:30:53.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.117+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/2426118441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a144f8c610 con 0x55a144f75240 2024-06-13T11:30:53.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.118+0000 7f0c81600700 1 -- 172.21.15.2:0/2426118441 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c84019b10 con 0x55a144f75240 2024-06-13T11:30:53.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.118+0000 7f0c81600700 1 -- 172.21.15.2:0/2426118441 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f0c880a51e0 con 0x55a144f75240 2024-06-13T11:30:53.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.118+0000 7f0ca86d1b80 10 client.16047 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:30:53.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.118+0000 7f0ca86d1b80 10 client.16047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:30:53.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.118+0000 7f0ca86d1b80 20 client.16047 populate_metadata read hostname 'smithi002' 2024-06-13T11:30:53.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.118+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/2426118441 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a144f8eb30 0x55a144f90f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.118+0000 7f0ca86d1b80 4 client.16047 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:30:53.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.118+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/2426118441 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a144ed4000 con 0x55a144f8eb30 2024-06-13T11:30:53.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.118+0000 7f0c96000700 1 --2- 172.21.15.2:0/2426118441 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a144f8eb30 0x55a144f90f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.119+0000 7f0c96000700 1 --2- 172.21.15.2:0/2426118441 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a144f8eb30 0x55a144f90f40 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c9fce330cb81ff1 server_cookie=d4633e282d81d9e8 in_seq=0 out_seq=0 2024-06-13T11:30:53.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.119+0000 7f0c81600700 10 client.16047 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:30:53.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.120+0000 7f0c81600700 1 -- 172.21.15.2:0/2426118441 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a144ed4000 con 0x55a144f8eb30 2024-06-13T11:30:53.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.120+0000 7f0c81600700 10 client.16047 handle_command_reply: tid=0 2024-06-13T11:30:53.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.120+0000 7f0ca86d1b80 1 client.16047 shutdown 2024-06-13T11:30:53.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.120+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/2426118441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f75240 msgr2=0x55a144f81220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:53.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.120+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/2426118441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f75240 0x55a144f81220 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0c88000c00 tx=0x7f0c8809c650 comp rx=0 tx=0).stop 2024-06-13T11:30:53.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.120+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/2426118441 shutdown_connections 2024-06-13T11:30:53.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.120+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/2426118441 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a144f8eb30 0x55a144f90f40 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.120+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/2426118441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f75240 0x55a144f81220 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.120+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/2426118441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f7b4b0 0x55a144f7ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.120+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/2426118441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f7ab90 0x55a144f7e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.120+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/2426118441 >> 172.21.15.2:0/2426118441 conn(0x55a144ea1170 msgr2=0x55a144f69790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:53.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.120+0000 7f0c81600700 0 client.16047 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:30:53.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.121+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/2426118441 shutdown_connections 2024-06-13T11:30:53.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.121+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/2426118441 wait complete. 2024-06-13T11:30:53.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.121+0000 7f0ca86d1b80 20 client.16047 trim_cache size 0 max 16384 2024-06-13T11:30:53.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.143+0000 7f0ca86d1b80 1 Processor -- start 2024-06-13T11:30:53.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.143+0000 7f0ca86d1b80 1 -- start start 2024-06-13T11:30:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.144+0000 7f0ca86d1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f75240 0x55a144f74d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.144+0000 7f0ca86d1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7ab90 0x55a144f78c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.144+0000 7f0ca86d1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f7b4b0 0x55a144f7c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.144+0000 7f0ca86d1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981b2dd0 con 0x55a144f7ab90 2024-06-13T11:30:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.144+0000 7f0ca86d1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981b0660 con 0x55a144f7b4b0 2024-06-13T11:30:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.144+0000 7f0ca86d1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981ae4b0 con 0x55a144f75240 2024-06-13T11:30:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.144+0000 7f0c96000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7ab90 0x55a144f78c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.144+0000 7f0c96000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7ab90 0x55a144f78c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56992/0 (socket says 172.21.15.2:56992) 2024-06-13T11:30:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.144+0000 7f0c96000700 1 -- 172.21.15.2:0/1538977417 learned_addr learned my addr 172.21.15.2:0/1538977417 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.144+0000 7f0c97400700 1 --2- 172.21.15.2:0/1538977417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f7b4b0 0x55a144f7c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.144+0000 7f0c96a00700 1 --2- 172.21.15.2:0/1538977417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f75240 0x55a144f74d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.144+0000 7f0c96000700 1 -- 172.21.15.2:0/1538977417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f75240 msgr2=0x55a144f74d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.144+0000 7f0c96000700 1 --2- 172.21.15.2:0/1538977417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f75240 0x55a144f74d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.144+0000 7f0c96000700 1 -- 172.21.15.2:0/1538977417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f7b4b0 msgr2=0x55a144f7c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.145+0000 7f0c96000700 1 --2- 172.21.15.2:0/1538977417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f7b4b0 0x55a144f7c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.145+0000 7f0c96000700 1 -- 172.21.15.2:0/1538977417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a144f91590 con 0x55a144f7ab90 2024-06-13T11:30:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.145+0000 7f0c96000700 1 --2- 172.21.15.2:0/1538977417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7ab90 0x55a144f78c80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009c50 tx=0x7f0c840198d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2005dbe1c13697d4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.145+0000 7f0c83e00700 1 -- 172.21.15.2:0/1538977417 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8401e040 con 0x55a144f7ab90 2024-06-13T11:30:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.145+0000 7f0c83e00700 1 -- 172.21.15.2:0/1538977417 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c84005d00 con 0x55a144f7ab90 2024-06-13T11:30:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.145+0000 7f0c83e00700 1 -- 172.21.15.2:0/1538977417 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c84003a40 con 0x55a144f7ab90 2024-06-13T11:30:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.146+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/1538977417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7ab90 msgr2=0x55a144f78c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.146+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/1538977417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7ab90 0x55a144f78c80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009c50 tx=0x7f0c840198d0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.146+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/1538977417 shutdown_connections 2024-06-13T11:30:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.146+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/1538977417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f7b4b0 0x55a144f7c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.146+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/1538977417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f75240 0x55a144f74d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.146+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/1538977417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7ab90 0x55a144f78c80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.146+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/1538977417 >> 172.21.15.2:0/1538977417 conn(0x55a144ea1170 msgr2=0x55a144f7ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.146+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/1538977417 shutdown_connections 2024-06-13T11:30:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.146+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/1538977417 wait complete. 2024-06-13T11:30:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.146+0000 7f0ca86d1b80 1 -- start start 2024-06-13T11:30:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.147+0000 7f0ca86d1b80 1 Processor -- start 2024-06-13T11:30:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.147+0000 7f0ca86d1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f75240 0x55a144f87330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.147+0000 7f0ca86d1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7ab90 0x55a144f87870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.147+0000 7f0ca86d1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f7b4b0 0x55a144f95dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.147+0000 7f0ca86d1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981aeb20 con 0x55a144f7ab90 2024-06-13T11:30:53.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.147+0000 7f0ca86d1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981aff90 con 0x55a144f7b4b0 2024-06-13T11:30:53.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.147+0000 7f0ca86d1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0c981af1f0 con 0x55a144f75240 2024-06-13T11:30:53.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.147+0000 7f0ca86d1b80 10 client.0 _ll_register_callbacks cb 0x55a144e5c380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:30:53.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.148+0000 7f0c96a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f75240 0x55a144f87330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.148+0000 7f0c96000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7ab90 0x55a144f87870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.148+0000 7f0c96a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f75240 0x55a144f87330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:46944/0 (socket says 172.21.15.2:46944) 2024-06-13T11:30:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.148+0000 7f0c96a00700 1 -- 172.21.15.2:0/3675432141 learned_addr learned my addr 172.21.15.2:0/3675432141 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:30:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.148+0000 7f0c97400700 1 --2- 172.21.15.2:0/3675432141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f7b4b0 0x55a144f95dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.148+0000 7f0c96000700 1 -- 172.21.15.2:0/3675432141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f75240 msgr2=0x55a144f87330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.148+0000 7f0c96000700 1 --2- 172.21.15.2:0/3675432141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f75240 0x55a144f87330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.148+0000 7f0c96000700 1 -- 172.21.15.2:0/3675432141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f7b4b0 msgr2=0x55a144f95dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:30:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.148+0000 7f0c96000700 1 --2- 172.21.15.2:0/3675432141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f7b4b0 0x55a144f95dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.148+0000 7f0c96000700 1 -- 172.21.15.2:0/3675432141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a144f965e0 con 0x55a144f7ab90 2024-06-13T11:30:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.148+0000 7f0c96a00700 1 --2- 172.21.15.2:0/3675432141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f75240 0x55a144f87330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:30:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.148+0000 7f0c96000700 1 --2- 172.21.15.2:0/3675432141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7ab90 0x55a144f87870 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55a144f7a730 tx=0x7f0c84005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e4ddedcfbb592c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:30:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.148+0000 7f0c81600700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:30:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.149+0000 7f0c81600700 1 -- 172.21.15.2:0/3675432141 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8401e070 con 0x55a144f7ab90 2024-06-13T11:30:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.149+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/3675432141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a144ece580 con 0x55a144f7ab90 2024-06-13T11:30:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.149+0000 7f0c81600700 1 -- 172.21.15.2:0/3675432141 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9395+0+0 (secure 0 0 0) 0x7f0c84005040 con 0x55a144f7ab90 2024-06-13T11:30:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.149+0000 7f0c81600700 1 -- 172.21.15.2:0/3675432141 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0c84041050 con 0x55a144f7ab90 2024-06-13T11:30:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.149+0000 7f0ca86d1b80 10 client.16053 fetch_fsmap learned FSMap version 31 2024-06-13T11:30:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.149+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/3675432141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a144ff92c0 con 0x55a144f7ab90 2024-06-13T11:30:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.149+0000 7f0c81600700 1 -- 172.21.15.2:0/3675432141 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55a144ece580 con 0x55a144f7ab90 2024-06-13T11:30:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.150+0000 7f0c81600700 1 -- 172.21.15.2:0/3675432141 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f0c8400e4d0 con 0x55a144f7ab90 2024-06-13T11:30:53.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.150+0000 7f0ca86d1b80 10 client.16053 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:30:53.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.150+0000 7f0ca86d1b80 10 client.16053 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:30:53.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.150+0000 7f0ca86d1b80 20 client.16053 populate_metadata read hostname 'smithi002' 2024-06-13T11:30:53.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.150+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/3675432141 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a144ff9670 0x55a144ffba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:30:53.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.150+0000 7f0ca86d1b80 4 client.16053 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:30:53.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.150+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/3675432141 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a144d48250 con 0x55a144ff9670 2024-06-13T11:30:53.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.150+0000 7f0c96a00700 1 --2- 172.21.15.2:0/3675432141 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a144ff9670 0x55a144ffba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:30:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.151+0000 7f0c96a00700 1 --2- 172.21.15.2:0/3675432141 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a144ff9670 0x55a144ffba60 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e9a4ffb0f8994b7 server_cookie=688c2374eea8d24e in_seq=0 out_seq=0 2024-06-13T11:30:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.151+0000 7f0c81600700 10 client.16053 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:30:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.151+0000 7f0c81600700 1 -- 172.21.15.2:0/3675432141 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a144d48250 con 0x55a144ff9670 2024-06-13T11:30:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.151+0000 7f0c81600700 10 client.16053 handle_command_reply: tid=0 2024-06-13T11:30:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.151+0000 7f0ca86d1b80 1 client.16053 shutdown 2024-06-13T11:30:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.151+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/3675432141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7ab90 msgr2=0x55a144f87870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.151+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/3675432141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7ab90 0x55a144f87870 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55a144f7a730 tx=0x7f0c84005810 comp rx=0 tx=0).stop 2024-06-13T11:30:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.151+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/3675432141 shutdown_connections 2024-06-13T11:30:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.151+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/3675432141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a144f7b4b0 0x55a144f95dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.151+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/3675432141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a144f75240 0x55a144f87330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.151+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/3675432141 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a144ff9670 0x55a144ffba60 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.151+0000 7f0ca86d1b80 1 --2- 172.21.15.2:0/3675432141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a144f7ab90 0x55a144f87870 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.151+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/3675432141 >> 172.21.15.2:0/3675432141 conn(0x55a144ea1170 msgr2=0x55a144f7d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.151+0000 7f0c81600700 0 client.16053 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:30:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.151+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/3675432141 shutdown_connections 2024-06-13T11:30:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.151+0000 7f0ca86d1b80 1 -- 172.21.15.2:0/3675432141 wait complete. 2024-06-13T11:30:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.152+0000 7f0ca86d1b80 20 client.16053 trim_cache size 0 max 16384 2024-06-13T11:30:53.158 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:30:53.158 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-13T11:30:53.158 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-06-13T11:30:53.158 INFO:teuthology.orchestra.run.smithi002.stdout: "dc3029e8-42ba-4fa7-a160-546b5d242a15": { 2024-06-13T11:30:53.158 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-06-13T11:30:53.158 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "dc3029e8-42ba-4fa7-a160-546b5d242a15", 2024-06-13T11:30:53.159 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-06-13T11:30:53.159 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:30:53.159 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:30:53.159 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:30:53.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.152+0000 7f0c9de00700 1 -- 172.21.15.2:0/2339059203 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0c7c0a2e10 msgr2=0x7f0c7c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:53.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.152+0000 7f0c9de00700 1 --2- 172.21.15.2:0/2339059203 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0c7c0a2e10 0x7f0c7c0a52d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009d20 tx=0x7f0c90009040 comp rx=0 tx=0).stop 2024-06-13T11:30:53.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.152+0000 7f0c9de00700 1 -- 172.21.15.2:0/2339059203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c981046b0 msgr2=0x7f0c9819af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:30:53.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.152+0000 7f0c9de00700 1 --2- 172.21.15.2:0/2339059203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c981046b0 0x7f0c9819af20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0c88005910 tx=0x7f0c8800bab0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.152+0000 7f0c9de00700 1 -- 172.21.15.2:0/2339059203 shutdown_connections 2024-06-13T11:30:53.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.152+0000 7f0c9de00700 1 --2- 172.21.15.2:0/2339059203 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0c7c0a2e10 0x7f0c7c0a52d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.152+0000 7f0c9de00700 1 --2- 172.21.15.2:0/2339059203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c9810a6b0 0x7f0c9819f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.152+0000 7f0c9de00700 1 --2- 172.21.15.2:0/2339059203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c981046b0 0x7f0c9819af20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.152+0000 7f0c9de00700 1 --2- 172.21.15.2:0/2339059203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c98105070 0x7f0c9819b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:30:53.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.152+0000 7f0c9de00700 1 -- 172.21.15.2:0/2339059203 >> 172.21.15.2:0/2339059203 conn(0x7f0c981001a0 msgr2=0x7f0c98100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:30:53.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.153+0000 7f0c9de00700 1 -- 172.21.15.2:0/2339059203 shutdown_connections 2024-06-13T11:30:53.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:30:53.153+0000 7f0c9de00700 1 -- 172.21.15.2:0/2339059203 wait complete. 2024-06-13T11:30:53.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:53 smithi002 ceph-mon[32210]: pgmap v216: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-06-13T11:30:54.017 INFO:tasks.cephfs.filesystem:scrub status for tag:dc3029e8-42ba-4fa7-a160-546b5d242a15 - {'path': '/', 'tag': 'dc3029e8-42ba-4fa7-a160-546b5d242a15', 'options': 'recursive,force'} 2024-06-13T11:30:54.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:53 smithi077 ceph-mon[36410]: pgmap v216: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-06-13T11:30:54.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:53 smithi178 ceph-mon[36913]: pgmap v216: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-06-13T11:30:56.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:55 smithi077 ceph-mon[36410]: pgmap v217: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:30:56.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:55 smithi002 ceph-mon[32210]: pgmap v217: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:30:56.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:55 smithi178 ceph-mon[36913]: pgmap v217: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:30:57.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:56 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:30:57.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:56 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:30:57.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:56 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:30:57.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:56 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:30:57.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:56 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:30:57.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:56 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:30:57.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:57 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:30:57.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:57 smithi002 ceph-mon[32210]: pgmap v218: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:30:58.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:57 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:30:58.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:57 smithi077 ceph-mon[36410]: pgmap v218: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:30:58.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:57 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:30:58.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:57 smithi178 ceph-mon[36913]: pgmap v218: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:31:00.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:30:59 smithi077 ceph-mon[36410]: pgmap v219: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-06-13T11:31:00.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:30:59 smithi002 ceph-mon[32210]: pgmap v219: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-06-13T11:31:00.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:30:59 smithi178 ceph-mon[36913]: pgmap v219: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-06-13T11:31:02.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:01 smithi077 ceph-mon[36410]: pgmap v220: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4 op/s 2024-06-13T11:31:02.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:01 smithi002 ceph-mon[32210]: pgmap v220: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4 op/s 2024-06-13T11:31:02.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:01 smithi178 ceph-mon[36913]: pgmap v220: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4 op/s 2024-06-13T11:31:04.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:03 smithi077 ceph-mon[36410]: pgmap v221: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-06-13T11:31:04.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:03 smithi002 ceph-mon[32210]: pgmap v221: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-06-13T11:31:04.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:03 smithi178 ceph-mon[36913]: pgmap v221: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-06-13T11:31:05.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:04 smithi077 ceph-mon[36410]: pgmap v222: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:31:05.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:04 smithi002 ceph-mon[32210]: pgmap v222: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:31:05.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:04 smithi178 ceph-mon[36913]: pgmap v222: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:31:07.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:07 smithi002 ceph-mon[32210]: pgmap v223: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:31:07.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:07 smithi002 ceph-mon[32210]: osdmap e101: 12 total, 12 up, 12 in 2024-06-13T11:31:07.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:07 smithi178 ceph-mon[36913]: pgmap v223: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:31:07.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:07 smithi178 ceph-mon[36913]: osdmap e101: 12 total, 12 up, 12 in 2024-06-13T11:31:07.742 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:07 smithi077 ceph-mon[36410]: pgmap v223: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:31:07.743 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:07 smithi077 ceph-mon[36410]: osdmap e101: 12 total, 12 up, 12 in 2024-06-13T11:31:09.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:09 smithi002 ceph-mon[32210]: pgmap v225: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-06-13T11:31:09.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:09 smithi002 ceph-mon[32210]: osdmap e102: 12 total, 12 up, 12 in 2024-06-13T11:31:09.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:09 smithi178 ceph-mon[36913]: pgmap v225: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-06-13T11:31:09.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:09 smithi178 ceph-mon[36913]: osdmap e102: 12 total, 12 up, 12 in 2024-06-13T11:31:09.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:09 smithi077 ceph-mon[36410]: pgmap v225: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-06-13T11:31:09.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:09 smithi077 ceph-mon[36410]: osdmap e102: 12 total, 12 up, 12 in 2024-06-13T11:31:11.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:11 smithi002 ceph-mon[32210]: pgmap v227: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-06-13T11:31:11.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:11 smithi178 ceph-mon[36913]: pgmap v227: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-06-13T11:31:11.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:11 smithi077 ceph-mon[36410]: pgmap v227: 129 pgs: 129 active+clean; 83 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-06-13T11:31:13.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:13 smithi002 ceph-mon[32210]: pgmap v228: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:31:13.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:13 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:31:13.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:13 smithi178 ceph-mon[36913]: pgmap v228: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:31:13.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:13 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:31:13.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:13 smithi077 ceph-mon[36410]: pgmap v228: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:31:13.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:13 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:31:14.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:14 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:31:14.898 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:14 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:31:14.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:14 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:31:14.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:14 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:31:15.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:14 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:31:15.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:14 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:31:15.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:15 smithi178 ceph-mon[36913]: pgmap v229: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:31:15.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:15 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:31:15.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:15 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:31:15.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:15 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:31:16.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:15 smithi077 ceph-mon[36410]: pgmap v229: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:31:16.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:15 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:31:16.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:15 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:31:16.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:15 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:31:16.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:15 smithi002 ceph-mon[32210]: pgmap v229: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:31:16.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:15 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:31:16.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:15 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:31:16.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:15 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:31:17.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:17 smithi178 ceph-mon[36913]: pgmap v230: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-06-13T11:31:18.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:17 smithi077 ceph-mon[36410]: pgmap v230: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-06-13T11:31:18.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:17 smithi002 ceph-mon[32210]: pgmap v230: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-06-13T11:31:19.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:19 smithi178 ceph-mon[36913]: pgmap v231: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-06-13T11:31:20.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:19 smithi077 ceph-mon[36410]: pgmap v231: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-06-13T11:31:20.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:19 smithi002 ceph-mon[32210]: pgmap v231: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-06-13T11:31:21.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:21 smithi178 ceph-mon[36913]: pgmap v232: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-06-13T11:31:22.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:21 smithi077 ceph-mon[36410]: pgmap v232: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-06-13T11:31:22.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:21 smithi002 ceph-mon[32210]: pgmap v232: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-06-13T11:31:23.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:23 smithi178 ceph-mon[36913]: pgmap v233: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:31:24.018 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:31:24.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:23 smithi077 ceph-mon[36410]: pgmap v233: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:31:24.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:23 smithi002 ceph-mon[32210]: pgmap v233: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:31:24.506 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:31:25.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:25 smithi002 ceph-mon[32210]: pgmap v234: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:25.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:25 smithi178 ceph-mon[36913]: pgmap v234: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:26.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:25 smithi077 ceph-mon[36410]: pgmap v234: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.918+0000 7f6b03000700 1 -- 172.21.15.2:0/1433095898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6afc10d8a0 msgr2=0x7f6afc10dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.918+0000 7f6b03000700 1 --2- 172.21.15.2:0/1433095898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6afc10d8a0 0x7f6afc10dc80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6af0009990 tx=0x7f6af0009ca0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.918+0000 7f6b03000700 1 -- 172.21.15.2:0/1433095898 shutdown_connections 2024-06-13T11:31:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.918+0000 7f6b03000700 1 --2- 172.21.15.2:0/1433095898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6afc10d8a0 0x7f6afc10dc80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.918+0000 7f6b03000700 1 --2- 172.21.15.2:0/1433095898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6afc109390 0x7f6afc115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.918+0000 7f6b03000700 1 --2- 172.21.15.2:0/1433095898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6afc1089d0 0x7f6afc108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.918+0000 7f6b03000700 1 -- 172.21.15.2:0/1433095898 >> 172.21.15.2:0/1433095898 conn(0x7f6afc078220 msgr2=0x7f6afc1072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.918+0000 7f6b03000700 1 -- 172.21.15.2:0/1433095898 shutdown_connections 2024-06-13T11:31:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.918+0000 7f6b03000700 1 -- 172.21.15.2:0/1433095898 wait complete. 2024-06-13T11:31:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.919+0000 7f6b03000700 1 Processor -- start 2024-06-13T11:31:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.919+0000 7f6b03000700 1 -- start start 2024-06-13T11:31:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.920+0000 7f6b03000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6afc1089d0 0x7f6afc19f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.920+0000 7f6b03000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6afc109390 0x7f6afc19f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.920+0000 7f6b03000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6afc10d8a0 0x7f6afc1a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.920+0000 7f6b03000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc118cc0 con 0x7f6afc109390 2024-06-13T11:31:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.920+0000 7f6b03000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc118b40 con 0x7f6afc1089d0 2024-06-13T11:31:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.920+0000 7f6b03000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc118e40 con 0x7f6afc10d8a0 2024-06-13T11:31:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.920+0000 7f6b01200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6afc109390 0x7f6afc19f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.920+0000 7f6b01c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6afc1089d0 0x7f6afc19f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.920+0000 7f6b02600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6afc10d8a0 0x7f6afc1a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.920+0000 7f6b01200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6afc109390 0x7f6afc19f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38078/0 (socket says 172.21.15.2:38078) 2024-06-13T11:31:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.920+0000 7f6b01200700 1 -- 172.21.15.2:0/453201821 learned_addr learned my addr 172.21.15.2:0/453201821 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.921+0000 7f6b01c00700 1 -- 172.21.15.2:0/453201821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6afc10d8a0 msgr2=0x7f6afc1a3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.921+0000 7f6b01c00700 1 --2- 172.21.15.2:0/453201821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6afc10d8a0 0x7f6afc1a3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.921+0000 7f6b01c00700 1 -- 172.21.15.2:0/453201821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6afc109390 msgr2=0x7f6afc19f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.921+0000 7f6b01c00700 1 --2- 172.21.15.2:0/453201821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6afc109390 0x7f6afc19f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.921+0000 7f6b01c00700 1 -- 172.21.15.2:0/453201821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6afc1a4200 con 0x7f6afc1089d0 2024-06-13T11:31:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.921+0000 7f6b02600700 1 --2- 172.21.15.2:0/453201821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6afc10d8a0 0x7f6afc1a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.921+0000 7f6b01c00700 1 --2- 172.21.15.2:0/453201821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6afc1089d0 0x7f6afc19f1f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6af0006010 tx=0x7f6af000bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.921+0000 7f6afa000700 1 -- 172.21.15.2:0/453201821 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af0027070 con 0x7f6afc1089d0 2024-06-13T11:31:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.921+0000 7f6afa000700 1 -- 172.21.15.2:0/453201821 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6af00056d0 con 0x7f6afc1089d0 2024-06-13T11:31:26.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.922+0000 7f6b03000700 1 -- 172.21.15.2:0/453201821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6afc1a4490 con 0x7f6afc1089d0 2024-06-13T11:31:26.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.922+0000 7f6afa000700 1 -- 172.21.15.2:0/453201821 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af0022d90 con 0x7f6afc1089d0 2024-06-13T11:31:26.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.922+0000 7f6b03000700 1 -- 172.21.15.2:0/453201821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6afc1abd70 con 0x7f6afc1089d0 2024-06-13T11:31:26.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.925+0000 7f6afa000700 1 -- 172.21.15.2:0/453201821 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f6af002a070 con 0x7f6afc1089d0 2024-06-13T11:31:26.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.926+0000 7f6afa000700 1 --2- 172.21.15.2:0/453201821 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6ae40a2e10 0x7f6ae40a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.927+0000 7f6afa000700 1 -- 172.21.15.2:0/453201821 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7f6af00d0630 con 0x7f6afc1089d0 2024-06-13T11:31:26.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.927+0000 7f6b0ef9cb80 1 Processor -- start 2024-06-13T11:31:26.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.927+0000 7f6b01200700 1 --2- 172.21.15.2:0/453201821 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6ae40a2e10 0x7f6ae40a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.927+0000 7f6b0ef9cb80 1 -- start start 2024-06-13T11:31:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.927+0000 7f6b0ef9cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 0x5603ddaff420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.927+0000 7f6b0ef9cb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddaffde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.927+0000 7f6b0ef9cb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 0x5603ddb0a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.927+0000 7f6b0ef9cb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5603dda0ca10 con 0x5603ddb08570 2024-06-13T11:31:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.927+0000 7f6b0ef9cb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5603dda4fb00 con 0x5603ddaff960 2024-06-13T11:31:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.927+0000 7f6b0ef9cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5603dda0a8f0 con 0x5603dda79e40 2024-06-13T11:31:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.928+0000 7f6b01c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 0x5603ddaff420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.928+0000 7f6b01200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddaffde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.928+0000 7f6b01c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 0x5603ddaff420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:36968/0 (socket says 172.21.15.2:36968) 2024-06-13T11:31:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.928+0000 7f6b01200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddaffde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:47206/0 (socket says 172.21.15.2:47206) 2024-06-13T11:31:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.928+0000 7f6b01c00700 1 -- 172.21.15.2:0/1877707212 learned_addr learned my addr 172.21.15.2:0/1877707212 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.928+0000 7f6b02600700 1 --2- 172.21.15.2:0/1877707212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 0x5603ddb0a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.928+0000 7f6b01200700 1 --2- 172.21.15.2:0/453201821 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6ae40a2e10 0x7f6ae40a52d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6afc108580 tx=0x7f6ae8009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.928+0000 7f6b01200700 1 -- 172.21.15.2:0/1877707212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 msgr2=0x5603ddaff420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.928+0000 7f6b01200700 1 --2- 172.21.15.2:0/1877707212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 0x5603ddaff420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.928+0000 7f6b01200700 1 -- 172.21.15.2:0/1877707212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 msgr2=0x5603ddb0a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:26.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.928+0000 7f6b01200700 1 --2- 172.21.15.2:0/1877707212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 0x5603ddb0a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.928+0000 7f6b01200700 1 -- 172.21.15.2:0/1877707212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603dd9f7f90 con 0x5603ddaff960 2024-06-13T11:31:26.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.929+0000 7f6b01200700 1 --2- 172.21.15.2:0/1877707212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddaffde0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800e400 tx=0x7f6ae8014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f66cefa0fa207672 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:26.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.929+0000 7f6aeea00700 1 -- 172.21.15.2:0/1877707212 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae800eda0 con 0x5603ddaff960 2024-06-13T11:31:26.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.929+0000 7f6aeea00700 1 -- 172.21.15.2:0/1877707212 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ae8004d10 con 0x5603ddaff960 2024-06-13T11:31:26.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.929+0000 7f6aeea00700 1 -- 172.21.15.2:0/1877707212 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae80266e0 con 0x5603ddaff960 2024-06-13T11:31:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.930+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1877707212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 msgr2=0x5603ddaffde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.930+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/1877707212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddaffde0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800e400 tx=0x7f6ae8014000 comp rx=0 tx=0).stop 2024-06-13T11:31:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.930+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1877707212 shutdown_connections 2024-06-13T11:31:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.930+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/1877707212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 0x5603ddb0a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.930+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/1877707212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 0x5603ddaff420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.930+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/1877707212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddaffde0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.930+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1877707212 >> 172.21.15.2:0/1877707212 conn(0x5603dda2a170 msgr2=0x5603ddaf9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:26.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.930+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1877707212 shutdown_connections 2024-06-13T11:31:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.930+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1877707212 wait complete. 2024-06-13T11:31:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.931+0000 7f6b0ef9cb80 1 -- start start 2024-06-13T11:31:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.931+0000 7f6b0ef9cb80 1 Processor -- start 2024-06-13T11:31:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.931+0000 7f6b0ef9cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 0x5603ddb07d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.931+0000 7f6b0ef9cb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddb05000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.931+0000 7f6b0ef9cb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 0x5603ddb05540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.931+0000 7f6b0ef9cb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5603dd9ebf60 con 0x5603ddb08570 2024-06-13T11:31:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.932+0000 7f6b0ef9cb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5603dda4bac0 con 0x5603ddaff960 2024-06-13T11:31:26.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.932+0000 7f6b0ef9cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5603ddb0b1e0 con 0x5603dda79e40 2024-06-13T11:31:26.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.932+0000 7f6b0ef9cb80 10 client.0 _ll_register_callbacks cb 0x5603dd9e9720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:31:26.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.932+0000 7f6b01c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 0x5603ddb07d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.932+0000 7f6b01c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 0x5603ddb07d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:36970/0 (socket says 172.21.15.2:36970) 2024-06-13T11:31:26.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.932+0000 7f6b01c00700 1 -- 172.21.15.2:0/1239350899 learned_addr learned my addr 172.21.15.2:0/1239350899 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:26.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.932+0000 7f6b02600700 1 --2- 172.21.15.2:0/1239350899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 0x5603ddb05540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.932+0000 7f6b01200700 1 --2- 172.21.15.2:0/1239350899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddb05000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.932+0000 7f6b01c00700 1 -- 172.21.15.2:0/1239350899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 msgr2=0x5603ddb05000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:26.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.932+0000 7f6b01c00700 1 --2- 172.21.15.2:0/1239350899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddb05000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.932+0000 7f6b01c00700 1 -- 172.21.15.2:0/1239350899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 msgr2=0x5603ddb05540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:26.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.932+0000 7f6b01c00700 1 --2- 172.21.15.2:0/1239350899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 0x5603ddb05540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.932+0000 7f6b01c00700 1 -- 172.21.15.2:0/1239350899 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603dd99e8d0 con 0x5603dda79e40 2024-06-13T11:31:26.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.932+0000 7f6b01200700 1 --2- 172.21.15.2:0/1239350899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddb05000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:31:26.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.933+0000 7f6b01c00700 1 --2- 172.21.15.2:0/1239350899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 0x5603ddb07d00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6af00cdfc0 tx=0x7f6af009c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bac97a9517fabc81 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:26.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.933+0000 7f6ae3400700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:31:26.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.933+0000 7f6ae3400700 1 -- 172.21.15.2:0/1239350899 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af00b5060 con 0x5603dda79e40 2024-06-13T11:31:26.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.933+0000 7f6ae3400700 1 -- 172.21.15.2:0/1239350899 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7f6af00d0190 con 0x5603dda79e40 2024-06-13T11:31:26.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.933+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1239350899 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ae8004d10 con 0x5603dda79e40 2024-06-13T11:31:26.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.933+0000 7f6ae3400700 1 -- 172.21.15.2:0/1239350899 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6af0022470 con 0x5603dda79e40 2024-06-13T11:31:26.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.933+0000 7f6b0ef9cb80 10 client.26209 fetch_fsmap learned FSMap version 31 2024-06-13T11:31:26.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.933+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1239350899 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5603ddb15960 con 0x5603dda79e40 2024-06-13T11:31:26.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.933+0000 7f6ae3400700 1 -- 172.21.15.2:0/1239350899 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ae8004d10 con 0x5603dda79e40 2024-06-13T11:31:26.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.934+0000 7f6ae3400700 1 -- 172.21.15.2:0/1239350899 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f6af009db50 con 0x5603dda79e40 2024-06-13T11:31:26.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.934+0000 7f6b0ef9cb80 10 client.26209 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:31:26.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.934+0000 7f6b0ef9cb80 10 client.26209 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:31:26.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.934+0000 7f6b0ef9cb80 20 client.26209 populate_metadata read hostname 'smithi002' 2024-06-13T11:31:26.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.934+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/1239350899 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5603ddb17f70 0x5603ddb1a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.934+0000 7f6b0ef9cb80 4 client.26209 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:31:26.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.934+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1239350899 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603dda5d000 con 0x5603ddb17f70 2024-06-13T11:31:26.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.934+0000 7f6b01200700 1 --2- 172.21.15.2:0/1239350899 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5603ddb17f70 0x5603ddb1a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.935+0000 7f6b01200700 1 --2- 172.21.15.2:0/1239350899 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5603ddb17f70 0x5603ddb1a3a0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d93d2631163c932 server_cookie=4009fa6b9e08addc in_seq=0 out_seq=0 2024-06-13T11:31:26.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.935+0000 7f6ae3400700 10 client.26209 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:31:26.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.936+0000 7f6ae3400700 1 -- 172.21.15.2:0/1239350899 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5603dda5d000 con 0x5603ddb17f70 2024-06-13T11:31:26.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.936+0000 7f6ae3400700 10 client.26209 handle_command_reply: tid=0 2024-06-13T11:31:26.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.936+0000 7f6b0ef9cb80 1 client.26209 shutdown 2024-06-13T11:31:26.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.936+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1239350899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 msgr2=0x5603ddb07d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:26.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.936+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/1239350899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 0x5603ddb07d00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6af00cdfc0 tx=0x7f6af009c720 comp rx=0 tx=0).stop 2024-06-13T11:31:26.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.936+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1239350899 shutdown_connections 2024-06-13T11:31:26.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.936+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/1239350899 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5603ddb17f70 0x5603ddb1a3a0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.936+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/1239350899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 0x5603ddb05540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.936+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/1239350899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 0x5603ddb07d00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.936+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/1239350899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddb05000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.936+0000 7f6ae3400700 0 client.26209 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:31:26.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.936+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1239350899 >> 172.21.15.2:0/1239350899 conn(0x5603dda2a170 msgr2=0x5603ddaf9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:26.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.936+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1239350899 shutdown_connections 2024-06-13T11:31:26.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.936+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1239350899 wait complete. 2024-06-13T11:31:26.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.937+0000 7f6b0ef9cb80 20 client.26209 trim_cache size 0 max 16384 2024-06-13T11:31:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.960+0000 7f6b0ef9cb80 1 Processor -- start 2024-06-13T11:31:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.960+0000 7f6b0ef9cb80 1 -- start start 2024-06-13T11:31:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.960+0000 7f6b0ef9cb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603dda79e40 0x5603ddaf9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.960+0000 7f6b0ef9cb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddb1fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.960+0000 7f6b0ef9cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603ddb08570 0x5603ddb201b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.960+0000 7f6b0ef9cb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc1b7330 con 0x5603dda79e40 2024-06-13T11:31:26.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.960+0000 7f6b0ef9cb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc1b4bc0 con 0x5603ddaff960 2024-06-13T11:31:26.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.960+0000 7f6b0ef9cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc1b2a30 con 0x5603ddb08570 2024-06-13T11:31:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.961+0000 7f6b01c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603dda79e40 0x5603ddaf9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.961+0000 7f6b01c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603dda79e40 0x5603ddaf9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38094/0 (socket says 172.21.15.2:38094) 2024-06-13T11:31:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.961+0000 7f6b01c00700 1 -- 172.21.15.2:0/2185105953 learned_addr learned my addr 172.21.15.2:0/2185105953 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:26.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.961+0000 7f6b01200700 1 --2- 172.21.15.2:0/2185105953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddb1fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.961+0000 7f6b02600700 1 --2- 172.21.15.2:0/2185105953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603ddb08570 0x5603ddb201b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.961+0000 7f6b01c00700 1 -- 172.21.15.2:0/2185105953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603ddb08570 msgr2=0x5603ddb201b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.961+0000 7f6b01c00700 1 --2- 172.21.15.2:0/2185105953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603ddb08570 0x5603ddb201b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.961+0000 7f6b01c00700 1 -- 172.21.15.2:0/2185105953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 msgr2=0x5603ddb1fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.961+0000 7f6b01c00700 1 --2- 172.21.15.2:0/2185105953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddb1fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.961+0000 7f6b01c00700 1 -- 172.21.15.2:0/2185105953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ddb00bc0 con 0x5603dda79e40 2024-06-13T11:31:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.961+0000 7f6b01200700 1 --2- 172.21.15.2:0/2185105953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddb1fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:26.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.961+0000 7f6b01c00700 1 --2- 172.21.15.2:0/2185105953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603dda79e40 0x5603ddaf9960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6af0009990 tx=0x7f6af00cda70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124d9271fc5cff61 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.962+0000 7f6aee000700 1 -- 172.21.15.2:0/2185105953 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af009cf20 con 0x5603dda79e40 2024-06-13T11:31:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.962+0000 7f6aee000700 1 -- 172.21.15.2:0/2185105953 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6af00bb170 con 0x5603dda79e40 2024-06-13T11:31:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.962+0000 7f6aee000700 1 -- 172.21.15.2:0/2185105953 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af009db50 con 0x5603dda79e40 2024-06-13T11:31:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.962+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/2185105953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603dda79e40 msgr2=0x5603ddaf9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.962+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/2185105953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603dda79e40 0x5603ddaf9960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6af0009990 tx=0x7f6af00cda70 comp rx=0 tx=0).stop 2024-06-13T11:31:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.962+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/2185105953 shutdown_connections 2024-06-13T11:31:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.962+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/2185105953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603dda79e40 0x5603ddaf9960 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.962+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/2185105953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603ddb08570 0x5603ddb201b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.962+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/2185105953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddb1fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.962+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/2185105953 >> 172.21.15.2:0/2185105953 conn(0x5603dda2a170 msgr2=0x5603ddb00460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:26.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.962+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/2185105953 shutdown_connections 2024-06-13T11:31:26.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.962+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/2185105953 wait complete. 2024-06-13T11:31:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.963+0000 7f6b0ef9cb80 1 -- start start 2024-06-13T11:31:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.963+0000 7f6b0ef9cb80 1 Processor -- start 2024-06-13T11:31:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b0ef9cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 0x5603ddb0c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b0ef9cb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddb0c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b0ef9cb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 0x5603ddb0ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b0ef9cb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc1b3080 con 0x5603ddb08570 2024-06-13T11:31:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b0ef9cb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc1b44f0 con 0x5603ddaff960 2024-06-13T11:31:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b0ef9cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc1b3750 con 0x5603dda79e40 2024-06-13T11:31:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b0ef9cb80 10 client.0 _ll_register_callbacks cb 0x5603dd9e9720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:31:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b02600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 0x5603ddb0ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b02600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 0x5603ddb0ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38100/0 (socket says 172.21.15.2:38100) 2024-06-13T11:31:26.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b02600700 1 -- 172.21.15.2:0/1597631305 learned_addr learned my addr 172.21.15.2:0/1597631305 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b01c00700 1 --2- 172.21.15.2:0/1597631305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 0x5603ddb0c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b01200700 1 --2- 172.21.15.2:0/1597631305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddb0c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b02600700 1 -- 172.21.15.2:0/1597631305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 msgr2=0x5603ddb0c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b02600700 1 --2- 172.21.15.2:0/1597631305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 0x5603ddb0c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b02600700 1 -- 172.21.15.2:0/1597631305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 msgr2=0x5603ddb0c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b02600700 1 --2- 172.21.15.2:0/1597631305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddb0c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.964+0000 7f6b02600700 1 -- 172.21.15.2:0/1597631305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603ddb81e00 con 0x5603ddb08570 2024-06-13T11:31:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.965+0000 7f6b02600700 1 --2- 172.21.15.2:0/1597631305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 0x5603ddb0ce50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6af4004660 tx=0x7f6af4004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c12c8481de5f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:26.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.965+0000 7f6ae3400700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:31:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.965+0000 7f6ae3400700 1 -- 172.21.15.2:0/1597631305 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af4004db0 con 0x5603ddb08570 2024-06-13T11:31:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.965+0000 7f6ae3400700 1 -- 172.21.15.2:0/1597631305 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7f6af4007b80 con 0x5603ddb08570 2024-06-13T11:31:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.965+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1597631305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6af00bb170 con 0x5603ddb08570 2024-06-13T11:31:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.966+0000 7f6ae3400700 1 -- 172.21.15.2:0/1597631305 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6af4029050 con 0x5603ddb08570 2024-06-13T11:31:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.966+0000 7f6b0ef9cb80 10 client.16071 fetch_fsmap learned FSMap version 31 2024-06-13T11:31:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.966+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1597631305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5603ddb83130 con 0x5603ddb08570 2024-06-13T11:31:26.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.966+0000 7f6ae3400700 1 -- 172.21.15.2:0/1597631305 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6af00bb170 con 0x5603ddb08570 2024-06-13T11:31:26.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.966+0000 7f6ae3400700 1 -- 172.21.15.2:0/1597631305 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f6af4020430 con 0x5603ddb08570 2024-06-13T11:31:26.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.966+0000 7f6b0ef9cb80 10 client.16071 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:31:26.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.966+0000 7f6b0ef9cb80 10 client.16071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:31:26.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.966+0000 7f6b0ef9cb80 20 client.16071 populate_metadata read hostname 'smithi002' 2024-06-13T11:31:26.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.966+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/1597631305 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5603ddb837e0 0x5603ddb85c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:26.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.966+0000 7f6b0ef9cb80 4 client.16071 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:31:26.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.966+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1597631305 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5603dda57580 con 0x5603ddb837e0 2024-06-13T11:31:26.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.967+0000 7f6b01c00700 1 --2- 172.21.15.2:0/1597631305 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5603ddb837e0 0x5603ddb85c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:26.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.967+0000 7f6b01c00700 1 --2- 172.21.15.2:0/1597631305 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5603ddb837e0 0x5603ddb85c00 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26f6b2b480c2b0f1 server_cookie=160b961e4d2bdbf in_seq=0 out_seq=0 2024-06-13T11:31:26.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.967+0000 7f6ae3400700 10 client.16071 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:31:26.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.967+0000 7f6ae3400700 1 -- 172.21.15.2:0/1597631305 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5603dda57580 con 0x5603ddb837e0 2024-06-13T11:31:26.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.967+0000 7f6ae3400700 10 client.16071 handle_command_reply: tid=0 2024-06-13T11:31:26.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.967+0000 7f6b0ef9cb80 1 client.16071 shutdown 2024-06-13T11:31:26.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.968+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1597631305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 msgr2=0x5603ddb0ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:26.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.968+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/1597631305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 0x5603ddb0ce50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6af4004660 tx=0x7f6af4004970 comp rx=0 tx=0).stop 2024-06-13T11:31:26.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.968+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1597631305 shutdown_connections 2024-06-13T11:31:26.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.968+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/1597631305 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5603ddb837e0 0x5603ddb85c00 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.968+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/1597631305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5603ddb08570 0x5603ddb0ce50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.968+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/1597631305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603dda79e40 0x5603ddb0c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.968+0000 7f6b0ef9cb80 1 --2- 172.21.15.2:0/1597631305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603ddaff960 0x5603ddb0c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.968+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1597631305 >> 172.21.15.2:0/1597631305 conn(0x5603dda2a170 msgr2=0x5603ddafd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:26.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.968+0000 7f6ae3400700 0 client.16071 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:31:26.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.968+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1597631305 shutdown_connections 2024-06-13T11:31:26.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.968+0000 7f6b0ef9cb80 1 -- 172.21.15.2:0/1597631305 wait complete. 2024-06-13T11:31:26.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.968+0000 7f6b0ef9cb80 20 client.16071 trim_cache size 0 max 16384 2024-06-13T11:31:26.974 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:31:26.974 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-06-13T11:31:26.974 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-06-13T11:31:26.974 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:31:26.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.969+0000 7f6b03000700 1 -- 172.21.15.2:0/453201821 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6ae40a2e10 msgr2=0x7f6ae40a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:26.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.969+0000 7f6b03000700 1 --2- 172.21.15.2:0/453201821 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6ae40a2e10 0x7f6ae40a52d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6afc108580 tx=0x7f6ae8009260 comp rx=0 tx=0).stop 2024-06-13T11:31:26.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.969+0000 7f6b03000700 1 -- 172.21.15.2:0/453201821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6afc1089d0 msgr2=0x7f6afc19f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:26.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.969+0000 7f6b03000700 1 --2- 172.21.15.2:0/453201821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6afc1089d0 0x7f6afc19f1f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6af0006010 tx=0x7f6af000bab0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.969+0000 7f6b03000700 1 -- 172.21.15.2:0/453201821 shutdown_connections 2024-06-13T11:31:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.969+0000 7f6b03000700 1 --2- 172.21.15.2:0/453201821 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6ae40a2e10 0x7f6ae40a52d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.969+0000 7f6b03000700 1 --2- 172.21.15.2:0/453201821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6afc10d8a0 0x7f6afc1a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.969+0000 7f6b03000700 1 --2- 172.21.15.2:0/453201821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6afc1089d0 0x7f6afc19f1f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.969+0000 7f6b03000700 1 --2- 172.21.15.2:0/453201821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6afc109390 0x7f6afc19f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.969+0000 7f6b03000700 1 -- 172.21.15.2:0/453201821 >> 172.21.15.2:0/453201821 conn(0x7f6afc078220 msgr2=0x7f6afc0788a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.969+0000 7f6b03000700 1 -- 172.21.15.2:0/453201821 shutdown_connections 2024-06-13T11:31:26.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:26.969+0000 7f6b03000700 1 -- 172.21.15.2:0/453201821 wait complete. 2024-06-13T11:31:27.865 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-13T11:31:27.865 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:31:27.940 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:27 smithi002 ceph-mon[32210]: pgmap v235: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:27.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:27 smithi178 ceph-mon[36913]: pgmap v235: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:28.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:27 smithi077 ceph-mon[36410]: pgmap v235: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:28.304 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:31:29.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:29 smithi178 ceph-mon[36913]: pgmap v236: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:31:30.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:29 smithi077 ceph-mon[36410]: pgmap v236: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:31:30.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:29 smithi002 ceph-mon[32210]: pgmap v236: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:31:30.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.740+0000 7f7325800700 1 -- 172.21.15.2:0/2714975448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f732006ab30 msgr2=0x7f732010f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:30.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.740+0000 7f7325800700 1 --2- 172.21.15.2:0/2714975448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f732006ab30 0x7f732010f320 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7318009990 tx=0x7f7318009ca0 comp rx=0 tx=0).stop 2024-06-13T11:31:30.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.740+0000 7f7325800700 1 -- 172.21.15.2:0/2714975448 shutdown_connections 2024-06-13T11:31:30.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.740+0000 7f7325800700 1 --2- 172.21.15.2:0/2714975448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f732006ab30 0x7f732010f320 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:30.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.740+0000 7f7325800700 1 --2- 172.21.15.2:0/2714975448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7320108500 0x7f73201088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:30.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.740+0000 7f7325800700 1 --2- 172.21.15.2:0/2714975448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f732006a170 0x7f732006a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:30.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.740+0000 7f7325800700 1 -- 172.21.15.2:0/2714975448 >> 172.21.15.2:0/2714975448 conn(0x7f7320078340 msgr2=0x7f7320078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:30.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.740+0000 7f7325800700 1 -- 172.21.15.2:0/2714975448 shutdown_connections 2024-06-13T11:31:30.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.740+0000 7f7325800700 1 -- 172.21.15.2:0/2714975448 wait complete. 2024-06-13T11:31:30.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.741+0000 7f7325800700 1 Processor -- start 2024-06-13T11:31:30.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.742+0000 7f7325800700 1 -- start start 2024-06-13T11:31:30.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.742+0000 7f7325800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f732006a170 0x7f732019e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:30.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.742+0000 7f7325800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f732006ab30 0x7f732019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:30.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.742+0000 7f7325800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7320108500 0x7f73201989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:30.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.742+0000 7f7325800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7320112780 con 0x7f7320108500 2024-06-13T11:31:30.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.742+0000 7f7325800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7320112600 con 0x7f732006a170 2024-06-13T11:31:30.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.742+0000 7f7325800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7320112900 con 0x7f732006ab30 2024-06-13T11:31:30.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.742+0000 7f731f400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7320108500 0x7f73201989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:30.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.743+0000 7f731ea00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f732006a170 0x7f732019e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:30.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.743+0000 7f731f400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7320108500 0x7f73201989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38126/0 (socket says 172.21.15.2:38126) 2024-06-13T11:31:30.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.743+0000 7f731f400700 1 -- 172.21.15.2:0/1200808803 learned_addr learned my addr 172.21.15.2:0/1200808803 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:30.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.743+0000 7f7316000700 1 --2- 172.21.15.2:0/1200808803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f732006ab30 0x7f732019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:30.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.743+0000 7f7316000700 1 -- 172.21.15.2:0/1200808803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f732006a170 msgr2=0x7f732019e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:30.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.743+0000 7f7316000700 1 --2- 172.21.15.2:0/1200808803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f732006a170 0x7f732019e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:30.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.743+0000 7f7316000700 1 -- 172.21.15.2:0/1200808803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7320108500 msgr2=0x7f73201989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:30.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.743+0000 7f7316000700 1 --2- 172.21.15.2:0/1200808803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7320108500 0x7f73201989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:30.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.743+0000 7f7316000700 1 -- 172.21.15.2:0/1200808803 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7320199140 con 0x7f732006ab30 2024-06-13T11:31:30.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.743+0000 7f7316000700 1 --2- 172.21.15.2:0/1200808803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f732006ab30 0x7f732019ed60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f730800e9f0 tx=0x7f730800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:30.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.744+0000 7f7317e00700 1 -- 172.21.15.2:0/1200808803 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730800cb70 con 0x7f732006ab30 2024-06-13T11:31:30.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.744+0000 7f7317e00700 1 -- 172.21.15.2:0/1200808803 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f730800ee90 con 0x7f732006ab30 2024-06-13T11:31:30.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.744+0000 7f7317e00700 1 -- 172.21.15.2:0/1200808803 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308003dc0 con 0x7f732006ab30 2024-06-13T11:31:30.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.744+0000 7f7325800700 1 -- 172.21.15.2:0/1200808803 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7320199430 con 0x7f732006ab30 2024-06-13T11:31:30.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.744+0000 7f7325800700 1 -- 172.21.15.2:0/1200808803 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73201a56f0 con 0x7f732006ab30 2024-06-13T11:31:30.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.745+0000 7f7325800700 1 -- 172.21.15.2:0/1200808803 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f732010a9e0 con 0x7f732006ab30 2024-06-13T11:31:30.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.747+0000 7f7317e00700 1 -- 172.21.15.2:0/1200808803 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f7308003fa0 con 0x7f732006ab30 2024-06-13T11:31:30.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.748+0000 7f7317e00700 1 --2- 172.21.15.2:0/1200808803 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f73040a2e10 0x7f73040a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:30.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.748+0000 7f7317e00700 1 -- 172.21.15.2:0/1200808803 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7f73080cf970 con 0x7f732006ab30 2024-06-13T11:31:30.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.749+0000 7f731ea00700 1 --2- 172.21.15.2:0/1200808803 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f73040a2e10 0x7f73040a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:30.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.749+0000 7f731ea00700 1 --2- 172.21.15.2:0/1200808803 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f73040a2e10 0x7f73040a52d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7320199b20 tx=0x7f731000b040 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:30.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:30.753+0000 7f7317e00700 1 -- 172.21.15.2:0/1200808803 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f730809c170 con 0x7f732006ab30 2024-06-13T11:31:31.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:31.040+0000 7f7325800700 1 -- 172.21.15.2:0/1200808803 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7320069180 con 0x7f732006ab30 2024-06-13T11:31:31.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:31.042+0000 7f7317e00700 1 -- 172.21.15.2:0/1200808803 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11853 (secure 0 0 0) 0x7f730809ba70 con 0x7f732006ab30 2024-06-13T11:31:31.041 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:31:31.041 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:29:21.309310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24511,24493,24509]},"id":1}]} 2024-06-13T11:31:31.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:31.045+0000 7f7325800700 1 -- 172.21.15.2:0/1200808803 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f73040a2e10 msgr2=0x7f73040a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:31.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:31.045+0000 7f7325800700 1 --2- 172.21.15.2:0/1200808803 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f73040a2e10 0x7f73040a52d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7320199b20 tx=0x7f731000b040 comp rx=0 tx=0).stop 2024-06-13T11:31:31.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:31.045+0000 7f7325800700 1 -- 172.21.15.2:0/1200808803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f732006ab30 msgr2=0x7f732019ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:31.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:31.045+0000 7f7325800700 1 --2- 172.21.15.2:0/1200808803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f732006ab30 0x7f732019ed60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f730800e9f0 tx=0x7f730800ed00 comp rx=0 tx=0).stop 2024-06-13T11:31:31.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:31.045+0000 7f7325800700 1 -- 172.21.15.2:0/1200808803 shutdown_connections 2024-06-13T11:31:31.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:31.045+0000 7f7325800700 1 --2- 172.21.15.2:0/1200808803 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f73040a2e10 0x7f73040a52d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:31.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:31.045+0000 7f7325800700 1 --2- 172.21.15.2:0/1200808803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7320108500 0x7f73201989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:31.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:31.045+0000 7f7325800700 1 --2- 172.21.15.2:0/1200808803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f732006a170 0x7f732019e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:31.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:31.045+0000 7f7325800700 1 --2- 172.21.15.2:0/1200808803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f732006ab30 0x7f732019ed60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:31.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:31.045+0000 7f7325800700 1 -- 172.21.15.2:0/1200808803 >> 172.21.15.2:0/1200808803 conn(0x7f7320078340 msgr2=0x7f73200fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:31.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:31.045+0000 7f7325800700 1 -- 172.21.15.2:0/1200808803 shutdown_connections 2024-06-13T11:31:31.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:31.046+0000 7f7325800700 1 -- 172.21.15.2:0/1200808803 wait complete. 2024-06-13T11:31:31.046 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 31 2024-06-13T11:31:31.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-13T11:31:32.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:31 smithi002 ceph-mon[32210]: pgmap v237: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:32.016 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:31 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1200808803' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:31:32.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:31 smithi077 ceph-mon[36410]: pgmap v237: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:32.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:31 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1200808803' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:31:32.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:31 smithi178 ceph-mon[36913]: pgmap v237: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:32.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:31 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1200808803' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:31:32.402 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:31:33.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:33 smithi002 ceph-mon[32210]: pgmap v238: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:31:34.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:33 smithi077 ceph-mon[36410]: pgmap v238: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:31:34.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:33 smithi178 ceph-mon[36913]: pgmap v238: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:31:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.983+0000 7f307aa00700 1 -- 172.21.15.2:0/2168810352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30741006e0 msgr2=0x7f3074100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.983+0000 7f307aa00700 1 --2- 172.21.15.2:0/2168810352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30741006e0 0x7f3074100b60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3060009990 tx=0x7f3060009ca0 comp rx=0 tx=0).stop 2024-06-13T11:31:34.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.983+0000 7f307aa00700 1 -- 172.21.15.2:0/2168810352 shutdown_connections 2024-06-13T11:31:34.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.983+0000 7f307aa00700 1 --2- 172.21.15.2:0/2168810352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30741010a0 0x7f307410d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:34.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.983+0000 7f307aa00700 1 --2- 172.21.15.2:0/2168810352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3074106690 0x7f3074106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:34.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.983+0000 7f307aa00700 1 --2- 172.21.15.2:0/2168810352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30741006e0 0x7f3074100b60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:34.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.983+0000 7f307aa00700 1 -- 172.21.15.2:0/2168810352 >> 172.21.15.2:0/2168810352 conn(0x7f3074077590 msgr2=0x7f30740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:34.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.983+0000 7f307aa00700 1 -- 172.21.15.2:0/2168810352 shutdown_connections 2024-06-13T11:31:34.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.983+0000 7f307aa00700 1 -- 172.21.15.2:0/2168810352 wait complete. 2024-06-13T11:31:34.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.985+0000 7f307aa00700 1 Processor -- start 2024-06-13T11:31:34.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.985+0000 7f307aa00700 1 -- start start 2024-06-13T11:31:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.985+0000 7f307aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30741006e0 0x7f30740fca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.985+0000 7f307aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30741010a0 0x7f30740fcf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.985+0000 7f307aa00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3074106690 0x7f30740fd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.986+0000 7f307aa00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30741116e0 con 0x7f30741006e0 2024-06-13T11:31:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.986+0000 7f307aa00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3074111560 con 0x7f3074106690 2024-06-13T11:31:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.986+0000 7f307aa00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3074111860 con 0x7f30741010a0 2024-06-13T11:31:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.986+0000 7f3073e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30741006e0 0x7f30740fca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.986+0000 7f3073e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30741006e0 0x7f30740fca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38136/0 (socket says 172.21.15.2:38136) 2024-06-13T11:31:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.986+0000 7f3073e00700 1 -- 172.21.15.2:0/1054897403 learned_addr learned my addr 172.21.15.2:0/1054897403 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.986+0000 7f3073400700 1 --2- 172.21.15.2:0/1054897403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30741010a0 0x7f30740fcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.986+0000 7f3078a00700 1 --2- 172.21.15.2:0/1054897403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3074106690 0x7f30740fd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:34.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.987+0000 7f3073e00700 1 -- 172.21.15.2:0/1054897403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30741010a0 msgr2=0x7f30740fcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.987+0000 7f3073e00700 1 --2- 172.21.15.2:0/1054897403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30741010a0 0x7f30740fcf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.987+0000 7f3073e00700 1 -- 172.21.15.2:0/1054897403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3074106690 msgr2=0x7f30740fd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.987+0000 7f3073e00700 1 --2- 172.21.15.2:0/1054897403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3074106690 0x7f30740fd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.987+0000 7f3073e00700 1 -- 172.21.15.2:0/1054897403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30741a7230 con 0x7f30741006e0 2024-06-13T11:31:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.987+0000 7f3078a00700 1 --2- 172.21.15.2:0/1054897403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3074106690 0x7f30740fd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.987+0000 7f3073400700 1 --2- 172.21.15.2:0/1054897403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30741010a0 0x7f30740fcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.987+0000 7f3073e00700 1 --2- 172.21.15.2:0/1054897403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30741006e0 0x7f30740fca00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f306400e9a0 tx=0x7f306400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.987+0000 7f3070c00700 1 -- 172.21.15.2:0/1054897403 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306400ca10 con 0x7f30741006e0 2024-06-13T11:31:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.988+0000 7f3070c00700 1 -- 172.21.15.2:0/1054897403 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f306400cbb0 con 0x7f30741006e0 2024-06-13T11:31:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.988+0000 7f307aa00700 1 -- 172.21.15.2:0/1054897403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30741a7520 con 0x7f30741006e0 2024-06-13T11:31:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.988+0000 7f3070c00700 1 -- 172.21.15.2:0/1054897403 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064018680 con 0x7f30741006e0 2024-06-13T11:31:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.988+0000 7f307aa00700 1 -- 172.21.15.2:0/1054897403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30741a7a60 con 0x7f30741006e0 2024-06-13T11:31:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.991+0000 7f3070c00700 1 -- 172.21.15.2:0/1054897403 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f3064010430 con 0x7f30741006e0 2024-06-13T11:31:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.992+0000 7f3070c00700 1 --2- 172.21.15.2:0/1054897403 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f30580a2d90 0x7f30580a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.993+0000 7f30852c7b80 1 Processor -- start 2024-06-13T11:31:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.993+0000 7f3070c00700 1 -- 172.21.15.2:0/1054897403 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7f30640cf990 con 0x7f30741006e0 2024-06-13T11:31:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.993+0000 7f30852c7b80 1 -- start start 2024-06-13T11:31:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.993+0000 7f3073400700 1 --2- 172.21.15.2:0/1054897403 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f30580a2d90 0x7f30580a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.993+0000 7f30852c7b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2b3a0 0x561829b2b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.993+0000 7f30852c7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2bcc0 0x561829b25510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.993+0000 7f30852c7b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 0x561829b25e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.993+0000 7f30852c7b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561829a2ba10 con 0x561829b25a50 2024-06-13T11:31:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.993+0000 7f30852c7b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561829a6eb00 con 0x561829b2b3a0 2024-06-13T11:31:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.993+0000 7f30852c7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561829a298f0 con 0x561829b2bcc0 2024-06-13T11:31:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.994+0000 7f3073e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2b3a0 0x561829b2b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.994+0000 7f3073e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2b3a0 0x561829b2b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:47262/0 (socket says 172.21.15.2:47262) 2024-06-13T11:31:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.994+0000 7f3073e00700 1 -- 172.21.15.2:0/2927176606 learned_addr learned my addr 172.21.15.2:0/2927176606 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.994+0000 7f3078a00700 1 --2- 172.21.15.2:0/2927176606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 0x561829b25e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.994+0000 7f3073400700 1 --2- 172.21.15.2:0/1054897403 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f30580a2d90 0x7f30580a5250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f30740ffcb0 tx=0x7f306000b260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.994+0000 7f3073400700 1 --2- 172.21.15.2:0/2927176606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2bcc0 0x561829b25510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.994+0000 7f3073e00700 1 -- 172.21.15.2:0/2927176606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2bcc0 msgr2=0x561829b25510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.994+0000 7f3073e00700 1 --2- 172.21.15.2:0/2927176606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2bcc0 0x561829b25510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.994+0000 7f3073e00700 1 -- 172.21.15.2:0/2927176606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 msgr2=0x561829b25e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.994+0000 7f3073e00700 1 --2- 172.21.15.2:0/2927176606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 0x561829b25e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.994+0000 7f3073e00700 1 -- 172.21.15.2:0/2927176606 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561829a16f90 con 0x561829b2b3a0 2024-06-13T11:31:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.994+0000 7f3073400700 1 --2- 172.21.15.2:0/2927176606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2bcc0 0x561829b25510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:31:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.995+0000 7f3073e00700 1 --2- 172.21.15.2:0/2927176606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2b3a0 0x561829b2b780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3064009230 tx=0x7f306409ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cab5c9391e87b5e5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.995+0000 7f3069600700 1 -- 172.21.15.2:0/2927176606 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30640a4700 con 0x561829b2b3a0 2024-06-13T11:31:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.995+0000 7f3069600700 1 -- 172.21.15.2:0/2927176606 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3064099d90 con 0x561829b2b3a0 2024-06-13T11:31:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.995+0000 7f3069600700 1 -- 172.21.15.2:0/2927176606 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064010980 con 0x561829b2b3a0 2024-06-13T11:31:34.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.996+0000 7f30852c7b80 1 -- 172.21.15.2:0/2927176606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2b3a0 msgr2=0x561829b2b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:34.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.996+0000 7f30852c7b80 1 --2- 172.21.15.2:0/2927176606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2b3a0 0x561829b2b780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3064009230 tx=0x7f306409ba90 comp rx=0 tx=0).stop 2024-06-13T11:31:34.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.996+0000 7f30852c7b80 1 -- 172.21.15.2:0/2927176606 shutdown_connections 2024-06-13T11:31:35.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.996+0000 7f30852c7b80 1 --2- 172.21.15.2:0/2927176606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 0x561829b25e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.996+0000 7f30852c7b80 1 --2- 172.21.15.2:0/2927176606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2b3a0 0x561829b2b780 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.996+0000 7f30852c7b80 1 --2- 172.21.15.2:0/2927176606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2bcc0 0x561829b25510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.996+0000 7f30852c7b80 1 -- 172.21.15.2:0/2927176606 >> 172.21.15.2:0/2927176606 conn(0x561829a49170 msgr2=0x561829b17ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:35.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.996+0000 7f30852c7b80 1 -- 172.21.15.2:0/2927176606 shutdown_connections 2024-06-13T11:31:35.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.996+0000 7f30852c7b80 1 -- 172.21.15.2:0/2927176606 wait complete. 2024-06-13T11:31:35.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.997+0000 7f30852c7b80 1 -- start start 2024-06-13T11:31:35.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.997+0000 7f30852c7b80 1 Processor -- start 2024-06-13T11:31:35.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.997+0000 7f30852c7b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b25a50 0x561829b31b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:35.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.997+0000 7f30852c7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2b3a0 0x561829b2ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:35.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.997+0000 7f30852c7b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b2bcc0 0x561829b2f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:35.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.997+0000 7f30852c7b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561829a0af60 con 0x561829b2bcc0 2024-06-13T11:31:35.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.997+0000 7f30852c7b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561829a6aac0 con 0x561829b25a50 2024-06-13T11:31:35.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.997+0000 7f30852c7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561829b326a0 con 0x561829b2b3a0 2024-06-13T11:31:35.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.997+0000 7f30852c7b80 10 client.0 _ll_register_callbacks cb 0x561829a04380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:31:35.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.998+0000 7f3078a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b2bcc0 0x561829b2f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:35.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.998+0000 7f3078a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b2bcc0 0x561829b2f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38150/0 (socket says 172.21.15.2:38150) 2024-06-13T11:31:35.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.998+0000 7f3078a00700 1 -- 172.21.15.2:0/2872062680 learned_addr learned my addr 172.21.15.2:0/2872062680 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:35.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.998+0000 7f3073e00700 1 --2- 172.21.15.2:0/2872062680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b25a50 0x561829b31b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:35.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.998+0000 7f3073400700 1 --2- 172.21.15.2:0/2872062680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2b3a0 0x561829b2ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:35.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.998+0000 7f3073e00700 1 -- 172.21.15.2:0/2872062680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2b3a0 msgr2=0x561829b2ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:35.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.998+0000 7f3073e00700 1 --2- 172.21.15.2:0/2872062680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2b3a0 0x561829b2ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.998+0000 7f3073e00700 1 -- 172.21.15.2:0/2872062680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b2bcc0 msgr2=0x561829b2f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:35.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.998+0000 7f3073e00700 1 --2- 172.21.15.2:0/2872062680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b2bcc0 0x561829b2f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.998+0000 7f3073e00700 1 -- 172.21.15.2:0/2872062680 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618299bd8d0 con 0x561829b25a50 2024-06-13T11:31:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.998+0000 7f3078a00700 1 --2- 172.21.15.2:0/2872062680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b2bcc0 0x561829b2f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.999+0000 7f3073e00700 1 --2- 172.21.15.2:0/2872062680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b25a50 0x561829b31b00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3064009230 tx=0x7f306400c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b034075d8ee57a7 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.999+0000 7f305e000700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:31:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.999+0000 7f305e000700 1 -- 172.21.15.2:0/2872062680 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064010920 con 0x561829b25a50 2024-06-13T11:31:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.999+0000 7f305e000700 1 -- 172.21.15.2:0/2872062680 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7f306409aee0 con 0x561829b25a50 2024-06-13T11:31:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.999+0000 7f30852c7b80 1 -- 172.21.15.2:0/2872062680 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3064099d90 con 0x561829b25a50 2024-06-13T11:31:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.999+0000 7f305e000700 1 -- 172.21.15.2:0/2872062680 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f306409b0e0 con 0x561829b25a50 2024-06-13T11:31:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.999+0000 7f30852c7b80 10 client.26192 fetch_fsmap learned FSMap version 31 2024-06-13T11:31:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.999+0000 7f30852c7b80 1 -- 172.21.15.2:0/2872062680 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561829b3cde0 con 0x561829b25a50 2024-06-13T11:31:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:34.999+0000 7f305e000700 1 -- 172.21.15.2:0/2872062680 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3064099d90 con 0x561829b25a50 2024-06-13T11:31:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.000+0000 7f305e000700 1 -- 172.21.15.2:0/2872062680 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f306409aae0 con 0x561829b25a50 2024-06-13T11:31:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.000+0000 7f30852c7b80 10 client.26192 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:31:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.000+0000 7f30852c7b80 10 client.26192 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:31:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.000+0000 7f30852c7b80 20 client.26192 populate_metadata read hostname 'smithi002' 2024-06-13T11:31:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.000+0000 7f30852c7b80 1 --2- 172.21.15.2:0/2872062680 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x561829b3f2b0 0x561829b416a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.000+0000 7f30852c7b80 4 client.26192 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:31:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.000+0000 7f30852c7b80 1 -- 172.21.15.2:0/2872062680 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561829a7c000 con 0x561829b3f2b0 2024-06-13T11:31:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.000+0000 7f3073400700 1 --2- 172.21.15.2:0/2872062680 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x561829b3f2b0 0x561829b416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.001+0000 7f3073400700 1 --2- 172.21.15.2:0/2872062680 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x561829b3f2b0 0x561829b416a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1a8e62b709ac8aca server_cookie=c3c9caff5b388407 in_seq=0 out_seq=0 2024-06-13T11:31:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.001+0000 7f305e000700 10 client.26192 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:31:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.002+0000 7f305e000700 1 -- 172.21.15.2:0/2872062680 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561829a7c000 con 0x561829b3f2b0 2024-06-13T11:31:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.002+0000 7f305e000700 10 client.26192 handle_command_reply: tid=0 2024-06-13T11:31:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.002+0000 7f30852c7b80 1 client.26192 shutdown 2024-06-13T11:31:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.002+0000 7f30852c7b80 1 -- 172.21.15.2:0/2872062680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b25a50 msgr2=0x561829b31b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.002+0000 7f30852c7b80 1 --2- 172.21.15.2:0/2872062680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b25a50 0x561829b31b00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3064009230 tx=0x7f306400c400 comp rx=0 tx=0).stop 2024-06-13T11:31:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.002+0000 7f30852c7b80 1 -- 172.21.15.2:0/2872062680 shutdown_connections 2024-06-13T11:31:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.002+0000 7f30852c7b80 1 --2- 172.21.15.2:0/2872062680 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x561829b3f2b0 0x561829b416a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.003+0000 7f30852c7b80 1 --2- 172.21.15.2:0/2872062680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b2bcc0 0x561829b2f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.003+0000 7f305e000700 0 client.26192 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:31:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.003+0000 7f30852c7b80 1 --2- 172.21.15.2:0/2872062680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b25a50 0x561829b31b00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.003+0000 7f30852c7b80 1 --2- 172.21.15.2:0/2872062680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2b3a0 0x561829b2ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.003+0000 7f30852c7b80 1 -- 172.21.15.2:0/2872062680 >> 172.21.15.2:0/2872062680 conn(0x561829a49170 msgr2=0x561829b11790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.003+0000 7f30852c7b80 1 -- 172.21.15.2:0/2872062680 shutdown_connections 2024-06-13T11:31:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.003+0000 7f30852c7b80 1 -- 172.21.15.2:0/2872062680 wait complete. 2024-06-13T11:31:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.003+0000 7f30852c7b80 20 client.26192 trim_cache size 0 max 16384 2024-06-13T11:31:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.020+0000 7f30852c7b80 1 Processor -- start 2024-06-13T11:31:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.020+0000 7f30852c7b80 1 -- start start 2024-06-13T11:31:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.021+0000 7f30852c7b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 0x561829b12130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.021+0000 7f30852c7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2b3a0 0x561829b2dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.021+0000 7f30852c7b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2bcc0 0x561829b31640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.021+0000 7f30852c7b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30741aee20 con 0x561829b25a50 2024-06-13T11:31:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.021+0000 7f30852c7b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f30741ac6b0 con 0x561829b2bcc0 2024-06-13T11:31:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.021+0000 7f30852c7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f30741aa540 con 0x561829b2b3a0 2024-06-13T11:31:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.021+0000 7f3073e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 0x561829b12130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.021+0000 7f3073e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 0x561829b12130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38154/0 (socket says 172.21.15.2:38154) 2024-06-13T11:31:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.021+0000 7f3073e00700 1 -- 172.21.15.2:0/2902647950 learned_addr learned my addr 172.21.15.2:0/2902647950 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.021+0000 7f3078a00700 1 --2- 172.21.15.2:0/2902647950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2bcc0 0x561829b31640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.021+0000 7f3073400700 1 --2- 172.21.15.2:0/2902647950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2b3a0 0x561829b2dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.022+0000 7f3073e00700 1 -- 172.21.15.2:0/2902647950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2b3a0 msgr2=0x561829b2dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.022+0000 7f3073e00700 1 --2- 172.21.15.2:0/2902647950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2b3a0 0x561829b2dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.022+0000 7f3073e00700 1 -- 172.21.15.2:0/2902647950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2bcc0 msgr2=0x561829b31640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.022+0000 7f3073e00700 1 --2- 172.21.15.2:0/2902647950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2bcc0 0x561829b31640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.022+0000 7f3073e00700 1 -- 172.21.15.2:0/2902647950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561829b2d370 con 0x561829b25a50 2024-06-13T11:31:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.022+0000 7f3078a00700 1 --2- 172.21.15.2:0/2902647950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2bcc0 0x561829b31640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.022+0000 7f3073e00700 1 --2- 172.21.15.2:0/2902647950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 0x561829b12130 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f306400e970 tx=0x7f3064009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ad4837920b9b5a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.022+0000 7f3068c00700 1 -- 172.21.15.2:0/2902647950 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064097d30 con 0x561829b25a50 2024-06-13T11:31:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.022+0000 7f3068c00700 1 -- 172.21.15.2:0/2902647950 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f306409ba90 con 0x561829b25a50 2024-06-13T11:31:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.022+0000 7f3068c00700 1 -- 172.21.15.2:0/2902647950 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064010980 con 0x561829b25a50 2024-06-13T11:31:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.023+0000 7f30852c7b80 1 -- 172.21.15.2:0/2902647950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 msgr2=0x561829b12130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.023+0000 7f30852c7b80 1 --2- 172.21.15.2:0/2902647950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 0x561829b12130 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f306400e970 tx=0x7f3064009790 comp rx=0 tx=0).stop 2024-06-13T11:31:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.023+0000 7f30852c7b80 1 -- 172.21.15.2:0/2902647950 shutdown_connections 2024-06-13T11:31:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.023+0000 7f30852c7b80 1 --2- 172.21.15.2:0/2902647950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 0x561829b12130 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.023+0000 7f30852c7b80 1 --2- 172.21.15.2:0/2902647950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2bcc0 0x561829b31640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.023+0000 7f30852c7b80 1 --2- 172.21.15.2:0/2902647950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2b3a0 0x561829b2dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.023+0000 7f30852c7b80 1 -- 172.21.15.2:0/2902647950 >> 172.21.15.2:0/2902647950 conn(0x561829a49170 msgr2=0x561829b2d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.023+0000 7f30852c7b80 1 -- 172.21.15.2:0/2902647950 shutdown_connections 2024-06-13T11:31:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.023+0000 7f30852c7b80 1 -- 172.21.15.2:0/2902647950 wait complete. 2024-06-13T11:31:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.024+0000 7f30852c7b80 1 -- start start 2024-06-13T11:31:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.024+0000 7f30852c7b80 1 Processor -- start 2024-06-13T11:31:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.024+0000 7f30852c7b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 0x561829b41480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f30852c7b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2b3a0 0x561829b419c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f30852c7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2bcc0 0x561829b41f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f30852c7b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f30741aab90 con 0x561829b25a50 2024-06-13T11:31:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f30852c7b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f30741abfe0 con 0x561829b2b3a0 2024-06-13T11:31:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f30852c7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f30741ab240 con 0x561829b2bcc0 2024-06-13T11:31:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f30852c7b80 10 client.0 _ll_register_callbacks cb 0x561829a04380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:31:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f3073e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 0x561829b41480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f3073400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2b3a0 0x561829b419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f3073e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 0x561829b41480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38156/0 (socket says 172.21.15.2:38156) 2024-06-13T11:31:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f3073400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2b3a0 0x561829b419c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:47280/0 (socket says 172.21.15.2:47280) 2024-06-13T11:31:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f3073e00700 1 -- 172.21.15.2:0/1939810344 learned_addr learned my addr 172.21.15.2:0/1939810344 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f3078a00700 1 --2- 172.21.15.2:0/1939810344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2bcc0 0x561829b41f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f3073400700 1 -- 172.21.15.2:0/1939810344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2bcc0 msgr2=0x561829b41f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f3073400700 1 --2- 172.21.15.2:0/1939810344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2bcc0 0x561829b41f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f3073400700 1 -- 172.21.15.2:0/1939810344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 msgr2=0x561829b41480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f3073400700 1 --2- 172.21.15.2:0/1939810344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 0x561829b41480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f3073400700 1 -- 172.21.15.2:0/1939810344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561829ba7be0 con 0x561829b2b3a0 2024-06-13T11:31:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.025+0000 7f3078a00700 1 --2- 172.21.15.2:0/1939810344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2bcc0 0x561829b41f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:31:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.026+0000 7f3073400700 1 --2- 172.21.15.2:0/1939810344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2b3a0 0x561829b419c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3060006010 tx=0x7f3060009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=749bc2dc69bee918 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.026+0000 7f305e000700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:31:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.026+0000 7f305e000700 1 -- 172.21.15.2:0/1939810344 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3060003c70 con 0x561829b2b3a0 2024-06-13T11:31:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.026+0000 7f30852c7b80 1 -- 172.21.15.2:0/1939810344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f306409ba90 con 0x561829b2b3a0 2024-06-13T11:31:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.026+0000 7f305e000700 1 -- 172.21.15.2:0/1939810344 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7f306000f460 con 0x561829b2b3a0 2024-06-13T11:31:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.026+0000 7f305e000700 1 -- 172.21.15.2:0/1939810344 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3060045050 con 0x561829b2b3a0 2024-06-13T11:31:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.026+0000 7f30852c7b80 10 client.26198 fetch_fsmap learned FSMap version 31 2024-06-13T11:31:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.026+0000 7f30852c7b80 1 -- 172.21.15.2:0/1939810344 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561829ba8e90 con 0x561829b2b3a0 2024-06-13T11:31:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.027+0000 7f305e000700 1 -- 172.21.15.2:0/1939810344 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f306409ba90 con 0x561829b2b3a0 2024-06-13T11:31:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.027+0000 7f305e000700 1 -- 172.21.15.2:0/1939810344 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f3060032670 con 0x561829b2b3a0 2024-06-13T11:31:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.027+0000 7f30852c7b80 10 client.26198 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:31:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.027+0000 7f30852c7b80 10 client.26198 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:31:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.027+0000 7f30852c7b80 20 client.26198 populate_metadata read hostname 'smithi002' 2024-06-13T11:31:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.027+0000 7f30852c7b80 1 --2- 172.21.15.2:0/1939810344 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x561829ba9550 0x561829bab970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.027+0000 7f30852c7b80 4 client.26198 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:31:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.027+0000 7f30852c7b80 1 -- 172.21.15.2:0/1939810344 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561829a76580 con 0x561829ba9550 2024-06-13T11:31:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.028+0000 7f3073e00700 1 --2- 172.21.15.2:0/1939810344 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x561829ba9550 0x561829bab970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.028+0000 7f3073e00700 1 --2- 172.21.15.2:0/1939810344 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x561829ba9550 0x561829bab970 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c549947a2e42b41f server_cookie=7e401187c77f730f in_seq=0 out_seq=0 2024-06-13T11:31:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.028+0000 7f305e000700 10 client.26198 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:31:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.028+0000 7f305e000700 1 -- 172.21.15.2:0/1939810344 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561829a76580 con 0x561829ba9550 2024-06-13T11:31:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.028+0000 7f305e000700 10 client.26198 handle_command_reply: tid=0 2024-06-13T11:31:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.028+0000 7f30852c7b80 1 client.26198 shutdown 2024-06-13T11:31:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.029+0000 7f30852c7b80 1 -- 172.21.15.2:0/1939810344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2b3a0 msgr2=0x561829b419c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.029+0000 7f30852c7b80 1 --2- 172.21.15.2:0/1939810344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2b3a0 0x561829b419c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3060006010 tx=0x7f3060009ca0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.029+0000 7f30852c7b80 1 -- 172.21.15.2:0/1939810344 shutdown_connections 2024-06-13T11:31:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.029+0000 7f30852c7b80 1 --2- 172.21.15.2:0/1939810344 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x561829ba9550 0x561829bab970 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.029+0000 7f30852c7b80 1 --2- 172.21.15.2:0/1939810344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561829b25a50 0x561829b41480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.029+0000 7f30852c7b80 1 --2- 172.21.15.2:0/1939810344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561829b2bcc0 0x561829b41f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.029+0000 7f30852c7b80 1 --2- 172.21.15.2:0/1939810344 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561829b2b3a0 0x561829b419c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.029+0000 7f30852c7b80 1 -- 172.21.15.2:0/1939810344 >> 172.21.15.2:0/1939810344 conn(0x561829a49170 msgr2=0x561829b1c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.029+0000 7f305e000700 0 client.26198 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:31:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.029+0000 7f30852c7b80 1 -- 172.21.15.2:0/1939810344 shutdown_connections 2024-06-13T11:31:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.029+0000 7f30852c7b80 1 -- 172.21.15.2:0/1939810344 wait complete. 2024-06-13T11:31:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.029+0000 7f30852c7b80 20 client.26198 trim_cache size 0 max 16384 2024-06-13T11:31:35.035 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:31:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.030+0000 7f307aa00700 1 -- 172.21.15.2:0/1054897403 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f30580a2d90 msgr2=0x7f30580a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.030+0000 7f307aa00700 1 --2- 172.21.15.2:0/1054897403 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f30580a2d90 0x7f30580a5250 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f30740ffcb0 tx=0x7f306000b260 comp rx=0 tx=0).stop 2024-06-13T11:31:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.030+0000 7f307aa00700 1 -- 172.21.15.2:0/1054897403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30741006e0 msgr2=0x7f30740fca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.030+0000 7f307aa00700 1 --2- 172.21.15.2:0/1054897403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30741006e0 0x7f30740fca00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f306400e9a0 tx=0x7f306400ecb0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.030+0000 7f307aa00700 1 -- 172.21.15.2:0/1054897403 shutdown_connections 2024-06-13T11:31:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.030+0000 7f307aa00700 1 --2- 172.21.15.2:0/1054897403 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f30580a2d90 0x7f30580a5250 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.030+0000 7f307aa00700 1 --2- 172.21.15.2:0/1054897403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30741006e0 0x7f30740fca00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.030+0000 7f307aa00700 1 --2- 172.21.15.2:0/1054897403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3074106690 0x7f30740fd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.030+0000 7f307aa00700 1 --2- 172.21.15.2:0/1054897403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30741010a0 0x7f30740fcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.030+0000 7f307aa00700 1 -- 172.21.15.2:0/1054897403 >> 172.21.15.2:0/1054897403 conn(0x7f3074077590 msgr2=0x7f307410eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.030+0000 7f307aa00700 1 -- 172.21.15.2:0/1054897403 shutdown_connections 2024-06-13T11:31:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:35.030+0000 7f307aa00700 1 -- 172.21.15.2:0/1054897403 wait complete. 2024-06-13T11:31:35.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:35 smithi002 ceph-mon[32210]: pgmap v239: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:36.039 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-13T11:31:36.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:35 smithi077 ceph-mon[36410]: pgmap v239: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:36.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:35 smithi178 ceph-mon[36913]: pgmap v239: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:31:38.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:37 smithi077 ceph-mon[36410]: pgmap v240: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:38.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:37 smithi002 ceph-mon[32210]: pgmap v240: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:38.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:37 smithi178 ceph-mon[36913]: pgmap v240: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:38.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.788+0000 7fda0fe00700 1 -- 172.21.15.2:0/1829082405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda08113660 msgr2=0x7fda08115a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:38.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.788+0000 7fda0fe00700 1 --2- 172.21.15.2:0/1829082405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda08113660 0x7fda08115a50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fda00009990 tx=0x7fda00009ca0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.788+0000 7fda0fe00700 1 -- 172.21.15.2:0/1829082405 shutdown_connections 2024-06-13T11:31:38.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.788+0000 7fda0fe00700 1 --2- 172.21.15.2:0/1829082405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda08113660 0x7fda08115a50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.788+0000 7fda0fe00700 1 --2- 172.21.15.2:0/1829082405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda080746c0 0x7fda08074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.788+0000 7fda0fe00700 1 --2- 172.21.15.2:0/1829082405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda08074fe0 0x7fda08113120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.788+0000 7fda0fe00700 1 -- 172.21.15.2:0/1829082405 >> 172.21.15.2:0/1829082405 conn(0x7fda080795f0 msgr2=0x7fda08079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:38.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.788+0000 7fda0fe00700 1 -- 172.21.15.2:0/1829082405 shutdown_connections 2024-06-13T11:31:38.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.788+0000 7fda0fe00700 1 -- 172.21.15.2:0/1829082405 wait complete. 2024-06-13T11:31:38.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.789+0000 7fda0fe00700 1 Processor -- start 2024-06-13T11:31:38.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.790+0000 7fda0fe00700 1 -- start start 2024-06-13T11:31:38.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.790+0000 7fda0fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda080746c0 0x7fda0819f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.790+0000 7fda0fe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda08074fe0 0x7fda0819f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.790+0000 7fda0fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda08113660 0x7fda081a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.790+0000 7fda0fe00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fda08118d80 con 0x7fda08113660 2024-06-13T11:31:38.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.790+0000 7fda0fe00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fda08118c00 con 0x7fda08074fe0 2024-06-13T11:31:38.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.790+0000 7fda0fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fda08118f00 con 0x7fda080746c0 2024-06-13T11:31:38.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.790+0000 7fda0d400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda080746c0 0x7fda0819f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.790+0000 7fda0ca00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda08074fe0 0x7fda0819f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.790+0000 7fda0d400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda080746c0 0x7fda0819f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:44024/0 (socket says 172.21.15.2:44024) 2024-06-13T11:31:38.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.791+0000 7fda0d400700 1 -- 172.21.15.2:0/2948101521 learned_addr learned my addr 172.21.15.2:0/2948101521 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:38.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.790+0000 7fda0de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda08113660 0x7fda081a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.791+0000 7fda0d400700 1 -- 172.21.15.2:0/2948101521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda08074fe0 msgr2=0x7fda0819f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:38.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.791+0000 7fda0d400700 1 --2- 172.21.15.2:0/2948101521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda08074fe0 0x7fda0819f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.791+0000 7fda0d400700 1 -- 172.21.15.2:0/2948101521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda08113660 msgr2=0x7fda081a3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:38.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.791+0000 7fda0d400700 1 --2- 172.21.15.2:0/2948101521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda08113660 0x7fda081a3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.791+0000 7fda0d400700 1 -- 172.21.15.2:0/2948101521 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda081a4180 con 0x7fda080746c0 2024-06-13T11:31:38.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.791+0000 7fda0ca00700 1 --2- 172.21.15.2:0/2948101521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda08074fe0 0x7fda0819f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:38.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.791+0000 7fda0d400700 1 --2- 172.21.15.2:0/2948101521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda080746c0 0x7fda0819f170 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00ef10 tx=0x7fd9fc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:38.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.792+0000 7fda06000700 1 -- 172.21.15.2:0/2948101521 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc00c9c0 con 0x7fda080746c0 2024-06-13T11:31:38.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.792+0000 7fda0fe00700 1 -- 172.21.15.2:0/2948101521 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda081a4410 con 0x7fda080746c0 2024-06-13T11:31:38.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.792+0000 7fda06000700 1 -- 172.21.15.2:0/2948101521 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9fc019070 con 0x7fda080746c0 2024-06-13T11:31:38.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.792+0000 7fda06000700 1 -- 172.21.15.2:0/2948101521 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc007e60 con 0x7fda080746c0 2024-06-13T11:31:38.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.792+0000 7fda0fe00700 1 -- 172.21.15.2:0/2948101521 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda081abcf0 con 0x7fda080746c0 2024-06-13T11:31:38.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.795+0000 7fda06000700 1 -- 172.21.15.2:0/2948101521 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fd9fc012050 con 0x7fda080746c0 2024-06-13T11:31:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.796+0000 7fda06000700 1 --2- 172.21.15.2:0/2948101521 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9f00a2e10 0x7fd9f00a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.797+0000 7fda1a6d4b80 1 Processor -- start 2024-06-13T11:31:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.797+0000 7fda06000700 1 -- 172.21.15.2:0/2948101521 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7fd9fc0cf740 con 0x7fda080746c0 2024-06-13T11:31:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.797+0000 7fda0ca00700 1 --2- 172.21.15.2:0/2948101521 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9f00a2e10 0x7fd9f00a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.797+0000 7fda1a6d4b80 1 -- start start 2024-06-13T11:31:38.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.797+0000 7fda1a6d4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 0x55f5005ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.798+0000 7fda1a6d4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 0x55f5005aea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.798+0000 7fda1a6d4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005b9300 0x55f5005bb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.798+0000 7fda1a6d4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f5004bda10 con 0x55f50052ae40 2024-06-13T11:31:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.798+0000 7fda1a6d4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f500500b00 con 0x55f5005ae5b0 2024-06-13T11:31:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.798+0000 7fda1a6d4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f5004bb8f0 con 0x55f5005b9300 2024-06-13T11:31:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.798+0000 7fda0ca00700 1 --2- 172.21.15.2:0/2948101521 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9f00a2e10 0x7fd9f00a52d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fda0810fe90 tx=0x7fd9f4009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:38.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.798+0000 7fda0d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 0x55f5005ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.798+0000 7fda0ca00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 0x55f5005aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.798+0000 7fda0ca00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 0x55f5005aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:35078/0 (socket says 172.21.15.2:35078) 2024-06-13T11:31:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.798+0000 7fda0d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 0x55f5005ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49062/0 (socket says 172.21.15.2:49062) 2024-06-13T11:31:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.798+0000 7fda0ca00700 1 -- 172.21.15.2:0/2185827430 learned_addr learned my addr 172.21.15.2:0/2185827430 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.798+0000 7fda0de00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005b9300 0x55f5005bb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.798+0000 7fda0ca00700 1 -- 172.21.15.2:0/2185827430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005b9300 msgr2=0x55f5005bb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.798+0000 7fda0ca00700 1 --2- 172.21.15.2:0/2185827430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005b9300 0x55f5005bb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.798+0000 7fda0ca00700 1 -- 172.21.15.2:0/2185827430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 msgr2=0x55f5005ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:38.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.798+0000 7fda0ca00700 1 --2- 172.21.15.2:0/2185827430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 0x55f5005ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.799+0000 7fda0ca00700 1 -- 172.21.15.2:0/2185827430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5004a8f90 con 0x55f5005ae5b0 2024-06-13T11:31:38.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.799+0000 7fda0de00700 1 --2- 172.21.15.2:0/2185827430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005b9300 0x55f5005bb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:38.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.799+0000 7fda0ca00700 1 --2- 172.21.15.2:0/2185827430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 0x55f5005aea30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400e6f0 tx=0x7fd9f4014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eed3290b170e03b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:38.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.799+0000 7fd9faa00700 1 -- 172.21.15.2:0/2185827430 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4026600 con 0x55f5005ae5b0 2024-06-13T11:31:38.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.799+0000 7fd9faa00700 1 -- 172.21.15.2:0/2185827430 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9f4026c80 con 0x55f5005ae5b0 2024-06-13T11:31:38.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.799+0000 7fd9faa00700 1 -- 172.21.15.2:0/2185827430 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f401ed20 con 0x55f5005ae5b0 2024-06-13T11:31:38.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.800+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/2185827430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 msgr2=0x55f5005aea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:38.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.800+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/2185827430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 0x55f5005aea30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400e6f0 tx=0x7fd9f4014000 comp rx=0 tx=0).stop 2024-06-13T11:31:38.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.800+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/2185827430 shutdown_connections 2024-06-13T11:31:38.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.800+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/2185827430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 0x55f5005ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.800+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/2185827430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005b9300 0x55f5005bb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.800+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/2185827430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 0x55f5005aea30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.800+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/2185827430 >> 172.21.15.2:0/2185827430 conn(0x55f5004db170 msgr2=0x55f5005aa4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:38.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.800+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/2185827430 shutdown_connections 2024-06-13T11:31:38.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.800+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/2185827430 wait complete. 2024-06-13T11:31:38.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.801+0000 7fda1a6d4b80 1 -- start start 2024-06-13T11:31:38.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.801+0000 7fda1a6d4b80 1 Processor -- start 2024-06-13T11:31:38.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.802+0000 7fda1a6d4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f50052ae40 0x55f5005b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.802+0000 7fda1a6d4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 0x55f5005b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.802+0000 7fda1a6d4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5005b9300 0x55f5005b6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.802+0000 7fda1a6d4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f50049cf60 con 0x55f5005b9300 2024-06-13T11:31:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.802+0000 7fda1a6d4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f5004fcac0 con 0x55f5005ae5b0 2024-06-13T11:31:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.802+0000 7fda1a6d4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f5005bbfc0 con 0x55f50052ae40 2024-06-13T11:31:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.802+0000 7fda1a6d4b80 10 client.0 _ll_register_callbacks cb 0x55f50049a720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:31:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.802+0000 7fda0d400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f50052ae40 0x55f5005b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.802+0000 7fda0d400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f50052ae40 0x55f5005b8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:44052/0 (socket says 172.21.15.2:44052) 2024-06-13T11:31:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.802+0000 7fda0d400700 1 -- 172.21.15.2:0/469556294 learned_addr learned my addr 172.21.15.2:0/469556294 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.802+0000 7fda0de00700 1 --2- 172.21.15.2:0/469556294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5005b9300 0x55f5005b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.802+0000 7fda0ca00700 1 --2- 172.21.15.2:0/469556294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 0x55f5005b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.803+0000 7fda0d400700 1 -- 172.21.15.2:0/469556294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 msgr2=0x55f5005b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:38.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.803+0000 7fda0d400700 1 --2- 172.21.15.2:0/469556294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 0x55f5005b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.803+0000 7fda0d400700 1 -- 172.21.15.2:0/469556294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5005b9300 msgr2=0x55f5005b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:38.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.803+0000 7fda0d400700 1 --2- 172.21.15.2:0/469556294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5005b9300 0x55f5005b6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.803+0000 7fda0d400700 1 -- 172.21.15.2:0/469556294 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f50044f8d0 con 0x55f50052ae40 2024-06-13T11:31:38.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.803+0000 7fda0de00700 1 --2- 172.21.15.2:0/469556294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5005b9300 0x55f5005b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:31:38.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.803+0000 7fda0ca00700 1 --2- 172.21.15.2:0/469556294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 0x55f5005b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:31:38.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.803+0000 7fda0d400700 1 --2- 172.21.15.2:0/469556294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f50052ae40 0x55f5005b8ae0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc09b540 tx=0x7fd9fc09c070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=311f1b811e14bfd server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:38.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.803+0000 7fd9ef400700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:31:38.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.803+0000 7fd9ef400700 1 -- 172.21.15.2:0/469556294 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc0a44b0 con 0x55f50052ae40 2024-06-13T11:31:38.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.803+0000 7fd9ef400700 1 -- 172.21.15.2:0/469556294 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7fd9fc00cb60 con 0x55f50052ae40 2024-06-13T11:31:38.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.803+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/469556294 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9f4026c80 con 0x55f50052ae40 2024-06-13T11:31:38.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.803+0000 7fd9ef400700 1 -- 172.21.15.2:0/469556294 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd9fc0ba170 con 0x55f50052ae40 2024-06-13T11:31:38.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.804+0000 7fda1a6d4b80 10 client.26248 fetch_fsmap learned FSMap version 31 2024-06-13T11:31:38.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.804+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/469556294 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f5005c6750 con 0x55f50052ae40 2024-06-13T11:31:38.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.804+0000 7fd9ef400700 1 -- 172.21.15.2:0/469556294 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9f4026c80 con 0x55f50052ae40 2024-06-13T11:31:38.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.804+0000 7fd9ef400700 1 -- 172.21.15.2:0/469556294 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fd9fc0a4020 con 0x55f50052ae40 2024-06-13T11:31:38.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.804+0000 7fda1a6d4b80 10 client.26248 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:31:38.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.804+0000 7fda1a6d4b80 10 client.26248 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:31:38.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.804+0000 7fda1a6d4b80 20 client.26248 populate_metadata read hostname 'smithi002' 2024-06-13T11:31:38.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.804+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/469556294 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55f5005c8d30 0x55f5005cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.804+0000 7fda1a6d4b80 4 client.26248 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:31:38.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.804+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/469556294 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f50050e000 con 0x55f5005c8d30 2024-06-13T11:31:38.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.805+0000 7fda0ca00700 1 --2- 172.21.15.2:0/469556294 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55f5005c8d30 0x55f5005cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.805+0000 7fda0ca00700 1 --2- 172.21.15.2:0/469556294 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55f5005c8d30 0x55f5005cb120 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=95f79a178d6ef6aa server_cookie=b33a21dc8e246445 in_seq=0 out_seq=0 2024-06-13T11:31:38.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.805+0000 7fd9ef400700 10 client.26248 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:31:38.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.806+0000 7fd9ef400700 1 -- 172.21.15.2:0/469556294 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f50050e000 con 0x55f5005c8d30 2024-06-13T11:31:38.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.806+0000 7fd9ef400700 10 client.26248 handle_command_reply: tid=0 2024-06-13T11:31:38.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.806+0000 7fda1a6d4b80 1 client.26248 shutdown 2024-06-13T11:31:38.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.806+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/469556294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f50052ae40 msgr2=0x55f5005b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:38.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.806+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/469556294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f50052ae40 0x55f5005b8ae0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc09b540 tx=0x7fd9fc09c070 comp rx=0 tx=0).stop 2024-06-13T11:31:38.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.806+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/469556294 shutdown_connections 2024-06-13T11:31:38.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.806+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/469556294 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55f5005c8d30 0x55f5005cb120 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.806+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/469556294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5005b9300 0x55f5005b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.806+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/469556294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f50052ae40 0x55f5005b8ae0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.806+0000 7fd9ef400700 0 client.26248 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:31:38.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.806+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/469556294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 0x55f5005b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.806+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/469556294 >> 172.21.15.2:0/469556294 conn(0x55f5004db170 msgr2=0x55f5005a9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:38.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.807+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/469556294 shutdown_connections 2024-06-13T11:31:38.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.807+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/469556294 wait complete. 2024-06-13T11:31:38.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.807+0000 7fda1a6d4b80 20 client.26248 trim_cache size 0 max 16384 2024-06-13T11:31:38.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.824+0000 7fda1a6d4b80 1 Processor -- start 2024-06-13T11:31:38.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.824+0000 7fda1a6d4b80 1 -- start start 2024-06-13T11:31:38.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.824+0000 7fda1a6d4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 0x55f5005aa620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.824+0000 7fda1a6d4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 0x55f5005a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.824+0000 7fda1a6d4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005b9300 0x55f5005b8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.824+0000 7fda1a6d4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fda081b74e0 con 0x55f50052ae40 2024-06-13T11:31:38.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.824+0000 7fda1a6d4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fda081b4d70 con 0x55f5005ae5b0 2024-06-13T11:31:38.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.824+0000 7fda1a6d4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fda081b2be0 con 0x55f5005b9300 2024-06-13T11:31:38.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.825+0000 7fda0d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 0x55f5005aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.825+0000 7fda0d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 0x55f5005aa620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49080/0 (socket says 172.21.15.2:49080) 2024-06-13T11:31:38.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.825+0000 7fda0d400700 1 -- 172.21.15.2:0/4281452244 learned_addr learned my addr 172.21.15.2:0/4281452244 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:38.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.825+0000 7fda0de00700 1 --2- 172.21.15.2:0/4281452244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005b9300 0x55f5005b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.825+0000 7fda0ca00700 1 --2- 172.21.15.2:0/4281452244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 0x55f5005a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.825+0000 7fda0de00700 1 -- 172.21.15.2:0/4281452244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 msgr2=0x55f5005a95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:38.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.825+0000 7fda0de00700 1 --2- 172.21.15.2:0/4281452244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 0x55f5005a95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.825+0000 7fda0de00700 1 -- 172.21.15.2:0/4281452244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 msgr2=0x55f5005aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:38.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.825+0000 7fda0de00700 1 --2- 172.21.15.2:0/4281452244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 0x55f5005aa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.825+0000 7fda0de00700 1 -- 172.21.15.2:0/4281452244 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5005b1c80 con 0x55f5005b9300 2024-06-13T11:31:38.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.825+0000 7fda0d400700 1 --2- 172.21.15.2:0/4281452244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 0x55f5005aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:38.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.826+0000 7fda0de00700 1 --2- 172.21.15.2:0/4281452244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005b9300 0x55f5005b8620 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fda000059d0 tx=0x7fda00005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce2978f7d0e743a6 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:38.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.826+0000 7fd9fa000700 1 -- 172.21.15.2:0/4281452244 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0000be60 con 0x55f5005b9300 2024-06-13T11:31:38.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.826+0000 7fd9fa000700 1 -- 172.21.15.2:0/4281452244 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda00005590 con 0x55f5005b9300 2024-06-13T11:31:38.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.826+0000 7fd9fa000700 1 -- 172.21.15.2:0/4281452244 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0000f460 con 0x55f5005b9300 2024-06-13T11:31:38.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.827+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/4281452244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005b9300 msgr2=0x55f5005b8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:38.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.827+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/4281452244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005b9300 0x55f5005b8620 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fda000059d0 tx=0x7fda00005040 comp rx=0 tx=0).stop 2024-06-13T11:31:38.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.827+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/4281452244 shutdown_connections 2024-06-13T11:31:38.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.827+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/4281452244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 0x55f5005aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.827+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/4281452244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005b9300 0x55f5005b8620 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.827+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/4281452244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005ae5b0 0x55f5005a95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.827+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/4281452244 >> 172.21.15.2:0/4281452244 conn(0x55f5004db170 msgr2=0x55f5005a8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:38.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.827+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/4281452244 shutdown_connections 2024-06-13T11:31:38.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.827+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/4281452244 wait complete. 2024-06-13T11:31:38.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.827+0000 7fda1a6d4b80 1 -- start start 2024-06-13T11:31:38.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.828+0000 7fda1a6d4b80 1 Processor -- start 2024-06-13T11:31:38.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.828+0000 7fda1a6d4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 0x55f5005c1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.828+0000 7fda1a6d4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005ae5b0 0x55f5005c1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.828+0000 7fda1a6d4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005b9300 0x55f5005b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.828+0000 7fda1a6d4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fda081b3230 con 0x55f50052ae40 2024-06-13T11:31:38.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.828+0000 7fda1a6d4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fda081b46a0 con 0x55f5005b9300 2024-06-13T11:31:38.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.828+0000 7fda1a6d4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fda081b3900 con 0x55f5005ae5b0 2024-06-13T11:31:38.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.828+0000 7fda1a6d4b80 10 client.0 _ll_register_callbacks cb 0x55f50049a720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:31:38.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.829+0000 7fda0ca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005ae5b0 0x55f5005c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.829+0000 7fda0d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 0x55f5005c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.829+0000 7fda0ca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005ae5b0 0x55f5005c1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:44072/0 (socket says 172.21.15.2:44072) 2024-06-13T11:31:38.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.829+0000 7fda0ca00700 1 -- 172.21.15.2:0/478897770 learned_addr learned my addr 172.21.15.2:0/478897770 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:38.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.829+0000 7fda0de00700 1 --2- 172.21.15.2:0/478897770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005b9300 0x55f5005b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.829+0000 7fda0ca00700 1 -- 172.21.15.2:0/478897770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005b9300 msgr2=0x55f5005b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:38.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.829+0000 7fda0ca00700 1 --2- 172.21.15.2:0/478897770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005b9300 0x55f5005b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.829+0000 7fda0ca00700 1 -- 172.21.15.2:0/478897770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 msgr2=0x55f5005c1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:38.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.829+0000 7fda0ca00700 1 --2- 172.21.15.2:0/478897770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 0x55f5005c1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.829+0000 7fda0ca00700 1 -- 172.21.15.2:0/478897770 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5005b3890 con 0x55f5005ae5b0 2024-06-13T11:31:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.829+0000 7fda0d400700 1 --2- 172.21.15.2:0/478897770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 0x55f5005c1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.829+0000 7fda0ca00700 1 --2- 172.21.15.2:0/478897770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005ae5b0 0x55f5005c1970 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400e6c0 tx=0x7fd9f4005e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=749891064651ff39 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.829+0000 7fd9ef400700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:31:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.830+0000 7fd9ef400700 1 -- 172.21.15.2:0/478897770 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f401e970 con 0x55f5005ae5b0 2024-06-13T11:31:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.830+0000 7fd9ef400700 1 -- 172.21.15.2:0/478897770 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7fd9f401eb10 con 0x55f5005ae5b0 2024-06-13T11:31:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.830+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/478897770 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda00005590 con 0x55f5005ae5b0 2024-06-13T11:31:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.830+0000 7fd9ef400700 1 -- 172.21.15.2:0/478897770 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd9f401ed10 con 0x55f5005ae5b0 2024-06-13T11:31:38.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.830+0000 7fda1a6d4b80 10 client.26254 fetch_fsmap learned FSMap version 31 2024-06-13T11:31:38.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.830+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/478897770 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f5005d0830 con 0x55f5005ae5b0 2024-06-13T11:31:38.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.830+0000 7fd9ef400700 1 -- 172.21.15.2:0/478897770 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda00005590 con 0x55f5005ae5b0 2024-06-13T11:31:38.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.830+0000 7fd9ef400700 1 -- 172.21.15.2:0/478897770 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fd9f4003a60 con 0x55f5005ae5b0 2024-06-13T11:31:38.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.830+0000 7fda1a6d4b80 10 client.26254 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:31:38.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.830+0000 7fda1a6d4b80 10 client.26254 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:31:38.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.830+0000 7fda1a6d4b80 20 client.26254 populate_metadata read hostname 'smithi002' 2024-06-13T11:31:38.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.830+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/478897770 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55f5006339b0 0x55f500635da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:38.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.830+0000 7fda1a6d4b80 4 client.26254 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:31:38.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.830+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/478897770 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f500508580 con 0x55f5006339b0 2024-06-13T11:31:38.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.831+0000 7fda0d400700 1 --2- 172.21.15.2:0/478897770 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55f5006339b0 0x55f500635da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:38.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.831+0000 7fda0d400700 1 --2- 172.21.15.2:0/478897770 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55f5006339b0 0x55f500635da0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=884a866008504f18 server_cookie=69f1d5d4e055837d in_seq=0 out_seq=0 2024-06-13T11:31:38.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.831+0000 7fd9ef400700 10 client.26254 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:31:38.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.831+0000 7fd9ef400700 1 -- 172.21.15.2:0/478897770 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f500508580 con 0x55f5006339b0 2024-06-13T11:31:38.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.831+0000 7fd9ef400700 10 client.26254 handle_command_reply: tid=0 2024-06-13T11:31:38.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.831+0000 7fda1a6d4b80 1 client.26254 shutdown 2024-06-13T11:31:38.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.832+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/478897770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005ae5b0 msgr2=0x55f5005c1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:38.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.832+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/478897770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005ae5b0 0x55f5005c1970 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400e6c0 tx=0x7fd9f4005e40 comp rx=0 tx=0).stop 2024-06-13T11:31:38.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.832+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/478897770 shutdown_connections 2024-06-13T11:31:38.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.832+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/478897770 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55f5006339b0 0x55f500635da0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.832+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/478897770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f50052ae40 0x55f5005c1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.832+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/478897770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f5005b9300 0x55f5005b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.832+0000 7fda1a6d4b80 1 --2- 172.21.15.2:0/478897770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f5005ae5b0 0x55f5005c1970 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.832+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/478897770 >> 172.21.15.2:0/478897770 conn(0x55f5004db170 msgr2=0x55f5005a9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:38.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.832+0000 7fd9ef400700 0 client.26254 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:31:38.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.832+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/478897770 shutdown_connections 2024-06-13T11:31:38.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.832+0000 7fda1a6d4b80 1 -- 172.21.15.2:0/478897770 wait complete. 2024-06-13T11:31:38.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.832+0000 7fda1a6d4b80 20 client.26254 trim_cache size 0 max 16384 2024-06-13T11:31:38.839 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:31:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.833+0000 7fda0fe00700 1 -- 172.21.15.2:0/2948101521 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9f00a2e10 msgr2=0x7fd9f00a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.833+0000 7fda0fe00700 1 --2- 172.21.15.2:0/2948101521 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9f00a2e10 0x7fd9f00a52d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fda0810fe90 tx=0x7fd9f4009260 comp rx=0 tx=0).stop 2024-06-13T11:31:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.833+0000 7fda0fe00700 1 -- 172.21.15.2:0/2948101521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda080746c0 msgr2=0x7fda0819f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.833+0000 7fda0fe00700 1 --2- 172.21.15.2:0/2948101521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda080746c0 0x7fda0819f170 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00ef10 tx=0x7fd9fc00c3a0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.833+0000 7fda0fe00700 1 -- 172.21.15.2:0/2948101521 shutdown_connections 2024-06-13T11:31:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.833+0000 7fda0fe00700 1 --2- 172.21.15.2:0/2948101521 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9f00a2e10 0x7fd9f00a52d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.833+0000 7fda0fe00700 1 --2- 172.21.15.2:0/2948101521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda08113660 0x7fda081a3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.833+0000 7fda0fe00700 1 --2- 172.21.15.2:0/2948101521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda080746c0 0x7fda0819f170 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.833+0000 7fda0fe00700 1 --2- 172.21.15.2:0/2948101521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda08074fe0 0x7fda0819f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.833+0000 7fda0fe00700 1 -- 172.21.15.2:0/2948101521 >> 172.21.15.2:0/2948101521 conn(0x7fda080795f0 msgr2=0x7fda081123b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.833+0000 7fda0fe00700 1 -- 172.21.15.2:0/2948101521 shutdown_connections 2024-06-13T11:31:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:38.833+0000 7fda0fe00700 1 -- 172.21.15.2:0/2948101521 wait complete. 2024-06-13T11:31:39.816 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-13T11:31:40.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:39 smithi077 ceph-mon[36410]: pgmap v241: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:31:40.144 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:39 smithi002 ceph-mon[32210]: pgmap v241: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:31:40.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:39 smithi178 ceph-mon[36913]: pgmap v241: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:31:40.288 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:31:42.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:41 smithi077 ceph-mon[36410]: pgmap v242: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:42.112 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:41 smithi002 ceph-mon[32210]: pgmap v242: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:42.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:41 smithi178 ceph-mon[36913]: pgmap v242: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:42.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.646+0000 7f4ff5000700 1 -- 172.21.15.2:0/3563579627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff0101390 msgr2=0x7f4ff0101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:42.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.646+0000 7f4ff5000700 1 --2- 172.21.15.2:0/3563579627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff0101390 0x7f4ff0101810 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80098f0 tx=0x7f4fd8009c00 comp rx=0 tx=0).stop 2024-06-13T11:31:42.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.646+0000 7f4ff5000700 1 -- 172.21.15.2:0/3563579627 shutdown_connections 2024-06-13T11:31:42.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.646+0000 7f4ff5000700 1 --2- 172.21.15.2:0/3563579627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff0107400 0x7f4ff01077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.646+0000 7f4ff5000700 1 --2- 172.21.15.2:0/3563579627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff0101d50 0x7f4ff010e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.646+0000 7f4ff5000700 1 --2- 172.21.15.2:0/3563579627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff0101390 0x7f4ff0101810 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.646+0000 7f4ff5000700 1 -- 172.21.15.2:0/3563579627 >> 172.21.15.2:0/3563579627 conn(0x7f4ff0078340 msgr2=0x7f4ff0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:42.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.646+0000 7f4ff5000700 1 -- 172.21.15.2:0/3563579627 shutdown_connections 2024-06-13T11:31:42.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.646+0000 7f4ff5000700 1 -- 172.21.15.2:0/3563579627 wait complete. 2024-06-13T11:31:42.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.647+0000 7f4ff5000700 1 Processor -- start 2024-06-13T11:31:42.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.648+0000 7f4ff5000700 1 -- start start 2024-06-13T11:31:42.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.648+0000 7f4ff5000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff0101390 0x7f4ff019aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.648+0000 7f4ff5000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff0101d50 0x7f4ff019b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.648+0000 7f4ff5000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff0107400 0x7f4ff019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.648+0000 7f4ff5000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff01116c0 con 0x7f4ff0101d50 2024-06-13T11:31:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.648+0000 7f4ff5000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff0111540 con 0x7f4ff0101390 2024-06-13T11:31:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.648+0000 7f4ff5000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff0111840 con 0x7f4ff0107400 2024-06-13T11:31:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.648+0000 7f4fe7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff0101d50 0x7f4ff019b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.648+0000 7f4fe7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff0101d50 0x7f4ff019b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49116/0 (socket says 172.21.15.2:49116) 2024-06-13T11:31:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.648+0000 7f4fe7e00700 1 -- 172.21.15.2:0/3826540102 learned_addr learned my addr 172.21.15.2:0/3826540102 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:42.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.648+0000 7f4fede00700 1 --2- 172.21.15.2:0/3826540102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff0101390 0x7f4ff019aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.648+0000 7f4fee800700 1 --2- 172.21.15.2:0/3826540102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff0107400 0x7f4ff019f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.649+0000 7f4fe7e00700 1 -- 172.21.15.2:0/3826540102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff0107400 msgr2=0x7f4ff019f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:42.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.649+0000 7f4fe7e00700 1 --2- 172.21.15.2:0/3826540102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff0107400 0x7f4ff019f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.649+0000 7f4fe7e00700 1 -- 172.21.15.2:0/3826540102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff0101390 msgr2=0x7f4ff019aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:42.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.649+0000 7f4fe7e00700 1 --2- 172.21.15.2:0/3826540102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff0101390 0x7f4ff019aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.649+0000 7f4fe7e00700 1 -- 172.21.15.2:0/3826540102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff019fed0 con 0x7f4ff0101d50 2024-06-13T11:31:42.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.649+0000 7f4fede00700 1 --2- 172.21.15.2:0/3826540102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff0101390 0x7f4ff019aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:42.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.649+0000 7f4fe7e00700 1 --2- 172.21.15.2:0/3826540102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff0101d50 0x7f4ff019b400 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8005950 tx=0x7f4fd800fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:42.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.650+0000 7f4fe6a00700 1 -- 172.21.15.2:0/3826540102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd80051f0 con 0x7f4ff0101d50 2024-06-13T11:31:42.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.650+0000 7f4ff5000700 1 -- 172.21.15.2:0/3826540102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff01a0160 con 0x7f4ff0101d50 2024-06-13T11:31:42.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.650+0000 7f4fe6a00700 1 -- 172.21.15.2:0/3826540102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fd800b560 con 0x7f4ff0101d50 2024-06-13T11:31:42.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.650+0000 7f4fe6a00700 1 -- 172.21.15.2:0/3826540102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8003a40 con 0x7f4ff0101d50 2024-06-13T11:31:42.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.650+0000 7f4ff5000700 1 -- 172.21.15.2:0/3826540102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff01a7a40 con 0x7f4ff0101d50 2024-06-13T11:31:42.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.653+0000 7f4fe6a00700 1 -- 172.21.15.2:0/3826540102 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f4fd800ba80 con 0x7f4ff0101d50 2024-06-13T11:31:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.655+0000 7f4fff9c0b80 1 Processor -- start 2024-06-13T11:31:42.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.655+0000 7f4fe6a00700 1 --2- 172.21.15.2:0/3826540102 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4fd40a2e10 0x7f4fd40a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.655+0000 7f4fff9c0b80 1 -- start start 2024-06-13T11:31:42.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.655+0000 7f4fe6a00700 1 -- 172.21.15.2:0/3826540102 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7f4fd80d0790 con 0x7f4ff0101d50 2024-06-13T11:31:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.655+0000 7f4fee800700 1 --2- 172.21.15.2:0/3826540102 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4fd40a2e10 0x7f4fd40a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.655+0000 7f4fff9c0b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f01070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.655+0000 7f4fff9c0b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 0x561ce4f01a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.655+0000 7f4fff9c0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 0x561ce4f0e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.655+0000 7f4fff9c0b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561ce4e10a10 con 0x561ce4f015b0 2024-06-13T11:31:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.655+0000 7f4fff9c0b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561ce4e53b00 con 0x561ce4e7de40 2024-06-13T11:31:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.655+0000 7f4fff9c0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561ce4e0e8f0 con 0x561ce4f0c300 2024-06-13T11:31:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.656+0000 7f4fe7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 0x561ce4f01a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.656+0000 7f4fede00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f01070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.656+0000 7f4fe7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 0x561ce4f01a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49118/0 (socket says 172.21.15.2:49118) 2024-06-13T11:31:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.656+0000 7f4fe7e00700 1 -- 172.21.15.2:0/1885124903 learned_addr learned my addr 172.21.15.2:0/1885124903 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.656+0000 7f4fee800700 1 --2- 172.21.15.2:0/1885124903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 0x561ce4f0e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.656+0000 7f4fede00700 1 -- 172.21.15.2:0/1885124903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 msgr2=0x561ce4f0e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.656+0000 7f4fede00700 1 --2- 172.21.15.2:0/1885124903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 0x561ce4f0e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.656+0000 7f4fede00700 1 -- 172.21.15.2:0/1885124903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 msgr2=0x561ce4f01a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.656+0000 7f4fede00700 1 --2- 172.21.15.2:0/1885124903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 0x561ce4f01a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.656+0000 7f4fede00700 1 -- 172.21.15.2:0/1885124903 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ce4dfbf90 con 0x561ce4e7de40 2024-06-13T11:31:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.656+0000 7f4fe7e00700 1 --2- 172.21.15.2:0/1885124903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 0x561ce4f01a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.656+0000 7f4fee800700 1 --2- 172.21.15.2:0/1885124903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 0x561ce4f0e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T11:31:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.657+0000 7f4fee800700 1 --2- 172.21.15.2:0/3826540102 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4fd40a2e10 0x7f4fd40a52d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800f590 tx=0x7f4fe800b040 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.657+0000 7f4fede00700 1 --2- 172.21.15.2:0/1885124903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f01070 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0011440 tx=0x7f4fe0011750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50bae3cef89db76 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.657+0000 7f4fdf400700 1 -- 172.21.15.2:0/1885124903 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0004230 con 0x561ce4e7de40 2024-06-13T11:31:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.657+0000 7f4fdf400700 1 -- 172.21.15.2:0/1885124903 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fe0004d10 con 0x561ce4e7de40 2024-06-13T11:31:42.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.657+0000 7f4fdf400700 1 -- 172.21.15.2:0/1885124903 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0003680 con 0x561ce4e7de40 2024-06-13T11:31:42.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.658+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/1885124903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 msgr2=0x561ce4f01070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:42.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.658+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/1885124903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f01070 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0011440 tx=0x7f4fe0011750 comp rx=0 tx=0).stop 2024-06-13T11:31:42.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.658+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/1885124903 shutdown_connections 2024-06-13T11:31:42.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.658+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/1885124903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 0x561ce4f0e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.658+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/1885124903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f01070 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.658+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/1885124903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 0x561ce4f01a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.658+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/1885124903 >> 172.21.15.2:0/1885124903 conn(0x561ce4e2e170 msgr2=0x561ce4efd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:42.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.658+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/1885124903 shutdown_connections 2024-06-13T11:31:42.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.658+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/1885124903 wait complete. 2024-06-13T11:31:42.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.659+0000 7f4fff9c0b80 1 -- start start 2024-06-13T11:31:42.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.659+0000 7f4fff9c0b80 1 Processor -- start 2024-06-13T11:31:42.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.660+0000 7f4fff9c0b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f0ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.660+0000 7f4fff9c0b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 0x561ce4f08d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.660+0000 7f4fff9c0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 0x561ce4f09280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.660+0000 7f4fff9c0b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561ce4deff60 con 0x561ce4f015b0 2024-06-13T11:31:42.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.660+0000 7f4fff9c0b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561ce4e4fac0 con 0x561ce4e7de40 2024-06-13T11:31:42.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.660+0000 7f4fff9c0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561ce4f0efc0 con 0x561ce4f0c300 2024-06-13T11:31:42.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.660+0000 7f4fff9c0b80 10 client.0 _ll_register_callbacks cb 0x561ce4ded720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:31:42.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.660+0000 7f4fede00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f0ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.660+0000 7f4fe7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 0x561ce4f08d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.660+0000 7f4fede00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f0ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:35128/0 (socket says 172.21.15.2:35128) 2024-06-13T11:31:42.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.660+0000 7f4fede00700 1 -- 172.21.15.2:0/377020451 learned_addr learned my addr 172.21.15.2:0/377020451 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:42.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.660+0000 7f4fee800700 1 --2- 172.21.15.2:0/377020451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 0x561ce4f09280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.661+0000 7f4fe7e00700 1 -- 172.21.15.2:0/377020451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 msgr2=0x561ce4f09280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:42.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.661+0000 7f4fe7e00700 1 --2- 172.21.15.2:0/377020451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 0x561ce4f09280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.661+0000 7f4fe7e00700 1 -- 172.21.15.2:0/377020451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 msgr2=0x561ce4f0ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:42.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.661+0000 7f4fe7e00700 1 --2- 172.21.15.2:0/377020451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f0ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.661+0000 7f4fe7e00700 1 -- 172.21.15.2:0/377020451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ce4da28d0 con 0x561ce4f015b0 2024-06-13T11:31:42.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.661+0000 7f4fede00700 1 --2- 172.21.15.2:0/377020451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f0ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:42.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.661+0000 7f4fee800700 1 --2- 172.21.15.2:0/377020451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 0x561ce4f09280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:42.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.661+0000 7f4fe7e00700 1 --2- 172.21.15.2:0/377020451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 0x561ce4f08d40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8098d80 tx=0x7f4fd8021470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce06e7f396b40ab5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:42.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.661+0000 7f4fd3e00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:31:42.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.661+0000 7f4fd3e00700 1 -- 172.21.15.2:0/377020451 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd80b5060 con 0x561ce4f015b0 2024-06-13T11:31:42.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.661+0000 7f4fd3e00700 1 -- 172.21.15.2:0/377020451 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7f4fd8003cc0 con 0x561ce4f015b0 2024-06-13T11:31:42.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.661+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/377020451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fe0004d10 con 0x561ce4f015b0 2024-06-13T11:31:42.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.662+0000 7f4fd3e00700 1 -- 172.21.15.2:0/377020451 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4fd8085e60 con 0x561ce4f015b0 2024-06-13T11:31:42.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.662+0000 7f4fff9c0b80 10 client.16125 fetch_fsmap learned FSMap version 31 2024-06-13T11:31:42.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.662+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/377020451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561ce4f19620 con 0x561ce4f015b0 2024-06-13T11:31:42.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.662+0000 7f4fd3e00700 1 -- 172.21.15.2:0/377020451 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fe0004d10 con 0x561ce4f015b0 2024-06-13T11:31:42.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.662+0000 7f4fd3e00700 1 -- 172.21.15.2:0/377020451 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f4fd800b710 con 0x561ce4f015b0 2024-06-13T11:31:42.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.662+0000 7f4fff9c0b80 10 client.16125 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:31:42.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.662+0000 7f4fff9c0b80 10 client.16125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:31:42.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.662+0000 7f4fff9c0b80 20 client.16125 populate_metadata read hostname 'smithi002' 2024-06-13T11:31:42.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.662+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/377020451 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561ce4f1bb90 0x561ce4f1e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.662+0000 7f4fff9c0b80 4 client.16125 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:31:42.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.662+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/377020451 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ce4e61000 con 0x561ce4f1bb90 2024-06-13T11:31:42.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.663+0000 7f4fede00700 1 --2- 172.21.15.2:0/377020451 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561ce4f1bb90 0x561ce4f1e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.663+0000 7f4fede00700 1 --2- 172.21.15.2:0/377020451 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561ce4f1bb90 0x561ce4f1e010 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b40c524fd9b18100 server_cookie=6da3813d5c678cfc in_seq=0 out_seq=0 2024-06-13T11:31:42.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.663+0000 7f4fd3e00700 10 client.16125 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:31:42.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.664+0000 7f4fd3e00700 1 -- 172.21.15.2:0/377020451 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561ce4e61000 con 0x561ce4f1bb90 2024-06-13T11:31:42.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.664+0000 7f4fd3e00700 10 client.16125 handle_command_reply: tid=0 2024-06-13T11:31:42.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.664+0000 7f4fff9c0b80 1 client.16125 shutdown 2024-06-13T11:31:42.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.664+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/377020451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 msgr2=0x561ce4f08d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:42.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.664+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/377020451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 0x561ce4f08d40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8098d80 tx=0x7f4fd8021470 comp rx=0 tx=0).stop 2024-06-13T11:31:42.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.665+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/377020451 shutdown_connections 2024-06-13T11:31:42.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.665+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/377020451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 0x561ce4f09280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.665+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/377020451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f0ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.665+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/377020451 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561ce4f1bb90 0x561ce4f1e010 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.665+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/377020451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 0x561ce4f08d40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.665+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/377020451 >> 172.21.15.2:0/377020451 conn(0x561ce4e2e170 msgr2=0x561ce4efc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:42.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.665+0000 7f4fd3e00700 0 client.16125 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:31:42.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.665+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/377020451 shutdown_connections 2024-06-13T11:31:42.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.665+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/377020451 wait complete. 2024-06-13T11:31:42.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.665+0000 7f4fff9c0b80 20 client.16125 trim_cache size 0 max 16384 2024-06-13T11:31:42.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.682+0000 7f4fff9c0b80 1 Processor -- start 2024-06-13T11:31:42.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.682+0000 7f4fff9c0b80 1 -- start start 2024-06-13T11:31:42.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.682+0000 7f4fff9c0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4e7de40 0x561ce4f0b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.683+0000 7f4fff9c0b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4f015b0 0x561ce4f0d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.683+0000 7f4fff9c0b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f0c300 0x561ce4f07630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.683+0000 7f4fff9c0b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff01b3030 con 0x561ce4f0c300 2024-06-13T11:31:42.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.683+0000 7f4fff9c0b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff01b08c0 con 0x561ce4f015b0 2024-06-13T11:31:42.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.683+0000 7f4fff9c0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff01ae730 con 0x561ce4e7de40 2024-06-13T11:31:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.683+0000 7f4fee800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f0c300 0x561ce4f07630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.683+0000 7f4fede00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4e7de40 0x561ce4f0b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.683+0000 7f4fe7e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4f015b0 0x561ce4f0d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.683+0000 7f4fede00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4e7de40 0x561ce4f0b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:44106/0 (socket says 172.21.15.2:44106) 2024-06-13T11:31:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.683+0000 7f4fede00700 1 -- 172.21.15.2:0/1232537776 learned_addr learned my addr 172.21.15.2:0/1232537776 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.683+0000 7f4fede00700 1 -- 172.21.15.2:0/1232537776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4f015b0 msgr2=0x561ce4f0d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.683+0000 7f4fede00700 1 --2- 172.21.15.2:0/1232537776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4f015b0 0x561ce4f0d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.683+0000 7f4fede00700 1 -- 172.21.15.2:0/1232537776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f0c300 msgr2=0x561ce4f07630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:42.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.683+0000 7f4fede00700 1 --2- 172.21.15.2:0/1232537776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f0c300 0x561ce4f07630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.683+0000 7f4fede00700 1 -- 172.21.15.2:0/1232537776 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ce4f049b0 con 0x561ce4e7de40 2024-06-13T11:31:42.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.684+0000 7f4fede00700 1 --2- 172.21.15.2:0/1232537776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4e7de40 0x561ce4f0b580 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0011440 tx=0x7f4fe00057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa7d16bdcace4758 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:42.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.684+0000 7f4fdea00700 1 -- 172.21.15.2:0/1232537776 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0032070 con 0x561ce4e7de40 2024-06-13T11:31:42.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.684+0000 7f4fdea00700 1 -- 172.21.15.2:0/1232537776 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fe002a070 con 0x561ce4e7de40 2024-06-13T11:31:42.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.684+0000 7f4fdea00700 1 -- 172.21.15.2:0/1232537776 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe002c760 con 0x561ce4e7de40 2024-06-13T11:31:42.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.685+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/1232537776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4e7de40 msgr2=0x561ce4f0b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:42.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.685+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/1232537776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4e7de40 0x561ce4f0b580 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0011440 tx=0x7f4fe00057c0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.685+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/1232537776 shutdown_connections 2024-06-13T11:31:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.685+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/1232537776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f0c300 0x561ce4f07630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.685+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/1232537776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4e7de40 0x561ce4f0b580 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.685+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/1232537776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4f015b0 0x561ce4f0d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.685+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/1232537776 >> 172.21.15.2:0/1232537776 conn(0x561ce4e2e170 msgr2=0x561ce4efcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.685+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/1232537776 shutdown_connections 2024-06-13T11:31:42.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.685+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/1232537776 wait complete. 2024-06-13T11:31:42.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.686+0000 7f4fff9c0b80 1 -- start start 2024-06-13T11:31:42.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.686+0000 7f4fff9c0b80 1 Processor -- start 2024-06-13T11:31:42.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.686+0000 7f4fff9c0b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f22a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.686+0000 7f4fff9c0b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 0x561ce4f22f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.686+0000 7f4fff9c0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 0x561ce4f13250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.686+0000 7f4fff9c0b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff01aed80 con 0x561ce4f015b0 2024-06-13T11:31:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.686+0000 7f4fff9c0b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff01b01f0 con 0x561ce4e7de40 2024-06-13T11:31:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.686+0000 7f4fff9c0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff01af450 con 0x561ce4f0c300 2024-06-13T11:31:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.686+0000 7f4fff9c0b80 10 client.0 _ll_register_callbacks cb 0x561ce4ded720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:31:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.687+0000 7f4fe7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 0x561ce4f22f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.687+0000 7f4fede00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f22a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.687+0000 7f4fee800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 0x561ce4f13250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.687+0000 7f4fee800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 0x561ce4f13250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:44108/0 (socket says 172.21.15.2:44108) 2024-06-13T11:31:42.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.687+0000 7f4fede00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f22a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:35152/0 (socket says 172.21.15.2:35152) 2024-06-13T11:31:42.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.687+0000 7f4fede00700 1 -- 172.21.15.2:0/2330478745 learned_addr learned my addr 172.21.15.2:0/2330478745 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:42.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.687+0000 7f4fe7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 0x561ce4f22f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49144/0 (socket says 172.21.15.2:49144) 2024-06-13T11:31:42.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.687+0000 7f4fede00700 1 -- 172.21.15.2:0/2330478745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 msgr2=0x561ce4f13250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:42.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.687+0000 7f4fede00700 1 --2- 172.21.15.2:0/2330478745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 0x561ce4f13250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.687+0000 7f4fede00700 1 -- 172.21.15.2:0/2330478745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 msgr2=0x561ce4f22f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.687+0000 7f4fede00700 1 --2- 172.21.15.2:0/2330478745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 0x561ce4f22f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.687+0000 7f4fede00700 1 -- 172.21.15.2:0/2330478745 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ce4f13790 con 0x561ce4e7de40 2024-06-13T11:31:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.688+0000 7f4fede00700 1 --2- 172.21.15.2:0/2330478745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f22a10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009bd0 tx=0x7f4fe0009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ef80c66c20e6752 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.688+0000 7f4fd3e00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:31:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.688+0000 7f4fd3e00700 1 -- 172.21.15.2:0/2330478745 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0032070 con 0x561ce4e7de40 2024-06-13T11:31:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.688+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/2330478745 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fe002a070 con 0x561ce4e7de40 2024-06-13T11:31:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.688+0000 7f4fd3e00700 1 -- 172.21.15.2:0/2330478745 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7f4fe0004910 con 0x561ce4e7de40 2024-06-13T11:31:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.688+0000 7f4fd3e00700 1 -- 172.21.15.2:0/2330478745 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4fe0040050 con 0x561ce4e7de40 2024-06-13T11:31:42.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.688+0000 7f4fff9c0b80 10 client.26234 fetch_fsmap learned FSMap version 31 2024-06-13T11:31:42.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.688+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/2330478745 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561ce4f14a90 con 0x561ce4e7de40 2024-06-13T11:31:42.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.689+0000 7f4fd3e00700 1 -- 172.21.15.2:0/2330478745 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fe002a070 con 0x561ce4e7de40 2024-06-13T11:31:42.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.689+0000 7f4fd3e00700 1 -- 172.21.15.2:0/2330478745 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f4fe002cab0 con 0x561ce4e7de40 2024-06-13T11:31:42.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.689+0000 7f4fff9c0b80 10 client.26234 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:31:42.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.689+0000 7f4fff9c0b80 10 client.26234 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:31:42.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.689+0000 7f4fff9c0b80 20 client.26234 populate_metadata read hostname 'smithi002' 2024-06-13T11:31:42.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.689+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/2330478745 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561ce4f868b0 0x561ce4f88ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:42.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.689+0000 7f4fff9c0b80 4 client.26234 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:31:42.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.689+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/2330478745 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561ce4e5b580 con 0x561ce4f868b0 2024-06-13T11:31:42.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.689+0000 7f4fe7e00700 1 --2- 172.21.15.2:0/2330478745 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561ce4f868b0 0x561ce4f88ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:42.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.690+0000 7f4fe7e00700 1 --2- 172.21.15.2:0/2330478745 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561ce4f868b0 0x561ce4f88ca0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e83ae68d45048c1a server_cookie=820783fceeb8ad68 in_seq=0 out_seq=0 2024-06-13T11:31:42.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.690+0000 7f4fd3e00700 10 client.26234 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:31:42.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.690+0000 7f4fd3e00700 1 -- 172.21.15.2:0/2330478745 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561ce4e5b580 con 0x561ce4f868b0 2024-06-13T11:31:42.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.690+0000 7f4fd3e00700 10 client.26234 handle_command_reply: tid=0 2024-06-13T11:31:42.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.690+0000 7f4fff9c0b80 1 client.26234 shutdown 2024-06-13T11:31:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.690+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/2330478745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 msgr2=0x561ce4f22a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.690+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/2330478745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f22a10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009bd0 tx=0x7f4fe0009290 comp rx=0 tx=0).stop 2024-06-13T11:31:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.690+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/2330478745 shutdown_connections 2024-06-13T11:31:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.690+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/2330478745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ce4f0c300 0x561ce4f13250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.690+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/2330478745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561ce4e7de40 0x561ce4f22a10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.690+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/2330478745 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561ce4f868b0 0x561ce4f88ca0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.690+0000 7f4fff9c0b80 1 --2- 172.21.15.2:0/2330478745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561ce4f015b0 0x561ce4f22f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.690+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/2330478745 >> 172.21.15.2:0/2330478745 conn(0x561ce4e2e170 msgr2=0x561ce4efbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.690+0000 7f4fd3e00700 0 client.26234 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:31:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.690+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/2330478745 shutdown_connections 2024-06-13T11:31:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.691+0000 7f4fff9c0b80 1 -- 172.21.15.2:0/2330478745 wait complete. 2024-06-13T11:31:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.691+0000 7f4fff9c0b80 20 client.26234 trim_cache size 0 max 16384 2024-06-13T11:31:42.697 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:31:42.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.691+0000 7f4ff5000700 1 -- 172.21.15.2:0/3826540102 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4fd40a2e10 msgr2=0x7f4fd40a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:42.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.691+0000 7f4ff5000700 1 --2- 172.21.15.2:0/3826540102 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4fd40a2e10 0x7f4fd40a52d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800f590 tx=0x7f4fe800b040 comp rx=0 tx=0).stop 2024-06-13T11:31:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.691+0000 7f4ff5000700 1 -- 172.21.15.2:0/3826540102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff0101d50 msgr2=0x7f4ff019b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.691+0000 7f4ff5000700 1 --2- 172.21.15.2:0/3826540102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff0101d50 0x7f4ff019b400 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8005950 tx=0x7f4fd800fb20 comp rx=0 tx=0).stop 2024-06-13T11:31:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.692+0000 7f4ff5000700 1 -- 172.21.15.2:0/3826540102 shutdown_connections 2024-06-13T11:31:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.692+0000 7f4ff5000700 1 --2- 172.21.15.2:0/3826540102 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4fd40a2e10 0x7f4fd40a52d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.692+0000 7f4ff5000700 1 --2- 172.21.15.2:0/3826540102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff0107400 0x7f4ff019f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.692+0000 7f4ff5000700 1 --2- 172.21.15.2:0/3826540102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff0101390 0x7f4ff019aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.692+0000 7f4ff5000700 1 --2- 172.21.15.2:0/3826540102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ff0101d50 0x7f4ff019b400 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:42.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.692+0000 7f4ff5000700 1 -- 172.21.15.2:0/3826540102 >> 172.21.15.2:0/3826540102 conn(0x7f4ff0078340 msgr2=0x7f4ff006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:42.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.692+0000 7f4ff5000700 1 -- 172.21.15.2:0/3826540102 shutdown_connections 2024-06-13T11:31:42.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:42.692+0000 7f4ff5000700 1 -- 172.21.15.2:0/3826540102 wait complete. 2024-06-13T11:31:43.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:43 smithi002 ceph-mon[32210]: pgmap v243: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:31:43.998 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:43 smithi178 ceph-mon[36913]: pgmap v243: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:31:44.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:43 smithi077 ceph-mon[36410]: pgmap v243: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:31:44.704 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-13T11:31:44.705 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-13T11:31:45.185 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:31:45.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:45 smithi002 ceph-mon[32210]: pgmap v244: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:46.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:45 smithi077 ceph-mon[36410]: pgmap v244: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:46.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:45 smithi178 ceph-mon[36913]: pgmap v244: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:47.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.452+0000 7f1162000700 1 -- 172.21.15.2:0/3464367471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c06ac60 msgr2=0x7f115c06b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:47.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.452+0000 7f1162000700 1 --2- 172.21.15.2:0/3464367471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c06ac60 0x7f115c06b040 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1150009990 tx=0x7f1150009ca0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.453+0000 7f1162000700 1 -- 172.21.15.2:0/3464367471 shutdown_connections 2024-06-13T11:31:47.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.453+0000 7f1162000700 1 --2- 172.21.15.2:0/3464367471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c06ac60 0x7f115c06b040 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.453+0000 7f1162000700 1 --2- 172.21.15.2:0/3464367471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f115c1077c0 0x7f115c10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.453+0000 7f1162000700 1 --2- 172.21.15.2:0/3464367471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f115c06b610 0x7f115c107090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.453+0000 7f1162000700 1 -- 172.21.15.2:0/3464367471 >> 172.21.15.2:0/3464367471 conn(0x7f115c0781d0 msgr2=0x7f115c0785e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:47.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.453+0000 7f1162000700 1 -- 172.21.15.2:0/3464367471 shutdown_connections 2024-06-13T11:31:47.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.453+0000 7f1162000700 1 -- 172.21.15.2:0/3464367471 wait complete. 2024-06-13T11:31:47.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.454+0000 7f1162000700 1 Processor -- start 2024-06-13T11:31:47.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.454+0000 7f1162000700 1 -- start start 2024-06-13T11:31:47.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.455+0000 7f1162000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c06b610 0x7f115c19ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.455+0000 7f1162000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f115c1077c0 0x7f115c19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.455+0000 7f1162000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f115c198b30 0x7f115c198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.455+0000 7f1162000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f115c1126f0 con 0x7f115c06b610 2024-06-13T11:31:47.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.455+0000 7f1162000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f115c112570 con 0x7f115c1077c0 2024-06-13T11:31:47.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.455+0000 7f1162000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f115c112870 con 0x7f115c198b30 2024-06-13T11:31:47.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.455+0000 7f1160c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c06b610 0x7f115c19ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.455+0000 7f1160c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c06b610 0x7f115c19ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38238/0 (socket says 172.21.15.2:38238) 2024-06-13T11:31:47.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.455+0000 7f1160c00700 1 -- 172.21.15.2:0/1177836638 learned_addr learned my addr 172.21.15.2:0/1177836638 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:47.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.455+0000 7f115be00700 1 --2- 172.21.15.2:0/1177836638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f115c1077c0 0x7f115c19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.455+0000 7f1161600700 1 --2- 172.21.15.2:0/1177836638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f115c198b30 0x7f115c198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.456+0000 7f1160c00700 1 -- 172.21.15.2:0/1177836638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f115c198b30 msgr2=0x7f115c198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:47.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.456+0000 7f1160c00700 1 --2- 172.21.15.2:0/1177836638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f115c198b30 0x7f115c198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.456+0000 7f1160c00700 1 -- 172.21.15.2:0/1177836638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f115c1077c0 msgr2=0x7f115c19efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:47.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.456+0000 7f1160c00700 1 --2- 172.21.15.2:0/1177836638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f115c1077c0 0x7f115c19efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.456+0000 7f1160c00700 1 -- 172.21.15.2:0/1177836638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115c199750 con 0x7f115c06b610 2024-06-13T11:31:47.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.456+0000 7f1161600700 1 --2- 172.21.15.2:0/1177836638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f115c198b30 0x7f115c198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:47.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.456+0000 7f1160c00700 1 --2- 172.21.15.2:0/1177836638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c06b610 0x7f115c19ea60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1150006010 tx=0x7f115000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:47.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.456+0000 7f1159600700 1 -- 172.21.15.2:0/1177836638 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1150026070 con 0x7f115c06b610 2024-06-13T11:31:47.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.456+0000 7f1159600700 1 -- 172.21.15.2:0/1177836638 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1150003d70 con 0x7f115c06b610 2024-06-13T11:31:47.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.456+0000 7f1162000700 1 -- 172.21.15.2:0/1177836638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f115c101550 con 0x7f115c06b610 2024-06-13T11:31:47.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.457+0000 7f1159600700 1 -- 172.21.15.2:0/1177836638 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115000fcd0 con 0x7f115c06b610 2024-06-13T11:31:47.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.457+0000 7f1162000700 1 -- 172.21.15.2:0/1177836638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f115c101a80 con 0x7f115c06b610 2024-06-13T11:31:47.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.460+0000 7f1159600700 1 -- 172.21.15.2:0/1177836638 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f1150029070 con 0x7f115c06b610 2024-06-13T11:31:47.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.461+0000 7f1159600700 1 --2- 172.21.15.2:0/1177836638 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f11440a2e10 0x7f11440a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.461+0000 7f1159600700 1 -- 172.21.15.2:0/1177836638 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7f11500d01c0 con 0x7f115c06b610 2024-06-13T11:31:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.462+0000 7f115be00700 1 --2- 172.21.15.2:0/1177836638 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f11440a2e10 0x7f11440a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.462+0000 7f116dfb6b80 1 Processor -- start 2024-06-13T11:31:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.462+0000 7f116dfb6b80 1 -- start start 2024-06-13T11:31:47.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.462+0000 7f116dfb6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.462+0000 7f116dfb6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.462+0000 7f116dfb6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5bc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.462+0000 7f116dfb6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a4ff4bea90 con 0x55a4ff5ba5f0 2024-06-13T11:31:47.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.462+0000 7f116dfb6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a4ff501b80 con 0x55a4ff52bec0 2024-06-13T11:31:47.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.462+0000 7f116dfb6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a4ff4bc970 con 0x55a4ff5b19e0 2024-06-13T11:31:47.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.463+0000 7f115be00700 1 --2- 172.21.15.2:0/1177836638 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f11440a2e10 0x7f11440a52d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f115c19a280 tx=0x7f1148009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:47.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.463+0000 7f1160c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.463+0000 7f1160c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:40842/0 (socket says 172.21.15.2:40842) 2024-06-13T11:31:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.463+0000 7f1160c00700 1 -- 172.21.15.2:0/1477393027 learned_addr learned my addr 172.21.15.2:0/1477393027 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.463+0000 7f1161600700 1 --2- 172.21.15.2:0/1477393027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5bc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.463+0000 7f115be00700 1 --2- 172.21.15.2:0/1477393027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.463+0000 7f1160c00700 1 -- 172.21.15.2:0/1477393027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5b19e0 msgr2=0x55a4ff5b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.463+0000 7f1160c00700 1 --2- 172.21.15.2:0/1477393027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.463+0000 7f1160c00700 1 -- 172.21.15.2:0/1477393027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff5ba5f0 msgr2=0x55a4ff5bc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:47.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.463+0000 7f1160c00700 1 --2- 172.21.15.2:0/1477393027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5bc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.463+0000 7f1160c00700 1 -- 172.21.15.2:0/1477393027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4ff4aa010 con 0x55a4ff52bec0 2024-06-13T11:31:47.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.463+0000 7f115be00700 1 --2- 172.21.15.2:0/1477393027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:31:47.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.464+0000 7f1160c00700 1 --2- 172.21.15.2:0/1477393027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b14a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1150098d20 tx=0x7f1150009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33360ae375324817 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:47.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.464+0000 7f114e000700 1 -- 172.21.15.2:0/1477393027 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11500095c0 con 0x55a4ff52bec0 2024-06-13T11:31:47.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.464+0000 7f114e000700 1 -- 172.21.15.2:0/1477393027 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f115009ca50 con 0x55a4ff52bec0 2024-06-13T11:31:47.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.464+0000 7f114e000700 1 -- 172.21.15.2:0/1477393027 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115009c810 con 0x55a4ff52bec0 2024-06-13T11:31:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.465+0000 7f116dfb6b80 1 -- 172.21.15.2:0/1477393027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff52bec0 msgr2=0x55a4ff5b14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.465+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/1477393027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b14a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1150098d20 tx=0x7f1150009310 comp rx=0 tx=0).stop 2024-06-13T11:31:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.465+0000 7f116dfb6b80 1 -- 172.21.15.2:0/1477393027 shutdown_connections 2024-06-13T11:31:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.465+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/1477393027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5bc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.465+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/1477393027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b14a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.465+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/1477393027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.465+0000 7f116dfb6b80 1 -- 172.21.15.2:0/1477393027 >> 172.21.15.2:0/1477393027 conn(0x55a4ff4dc1f0 msgr2=0x55a4ff5ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.465+0000 7f116dfb6b80 1 -- 172.21.15.2:0/1477393027 shutdown_connections 2024-06-13T11:31:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.465+0000 7f116dfb6b80 1 -- 172.21.15.2:0/1477393027 wait complete. 2024-06-13T11:31:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.466+0000 7f116dfb6b80 1 -- start start 2024-06-13T11:31:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.466+0000 7f116dfb6b80 1 Processor -- start 2024-06-13T11:31:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.466+0000 7f116dfb6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.466+0000 7f116dfb6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.466+0000 7f116dfb6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5b75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.467+0000 7f116dfb6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a4ff49dfe0 con 0x55a4ff52bec0 2024-06-13T11:31:47.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.467+0000 7f116dfb6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a4ff4fdb40 con 0x55a4ff5ba5f0 2024-06-13T11:31:47.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.467+0000 7f116dfb6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a4ff5bd010 con 0x55a4ff5b19e0 2024-06-13T11:31:47.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.467+0000 7f116dfb6b80 10 client.0 _ll_register_callbacks cb 0x55a4ff49b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:31:47.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.467+0000 7f1160c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.467+0000 7f1160c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38250/0 (socket says 172.21.15.2:38250) 2024-06-13T11:31:47.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.467+0000 7f1160c00700 1 -- 172.21.15.2:0/3428577726 learned_addr learned my addr 172.21.15.2:0/3428577726 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:47.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.467+0000 7f1161600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5b75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.467+0000 7f115be00700 1 --2- 172.21.15.2:0/3428577726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.467+0000 7f1160c00700 1 -- 172.21.15.2:0/3428577726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5b19e0 msgr2=0x55a4ff5b70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:47.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.467+0000 7f1160c00700 1 --2- 172.21.15.2:0/3428577726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5b70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.467+0000 7f1160c00700 1 -- 172.21.15.2:0/3428577726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff5ba5f0 msgr2=0x55a4ff5b75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:47.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.467+0000 7f1160c00700 1 --2- 172.21.15.2:0/3428577726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5b75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.467+0000 7f1160c00700 1 -- 172.21.15.2:0/3428577726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4ff450950 con 0x55a4ff52bec0 2024-06-13T11:31:47.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.467+0000 7f1161600700 1 --2- 172.21.15.2:0/3428577726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5b75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:47.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.468+0000 7f1160c00700 1 --2- 172.21.15.2:0/3428577726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b9db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f115009c000 tx=0x7f11500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1210a7f5bec3c34b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:47.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.468+0000 7f1142a00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:31:47.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.468+0000 7f1142a00700 1 -- 172.21.15.2:0/3428577726 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11500a4ca0 con 0x55a4ff52bec0 2024-06-13T11:31:47.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.468+0000 7f1142a00700 1 -- 172.21.15.2:0/3428577726 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7f11500bc0c0 con 0x55a4ff52bec0 2024-06-13T11:31:47.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.468+0000 7f116dfb6b80 1 -- 172.21.15.2:0/3428577726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f115009ca50 con 0x55a4ff52bec0 2024-06-13T11:31:47.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.468+0000 7f1142a00700 1 -- 172.21.15.2:0/3428577726 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f11500a0700 con 0x55a4ff52bec0 2024-06-13T11:31:47.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.468+0000 7f116dfb6b80 10 client.16143 fetch_fsmap learned FSMap version 31 2024-06-13T11:31:47.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.468+0000 7f116dfb6b80 1 -- 172.21.15.2:0/3428577726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a4ff5c7710 con 0x55a4ff52bec0 2024-06-13T11:31:47.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.469+0000 7f1142a00700 1 -- 172.21.15.2:0/3428577726 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f115009ca50 con 0x55a4ff52bec0 2024-06-13T11:31:47.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.469+0000 7f1142a00700 1 -- 172.21.15.2:0/3428577726 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f115009b7a0 con 0x55a4ff52bec0 2024-06-13T11:31:47.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.469+0000 7f116dfb6b80 10 client.16143 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:31:47.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.469+0000 7f116dfb6b80 10 client.16143 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:31:47.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.469+0000 7f116dfb6b80 20 client.16143 populate_metadata read hostname 'smithi002' 2024-06-13T11:31:47.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.469+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/3428577726 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a4ff5c9be0 0x55a4ff5cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.469+0000 7f116dfb6b80 4 client.16143 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:31:47.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.469+0000 7f116dfb6b80 1 -- 172.21.15.2:0/3428577726 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4ff50f080 con 0x55a4ff5c9be0 2024-06-13T11:31:47.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.469+0000 7f115be00700 1 --2- 172.21.15.2:0/3428577726 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a4ff5c9be0 0x55a4ff5cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.470+0000 7f115be00700 1 --2- 172.21.15.2:0/3428577726 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a4ff5c9be0 0x55a4ff5cbfd0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bfcb2e686985a8c server_cookie=34f1d55f0e18042 in_seq=0 out_seq=0 2024-06-13T11:31:47.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.470+0000 7f1142a00700 10 client.16143 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:31:47.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.471+0000 7f1142a00700 1 -- 172.21.15.2:0/3428577726 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a4ff50f080 con 0x55a4ff5c9be0 2024-06-13T11:31:47.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.471+0000 7f1142a00700 10 client.16143 handle_command_reply: tid=0 2024-06-13T11:31:47.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.471+0000 7f116dfb6b80 1 client.16143 shutdown 2024-06-13T11:31:47.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.471+0000 7f116dfb6b80 1 -- 172.21.15.2:0/3428577726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff52bec0 msgr2=0x55a4ff5b9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:47.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.471+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/3428577726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b9db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f115009c000 tx=0x7f11500046c0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.471+0000 7f116dfb6b80 1 -- 172.21.15.2:0/3428577726 shutdown_connections 2024-06-13T11:31:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.471+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/3428577726 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a4ff5c9be0 0x55a4ff5cbfd0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.471+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/3428577726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b9db0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.471+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/3428577726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5b75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.471+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/3428577726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5b70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.471+0000 7f116dfb6b80 1 -- 172.21.15.2:0/3428577726 >> 172.21.15.2:0/3428577726 conn(0x55a4ff4dc1f0 msgr2=0x55a4ff5ab490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.471+0000 7f1142a00700 0 client.16143 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:31:47.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.472+0000 7f116dfb6b80 1 -- 172.21.15.2:0/3428577726 shutdown_connections 2024-06-13T11:31:47.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.472+0000 7f116dfb6b80 1 -- 172.21.15.2:0/3428577726 wait complete. 2024-06-13T11:31:47.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.472+0000 7f116dfb6b80 20 client.16143 trim_cache size 0 max 16384 2024-06-13T11:31:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.495+0000 7f116dfb6b80 1 Processor -- start 2024-06-13T11:31:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.495+0000 7f116dfb6b80 1 -- start start 2024-06-13T11:31:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.495+0000 7f116dfb6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.495+0000 7f116dfb6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5d16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.496+0000 7f116dfb6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.496+0000 7f116dfb6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f115c1aefe0 con 0x55a4ff52bec0 2024-06-13T11:31:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.496+0000 7f116dfb6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f115c1ac870 con 0x55a4ff5b19e0 2024-06-13T11:31:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.496+0000 7f116dfb6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f115c1aa6e0 con 0x55a4ff5ba5f0 2024-06-13T11:31:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.496+0000 7f1160c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.496+0000 7f1160c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38266/0 (socket says 172.21.15.2:38266) 2024-06-13T11:31:47.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.496+0000 7f1160c00700 1 -- 172.21.15.2:0/28531061 learned_addr learned my addr 172.21.15.2:0/28531061 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:47.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.496+0000 7f115be00700 1 --2- 172.21.15.2:0/28531061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5d16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.496+0000 7f1161600700 1 --2- 172.21.15.2:0/28531061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.496+0000 7f1160c00700 1 -- 172.21.15.2:0/28531061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5ba5f0 msgr2=0x55a4ff5d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:47.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.496+0000 7f1160c00700 1 --2- 172.21.15.2:0/28531061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5d1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.496+0000 7f1160c00700 1 -- 172.21.15.2:0/28531061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff5b19e0 msgr2=0x55a4ff5d16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:47.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.496+0000 7f1160c00700 1 --2- 172.21.15.2:0/28531061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5d16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.496+0000 7f1160c00700 1 -- 172.21.15.2:0/28531061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4ff5b7fe0 con 0x55a4ff52bec0 2024-06-13T11:31:47.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.497+0000 7f115be00700 1 --2- 172.21.15.2:0/28531061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5d16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:47.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.497+0000 7f1160c00700 1 --2- 172.21.15.2:0/28531061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b8ff0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1150098d20 tx=0x7f1150009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d325521321d1fc9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:47.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.497+0000 7f114d600700 1 -- 172.21.15.2:0/28531061 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11500095c0 con 0x55a4ff52bec0 2024-06-13T11:31:47.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.497+0000 7f114d600700 1 -- 172.21.15.2:0/28531061 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f115009ca50 con 0x55a4ff52bec0 2024-06-13T11:31:47.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.497+0000 7f114d600700 1 -- 172.21.15.2:0/28531061 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11500a4cc0 con 0x55a4ff52bec0 2024-06-13T11:31:47.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.498+0000 7f116dfb6b80 1 -- 172.21.15.2:0/28531061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff52bec0 msgr2=0x55a4ff5b8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:47.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.498+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/28531061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b8ff0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1150098d20 tx=0x7f1150009310 comp rx=0 tx=0).stop 2024-06-13T11:31:47.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.498+0000 7f116dfb6b80 1 -- 172.21.15.2:0/28531061 shutdown_connections 2024-06-13T11:31:47.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.498+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/28531061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff52bec0 0x55a4ff5b8ff0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.498+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/28531061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.498+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/28531061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5d16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.498+0000 7f116dfb6b80 1 -- 172.21.15.2:0/28531061 >> 172.21.15.2:0/28531061 conn(0x55a4ff4dc1f0 msgr2=0x55a4ff5b88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:47.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.498+0000 7f116dfb6b80 1 -- 172.21.15.2:0/28531061 shutdown_connections 2024-06-13T11:31:47.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.498+0000 7f116dfb6b80 1 -- 172.21.15.2:0/28531061 wait complete. 2024-06-13T11:31:47.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.499+0000 7f116dfb6b80 1 -- start start 2024-06-13T11:31:47.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.499+0000 7f116dfb6b80 1 Processor -- start 2024-06-13T11:31:47.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.499+0000 7f116dfb6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff52bec0 0x55a4ff5c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.499+0000 7f116dfb6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.499+0000 7f116dfb6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.499+0000 7f116dfb6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f115c1aad30 con 0x55a4ff5ba5f0 2024-06-13T11:31:47.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.499+0000 7f116dfb6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f115c1ac1a0 con 0x55a4ff52bec0 2024-06-13T11:31:47.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.499+0000 7f116dfb6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f115c1ab400 con 0x55a4ff5b19e0 2024-06-13T11:31:47.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.500+0000 7f116dfb6b80 10 client.0 _ll_register_callbacks cb 0x55a4ff49b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:31:47.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.500+0000 7f1160c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff52bec0 0x55a4ff5c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.500+0000 7f1161600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.500+0000 7f1160c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff52bec0 0x55a4ff5c28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:40874/0 (socket says 172.21.15.2:40874) 2024-06-13T11:31:47.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.500+0000 7f1160c00700 1 -- 172.21.15.2:0/1587040348 learned_addr learned my addr 172.21.15.2:0/1587040348 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.500+0000 7f115be00700 1 --2- 172.21.15.2:0/1587040348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.500+0000 7f1160c00700 1 -- 172.21.15.2:0/1587040348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5b19e0 msgr2=0x55a4ff5b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.500+0000 7f1160c00700 1 --2- 172.21.15.2:0/1587040348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.500+0000 7f1160c00700 1 -- 172.21.15.2:0/1587040348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff5ba5f0 msgr2=0x55a4ff5b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.500+0000 7f1160c00700 1 --2- 172.21.15.2:0/1587040348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.500+0000 7f1160c00700 1 -- 172.21.15.2:0/1587040348 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4ff5b4990 con 0x55a4ff52bec0 2024-06-13T11:31:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.500+0000 7f1160c00700 1 --2- 172.21.15.2:0/1587040348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff52bec0 0x55a4ff5c28f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f115009c2e0 tx=0x7f1150009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e902096b656c7cb8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:47.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.500+0000 7f1142a00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:31:47.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.501+0000 7f1142a00700 1 -- 172.21.15.2:0/1587040348 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11500095c0 con 0x55a4ff52bec0 2024-06-13T11:31:47.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.501+0000 7f116dfb6b80 1 -- 172.21.15.2:0/1587040348 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f115009ca50 con 0x55a4ff52bec0 2024-06-13T11:31:47.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.501+0000 7f1142a00700 1 -- 172.21.15.2:0/1587040348 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7f11500bc110 con 0x55a4ff52bec0 2024-06-13T11:31:47.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.501+0000 7f1142a00700 1 -- 172.21.15.2:0/1587040348 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f115007c020 con 0x55a4ff52bec0 2024-06-13T11:31:47.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.501+0000 7f116dfb6b80 10 client.26252 fetch_fsmap learned FSMap version 31 2024-06-13T11:31:47.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.501+0000 7f116dfb6b80 1 -- 172.21.15.2:0/1587040348 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a4ff5b4990 con 0x55a4ff52bec0 2024-06-13T11:31:47.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.501+0000 7f1142a00700 1 -- 172.21.15.2:0/1587040348 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f115009ca50 con 0x55a4ff52bec0 2024-06-13T11:31:47.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.501+0000 7f1142a00700 1 -- 172.21.15.2:0/1587040348 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f115009b210 con 0x55a4ff52bec0 2024-06-13T11:31:47.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.502+0000 7f116dfb6b80 10 client.26252 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:31:47.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.502+0000 7f116dfb6b80 10 client.26252 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:31:47.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.502+0000 7f116dfb6b80 20 client.26252 populate_metadata read hostname 'smithi002' 2024-06-13T11:31:47.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.502+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/1587040348 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a4ff6348b0 0x55a4ff636ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:47.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.502+0000 7f116dfb6b80 4 client.26252 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-13T11:31:47.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.502+0000 7f116dfb6b80 1 -- 172.21.15.2:0/1587040348 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a4ff509600 con 0x55a4ff6348b0 2024-06-13T11:31:47.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.502+0000 7f115be00700 1 --2- 172.21.15.2:0/1587040348 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a4ff6348b0 0x55a4ff636ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:47.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.502+0000 7f115be00700 1 --2- 172.21.15.2:0/1587040348 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a4ff6348b0 0x55a4ff636ca0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=106cddbaf4ef1b8e server_cookie=f0bfbb73345bd153 in_seq=0 out_seq=0 2024-06-13T11:31:47.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.502+0000 7f1142a00700 10 client.26252 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:31:47.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.504+0000 7f1142a00700 1 -- 172.21.15.2:0/1587040348 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a4ff509600 con 0x55a4ff6348b0 2024-06-13T11:31:47.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.504+0000 7f1142a00700 10 client.26252 handle_command_reply: tid=0 2024-06-13T11:31:47.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.504+0000 7f116dfb6b80 1 client.26252 shutdown 2024-06-13T11:31:47.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.504+0000 7f116dfb6b80 1 -- 172.21.15.2:0/1587040348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff52bec0 msgr2=0x55a4ff5c28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:47.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.504+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/1587040348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff52bec0 0x55a4ff5c28f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f115009c2e0 tx=0x7f1150009ca0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.504+0000 7f116dfb6b80 1 -- 172.21.15.2:0/1587040348 shutdown_connections 2024-06-13T11:31:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.504+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/1587040348 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a4ff6348b0 0x55a4ff636ca0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.504+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/1587040348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4ff5ba5f0 0x55a4ff5b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.504+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/1587040348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a4ff52bec0 0x55a4ff5c28f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.504+0000 7f116dfb6b80 1 --2- 172.21.15.2:0/1587040348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a4ff5b19e0 0x55a4ff5b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.504+0000 7f1142a00700 0 client.26252 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:31:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.504+0000 7f116dfb6b80 1 -- 172.21.15.2:0/1587040348 >> 172.21.15.2:0/1587040348 conn(0x55a4ff4dc1f0 msgr2=0x55a4ff5b7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.504+0000 7f116dfb6b80 1 -- 172.21.15.2:0/1587040348 shutdown_connections 2024-06-13T11:31:47.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.504+0000 7f116dfb6b80 1 -- 172.21.15.2:0/1587040348 wait complete. 2024-06-13T11:31:47.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.505+0000 7f116dfb6b80 20 client.26252 trim_cache size 0 max 16384 2024-06-13T11:31:47.510 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:31:47.510 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-06-13T11:31:47.510 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "a9a32da9-6720-4b93-be71-bde7ec688aaa", 2024-06-13T11:31:47.510 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-06-13T11:31:47.510 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:31:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.505+0000 7f1162000700 1 -- 172.21.15.2:0/1177836638 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f11440a2e10 msgr2=0x7f11440a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.505+0000 7f1162000700 1 --2- 172.21.15.2:0/1177836638 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f11440a2e10 0x7f11440a52d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f115c19a280 tx=0x7f1148009260 comp rx=0 tx=0).stop 2024-06-13T11:31:47.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.505+0000 7f1162000700 1 -- 172.21.15.2:0/1177836638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c06b610 msgr2=0x7f115c19ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:47.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.505+0000 7f1162000700 1 --2- 172.21.15.2:0/1177836638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c06b610 0x7f115c19ea60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1150006010 tx=0x7f115000bab0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.506+0000 7f1162000700 1 -- 172.21.15.2:0/1177836638 shutdown_connections 2024-06-13T11:31:47.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.506+0000 7f1162000700 1 --2- 172.21.15.2:0/1177836638 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f11440a2e10 0x7f11440a52d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.506+0000 7f1162000700 1 --2- 172.21.15.2:0/1177836638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c06b610 0x7f115c19ea60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.506+0000 7f1162000700 1 --2- 172.21.15.2:0/1177836638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f115c198b30 0x7f115c198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.506+0000 7f1162000700 1 --2- 172.21.15.2:0/1177836638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f115c1077c0 0x7f115c19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:47.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.506+0000 7f1162000700 1 -- 172.21.15.2:0/1177836638 >> 172.21.15.2:0/1177836638 conn(0x7f115c0781d0 msgr2=0x7f115c0ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:47.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.506+0000 7f1162000700 1 -- 172.21.15.2:0/1177836638 shutdown_connections 2024-06-13T11:31:47.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:47.506+0000 7f1162000700 1 -- 172.21.15.2:0/1177836638 wait complete. 2024-06-13T11:31:47.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:47 smithi002 ceph-mon[32210]: pgmap v245: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:47.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:47 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:31:48.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:47 smithi077 ceph-mon[36410]: pgmap v245: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:48.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:47 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:31:48.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:47 smithi178 ceph-mon[36913]: pgmap v245: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:48.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:47 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:31:48.572 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:31:49.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:48 smithi077 ceph-mon[36410]: scrub queued for path: / 2024-06-13T11:31:49.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:48 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:31:49.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:48 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:31:49.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:48 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:31:49.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:48 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:31:49.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:48 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:31:49.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:48 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:31:49.069 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:31:49.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:48 smithi002 ceph-mon[32210]: scrub queued for path: / 2024-06-13T11:31:49.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:48 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:31:49.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:48 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:31:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:48 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:31:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:48 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:31:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:48 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:31:49.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:48 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:31:49.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:48 smithi178 ceph-mon[36913]: scrub queued for path: / 2024-06-13T11:31:49.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:48 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:31:49.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:48 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:31:49.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:48 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:31:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:48 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:31:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:48 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:31:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:48 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:31:49.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:49 smithi002 ceph-mon[32210]: pgmap v246: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:31:50.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:49 smithi077 ceph-mon[36410]: pgmap v246: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:31:50.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:49 smithi178 ceph-mon[36913]: pgmap v246: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:31:51.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.457+0000 7f51afe00700 1 -- 172.21.15.2:0/4103560079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a8113660 msgr2=0x7f51a8115a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:51.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.457+0000 7f51afe00700 1 --2- 172.21.15.2:0/4103560079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a8113660 0x7f51a8115a50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f51a000b0a0 tx=0x7f51a000b3b0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.457+0000 7f51afe00700 1 -- 172.21.15.2:0/4103560079 shutdown_connections 2024-06-13T11:31:51.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.457+0000 7f51afe00700 1 --2- 172.21.15.2:0/4103560079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a8113660 0x7f51a8115a50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.457+0000 7f51afe00700 1 --2- 172.21.15.2:0/4103560079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a80746c0 0x7f51a8074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.457+0000 7f51afe00700 1 --2- 172.21.15.2:0/4103560079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51a8074fe0 0x7f51a8113120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.457+0000 7f51afe00700 1 -- 172.21.15.2:0/4103560079 >> 172.21.15.2:0/4103560079 conn(0x7f51a80795f0 msgr2=0x7f51a8079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:51.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.458+0000 7f51afe00700 1 -- 172.21.15.2:0/4103560079 shutdown_connections 2024-06-13T11:31:51.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.458+0000 7f51afe00700 1 -- 172.21.15.2:0/4103560079 wait complete. 2024-06-13T11:31:51.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.459+0000 7f51afe00700 1 Processor -- start 2024-06-13T11:31:51.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.459+0000 7f51afe00700 1 -- start start 2024-06-13T11:31:51.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.460+0000 7f51afe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51a80746c0 0x7f51a819f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.460+0000 7f51afe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a8074fe0 0x7f51a819f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.460+0000 7f51afe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a8113660 0x7f51a81a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.460+0000 7f51afe00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f51a8118d80 con 0x7f51a80746c0 2024-06-13T11:31:51.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.460+0000 7f51afe00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f51a8118c00 con 0x7f51a8113660 2024-06-13T11:31:51.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.460+0000 7f51afe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f51a8118f00 con 0x7f51a8074fe0 2024-06-13T11:31:51.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.460+0000 7f51ad400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51a80746c0 0x7f51a819f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.460+0000 7f51aca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a8074fe0 0x7f51a819f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.460+0000 7f51ade00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a8113660 0x7f51a81a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.460+0000 7f51aca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a8074fe0 0x7f51a819f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:36524/0 (socket says 172.21.15.2:36524) 2024-06-13T11:31:51.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.460+0000 7f51aca00700 1 -- 172.21.15.2:0/783687810 learned_addr learned my addr 172.21.15.2:0/783687810 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:51.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.461+0000 7f51aca00700 1 -- 172.21.15.2:0/783687810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a8113660 msgr2=0x7f51a81a3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:51.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.461+0000 7f51aca00700 1 --2- 172.21.15.2:0/783687810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a8113660 0x7f51a81a3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.461+0000 7f51aca00700 1 -- 172.21.15.2:0/783687810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51a80746c0 msgr2=0x7f51a819f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:51.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.461+0000 7f51aca00700 1 --2- 172.21.15.2:0/783687810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51a80746c0 0x7f51a819f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.461+0000 7f51aca00700 1 -- 172.21.15.2:0/783687810 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a81a41e0 con 0x7f51a8074fe0 2024-06-13T11:31:51.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.461+0000 7f51ad400700 1 --2- 172.21.15.2:0/783687810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51a80746c0 0x7f51a819f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:51.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.461+0000 7f51aca00700 1 --2- 172.21.15.2:0/783687810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a8074fe0 0x7f51a819f710 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f519400e9a0 tx=0x7f519400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:51.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.462+0000 7f51a6000700 1 -- 172.21.15.2:0/783687810 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519400ca10 con 0x7f51a8074fe0 2024-06-13T11:31:51.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.462+0000 7f51a6000700 1 -- 172.21.15.2:0/783687810 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f519400cbb0 con 0x7f51a8074fe0 2024-06-13T11:31:51.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.462+0000 7f51a6000700 1 -- 172.21.15.2:0/783687810 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5194018680 con 0x7f51a8074fe0 2024-06-13T11:31:51.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.462+0000 7f51afe00700 1 -- 172.21.15.2:0/783687810 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a81a44d0 con 0x7f51a8074fe0 2024-06-13T11:31:51.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.462+0000 7f51afe00700 1 -- 172.21.15.2:0/783687810 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a81abd50 con 0x7f51a8074fe0 2024-06-13T11:31:51.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.465+0000 7f51a6000700 1 -- 172.21.15.2:0/783687810 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f5194010430 con 0x7f51a8074fe0 2024-06-13T11:31:51.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.466+0000 7f51ba748b80 1 Processor -- start 2024-06-13T11:31:51.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.467+0000 7f51ba748b80 1 -- start start 2024-06-13T11:31:51.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.467+0000 7f51ba748b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a1b90 0x5582e62a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.467+0000 7f51ba748b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e62a24b0 0x5582e629bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.467+0000 7f51ba748b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e629c240 0x5582e629c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.467+0000 7f51ba748b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5582e61aaa10 con 0x5582e62a1b90 2024-06-13T11:31:51.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.467+0000 7f51ba748b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5582e61edb00 con 0x5582e629c240 2024-06-13T11:31:51.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.467+0000 7f51ba748b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5582e61a88f0 con 0x5582e62a24b0 2024-06-13T11:31:51.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.467+0000 7f51ad400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e62a24b0 0x5582e629bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.467+0000 7f51a6000700 1 --2- 172.21.15.2:0/783687810 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f51900a2e90 0x7f51900a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.467+0000 7f51ade00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a1b90 0x5582e62a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.467+0000 7f51ad400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e62a24b0 0x5582e629bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:36540/0 (socket says 172.21.15.2:36540) 2024-06-13T11:31:51.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.467+0000 7f51ad400700 1 -- 172.21.15.2:0/594811776 learned_addr learned my addr 172.21.15.2:0/594811776 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:51.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.468+0000 7f51aca00700 1 --2- 172.21.15.2:0/594811776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e629c240 0x5582e629c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.468+0000 7f51a6000700 1 -- 172.21.15.2:0/783687810 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7f51940cf9a0 con 0x7f51a8074fe0 2024-06-13T11:31:51.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.468+0000 7f51ade00700 1 --2- 172.21.15.2:0/783687810 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f51900a2e90 0x7f51900a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.468+0000 7f51ad400700 1 -- 172.21.15.2:0/594811776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e629c240 msgr2=0x5582e629c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:51.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.468+0000 7f51ad400700 1 --2- 172.21.15.2:0/594811776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e629c240 0x5582e629c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.468+0000 7f51ad400700 1 -- 172.21.15.2:0/594811776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a1b90 msgr2=0x5582e62a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:51.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.468+0000 7f51ad400700 1 --2- 172.21.15.2:0/594811776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a1b90 0x5582e62a1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.468+0000 7f51ad400700 1 -- 172.21.15.2:0/594811776 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582e6195f90 con 0x5582e62a24b0 2024-06-13T11:31:51.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.469+0000 7f51ad400700 1 --2- 172.21.15.2:0/594811776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e62a24b0 0x5582e629bd00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f519c010530 tx=0x7f519c010840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37a4bed063449625 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:51.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.469+0000 7f51ade00700 1 --2- 172.21.15.2:0/783687810 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f51900a2e90 0x7f51900a5350 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f51a0006130 tx=0x7f51a000b3b0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:51.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.469+0000 7f519aa00700 1 -- 172.21.15.2:0/594811776 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c004020 con 0x5582e62a24b0 2024-06-13T11:31:51.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.469+0000 7f519aa00700 1 -- 172.21.15.2:0/594811776 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f519c003680 con 0x5582e62a24b0 2024-06-13T11:31:51.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.469+0000 7f519aa00700 1 -- 172.21.15.2:0/594811776 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c0117e0 con 0x5582e62a24b0 2024-06-13T11:31:51.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.470+0000 7f51ba748b80 1 -- 172.21.15.2:0/594811776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e62a24b0 msgr2=0x5582e629bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:51.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.470+0000 7f51ba748b80 1 --2- 172.21.15.2:0/594811776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e62a24b0 0x5582e629bd00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f519c010530 tx=0x7f519c010840 comp rx=0 tx=0).stop 2024-06-13T11:31:51.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.470+0000 7f51ba748b80 1 -- 172.21.15.2:0/594811776 shutdown_connections 2024-06-13T11:31:51.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.470+0000 7f51ba748b80 1 --2- 172.21.15.2:0/594811776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a1b90 0x5582e62a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.470+0000 7f51ba748b80 1 --2- 172.21.15.2:0/594811776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e629c240 0x5582e629c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.470+0000 7f51ba748b80 1 --2- 172.21.15.2:0/594811776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e62a24b0 0x5582e629bd00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.470+0000 7f51ba748b80 1 -- 172.21.15.2:0/594811776 >> 172.21.15.2:0/594811776 conn(0x5582e61c8170 msgr2=0x5582e6296ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:51.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.470+0000 7f51ba748b80 1 -- 172.21.15.2:0/594811776 shutdown_connections 2024-06-13T11:31:51.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.470+0000 7f51ba748b80 1 -- 172.21.15.2:0/594811776 wait complete. 2024-06-13T11:31:51.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.471+0000 7f51ba748b80 1 -- start start 2024-06-13T11:31:51.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.471+0000 7f51ba748b80 1 Processor -- start 2024-06-13T11:31:51.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.471+0000 7f51ba748b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e629c240 0x5582e62a81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.471+0000 7f51ba748b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a1b90 0x5582e62a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.471+0000 7f51ba748b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e62a24b0 0x5582e62a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.471+0000 7f51ba748b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5582e6189f60 con 0x5582e62a1b90 2024-06-13T11:31:51.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.471+0000 7f51ba748b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5582e61e9ac0 con 0x5582e62a24b0 2024-06-13T11:31:51.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.471+0000 7f51ba748b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5582e62a8e90 con 0x5582e629c240 2024-06-13T11:31:51.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.471+0000 7f51ba748b80 10 client.0 _ll_register_callbacks cb 0x5582e6183380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:31:51.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.472+0000 7f51aca00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a1b90 0x5582e62a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.472+0000 7f51aca00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a1b90 0x5582e62a54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38302/0 (socket says 172.21.15.2:38302) 2024-06-13T11:31:51.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.472+0000 7f51aca00700 1 -- 172.21.15.2:0/1824141402 learned_addr learned my addr 172.21.15.2:0/1824141402 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:51.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.472+0000 7f51ad400700 1 --2- 172.21.15.2:0/1824141402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e629c240 0x5582e62a81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.472+0000 7f51ade00700 1 --2- 172.21.15.2:0/1824141402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e62a24b0 0x5582e62a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.472+0000 7f51aca00700 1 -- 172.21.15.2:0/1824141402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e629c240 msgr2=0x5582e62a81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:51.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.472+0000 7f51aca00700 1 --2- 172.21.15.2:0/1824141402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e629c240 0x5582e62a81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.472+0000 7f51aca00700 1 -- 172.21.15.2:0/1824141402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e62a24b0 msgr2=0x5582e62a5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:51.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.472+0000 7f51aca00700 1 --2- 172.21.15.2:0/1824141402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e62a24b0 0x5582e62a5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.472+0000 7f51aca00700 1 -- 172.21.15.2:0/1824141402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582e613c8d0 con 0x5582e62a1b90 2024-06-13T11:31:51.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.473+0000 7f51aca00700 1 --2- 172.21.15.2:0/1824141402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a1b90 0x5582e62a54d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f519400cfd0 tx=0x7f519401d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc06550f9772120 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:51.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.473+0000 7f518f400700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:31:51.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.473+0000 7f518f400700 1 -- 172.21.15.2:0/1824141402 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519409bf00 con 0x5582e62a1b90 2024-06-13T11:31:51.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.473+0000 7f518f400700 1 -- 172.21.15.2:0/1824141402 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7f51940a4280 con 0x5582e62a1b90 2024-06-13T11:31:51.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.473+0000 7f51ba748b80 1 -- 172.21.15.2:0/1824141402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f519c003680 con 0x5582e62a1b90 2024-06-13T11:31:51.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.473+0000 7f518f400700 1 -- 172.21.15.2:0/1824141402 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f519401d210 con 0x5582e62a1b90 2024-06-13T11:31:51.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.473+0000 7f51ba748b80 10 client.16161 fetch_fsmap learned FSMap version 31 2024-06-13T11:31:51.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.473+0000 7f51ba748b80 1 -- 172.21.15.2:0/1824141402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5582e62b3640 con 0x5582e62a1b90 2024-06-13T11:31:51.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.473+0000 7f518f400700 1 -- 172.21.15.2:0/1824141402 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f519c003680 con 0x5582e62a1b90 2024-06-13T11:31:51.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.474+0000 7f518f400700 1 -- 172.21.15.2:0/1824141402 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f5194010720 con 0x5582e62a1b90 2024-06-13T11:31:51.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.474+0000 7f51ba748b80 10 client.16161 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:31:51.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.474+0000 7f51ba748b80 10 client.16161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:31:51.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.474+0000 7f51ba748b80 20 client.16161 populate_metadata read hostname 'smithi002' 2024-06-13T11:31:51.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.474+0000 7f51ba748b80 1 --2- 172.21.15.2:0/1824141402 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5582e62b5bd0 0x5582e62b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.474+0000 7f51ba748b80 4 client.16161 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:31:51.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.474+0000 7f51ba748b80 1 -- 172.21.15.2:0/1824141402 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582e61fb000 con 0x5582e62b5bd0 2024-06-13T11:31:51.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.474+0000 7f51ad400700 1 --2- 172.21.15.2:0/1824141402 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5582e62b5bd0 0x5582e62b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.475+0000 7f51ad400700 1 --2- 172.21.15.2:0/1824141402 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5582e62b5bd0 0x5582e62b7fc0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=724b7f3b2befb589 server_cookie=34b434d4f320fdee in_seq=0 out_seq=0 2024-06-13T11:31:51.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.475+0000 7f518f400700 10 client.16161 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:31:51.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.476+0000 7f518f400700 1 -- 172.21.15.2:0/1824141402 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5582e61fb000 con 0x5582e62b5bd0 2024-06-13T11:31:51.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.476+0000 7f518f400700 10 client.16161 handle_command_reply: tid=0 2024-06-13T11:31:51.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.476+0000 7f51ba748b80 1 client.16161 shutdown 2024-06-13T11:31:51.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.476+0000 7f51ba748b80 1 -- 172.21.15.2:0/1824141402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a1b90 msgr2=0x5582e62a54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:51.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.476+0000 7f51ba748b80 1 --2- 172.21.15.2:0/1824141402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a1b90 0x5582e62a54d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f519400cfd0 tx=0x7f519401d400 comp rx=0 tx=0).stop 2024-06-13T11:31:51.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.476+0000 7f51ba748b80 1 -- 172.21.15.2:0/1824141402 shutdown_connections 2024-06-13T11:31:51.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.476+0000 7f51ba748b80 1 --2- 172.21.15.2:0/1824141402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e62a24b0 0x5582e62a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.476+0000 7f51ba748b80 1 --2- 172.21.15.2:0/1824141402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e629c240 0x5582e62a81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.476+0000 7f51ba748b80 1 --2- 172.21.15.2:0/1824141402 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5582e62b5bd0 0x5582e62b7fc0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.476+0000 7f51ba748b80 1 --2- 172.21.15.2:0/1824141402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a1b90 0x5582e62a54d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.476+0000 7f518f400700 0 client.16161 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:31:51.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.476+0000 7f51ba748b80 1 -- 172.21.15.2:0/1824141402 >> 172.21.15.2:0/1824141402 conn(0x5582e61c8170 msgr2=0x5582e6290790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:51.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.476+0000 7f51ba748b80 1 -- 172.21.15.2:0/1824141402 shutdown_connections 2024-06-13T11:31:51.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.477+0000 7f51ba748b80 1 -- 172.21.15.2:0/1824141402 wait complete. 2024-06-13T11:31:51.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.477+0000 7f51ba748b80 20 client.16161 trim_cache size 0 max 16384 2024-06-13T11:31:51.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.499+0000 7f51ba748b80 1 Processor -- start 2024-06-13T11:31:51.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.500+0000 7f51ba748b80 1 -- start start 2024-06-13T11:31:51.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.500+0000 7f51ba748b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e629c240 0x5582e629bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.500+0000 7f51ba748b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e62a1b90 0x5582e6291130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.500+0000 7f51ba748b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a24b0 0x5582e62a3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.500+0000 7f51ba748b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f51a81b7490 con 0x5582e62a24b0 2024-06-13T11:31:51.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.500+0000 7f51ba748b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f51a81b4d20 con 0x5582e629c240 2024-06-13T11:31:51.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.500+0000 7f51ba748b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f51a81b2b90 con 0x5582e62a1b90 2024-06-13T11:31:51.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.500+0000 7f51ade00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a24b0 0x5582e62a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.500+0000 7f51aca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e62a1b90 0x5582e6291130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.500+0000 7f51ad400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e629c240 0x5582e629bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.500+0000 7f51ade00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a24b0 0x5582e62a3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38318/0 (socket says 172.21.15.2:38318) 2024-06-13T11:31:51.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.500+0000 7f51ade00700 1 -- 172.21.15.2:0/1118181134 learned_addr learned my addr 172.21.15.2:0/1118181134 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:51.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.501+0000 7f51aca00700 1 -- 172.21.15.2:0/1118181134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e629c240 msgr2=0x5582e629bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:51.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.501+0000 7f51aca00700 1 --2- 172.21.15.2:0/1118181134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e629c240 0x5582e629bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.501+0000 7f51aca00700 1 -- 172.21.15.2:0/1118181134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a24b0 msgr2=0x5582e62a3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:51.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.501+0000 7f51aca00700 1 --2- 172.21.15.2:0/1118181134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a24b0 0x5582e62a3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.501+0000 7f51aca00700 1 -- 172.21.15.2:0/1118181134 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582e62a3a40 con 0x5582e62a1b90 2024-06-13T11:31:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.501+0000 7f51ad400700 1 --2- 172.21.15.2:0/1118181134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e629c240 0x5582e629bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.501+0000 7f51aca00700 1 --2- 172.21.15.2:0/1118181134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e62a1b90 0x5582e6291130 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5194098470 tx=0x7f5194099fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca0d6d9746fb5fa server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.501+0000 7f519a000700 1 -- 172.21.15.2:0/1118181134 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519409fe50 con 0x5582e62a1b90 2024-06-13T11:31:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.502+0000 7f519a000700 1 -- 172.21.15.2:0/1118181134 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51940a4710 con 0x5582e62a1b90 2024-06-13T11:31:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.502+0000 7f519a000700 1 -- 172.21.15.2:0/1118181134 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519409aef0 con 0x5582e62a1b90 2024-06-13T11:31:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.502+0000 7f51ba748b80 1 -- 172.21.15.2:0/1118181134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e62a1b90 msgr2=0x5582e6291130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.502+0000 7f51ba748b80 1 --2- 172.21.15.2:0/1118181134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e62a1b90 0x5582e6291130 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5194098470 tx=0x7f5194099fb0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.502+0000 7f51ba748b80 1 -- 172.21.15.2:0/1118181134 shutdown_connections 2024-06-13T11:31:51.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.502+0000 7f51ba748b80 1 --2- 172.21.15.2:0/1118181134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a24b0 0x5582e62a3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.502+0000 7f51ba748b80 1 --2- 172.21.15.2:0/1118181134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e629c240 0x5582e629bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.502+0000 7f51ba748b80 1 --2- 172.21.15.2:0/1118181134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e62a1b90 0x5582e6291130 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.502+0000 7f51ba748b80 1 -- 172.21.15.2:0/1118181134 >> 172.21.15.2:0/1118181134 conn(0x5582e61c8170 msgr2=0x5582e62a2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:51.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.502+0000 7f51ba748b80 1 -- 172.21.15.2:0/1118181134 shutdown_connections 2024-06-13T11:31:51.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.502+0000 7f51ba748b80 1 -- 172.21.15.2:0/1118181134 wait complete. 2024-06-13T11:31:51.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.503+0000 7f51ba748b80 1 -- start start 2024-06-13T11:31:51.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.503+0000 7f51ba748b80 1 Processor -- start 2024-06-13T11:31:51.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51ba748b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e629c240 0x5582e62bd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51ba748b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e62a1b90 0x5582e62bd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51ba748b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a24b0 0x5582e62bde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51ba748b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f51a81b31e0 con 0x5582e62a24b0 2024-06-13T11:31:51.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51ba748b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f51a81b4650 con 0x5582e62a1b90 2024-06-13T11:31:51.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51ba748b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f51a81b38b0 con 0x5582e629c240 2024-06-13T11:31:51.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51ba748b80 10 client.0 _ll_register_callbacks cb 0x5582e6183380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:31:51.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51ad400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e629c240 0x5582e62bd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51ad400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e629c240 0x5582e62bd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:36554/0 (socket says 172.21.15.2:36554) 2024-06-13T11:31:51.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51ade00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a24b0 0x5582e62bde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51ad400700 1 -- 172.21.15.2:0/3162007325 learned_addr learned my addr 172.21.15.2:0/3162007325 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:31:51.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51aca00700 1 --2- 172.21.15.2:0/3162007325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e62a1b90 0x5582e62bd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51ad400700 1 -- 172.21.15.2:0/3162007325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e62a1b90 msgr2=0x5582e62bd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:51.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51ad400700 1 --2- 172.21.15.2:0/3162007325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e62a1b90 0x5582e62bd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51ad400700 1 -- 172.21.15.2:0/3162007325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a24b0 msgr2=0x5582e62bde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:31:51.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51ad400700 1 --2- 172.21.15.2:0/3162007325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a24b0 0x5582e62bde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51ad400700 1 -- 172.21.15.2:0/3162007325 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582e631f810 con 0x5582e629c240 2024-06-13T11:31:51.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.504+0000 7f51aca00700 1 --2- 172.21.15.2:0/3162007325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e62a1b90 0x5582e62bd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:31:51.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.505+0000 7f51ad400700 1 --2- 172.21.15.2:0/3162007325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e629c240 0x5582e62bd380 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f519c010530 tx=0x7f519c0036f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50fe2472761e7a46 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:31:51.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.505+0000 7f518f400700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:31:51.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.505+0000 7f518f400700 1 -- 172.21.15.2:0/3162007325 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c0054d0 con 0x5582e629c240 2024-06-13T11:31:51.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.505+0000 7f51ba748b80 1 -- 172.21.15.2:0/3162007325 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51940a4710 con 0x5582e629c240 2024-06-13T11:31:51.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.505+0000 7f518f400700 1 -- 172.21.15.2:0/3162007325 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9483+0+0 (secure 0 0 0) 0x7f519c005670 con 0x5582e629c240 2024-06-13T11:31:51.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.505+0000 7f518f400700 1 -- 172.21.15.2:0/3162007325 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f519c0046f0 con 0x5582e629c240 2024-06-13T11:31:51.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.506+0000 7f51ba748b80 10 client.26305 fetch_fsmap learned FSMap version 31 2024-06-13T11:31:51.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.506+0000 7f51ba748b80 1 -- 172.21.15.2:0/3162007325 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5582e6320a40 con 0x5582e629c240 2024-06-13T11:31:51.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.506+0000 7f518f400700 1 -- 172.21.15.2:0/3162007325 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51940a4710 con 0x5582e629c240 2024-06-13T11:31:51.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.506+0000 7f518f400700 1 -- 172.21.15.2:0/3162007325 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f519c02e070 con 0x5582e629c240 2024-06-13T11:31:51.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.506+0000 7f51ba748b80 10 client.26305 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:31:51.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.506+0000 7f51ba748b80 10 client.26305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:31:51.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.506+0000 7f51ba748b80 20 client.26305 populate_metadata read hostname 'smithi002' 2024-06-13T11:31:51.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.506+0000 7f51ba748b80 1 --2- 172.21.15.2:0/3162007325 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5582e6321010 0x5582e6323430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:31:51.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.506+0000 7f51ba748b80 4 client.26305 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:31:51.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.506+0000 7f51ba748b80 1 -- 172.21.15.2:0/3162007325 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5582e61f5580 con 0x5582e6321010 2024-06-13T11:31:51.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.507+0000 7f51aca00700 1 --2- 172.21.15.2:0/3162007325 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5582e6321010 0x5582e6323430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:31:51.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.507+0000 7f51aca00700 1 --2- 172.21.15.2:0/3162007325 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5582e6321010 0x5582e6323430 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f87d5a67f9832b16 server_cookie=2d0d59d45ad46670 in_seq=0 out_seq=0 2024-06-13T11:31:51.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.507+0000 7f518f400700 10 client.26305 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:31:51.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.507+0000 7f518f400700 1 -- 172.21.15.2:0/3162007325 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5582e61f5580 con 0x5582e6321010 2024-06-13T11:31:51.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.507+0000 7f518f400700 10 client.26305 handle_command_reply: tid=0 2024-06-13T11:31:51.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.507+0000 7f51ba748b80 1 client.26305 shutdown 2024-06-13T11:31:51.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.507+0000 7f51ba748b80 1 -- 172.21.15.2:0/3162007325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e629c240 msgr2=0x5582e62bd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:51.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.507+0000 7f51ba748b80 1 --2- 172.21.15.2:0/3162007325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e629c240 0x5582e62bd380 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f519c010530 tx=0x7f519c0036f0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.508+0000 7f51ba748b80 1 -- 172.21.15.2:0/3162007325 shutdown_connections 2024-06-13T11:31:51.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.508+0000 7f51ba748b80 1 --2- 172.21.15.2:0/3162007325 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5582e6321010 0x5582e6323430 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.508+0000 7f51ba748b80 1 --2- 172.21.15.2:0/3162007325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5582e62a24b0 0x5582e62bde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.508+0000 7f51ba748b80 1 --2- 172.21.15.2:0/3162007325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5582e629c240 0x5582e62bd380 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.508+0000 7f51ba748b80 1 --2- 172.21.15.2:0/3162007325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5582e62a1b90 0x5582e62bd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.508+0000 7f51ba748b80 1 -- 172.21.15.2:0/3162007325 >> 172.21.15.2:0/3162007325 conn(0x5582e61c8170 msgr2=0x5582e62a0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:51.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.508+0000 7f518f400700 0 client.26305 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:31:51.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.508+0000 7f51ba748b80 1 -- 172.21.15.2:0/3162007325 shutdown_connections 2024-06-13T11:31:51.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.508+0000 7f51ba748b80 1 -- 172.21.15.2:0/3162007325 wait complete. 2024-06-13T11:31:51.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.508+0000 7f51ba748b80 20 client.26305 trim_cache size 0 max 16384 2024-06-13T11:31:51.514 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:31:51.515 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-13T11:31:51.515 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-06-13T11:31:51.515 INFO:teuthology.orchestra.run.smithi002.stdout: "a9a32da9-6720-4b93-be71-bde7ec688aaa": { 2024-06-13T11:31:51.515 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-06-13T11:31:51.515 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "a9a32da9-6720-4b93-be71-bde7ec688aaa", 2024-06-13T11:31:51.515 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-06-13T11:31:51.515 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:31:51.516 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:31:51.516 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:31:51.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.509+0000 7f51afe00700 1 -- 172.21.15.2:0/783687810 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f51900a2e90 msgr2=0x7f51900a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:51.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.509+0000 7f51afe00700 1 --2- 172.21.15.2:0/783687810 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f51900a2e90 0x7f51900a5350 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f51a0006130 tx=0x7f51a000b3b0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.509+0000 7f51afe00700 1 -- 172.21.15.2:0/783687810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a8074fe0 msgr2=0x7f51a819f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:31:51.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.509+0000 7f51afe00700 1 --2- 172.21.15.2:0/783687810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a8074fe0 0x7f51a819f710 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f519400e9a0 tx=0x7f519400ecb0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.509+0000 7f51afe00700 1 -- 172.21.15.2:0/783687810 shutdown_connections 2024-06-13T11:31:51.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.509+0000 7f51afe00700 1 --2- 172.21.15.2:0/783687810 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f51900a2e90 0x7f51900a5350 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.509+0000 7f51afe00700 1 --2- 172.21.15.2:0/783687810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51a80746c0 0x7f51a819f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.509+0000 7f51afe00700 1 --2- 172.21.15.2:0/783687810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51a8113660 0x7f51a81a3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.509+0000 7f51afe00700 1 --2- 172.21.15.2:0/783687810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a8074fe0 0x7f51a819f710 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:31:51.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.509+0000 7f51afe00700 1 -- 172.21.15.2:0/783687810 >> 172.21.15.2:0/783687810 conn(0x7f51a80795f0 msgr2=0x7f51a8112350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:31:51.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.509+0000 7f51afe00700 1 -- 172.21.15.2:0/783687810 shutdown_connections 2024-06-13T11:31:51.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:31:51.509+0000 7f51afe00700 1 -- 172.21.15.2:0/783687810 wait complete. 2024-06-13T11:31:51.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:51 smithi002 ceph-mon[32210]: pgmap v247: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:52.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:51 smithi077 ceph-mon[36410]: pgmap v247: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:52.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:51 smithi178 ceph-mon[36913]: pgmap v247: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:31:52.436 INFO:tasks.cephfs.filesystem:scrub status for tag:a9a32da9-6720-4b93-be71-bde7ec688aaa - {'path': '/', 'tag': 'a9a32da9-6720-4b93-be71-bde7ec688aaa', 'options': 'recursive,force'} 2024-06-13T11:31:54.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:53 smithi077 ceph-mon[36410]: pgmap v248: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:31:54.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:53 smithi002 ceph-mon[32210]: pgmap v248: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:31:54.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:53 smithi178 ceph-mon[36913]: pgmap v248: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:31:56.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:55 smithi077 ceph-mon[36410]: pgmap v249: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:31:56.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:55 smithi002 ceph-mon[32210]: pgmap v249: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:31:56.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:55 smithi178 ceph-mon[36913]: pgmap v249: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:31:57.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:56 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:31:57.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:56 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:31:57.046 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:56 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:31:57.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:56 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:31:57.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:56 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:31:57.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:56 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:31:58.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:57 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:31:58.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:57 smithi077 ceph-mon[36410]: pgmap v250: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:31:58.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:57 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:31:58.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:57 smithi002 ceph-mon[32210]: pgmap v250: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:31:58.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:57 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:31:58.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:57 smithi178 ceph-mon[36913]: pgmap v250: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:31:59.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:31:58 smithi002 ceph-mon[32210]: pgmap v251: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:31:59.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:31:58 smithi178 ceph-mon[36913]: pgmap v251: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:31:59.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:31:58 smithi077 ceph-mon[36410]: pgmap v251: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:32:01.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:01 smithi178 ceph-mon[36913]: pgmap v252: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:32:01.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:01 smithi077 ceph-mon[36410]: pgmap v252: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:32:01.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:01 smithi002 ceph-mon[32210]: pgmap v252: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:32:03.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:03 smithi178 ceph-mon[36913]: pgmap v253: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-06-13T11:32:03.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:03 smithi077 ceph-mon[36410]: pgmap v253: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-06-13T11:32:03.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:03 smithi002 ceph-mon[32210]: pgmap v253: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-06-13T11:32:05.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:05 smithi077 ceph-mon[36410]: pgmap v254: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:32:05.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:05 smithi002 ceph-mon[32210]: pgmap v254: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:32:05.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:05 smithi178 ceph-mon[36913]: pgmap v254: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:32:07.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:07 smithi077 ceph-mon[36410]: pgmap v255: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:32:07.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:07 smithi077 ceph-mon[36410]: osdmap e103: 12 total, 12 up, 12 in 2024-06-13T11:32:07.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:07 smithi002 ceph-mon[32210]: pgmap v255: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:32:07.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:07 smithi002 ceph-mon[32210]: osdmap e103: 12 total, 12 up, 12 in 2024-06-13T11:32:07.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:07 smithi178 ceph-mon[36913]: pgmap v255: 129 pgs: 129 active+clean; 83 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:32:07.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:07 smithi178 ceph-mon[36913]: osdmap e103: 12 total, 12 up, 12 in 2024-06-13T11:32:09.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:09 smithi077 ceph-mon[36410]: pgmap v257: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-06-13T11:32:09.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:09 smithi077 ceph-mon[36410]: osdmap e104: 12 total, 12 up, 12 in 2024-06-13T11:32:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:09 smithi002 ceph-mon[32210]: pgmap v257: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-06-13T11:32:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:09 smithi002 ceph-mon[32210]: osdmap e104: 12 total, 12 up, 12 in 2024-06-13T11:32:09.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:09 smithi178 ceph-mon[36913]: pgmap v257: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-06-13T11:32:09.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:09 smithi178 ceph-mon[36913]: osdmap e104: 12 total, 12 up, 12 in 2024-06-13T11:32:11.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:11 smithi077 ceph-mon[36410]: pgmap v259: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-06-13T11:32:11.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:11 smithi002 ceph-mon[32210]: pgmap v259: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-06-13T11:32:11.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:11 smithi178 ceph-mon[36913]: pgmap v259: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-06-13T11:32:13.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:13 smithi077 ceph-mon[36410]: pgmap v260: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:32:13.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:13 smithi002 ceph-mon[32210]: pgmap v260: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:32:13.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:13 smithi178 ceph-mon[36913]: pgmap v260: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:32:15.748 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:15 smithi178 ceph-mon[36913]: pgmap v261: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:32:15.748 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:15 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:32:15.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:15 smithi077 ceph-mon[36410]: pgmap v261: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:32:15.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:15 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:32:15.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:15 smithi002 ceph-mon[32210]: pgmap v261: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:32:15.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:15 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:32:17.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:16 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:32:17.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:16 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:32:17.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:16 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:32:17.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:16 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:32:17.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:16 smithi077 ceph-mon[36410]: pgmap v262: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2024-06-13T11:32:17.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:16 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:32:17.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:16 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:32:17.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:16 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:32:17.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:16 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:32:17.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:16 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:32:17.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:16 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:32:17.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:16 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:32:17.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:16 smithi002 ceph-mon[32210]: pgmap v262: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2024-06-13T11:32:17.396 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:16 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:32:17.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:16 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:32:17.397 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:16 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:32:17.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:16 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:32:17.446 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:16 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:32:17.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:16 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:32:17.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:16 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:32:17.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:16 smithi178 ceph-mon[36913]: pgmap v262: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2024-06-13T11:32:17.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:16 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:32:17.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:16 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:32:17.447 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:16 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:32:19.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:19 smithi077 ceph-mon[36410]: pgmap v263: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-06-13T11:32:19.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:19 smithi002 ceph-mon[32210]: pgmap v263: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-06-13T11:32:19.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:19 smithi178 ceph-mon[36913]: pgmap v263: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-06-13T11:32:21.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:21 smithi077 ceph-mon[36410]: pgmap v264: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 91 B/s wr, 5 op/s 2024-06-13T11:32:21.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:21 smithi002 ceph-mon[32210]: pgmap v264: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 91 B/s wr, 5 op/s 2024-06-13T11:32:21.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:21 smithi178 ceph-mon[36913]: pgmap v264: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 91 B/s wr, 5 op/s 2024-06-13T11:32:22.438 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:32:22.925 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:32:23.639 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:23 smithi002 ceph-mon[32210]: pgmap v265: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:32:23.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:23 smithi077 ceph-mon[36410]: pgmap v265: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:32:23.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:23 smithi178 ceph-mon[36913]: pgmap v265: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:32:25.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.500+0000 7fd9d9c00700 1 -- 172.21.15.2:0/468316628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9d406a170 msgr2=0x7fd9d406a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:25.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.500+0000 7fd9d9c00700 1 --2- 172.21.15.2:0/468316628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9d406a170 0x7fd9d406a5d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc009990 tx=0x7fd9bc009ca0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.500+0000 7fd9d9c00700 1 -- 172.21.15.2:0/468316628 shutdown_connections 2024-06-13T11:32:25.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.500+0000 7fd9d9c00700 1 --2- 172.21.15.2:0/468316628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9d41084e0 0x7fd9d41088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.500+0000 7fd9d9c00700 1 --2- 172.21.15.2:0/468316628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9d406ab10 0x7fd9d410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.500+0000 7fd9d9c00700 1 --2- 172.21.15.2:0/468316628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9d406a170 0x7fd9d406a5d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.500+0000 7fd9d9c00700 1 -- 172.21.15.2:0/468316628 >> 172.21.15.2:0/468316628 conn(0x7fd9d40782c0 msgr2=0x7fd9d40786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:25.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.500+0000 7fd9d9c00700 1 -- 172.21.15.2:0/468316628 shutdown_connections 2024-06-13T11:32:25.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.500+0000 7fd9d9c00700 1 -- 172.21.15.2:0/468316628 wait complete. 2024-06-13T11:32:25.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.501+0000 7fd9d9c00700 1 Processor -- start 2024-06-13T11:32:25.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.501+0000 7fd9d9c00700 1 -- start start 2024-06-13T11:32:25.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.502+0000 7fd9d9c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9d406a170 0x7fd9d419e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.502+0000 7fd9d9c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9d406ab10 0x7fd9d419edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.502+0000 7fd9d9c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9d41084e0 0x7fd9d4198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.502+0000 7fd9d9c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d4112790 con 0x7fd9d406a170 2024-06-13T11:32:25.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.502+0000 7fd9d9c00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d4112610 con 0x7fd9d406ab10 2024-06-13T11:32:25.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.502+0000 7fd9d9c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d4112910 con 0x7fd9d41084e0 2024-06-13T11:32:25.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.502+0000 7fd9d2a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9d406a170 0x7fd9d419e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.502+0000 7fd9cbe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9d406ab10 0x7fd9d419edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.502+0000 7fd9d3400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9d41084e0 0x7fd9d4198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.502+0000 7fd9d2a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9d406a170 0x7fd9d419e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36714/0 (socket says 172.21.15.2:36714) 2024-06-13T11:32:25.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.502+0000 7fd9d2a00700 1 -- 172.21.15.2:0/23100514 learned_addr learned my addr 172.21.15.2:0/23100514 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:25.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.503+0000 7fd9d3400700 1 -- 172.21.15.2:0/23100514 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9d406ab10 msgr2=0x7fd9d419edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:25.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.503+0000 7fd9d3400700 1 --2- 172.21.15.2:0/23100514 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9d406ab10 0x7fd9d419edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.503+0000 7fd9d3400700 1 -- 172.21.15.2:0/23100514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9d406a170 msgr2=0x7fd9d419e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:25.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.503+0000 7fd9d3400700 1 --2- 172.21.15.2:0/23100514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9d406a170 0x7fd9d419e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.503+0000 7fd9d3400700 1 -- 172.21.15.2:0/23100514 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d41991b0 con 0x7fd9d41084e0 2024-06-13T11:32:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.503+0000 7fd9d3400700 1 --2- 172.21.15.2:0/23100514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9d41084e0 0x7fd9d4198a50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc007f10 tx=0x7fd9cc00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.503+0000 7fd9cb400700 1 -- 172.21.15.2:0/23100514 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc004db0 con 0x7fd9d41084e0 2024-06-13T11:32:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.503+0000 7fd9cb400700 1 -- 172.21.15.2:0/23100514 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9cc009e20 con 0x7fd9d41084e0 2024-06-13T11:32:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.503+0000 7fd9d9c00700 1 -- 172.21.15.2:0/23100514 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d41994a0 con 0x7fd9d41084e0 2024-06-13T11:32:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.503+0000 7fd9cb400700 1 -- 172.21.15.2:0/23100514 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc015400 con 0x7fd9d41084e0 2024-06-13T11:32:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.504+0000 7fd9d9c00700 1 -- 172.21.15.2:0/23100514 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d4101390 con 0x7fd9d41084e0 2024-06-13T11:32:25.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.507+0000 7fd9cb400700 1 -- 172.21.15.2:0/23100514 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fd9cc00db20 con 0x7fd9d41084e0 2024-06-13T11:32:25.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.508+0000 7fd9e4525b80 1 Processor -- start 2024-06-13T11:32:25.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.508+0000 7fd9cb400700 1 --2- 172.21.15.2:0/23100514 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9b80a2e10 0x7fd9b80a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.509+0000 7fd9e4525b80 1 -- start start 2024-06-13T11:32:25.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.509+0000 7fd9cb400700 1 -- 172.21.15.2:0/23100514 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7fd9cc0cf140 con 0x7fd9d41084e0 2024-06-13T11:32:25.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.509+0000 7fd9cbe00700 1 --2- 172.21.15.2:0/23100514 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9b80a2e10 0x7fd9b80a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.509+0000 7fd9e4525b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33fb90 0x55a98d33ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.509+0000 7fd9e4525b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d3404b0 0x55a98d339d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.509+0000 7fd9e4525b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d33a240 0x55a98d33a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.509+0000 7fd9e4525b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a98d248a10 con 0x55a98d3404b0 2024-06-13T11:32:25.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.509+0000 7fd9e4525b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a98d28bb00 con 0x55a98d33a240 2024-06-13T11:32:25.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.509+0000 7fd9e4525b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a98d2468f0 con 0x55a98d33fb90 2024-06-13T11:32:25.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.510+0000 7fd9d2a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33fb90 0x55a98d33ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.510+0000 7fd9d3400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d33a240 0x55a98d33a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.510+0000 7fd9d2a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33fb90 0x55a98d33ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:37082/0 (socket says 172.21.15.2:37082) 2024-06-13T11:32:25.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.510+0000 7fd9d3400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d33a240 0x55a98d33a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:40054/0 (socket says 172.21.15.2:40054) 2024-06-13T11:32:25.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.510+0000 7fd9d2a00700 1 -- 172.21.15.2:0/321322670 learned_addr learned my addr 172.21.15.2:0/321322670 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:25.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.510+0000 7fd9cbe00700 1 --2- 172.21.15.2:0/321322670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d3404b0 0x55a98d339d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.510+0000 7fd9d3400700 1 -- 172.21.15.2:0/321322670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33fb90 msgr2=0x55a98d33ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:25.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.510+0000 7fd9d3400700 1 --2- 172.21.15.2:0/321322670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33fb90 0x55a98d33ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.510+0000 7fd9d3400700 1 -- 172.21.15.2:0/321322670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d3404b0 msgr2=0x55a98d339d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:25.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.510+0000 7fd9d3400700 1 --2- 172.21.15.2:0/321322670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d3404b0 0x55a98d339d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.510+0000 7fd9d3400700 1 -- 172.21.15.2:0/321322670 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a98d233f90 con 0x55a98d33a240 2024-06-13T11:32:25.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.510+0000 7fd9cbe00700 1 --2- 172.21.15.2:0/23100514 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9b80a2e10 0x7fd9b80a52d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4107fd0 tx=0x7fd9bc00b610 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:25.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.511+0000 7fd9d3400700 1 --2- 172.21.15.2:0/321322670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d33a240 0x55a98d33a680 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0cc470 tx=0x7fd9cc09b140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a4569fa7d4e2b49 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:25.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.511+0000 7fd9c3e00700 1 -- 172.21.15.2:0/321322670 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0a3eb0 con 0x55a98d33a240 2024-06-13T11:32:25.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.511+0000 7fd9c3e00700 1 -- 172.21.15.2:0/321322670 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9cc00de10 con 0x55a98d33a240 2024-06-13T11:32:25.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.511+0000 7fd9c3e00700 1 -- 172.21.15.2:0/321322670 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0bb320 con 0x55a98d33a240 2024-06-13T11:32:25.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.512+0000 7fd9e4525b80 1 -- 172.21.15.2:0/321322670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d33a240 msgr2=0x55a98d33a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:25.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.512+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/321322670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d33a240 0x55a98d33a680 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0cc470 tx=0x7fd9cc09b140 comp rx=0 tx=0).stop 2024-06-13T11:32:25.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.512+0000 7fd9e4525b80 1 -- 172.21.15.2:0/321322670 shutdown_connections 2024-06-13T11:32:25.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.512+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/321322670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d33a240 0x55a98d33a680 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.512+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/321322670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33fb90 0x55a98d33ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.512+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/321322670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d3404b0 0x55a98d339d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.512+0000 7fd9e4525b80 1 -- 172.21.15.2:0/321322670 >> 172.21.15.2:0/321322670 conn(0x55a98d266170 msgr2=0x55a98d334ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:25.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.512+0000 7fd9e4525b80 1 -- 172.21.15.2:0/321322670 shutdown_connections 2024-06-13T11:32:25.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.512+0000 7fd9e4525b80 1 -- 172.21.15.2:0/321322670 wait complete. 2024-06-13T11:32:25.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.513+0000 7fd9e4525b80 1 -- start start 2024-06-13T11:32:25.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.513+0000 7fd9e4525b80 1 Processor -- start 2024-06-13T11:32:25.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.513+0000 7fd9e4525b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d33a240 0x55a98d346340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.513+0000 7fd9e4525b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33fb90 0x55a98d343640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.514+0000 7fd9e4525b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d3404b0 0x55a98d343b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.514+0000 7fd9e4525b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a98d227f60 con 0x55a98d33a240 2024-06-13T11:32:25.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.514+0000 7fd9e4525b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a98d287ac0 con 0x55a98d3404b0 2024-06-13T11:32:25.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.514+0000 7fd9e4525b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a98d346e90 con 0x55a98d33fb90 2024-06-13T11:32:25.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.514+0000 7fd9e4525b80 10 client.0 _ll_register_callbacks cb 0x55a98d221380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:32:25.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.514+0000 7fd9d2a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d33a240 0x55a98d346340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.514+0000 7fd9d2a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d33a240 0x55a98d346340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36730/0 (socket says 172.21.15.2:36730) 2024-06-13T11:32:25.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.514+0000 7fd9d2a00700 1 -- 172.21.15.2:0/177613419 learned_addr learned my addr 172.21.15.2:0/177613419 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:25.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.514+0000 7fd9cbe00700 1 --2- 172.21.15.2:0/177613419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33fb90 0x55a98d343640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.514+0000 7fd9d3400700 1 --2- 172.21.15.2:0/177613419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d3404b0 0x55a98d343b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.514+0000 7fd9cbe00700 1 -- 172.21.15.2:0/177613419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d3404b0 msgr2=0x55a98d343b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:25.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.514+0000 7fd9cbe00700 1 --2- 172.21.15.2:0/177613419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d3404b0 0x55a98d343b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.514+0000 7fd9cbe00700 1 -- 172.21.15.2:0/177613419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d33a240 msgr2=0x55a98d346340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:25.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.514+0000 7fd9cbe00700 1 --2- 172.21.15.2:0/177613419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d33a240 0x55a98d346340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.515+0000 7fd9cbe00700 1 -- 172.21.15.2:0/177613419 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a98d1da8d0 con 0x55a98d33fb90 2024-06-13T11:32:25.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.515+0000 7fd9cbe00700 1 --2- 172.21.15.2:0/177613419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33fb90 0x55a98d343640 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc006010 tx=0x7fd9bc009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=853dd1f526516409 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:25.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.515+0000 7fd9c0c00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:32:25.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.515+0000 7fd9c0c00700 1 -- 172.21.15.2:0/177613419 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc035060 con 0x55a98d33fb90 2024-06-13T11:32:25.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.515+0000 7fd9e4525b80 1 -- 172.21.15.2:0/177613419 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9cc00de10 con 0x55a98d33fb90 2024-06-13T11:32:25.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.515+0000 7fd9c0c00700 1 -- 172.21.15.2:0/177613419 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7fd9bc021070 con 0x55a98d33fb90 2024-06-13T11:32:25.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.516+0000 7fd9c0c00700 1 -- 172.21.15.2:0/177613419 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd9bc03c050 con 0x55a98d33fb90 2024-06-13T11:32:25.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.516+0000 7fd9e4525b80 10 client.26317 fetch_fsmap learned FSMap version 31 2024-06-13T11:32:25.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.516+0000 7fd9e4525b80 1 -- 172.21.15.2:0/177613419 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a98d351710 con 0x55a98d33fb90 2024-06-13T11:32:25.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.516+0000 7fd9c0c00700 1 -- 172.21.15.2:0/177613419 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9cc00de10 con 0x55a98d33fb90 2024-06-13T11:32:25.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.516+0000 7fd9c0c00700 1 -- 172.21.15.2:0/177613419 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fd9bc00fa10 con 0x55a98d33fb90 2024-06-13T11:32:25.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.516+0000 7fd9e4525b80 10 client.26317 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:32:25.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.516+0000 7fd9e4525b80 10 client.26317 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:32:25.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.516+0000 7fd9e4525b80 20 client.26317 populate_metadata read hostname 'smithi002' 2024-06-13T11:32:25.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.516+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/177613419 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a98d353d50 0x55a98d356140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.516+0000 7fd9e4525b80 4 client.26317 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:32:25.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.516+0000 7fd9e4525b80 1 -- 172.21.15.2:0/177613419 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a98d299000 con 0x55a98d353d50 2024-06-13T11:32:25.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.517+0000 7fd9d2a00700 1 --2- 172.21.15.2:0/177613419 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a98d353d50 0x55a98d356140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.517+0000 7fd9d2a00700 1 --2- 172.21.15.2:0/177613419 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a98d353d50 0x55a98d356140 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6fd304d14edcdb server_cookie=9255c1422eb104b9 in_seq=0 out_seq=0 2024-06-13T11:32:25.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.517+0000 7fd9c0c00700 10 client.26317 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:32:25.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.518+0000 7fd9c0c00700 1 -- 172.21.15.2:0/177613419 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a98d299000 con 0x55a98d353d50 2024-06-13T11:32:25.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.518+0000 7fd9c0c00700 10 client.26317 handle_command_reply: tid=0 2024-06-13T11:32:25.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.518+0000 7fd9e4525b80 1 client.26317 shutdown 2024-06-13T11:32:25.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.518+0000 7fd9e4525b80 1 -- 172.21.15.2:0/177613419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33fb90 msgr2=0x55a98d343640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:25.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.518+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/177613419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33fb90 0x55a98d343640 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc006010 tx=0x7fd9bc009ca0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.519+0000 7fd9e4525b80 1 -- 172.21.15.2:0/177613419 shutdown_connections 2024-06-13T11:32:25.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.519+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/177613419 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a98d353d50 0x55a98d356140 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.519+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/177613419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d33a240 0x55a98d346340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.519+0000 7fd9c0c00700 0 client.26317 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:32:25.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.519+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/177613419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d3404b0 0x55a98d343b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.519+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/177613419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33fb90 0x55a98d343640 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.519+0000 7fd9e4525b80 1 -- 172.21.15.2:0/177613419 >> 172.21.15.2:0/177613419 conn(0x55a98d266170 msgr2=0x55a98d32e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:25.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.519+0000 7fd9e4525b80 1 -- 172.21.15.2:0/177613419 shutdown_connections 2024-06-13T11:32:25.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.519+0000 7fd9e4525b80 1 -- 172.21.15.2:0/177613419 wait complete. 2024-06-13T11:32:25.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.519+0000 7fd9e4525b80 20 client.26317 trim_cache size 0 max 16384 2024-06-13T11:32:25.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.542+0000 7fd9e4525b80 1 Processor -- start 2024-06-13T11:32:25.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.542+0000 7fd9e4525b80 1 -- start start 2024-06-13T11:32:25.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.542+0000 7fd9e4525b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33a240 0x55a98d34ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.542+0000 7fd9e4525b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d33fb90 0x55a98d335160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.542+0000 7fd9e4525b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d3404b0 0x55a98d32f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.542+0000 7fd9e4525b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d41b2fe0 con 0x55a98d3404b0 2024-06-13T11:32:25.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.542+0000 7fd9e4525b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d41b0870 con 0x55a98d33fb90 2024-06-13T11:32:25.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.542+0000 7fd9e4525b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d41ae700 con 0x55a98d33a240 2024-06-13T11:32:25.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.543+0000 7fd9d2a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33a240 0x55a98d34ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.543+0000 7fd9d3400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d3404b0 0x55a98d32f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.543+0000 7fd9d2a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33a240 0x55a98d34ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:37098/0 (socket says 172.21.15.2:37098) 2024-06-13T11:32:25.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.543+0000 7fd9d2a00700 1 -- 172.21.15.2:0/2005859495 learned_addr learned my addr 172.21.15.2:0/2005859495 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:25.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.543+0000 7fd9cbe00700 1 --2- 172.21.15.2:0/2005859495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d33fb90 0x55a98d335160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.543+0000 7fd9d2a00700 1 -- 172.21.15.2:0/2005859495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d33fb90 msgr2=0x55a98d335160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:25.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.543+0000 7fd9d2a00700 1 --2- 172.21.15.2:0/2005859495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d33fb90 0x55a98d335160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.543+0000 7fd9d2a00700 1 -- 172.21.15.2:0/2005859495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d3404b0 msgr2=0x55a98d32f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:25.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.543+0000 7fd9d2a00700 1 --2- 172.21.15.2:0/2005859495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d3404b0 0x55a98d32f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.543+0000 7fd9d2a00700 1 -- 172.21.15.2:0/2005859495 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a98d341bb0 con 0x55a98d33a240 2024-06-13T11:32:25.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.543+0000 7fd9d2a00700 1 --2- 172.21.15.2:0/2005859495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33a240 0x55a98d34ffb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4000c00 tx=0x7fd9c4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfe9abef0c8a13c7 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:25.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.544+0000 7fd9c3400700 1 -- 172.21.15.2:0/2005859495 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4010d70 con 0x55a98d33a240 2024-06-13T11:32:25.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.544+0000 7fd9c3400700 1 -- 172.21.15.2:0/2005859495 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9c4004500 con 0x55a98d33a240 2024-06-13T11:32:25.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.544+0000 7fd9c3400700 1 -- 172.21.15.2:0/2005859495 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4005280 con 0x55a98d33a240 2024-06-13T11:32:25.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.544+0000 7fd9e4525b80 1 -- 172.21.15.2:0/2005859495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33a240 msgr2=0x55a98d34ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:25.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.544+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/2005859495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33a240 0x55a98d34ffb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4000c00 tx=0x7fd9c4009260 comp rx=0 tx=0).stop 2024-06-13T11:32:25.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.545+0000 7fd9e4525b80 1 -- 172.21.15.2:0/2005859495 shutdown_connections 2024-06-13T11:32:25.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.545+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/2005859495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d3404b0 0x55a98d32f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.545+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/2005859495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33a240 0x55a98d34ffb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.545+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/2005859495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d33fb90 0x55a98d335160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.545+0000 7fd9e4525b80 1 -- 172.21.15.2:0/2005859495 >> 172.21.15.2:0/2005859495 conn(0x55a98d266170 msgr2=0x55a98d340fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:25.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.545+0000 7fd9e4525b80 1 -- 172.21.15.2:0/2005859495 shutdown_connections 2024-06-13T11:32:25.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.545+0000 7fd9e4525b80 1 -- 172.21.15.2:0/2005859495 wait complete. 2024-06-13T11:32:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.545+0000 7fd9e4525b80 1 -- start start 2024-06-13T11:32:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.545+0000 7fd9e4525b80 1 Processor -- start 2024-06-13T11:32:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.546+0000 7fd9e4525b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33a240 0x55a98d34c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.546+0000 7fd9e4525b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d33fb90 0x55a98d34c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.546+0000 7fd9e4525b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d3404b0 0x55a98d3490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.546+0000 7fd9e4525b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d41aed50 con 0x55a98d33fb90 2024-06-13T11:32:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.546+0000 7fd9e4525b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d41b01a0 con 0x55a98d3404b0 2024-06-13T11:32:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.546+0000 7fd9e4525b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d41af400 con 0x55a98d33a240 2024-06-13T11:32:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.546+0000 7fd9e4525b80 10 client.0 _ll_register_callbacks cb 0x55a98d221380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:32:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.546+0000 7fd9d2a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33a240 0x55a98d34c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.546+0000 7fd9cbe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d33fb90 0x55a98d34c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.546+0000 7fd9d2a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33a240 0x55a98d34c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:37110/0 (socket says 172.21.15.2:37110) 2024-06-13T11:32:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.546+0000 7fd9d2a00700 1 -- 172.21.15.2:0/3191656772 learned_addr learned my addr 172.21.15.2:0/3191656772 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.547+0000 7fd9d3400700 1 --2- 172.21.15.2:0/3191656772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d3404b0 0x55a98d3490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.547+0000 7fd9cbe00700 1 -- 172.21.15.2:0/3191656772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33a240 msgr2=0x55a98d34c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.547+0000 7fd9cbe00700 1 --2- 172.21.15.2:0/3191656772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33a240 0x55a98d34c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.547+0000 7fd9cbe00700 1 -- 172.21.15.2:0/3191656772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d3404b0 msgr2=0x55a98d3490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:25.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.547+0000 7fd9cbe00700 1 --2- 172.21.15.2:0/3191656772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d3404b0 0x55a98d3490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.547+0000 7fd9cbe00700 1 -- 172.21.15.2:0/3191656772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a98d3496e0 con 0x55a98d33fb90 2024-06-13T11:32:25.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.547+0000 7fd9d3400700 1 --2- 172.21.15.2:0/3191656772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d3404b0 0x55a98d3490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:32:25.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.547+0000 7fd9d2a00700 1 --2- 172.21.15.2:0/3191656772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33a240 0x55a98d34c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:32:25.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.547+0000 7fd9cbe00700 1 --2- 172.21.15.2:0/3191656772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d33fb90 0x55a98d34c660 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00fe60 tx=0x7fd9bc00b2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1ec12b27bd7899 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:25.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.547+0000 7fd9c0c00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:32:25.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.548+0000 7fd9c0c00700 1 -- 172.21.15.2:0/3191656772 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc035040 con 0x55a98d33fb90 2024-06-13T11:32:25.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.548+0000 7fd9c0c00700 1 -- 172.21.15.2:0/3191656772 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7fd9bc021050 con 0x55a98d33fb90 2024-06-13T11:32:25.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.548+0000 7fd9e4525b80 1 -- 172.21.15.2:0/3191656772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9c4004500 con 0x55a98d33fb90 2024-06-13T11:32:25.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.548+0000 7fd9c0c00700 1 -- 172.21.15.2:0/3191656772 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd9bc052050 con 0x55a98d33fb90 2024-06-13T11:32:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.548+0000 7fd9e4525b80 10 client.16185 fetch_fsmap learned FSMap version 31 2024-06-13T11:32:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.548+0000 7fd9e4525b80 1 -- 172.21.15.2:0/3191656772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a98d3bf220 con 0x55a98d33fb90 2024-06-13T11:32:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.549+0000 7fd9c0c00700 1 -- 172.21.15.2:0/3191656772 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9c4004500 con 0x55a98d33fb90 2024-06-13T11:32:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.549+0000 7fd9c0c00700 1 -- 172.21.15.2:0/3191656772 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fd9bc049470 con 0x55a98d33fb90 2024-06-13T11:32:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.549+0000 7fd9e4525b80 10 client.16185 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:32:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.549+0000 7fd9e4525b80 10 client.16185 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:32:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.549+0000 7fd9e4525b80 20 client.16185 populate_metadata read hostname 'smithi002' 2024-06-13T11:32:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.549+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/3191656772 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a98d3bf8c0 0x55a98d3c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.549+0000 7fd9e4525b80 4 client.16185 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:32:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.549+0000 7fd9e4525b80 1 -- 172.21.15.2:0/3191656772 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a98d293580 con 0x55a98d3bf8c0 2024-06-13T11:32:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.550+0000 7fd9d2a00700 1 --2- 172.21.15.2:0/3191656772 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a98d3bf8c0 0x55a98d3c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.550+0000 7fd9d2a00700 1 --2- 172.21.15.2:0/3191656772 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a98d3bf8c0 0x55a98d3c1ce0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80fe11a64c7b5bd7 server_cookie=cfcc530d9f93500a in_seq=0 out_seq=0 2024-06-13T11:32:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.550+0000 7fd9c0c00700 10 client.16185 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:32:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.551+0000 7fd9c0c00700 1 -- 172.21.15.2:0/3191656772 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a98d293580 con 0x55a98d3bf8c0 2024-06-13T11:32:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.551+0000 7fd9c0c00700 10 client.16185 handle_command_reply: tid=0 2024-06-13T11:32:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.551+0000 7fd9e4525b80 1 client.16185 shutdown 2024-06-13T11:32:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.551+0000 7fd9e4525b80 1 -- 172.21.15.2:0/3191656772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d33fb90 msgr2=0x55a98d34c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.551+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/3191656772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d33fb90 0x55a98d34c660 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00fe60 tx=0x7fd9bc00b2f0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.551+0000 7fd9e4525b80 1 -- 172.21.15.2:0/3191656772 shutdown_connections 2024-06-13T11:32:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.551+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/3191656772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a98d3404b0 0x55a98d3490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.551+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/3191656772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a98d33a240 0x55a98d34c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.551+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/3191656772 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55a98d3bf8c0 0x55a98d3c1ce0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.551+0000 7fd9e4525b80 1 --2- 172.21.15.2:0/3191656772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a98d33fb90 0x55a98d34c660 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.551+0000 7fd9e4525b80 1 -- 172.21.15.2:0/3191656772 >> 172.21.15.2:0/3191656772 conn(0x55a98d266170 msgr2=0x55a98d33efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.551+0000 7fd9c0c00700 0 client.16185 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:32:25.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.551+0000 7fd9e4525b80 1 -- 172.21.15.2:0/3191656772 shutdown_connections 2024-06-13T11:32:25.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.551+0000 7fd9e4525b80 1 -- 172.21.15.2:0/3191656772 wait complete. 2024-06-13T11:32:25.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.551+0000 7fd9e4525b80 20 client.16185 trim_cache size 0 max 16384 2024-06-13T11:32:25.556 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:32:25.556 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-06-13T11:32:25.556 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-06-13T11:32:25.557 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:32:25.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.552+0000 7fd9d9c00700 1 -- 172.21.15.2:0/23100514 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9b80a2e10 msgr2=0x7fd9b80a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:25.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.552+0000 7fd9d9c00700 1 --2- 172.21.15.2:0/23100514 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9b80a2e10 0x7fd9b80a52d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4107fd0 tx=0x7fd9bc00b610 comp rx=0 tx=0).stop 2024-06-13T11:32:25.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.552+0000 7fd9d9c00700 1 -- 172.21.15.2:0/23100514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9d41084e0 msgr2=0x7fd9d4198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:25.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.552+0000 7fd9d9c00700 1 --2- 172.21.15.2:0/23100514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9d41084e0 0x7fd9d4198a50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc007f10 tx=0x7fd9cc00d3b0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.552+0000 7fd9d9c00700 1 -- 172.21.15.2:0/23100514 shutdown_connections 2024-06-13T11:32:25.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.552+0000 7fd9d9c00700 1 --2- 172.21.15.2:0/23100514 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd9b80a2e10 0x7fd9b80a52d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.552+0000 7fd9d9c00700 1 --2- 172.21.15.2:0/23100514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9d406a170 0x7fd9d419e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.552+0000 7fd9d9c00700 1 --2- 172.21.15.2:0/23100514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9d41084e0 0x7fd9d4198a50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.552+0000 7fd9d9c00700 1 --2- 172.21.15.2:0/23100514 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9d406ab10 0x7fd9d419edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:25.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.552+0000 7fd9d9c00700 1 -- 172.21.15.2:0/23100514 >> 172.21.15.2:0/23100514 conn(0x7fd9d40782c0 msgr2=0x7fd9d40ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:25.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.553+0000 7fd9d9c00700 1 -- 172.21.15.2:0/23100514 shutdown_connections 2024-06-13T11:32:25.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:25.553+0000 7fd9d9c00700 1 -- 172.21.15.2:0/23100514 wait complete. 2024-06-13T11:32:25.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:25 smithi077 ceph-mon[36410]: pgmap v266: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:32:25.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:25 smithi002 ceph-mon[32210]: pgmap v266: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:32:25.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:25 smithi178 ceph-mon[36913]: pgmap v266: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:32:26.394 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-13T11:32:26.395 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:32:26.866 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:32:27.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:27 smithi002 ceph-mon[32210]: pgmap v267: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:32:27.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:27 smithi077 ceph-mon[36410]: pgmap v267: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:32:27.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:27 smithi178 ceph-mon[36913]: pgmap v267: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-06-13T11:32:29.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.134+0000 7f6ef3e00700 1 -- 172.21.15.2:0/3639337814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef41068a0 msgr2=0x7f6ef4111530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:29.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.134+0000 7f6ef3e00700 1 --2- 172.21.15.2:0/3639337814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef41068a0 0x7f6ef4111530 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00b0a0 tx=0x7f6eec00b3b0 comp rx=0 tx=0).stop 2024-06-13T11:32:29.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.135+0000 7f6ef3e00700 1 -- 172.21.15.2:0/3639337814 shutdown_connections 2024-06-13T11:32:29.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.135+0000 7f6ef3e00700 1 --2- 172.21.15.2:0/3639337814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef41068a0 0x7f6ef4111530 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:29.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.135+0000 7f6ef3e00700 1 --2- 172.21.15.2:0/3639337814 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef41048d0 0x7f6ef4104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:29.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.135+0000 7f6ef3e00700 1 --2- 172.21.15.2:0/3639337814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ef41051f0 0x7f6ef4106170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:29.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.135+0000 7f6ef3e00700 1 -- 172.21.15.2:0/3639337814 >> 172.21.15.2:0/3639337814 conn(0x7f6ef4100040 msgr2=0x7f6ef4102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:29.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.135+0000 7f6ef3e00700 1 -- 172.21.15.2:0/3639337814 shutdown_connections 2024-06-13T11:32:29.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.135+0000 7f6ef3e00700 1 -- 172.21.15.2:0/3639337814 wait complete. 2024-06-13T11:32:29.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.136+0000 7f6ef3e00700 1 Processor -- start 2024-06-13T11:32:29.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.136+0000 7f6ef3e00700 1 -- start start 2024-06-13T11:32:29.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.136+0000 7f6ef3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ef41048d0 0x7f6ef419ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:29.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.136+0000 7f6ef3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef41051f0 0x7f6ef419b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:29.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.137+0000 7f6ef3e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef41068a0 0x7f6ef419f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:29.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.137+0000 7f6ef3e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef41149c0 con 0x7f6ef41051f0 2024-06-13T11:32:29.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.137+0000 7f6ef3e00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef4114840 con 0x7f6ef41068a0 2024-06-13T11:32:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.137+0000 7f6ef3e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef4114b40 con 0x7f6ef41048d0 2024-06-13T11:32:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.137+0000 7f6ef2000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef41051f0 0x7f6ef419b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.137+0000 7f6ef2000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef41051f0 0x7f6ef419b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39916/0 (socket says 172.21.15.2:39916) 2024-06-13T11:32:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.137+0000 7f6ef2000700 1 -- 172.21.15.2:0/2240585665 learned_addr learned my addr 172.21.15.2:0/2240585665 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.137+0000 7f6ef2a00700 1 --2- 172.21.15.2:0/2240585665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ef41048d0 0x7f6ef419ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.137+0000 7f6ef3400700 1 --2- 172.21.15.2:0/2240585665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef41068a0 0x7f6ef419f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.137+0000 7f6ef2000700 1 -- 172.21.15.2:0/2240585665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ef41048d0 msgr2=0x7f6ef419ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:29.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.137+0000 7f6ef2000700 1 --2- 172.21.15.2:0/2240585665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ef41048d0 0x7f6ef419ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.137+0000 7f6ef2000700 1 -- 172.21.15.2:0/2240585665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef41068a0 msgr2=0x7f6ef419f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.137+0000 7f6ef2000700 1 --2- 172.21.15.2:0/2240585665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef41068a0 0x7f6ef419f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.137+0000 7f6ef2000700 1 -- 172.21.15.2:0/2240585665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef419fd80 con 0x7f6ef41051f0 2024-06-13T11:32:29.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.138+0000 7f6ef2000700 1 --2- 172.21.15.2:0/2240585665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef41051f0 0x7f6ef419b2b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000e9f0 tx=0x7f6ee000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.138+0000 7f6ef8a00700 1 -- 172.21.15.2:0/2240585665 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0004a30 con 0x7f6ef41051f0 2024-06-13T11:32:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.138+0000 7f6ef3e00700 1 -- 172.21.15.2:0/2240585665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef41a0070 con 0x7f6ef41051f0 2024-06-13T11:32:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.138+0000 7f6ef8a00700 1 -- 172.21.15.2:0/2240585665 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ee000cca0 con 0x7f6ef41051f0 2024-06-13T11:32:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.138+0000 7f6ef8a00700 1 -- 172.21.15.2:0/2240585665 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00056c0 con 0x7f6ef41051f0 2024-06-13T11:32:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.138+0000 7f6ef3e00700 1 -- 172.21.15.2:0/2240585665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef41a78f0 con 0x7f6ef41051f0 2024-06-13T11:32:29.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.139+0000 7f6ef3e00700 1 -- 172.21.15.2:0/2240585665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef4069180 con 0x7f6ef41051f0 2024-06-13T11:32:29.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.141+0000 7f6ef8a00700 1 -- 172.21.15.2:0/2240585665 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f6ee000c7c0 con 0x7f6ef41051f0 2024-06-13T11:32:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.143+0000 7f6ef8a00700 1 --2- 172.21.15.2:0/2240585665 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6ed80a2d90 0x7f6ed80a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.143+0000 7f6ef8a00700 1 -- 172.21.15.2:0/2240585665 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7f6ee00cfa70 con 0x7f6ef41051f0 2024-06-13T11:32:29.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.143+0000 7f6ef2a00700 1 --2- 172.21.15.2:0/2240585665 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6ed80a2d90 0x7f6ed80a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:29.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.144+0000 7f6ef2a00700 1 --2- 172.21.15.2:0/2240585665 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6ed80a2d90 0x7f6ed80a5250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009c60 tx=0x7f6ee4009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:29.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.148+0000 7f6ef8a00700 1 -- 172.21.15.2:0/2240585665 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6ee009c270 con 0x7f6ef41051f0 2024-06-13T11:32:29.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.427+0000 7f6ef3e00700 1 -- 172.21.15.2:0/2240585665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ef419c0d0 con 0x7f6ef41051f0 2024-06-13T11:32:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.429+0000 7f6ef8a00700 1 -- 172.21.15.2:0/2240585665 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11853 (secure 0 0 0) 0x7f6ee009bb70 con 0x7f6ef41051f0 2024-06-13T11:32:29.429 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:32:29.429 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:29:21.309310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24511,24493,24509]},"id":1}]} 2024-06-13T11:32:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.433+0000 7f6ef3e00700 1 -- 172.21.15.2:0/2240585665 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6ed80a2d90 msgr2=0x7f6ed80a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.433+0000 7f6ef3e00700 1 --2- 172.21.15.2:0/2240585665 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6ed80a2d90 0x7f6ed80a5250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009c60 tx=0x7f6ee4009260 comp rx=0 tx=0).stop 2024-06-13T11:32:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.433+0000 7f6ef3e00700 1 -- 172.21.15.2:0/2240585665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef41051f0 msgr2=0x7f6ef419b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.433+0000 7f6ef3e00700 1 --2- 172.21.15.2:0/2240585665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef41051f0 0x7f6ef419b2b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000e9f0 tx=0x7f6ee000ed00 comp rx=0 tx=0).stop 2024-06-13T11:32:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.433+0000 7f6ef3e00700 1 -- 172.21.15.2:0/2240585665 shutdown_connections 2024-06-13T11:32:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.433+0000 7f6ef3e00700 1 --2- 172.21.15.2:0/2240585665 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f6ed80a2d90 0x7f6ed80a5250 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.433+0000 7f6ef3e00700 1 --2- 172.21.15.2:0/2240585665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef41068a0 0x7f6ef419f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.433+0000 7f6ef3e00700 1 --2- 172.21.15.2:0/2240585665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ef41048d0 0x7f6ef419ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.433+0000 7f6ef3e00700 1 --2- 172.21.15.2:0/2240585665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ef41051f0 0x7f6ef419b2b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:29.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.433+0000 7f6ef3e00700 1 -- 172.21.15.2:0/2240585665 >> 172.21.15.2:0/2240585665 conn(0x7f6ef4100040 msgr2=0x7f6ef4101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:29.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.434+0000 7f6ef3e00700 1 -- 172.21.15.2:0/2240585665 shutdown_connections 2024-06-13T11:32:29.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:29.434+0000 7f6ef3e00700 1 -- 172.21.15.2:0/2240585665 wait complete. 2024-06-13T11:32:29.435 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 31 2024-06-13T11:32:29.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:29 smithi077 ceph-mon[36410]: pgmap v268: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-06-13T11:32:29.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:29 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2240585665' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:32:29.832 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:29 smithi002 ceph-mon[32210]: pgmap v268: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-06-13T11:32:29.832 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:29 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2240585665' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:32:29.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:29 smithi178 ceph-mon[36913]: pgmap v268: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-06-13T11:32:29.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:29 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2240585665' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:32:30.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-13T11:32:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:32:31.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:31 smithi002 ceph-mon[32210]: pgmap v269: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:31.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:31 smithi077 ceph-mon[36410]: pgmap v269: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:31.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:31 smithi178 ceph-mon[36913]: pgmap v269: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:33.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.143+0000 7f774e600700 1 -- 172.21.15.2:0/949659503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77481133d0 msgr2=0x7f77481157c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:33.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.143+0000 7f774e600700 1 --2- 172.21.15.2:0/949659503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77481133d0 0x7f77481157c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f774000b0a0 tx=0x7f774000b3b0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.143+0000 7f774e600700 1 -- 172.21.15.2:0/949659503 shutdown_connections 2024-06-13T11:32:33.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.143+0000 7f774e600700 1 --2- 172.21.15.2:0/949659503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77481133d0 0x7f77481157c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.143+0000 7f774e600700 1 --2- 172.21.15.2:0/949659503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7748074830 0x7f7748074c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.143+0000 7f774e600700 1 --2- 172.21.15.2:0/949659503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7748075150 0x7f7748112e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.143+0000 7f774e600700 1 -- 172.21.15.2:0/949659503 >> 172.21.15.2:0/949659503 conn(0x7f77480fdf10 msgr2=0x7f7748100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:33.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.143+0000 7f774e600700 1 -- 172.21.15.2:0/949659503 shutdown_connections 2024-06-13T11:32:33.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.143+0000 7f774e600700 1 -- 172.21.15.2:0/949659503 wait complete. 2024-06-13T11:32:33.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.144+0000 7f774e600700 1 Processor -- start 2024-06-13T11:32:33.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.145+0000 7f774e600700 1 -- start start 2024-06-13T11:32:33.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.145+0000 7f774e600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7748074830 0x7f774819f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.145+0000 7f774e600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7748075150 0x7f774819f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.145+0000 7f774e600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77481133d0 0x7f77481a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.145+0000 7f774e600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7748118d10 con 0x7f7748075150 2024-06-13T11:32:33.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.145+0000 7f774e600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7748118b90 con 0x7f77481133d0 2024-06-13T11:32:33.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.145+0000 7f774e600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7748118e90 con 0x7f7748074830 2024-06-13T11:32:33.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.145+0000 7f7747e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7748075150 0x7f774819f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.145+0000 7f774d200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7748074830 0x7f774819f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.145+0000 7f7747e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7748075150 0x7f774819f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39928/0 (socket says 172.21.15.2:39928) 2024-06-13T11:32:33.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.145+0000 7f7747e00700 1 -- 172.21.15.2:0/4116771116 learned_addr learned my addr 172.21.15.2:0/4116771116 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:33.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.146+0000 7f774dc00700 1 --2- 172.21.15.2:0/4116771116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77481133d0 0x7f77481a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.146+0000 7f774d200700 1 -- 172.21.15.2:0/4116771116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77481133d0 msgr2=0x7f77481a3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:33.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.146+0000 7f774d200700 1 --2- 172.21.15.2:0/4116771116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77481133d0 0x7f77481a3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.146+0000 7f774d200700 1 -- 172.21.15.2:0/4116771116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7748075150 msgr2=0x7f774819f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:33.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.146+0000 7f774d200700 1 --2- 172.21.15.2:0/4116771116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7748075150 0x7f774819f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.146+0000 7f774d200700 1 -- 172.21.15.2:0/4116771116 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77481a4150 con 0x7f7748074830 2024-06-13T11:32:33.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.146+0000 7f7747e00700 1 --2- 172.21.15.2:0/4116771116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7748075150 0x7f774819f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:32:33.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.146+0000 7f774d200700 1 --2- 172.21.15.2:0/4116771116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7748074830 0x7f774819f140 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f773c00e9f0 tx=0x7f773c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:33.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.147+0000 7f7745600700 1 -- 172.21.15.2:0/4116771116 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c00c9c0 con 0x7f7748074830 2024-06-13T11:32:33.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.147+0000 7f7745600700 1 -- 172.21.15.2:0/4116771116 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f773c00cb60 con 0x7f7748074830 2024-06-13T11:32:33.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.147+0000 7f774e600700 1 -- 172.21.15.2:0/4116771116 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77481a4440 con 0x7f7748074830 2024-06-13T11:32:33.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.147+0000 7f7745600700 1 -- 172.21.15.2:0/4116771116 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c018680 con 0x7f7748074830 2024-06-13T11:32:33.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.147+0000 7f774e600700 1 -- 172.21.15.2:0/4116771116 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77481abcc0 con 0x7f7748074830 2024-06-13T11:32:33.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.149+0000 7f7745600700 1 -- 172.21.15.2:0/4116771116 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f773c010430 con 0x7f7748074830 2024-06-13T11:32:33.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.151+0000 7f7745600700 1 --2- 172.21.15.2:0/4116771116 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f77300a2d90 0x7f77300a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.151+0000 7f775a5c8b80 1 Processor -- start 2024-06-13T11:32:33.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.151+0000 7f7745600700 1 -- 172.21.15.2:0/4116771116 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7f773c0cf980 con 0x7f7748074830 2024-06-13T11:32:33.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.151+0000 7f775a5c8b80 1 -- start start 2024-06-13T11:32:33.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.151+0000 7f7747e00700 1 --2- 172.21.15.2:0/4116771116 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f77300a2d90 0x7f77300a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.151+0000 7f775a5c8b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b4892d60 0x55a5b4893140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.151+0000 7f775a5c8b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4893680 0x55a5b489dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.151+0000 7f775a5c8b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b489e530 0x55a5b48a0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.151+0000 7f775a5c8b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a5b47a2a10 con 0x55a5b489e530 2024-06-13T11:32:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.152+0000 7f775a5c8b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a5b47e5b00 con 0x55a5b4893680 2024-06-13T11:32:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.152+0000 7f775a5c8b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a5b47a08f0 con 0x55a5b4892d60 2024-06-13T11:32:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.152+0000 7f774d200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b4892d60 0x55a5b4893140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.152+0000 7f774d200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b4892d60 0x55a5b4893140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:34822/0 (socket says 172.21.15.2:34822) 2024-06-13T11:32:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.152+0000 7f774d200700 1 -- 172.21.15.2:0/2082152374 learned_addr learned my addr 172.21.15.2:0/2082152374 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.152+0000 7f774dc00700 1 --2- 172.21.15.2:0/2082152374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b489e530 0x55a5b48a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.152+0000 7f7747e00700 1 --2- 172.21.15.2:0/2082152374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4893680 0x55a5b489dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.152+0000 7f7747e00700 1 --2- 172.21.15.2:0/4116771116 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f77300a2d90 0x7f77300a5250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7734009680 tx=0x7f7734009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.152+0000 7f774d200700 1 -- 172.21.15.2:0/2082152374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4893680 msgr2=0x55a5b489dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.152+0000 7f774d200700 1 --2- 172.21.15.2:0/2082152374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4893680 0x55a5b489dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.152+0000 7f774d200700 1 -- 172.21.15.2:0/2082152374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b489e530 msgr2=0x55a5b48a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.152+0000 7f774d200700 1 --2- 172.21.15.2:0/2082152374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b489e530 0x55a5b48a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.152+0000 7f774d200700 1 -- 172.21.15.2:0/2082152374 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5b478df90 con 0x55a5b4892d60 2024-06-13T11:32:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.153+0000 7f774d200700 1 --2- 172.21.15.2:0/2082152374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b4892d60 0x55a5b4893140 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f773c0a41c0 tx=0x7f773c00cd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a827a155e3065e89 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.153+0000 7f773a000700 1 -- 172.21.15.2:0/2082152374 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c09fe30 con 0x55a5b4892d60 2024-06-13T11:32:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.153+0000 7f773a000700 1 -- 172.21.15.2:0/2082152374 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f773c0a46f0 con 0x55a5b4892d60 2024-06-13T11:32:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.153+0000 7f773a000700 1 -- 172.21.15.2:0/2082152374 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c010720 con 0x55a5b4892d60 2024-06-13T11:32:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.154+0000 7f775a5c8b80 1 -- 172.21.15.2:0/2082152374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b4892d60 msgr2=0x55a5b4893140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.154+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/2082152374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b4892d60 0x55a5b4893140 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f773c0a41c0 tx=0x7f773c00cd90 comp rx=0 tx=0).stop 2024-06-13T11:32:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.154+0000 7f775a5c8b80 1 -- 172.21.15.2:0/2082152374 shutdown_connections 2024-06-13T11:32:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.154+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/2082152374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b489e530 0x55a5b48a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.154+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/2082152374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b4892d60 0x55a5b4893140 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.154+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/2082152374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4893680 0x55a5b489dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.154+0000 7f775a5c8b80 1 -- 172.21.15.2:0/2082152374 >> 172.21.15.2:0/2082152374 conn(0x55a5b47c0170 msgr2=0x55a5b488f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.154+0000 7f775a5c8b80 1 -- 172.21.15.2:0/2082152374 shutdown_connections 2024-06-13T11:32:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.154+0000 7f775a5c8b80 1 -- 172.21.15.2:0/2082152374 wait complete. 2024-06-13T11:32:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.155+0000 7f775a5c8b80 1 -- start start 2024-06-13T11:32:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.155+0000 7f775a5c8b80 1 Processor -- start 2024-06-13T11:32:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.155+0000 7f775a5c8b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4892d60 0x55a5b489dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f775a5c8b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b4893680 0x55a5b489b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f775a5c8b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b489e530 0x55a5b489b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f775a5c8b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a5b4781f60 con 0x55a5b489e530 2024-06-13T11:32:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f775a5c8b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a5b47e1ac0 con 0x55a5b4892d60 2024-06-13T11:32:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f775a5c8b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a5b48a0f60 con 0x55a5b4893680 2024-06-13T11:32:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f775a5c8b80 10 client.0 _ll_register_callbacks cb 0x55a5b477b380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:32:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f774d200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4892d60 0x55a5b489dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f774dc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b489e530 0x55a5b489b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f7747e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b4893680 0x55a5b489b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f774d200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4892d60 0x55a5b489dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:49352/0 (socket says 172.21.15.2:49352) 2024-06-13T11:32:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f774d200700 1 -- 172.21.15.2:0/1845483254 learned_addr learned my addr 172.21.15.2:0/1845483254 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f774d200700 1 -- 172.21.15.2:0/1845483254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b4893680 msgr2=0x55a5b489b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f774d200700 1 --2- 172.21.15.2:0/1845483254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b4893680 0x55a5b489b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f774d200700 1 -- 172.21.15.2:0/1845483254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b489e530 msgr2=0x55a5b489b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f774d200700 1 --2- 172.21.15.2:0/1845483254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b489e530 0x55a5b489b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f774d200700 1 -- 172.21.15.2:0/1845483254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5b47348d0 con 0x55a5b4892d60 2024-06-13T11:32:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.156+0000 7f7747e00700 1 --2- 172.21.15.2:0/1845483254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b4893680 0x55a5b489b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:32:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.157+0000 7f774d200700 1 --2- 172.21.15.2:0/1845483254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4892d60 0x55a5b489dd70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f773c097ee0 tx=0x7f773c09bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a34a5edcc20cf5ec server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.157+0000 7f772ea00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:32:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.157+0000 7f772ea00700 1 -- 172.21.15.2:0/1845483254 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c0b9060 con 0x55a5b4892d60 2024-06-13T11:32:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.157+0000 7f772ea00700 1 -- 172.21.15.2:0/1845483254 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7f773c010930 con 0x55a5b4892d60 2024-06-13T11:32:33.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.157+0000 7f775a5c8b80 1 -- 172.21.15.2:0/1845483254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f773c0a46f0 con 0x55a5b4892d60 2024-06-13T11:32:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.157+0000 7f772ea00700 1 -- 172.21.15.2:0/1845483254 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f773c09fe30 con 0x55a5b4892d60 2024-06-13T11:32:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.157+0000 7f775a5c8b80 10 client.26306 fetch_fsmap learned FSMap version 31 2024-06-13T11:32:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.157+0000 7f775a5c8b80 1 -- 172.21.15.2:0/1845483254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a5b48ab730 con 0x55a5b4892d60 2024-06-13T11:32:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.158+0000 7f772ea00700 1 -- 172.21.15.2:0/1845483254 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f773c0a46f0 con 0x55a5b4892d60 2024-06-13T11:32:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.158+0000 7f772ea00700 1 -- 172.21.15.2:0/1845483254 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f773c09a940 con 0x55a5b4892d60 2024-06-13T11:32:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.158+0000 7f775a5c8b80 10 client.26306 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:32:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.158+0000 7f775a5c8b80 10 client.26306 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:32:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.158+0000 7f775a5c8b80 20 client.26306 populate_metadata read hostname 'smithi002' 2024-06-13T11:32:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.158+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/1845483254 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55a5b48adc00 0x55a5b48afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.158+0000 7f775a5c8b80 4 client.26306 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:32:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.158+0000 7f775a5c8b80 1 -- 172.21.15.2:0/1845483254 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5b47f3000 con 0x55a5b48adc00 2024-06-13T11:32:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.158+0000 7f7747e00700 1 --2- 172.21.15.2:0/1845483254 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55a5b48adc00 0x55a5b48afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.159+0000 7f7747e00700 1 --2- 172.21.15.2:0/1845483254 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55a5b48adc00 0x55a5b48afff0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e0227de67068ce86 server_cookie=297ea3a34c5863fa in_seq=0 out_seq=0 2024-06-13T11:32:33.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.159+0000 7f772ea00700 10 client.26306 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:32:33.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.160+0000 7f772ea00700 1 -- 172.21.15.2:0/1845483254 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a5b47f3000 con 0x55a5b48adc00 2024-06-13T11:32:33.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.160+0000 7f772ea00700 10 client.26306 handle_command_reply: tid=0 2024-06-13T11:32:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.160+0000 7f775a5c8b80 1 client.26306 shutdown 2024-06-13T11:32:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.160+0000 7f775a5c8b80 1 -- 172.21.15.2:0/1845483254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4892d60 msgr2=0x55a5b489dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.160+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/1845483254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4892d60 0x55a5b489dd70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f773c097ee0 tx=0x7f773c09bef0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.160+0000 7f775a5c8b80 1 -- 172.21.15.2:0/1845483254 shutdown_connections 2024-06-13T11:32:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.160+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/1845483254 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55a5b48adc00 0x55a5b48afff0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.160+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/1845483254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b489e530 0x55a5b489b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.160+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/1845483254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4892d60 0x55a5b489dd70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.160+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/1845483254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b4893680 0x55a5b489b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.160+0000 7f772ea00700 0 client.26306 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:32:33.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.160+0000 7f775a5c8b80 1 -- 172.21.15.2:0/1845483254 >> 172.21.15.2:0/1845483254 conn(0x55a5b47c0170 msgr2=0x55a5b488ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:33.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.160+0000 7f775a5c8b80 1 -- 172.21.15.2:0/1845483254 shutdown_connections 2024-06-13T11:32:33.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.161+0000 7f775a5c8b80 1 -- 172.21.15.2:0/1845483254 wait complete. 2024-06-13T11:32:33.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.161+0000 7f775a5c8b80 20 client.26306 trim_cache size 0 max 16384 2024-06-13T11:32:33.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.178+0000 7f775a5c8b80 1 Processor -- start 2024-06-13T11:32:33.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.178+0000 7f775a5c8b80 1 -- start start 2024-06-13T11:32:33.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.178+0000 7f775a5c8b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b4892d60 0x55a5b488f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.178+0000 7f775a5c8b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4893680 0x55a5b489a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.178+0000 7f775a5c8b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b489e530 0x55a5b489d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.178+0000 7f775a5c8b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77481b73d0 con 0x55a5b4892d60 2024-06-13T11:32:33.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.178+0000 7f775a5c8b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f77481b4c60 con 0x55a5b4893680 2024-06-13T11:32:33.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.178+0000 7f775a5c8b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f77481b2ad0 con 0x55a5b489e530 2024-06-13T11:32:33.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.179+0000 7f774d200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b4892d60 0x55a5b488f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.179+0000 7f774d200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b4892d60 0x55a5b488f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39962/0 (socket says 172.21.15.2:39962) 2024-06-13T11:32:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.179+0000 7f774d200700 1 -- 172.21.15.2:0/3076377270 learned_addr learned my addr 172.21.15.2:0/3076377270 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.179+0000 7f7747e00700 1 --2- 172.21.15.2:0/3076377270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4893680 0x55a5b489a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.179+0000 7f774dc00700 1 --2- 172.21.15.2:0/3076377270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b489e530 0x55a5b489d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.179+0000 7f774d200700 1 -- 172.21.15.2:0/3076377270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b489e530 msgr2=0x55a5b489d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.179+0000 7f774d200700 1 --2- 172.21.15.2:0/3076377270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b489e530 0x55a5b489d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.179+0000 7f774d200700 1 -- 172.21.15.2:0/3076377270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4893680 msgr2=0x55a5b489a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.179+0000 7f774d200700 1 --2- 172.21.15.2:0/3076377270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4893680 0x55a5b489a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.179+0000 7f774d200700 1 -- 172.21.15.2:0/3076377270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5b488fd50 con 0x55a5b4892d60 2024-06-13T11:32:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.179+0000 7f7747e00700 1 --2- 172.21.15.2:0/3076377270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4893680 0x55a5b489a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:32:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.179+0000 7f774d200700 1 --2- 172.21.15.2:0/3076377270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b4892d60 0x55a5b488f3c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f773c098450 tx=0x7f773c010ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ccaec4b29cc3d8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.180+0000 7f7739600700 1 -- 172.21.15.2:0/3076377270 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c0b9070 con 0x55a5b4892d60 2024-06-13T11:32:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.180+0000 7f7739600700 1 -- 172.21.15.2:0/3076377270 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f773c0a46f0 con 0x55a5b4892d60 2024-06-13T11:32:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.180+0000 7f7739600700 1 -- 172.21.15.2:0/3076377270 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c0ba250 con 0x55a5b4892d60 2024-06-13T11:32:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.180+0000 7f775a5c8b80 1 -- 172.21.15.2:0/3076377270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b4892d60 msgr2=0x55a5b488f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.180+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/3076377270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b4892d60 0x55a5b488f3c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f773c098450 tx=0x7f773c010ba0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.181+0000 7f775a5c8b80 1 -- 172.21.15.2:0/3076377270 shutdown_connections 2024-06-13T11:32:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.181+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/3076377270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b4892d60 0x55a5b488f3c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.181+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/3076377270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b489e530 0x55a5b489d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.181+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/3076377270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4893680 0x55a5b489a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.181+0000 7f775a5c8b80 1 -- 172.21.15.2:0/3076377270 >> 172.21.15.2:0/3076377270 conn(0x55a5b47c0170 msgr2=0x55a5b489b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.181+0000 7f775a5c8b80 1 -- 172.21.15.2:0/3076377270 shutdown_connections 2024-06-13T11:32:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.181+0000 7f775a5c8b80 1 -- 172.21.15.2:0/3076377270 wait complete. 2024-06-13T11:32:33.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.181+0000 7f775a5c8b80 1 -- start start 2024-06-13T11:32:33.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.181+0000 7f775a5c8b80 1 Processor -- start 2024-06-13T11:32:33.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.182+0000 7f775a5c8b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4892d60 0x55a5b48b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.182+0000 7f775a5c8b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b4893680 0x55a5b48b0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.182+0000 7f775a5c8b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b489e530 0x55a5b48b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.182+0000 7f775a5c8b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f77481b3120 con 0x55a5b4893680 2024-06-13T11:32:33.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.182+0000 7f775a5c8b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f77481b4590 con 0x55a5b4892d60 2024-06-13T11:32:33.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.182+0000 7f775a5c8b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f77481b37f0 con 0x55a5b489e530 2024-06-13T11:32:33.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.182+0000 7f775a5c8b80 10 client.0 _ll_register_callbacks cb 0x55a5b477b380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:32:33.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.182+0000 7f7747e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b4893680 0x55a5b48b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.182+0000 7f7747e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b4893680 0x55a5b48b0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39974/0 (socket says 172.21.15.2:39974) 2024-06-13T11:32:33.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.182+0000 7f7747e00700 1 -- 172.21.15.2:0/578543787 learned_addr learned my addr 172.21.15.2:0/578543787 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:33.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.182+0000 7f774d200700 1 --2- 172.21.15.2:0/578543787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4892d60 0x55a5b48b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.182+0000 7f774dc00700 1 --2- 172.21.15.2:0/578543787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b489e530 0x55a5b48b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.183+0000 7f7747e00700 1 -- 172.21.15.2:0/578543787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b489e530 msgr2=0x55a5b48b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:33.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.183+0000 7f7747e00700 1 --2- 172.21.15.2:0/578543787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b489e530 0x55a5b48b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.183+0000 7f7747e00700 1 -- 172.21.15.2:0/578543787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4892d60 msgr2=0x55a5b48b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:33.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.183+0000 7f7747e00700 1 --2- 172.21.15.2:0/578543787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4892d60 0x55a5b48b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.183+0000 7f7747e00700 1 -- 172.21.15.2:0/578543787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5b48b12a0 con 0x55a5b4893680 2024-06-13T11:32:33.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.183+0000 7f7747e00700 1 --2- 172.21.15.2:0/578543787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b4893680 0x55a5b48b0820 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55a5b4781ff0 tx=0x7f77340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f0b1f36aa6dd66 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:33.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.183+0000 7f772ea00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:32:33.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.183+0000 7f772ea00700 1 -- 172.21.15.2:0/578543787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7734028780 con 0x55a5b4893680 2024-06-13T11:32:33.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.183+0000 7f775a5c8b80 1 -- 172.21.15.2:0/578543787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f773c0a46f0 con 0x55a5b4893680 2024-06-13T11:32:33.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.184+0000 7f772ea00700 1 -- 172.21.15.2:0/578543787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7f7734009040 con 0x55a5b4893680 2024-06-13T11:32:33.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.184+0000 7f772ea00700 1 -- 172.21.15.2:0/578543787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7734028920 con 0x55a5b4893680 2024-06-13T11:32:33.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.184+0000 7f775a5c8b80 10 client.16209 fetch_fsmap learned FSMap version 31 2024-06-13T11:32:33.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.184+0000 7f775a5c8b80 1 -- 172.21.15.2:0/578543787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a5b49182c0 con 0x55a5b4893680 2024-06-13T11:32:33.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.184+0000 7f772ea00700 1 -- 172.21.15.2:0/578543787 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f773c0a46f0 con 0x55a5b4893680 2024-06-13T11:32:33.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.184+0000 7f772ea00700 1 -- 172.21.15.2:0/578543787 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f773401a040 con 0x55a5b4893680 2024-06-13T11:32:33.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.184+0000 7f775a5c8b80 10 client.16209 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:32:33.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.184+0000 7f775a5c8b80 10 client.16209 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:32:33.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.184+0000 7f775a5c8b80 20 client.16209 populate_metadata read hostname 'smithi002' 2024-06-13T11:32:33.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.184+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/578543787 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55a5b49189a0 0x55a5b491adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:33.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.184+0000 7f775a5c8b80 4 client.16209 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:32:33.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.184+0000 7f775a5c8b80 1 -- 172.21.15.2:0/578543787 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a5b47ed580 con 0x55a5b49189a0 2024-06-13T11:32:33.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.185+0000 7f774d200700 1 --2- 172.21.15.2:0/578543787 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55a5b49189a0 0x55a5b491adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:33.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.185+0000 7f774d200700 1 --2- 172.21.15.2:0/578543787 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55a5b49189a0 0x55a5b491adc0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e0471acdb748a017 server_cookie=5be16bd2e95788d6 in_seq=0 out_seq=0 2024-06-13T11:32:33.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.185+0000 7f772ea00700 10 client.16209 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:32:33.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.186+0000 7f772ea00700 1 -- 172.21.15.2:0/578543787 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a5b47ed580 con 0x55a5b49189a0 2024-06-13T11:32:33.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.186+0000 7f772ea00700 10 client.16209 handle_command_reply: tid=0 2024-06-13T11:32:33.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.186+0000 7f775a5c8b80 1 client.16209 shutdown 2024-06-13T11:32:33.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.186+0000 7f775a5c8b80 1 -- 172.21.15.2:0/578543787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b4893680 msgr2=0x55a5b48b0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:33.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.186+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/578543787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b4893680 0x55a5b48b0820 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55a5b4781ff0 tx=0x7f77340047c0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.186+0000 7f775a5c8b80 1 -- 172.21.15.2:0/578543787 shutdown_connections 2024-06-13T11:32:33.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.186+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/578543787 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x55a5b49189a0 0x55a5b491adc0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.186+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/578543787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5b489e530 0x55a5b48b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.186+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/578543787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5b4892d60 0x55a5b48b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.186+0000 7f775a5c8b80 1 --2- 172.21.15.2:0/578543787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a5b4893680 0x55a5b48b0820 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.186+0000 7f775a5c8b80 1 -- 172.21.15.2:0/578543787 >> 172.21.15.2:0/578543787 conn(0x55a5b47c0170 msgr2=0x55a5b489a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:33.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.186+0000 7f772ea00700 0 client.16209 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:32:33.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.186+0000 7f775a5c8b80 1 -- 172.21.15.2:0/578543787 shutdown_connections 2024-06-13T11:32:33.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.186+0000 7f775a5c8b80 1 -- 172.21.15.2:0/578543787 wait complete. 2024-06-13T11:32:33.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.186+0000 7f775a5c8b80 20 client.16209 trim_cache size 0 max 16384 2024-06-13T11:32:33.194 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:32:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.187+0000 7f774e600700 1 -- 172.21.15.2:0/4116771116 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f77300a2d90 msgr2=0x7f77300a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.187+0000 7f774e600700 1 --2- 172.21.15.2:0/4116771116 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f77300a2d90 0x7f77300a5250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7734009680 tx=0x7f7734009260 comp rx=0 tx=0).stop 2024-06-13T11:32:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.187+0000 7f774e600700 1 -- 172.21.15.2:0/4116771116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7748074830 msgr2=0x7f774819f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.187+0000 7f774e600700 1 --2- 172.21.15.2:0/4116771116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7748074830 0x7f774819f140 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f773c00e9f0 tx=0x7f773c00ed00 comp rx=0 tx=0).stop 2024-06-13T11:32:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.187+0000 7f774e600700 1 -- 172.21.15.2:0/4116771116 shutdown_connections 2024-06-13T11:32:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.187+0000 7f774e600700 1 --2- 172.21.15.2:0/4116771116 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f77300a2d90 0x7f77300a5250 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.187+0000 7f774e600700 1 --2- 172.21.15.2:0/4116771116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77481133d0 0x7f77481a3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.187+0000 7f774e600700 1 --2- 172.21.15.2:0/4116771116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7748074830 0x7f774819f140 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.187+0000 7f774e600700 1 --2- 172.21.15.2:0/4116771116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7748075150 0x7f774819f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:33.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.187+0000 7f774e600700 1 -- 172.21.15.2:0/4116771116 >> 172.21.15.2:0/4116771116 conn(0x7f77480fdf10 msgr2=0x7f77480feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:33.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.187+0000 7f774e600700 1 -- 172.21.15.2:0/4116771116 shutdown_connections 2024-06-13T11:32:33.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:33.187+0000 7f774e600700 1 -- 172.21.15.2:0/4116771116 wait complete. 2024-06-13T11:32:33.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:33 smithi077 ceph-mon[36410]: pgmap v270: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:32:33.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:33 smithi002 ceph-mon[32210]: pgmap v270: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:32:33.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:33 smithi178 ceph-mon[36913]: pgmap v270: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:32:34.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-13T11:32:34.693 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:32:35.754 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:35 smithi002 ceph-mon[32210]: pgmap v271: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:35.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:35 smithi077 ceph-mon[36410]: pgmap v271: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:35.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:35 smithi178 ceph-mon[36913]: pgmap v271: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:37.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.115+0000 7fe67d400700 1 -- 172.21.15.2:0/1022705838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe678105070 msgr2=0x7fe678111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:37.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.115+0000 7fe67d400700 1 --2- 172.21.15.2:0/1022705838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe678105070 0x7fe678111580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe670009f90 tx=0x7fe67000b330 comp rx=0 tx=0).stop 2024-06-13T11:32:37.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.115+0000 7fe67d400700 1 -- 172.21.15.2:0/1022705838 shutdown_connections 2024-06-13T11:32:37.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.115+0000 7fe67d400700 1 --2- 172.21.15.2:0/1022705838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe67810a6b0 0x7fe67810aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.115+0000 7fe67d400700 1 --2- 172.21.15.2:0/1022705838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe678105070 0x7fe678111580 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.115+0000 7fe67d400700 1 --2- 172.21.15.2:0/1022705838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6781046b0 0x7fe678104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.115+0000 7fe67d400700 1 -- 172.21.15.2:0/1022705838 >> 172.21.15.2:0/1022705838 conn(0x7fe6781001a0 msgr2=0x7fe6781025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.115+0000 7fe67d400700 1 -- 172.21.15.2:0/1022705838 shutdown_connections 2024-06-13T11:32:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.115+0000 7fe67d400700 1 -- 172.21.15.2:0/1022705838 wait complete. 2024-06-13T11:32:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.116+0000 7fe67d400700 1 Processor -- start 2024-06-13T11:32:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.117+0000 7fe67d400700 1 -- start start 2024-06-13T11:32:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.117+0000 7fe67d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6781046b0 0x7fe67819adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.117+0000 7fe67d400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe678105070 0x7fe67819b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.117+0000 7fe67d400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe67810a6b0 0x7fe67819f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.117+0000 7fe67d400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe678114a50 con 0x7fe6781046b0 2024-06-13T11:32:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.117+0000 7fe67d400700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6781148d0 con 0x7fe67810a6b0 2024-06-13T11:32:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.117+0000 7fe67d400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe678114bd0 con 0x7fe678105070 2024-06-13T11:32:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.117+0000 7fe675e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe678105070 0x7fe67819b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.117+0000 7fe676800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6781046b0 0x7fe67819adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.118+0000 7fe675e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe678105070 0x7fe67819b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:43448/0 (socket says 172.21.15.2:43448) 2024-06-13T11:32:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.118+0000 7fe675e00700 1 -- 172.21.15.2:0/1405006100 learned_addr learned my addr 172.21.15.2:0/1405006100 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.118+0000 7fe677200700 1 --2- 172.21.15.2:0/1405006100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe67810a6b0 0x7fe67819f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.118+0000 7fe677200700 1 -- 172.21.15.2:0/1405006100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe678105070 msgr2=0x7fe67819b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:37.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.118+0000 7fe677200700 1 --2- 172.21.15.2:0/1405006100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe678105070 0x7fe67819b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.118+0000 7fe677200700 1 -- 172.21.15.2:0/1405006100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6781046b0 msgr2=0x7fe67819adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:37.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.118+0000 7fe677200700 1 --2- 172.21.15.2:0/1405006100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6781046b0 0x7fe67819adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.118+0000 7fe677200700 1 -- 172.21.15.2:0/1405006100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67819fdd0 con 0x7fe67810a6b0 2024-06-13T11:32:37.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.118+0000 7fe676800700 1 --2- 172.21.15.2:0/1405006100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6781046b0 0x7fe67819adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:32:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.119+0000 7fe677200700 1 --2- 172.21.15.2:0/1405006100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe67810a6b0 0x7fe67819f690 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe670009f90 tx=0x7fe67000cfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.119+0000 7fe66f400700 1 -- 172.21.15.2:0/1405006100 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670021070 con 0x7fe67810a6b0 2024-06-13T11:32:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.119+0000 7fe66f400700 1 -- 172.21.15.2:0/1405006100 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe670007ac0 con 0x7fe67810a6b0 2024-06-13T11:32:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.119+0000 7fe67d400700 1 -- 172.21.15.2:0/1405006100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6781a0060 con 0x7fe67810a6b0 2024-06-13T11:32:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.119+0000 7fe66f400700 1 -- 172.21.15.2:0/1405006100 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6700052a0 con 0x7fe67810a6b0 2024-06-13T11:32:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.119+0000 7fe67d400700 1 -- 172.21.15.2:0/1405006100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6781a7940 con 0x7fe67810a6b0 2024-06-13T11:32:37.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.124+0000 7fe66f400700 1 -- 172.21.15.2:0/1405006100 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fe670024070 con 0x7fe67810a6b0 2024-06-13T11:32:37.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.125+0000 7fe687e69b80 1 Processor -- start 2024-06-13T11:32:37.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.125+0000 7fe687e69b80 1 -- start start 2024-06-13T11:32:37.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.125+0000 7fe687e69b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c5c8e40 0x55c34c64c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.125+0000 7fe687e69b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c64c5b0 0x55c34c64ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.125+0000 7fe687e69b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c657300 0x55c34c6596f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.125+0000 7fe687e69b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c34c55ba10 con 0x55c34c64c5b0 2024-06-13T11:32:37.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.125+0000 7fe687e69b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c34c59eb00 con 0x55c34c657300 2024-06-13T11:32:37.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.125+0000 7fe687e69b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c34c5598f0 con 0x55c34c5c8e40 2024-06-13T11:32:37.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.126+0000 7fe66f400700 1 --2- 172.21.15.2:0/1405006100 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe65c0a2d90 0x7fe65c0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.126+0000 7fe675e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c5c8e40 0x55c34c64c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.126+0000 7fe676800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c64c5b0 0x55c34c64ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.126+0000 7fe675e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c5c8e40 0x55c34c64c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:43454/0 (socket says 172.21.15.2:43454) 2024-06-13T11:32:37.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.126+0000 7fe675e00700 1 -- 172.21.15.2:0/3515558688 learned_addr learned my addr 172.21.15.2:0/3515558688 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:37.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.126+0000 7fe675e00700 1 --2- 172.21.15.2:0/3515558688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c657300 0x55c34c6596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.126+0000 7fe677200700 1 --2- 172.21.15.2:0/1405006100 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe65c0a2d90 0x7fe65c0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.126+0000 7fe675e00700 1 -- 172.21.15.2:0/3515558688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c657300 msgr2=0x55c34c6596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:37.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.126+0000 7fe675e00700 1 --2- 172.21.15.2:0/3515558688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c657300 0x55c34c6596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.126+0000 7fe66f400700 1 -- 172.21.15.2:0/1405006100 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7fe67000f020 con 0x7fe67810a6b0 2024-06-13T11:32:37.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.126+0000 7fe675e00700 1 -- 172.21.15.2:0/3515558688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c64c5b0 msgr2=0x55c34c64ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:37.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.126+0000 7fe675e00700 1 --2- 172.21.15.2:0/3515558688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c64c5b0 0x55c34c64ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.126+0000 7fe675e00700 1 -- 172.21.15.2:0/3515558688 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c34c546f90 con 0x55c34c5c8e40 2024-06-13T11:32:37.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.127+0000 7fe675e00700 1 --2- 172.21.15.2:0/3515558688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c5c8e40 0x55c34c64c070 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe6640119a0 tx=0x7fe664009960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7ffa950e38e1dee server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:37.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.127+0000 7fe677200700 1 --2- 172.21.15.2:0/1405006100 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe65c0a2d90 0x7fe65c0a5250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe6700cdf30 tx=0x7fe670006000 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:37.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.127+0000 7fe663e00700 1 -- 172.21.15.2:0/3515558688 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66401f440 con 0x55c34c5c8e40 2024-06-13T11:32:37.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.127+0000 7fe663e00700 1 -- 172.21.15.2:0/3515558688 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe66400f8a0 con 0x55c34c5c8e40 2024-06-13T11:32:37.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.127+0000 7fe663e00700 1 -- 172.21.15.2:0/3515558688 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66400e7d0 con 0x55c34c5c8e40 2024-06-13T11:32:37.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.128+0000 7fe687e69b80 1 -- 172.21.15.2:0/3515558688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c5c8e40 msgr2=0x55c34c64c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:37.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.128+0000 7fe687e69b80 1 --2- 172.21.15.2:0/3515558688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c5c8e40 0x55c34c64c070 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe6640119a0 tx=0x7fe664009960 comp rx=0 tx=0).stop 2024-06-13T11:32:37.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.128+0000 7fe687e69b80 1 -- 172.21.15.2:0/3515558688 shutdown_connections 2024-06-13T11:32:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.128+0000 7fe687e69b80 1 --2- 172.21.15.2:0/3515558688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c657300 0x55c34c6596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.128+0000 7fe687e69b80 1 --2- 172.21.15.2:0/3515558688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c5c8e40 0x55c34c64c070 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.128+0000 7fe687e69b80 1 --2- 172.21.15.2:0/3515558688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c64c5b0 0x55c34c64ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.128+0000 7fe687e69b80 1 -- 172.21.15.2:0/3515558688 >> 172.21.15.2:0/3515558688 conn(0x55c34c579170 msgr2=0x55c34c6484b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.128+0000 7fe687e69b80 1 -- 172.21.15.2:0/3515558688 shutdown_connections 2024-06-13T11:32:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.128+0000 7fe687e69b80 1 -- 172.21.15.2:0/3515558688 wait complete. 2024-06-13T11:32:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.129+0000 7fe687e69b80 1 -- start start 2024-06-13T11:32:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.129+0000 7fe687e69b80 1 Processor -- start 2024-06-13T11:32:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.130+0000 7fe687e69b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c5c8e40 0x55c34c656ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.130+0000 7fe687e69b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c64c5b0 0x55c34c653dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.130+0000 7fe687e69b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c657300 0x55c34c654310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.130+0000 7fe687e69b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c34c53af60 con 0x55c34c657300 2024-06-13T11:32:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.130+0000 7fe687e69b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c34c59aac0 con 0x55c34c64c5b0 2024-06-13T11:32:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.130+0000 7fe687e69b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c34c659fc0 con 0x55c34c5c8e40 2024-06-13T11:32:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.130+0000 7fe687e69b80 10 client.0 _ll_register_callbacks cb 0x55c34c538720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:32:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.130+0000 7fe676800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c64c5b0 0x55c34c653dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.130+0000 7fe675e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c657300 0x55c34c654310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.130+0000 7fe675e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c5c8e40 0x55c34c656ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.130+0000 7fe676800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c64c5b0 0x55c34c653dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:52208/0 (socket says 172.21.15.2:52208) 2024-06-13T11:32:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.130+0000 7fe676800700 1 -- 172.21.15.2:0/1257856496 learned_addr learned my addr 172.21.15.2:0/1257856496 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.130+0000 7fe675e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c5c8e40 0x55c34c656ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:43470/0 (socket says 172.21.15.2:43470) 2024-06-13T11:32:37.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.131+0000 7fe676800700 1 -- 172.21.15.2:0/1257856496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c5c8e40 msgr2=0x55c34c656ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:37.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.131+0000 7fe676800700 1 --2- 172.21.15.2:0/1257856496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c5c8e40 0x55c34c656ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.131+0000 7fe676800700 1 -- 172.21.15.2:0/1257856496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c657300 msgr2=0x55c34c654310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.131+0000 7fe676800700 1 --2- 172.21.15.2:0/1257856496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c657300 0x55c34c654310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.131+0000 7fe676800700 1 -- 172.21.15.2:0/1257856496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c34c4ed8d0 con 0x55c34c64c5b0 2024-06-13T11:32:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.131+0000 7fe676800700 1 --2- 172.21.15.2:0/1257856496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c64c5b0 0x55c34c653dd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe668012d00 tx=0x7fe66800f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b84c21243af9cab server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.131+0000 7fe660c00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:32:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.131+0000 7fe660c00700 1 -- 172.21.15.2:0/1257856496 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66800fb80 con 0x55c34c64c5b0 2024-06-13T11:32:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.131+0000 7fe687e69b80 1 -- 172.21.15.2:0/1257856496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe66400f8a0 con 0x55c34c64c5b0 2024-06-13T11:32:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.131+0000 7fe660c00700 1 -- 172.21.15.2:0/1257856496 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7fe66800fd20 con 0x55c34c64c5b0 2024-06-13T11:32:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.132+0000 7fe660c00700 1 -- 172.21.15.2:0/1257856496 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe668004850 con 0x55c34c64c5b0 2024-06-13T11:32:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.132+0000 7fe687e69b80 10 client.26324 fetch_fsmap learned FSMap version 31 2024-06-13T11:32:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.132+0000 7fe687e69b80 1 -- 172.21.15.2:0/1257856496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c34c6647f0 con 0x55c34c64c5b0 2024-06-13T11:32:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.132+0000 7fe660c00700 1 -- 172.21.15.2:0/1257856496 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe66400f8a0 con 0x55c34c64c5b0 2024-06-13T11:32:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.132+0000 7fe660c00700 1 -- 172.21.15.2:0/1257856496 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fe668010430 con 0x55c34c64c5b0 2024-06-13T11:32:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.132+0000 7fe687e69b80 10 client.26324 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:32:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.132+0000 7fe687e69b80 10 client.26324 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:32:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.132+0000 7fe687e69b80 20 client.26324 populate_metadata read hostname 'smithi002' 2024-06-13T11:32:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.132+0000 7fe687e69b80 1 --2- 172.21.15.2:0/1257856496 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55c34c666e20 0x55c34c669210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.132+0000 7fe687e69b80 4 client.26324 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:32:37.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.132+0000 7fe687e69b80 1 -- 172.21.15.2:0/1257856496 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c34c5ac000 con 0x55c34c666e20 2024-06-13T11:32:37.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.133+0000 7fe675e00700 1 --2- 172.21.15.2:0/1257856496 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55c34c666e20 0x55c34c669210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.133+0000 7fe675e00700 1 --2- 172.21.15.2:0/1257856496 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55c34c666e20 0x55c34c669210 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a3cddf6332d4f0d4 server_cookie=46c4f4dbbe3c6923 in_seq=0 out_seq=0 2024-06-13T11:32:37.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.133+0000 7fe660c00700 10 client.26324 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:32:37.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.134+0000 7fe660c00700 1 -- 172.21.15.2:0/1257856496 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c34c5ac000 con 0x55c34c666e20 2024-06-13T11:32:37.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.134+0000 7fe660c00700 10 client.26324 handle_command_reply: tid=0 2024-06-13T11:32:37.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.134+0000 7fe687e69b80 1 client.26324 shutdown 2024-06-13T11:32:37.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.134+0000 7fe687e69b80 1 -- 172.21.15.2:0/1257856496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c64c5b0 msgr2=0x55c34c653dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:37.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.134+0000 7fe687e69b80 1 --2- 172.21.15.2:0/1257856496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c64c5b0 0x55c34c653dd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe668012d00 tx=0x7fe66800f6a0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.134+0000 7fe687e69b80 1 -- 172.21.15.2:0/1257856496 shutdown_connections 2024-06-13T11:32:37.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.134+0000 7fe687e69b80 1 --2- 172.21.15.2:0/1257856496 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55c34c666e20 0x55c34c669210 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.134+0000 7fe687e69b80 1 --2- 172.21.15.2:0/1257856496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c657300 0x55c34c654310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.134+0000 7fe687e69b80 1 --2- 172.21.15.2:0/1257856496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c5c8e40 0x55c34c656ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.134+0000 7fe660c00700 0 client.26324 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:32:37.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.134+0000 7fe687e69b80 1 --2- 172.21.15.2:0/1257856496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c64c5b0 0x55c34c653dd0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.134+0000 7fe687e69b80 1 -- 172.21.15.2:0/1257856496 >> 172.21.15.2:0/1257856496 conn(0x55c34c579170 msgr2=0x55c34c647740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:37.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.135+0000 7fe687e69b80 1 -- 172.21.15.2:0/1257856496 shutdown_connections 2024-06-13T11:32:37.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.135+0000 7fe687e69b80 1 -- 172.21.15.2:0/1257856496 wait complete. 2024-06-13T11:32:37.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.135+0000 7fe687e69b80 20 client.26324 trim_cache size 0 max 16384 2024-06-13T11:32:37.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.152+0000 7fe687e69b80 1 Processor -- start 2024-06-13T11:32:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.152+0000 7fe687e69b80 1 -- start start 2024-06-13T11:32:37.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.152+0000 7fe687e69b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c5c8e40 0x55c34c648620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.152+0000 7fe687e69b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c64c5b0 0x55c34c654340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.152+0000 7fe687e69b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c657300 0x55c34c6475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.152+0000 7fe687e69b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6781b2f60 con 0x55c34c5c8e40 2024-06-13T11:32:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.152+0000 7fe687e69b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6781b07f0 con 0x55c34c64c5b0 2024-06-13T11:32:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.152+0000 7fe687e69b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe6781ae660 con 0x55c34c657300 2024-06-13T11:32:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.152+0000 7fe675e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c5c8e40 0x55c34c648620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.152+0000 7fe675e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c5c8e40 0x55c34c648620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35888/0 (socket says 172.21.15.2:35888) 2024-06-13T11:32:37.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.152+0000 7fe675e00700 1 -- 172.21.15.2:0/3486519128 learned_addr learned my addr 172.21.15.2:0/3486519128 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:37.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.153+0000 7fe676800700 1 --2- 172.21.15.2:0/3486519128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c64c5b0 0x55c34c654340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.153+0000 7fe675e00700 1 --2- 172.21.15.2:0/3486519128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c657300 0x55c34c6475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.153+0000 7fe675e00700 1 -- 172.21.15.2:0/3486519128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c657300 msgr2=0x55c34c6475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:37.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.153+0000 7fe675e00700 1 --2- 172.21.15.2:0/3486519128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c657300 0x55c34c6475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.153+0000 7fe675e00700 1 -- 172.21.15.2:0/3486519128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c64c5b0 msgr2=0x55c34c654340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:37.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.153+0000 7fe675e00700 1 --2- 172.21.15.2:0/3486519128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c64c5b0 0x55c34c654340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.153+0000 7fe675e00700 1 -- 172.21.15.2:0/3486519128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c34c64fc50 con 0x55c34c5c8e40 2024-06-13T11:32:37.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.153+0000 7fe675e00700 1 --2- 172.21.15.2:0/3486519128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c5c8e40 0x55c34c648620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe664011940 tx=0x7fe664009d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5c0cf4b73e9498 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:37.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.154+0000 7fe663400700 1 -- 172.21.15.2:0/3486519128 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664027040 con 0x55c34c5c8e40 2024-06-13T11:32:37.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.154+0000 7fe663400700 1 -- 172.21.15.2:0/3486519128 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe66400fa80 con 0x55c34c5c8e40 2024-06-13T11:32:37.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.154+0000 7fe663400700 1 -- 172.21.15.2:0/3486519128 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66402faf0 con 0x55c34c5c8e40 2024-06-13T11:32:37.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.154+0000 7fe687e69b80 1 -- 172.21.15.2:0/3486519128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c5c8e40 msgr2=0x55c34c648620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.154+0000 7fe687e69b80 1 --2- 172.21.15.2:0/3486519128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c5c8e40 0x55c34c648620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe664011940 tx=0x7fe664009d00 comp rx=0 tx=0).stop 2024-06-13T11:32:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.154+0000 7fe687e69b80 1 -- 172.21.15.2:0/3486519128 shutdown_connections 2024-06-13T11:32:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.154+0000 7fe687e69b80 1 --2- 172.21.15.2:0/3486519128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c5c8e40 0x55c34c648620 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.154+0000 7fe687e69b80 1 --2- 172.21.15.2:0/3486519128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c657300 0x55c34c6475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.154+0000 7fe687e69b80 1 --2- 172.21.15.2:0/3486519128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c64c5b0 0x55c34c654340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.154+0000 7fe687e69b80 1 -- 172.21.15.2:0/3486519128 >> 172.21.15.2:0/3486519128 conn(0x55c34c579170 msgr2=0x55c34c646eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.155+0000 7fe687e69b80 1 -- 172.21.15.2:0/3486519128 shutdown_connections 2024-06-13T11:32:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.155+0000 7fe687e69b80 1 -- 172.21.15.2:0/3486519128 wait complete. 2024-06-13T11:32:37.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.155+0000 7fe687e69b80 1 -- start start 2024-06-13T11:32:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.155+0000 7fe687e69b80 1 Processor -- start 2024-06-13T11:32:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.156+0000 7fe687e69b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c5c8e40 0x55c34c658ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.156+0000 7fe687e69b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c64c5b0 0x55c34c6576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.156+0000 7fe687e69b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c657300 0x55c34c657c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.156+0000 7fe687e69b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe6781aecb0 con 0x55c34c64c5b0 2024-06-13T11:32:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.156+0000 7fe687e69b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6781b0120 con 0x55c34c5c8e40 2024-06-13T11:32:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.156+0000 7fe687e69b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe6781af380 con 0x55c34c657300 2024-06-13T11:32:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.156+0000 7fe687e69b80 10 client.0 _ll_register_callbacks cb 0x55c34c538720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:32:37.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.156+0000 7fe675e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c5c8e40 0x55c34c658ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.156+0000 7fe676800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c64c5b0 0x55c34c6576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.156+0000 7fe675e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c5c8e40 0x55c34c658ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:52222/0 (socket says 172.21.15.2:52222) 2024-06-13T11:32:37.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.156+0000 7fe675e00700 1 -- 172.21.15.2:0/3163483474 learned_addr learned my addr 172.21.15.2:0/3163483474 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:37.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.156+0000 7fe675e00700 1 --2- 172.21.15.2:0/3163483474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c657300 0x55c34c657c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.157+0000 7fe676800700 1 -- 172.21.15.2:0/3163483474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c657300 msgr2=0x55c34c657c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:37.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.157+0000 7fe676800700 1 --2- 172.21.15.2:0/3163483474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c657300 0x55c34c657c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.157+0000 7fe676800700 1 -- 172.21.15.2:0/3163483474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c5c8e40 msgr2=0x55c34c658ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:37.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.157+0000 7fe676800700 1 --2- 172.21.15.2:0/3163483474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c5c8e40 0x55c34c658ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.157+0000 7fe676800700 1 -- 172.21.15.2:0/3163483474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c34c658410 con 0x55c34c64c5b0 2024-06-13T11:32:37.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.157+0000 7fe676800700 1 --2- 172.21.15.2:0/3163483474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c64c5b0 0x55c34c6576e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe668010a90 tx=0x7fe66800fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c2c4fe1d1e9ced server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:37.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.157+0000 7fe660c00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:32:37.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.157+0000 7fe660c00700 1 -- 172.21.15.2:0/3163483474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe668031060 con 0x55c34c64c5b0 2024-06-13T11:32:37.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.157+0000 7fe660c00700 1 -- 172.21.15.2:0/3163483474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7fe668010d20 con 0x55c34c64c5b0 2024-06-13T11:32:37.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.158+0000 7fe687e69b80 1 -- 172.21.15.2:0/3163483474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe66400fa80 con 0x55c34c64c5b0 2024-06-13T11:32:37.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.158+0000 7fe660c00700 1 -- 172.21.15.2:0/3163483474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe668005da0 con 0x55c34c64c5b0 2024-06-13T11:32:37.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.158+0000 7fe687e69b80 10 client.16227 fetch_fsmap learned FSMap version 31 2024-06-13T11:32:37.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.158+0000 7fe687e69b80 1 -- 172.21.15.2:0/3163483474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c34c65f200 con 0x55c34c64c5b0 2024-06-13T11:32:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.158+0000 7fe660c00700 1 -- 172.21.15.2:0/3163483474 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe66400fa80 con 0x55c34c64c5b0 2024-06-13T11:32:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.158+0000 7fe660c00700 1 -- 172.21.15.2:0/3163483474 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fe6680039f0 con 0x55c34c64c5b0 2024-06-13T11:32:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.158+0000 7fe687e69b80 10 client.16227 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:32:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.158+0000 7fe687e69b80 10 client.16227 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:32:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.158+0000 7fe687e69b80 20 client.16227 populate_metadata read hostname 'smithi002' 2024-06-13T11:32:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.158+0000 7fe687e69b80 1 --2- 172.21.15.2:0/3163483474 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55c34c65f850 0x55c34c6d3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.158+0000 7fe687e69b80 4 client.16227 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:32:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.158+0000 7fe687e69b80 1 -- 172.21.15.2:0/3163483474 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c34c5a6580 con 0x55c34c65f850 2024-06-13T11:32:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.159+0000 7fe675e00700 1 --2- 172.21.15.2:0/3163483474 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55c34c65f850 0x55c34c6d3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:37.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.159+0000 7fe675e00700 1 --2- 172.21.15.2:0/3163483474 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55c34c65f850 0x55c34c6d3ac0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=98375b7853d18203 server_cookie=6148268b8a9632db in_seq=0 out_seq=0 2024-06-13T11:32:37.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.159+0000 7fe660c00700 10 client.16227 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:32:37.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.159+0000 7fe660c00700 1 -- 172.21.15.2:0/3163483474 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c34c5a6580 con 0x55c34c65f850 2024-06-13T11:32:37.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.159+0000 7fe660c00700 10 client.16227 handle_command_reply: tid=0 2024-06-13T11:32:37.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.159+0000 7fe687e69b80 1 client.16227 shutdown 2024-06-13T11:32:37.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.160+0000 7fe687e69b80 1 -- 172.21.15.2:0/3163483474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c64c5b0 msgr2=0x55c34c6576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:37.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.160+0000 7fe687e69b80 1 --2- 172.21.15.2:0/3163483474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c64c5b0 0x55c34c6576e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe668010a90 tx=0x7fe66800fe10 comp rx=0 tx=0).stop 2024-06-13T11:32:37.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.160+0000 7fe687e69b80 1 -- 172.21.15.2:0/3163483474 shutdown_connections 2024-06-13T11:32:37.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.160+0000 7fe687e69b80 1 --2- 172.21.15.2:0/3163483474 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x55c34c65f850 0x55c34c6d3ac0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.160+0000 7fe687e69b80 1 --2- 172.21.15.2:0/3163483474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c34c657300 0x55c34c657c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.160+0000 7fe687e69b80 1 --2- 172.21.15.2:0/3163483474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c34c5c8e40 0x55c34c658ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.160+0000 7fe660c00700 0 client.16227 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:32:37.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.160+0000 7fe687e69b80 1 --2- 172.21.15.2:0/3163483474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c34c64c5b0 0x55c34c6576e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.160+0000 7fe687e69b80 1 -- 172.21.15.2:0/3163483474 >> 172.21.15.2:0/3163483474 conn(0x55c34c579170 msgr2=0x55c34c647740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:37.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.160+0000 7fe687e69b80 1 -- 172.21.15.2:0/3163483474 shutdown_connections 2024-06-13T11:32:37.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.160+0000 7fe687e69b80 1 -- 172.21.15.2:0/3163483474 wait complete. 2024-06-13T11:32:37.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.160+0000 7fe687e69b80 20 client.16227 trim_cache size 0 max 16384 2024-06-13T11:32:37.165 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:32:37.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.161+0000 7fe67d400700 1 -- 172.21.15.2:0/1405006100 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe65c0a2d90 msgr2=0x7fe65c0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:37.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.161+0000 7fe67d400700 1 --2- 172.21.15.2:0/1405006100 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe65c0a2d90 0x7fe65c0a5250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe6700cdf30 tx=0x7fe670006000 comp rx=0 tx=0).stop 2024-06-13T11:32:37.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.161+0000 7fe67d400700 1 -- 172.21.15.2:0/1405006100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe67810a6b0 msgr2=0x7fe67819f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.161+0000 7fe67d400700 1 --2- 172.21.15.2:0/1405006100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe67810a6b0 0x7fe67819f690 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe670009f90 tx=0x7fe67000cfa0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.161+0000 7fe67d400700 1 -- 172.21.15.2:0/1405006100 shutdown_connections 2024-06-13T11:32:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.161+0000 7fe67d400700 1 --2- 172.21.15.2:0/1405006100 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe65c0a2d90 0x7fe65c0a5250 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.161+0000 7fe67d400700 1 --2- 172.21.15.2:0/1405006100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6781046b0 0x7fe67819adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.161+0000 7fe67d400700 1 --2- 172.21.15.2:0/1405006100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe67810a6b0 0x7fe67819f690 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.161+0000 7fe67d400700 1 --2- 172.21.15.2:0/1405006100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe678105070 0x7fe67819b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.161+0000 7fe67d400700 1 -- 172.21.15.2:0/1405006100 >> 172.21.15.2:0/1405006100 conn(0x7fe6781001a0 msgr2=0x7fe678100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.161+0000 7fe67d400700 1 -- 172.21.15.2:0/1405006100 shutdown_connections 2024-06-13T11:32:37.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:37.161+0000 7fe67d400700 1 -- 172.21.15.2:0/1405006100 wait complete. 2024-06-13T11:32:37.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:37 smithi002 ceph-mon[32210]: pgmap v272: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:37.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:37 smithi077 ceph-mon[36410]: pgmap v272: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:37.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:37 smithi178 ceph-mon[36913]: pgmap v272: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:38.133 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-13T11:32:38.603 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:32:39.789 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:39 smithi002 ceph-mon[32210]: pgmap v273: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:32:39.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:39 smithi077 ceph-mon[36410]: pgmap v273: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:32:39.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:39 smithi178 ceph-mon[36913]: pgmap v273: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:32:40.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.987+0000 7fab3ae00700 1 -- 172.21.15.2:0/3721112167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34103fc0 msgr2=0x7fab34104440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:40.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.987+0000 7fab3ae00700 1 --2- 172.21.15.2:0/3721112167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34103fc0 0x7fab34104440 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fab200099c0 tx=0x7fab20009cd0 comp rx=0 tx=0).stop 2024-06-13T11:32:40.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.987+0000 7fab3ae00700 1 -- 172.21.15.2:0/3721112167 shutdown_connections 2024-06-13T11:32:40.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.987+0000 7fab3ae00700 1 --2- 172.21.15.2:0/3721112167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab34104980 0x7fab3410f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:40.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.987+0000 7fab3ae00700 1 --2- 172.21.15.2:0/3721112167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab341026d0 0x7fab34102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:40.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.988+0000 7fab3ae00700 1 --2- 172.21.15.2:0/3721112167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34103fc0 0x7fab34104440 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:40.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.988+0000 7fab3ae00700 1 -- 172.21.15.2:0/3721112167 >> 172.21.15.2:0/3721112167 conn(0x7fab340fde80 msgr2=0x7fab341002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:40.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.988+0000 7fab3ae00700 1 -- 172.21.15.2:0/3721112167 shutdown_connections 2024-06-13T11:32:40.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.988+0000 7fab3ae00700 1 -- 172.21.15.2:0/3721112167 wait complete. 2024-06-13T11:32:40.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.989+0000 7fab3ae00700 1 Processor -- start 2024-06-13T11:32:40.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.989+0000 7fab3ae00700 1 -- start start 2024-06-13T11:32:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.989+0000 7fab3ae00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab341026d0 0x7fab34074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.989+0000 7fab3ae00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab34103fc0 0x7fab34074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.989+0000 7fab3ae00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34104980 0x7fab34075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.990+0000 7fab3ae00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fab34112800 con 0x7fab34104980 2024-06-13T11:32:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.990+0000 7fab3ae00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fab34112680 con 0x7fab34103fc0 2024-06-13T11:32:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.990+0000 7fab3ae00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fab34112980 con 0x7fab341026d0 2024-06-13T11:32:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.990+0000 7fab39a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab341026d0 0x7fab34074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.990+0000 7fab39a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab341026d0 0x7fab34074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:43498/0 (socket says 172.21.15.2:43498) 2024-06-13T11:32:40.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.990+0000 7fab39000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab34103fc0 0x7fab34074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:40.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.990+0000 7fab39a00700 1 -- 172.21.15.2:0/3967415912 learned_addr learned my addr 172.21.15.2:0/3967415912 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:40.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.990+0000 7fab3a400700 1 --2- 172.21.15.2:0/3967415912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34104980 0x7fab34075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:40.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.990+0000 7fab39a00700 1 -- 172.21.15.2:0/3967415912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab34103fc0 msgr2=0x7fab34074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:40.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.990+0000 7fab39a00700 1 --2- 172.21.15.2:0/3967415912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab34103fc0 0x7fab34074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:40.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.990+0000 7fab39a00700 1 -- 172.21.15.2:0/3967415912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34104980 msgr2=0x7fab34075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:40.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.990+0000 7fab39a00700 1 --2- 172.21.15.2:0/3967415912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34104980 0x7fab34075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:40.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.990+0000 7fab39a00700 1 -- 172.21.15.2:0/3967415912 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab341a70d0 con 0x7fab341026d0 2024-06-13T11:32:40.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.991+0000 7fab39a00700 1 --2- 172.21.15.2:0/3967415912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab341026d0 0x7fab34074790 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fab2800e9a0 tx=0x7fab2800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:40.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.991+0000 7fab32000700 1 -- 172.21.15.2:0/3967415912 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2800cbd0 con 0x7fab341026d0 2024-06-13T11:32:40.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.991+0000 7fab32000700 1 -- 172.21.15.2:0/3967415912 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab2800cd70 con 0x7fab341026d0 2024-06-13T11:32:40.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.991+0000 7fab3ae00700 1 -- 172.21.15.2:0/3967415912 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab341a73c0 con 0x7fab341026d0 2024-06-13T11:32:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.991+0000 7fab32000700 1 -- 172.21.15.2:0/3967415912 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28018750 con 0x7fab341026d0 2024-06-13T11:32:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.991+0000 7fab3ae00700 1 -- 172.21.15.2:0/3967415912 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab341a78d0 con 0x7fab341026d0 2024-06-13T11:32:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.994+0000 7fab32000700 1 -- 172.21.15.2:0/3967415912 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fab28010430 con 0x7fab341026d0 2024-06-13T11:32:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.996+0000 7fab32000700 1 --2- 172.21.15.2:0/3967415912 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fab1c0a2d90 0x7fab1c0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.996+0000 7fab46dc4b80 1 Processor -- start 2024-06-13T11:32:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.996+0000 7fab32000700 1 -- 172.21.15.2:0/3967415912 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7fab280cfb30 con 0x7fab341026d0 2024-06-13T11:32:40.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.996+0000 7fab46dc4b80 1 -- start start 2024-06-13T11:32:40.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.996+0000 7fab39000700 1 --2- 172.21.15.2:0/3967415912 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fab1c0a2d90 0x7fab1c0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:40.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.996+0000 7fab46dc4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a920bee40 0x559a92144420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:40.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.997+0000 7fab46dc4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a92144960 0x559a92144de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:40.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.997+0000 7fab46dc4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a9214d570 0x559a9214f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:40.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.997+0000 7fab46dc4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559a92051a10 con 0x559a9214d570 2024-06-13T11:32:40.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.997+0000 7fab46dc4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559a92094b00 con 0x559a92144960 2024-06-13T11:32:40.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.997+0000 7fab46dc4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559a9204f8f0 con 0x559a920bee40 2024-06-13T11:32:40.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.997+0000 7fab39a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a920bee40 0x559a92144420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:40.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.997+0000 7fab39a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a920bee40 0x559a92144420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:43502/0 (socket says 172.21.15.2:43502) 2024-06-13T11:32:40.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.997+0000 7fab39a00700 1 -- 172.21.15.2:0/3632997504 learned_addr learned my addr 172.21.15.2:0/3632997504 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.997+0000 7fab3a400700 1 --2- 172.21.15.2:0/3632997504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a9214d570 0x559a9214f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.997+0000 7fab39000700 1 --2- 172.21.15.2:0/3632997504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a92144960 0x559a92144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.997+0000 7fab39a00700 1 -- 172.21.15.2:0/3632997504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a92144960 msgr2=0x559a92144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.997+0000 7fab39a00700 1 --2- 172.21.15.2:0/3632997504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a92144960 0x559a92144de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.997+0000 7fab39a00700 1 -- 172.21.15.2:0/3632997504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a9214d570 msgr2=0x559a9214f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.997+0000 7fab39a00700 1 --2- 172.21.15.2:0/3632997504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a9214d570 0x559a9214f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.997+0000 7fab39a00700 1 -- 172.21.15.2:0/3632997504 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a9203cf90 con 0x559a920bee40 2024-06-13T11:32:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.998+0000 7fab39000700 1 --2- 172.21.15.2:0/3967415912 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fab1c0a2d90 0x7fab1c0a5250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fab340761d0 tx=0x7fab20005fb0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.998+0000 7fab39a00700 1 --2- 172.21.15.2:0/3632997504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a920bee40 0x559a92144420 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fab280a4370 tx=0x7fab2809b590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4f8edefb1bb6b7 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:41.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.998+0000 7fab26a00700 1 -- 172.21.15.2:0/3632997504 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28086050 con 0x559a920bee40 2024-06-13T11:32:41.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.998+0000 7fab26a00700 1 -- 172.21.15.2:0/3632997504 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab2809ffe0 con 0x559a920bee40 2024-06-13T11:32:41.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.998+0000 7fab26a00700 1 -- 172.21.15.2:0/3632997504 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab280a4410 con 0x559a920bee40 2024-06-13T11:32:41.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.999+0000 7fab46dc4b80 1 -- 172.21.15.2:0/3632997504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a920bee40 msgr2=0x559a92144420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:41.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.999+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/3632997504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a920bee40 0x559a92144420 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fab280a4370 tx=0x7fab2809b590 comp rx=0 tx=0).stop 2024-06-13T11:32:41.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.999+0000 7fab46dc4b80 1 -- 172.21.15.2:0/3632997504 shutdown_connections 2024-06-13T11:32:41.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.999+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/3632997504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a9214d570 0x559a9214f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.999+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/3632997504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a920bee40 0x559a92144420 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.999+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/3632997504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a92144960 0x559a92144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.999+0000 7fab46dc4b80 1 -- 172.21.15.2:0/3632997504 >> 172.21.15.2:0/3632997504 conn(0x559a9206f170 msgr2=0x559a9213e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:41.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.999+0000 7fab46dc4b80 1 -- 172.21.15.2:0/3632997504 shutdown_connections 2024-06-13T11:32:41.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.999+0000 7fab46dc4b80 1 -- 172.21.15.2:0/3632997504 wait complete. 2024-06-13T11:32:41.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:40.999+0000 7fab46dc4b80 1 -- start start 2024-06-13T11:32:41.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.000+0000 7fab46dc4b80 1 Processor -- start 2024-06-13T11:32:41.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.000+0000 7fab46dc4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a920bee40 0x559a9214cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:41.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.000+0000 7fab46dc4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a92144960 0x559a9214a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:41.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.000+0000 7fab46dc4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a9214d570 0x559a9214a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:41.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.000+0000 7fab46dc4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559a92030f60 con 0x559a92144960 2024-06-13T11:32:41.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.000+0000 7fab46dc4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559a92090ac0 con 0x559a9214d570 2024-06-13T11:32:41.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.000+0000 7fab46dc4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559a92150120 con 0x559a920bee40 2024-06-13T11:32:41.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.000+0000 7fab46dc4b80 10 client.0 _ll_register_callbacks cb 0x559a9202e720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:32:41.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.001+0000 7fab39000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a92144960 0x559a9214a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:41.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.001+0000 7fab39000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a92144960 0x559a9214a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35932/0 (socket says 172.21.15.2:35932) 2024-06-13T11:32:41.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.001+0000 7fab39000700 1 -- 172.21.15.2:0/1023077651 learned_addr learned my addr 172.21.15.2:0/1023077651 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:41.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.001+0000 7fab39a00700 1 --2- 172.21.15.2:0/1023077651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a920bee40 0x559a9214cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:41.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.001+0000 7fab3a400700 1 --2- 172.21.15.2:0/1023077651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a9214d570 0x559a9214a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:41.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.001+0000 7fab39a00700 1 -- 172.21.15.2:0/1023077651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a9214d570 msgr2=0x559a9214a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:41.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.001+0000 7fab39a00700 1 --2- 172.21.15.2:0/1023077651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a9214d570 0x559a9214a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.001+0000 7fab39a00700 1 -- 172.21.15.2:0/1023077651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a92144960 msgr2=0x559a9214a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:41.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.001+0000 7fab39a00700 1 --2- 172.21.15.2:0/1023077651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a92144960 0x559a9214a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.001+0000 7fab39a00700 1 -- 172.21.15.2:0/1023077651 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a91fe38d0 con 0x559a920bee40 2024-06-13T11:32:41.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.002+0000 7fab39a00700 1 --2- 172.21.15.2:0/1023077651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a920bee40 0x559a9214cd70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fab280cd3e0 tx=0x7fab2800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a388f3e7da68ac5a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:41.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.002+0000 7fab1b400700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:32:41.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.002+0000 7fab1b400700 1 -- 172.21.15.2:0/1023077651 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab280b8030 con 0x559a920bee40 2024-06-13T11:32:41.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.002+0000 7fab1b400700 1 -- 172.21.15.2:0/1023077651 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7fab280a4410 con 0x559a920bee40 2024-06-13T11:32:41.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.002+0000 7fab46dc4b80 1 -- 172.21.15.2:0/1023077651 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab2809ffe0 con 0x559a920bee40 2024-06-13T11:32:41.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.002+0000 7fab1b400700 1 -- 172.21.15.2:0/1023077651 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fab28099ff0 con 0x559a920bee40 2024-06-13T11:32:41.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.002+0000 7fab46dc4b80 10 client.26377 fetch_fsmap learned FSMap version 31 2024-06-13T11:32:41.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.002+0000 7fab46dc4b80 1 -- 172.21.15.2:0/1023077651 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x559a9215a8d0 con 0x559a920bee40 2024-06-13T11:32:41.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.002+0000 7fab1b400700 1 -- 172.21.15.2:0/1023077651 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab2809ffe0 con 0x559a920bee40 2024-06-13T11:32:41.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.003+0000 7fab1b400700 1 -- 172.21.15.2:0/1023077651 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fab280ba3e0 con 0x559a920bee40 2024-06-13T11:32:41.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.003+0000 7fab46dc4b80 10 client.26377 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:32:41.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.003+0000 7fab46dc4b80 10 client.26377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:32:41.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.003+0000 7fab46dc4b80 20 client.26377 populate_metadata read hostname 'smithi002' 2024-06-13T11:32:41.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.003+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/1023077651 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x559a9215cbd0 0x559a9215efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:41.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.003+0000 7fab46dc4b80 4 client.26377 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:32:41.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.003+0000 7fab46dc4b80 1 -- 172.21.15.2:0/1023077651 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a920a2000 con 0x559a9215cbd0 2024-06-13T11:32:41.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.003+0000 7fab39000700 1 --2- 172.21.15.2:0/1023077651 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x559a9215cbd0 0x559a9215efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:41.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.004+0000 7fab39000700 1 --2- 172.21.15.2:0/1023077651 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x559a9215cbd0 0x559a9215efc0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8554185592c51d85 server_cookie=9b3fc5b2829be7e3 in_seq=0 out_seq=0 2024-06-13T11:32:41.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.004+0000 7fab1b400700 10 client.26377 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:32:41.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.005+0000 7fab1b400700 1 -- 172.21.15.2:0/1023077651 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559a920a2000 con 0x559a9215cbd0 2024-06-13T11:32:41.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.005+0000 7fab1b400700 10 client.26377 handle_command_reply: tid=0 2024-06-13T11:32:41.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.005+0000 7fab46dc4b80 1 client.26377 shutdown 2024-06-13T11:32:41.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.005+0000 7fab46dc4b80 1 -- 172.21.15.2:0/1023077651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a920bee40 msgr2=0x559a9214cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:41.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.005+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/1023077651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a920bee40 0x559a9214cd70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fab280cd3e0 tx=0x7fab2800ef60 comp rx=0 tx=0).stop 2024-06-13T11:32:41.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.005+0000 7fab46dc4b80 1 -- 172.21.15.2:0/1023077651 shutdown_connections 2024-06-13T11:32:41.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.005+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/1023077651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a9214d570 0x559a9214a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.005+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/1023077651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a920bee40 0x559a9214cd70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.005+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/1023077651 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x559a9215cbd0 0x559a9215efc0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.005+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/1023077651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a92144960 0x559a9214a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.005+0000 7fab46dc4b80 1 -- 172.21.15.2:0/1023077651 >> 172.21.15.2:0/1023077651 conn(0x559a9206f170 msgr2=0x559a9213e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:41.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.005+0000 7fab1b400700 0 client.26377 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:32:41.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.005+0000 7fab46dc4b80 1 -- 172.21.15.2:0/1023077651 shutdown_connections 2024-06-13T11:32:41.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.005+0000 7fab46dc4b80 1 -- 172.21.15.2:0/1023077651 wait complete. 2024-06-13T11:32:41.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.006+0000 7fab46dc4b80 20 client.26377 trim_cache size 0 max 16384 2024-06-13T11:32:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.023+0000 7fab46dc4b80 1 Processor -- start 2024-06-13T11:32:41.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.023+0000 7fab46dc4b80 1 -- start start 2024-06-13T11:32:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.023+0000 7fab46dc4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a920bee40 0x559a9213e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.023+0000 7fab46dc4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a92144960 0x559a92148f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.023+0000 7fab46dc4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a9214d570 0x559a92147310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.023+0000 7fab46dc4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fab341b2e30 con 0x559a92144960 2024-06-13T11:32:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.023+0000 7fab46dc4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fab341b06c0 con 0x559a920bee40 2024-06-13T11:32:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.023+0000 7fab46dc4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fab341ae530 con 0x559a9214d570 2024-06-13T11:32:41.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.024+0000 7fab39000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a92144960 0x559a92148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.024+0000 7fab39a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a920bee40 0x559a9213e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.024+0000 7fab39000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a92144960 0x559a92148f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35934/0 (socket says 172.21.15.2:35934) 2024-06-13T11:32:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.024+0000 7fab39000700 1 -- 172.21.15.2:0/3823192896 learned_addr learned my addr 172.21.15.2:0/3823192896 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:41.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.024+0000 7fab3a400700 1 --2- 172.21.15.2:0/3823192896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a9214d570 0x559a92147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.024+0000 7fab39000700 1 -- 172.21.15.2:0/3823192896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a9214d570 msgr2=0x559a92147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.024+0000 7fab39000700 1 --2- 172.21.15.2:0/3823192896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a9214d570 0x559a92147310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.024+0000 7fab39000700 1 -- 172.21.15.2:0/3823192896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a920bee40 msgr2=0x559a9213e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.024+0000 7fab39000700 1 --2- 172.21.15.2:0/3823192896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a920bee40 0x559a9213e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.024+0000 7fab39000700 1 -- 172.21.15.2:0/3823192896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a92135e10 con 0x559a92144960 2024-06-13T11:32:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.024+0000 7fab39a00700 1 --2- 172.21.15.2:0/3823192896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a920bee40 0x559a9213e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:32:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.025+0000 7fab39000700 1 --2- 172.21.15.2:0/3823192896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a92144960 0x559a92148f40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fab2000b580 tx=0x7fab2001a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b658ab2e17e5e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.025+0000 7fab26000700 1 -- 172.21.15.2:0/3823192896 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2000b790 con 0x559a92144960 2024-06-13T11:32:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.025+0000 7fab26000700 1 -- 172.21.15.2:0/3823192896 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab2000be10 con 0x559a92144960 2024-06-13T11:32:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.025+0000 7fab26000700 1 -- 172.21.15.2:0/3823192896 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20033ce0 con 0x559a92144960 2024-06-13T11:32:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.026+0000 7fab46dc4b80 1 -- 172.21.15.2:0/3823192896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a92144960 msgr2=0x559a92148f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.026+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/3823192896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a92144960 0x559a92148f40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fab2000b580 tx=0x7fab2001a070 comp rx=0 tx=0).stop 2024-06-13T11:32:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.026+0000 7fab46dc4b80 1 -- 172.21.15.2:0/3823192896 shutdown_connections 2024-06-13T11:32:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.026+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/3823192896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a9214d570 0x559a92147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.026+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/3823192896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a920bee40 0x559a9213e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.026+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/3823192896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a92144960 0x559a92148f40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.026+0000 7fab46dc4b80 1 -- 172.21.15.2:0/3823192896 >> 172.21.15.2:0/3823192896 conn(0x559a9206f170 msgr2=0x559a92148830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.026+0000 7fab46dc4b80 1 -- 172.21.15.2:0/3823192896 shutdown_connections 2024-06-13T11:32:41.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.026+0000 7fab46dc4b80 1 -- 172.21.15.2:0/3823192896 wait complete. 2024-06-13T11:32:41.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.026+0000 7fab46dc4b80 1 -- start start 2024-06-13T11:32:41.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.027+0000 7fab46dc4b80 1 Processor -- start 2024-06-13T11:32:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.027+0000 7fab46dc4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a920bee40 0x559a9215ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.027+0000 7fab46dc4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a92144960 0x559a9215f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.027+0000 7fab46dc4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a9214d570 0x559a9215f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.027+0000 7fab46dc4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fab341aeb80 con 0x559a9214d570 2024-06-13T11:32:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.027+0000 7fab46dc4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fab341afff0 con 0x559a920bee40 2024-06-13T11:32:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.027+0000 7fab46dc4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fab341af250 con 0x559a92144960 2024-06-13T11:32:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.027+0000 7fab46dc4b80 10 client.0 _ll_register_callbacks cb 0x559a9202e720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:32:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.028+0000 7fab3a400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a9214d570 0x559a9215f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.028+0000 7fab39a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a920bee40 0x559a9215ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.028+0000 7fab39000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a92144960 0x559a9215f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.028+0000 7fab3a400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a9214d570 0x559a9215f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35936/0 (socket says 172.21.15.2:35936) 2024-06-13T11:32:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.028+0000 7fab3a400700 1 -- 172.21.15.2:0/1565571832 learned_addr learned my addr 172.21.15.2:0/1565571832 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.028+0000 7fab39a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a920bee40 0x559a9215ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:52252/0 (socket says 172.21.15.2:52252) 2024-06-13T11:32:41.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.028+0000 7fab39000700 1 -- 172.21.15.2:0/1565571832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a920bee40 msgr2=0x559a9215ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:41.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.028+0000 7fab39000700 1 --2- 172.21.15.2:0/1565571832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a920bee40 0x559a9215ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.028+0000 7fab39000700 1 -- 172.21.15.2:0/1565571832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a9214d570 msgr2=0x559a9215f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:41.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.028+0000 7fab39000700 1 --2- 172.21.15.2:0/1565571832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a9214d570 0x559a9215f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.028+0000 7fab39000700 1 -- 172.21.15.2:0/1565571832 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a921c57b0 con 0x559a92144960 2024-06-13T11:32:41.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.028+0000 7fab39a00700 1 --2- 172.21.15.2:0/1565571832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a920bee40 0x559a9215ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:32:41.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.028+0000 7fab39000700 1 --2- 172.21.15.2:0/1565571832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a92144960 0x559a9215f180 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fab200098e0 tx=0x7fab20005810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcfdb66375af78e7 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:41.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.028+0000 7fab1b400700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:32:41.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.029+0000 7fab1b400700 1 -- 172.21.15.2:0/1565571832 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20043070 con 0x559a92144960 2024-06-13T11:32:41.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.029+0000 7fab1b400700 1 -- 172.21.15.2:0/1565571832 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7fab2000b790 con 0x559a92144960 2024-06-13T11:32:41.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.029+0000 7fab46dc4b80 1 -- 172.21.15.2:0/1565571832 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab2000be10 con 0x559a92144960 2024-06-13T11:32:41.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.029+0000 7fab1b400700 1 -- 172.21.15.2:0/1565571832 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fab2004e050 con 0x559a92144960 2024-06-13T11:32:41.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.029+0000 7fab46dc4b80 10 client.26383 fetch_fsmap learned FSMap version 31 2024-06-13T11:32:41.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.029+0000 7fab46dc4b80 1 -- 172.21.15.2:0/1565571832 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x559a921c6a90 con 0x559a92144960 2024-06-13T11:32:41.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.029+0000 7fab1b400700 1 -- 172.21.15.2:0/1565571832 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab2000be10 con 0x559a92144960 2024-06-13T11:32:41.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.030+0000 7fab1b400700 1 -- 172.21.15.2:0/1565571832 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fab20030040 con 0x559a92144960 2024-06-13T11:32:41.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.030+0000 7fab46dc4b80 10 client.26383 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:32:41.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.030+0000 7fab46dc4b80 10 client.26383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:32:41.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.030+0000 7fab46dc4b80 20 client.26383 populate_metadata read hostname 'smithi002' 2024-06-13T11:32:41.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.030+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/1565571832 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x559a921c6fd0 0x559a921c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:41.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.030+0000 7fab46dc4b80 4 client.26383 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:32:41.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.030+0000 7fab46dc4b80 1 -- 172.21.15.2:0/1565571832 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559a9209c580 con 0x559a921c6fd0 2024-06-13T11:32:41.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.030+0000 7fab39a00700 1 --2- 172.21.15.2:0/1565571832 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x559a921c6fd0 0x559a921c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:41.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.031+0000 7fab39a00700 1 --2- 172.21.15.2:0/1565571832 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x559a921c6fd0 0x559a921c93f0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46414964376eb191 server_cookie=7c4d7a5d1404ff47 in_seq=0 out_seq=0 2024-06-13T11:32:41.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.031+0000 7fab1b400700 10 client.26383 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:32:41.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.031+0000 7fab1b400700 1 -- 172.21.15.2:0/1565571832 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559a9209c580 con 0x559a921c6fd0 2024-06-13T11:32:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.031+0000 7fab1b400700 10 client.26383 handle_command_reply: tid=0 2024-06-13T11:32:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.031+0000 7fab46dc4b80 1 client.26383 shutdown 2024-06-13T11:32:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.031+0000 7fab46dc4b80 1 -- 172.21.15.2:0/1565571832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a92144960 msgr2=0x559a9215f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.031+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/1565571832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a92144960 0x559a9215f180 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fab200098e0 tx=0x7fab20005810 comp rx=0 tx=0).stop 2024-06-13T11:32:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.031+0000 7fab46dc4b80 1 -- 172.21.15.2:0/1565571832 shutdown_connections 2024-06-13T11:32:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.031+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/1565571832 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x559a921c6fd0 0x559a921c93f0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.031+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/1565571832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559a9214d570 0x559a9215f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.031+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/1565571832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a920bee40 0x559a9215ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.031+0000 7fab46dc4b80 1 --2- 172.21.15.2:0/1565571832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a92144960 0x559a9215f180 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.031+0000 7fab1b400700 0 client.26383 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:32:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.031+0000 7fab46dc4b80 1 -- 172.21.15.2:0/1565571832 >> 172.21.15.2:0/1565571832 conn(0x559a9206f170 msgr2=0x559a92148830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.031+0000 7fab46dc4b80 1 -- 172.21.15.2:0/1565571832 shutdown_connections 2024-06-13T11:32:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.031+0000 7fab46dc4b80 1 -- 172.21.15.2:0/1565571832 wait complete. 2024-06-13T11:32:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.032+0000 7fab46dc4b80 20 client.26383 trim_cache size 0 max 16384 2024-06-13T11:32:41.037 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:32:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.032+0000 7fab3ae00700 1 -- 172.21.15.2:0/3967415912 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fab1c0a2d90 msgr2=0x7fab1c0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.032+0000 7fab3ae00700 1 --2- 172.21.15.2:0/3967415912 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fab1c0a2d90 0x7fab1c0a5250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fab340761d0 tx=0x7fab20005fb0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.032+0000 7fab3ae00700 1 -- 172.21.15.2:0/3967415912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab341026d0 msgr2=0x7fab34074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.032+0000 7fab3ae00700 1 --2- 172.21.15.2:0/3967415912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab341026d0 0x7fab34074790 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fab2800e9a0 tx=0x7fab2800ecb0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.032+0000 7fab3ae00700 1 -- 172.21.15.2:0/3967415912 shutdown_connections 2024-06-13T11:32:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.032+0000 7fab3ae00700 1 --2- 172.21.15.2:0/3967415912 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fab1c0a2d90 0x7fab1c0a5250 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.032+0000 7fab3ae00700 1 --2- 172.21.15.2:0/3967415912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab34104980 0x7fab34075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.032+0000 7fab3ae00700 1 --2- 172.21.15.2:0/3967415912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab341026d0 0x7fab34074790 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.032+0000 7fab3ae00700 1 --2- 172.21.15.2:0/3967415912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab34103fc0 0x7fab34074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.032+0000 7fab3ae00700 1 -- 172.21.15.2:0/3967415912 >> 172.21.15.2:0/3967415912 conn(0x7fab340fde80 msgr2=0x7fab340fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.033+0000 7fab3ae00700 1 -- 172.21.15.2:0/3967415912 shutdown_connections 2024-06-13T11:32:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:41.033+0000 7fab3ae00700 1 -- 172.21.15.2:0/3967415912 wait complete. 2024-06-13T11:32:41.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:41 smithi077 ceph-mon[36410]: pgmap v274: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:41.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:41 smithi002 ceph-mon[32210]: pgmap v274: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:41.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:41 smithi178 ceph-mon[36913]: pgmap v274: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:43.050 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-13T11:32:43.050 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-13T11:32:43.536 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:32:43.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:43 smithi077 ceph-mon[36410]: pgmap v275: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:32:43.855 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:43 smithi002 ceph-mon[32210]: pgmap v275: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:32:43.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:43 smithi178 ceph-mon[36913]: pgmap v275: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:32:45.538 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:45 smithi002 ceph-mon[32210]: pgmap v276: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:45.762 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:45 smithi178 ceph-mon[36913]: pgmap v276: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:45.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:45 smithi077 ceph-mon[36410]: pgmap v276: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:45.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.836+0000 7f49df800700 1 -- 172.21.15.2:0/2489022213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d8113660 msgr2=0x7f49d8115a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:45.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.836+0000 7f49df800700 1 --2- 172.21.15.2:0/2489022213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d8113660 0x7f49d8115a50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009f90 tx=0x7f49d000b330 comp rx=0 tx=0).stop 2024-06-13T11:32:45.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.836+0000 7f49df800700 1 -- 172.21.15.2:0/2489022213 shutdown_connections 2024-06-13T11:32:45.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.836+0000 7f49df800700 1 --2- 172.21.15.2:0/2489022213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d8113660 0x7f49d8115a50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.836+0000 7f49df800700 1 --2- 172.21.15.2:0/2489022213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d80746c0 0x7f49d8074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.836+0000 7f49df800700 1 --2- 172.21.15.2:0/2489022213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49d8074fe0 0x7f49d8113120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.836+0000 7f49df800700 1 -- 172.21.15.2:0/2489022213 >> 172.21.15.2:0/2489022213 conn(0x7f49d80795f0 msgr2=0x7f49d8079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:45.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.836+0000 7f49df800700 1 -- 172.21.15.2:0/2489022213 shutdown_connections 2024-06-13T11:32:45.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.836+0000 7f49df800700 1 -- 172.21.15.2:0/2489022213 wait complete. 2024-06-13T11:32:45.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.837+0000 7f49df800700 1 Processor -- start 2024-06-13T11:32:45.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.837+0000 7f49df800700 1 -- start start 2024-06-13T11:32:45.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.838+0000 7f49df800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d80746c0 0x7f49d819f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.838+0000 7f49df800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49d8074fe0 0x7f49d819f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.838+0000 7f49df800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d8113660 0x7f49d81a3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.838+0000 7f49df800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f49d8118df0 con 0x7f49d8113660 2024-06-13T11:32:45.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.838+0000 7f49df800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f49d8118c70 con 0x7f49d80746c0 2024-06-13T11:32:45.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.838+0000 7f49df800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f49d8118f70 con 0x7f49d8074fe0 2024-06-13T11:32:45.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.838+0000 7f49dce00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d80746c0 0x7f49d819f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.838+0000 7f49d7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49d8074fe0 0x7f49d819f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.838+0000 7f49dd800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d8113660 0x7f49d81a3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.838+0000 7f49dce00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d80746c0 0x7f49d819f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:52268/0 (socket says 172.21.15.2:52268) 2024-06-13T11:32:45.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.838+0000 7f49dce00700 1 -- 172.21.15.2:0/2039811942 learned_addr learned my addr 172.21.15.2:0/2039811942 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:45.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.839+0000 7f49dce00700 1 -- 172.21.15.2:0/2039811942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49d8074fe0 msgr2=0x7f49d819f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:45.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.839+0000 7f49dce00700 1 --2- 172.21.15.2:0/2039811942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49d8074fe0 0x7f49d819f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.839+0000 7f49dce00700 1 -- 172.21.15.2:0/2039811942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d8113660 msgr2=0x7f49d81a3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:45.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.839+0000 7f49dce00700 1 --2- 172.21.15.2:0/2039811942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d8113660 0x7f49d81a3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.839+0000 7f49dce00700 1 -- 172.21.15.2:0/2039811942 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d81a4230 con 0x7f49d80746c0 2024-06-13T11:32:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.839+0000 7f49dce00700 1 --2- 172.21.15.2:0/2039811942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d80746c0 0x7f49d819f220 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00e9a0 tx=0x7f49cc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.839+0000 7f49d5600700 1 -- 172.21.15.2:0/2039811942 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc00c9c0 con 0x7f49d80746c0 2024-06-13T11:32:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.839+0000 7f49d5600700 1 -- 172.21.15.2:0/2039811942 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49cc00cb60 con 0x7f49d80746c0 2024-06-13T11:32:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.839+0000 7f49df800700 1 -- 172.21.15.2:0/2039811942 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d81a4520 con 0x7f49d80746c0 2024-06-13T11:32:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.839+0000 7f49d5600700 1 -- 172.21.15.2:0/2039811942 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc018660 con 0x7f49d80746c0 2024-06-13T11:32:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.840+0000 7f49df800700 1 -- 172.21.15.2:0/2039811942 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d81abda0 con 0x7f49d80746c0 2024-06-13T11:32:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.843+0000 7f49d5600700 1 -- 172.21.15.2:0/2039811942 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f49cc00cd10 con 0x7f49d80746c0 2024-06-13T11:32:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.844+0000 7f49ea154b80 1 Processor -- start 2024-06-13T11:32:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.844+0000 7f49ea154b80 1 -- start start 2024-06-13T11:32:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.844+0000 7f49d5600700 1 --2- 172.21.15.2:0/2039811942 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f49c00a2d90 0x7f49c00a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.845+0000 7f49ea154b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f03c2ec0 0x55d1f04460f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.845+0000 7f49ea154b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0446630 0x55d1f0446ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.845+0000 7f49ea154b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f0451380 0x55d1f0453770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.845+0000 7f49ea154b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d1f0355a90 con 0x55d1f03c2ec0 2024-06-13T11:32:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.845+0000 7f49ea154b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d1f0398b80 con 0x55d1f0451380 2024-06-13T11:32:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.845+0000 7f49ea154b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d1f0353970 con 0x55d1f0446630 2024-06-13T11:32:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.845+0000 7f49d5600700 1 -- 172.21.15.2:0/2039811942 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7f49cc0cf9d0 con 0x7f49d80746c0 2024-06-13T11:32:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.845+0000 7f49dd800700 1 --2- 172.21.15.2:0/2039811942 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f49c00a2d90 0x7f49c00a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.845+0000 7f49d7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0446630 0x55d1f0446ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.845+0000 7f49dce00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f03c2ec0 0x55d1f04460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.845+0000 7f49d7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0446630 0x55d1f0446ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:43546/0 (socket says 172.21.15.2:43546) 2024-06-13T11:32:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.845+0000 7f49d7e00700 1 -- 172.21.15.2:0/2750559899 learned_addr learned my addr 172.21.15.2:0/2750559899 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.845+0000 7f49dd800700 1 --2- 172.21.15.2:0/2750559899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f0451380 0x55d1f0453770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.846+0000 7f49d7e00700 1 -- 172.21.15.2:0/2750559899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f0451380 msgr2=0x55d1f0453770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:45.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.846+0000 7f49d7e00700 1 --2- 172.21.15.2:0/2750559899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f0451380 0x55d1f0453770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.846+0000 7f49d7e00700 1 -- 172.21.15.2:0/2750559899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f03c2ec0 msgr2=0x55d1f04460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:45.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.846+0000 7f49d7e00700 1 --2- 172.21.15.2:0/2750559899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f03c2ec0 0x55d1f04460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.846+0000 7f49d7e00700 1 -- 172.21.15.2:0/2750559899 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1f0341010 con 0x55d1f0446630 2024-06-13T11:32:45.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.846+0000 7f49d7e00700 1 --2- 172.21.15.2:0/2750559899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0446630 0x55d1f0446ab0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009cd0 tx=0x7f49c4011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e79f5b10ffadc5a3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.846+0000 7f49dd800700 1 --2- 172.21.15.2:0/2039811942 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f49c00a2d90 0x7f49c00a5250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009450 tx=0x7f49d00093a0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.846+0000 7f49ca000700 1 -- 172.21.15.2:0/2750559899 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c4011d80 con 0x55d1f0446630 2024-06-13T11:32:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.846+0000 7f49ca000700 1 -- 172.21.15.2:0/2750559899 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49c4004510 con 0x55d1f0446630 2024-06-13T11:32:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.846+0000 7f49ca000700 1 -- 172.21.15.2:0/2750559899 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c4019420 con 0x55d1f0446630 2024-06-13T11:32:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.847+0000 7f49ea154b80 1 -- 172.21.15.2:0/2750559899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0446630 msgr2=0x55d1f0446ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.847+0000 7f49ea154b80 1 --2- 172.21.15.2:0/2750559899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0446630 0x55d1f0446ab0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009cd0 tx=0x7f49c4011440 comp rx=0 tx=0).stop 2024-06-13T11:32:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.847+0000 7f49ea154b80 1 -- 172.21.15.2:0/2750559899 shutdown_connections 2024-06-13T11:32:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.847+0000 7f49ea154b80 1 --2- 172.21.15.2:0/2750559899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f03c2ec0 0x55d1f04460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.847+0000 7f49ea154b80 1 --2- 172.21.15.2:0/2750559899 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f0451380 0x55d1f0453770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.847+0000 7f49ea154b80 1 --2- 172.21.15.2:0/2750559899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0446630 0x55d1f0446ab0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.847+0000 7f49ea154b80 1 -- 172.21.15.2:0/2750559899 >> 172.21.15.2:0/2750559899 conn(0x55d1f03731f0 msgr2=0x55d1f0442530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.847+0000 7f49ea154b80 1 -- 172.21.15.2:0/2750559899 shutdown_connections 2024-06-13T11:32:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.847+0000 7f49ea154b80 1 -- 172.21.15.2:0/2750559899 wait complete. 2024-06-13T11:32:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.848+0000 7f49ea154b80 1 -- start start 2024-06-13T11:32:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.848+0000 7f49ea154b80 1 Processor -- start 2024-06-13T11:32:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.849+0000 7f49ea154b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f03c2ec0 0x55d1f04509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.849+0000 7f49ea154b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0446630 0x55d1f044dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.849+0000 7f49ea154b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f0451380 0x55d1f044e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.849+0000 7f49ea154b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d1f0334fe0 con 0x55d1f0451380 2024-06-13T11:32:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.849+0000 7f49ea154b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d1f0394b40 con 0x55d1f03c2ec0 2024-06-13T11:32:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.849+0000 7f49ea154b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d1f0454040 con 0x55d1f0446630 2024-06-13T11:32:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.849+0000 7f49ea154b80 10 client.0 _ll_register_callbacks cb 0x55d1f03327a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:32:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.849+0000 7f49d7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0446630 0x55d1f044dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.849+0000 7f49dd800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f0451380 0x55d1f044e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.849+0000 7f49d7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0446630 0x55d1f044dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:43558/0 (socket says 172.21.15.2:43558) 2024-06-13T11:32:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.849+0000 7f49dce00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f03c2ec0 0x55d1f04509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.849+0000 7f49d7e00700 1 -- 172.21.15.2:0/2409817131 learned_addr learned my addr 172.21.15.2:0/2409817131 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.850+0000 7f49d7e00700 1 -- 172.21.15.2:0/2409817131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f03c2ec0 msgr2=0x55d1f04509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:45.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.850+0000 7f49d7e00700 1 --2- 172.21.15.2:0/2409817131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f03c2ec0 0x55d1f04509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.850+0000 7f49d7e00700 1 -- 172.21.15.2:0/2409817131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f0451380 msgr2=0x55d1f044e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:45.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.850+0000 7f49d7e00700 1 --2- 172.21.15.2:0/2409817131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f0451380 0x55d1f044e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.850+0000 7f49d7e00700 1 -- 172.21.15.2:0/2409817131 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1f02e7950 con 0x55d1f0446630 2024-06-13T11:32:45.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.850+0000 7f49dce00700 1 --2- 172.21.15.2:0/2409817131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f03c2ec0 0x55d1f04509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:32:45.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.850+0000 7f49d7e00700 1 --2- 172.21.15.2:0/2409817131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0446630 0x55d1f044dcd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f49c4011790 tx=0x7f49c4005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f34e95d78b686280 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:45.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.850+0000 7f49bea00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:32:45.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.850+0000 7f49bea00700 1 -- 172.21.15.2:0/2409817131 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c4027070 con 0x55d1f0446630 2024-06-13T11:32:45.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.850+0000 7f49ea154b80 1 -- 172.21.15.2:0/2409817131 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49c4004510 con 0x55d1f0446630 2024-06-13T11:32:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.850+0000 7f49bea00700 1 -- 172.21.15.2:0/2409817131 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7f49c4003c40 con 0x55d1f0446630 2024-06-13T11:32:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.851+0000 7f49bea00700 1 -- 172.21.15.2:0/2409817131 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f49c4033050 con 0x55d1f0446630 2024-06-13T11:32:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.851+0000 7f49ea154b80 10 client.26395 fetch_fsmap learned FSMap version 31 2024-06-13T11:32:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.851+0000 7f49ea154b80 1 -- 172.21.15.2:0/2409817131 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d1f045e640 con 0x55d1f0446630 2024-06-13T11:32:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.851+0000 7f49bea00700 1 -- 172.21.15.2:0/2409817131 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49c4004510 con 0x55d1f0446630 2024-06-13T11:32:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.851+0000 7f49bea00700 1 -- 172.21.15.2:0/2409817131 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f49c4018070 con 0x55d1f0446630 2024-06-13T11:32:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.851+0000 7f49ea154b80 10 client.26395 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:32:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.851+0000 7f49ea154b80 10 client.26395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:32:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.851+0000 7f49ea154b80 20 client.26395 populate_metadata read hostname 'smithi002' 2024-06-13T11:32:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.851+0000 7f49ea154b80 1 --2- 172.21.15.2:0/2409817131 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d1f0460b70 0x55d1f0462f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.851+0000 7f49ea154b80 4 client.26395 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:32:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.851+0000 7f49ea154b80 1 -- 172.21.15.2:0/2409817131 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1f03a6080 con 0x55d1f0460b70 2024-06-13T11:32:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.852+0000 7f49dce00700 1 --2- 172.21.15.2:0/2409817131 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d1f0460b70 0x55d1f0462f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.852+0000 7f49dce00700 1 --2- 172.21.15.2:0/2409817131 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d1f0460b70 0x55d1f0462f60 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeb8060a2c4ca3e4 server_cookie=c471b5c1f8e42a12 in_seq=0 out_seq=0 2024-06-13T11:32:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.852+0000 7f49bea00700 10 client.26395 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:32:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.853+0000 7f49bea00700 1 -- 172.21.15.2:0/2409817131 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d1f03a6080 con 0x55d1f0460b70 2024-06-13T11:32:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.853+0000 7f49bea00700 10 client.26395 handle_command_reply: tid=0 2024-06-13T11:32:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.853+0000 7f49ea154b80 1 client.26395 shutdown 2024-06-13T11:32:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.853+0000 7f49ea154b80 1 -- 172.21.15.2:0/2409817131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0446630 msgr2=0x55d1f044dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.853+0000 7f49ea154b80 1 --2- 172.21.15.2:0/2409817131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0446630 0x55d1f044dcd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f49c4011790 tx=0x7f49c4005f00 comp rx=0 tx=0).stop 2024-06-13T11:32:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.853+0000 7f49ea154b80 1 -- 172.21.15.2:0/2409817131 shutdown_connections 2024-06-13T11:32:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.853+0000 7f49ea154b80 1 --2- 172.21.15.2:0/2409817131 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d1f0460b70 0x55d1f0462f60 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.853+0000 7f49ea154b80 1 --2- 172.21.15.2:0/2409817131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f0451380 0x55d1f044e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.853+0000 7f49ea154b80 1 --2- 172.21.15.2:0/2409817131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f03c2ec0 0x55d1f04509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.853+0000 7f49ea154b80 1 --2- 172.21.15.2:0/2409817131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0446630 0x55d1f044dcd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.853+0000 7f49ea154b80 1 -- 172.21.15.2:0/2409817131 >> 172.21.15.2:0/2409817131 conn(0x55d1f03731f0 msgr2=0x55d1f04417c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.853+0000 7f49bea00700 0 client.26395 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:32:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.854+0000 7f49ea154b80 1 -- 172.21.15.2:0/2409817131 shutdown_connections 2024-06-13T11:32:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.854+0000 7f49ea154b80 1 -- 172.21.15.2:0/2409817131 wait complete. 2024-06-13T11:32:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.854+0000 7f49ea154b80 20 client.26395 trim_cache size 0 max 16384 2024-06-13T11:32:45.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.877+0000 7f49ea154b80 1 Processor -- start 2024-06-13T11:32:45.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.877+0000 7f49ea154b80 1 -- start start 2024-06-13T11:32:45.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.877+0000 7f49ea154b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f03c2ec0 0x55d1f0452770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.877+0000 7f49ea154b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f0446630 0x55d1f0450510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.877+0000 7f49ea154b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0451380 0x55d1f0449050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.877+0000 7f49ea154b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f49d81b74d0 con 0x55d1f03c2ec0 2024-06-13T11:32:45.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.877+0000 7f49ea154b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f49d81b4d60 con 0x55d1f0446630 2024-06-13T11:32:45.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.877+0000 7f49ea154b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f49d81b2bd0 con 0x55d1f0451380 2024-06-13T11:32:45.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.878+0000 7f49dd800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0451380 0x55d1f0449050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.878+0000 7f49dce00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f03c2ec0 0x55d1f0452770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.878+0000 7f49dd800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0451380 0x55d1f0449050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:43566/0 (socket says 172.21.15.2:43566) 2024-06-13T11:32:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.878+0000 7f49dd800700 1 -- 172.21.15.2:0/786592692 learned_addr learned my addr 172.21.15.2:0/786592692 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.878+0000 7f49d7e00700 1 --2- 172.21.15.2:0/786592692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f0446630 0x55d1f0450510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.878+0000 7f49dd800700 1 -- 172.21.15.2:0/786592692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f0446630 msgr2=0x55d1f0450510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:45.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.878+0000 7f49dd800700 1 --2- 172.21.15.2:0/786592692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f0446630 0x55d1f0450510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.878+0000 7f49dd800700 1 -- 172.21.15.2:0/786592692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f03c2ec0 msgr2=0x55d1f0452770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.878+0000 7f49dd800700 1 --2- 172.21.15.2:0/786592692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f03c2ec0 0x55d1f0452770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.878+0000 7f49dd800700 1 -- 172.21.15.2:0/786592692 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1f0442a70 con 0x55d1f0451380 2024-06-13T11:32:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.878+0000 7f49d7e00700 1 --2- 172.21.15.2:0/786592692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f0446630 0x55d1f0450510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:32:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.879+0000 7f49dd800700 1 --2- 172.21.15.2:0/786592692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0451380 0x55d1f0449050 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f49d0015000 tx=0x7f49d0023040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=645cbfc5f8f3706d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.879+0000 7f49c9600700 1 -- 172.21.15.2:0/786592692 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d00052c0 con 0x55d1f0451380 2024-06-13T11:32:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.879+0000 7f49c9600700 1 -- 172.21.15.2:0/786592692 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49d0032070 con 0x55d1f0451380 2024-06-13T11:32:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.879+0000 7f49c9600700 1 -- 172.21.15.2:0/786592692 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d0021c80 con 0x55d1f0451380 2024-06-13T11:32:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.879+0000 7f49ea154b80 1 -- 172.21.15.2:0/786592692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0451380 msgr2=0x55d1f0449050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.879+0000 7f49ea154b80 1 --2- 172.21.15.2:0/786592692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0451380 0x55d1f0449050 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f49d0015000 tx=0x7f49d0023040 comp rx=0 tx=0).stop 2024-06-13T11:32:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.880+0000 7f49ea154b80 1 -- 172.21.15.2:0/786592692 shutdown_connections 2024-06-13T11:32:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.880+0000 7f49ea154b80 1 --2- 172.21.15.2:0/786592692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f03c2ec0 0x55d1f0452770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.880+0000 7f49ea154b80 1 --2- 172.21.15.2:0/786592692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0451380 0x55d1f0449050 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.880+0000 7f49ea154b80 1 --2- 172.21.15.2:0/786592692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f0446630 0x55d1f0450510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.880+0000 7f49ea154b80 1 -- 172.21.15.2:0/786592692 >> 172.21.15.2:0/786592692 conn(0x55d1f03731f0 msgr2=0x55d1f04417c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.880+0000 7f49ea154b80 1 -- 172.21.15.2:0/786592692 shutdown_connections 2024-06-13T11:32:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.880+0000 7f49ea154b80 1 -- 172.21.15.2:0/786592692 wait complete. 2024-06-13T11:32:45.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.880+0000 7f49ea154b80 1 -- start start 2024-06-13T11:32:45.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.880+0000 7f49ea154b80 1 Processor -- start 2024-06-13T11:32:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.881+0000 7f49ea154b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f03c2ec0 0x55d1f04592d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.881+0000 7f49ea154b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f0446630 0x55d1f0459810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.881+0000 7f49ea154b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0451380 0x55d1f0468480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.881+0000 7f49ea154b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f49d81b3220 con 0x55d1f0446630 2024-06-13T11:32:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.881+0000 7f49ea154b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f49d81b4690 con 0x55d1f03c2ec0 2024-06-13T11:32:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.881+0000 7f49ea154b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f49d81b38f0 con 0x55d1f0451380 2024-06-13T11:32:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.881+0000 7f49ea154b80 10 client.0 _ll_register_callbacks cb 0x55d1f03327a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:32:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.881+0000 7f49dd800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0451380 0x55d1f0468480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.881+0000 7f49d7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f0446630 0x55d1f0459810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.881+0000 7f49dd800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0451380 0x55d1f0468480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:43572/0 (socket says 172.21.15.2:43572) 2024-06-13T11:32:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.881+0000 7f49dce00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f03c2ec0 0x55d1f04592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.881+0000 7f49dd800700 1 -- 172.21.15.2:0/1973248241 learned_addr learned my addr 172.21.15.2:0/1973248241 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.882+0000 7f49dd800700 1 -- 172.21.15.2:0/1973248241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f03c2ec0 msgr2=0x55d1f04592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.882+0000 7f49dd800700 1 --2- 172.21.15.2:0/1973248241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f03c2ec0 0x55d1f04592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.882+0000 7f49dd800700 1 -- 172.21.15.2:0/1973248241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f0446630 msgr2=0x55d1f0459810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.882+0000 7f49dd800700 1 --2- 172.21.15.2:0/1973248241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f0446630 0x55d1f0459810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.882+0000 7f49dd800700 1 -- 172.21.15.2:0/1973248241 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1f044bbd0 con 0x55d1f0451380 2024-06-13T11:32:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.882+0000 7f49d7e00700 1 --2- 172.21.15.2:0/1973248241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f0446630 0x55d1f0459810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:32:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.882+0000 7f49dd800700 1 --2- 172.21.15.2:0/1973248241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0451380 0x55d1f0468480 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f49d0003ed0 tx=0x7f49d0021b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6733b7494bf8bb2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.882+0000 7f49bea00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:32:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.882+0000 7f49bea00700 1 -- 172.21.15.2:0/1973248241 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d003c070 con 0x55d1f0451380 2024-06-13T11:32:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.883+0000 7f49ea154b80 1 -- 172.21.15.2:0/1973248241 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49d0032070 con 0x55d1f0451380 2024-06-13T11:32:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.883+0000 7f49bea00700 1 -- 172.21.15.2:0/1973248241 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7f49d001e660 con 0x55d1f0451380 2024-06-13T11:32:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.883+0000 7f49bea00700 1 -- 172.21.15.2:0/1973248241 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f49d001e8a0 con 0x55d1f0451380 2024-06-13T11:32:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.883+0000 7f49ea154b80 10 client.26401 fetch_fsmap learned FSMap version 31 2024-06-13T11:32:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.883+0000 7f49ea154b80 1 -- 172.21.15.2:0/1973248241 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d1f04cbb70 con 0x55d1f0451380 2024-06-13T11:32:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.883+0000 7f49bea00700 1 -- 172.21.15.2:0/1973248241 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49d0032070 con 0x55d1f0451380 2024-06-13T11:32:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.883+0000 7f49bea00700 1 -- 172.21.15.2:0/1973248241 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f49d0011070 con 0x55d1f0451380 2024-06-13T11:32:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.883+0000 7f49ea154b80 10 client.26401 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:32:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.883+0000 7f49ea154b80 10 client.26401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:32:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.883+0000 7f49ea154b80 20 client.26401 populate_metadata read hostname 'smithi002' 2024-06-13T11:32:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.883+0000 7f49ea154b80 1 --2- 172.21.15.2:0/1973248241 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d1f04cc180 0x55d1f04ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.883+0000 7f49ea154b80 4 client.26401 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-13T11:32:45.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.883+0000 7f49ea154b80 1 -- 172.21.15.2:0/1973248241 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d1f03a0600 con 0x55d1f04cc180 2024-06-13T11:32:45.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.884+0000 7f49dce00700 1 --2- 172.21.15.2:0/1973248241 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d1f04cc180 0x55d1f04ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:45.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.884+0000 7f49dce00700 1 --2- 172.21.15.2:0/1973248241 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d1f04cc180 0x55d1f04ce5a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b261c1f5969a3b3 server_cookie=d034f5d6491f3990 in_seq=0 out_seq=0 2024-06-13T11:32:45.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.884+0000 7f49bea00700 10 client.26401 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:32:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.886+0000 7f49bea00700 1 -- 172.21.15.2:0/1973248241 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d1f03a0600 con 0x55d1f04cc180 2024-06-13T11:32:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.886+0000 7f49bea00700 10 client.26401 handle_command_reply: tid=0 2024-06-13T11:32:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.886+0000 7f49ea154b80 1 client.26401 shutdown 2024-06-13T11:32:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.886+0000 7f49ea154b80 1 -- 172.21.15.2:0/1973248241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0451380 msgr2=0x55d1f0468480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:45.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.886+0000 7f49ea154b80 1 --2- 172.21.15.2:0/1973248241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0451380 0x55d1f0468480 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f49d0003ed0 tx=0x7f49d0021b90 comp rx=0 tx=0).stop 2024-06-13T11:32:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.886+0000 7f49ea154b80 1 -- 172.21.15.2:0/1973248241 shutdown_connections 2024-06-13T11:32:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.886+0000 7f49ea154b80 1 --2- 172.21.15.2:0/1973248241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1f0451380 0x55d1f0468480 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.886+0000 7f49ea154b80 1 --2- 172.21.15.2:0/1973248241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d1f03c2ec0 0x55d1f04592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.886+0000 7f49ea154b80 1 --2- 172.21.15.2:0/1973248241 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55d1f04cc180 0x55d1f04ce5a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.886+0000 7f49ea154b80 1 --2- 172.21.15.2:0/1973248241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d1f0446630 0x55d1f0459810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.886+0000 7f49ea154b80 1 -- 172.21.15.2:0/1973248241 >> 172.21.15.2:0/1973248241 conn(0x55d1f03731f0 msgr2=0x55d1f044d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.886+0000 7f49bea00700 0 client.26401 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:32:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.886+0000 7f49ea154b80 1 -- 172.21.15.2:0/1973248241 shutdown_connections 2024-06-13T11:32:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.886+0000 7f49ea154b80 1 -- 172.21.15.2:0/1973248241 wait complete. 2024-06-13T11:32:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.887+0000 7f49ea154b80 20 client.26401 trim_cache size 0 max 16384 2024-06-13T11:32:45.893 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:32:45.893 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-06-13T11:32:45.893 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "b3e44d3b-a190-46df-ae85-5162088fea8c", 2024-06-13T11:32:45.893 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-06-13T11:32:45.893 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:32:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.887+0000 7f49df800700 1 -- 172.21.15.2:0/2039811942 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f49c00a2d90 msgr2=0x7f49c00a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.887+0000 7f49df800700 1 --2- 172.21.15.2:0/2039811942 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f49c00a2d90 0x7f49c00a5250 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009450 tx=0x7f49d00093a0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.887+0000 7f49df800700 1 -- 172.21.15.2:0/2039811942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d80746c0 msgr2=0x7f49d819f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.887+0000 7f49df800700 1 --2- 172.21.15.2:0/2039811942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d80746c0 0x7f49d819f220 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00e9a0 tx=0x7f49cc00ecb0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.888+0000 7f49df800700 1 -- 172.21.15.2:0/2039811942 shutdown_connections 2024-06-13T11:32:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.888+0000 7f49df800700 1 --2- 172.21.15.2:0/2039811942 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f49c00a2d90 0x7f49c00a5250 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.888+0000 7f49df800700 1 --2- 172.21.15.2:0/2039811942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49d8113660 0x7f49d81a3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.888+0000 7f49df800700 1 --2- 172.21.15.2:0/2039811942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d80746c0 0x7f49d819f220 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.888+0000 7f49df800700 1 --2- 172.21.15.2:0/2039811942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49d8074fe0 0x7f49d819f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.888+0000 7f49df800700 1 -- 172.21.15.2:0/2039811942 >> 172.21.15.2:0/2039811942 conn(0x7f49d80795f0 msgr2=0x7f49d81123c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.888+0000 7f49df800700 1 -- 172.21.15.2:0/2039811942 shutdown_connections 2024-06-13T11:32:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:45.888+0000 7f49df800700 1 -- 172.21.15.2:0/2039811942 wait complete. 2024-06-13T11:32:46.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:46 smithi002 ceph-mon[32210]: scrub queued for path: / 2024-06-13T11:32:46.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:46 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:32:46.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:46 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:32:46.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:46 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:32:46.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:46 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:32:46.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:46 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:32:46.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:46 smithi077 ceph-mon[36410]: scrub queued for path: / 2024-06-13T11:32:46.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:46 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:32:46.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:46 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:32:46.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:46 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:32:46.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:46 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:32:46.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:46 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:32:46.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:46 smithi178 ceph-mon[36913]: scrub queued for path: / 2024-06-13T11:32:46.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:46 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:32:46.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:46 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:32:46.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:46 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:32:46.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:46 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:32:46.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:46 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:32:46.967 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:32:47.442 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:32:47.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:47 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:32:47.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:47 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:32:47.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:47 smithi077 ceph-mon[36410]: pgmap v277: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:47.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:47 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:32:47.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:47 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:32:47.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:47 smithi002 ceph-mon[32210]: pgmap v277: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:47.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:47 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:32:47.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:47 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:32:47.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:47 smithi178 ceph-mon[36913]: pgmap v277: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:32:49.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:49 smithi002 ceph-mon[32210]: pgmap v278: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:32:49.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:49 smithi077 ceph-mon[36410]: pgmap v278: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:32:49.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.908+0000 7f23c6800700 1 -- 172.21.15.2:0/1992256733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c0104f80 msgr2=0x7f23c0111440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:49.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.908+0000 7f23c6800700 1 --2- 172.21.15.2:0/1992256733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c0104f80 0x7f23c0111440 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f23b800b0d0 tx=0x7f23b800b3e0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.908+0000 7f23c6800700 1 -- 172.21.15.2:0/1992256733 shutdown_connections 2024-06-13T11:32:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.908+0000 7f23c6800700 1 --2- 172.21.15.2:0/1992256733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c0104f80 0x7f23c0111440 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.908+0000 7f23c6800700 1 --2- 172.21.15.2:0/1992256733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c010a670 0x7f23c010aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.908+0000 7f23c6800700 1 --2- 172.21.15.2:0/1992256733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c01045c0 0x7f23c0104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.908+0000 7f23c6800700 1 -- 172.21.15.2:0/1992256733 >> 172.21.15.2:0/1992256733 conn(0x7f23c01000d0 msgr2=0x7f23c01024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.908+0000 7f23c6800700 1 -- 172.21.15.2:0/1992256733 shutdown_connections 2024-06-13T11:32:49.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.908+0000 7f23c6800700 1 -- 172.21.15.2:0/1992256733 wait complete. 2024-06-13T11:32:49.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.909+0000 7f23c6800700 1 Processor -- start 2024-06-13T11:32:49.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.909+0000 7f23c6800700 1 -- start start 2024-06-13T11:32:49.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c6800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c01045c0 0x7f23c01a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c6800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0104f80 0x7f23c01a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c6800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c010a670 0x7f23c019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c6800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23c0114920 con 0x7f23c010a670 2024-06-13T11:32:49.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c6800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f23c01147a0 con 0x7f23c01045c0 2024-06-13T11:32:49.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c6800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f23c0114aa0 con 0x7f23c0104f80 2024-06-13T11:32:49.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c5400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c01045c0 0x7f23c01a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c5e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c010a670 0x7f23c019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c5400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c01045c0 0x7f23c01a0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:55156/0 (socket says 172.21.15.2:55156) 2024-06-13T11:32:49.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c5400700 1 -- 172.21.15.2:0/3845432726 learned_addr learned my addr 172.21.15.2:0/3845432726 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:49.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c4a00700 1 --2- 172.21.15.2:0/3845432726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0104f80 0x7f23c01a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c5400700 1 -- 172.21.15.2:0/3845432726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0104f80 msgr2=0x7f23c01a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c5400700 1 --2- 172.21.15.2:0/3845432726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0104f80 0x7f23c01a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c5400700 1 -- 172.21.15.2:0/3845432726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c010a670 msgr2=0x7f23c019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c5400700 1 --2- 172.21.15.2:0/3845432726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c010a670 0x7f23c019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c5400700 1 -- 172.21.15.2:0/3845432726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c019b1c0 con 0x7f23c01045c0 2024-06-13T11:32:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.910+0000 7f23c5e00700 1 --2- 172.21.15.2:0/3845432726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c010a670 0x7f23c019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:32:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.911+0000 7f23c5400700 1 --2- 172.21.15.2:0/3845432726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c01045c0 0x7f23c01a0850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f23b400d980 tx=0x7f23b400dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.911+0000 7f23be000700 1 -- 172.21.15.2:0/3845432726 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4016070 con 0x7f23c01045c0 2024-06-13T11:32:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.911+0000 7f23c6800700 1 -- 172.21.15.2:0/3845432726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c019b4b0 con 0x7f23c01045c0 2024-06-13T11:32:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.911+0000 7f23be000700 1 -- 172.21.15.2:0/3845432726 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23b4004d10 con 0x7f23c01045c0 2024-06-13T11:32:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.911+0000 7f23be000700 1 -- 172.21.15.2:0/3845432726 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4005670 con 0x7f23c01045c0 2024-06-13T11:32:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.911+0000 7f23c6800700 1 -- 172.21.15.2:0/3845432726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c01a7720 con 0x7f23c01045c0 2024-06-13T11:32:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.915+0000 7f23be000700 1 -- 172.21.15.2:0/3845432726 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f23b4004750 con 0x7f23c01045c0 2024-06-13T11:32:49.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.916+0000 7f23be000700 1 --2- 172.21.15.2:0/3845432726 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f23a80a2e10 0x7f23a80a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.916+0000 7f23d27a4b80 1 Processor -- start 2024-06-13T11:32:49.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.916+0000 7f23be000700 1 -- 172.21.15.2:0/3845432726 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7f23b40cf560 con 0x7f23c01045c0 2024-06-13T11:32:49.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.916+0000 7f23d27a4b80 1 -- start start 2024-06-13T11:32:49.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.916+0000 7f23c4a00700 1 --2- 172.21.15.2:0/3845432726 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f23a80a2e10 0x7f23a80a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.917+0000 7f23d27a4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b7c7e40 0x56107b84d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.917+0000 7f23d27a4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b84d960 0x56107b84dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.917+0000 7f23d27a4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b85ed80 0x56107b861170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.917+0000 7f23d27a4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56107b75aa10 con 0x56107b84d960 2024-06-13T11:32:49.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.917+0000 7f23d27a4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56107b79db00 con 0x56107b7c7e40 2024-06-13T11:32:49.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.917+0000 7f23d27a4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56107b7588f0 con 0x56107b85ed80 2024-06-13T11:32:49.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.917+0000 7f23c5400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b7c7e40 0x56107b84d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.917+0000 7f23c5e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b85ed80 0x56107b861170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.917+0000 7f23c5400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b7c7e40 0x56107b84d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:55172/0 (socket says 172.21.15.2:55172) 2024-06-13T11:32:49.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.917+0000 7f23c4a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b84d960 0x56107b84dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.917+0000 7f23c5400700 1 -- 172.21.15.2:0/4256690430 learned_addr learned my addr 172.21.15.2:0/4256690430 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:49.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.918+0000 7f23c4a00700 1 --2- 172.21.15.2:0/3845432726 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f23a80a2e10 0x7f23a80a52d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f23c0109bc0 tx=0x7f23ac011720 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:49.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.918+0000 7f23c5400700 1 -- 172.21.15.2:0/4256690430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b85ed80 msgr2=0x56107b861170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:49.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.918+0000 7f23c5400700 1 --2- 172.21.15.2:0/4256690430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b85ed80 0x56107b861170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.918+0000 7f23c5400700 1 -- 172.21.15.2:0/4256690430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b84d960 msgr2=0x56107b84dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:49.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.918+0000 7f23c5400700 1 --2- 172.21.15.2:0/4256690430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b84d960 0x56107b84dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.918+0000 7f23c5400700 1 -- 172.21.15.2:0/4256690430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56107b745f90 con 0x56107b7c7e40 2024-06-13T11:32:49.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.918+0000 7f23c5e00700 1 --2- 172.21.15.2:0/4256690430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b85ed80 0x56107b861170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:32:49.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.918+0000 7f23c5400700 1 --2- 172.21.15.2:0/4256690430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b7c7e40 0x56107b84d420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f23b4097b20 tx=0x7f23b4097320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e74052b3c2ed81ba server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.918+0000 7f23b2a00700 1 -- 172.21.15.2:0/4256690430 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b40860c0 con 0x56107b7c7e40 2024-06-13T11:32:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.918+0000 7f23b2a00700 1 -- 172.21.15.2:0/4256690430 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23b409b6c0 con 0x56107b7c7e40 2024-06-13T11:32:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.918+0000 7f23b2a00700 1 -- 172.21.15.2:0/4256690430 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b409b920 con 0x56107b7c7e40 2024-06-13T11:32:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.919+0000 7f23d27a4b80 1 -- 172.21.15.2:0/4256690430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b7c7e40 msgr2=0x56107b84d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.919+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/4256690430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b7c7e40 0x56107b84d420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f23b4097b20 tx=0x7f23b4097320 comp rx=0 tx=0).stop 2024-06-13T11:32:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.919+0000 7f23d27a4b80 1 -- 172.21.15.2:0/4256690430 shutdown_connections 2024-06-13T11:32:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.919+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/4256690430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b85ed80 0x56107b861170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.919+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/4256690430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b7c7e40 0x56107b84d420 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.919+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/4256690430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b84d960 0x56107b84dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.919+0000 7f23d27a4b80 1 -- 172.21.15.2:0/4256690430 >> 172.21.15.2:0/4256690430 conn(0x56107b778170 msgr2=0x56107b847820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:49.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.920+0000 7f23d27a4b80 1 -- 172.21.15.2:0/4256690430 shutdown_connections 2024-06-13T11:32:49.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.920+0000 7f23d27a4b80 1 -- 172.21.15.2:0/4256690430 wait complete. 2024-06-13T11:32:49.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.920+0000 7f23d27a4b80 1 -- start start 2024-06-13T11:32:49.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.921+0000 7f23d27a4b80 1 Processor -- start 2024-06-13T11:32:49.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.921+0000 7f23d27a4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b85e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.921+0000 7f23d27a4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b84d960 0x56107b85b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.921+0000 7f23d27a4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b85ed80 0x56107b85be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.921+0000 7f23d27a4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56107b739f60 con 0x56107b7c7e40 2024-06-13T11:32:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.921+0000 7f23d27a4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56107b799ac0 con 0x56107b84d960 2024-06-13T11:32:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.921+0000 7f23d27a4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56107b861990 con 0x56107b85ed80 2024-06-13T11:32:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.921+0000 7f23d27a4b80 10 client.0 _ll_register_callbacks cb 0x56107b737720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:32:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.921+0000 7f23c5400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b85e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.922+0000 7f23c5400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b85e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35444/0 (socket says 172.21.15.2:35444) 2024-06-13T11:32:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.922+0000 7f23c5400700 1 -- 172.21.15.2:0/2253739160 learned_addr learned my addr 172.21.15.2:0/2253739160 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.922+0000 7f23c4a00700 1 --2- 172.21.15.2:0/2253739160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b84d960 0x56107b85b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.922+0000 7f23c5e00700 1 --2- 172.21.15.2:0/2253739160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b85ed80 0x56107b85be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.922+0000 7f23c5400700 1 -- 172.21.15.2:0/2253739160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b85ed80 msgr2=0x56107b85be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:49.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.922+0000 7f23c5400700 1 --2- 172.21.15.2:0/2253739160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b85ed80 0x56107b85be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.922+0000 7f23c5400700 1 -- 172.21.15.2:0/2253739160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b84d960 msgr2=0x56107b85b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:49.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.922+0000 7f23c5400700 1 --2- 172.21.15.2:0/2253739160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b84d960 0x56107b85b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.922+0000 7f23c5400700 1 -- 172.21.15.2:0/2253739160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56107b6ec8d0 con 0x56107b7c7e40 2024-06-13T11:32:49.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.922+0000 7f23c5400700 1 --2- 172.21.15.2:0/2253739160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b85e5e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f23b4012040 tx=0x7f23b409fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8faa9ee2d6a27587 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:49.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.922+0000 7f23a7400700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:32:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.923+0000 7f23a7400700 1 -- 172.21.15.2:0/2253739160 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b40b8070 con 0x56107b7c7e40 2024-06-13T11:32:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.923+0000 7f23a7400700 1 -- 172.21.15.2:0/2253739160 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7f23b4004a40 con 0x56107b7c7e40 2024-06-13T11:32:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.923+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2253739160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23b409b6c0 con 0x56107b7c7e40 2024-06-13T11:32:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.923+0000 7f23a7400700 1 -- 172.21.15.2:0/2253739160 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f23b40afbe0 con 0x56107b7c7e40 2024-06-13T11:32:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.923+0000 7f23d27a4b80 10 client.16275 fetch_fsmap learned FSMap version 31 2024-06-13T11:32:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.923+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2253739160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56107b86c1c0 con 0x56107b7c7e40 2024-06-13T11:32:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.923+0000 7f23a7400700 1 -- 172.21.15.2:0/2253739160 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23b409b6c0 con 0x56107b7c7e40 2024-06-13T11:32:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.923+0000 7f23a7400700 1 -- 172.21.15.2:0/2253739160 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f23b40a3ea0 con 0x56107b7c7e40 2024-06-13T11:32:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.924+0000 7f23d27a4b80 10 client.16275 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:32:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.924+0000 7f23d27a4b80 10 client.16275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:32:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.924+0000 7f23d27a4b80 20 client.16275 populate_metadata read hostname 'smithi002' 2024-06-13T11:32:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.924+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/2253739160 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x56107b86e690 0x56107b870a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.924+0000 7f23d27a4b80 4 client.16275 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:32:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.924+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2253739160 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56107b7ab000 con 0x56107b86e690 2024-06-13T11:32:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.924+0000 7f23c4a00700 1 --2- 172.21.15.2:0/2253739160 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x56107b86e690 0x56107b870a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.925+0000 7f23c4a00700 1 --2- 172.21.15.2:0/2253739160 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x56107b86e690 0x56107b870a80 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b9fe31fad73205e server_cookie=bf4ede4f2891c2e8 in_seq=0 out_seq=0 2024-06-13T11:32:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.925+0000 7f23a7400700 10 client.16275 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:32:49.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.926+0000 7f23a7400700 1 -- 172.21.15.2:0/2253739160 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56107b7ab000 con 0x56107b86e690 2024-06-13T11:32:49.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.926+0000 7f23a7400700 10 client.16275 handle_command_reply: tid=0 2024-06-13T11:32:49.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.926+0000 7f23d27a4b80 1 client.16275 shutdown 2024-06-13T11:32:49.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.926+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2253739160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 msgr2=0x56107b85e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:49.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.926+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/2253739160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b85e5e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f23b4012040 tx=0x7f23b409fa70 comp rx=0 tx=0).stop 2024-06-13T11:32:49.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.926+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2253739160 shutdown_connections 2024-06-13T11:32:49.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.926+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/2253739160 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x56107b86e690 0x56107b870a80 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.926+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/2253739160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b85e5e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.926+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/2253739160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b85ed80 0x56107b85be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.926+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/2253739160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b84d960 0x56107b85b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.926+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2253739160 >> 172.21.15.2:0/2253739160 conn(0x56107b778170 msgr2=0x56107b847410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.926+0000 7f23a7400700 0 client.16275 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:32:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.927+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2253739160 shutdown_connections 2024-06-13T11:32:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.927+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2253739160 wait complete. 2024-06-13T11:32:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.927+0000 7f23d27a4b80 20 client.16275 trim_cache size 0 max 16384 2024-06-13T11:32:49.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:49 smithi178 ceph-mon[36913]: pgmap v278: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:32:49.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.949+0000 7f23d27a4b80 1 Processor -- start 2024-06-13T11:32:49.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.949+0000 7f23d27a4b80 1 -- start start 2024-06-13T11:32:49.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.950+0000 7f23d27a4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b847960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.950+0000 7f23d27a4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b84d960 0x56107b85e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.950+0000 7f23d27a4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b85ed80 0x56107b873aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.950+0000 7f23d27a4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23c01ae980 con 0x56107b7c7e40 2024-06-13T11:32:49.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.950+0000 7f23d27a4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f23c01ac210 con 0x56107b85ed80 2024-06-13T11:32:49.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.950+0000 7f23d27a4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f23c01aa080 con 0x56107b84d960 2024-06-13T11:32:49.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.950+0000 7f23c5400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b847960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.950+0000 7f23c5400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b847960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35448/0 (socket says 172.21.15.2:35448) 2024-06-13T11:32:49.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.950+0000 7f23c5400700 1 -- 172.21.15.2:0/2341875951 learned_addr learned my addr 172.21.15.2:0/2341875951 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:49.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.950+0000 7f23c5e00700 1 --2- 172.21.15.2:0/2341875951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b85ed80 0x56107b873aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.950+0000 7f23c4a00700 1 --2- 172.21.15.2:0/2341875951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b84d960 0x56107b85e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.950+0000 7f23c5400700 1 -- 172.21.15.2:0/2341875951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b84d960 msgr2=0x56107b85e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:49.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.951+0000 7f23c5400700 1 --2- 172.21.15.2:0/2341875951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b84d960 0x56107b85e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.951+0000 7f23c5400700 1 -- 172.21.15.2:0/2341875951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b85ed80 msgr2=0x56107b873aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:49.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.951+0000 7f23c5400700 1 --2- 172.21.15.2:0/2341875951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b85ed80 0x56107b873aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.951+0000 7f23c5400700 1 -- 172.21.15.2:0/2341875951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56107b859e50 con 0x56107b7c7e40 2024-06-13T11:32:49.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.951+0000 7f23c5400700 1 --2- 172.21.15.2:0/2341875951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b847960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f23b4097b20 tx=0x7f23b40cc9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf97f868260e196d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:49.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.951+0000 7f23b2000700 1 -- 172.21.15.2:0/2341875951 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b40b8070 con 0x56107b7c7e40 2024-06-13T11:32:49.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.951+0000 7f23b2000700 1 -- 172.21.15.2:0/2341875951 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23b4004a40 con 0x56107b7c7e40 2024-06-13T11:32:49.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.951+0000 7f23b2000700 1 -- 172.21.15.2:0/2341875951 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b409adf0 con 0x56107b7c7e40 2024-06-13T11:32:49.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.952+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2341875951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 msgr2=0x56107b847960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:49.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.952+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/2341875951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b847960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f23b4097b20 tx=0x7f23b40cc9a0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.952+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2341875951 shutdown_connections 2024-06-13T11:32:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.952+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/2341875951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b847960 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.952+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/2341875951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b85ed80 0x56107b873aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.952+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/2341875951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b84d960 0x56107b85e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.952+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2341875951 >> 172.21.15.2:0/2341875951 conn(0x56107b778170 msgr2=0x56107b85ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.952+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2341875951 shutdown_connections 2024-06-13T11:32:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.952+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2341875951 wait complete. 2024-06-13T11:32:49.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.952+0000 7f23d27a4b80 1 -- start start 2024-06-13T11:32:49.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.953+0000 7f23d27a4b80 1 Processor -- start 2024-06-13T11:32:49.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.953+0000 7f23d27a4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b874290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.953+0000 7f23d27a4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b84d960 0x56107b871630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.953+0000 7f23d27a4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b85ed80 0x56107b871bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.953+0000 7f23d27a4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23c01aa6d0 con 0x56107b7c7e40 2024-06-13T11:32:49.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.953+0000 7f23d27a4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f23c01abb40 con 0x56107b85ed80 2024-06-13T11:32:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.953+0000 7f23d27a4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f23c01aada0 con 0x56107b84d960 2024-06-13T11:32:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.953+0000 7f23d27a4b80 10 client.0 _ll_register_callbacks cb 0x56107b737720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:32:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.954+0000 7f23c5400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b874290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.954+0000 7f23c4a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b84d960 0x56107b871630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.954+0000 7f23c5400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b874290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35450/0 (socket says 172.21.15.2:35450) 2024-06-13T11:32:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.954+0000 7f23c5400700 1 -- 172.21.15.2:0/2829363932 learned_addr learned my addr 172.21.15.2:0/2829363932 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:32:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.954+0000 7f23c5e00700 1 --2- 172.21.15.2:0/2829363932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b85ed80 0x56107b871bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.954+0000 7f23c4a00700 1 -- 172.21.15.2:0/2829363932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b85ed80 msgr2=0x56107b871bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.954+0000 7f23c4a00700 1 --2- 172.21.15.2:0/2829363932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b85ed80 0x56107b871bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.954+0000 7f23c4a00700 1 -- 172.21.15.2:0/2829363932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 msgr2=0x56107b874290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:32:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.954+0000 7f23c4a00700 1 --2- 172.21.15.2:0/2829363932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b874290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.954+0000 7f23c4a00700 1 -- 172.21.15.2:0/2829363932 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56107b8723f0 con 0x56107b84d960 2024-06-13T11:32:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.954+0000 7f23c4a00700 1 --2- 172.21.15.2:0/2829363932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b84d960 0x56107b871630 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x56107b861a40 tx=0x7f23ac016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3597faa44332a3a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:32:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.954+0000 7f23a7400700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:32:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.955+0000 7f23a7400700 1 -- 172.21.15.2:0/2829363932 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ac017040 con 0x56107b84d960 2024-06-13T11:32:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.955+0000 7f23a7400700 1 -- 172.21.15.2:0/2829363932 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9483+0+0 (secure 0 0 0) 0x7f23ac004830 con 0x56107b84d960 2024-06-13T11:32:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.955+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2829363932 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23b4004a40 con 0x56107b84d960 2024-06-13T11:32:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.955+0000 7f23a7400700 1 -- 172.21.15.2:0/2829363932 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f23ac03a050 con 0x56107b84d960 2024-06-13T11:32:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.955+0000 7f23d27a4b80 10 client.26419 fetch_fsmap learned FSMap version 31 2024-06-13T11:32:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.955+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2829363932 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56107b8d90f0 con 0x56107b84d960 2024-06-13T11:32:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.955+0000 7f23a7400700 1 -- 172.21.15.2:0/2829363932 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23b4004a40 con 0x56107b84d960 2024-06-13T11:32:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.956+0000 7f23a7400700 1 -- 172.21.15.2:0/2829363932 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f23ac029410 con 0x56107b84d960 2024-06-13T11:32:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.956+0000 7f23d27a4b80 10 client.26419 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:32:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.956+0000 7f23d27a4b80 10 client.26419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:32:49.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.956+0000 7f23d27a4b80 20 client.26419 populate_metadata read hostname 'smithi002' 2024-06-13T11:32:49.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.956+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/2829363932 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x56107b8d9800 0x56107b8dbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:32:49.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.956+0000 7f23d27a4b80 4 client.26419 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:32:49.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.956+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2829363932 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56107b7a5580 con 0x56107b8d9800 2024-06-13T11:32:49.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.956+0000 7f23c5400700 1 --2- 172.21.15.2:0/2829363932 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x56107b8d9800 0x56107b8dbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:32:49.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.956+0000 7f23c5400700 1 --2- 172.21.15.2:0/2829363932 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x56107b8d9800 0x56107b8dbc20 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2c4faae793b8d19 server_cookie=b578ba99bc6585da in_seq=0 out_seq=0 2024-06-13T11:32:49.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.956+0000 7f23a7400700 10 client.26419 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:32:49.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.957+0000 7f23a7400700 1 -- 172.21.15.2:0/2829363932 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56107b7a5580 con 0x56107b8d9800 2024-06-13T11:32:49.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.957+0000 7f23a7400700 10 client.26419 handle_command_reply: tid=0 2024-06-13T11:32:49.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.957+0000 7f23d27a4b80 1 client.26419 shutdown 2024-06-13T11:32:49.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.957+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2829363932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b84d960 msgr2=0x56107b871630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:49.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.957+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/2829363932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b84d960 0x56107b871630 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x56107b861a40 tx=0x7f23ac016000 comp rx=0 tx=0).stop 2024-06-13T11:32:49.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.957+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2829363932 shutdown_connections 2024-06-13T11:32:49.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.957+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/2829363932 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x56107b8d9800 0x56107b8dbc20 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.957+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/2829363932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56107b7c7e40 0x56107b874290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.957+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/2829363932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56107b85ed80 0x56107b871bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.957+0000 7f23d27a4b80 1 --2- 172.21.15.2:0/2829363932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56107b84d960 0x56107b871630 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.957+0000 7f23a7400700 0 client.26419 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:32:49.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.957+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2829363932 >> 172.21.15.2:0/2829363932 conn(0x56107b778170 msgr2=0x56107b84b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:49.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.957+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2829363932 shutdown_connections 2024-06-13T11:32:49.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.957+0000 7f23d27a4b80 1 -- 172.21.15.2:0/2829363932 wait complete. 2024-06-13T11:32:49.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.957+0000 7f23d27a4b80 20 client.26419 trim_cache size 0 max 16384 2024-06-13T11:32:49.964 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:32:49.964 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-13T11:32:49.964 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-06-13T11:32:49.965 INFO:teuthology.orchestra.run.smithi002.stdout: "b3e44d3b-a190-46df-ae85-5162088fea8c": { 2024-06-13T11:32:49.965 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-06-13T11:32:49.965 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "b3e44d3b-a190-46df-ae85-5162088fea8c", 2024-06-13T11:32:49.965 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-06-13T11:32:49.965 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:32:49.965 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:32:49.965 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:32:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.958+0000 7f23c6800700 1 -- 172.21.15.2:0/3845432726 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f23a80a2e10 msgr2=0x7f23a80a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.958+0000 7f23c6800700 1 --2- 172.21.15.2:0/3845432726 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f23a80a2e10 0x7f23a80a52d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f23c0109bc0 tx=0x7f23ac011720 comp rx=0 tx=0).stop 2024-06-13T11:32:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.958+0000 7f23c6800700 1 -- 172.21.15.2:0/3845432726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c01045c0 msgr2=0x7f23c01a0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:32:49.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.958+0000 7f23c6800700 1 --2- 172.21.15.2:0/3845432726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c01045c0 0x7f23c01a0850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f23b400d980 tx=0x7f23b400dc90 comp rx=0 tx=0).stop 2024-06-13T11:32:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.958+0000 7f23c6800700 1 -- 172.21.15.2:0/3845432726 shutdown_connections 2024-06-13T11:32:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.958+0000 7f23c6800700 1 --2- 172.21.15.2:0/3845432726 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f23a80a2e10 0x7f23a80a52d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.958+0000 7f23c6800700 1 --2- 172.21.15.2:0/3845432726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23c010a670 0x7f23c019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.958+0000 7f23c6800700 1 --2- 172.21.15.2:0/3845432726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23c01045c0 0x7f23c01a0850 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.958+0000 7f23c6800700 1 --2- 172.21.15.2:0/3845432726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0104f80 0x7f23c01a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:32:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.958+0000 7f23c6800700 1 -- 172.21.15.2:0/3845432726 >> 172.21.15.2:0/3845432726 conn(0x7f23c01000d0 msgr2=0x7f23c0101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:32:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.959+0000 7f23c6800700 1 -- 172.21.15.2:0/3845432726 shutdown_connections 2024-06-13T11:32:49.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:32:49.959+0000 7f23c6800700 1 -- 172.21.15.2:0/3845432726 wait complete. 2024-06-13T11:32:50.891 INFO:tasks.cephfs.filesystem:scrub status for tag:b3e44d3b-a190-46df-ae85-5162088fea8c - {'path': '/', 'tag': 'b3e44d3b-a190-46df-ae85-5162088fea8c', 'options': 'recursive,force'} 2024-06-13T11:32:51.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:51 smithi077 ceph-mon[36410]: pgmap v279: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:32:51.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:51 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:32:51.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:51 smithi002 ceph-mon[32210]: pgmap v279: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:32:51.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:51 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:32:51.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:51 smithi178 ceph-mon[36913]: pgmap v279: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:32:51.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:51 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:32:52.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:52 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:32:52.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:52 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:32:52.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:52 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:32:52.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:52 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:32:53.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:52 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:32:53.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:52 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:32:53.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:53 smithi002 ceph-mon[32210]: pgmap v280: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:32:53.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:53 smithi178 ceph-mon[36913]: pgmap v280: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:32:54.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:53 smithi077 ceph-mon[36410]: pgmap v280: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:32:55.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:55 smithi002 ceph-mon[32210]: pgmap v281: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:32:55.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:55 smithi178 ceph-mon[36913]: pgmap v281: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:32:56.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:55 smithi077 ceph-mon[36410]: pgmap v281: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:32:57.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:57 smithi002 ceph-mon[32210]: pgmap v282: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:32:57.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:57 smithi178 ceph-mon[36913]: pgmap v282: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:32:58.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:57 smithi077 ceph-mon[36410]: pgmap v282: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:32:59.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:32:59 smithi002 ceph-mon[32210]: pgmap v283: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:32:59.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:32:59 smithi178 ceph-mon[36913]: pgmap v283: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:33:00.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:32:59 smithi077 ceph-mon[36410]: pgmap v283: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:33:01.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:01 smithi002 ceph-mon[32210]: pgmap v284: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:01.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:01 smithi178 ceph-mon[36913]: pgmap v284: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:02.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:01 smithi077 ceph-mon[36410]: pgmap v284: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:03.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:03 smithi002 ceph-mon[32210]: pgmap v285: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-06-13T11:33:03.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:03 smithi178 ceph-mon[36913]: pgmap v285: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-06-13T11:33:04.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:03 smithi077 ceph-mon[36410]: pgmap v285: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-06-13T11:33:05.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:05 smithi002 ceph-mon[32210]: pgmap v286: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:33:05.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:05 smithi178 ceph-mon[36913]: pgmap v286: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:33:06.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:05 smithi077 ceph-mon[36410]: pgmap v286: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:33:07.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:07 smithi002 ceph-mon[32210]: pgmap v287: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:33:07.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:07 smithi002 ceph-mon[32210]: osdmap e105: 12 total, 12 up, 12 in 2024-06-13T11:33:07.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:07 smithi178 ceph-mon[36913]: pgmap v287: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:33:07.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:07 smithi178 ceph-mon[36913]: osdmap e105: 12 total, 12 up, 12 in 2024-06-13T11:33:08.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:07 smithi077 ceph-mon[36410]: pgmap v287: 129 pgs: 129 active+clean; 83 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:33:08.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:07 smithi077 ceph-mon[36410]: osdmap e105: 12 total, 12 up, 12 in 2024-06-13T11:33:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:09 smithi002 ceph-mon[32210]: pgmap v289: 129 pgs: 129 active+clean; 83 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-06-13T11:33:09.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:09 smithi002 ceph-mon[32210]: osdmap e106: 12 total, 12 up, 12 in 2024-06-13T11:33:09.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:09 smithi178 ceph-mon[36913]: pgmap v289: 129 pgs: 129 active+clean; 83 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-06-13T11:33:09.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:09 smithi178 ceph-mon[36913]: osdmap e106: 12 total, 12 up, 12 in 2024-06-13T11:33:10.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:09 smithi077 ceph-mon[36410]: pgmap v289: 129 pgs: 129 active+clean; 83 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-06-13T11:33:10.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:09 smithi077 ceph-mon[36410]: osdmap e106: 12 total, 12 up, 12 in 2024-06-13T11:33:11.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:11 smithi002 ceph-mon[32210]: pgmap v291: 129 pgs: 129 active+clean; 83 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-06-13T11:33:11.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:11 smithi178 ceph-mon[36913]: pgmap v291: 129 pgs: 129 active+clean; 83 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-06-13T11:33:12.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:11 smithi077 ceph-mon[36410]: pgmap v291: 129 pgs: 129 active+clean; 83 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-06-13T11:33:13.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:13 smithi002 ceph-mon[32210]: pgmap v292: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:33:13.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:13 smithi178 ceph-mon[36913]: pgmap v292: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:33:14.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:13 smithi077 ceph-mon[36410]: pgmap v292: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:33:15.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:15 smithi002 ceph-mon[32210]: pgmap v293: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:33:15.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:15 smithi178 ceph-mon[36913]: pgmap v293: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:33:16.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:15 smithi077 ceph-mon[36410]: pgmap v293: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:33:17.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:17 smithi002 ceph-mon[32210]: pgmap v294: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 208 B/s wr, 6 op/s 2024-06-13T11:33:17.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:17 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:33:17.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:17 smithi178 ceph-mon[36913]: pgmap v294: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 208 B/s wr, 6 op/s 2024-06-13T11:33:17.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:17 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:33:18.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:17 smithi077 ceph-mon[36410]: pgmap v294: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 208 B/s wr, 6 op/s 2024-06-13T11:33:18.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:17 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:33:18.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:18 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:33:18.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:18 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:33:18.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:18 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:33:18.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:18 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:33:18.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:18 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:33:18.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:18 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:33:19.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:18 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:33:19.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:18 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:33:19.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:18 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:33:19.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:19 smithi002 ceph-mon[32210]: pgmap v295: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-06-13T11:33:19.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:19 smithi178 ceph-mon[36913]: pgmap v295: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-06-13T11:33:20.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:19 smithi077 ceph-mon[36410]: pgmap v295: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-06-13T11:33:20.892 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:33:21.373 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:33:21.799 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:21 smithi002 ceph-mon[32210]: pgmap v296: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-06-13T11:33:21.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:21 smithi178 ceph-mon[36913]: pgmap v296: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-06-13T11:33:22.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:21 smithi077 ceph-mon[36410]: pgmap v296: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-06-13T11:33:23.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.764+0000 7fdd87a00700 1 -- 172.21.15.2:0/4139196273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd80102ee0 msgr2=0x7fdd8010f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:23.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.764+0000 7fdd87a00700 1 --2- 172.21.15.2:0/4139196273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd80102ee0 0x7fdd8010f3c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009f90 tx=0x7fdd7800b330 comp rx=0 tx=0).stop 2024-06-13T11:33:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.764+0000 7fdd87a00700 1 -- 172.21.15.2:0/4139196273 shutdown_connections 2024-06-13T11:33:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.764+0000 7fdd87a00700 1 --2- 172.21.15.2:0/4139196273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd80107450 0x7fdd80107830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.764+0000 7fdd87a00700 1 --2- 172.21.15.2:0/4139196273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd80102ee0 0x7fdd8010f3c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.764+0000 7fdd87a00700 1 --2- 172.21.15.2:0/4139196273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd80102540 0x7fdd801029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.764+0000 7fdd87a00700 1 -- 172.21.15.2:0/4139196273 >> 172.21.15.2:0/4139196273 conn(0x7fdd800795f0 msgr2=0x7fdd80079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.764+0000 7fdd87a00700 1 -- 172.21.15.2:0/4139196273 shutdown_connections 2024-06-13T11:33:23.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.764+0000 7fdd87a00700 1 -- 172.21.15.2:0/4139196273 wait complete. 2024-06-13T11:33:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.766+0000 7fdd87a00700 1 Processor -- start 2024-06-13T11:33:23.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.766+0000 7fdd87a00700 1 -- start start 2024-06-13T11:33:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.767+0000 7fdd87a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd80102540 0x7fdd8019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.767+0000 7fdd87a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd80102ee0 0x7fdd8019ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.767+0000 7fdd87a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd80107450 0x7fdd80198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.767+0000 7fdd87a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdd80112800 con 0x7fdd80102540 2024-06-13T11:33:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.767+0000 7fdd87a00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd80112680 con 0x7fdd80102ee0 2024-06-13T11:33:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.767+0000 7fdd87a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdd80112980 con 0x7fdd80107450 2024-06-13T11:33:23.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.767+0000 7fdd85000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd80102540 0x7fdd8019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.767+0000 7fdd85a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd80107450 0x7fdd80198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.767+0000 7fdd85000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd80102540 0x7fdd8019e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48890/0 (socket says 172.21.15.2:48890) 2024-06-13T11:33:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.767+0000 7fdd85000700 1 -- 172.21.15.2:0/428226416 learned_addr learned my addr 172.21.15.2:0/428226416 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.767+0000 7fdd7fe00700 1 --2- 172.21.15.2:0/428226416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd80102ee0 0x7fdd8019ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.768+0000 7fdd85a00700 1 -- 172.21.15.2:0/428226416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd80102ee0 msgr2=0x7fdd8019ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.768+0000 7fdd85a00700 1 --2- 172.21.15.2:0/428226416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd80102ee0 0x7fdd8019ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.768+0000 7fdd85a00700 1 -- 172.21.15.2:0/428226416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd80102540 msgr2=0x7fdd8019e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:23.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.768+0000 7fdd85a00700 1 --2- 172.21.15.2:0/428226416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd80102540 0x7fdd8019e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.768+0000 7fdd85a00700 1 -- 172.21.15.2:0/428226416 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd80199240 con 0x7fdd80107450 2024-06-13T11:33:23.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.768+0000 7fdd85a00700 1 --2- 172.21.15.2:0/428226416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd80107450 0x7fdd80198ae0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdd78015000 tx=0x7fdd7800cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.768+0000 7fdd7d600700 1 -- 172.21.15.2:0/428226416 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78021070 con 0x7fdd80107450 2024-06-13T11:33:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.768+0000 7fdd7d600700 1 -- 172.21.15.2:0/428226416 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd78007ac0 con 0x7fdd80107450 2024-06-13T11:33:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.768+0000 7fdd87a00700 1 -- 172.21.15.2:0/428226416 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd801994d0 con 0x7fdd80107450 2024-06-13T11:33:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.768+0000 7fdd7d600700 1 -- 172.21.15.2:0/428226416 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78005040 con 0x7fdd80107450 2024-06-13T11:33:23.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.769+0000 7fdd87a00700 1 -- 172.21.15.2:0/428226416 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd801a57a0 con 0x7fdd80107450 2024-06-13T11:33:23.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.773+0000 7fdd7d600700 1 -- 172.21.15.2:0/428226416 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fdd78024070 con 0x7fdd80107450 2024-06-13T11:33:23.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.774+0000 7fdd922d1b80 1 Processor -- start 2024-06-13T11:33:23.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.775+0000 7fdd7d600700 1 --2- 172.21.15.2:0/428226416 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdd680a2d90 0x7fdd680a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.775+0000 7fdd922d1b80 1 -- start start 2024-06-13T11:33:23.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.775+0000 7fdd7d600700 1 -- 172.21.15.2:0/428226416 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7fdd7800f020 con 0x7fdd80107450 2024-06-13T11:33:23.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.775+0000 7fdd922d1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 0x561bf0a51380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.775+0000 7fdd922d1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a518c0 0x561bf0a4b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.775+0000 7fdd922d1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a4b650 0x561bf0a4ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.775+0000 7fdd922d1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561bf0955a10 con 0x561bf0a50fa0 2024-06-13T11:33:23.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.775+0000 7fdd7fe00700 1 --2- 172.21.15.2:0/428226416 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdd680a2d90 0x7fdd680a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.775+0000 7fdd922d1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561bf0998b00 con 0x561bf0a4b650 2024-06-13T11:33:23.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.775+0000 7fdd922d1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561bf09538f0 con 0x561bf0a518c0 2024-06-13T11:33:23.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.776+0000 7fdd85000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 0x561bf0a51380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.776+0000 7fdd85000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 0x561bf0a51380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48896/0 (socket says 172.21.15.2:48896) 2024-06-13T11:33:23.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.776+0000 7fdd85000700 1 -- 172.21.15.2:0/982522242 learned_addr learned my addr 172.21.15.2:0/982522242 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:23.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.776+0000 7fdd85a00700 1 --2- 172.21.15.2:0/982522242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a4b650 0x561bf0a4ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.776+0000 7fdd7fe00700 1 --2- 172.21.15.2:0/982522242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a518c0 0x561bf0a4b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.776+0000 7fdd85000700 1 -- 172.21.15.2:0/982522242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a518c0 msgr2=0x561bf0a4b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:23.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.776+0000 7fdd85000700 1 --2- 172.21.15.2:0/982522242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a518c0 0x561bf0a4b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.776+0000 7fdd85000700 1 -- 172.21.15.2:0/982522242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a4b650 msgr2=0x561bf0a4ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:23.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.776+0000 7fdd85000700 1 --2- 172.21.15.2:0/982522242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a4b650 0x561bf0a4ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.776+0000 7fdd85000700 1 -- 172.21.15.2:0/982522242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bf0940f90 con 0x561bf0a50fa0 2024-06-13T11:33:23.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.776+0000 7fdd85a00700 1 --2- 172.21.15.2:0/982522242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a4b650 0x561bf0a4ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:33:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.776+0000 7fdd7fe00700 1 --2- 172.21.15.2:0/428226416 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdd680a2d90 0x7fdd680a5250 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0046e0 tx=0x7fdd6c0138b0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.777+0000 7fdd85000700 1 --2- 172.21.15.2:0/982522242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 0x561bf0a51380 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009d50 tx=0x7fdd74011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442a393ccf7fcd81 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:23.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.777+0000 7fdd72000700 1 -- 172.21.15.2:0/982522242 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd74004220 con 0x561bf0a50fa0 2024-06-13T11:33:23.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.777+0000 7fdd72000700 1 -- 172.21.15.2:0/982522242 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd74004d10 con 0x561bf0a50fa0 2024-06-13T11:33:23.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.777+0000 7fdd72000700 1 -- 172.21.15.2:0/982522242 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd74005690 con 0x561bf0a50fa0 2024-06-13T11:33:23.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.778+0000 7fdd922d1b80 1 -- 172.21.15.2:0/982522242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 msgr2=0x561bf0a51380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:23.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.778+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/982522242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 0x561bf0a51380 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009d50 tx=0x7fdd74011720 comp rx=0 tx=0).stop 2024-06-13T11:33:23.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.778+0000 7fdd922d1b80 1 -- 172.21.15.2:0/982522242 shutdown_connections 2024-06-13T11:33:23.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.778+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/982522242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 0x561bf0a51380 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.778+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/982522242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a4b650 0x561bf0a4ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.778+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/982522242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a518c0 0x561bf0a4b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.778+0000 7fdd922d1b80 1 -- 172.21.15.2:0/982522242 >> 172.21.15.2:0/982522242 conn(0x561bf0973170 msgr2=0x561bf0a41ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:23.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.778+0000 7fdd922d1b80 1 -- 172.21.15.2:0/982522242 shutdown_connections 2024-06-13T11:33:23.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.778+0000 7fdd922d1b80 1 -- 172.21.15.2:0/982522242 wait complete. 2024-06-13T11:33:23.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.779+0000 7fdd922d1b80 1 -- start start 2024-06-13T11:33:23.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.779+0000 7fdd922d1b80 1 Processor -- start 2024-06-13T11:33:23.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.779+0000 7fdd922d1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a4b650 0x561bf0a57570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.779+0000 7fdd922d1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 0x561bf0a54870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.780+0000 7fdd922d1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a518c0 0x561bf0a54db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.780+0000 7fdd922d1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561bf0934f60 con 0x561bf0a50fa0 2024-06-13T11:33:23.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.780+0000 7fdd922d1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561bf0994ac0 con 0x561bf0a518c0 2024-06-13T11:33:23.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.780+0000 7fdd922d1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561bf0a582a0 con 0x561bf0a4b650 2024-06-13T11:33:23.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.780+0000 7fdd922d1b80 10 client.0 _ll_register_callbacks cb 0x561bf092e380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:33:23.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.780+0000 7fdd85a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a518c0 0x561bf0a54db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.780+0000 7fdd85000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a4b650 0x561bf0a57570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.780+0000 7fdd7fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 0x561bf0a54870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.780+0000 7fdd85a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a518c0 0x561bf0a54db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:44128/0 (socket says 172.21.15.2:44128) 2024-06-13T11:33:23.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.780+0000 7fdd85a00700 1 -- 172.21.15.2:0/3152020983 learned_addr learned my addr 172.21.15.2:0/3152020983 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:23.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.780+0000 7fdd85a00700 1 -- 172.21.15.2:0/3152020983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a4b650 msgr2=0x561bf0a57570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:23.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.780+0000 7fdd85a00700 1 --2- 172.21.15.2:0/3152020983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a4b650 0x561bf0a57570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.780+0000 7fdd85a00700 1 -- 172.21.15.2:0/3152020983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 msgr2=0x561bf0a54870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:23.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.780+0000 7fdd85a00700 1 --2- 172.21.15.2:0/3152020983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 0x561bf0a54870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.780+0000 7fdd85a00700 1 -- 172.21.15.2:0/3152020983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bf08e78d0 con 0x561bf0a518c0 2024-06-13T11:33:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.781+0000 7fdd85a00700 1 --2- 172.21.15.2:0/3152020983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a518c0 0x561bf0a54db0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdd7809c910 tx=0x7fdd7800b680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff22618a5803dd6 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.781+0000 7fdd66a00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:33:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.781+0000 7fdd66a00700 1 -- 172.21.15.2:0/3152020983 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7809cc10 con 0x561bf0a518c0 2024-06-13T11:33:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.781+0000 7fdd922d1b80 1 -- 172.21.15.2:0/3152020983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd74004d10 con 0x561bf0a518c0 2024-06-13T11:33:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.781+0000 7fdd66a00700 1 -- 172.21.15.2:0/3152020983 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7fdd78011c40 con 0x561bf0a518c0 2024-06-13T11:33:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.781+0000 7fdd66a00700 1 -- 172.21.15.2:0/3152020983 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fdd780a0fc0 con 0x561bf0a518c0 2024-06-13T11:33:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.781+0000 7fdd922d1b80 10 client.26396 fetch_fsmap learned FSMap version 31 2024-06-13T11:33:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.781+0000 7fdd922d1b80 1 -- 172.21.15.2:0/3152020983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561bf0a46d00 con 0x561bf0a518c0 2024-06-13T11:33:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.782+0000 7fdd66a00700 1 -- 172.21.15.2:0/3152020983 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd74004d10 con 0x561bf0a518c0 2024-06-13T11:33:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.782+0000 7fdd66a00700 1 -- 172.21.15.2:0/3152020983 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fdd780ba030 con 0x561bf0a518c0 2024-06-13T11:33:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.782+0000 7fdd922d1b80 10 client.26396 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:33:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.782+0000 7fdd922d1b80 10 client.26396 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:33:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.782+0000 7fdd922d1b80 20 client.26396 populate_metadata read hostname 'smithi002' 2024-06-13T11:33:23.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.782+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/3152020983 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561bf0a49360 0x561bf0a49790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.782+0000 7fdd922d1b80 4 client.26396 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:33:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.782+0000 7fdd922d1b80 1 -- 172.21.15.2:0/3152020983 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bf09a6000 con 0x561bf0a49360 2024-06-13T11:33:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.782+0000 7fdd85000700 1 --2- 172.21.15.2:0/3152020983 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561bf0a49360 0x561bf0a49790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.783+0000 7fdd85000700 1 --2- 172.21.15.2:0/3152020983 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561bf0a49360 0x561bf0a49790 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16d5d5b60651f5 server_cookie=e0c94b877bd9a2bb in_seq=0 out_seq=0 2024-06-13T11:33:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.783+0000 7fdd66a00700 10 client.26396 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:33:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.784+0000 7fdd66a00700 1 -- 172.21.15.2:0/3152020983 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561bf09a6000 con 0x561bf0a49360 2024-06-13T11:33:23.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.784+0000 7fdd66a00700 10 client.26396 handle_command_reply: tid=0 2024-06-13T11:33:23.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.784+0000 7fdd922d1b80 1 client.26396 shutdown 2024-06-13T11:33:23.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.784+0000 7fdd922d1b80 1 -- 172.21.15.2:0/3152020983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a518c0 msgr2=0x561bf0a54db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:23.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.784+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/3152020983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a518c0 0x561bf0a54db0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdd7809c910 tx=0x7fdd7800b680 comp rx=0 tx=0).stop 2024-06-13T11:33:23.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.784+0000 7fdd922d1b80 1 -- 172.21.15.2:0/3152020983 shutdown_connections 2024-06-13T11:33:23.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.784+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/3152020983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a518c0 0x561bf0a54db0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.784+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/3152020983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a4b650 0x561bf0a57570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.784+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/3152020983 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561bf0a49360 0x561bf0a49790 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.784+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/3152020983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 0x561bf0a54870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.784+0000 7fdd922d1b80 1 -- 172.21.15.2:0/3152020983 >> 172.21.15.2:0/3152020983 conn(0x561bf0973170 msgr2=0x561bf0a3b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:23.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.784+0000 7fdd66a00700 0 client.26396 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:33:23.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.785+0000 7fdd922d1b80 1 -- 172.21.15.2:0/3152020983 shutdown_connections 2024-06-13T11:33:23.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.785+0000 7fdd922d1b80 1 -- 172.21.15.2:0/3152020983 wait complete. 2024-06-13T11:33:23.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.785+0000 7fdd922d1b80 20 client.26396 trim_cache size 0 max 16384 2024-06-13T11:33:23.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.808+0000 7fdd922d1b80 1 Processor -- start 2024-06-13T11:33:23.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.808+0000 7fdd922d1b80 1 -- start start 2024-06-13T11:33:23.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.808+0000 7fdd922d1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a4b650 0x561bf0a3c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.808+0000 7fdd922d1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 0x561bf0a46400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.808+0000 7fdd922d1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a518c0 0x561bf0a570b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.808+0000 7fdd922d1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801aea50 con 0x561bf0a50fa0 2024-06-13T11:33:23.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.808+0000 7fdd922d1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801ac2e0 con 0x561bf0a4b650 2024-06-13T11:33:23.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.808+0000 7fdd922d1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801aa150 con 0x561bf0a518c0 2024-06-13T11:33:23.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.809+0000 7fdd7fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 0x561bf0a46400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.809+0000 7fdd7fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 0x561bf0a46400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48912/0 (socket says 172.21.15.2:48912) 2024-06-13T11:33:23.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.809+0000 7fdd7fe00700 1 -- 172.21.15.2:0/3822087735 learned_addr learned my addr 172.21.15.2:0/3822087735 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:23.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.809+0000 7fdd85000700 1 --2- 172.21.15.2:0/3822087735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a4b650 0x561bf0a3c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.809+0000 7fdd85a00700 1 --2- 172.21.15.2:0/3822087735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a518c0 0x561bf0a570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.809+0000 7fdd7fe00700 1 -- 172.21.15.2:0/3822087735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a518c0 msgr2=0x561bf0a570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:23.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.809+0000 7fdd7fe00700 1 --2- 172.21.15.2:0/3822087735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a518c0 0x561bf0a570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.809+0000 7fdd7fe00700 1 -- 172.21.15.2:0/3822087735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a4b650 msgr2=0x561bf0a3c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:23.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.809+0000 7fdd7fe00700 1 --2- 172.21.15.2:0/3822087735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a4b650 0x561bf0a3c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.809+0000 7fdd7fe00700 1 -- 172.21.15.2:0/3822087735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bf0a54640 con 0x561bf0a50fa0 2024-06-13T11:33:23.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.809+0000 7fdd85000700 1 --2- 172.21.15.2:0/3822087735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a4b650 0x561bf0a3c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:33:23.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.810+0000 7fdd7fe00700 1 --2- 172.21.15.2:0/3822087735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 0x561bf0a46400 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c012330 tx=0x7fdd6c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330e29008113d350 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:23.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.810+0000 7fdd71600700 1 -- 172.21.15.2:0/3822087735 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c010b20 con 0x561bf0a50fa0 2024-06-13T11:33:23.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.810+0000 7fdd71600700 1 -- 172.21.15.2:0/3822087735 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd6c010cc0 con 0x561bf0a50fa0 2024-06-13T11:33:23.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.810+0000 7fdd71600700 1 -- 172.21.15.2:0/3822087735 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c00f6b0 con 0x561bf0a50fa0 2024-06-13T11:33:23.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.811+0000 7fdd922d1b80 1 -- 172.21.15.2:0/3822087735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 msgr2=0x561bf0a46400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:23.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.811+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/3822087735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 0x561bf0a46400 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c012330 tx=0x7fdd6c01f000 comp rx=0 tx=0).stop 2024-06-13T11:33:23.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.811+0000 7fdd922d1b80 1 -- 172.21.15.2:0/3822087735 shutdown_connections 2024-06-13T11:33:23.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.811+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/3822087735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a518c0 0x561bf0a570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.811+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/3822087735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a4b650 0x561bf0a3c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.811+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/3822087735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a50fa0 0x561bf0a46400 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.811+0000 7fdd922d1b80 1 -- 172.21.15.2:0/3822087735 >> 172.21.15.2:0/3822087735 conn(0x561bf0973170 msgr2=0x561bf0a45cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:23.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.811+0000 7fdd922d1b80 1 -- 172.21.15.2:0/3822087735 shutdown_connections 2024-06-13T11:33:23.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.811+0000 7fdd922d1b80 1 -- 172.21.15.2:0/3822087735 wait complete. 2024-06-13T11:33:23.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.812+0000 7fdd922d1b80 1 -- start start 2024-06-13T11:33:23.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.812+0000 7fdd922d1b80 1 Processor -- start 2024-06-13T11:33:23.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd922d1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a4b650 0x561bf0a67dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd922d1b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a50fa0 0x561bf0a648a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd922d1b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a518c0 0x561bf0a64de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd922d1b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801aa7a0 con 0x561bf0a518c0 2024-06-13T11:33:23.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd922d1b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801abc10 con 0x561bf0a50fa0 2024-06-13T11:33:23.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd922d1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801aae70 con 0x561bf0a4b650 2024-06-13T11:33:23.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd922d1b80 10 client.0 _ll_register_callbacks cb 0x561bf092e380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:33:23.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd85a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a518c0 0x561bf0a64de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd7fe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a50fa0 0x561bf0a648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd85000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a4b650 0x561bf0a67dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd7fe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a50fa0 0x561bf0a648a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:44144/0 (socket says 172.21.15.2:44144) 2024-06-13T11:33:23.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd7fe00700 1 -- 172.21.15.2:0/2471112087 learned_addr learned my addr 172.21.15.2:0/2471112087 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:23.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd85000700 1 -- 172.21.15.2:0/2471112087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a50fa0 msgr2=0x561bf0a648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:23.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd85000700 1 --2- 172.21.15.2:0/2471112087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a50fa0 0x561bf0a648a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd85000700 1 -- 172.21.15.2:0/2471112087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a518c0 msgr2=0x561bf0a64de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:23.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd85000700 1 --2- 172.21.15.2:0/2471112087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a518c0 0x561bf0a64de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd85000700 1 -- 172.21.15.2:0/2471112087 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bf0a65320 con 0x561bf0a4b650 2024-06-13T11:33:23.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.813+0000 7fdd85a00700 1 --2- 172.21.15.2:0/2471112087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a518c0 0x561bf0a64de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:33:23.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.814+0000 7fdd85000700 1 --2- 172.21.15.2:0/2471112087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a4b650 0x561bf0a67dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdd74000c00 tx=0x7fdd74009ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=556dc40d5d0ef2a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:23.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.814+0000 7fdd66a00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:33:23.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.814+0000 7fdd66a00700 1 -- 172.21.15.2:0/2471112087 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7401d040 con 0x561bf0a4b650 2024-06-13T11:33:23.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.814+0000 7fdd922d1b80 1 -- 172.21.15.2:0/2471112087 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd6c010cc0 con 0x561bf0a4b650 2024-06-13T11:33:23.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.814+0000 7fdd66a00700 1 -- 172.21.15.2:0/2471112087 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7fdd74004c30 con 0x561bf0a4b650 2024-06-13T11:33:23.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.815+0000 7fdd66a00700 1 -- 172.21.15.2:0/2471112087 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fdd7403c050 con 0x561bf0a4b650 2024-06-13T11:33:23.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.815+0000 7fdd922d1b80 10 client.26437 fetch_fsmap learned FSMap version 31 2024-06-13T11:33:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.815+0000 7fdd922d1b80 1 -- 172.21.15.2:0/2471112087 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561bf0acb6c0 con 0x561bf0a4b650 2024-06-13T11:33:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.815+0000 7fdd66a00700 1 -- 172.21.15.2:0/2471112087 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd6c010cc0 con 0x561bf0a4b650 2024-06-13T11:33:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.815+0000 7fdd66a00700 1 -- 172.21.15.2:0/2471112087 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fdd74003680 con 0x561bf0a4b650 2024-06-13T11:33:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.815+0000 7fdd922d1b80 10 client.26437 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:33:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.815+0000 7fdd922d1b80 10 client.26437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:33:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.815+0000 7fdd922d1b80 20 client.26437 populate_metadata read hostname 'smithi002' 2024-06-13T11:33:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.815+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/2471112087 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561bf0acbbe0 0x561bf0ace000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.815+0000 7fdd922d1b80 4 client.26437 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:33:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.815+0000 7fdd922d1b80 1 -- 172.21.15.2:0/2471112087 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561bf09a0580 con 0x561bf0acbbe0 2024-06-13T11:33:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.816+0000 7fdd7fe00700 1 --2- 172.21.15.2:0/2471112087 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561bf0acbbe0 0x561bf0ace000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.816+0000 7fdd7fe00700 1 --2- 172.21.15.2:0/2471112087 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561bf0acbbe0 0x561bf0ace000 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd32250b19770b35 server_cookie=24ac7817db4f6635 in_seq=0 out_seq=0 2024-06-13T11:33:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.816+0000 7fdd66a00700 10 client.26437 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:33:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.816+0000 7fdd66a00700 1 -- 172.21.15.2:0/2471112087 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561bf09a0580 con 0x561bf0acbbe0 2024-06-13T11:33:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.816+0000 7fdd66a00700 10 client.26437 handle_command_reply: tid=0 2024-06-13T11:33:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.817+0000 7fdd922d1b80 1 client.26437 shutdown 2024-06-13T11:33:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.817+0000 7fdd922d1b80 1 -- 172.21.15.2:0/2471112087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a4b650 msgr2=0x561bf0a67dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.817+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/2471112087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a4b650 0x561bf0a67dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdd74000c00 tx=0x7fdd74009ea0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.817+0000 7fdd922d1b80 1 -- 172.21.15.2:0/2471112087 shutdown_connections 2024-06-13T11:33:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.817+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/2471112087 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x561bf0acbbe0 0x561bf0ace000 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.817+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/2471112087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561bf0a518c0 0x561bf0a64de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.817+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/2471112087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561bf0a4b650 0x561bf0a67dc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.817+0000 7fdd922d1b80 1 --2- 172.21.15.2:0/2471112087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561bf0a50fa0 0x561bf0a648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.817+0000 7fdd66a00700 0 client.26437 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:33:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.817+0000 7fdd922d1b80 1 -- 172.21.15.2:0/2471112087 >> 172.21.15.2:0/2471112087 conn(0x561bf0973170 msgr2=0x561bf0a523b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.817+0000 7fdd922d1b80 1 -- 172.21.15.2:0/2471112087 shutdown_connections 2024-06-13T11:33:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.817+0000 7fdd922d1b80 1 -- 172.21.15.2:0/2471112087 wait complete. 2024-06-13T11:33:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.817+0000 7fdd922d1b80 20 client.26437 trim_cache size 0 max 16384 2024-06-13T11:33:23.823 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:33:23.823 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-06-13T11:33:23.823 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-06-13T11:33:23.823 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:33:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.818+0000 7fdd87a00700 1 -- 172.21.15.2:0/428226416 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdd680a2d90 msgr2=0x7fdd680a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.818+0000 7fdd87a00700 1 --2- 172.21.15.2:0/428226416 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdd680a2d90 0x7fdd680a5250 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0046e0 tx=0x7fdd6c0138b0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.818+0000 7fdd87a00700 1 -- 172.21.15.2:0/428226416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd80107450 msgr2=0x7fdd80198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.818+0000 7fdd87a00700 1 --2- 172.21.15.2:0/428226416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd80107450 0x7fdd80198ae0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdd78015000 tx=0x7fdd7800cf70 comp rx=0 tx=0).stop 2024-06-13T11:33:23.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.818+0000 7fdd87a00700 1 -- 172.21.15.2:0/428226416 shutdown_connections 2024-06-13T11:33:23.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.818+0000 7fdd87a00700 1 --2- 172.21.15.2:0/428226416 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fdd680a2d90 0x7fdd680a5250 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.818+0000 7fdd87a00700 1 --2- 172.21.15.2:0/428226416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd80102540 0x7fdd8019e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.818+0000 7fdd87a00700 1 --2- 172.21.15.2:0/428226416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd80107450 0x7fdd80198ae0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.818+0000 7fdd87a00700 1 --2- 172.21.15.2:0/428226416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd80102ee0 0x7fdd8019ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:23.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.818+0000 7fdd87a00700 1 -- 172.21.15.2:0/428226416 >> 172.21.15.2:0/428226416 conn(0x7fdd800795f0 msgr2=0x7fdd801004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:23.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.818+0000 7fdd87a00700 1 -- 172.21.15.2:0/428226416 shutdown_connections 2024-06-13T11:33:23.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:23.818+0000 7fdd87a00700 1 -- 172.21.15.2:0/428226416 wait complete. 2024-06-13T11:33:23.870 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:23 smithi002 ceph-mon[32210]: pgmap v297: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:33:23.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:23 smithi178 ceph-mon[36913]: pgmap v297: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:33:24.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:23 smithi077 ceph-mon[36410]: pgmap v297: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:33:24.691 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-13T11:33:24.692 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:33:25.135 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:33:25.723 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:25 smithi002 ceph-mon[32210]: pgmap v298: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:25.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:25 smithi178 ceph-mon[36913]: pgmap v298: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:26.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:25 smithi077 ceph-mon[36410]: pgmap v298: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:27.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.285+0000 7f60e2e00700 1 -- 172.21.15.2:0/992482140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60dc109390 msgr2=0x7f60dc115830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:27.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.285+0000 7f60e2e00700 1 --2- 172.21.15.2:0/992482140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60dc109390 0x7f60dc115830 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009990 tx=0x7f60d4009ca0 comp rx=0 tx=0).stop 2024-06-13T11:33:27.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.286+0000 7f60e2e00700 1 -- 172.21.15.2:0/992482140 shutdown_connections 2024-06-13T11:33:27.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.286+0000 7f60e2e00700 1 --2- 172.21.15.2:0/992482140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60dc109390 0x7f60dc115830 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:27.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.286+0000 7f60e2e00700 1 --2- 172.21.15.2:0/992482140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60dc10d8a0 0x7f60dc10dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:27.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.286+0000 7f60e2e00700 1 --2- 172.21.15.2:0/992482140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60dc1089d0 0x7f60dc108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:27.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.286+0000 7f60e2e00700 1 -- 172.21.15.2:0/992482140 >> 172.21.15.2:0/992482140 conn(0x7f60dc078220 msgr2=0x7f60dc1072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:27.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.286+0000 7f60e2e00700 1 -- 172.21.15.2:0/992482140 shutdown_connections 2024-06-13T11:33:27.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.286+0000 7f60e2e00700 1 -- 172.21.15.2:0/992482140 wait complete. 2024-06-13T11:33:27.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.287+0000 7f60e2e00700 1 Processor -- start 2024-06-13T11:33:27.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.287+0000 7f60e2e00700 1 -- start start 2024-06-13T11:33:27.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.287+0000 7f60e2e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60dc1089d0 0x7f60dc19f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:27.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.287+0000 7f60e2e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60dc109390 0x7f60dc19f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.287+0000 7f60e2e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60dc10d8a0 0x7f60dc1a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.287+0000 7f60e2e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f60dc118d20 con 0x7f60dc1089d0 2024-06-13T11:33:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.287+0000 7f60e2e00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f60dc118ba0 con 0x7f60dc109390 2024-06-13T11:33:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.287+0000 7f60e2e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f60dc118ea0 con 0x7f60dc10d8a0 2024-06-13T11:33:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.288+0000 7f60e1a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60dc1089d0 0x7f60dc19f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.288+0000 7f60e1000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60dc109390 0x7f60dc19f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.288+0000 7f60e1000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60dc109390 0x7f60dc19f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:35176/0 (socket says 172.21.15.2:35176) 2024-06-13T11:33:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.288+0000 7f60e1000700 1 -- 172.21.15.2:0/1361255830 learned_addr learned my addr 172.21.15.2:0/1361255830 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:27.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.288+0000 7f60e2400700 1 --2- 172.21.15.2:0/1361255830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60dc10d8a0 0x7f60dc1a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:27.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.288+0000 7f60e1000700 1 -- 172.21.15.2:0/1361255830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60dc10d8a0 msgr2=0x7f60dc1a39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:27.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.288+0000 7f60e1000700 1 --2- 172.21.15.2:0/1361255830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60dc10d8a0 0x7f60dc1a39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:27.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.288+0000 7f60e1000700 1 -- 172.21.15.2:0/1361255830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60dc1089d0 msgr2=0x7f60dc19f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:27.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.288+0000 7f60e1000700 1 --2- 172.21.15.2:0/1361255830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60dc1089d0 0x7f60dc19f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:27.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.288+0000 7f60e1000700 1 -- 172.21.15.2:0/1361255830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60dc1a4130 con 0x7f60dc109390 2024-06-13T11:33:27.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.289+0000 7f60e1000700 1 --2- 172.21.15.2:0/1361255830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60dc109390 0x7f60dc19f6b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f60c800e9c0 tx=0x7f60c800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:27.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.289+0000 7f60da000700 1 -- 172.21.15.2:0/1361255830 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c800cbd0 con 0x7f60dc109390 2024-06-13T11:33:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.289+0000 7f60e2e00700 1 -- 172.21.15.2:0/1361255830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60dc1a4420 con 0x7f60dc109390 2024-06-13T11:33:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.289+0000 7f60da000700 1 -- 172.21.15.2:0/1361255830 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60c800ee60 con 0x7f60dc109390 2024-06-13T11:33:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.289+0000 7f60da000700 1 -- 172.21.15.2:0/1361255830 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c8005630 con 0x7f60dc109390 2024-06-13T11:33:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.289+0000 7f60e2e00700 1 -- 172.21.15.2:0/1361255830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60dc1abca0 con 0x7f60dc109390 2024-06-13T11:33:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.290+0000 7f60e2e00700 1 -- 172.21.15.2:0/1361255830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60dc069180 con 0x7f60dc109390 2024-06-13T11:33:27.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.292+0000 7f60da000700 1 -- 172.21.15.2:0/1361255830 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f60c8004750 con 0x7f60dc109390 2024-06-13T11:33:27.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.294+0000 7f60da000700 1 --2- 172.21.15.2:0/1361255830 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f60c40a2e10 0x7f60c40a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:27.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.294+0000 7f60da000700 1 -- 172.21.15.2:0/1361255830 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f60c80cfa40 con 0x7f60dc109390 2024-06-13T11:33:27.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.294+0000 7f60e1a00700 1 --2- 172.21.15.2:0/1361255830 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f60c40a2e10 0x7f60c40a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:27.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.295+0000 7f60e1a00700 1 --2- 172.21.15.2:0/1361255830 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f60c40a2e10 0x7f60c40a52d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f60d000f540 tx=0x7f60d000b040 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:27.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.298+0000 7f60da000700 1 -- 172.21.15.2:0/1361255830 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f60c809c240 con 0x7f60dc109390 2024-06-13T11:33:27.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.577+0000 7f60e2e00700 1 -- 172.21.15.2:0/1361255830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60dc1a0480 con 0x7f60dc109390 2024-06-13T11:33:27.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.579+0000 7f60da000700 1 -- 172.21.15.2:0/1361255830 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11853 (secure 0 0 0) 0x7f60c809bb40 con 0x7f60dc109390 2024-06-13T11:33:27.578 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:33:27.579 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:29:21.309310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24511,24493,24509]},"id":1}]} 2024-06-13T11:33:27.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.582+0000 7f60e2e00700 1 -- 172.21.15.2:0/1361255830 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f60c40a2e10 msgr2=0x7f60c40a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:27.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.582+0000 7f60e2e00700 1 --2- 172.21.15.2:0/1361255830 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f60c40a2e10 0x7f60c40a52d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f60d000f540 tx=0x7f60d000b040 comp rx=0 tx=0).stop 2024-06-13T11:33:27.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.582+0000 7f60e2e00700 1 -- 172.21.15.2:0/1361255830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60dc109390 msgr2=0x7f60dc19f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:27.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.582+0000 7f60e2e00700 1 --2- 172.21.15.2:0/1361255830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60dc109390 0x7f60dc19f6b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f60c800e9c0 tx=0x7f60c800ecd0 comp rx=0 tx=0).stop 2024-06-13T11:33:27.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.582+0000 7f60e2e00700 1 -- 172.21.15.2:0/1361255830 shutdown_connections 2024-06-13T11:33:27.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.582+0000 7f60e2e00700 1 --2- 172.21.15.2:0/1361255830 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f60c40a2e10 0x7f60c40a52d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:27.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.582+0000 7f60e2e00700 1 --2- 172.21.15.2:0/1361255830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60dc1089d0 0x7f60dc19f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:27.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.582+0000 7f60e2e00700 1 --2- 172.21.15.2:0/1361255830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60dc10d8a0 0x7f60dc1a39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:27.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.582+0000 7f60e2e00700 1 --2- 172.21.15.2:0/1361255830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60dc109390 0x7f60dc19f6b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:27.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.582+0000 7f60e2e00700 1 -- 172.21.15.2:0/1361255830 >> 172.21.15.2:0/1361255830 conn(0x7f60dc078220 msgr2=0x7f60dc078740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:27.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.582+0000 7f60e2e00700 1 -- 172.21.15.2:0/1361255830 shutdown_connections 2024-06-13T11:33:27.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:27.582+0000 7f60e2e00700 1 -- 172.21.15.2:0/1361255830 wait complete. 2024-06-13T11:33:27.583 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 31 2024-06-13T11:33:27.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:27 smithi002 ceph-mon[32210]: pgmap v299: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:27.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:27 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1361255830' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:33:27.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:27 smithi178 ceph-mon[36913]: pgmap v299: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:27.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:27 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1361255830' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:33:28.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:27 smithi077 ceph-mon[36410]: pgmap v299: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:28.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:27 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1361255830' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:33:28.378 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-13T11:33:28.848 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:33:29.925 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:29 smithi002 ceph-mon[32210]: pgmap v300: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:33:29.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:29 smithi178 ceph-mon[36913]: pgmap v300: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:33:30.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:29 smithi077 ceph-mon[36410]: pgmap v300: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:33:31.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.271+0000 7f7101600700 1 -- 172.21.15.2:0/2874904897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc102620 msgr2=0x7f70fc102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.271+0000 7f7101600700 1 --2- 172.21.15.2:0/2874904897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc102620 0x7f70fc102a00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009920 tx=0x7f70ec009c30 comp rx=0 tx=0).stop 2024-06-13T11:33:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.271+0000 7f7101600700 1 -- 172.21.15.2:0/2874904897 shutdown_connections 2024-06-13T11:33:31.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.271+0000 7f7101600700 1 --2- 172.21.15.2:0/2874904897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70fc107700 0x7f70fc10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.271+0000 7f7101600700 1 --2- 172.21.15.2:0/2874904897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc102620 0x7f70fc102a00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.271+0000 7f7101600700 1 --2- 172.21.15.2:0/2874904897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc102fd0 0x7f70fc107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.271+0000 7f7101600700 1 -- 172.21.15.2:0/2874904897 >> 172.21.15.2:0/2874904897 conn(0x7f70fc0fdf10 msgr2=0x7f70fc100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:31.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.272+0000 7f7101600700 1 -- 172.21.15.2:0/2874904897 shutdown_connections 2024-06-13T11:33:31.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.272+0000 7f7101600700 1 -- 172.21.15.2:0/2874904897 wait complete. 2024-06-13T11:33:31.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.273+0000 7f7101600700 1 Processor -- start 2024-06-13T11:33:31.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.273+0000 7f7101600700 1 -- start start 2024-06-13T11:33:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.274+0000 7f7101600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc102620 0x7f70fc074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.274+0000 7f7101600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70fc102fd0 0x7f70fc074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.274+0000 7f7101600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc107700 0x7f70fc075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.274+0000 7f7101600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc112760 con 0x7f70fc107700 2024-06-13T11:33:31.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.274+0000 7f7101600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc1125e0 con 0x7f70fc102fd0 2024-06-13T11:33:31.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.274+0000 7f7101600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc1128e0 con 0x7f70fc102620 2024-06-13T11:33:31.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.274+0000 7f70fbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc102620 0x7f70fc074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.274+0000 7f70fbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc102620 0x7f70fc074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:38714/0 (socket says 172.21.15.2:38714) 2024-06-13T11:33:31.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.274+0000 7f70fbe00700 1 -- 172.21.15.2:0/1001915304 learned_addr learned my addr 172.21.15.2:0/1001915304 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:31.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.274+0000 7f70f3400700 1 --2- 172.21.15.2:0/1001915304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70fc102fd0 0x7f70fc074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.275+0000 7f7100c00700 1 --2- 172.21.15.2:0/1001915304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc107700 0x7f70fc075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.275+0000 7f70fbe00700 1 -- 172.21.15.2:0/1001915304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70fc102fd0 msgr2=0x7f70fc074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:31.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.275+0000 7f70fbe00700 1 --2- 172.21.15.2:0/1001915304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70fc102fd0 0x7f70fc074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.275+0000 7f70fbe00700 1 -- 172.21.15.2:0/1001915304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc107700 msgr2=0x7f70fc075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.275+0000 7f70fbe00700 1 --2- 172.21.15.2:0/1001915304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc107700 0x7f70fc075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.275+0000 7f70fbe00700 1 -- 172.21.15.2:0/1001915304 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70fc1a7190 con 0x7f70fc102620 2024-06-13T11:33:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.275+0000 7f7100c00700 1 --2- 172.21.15.2:0/1001915304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc107700 0x7f70fc075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:33:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.275+0000 7f70fbe00700 1 --2- 172.21.15.2:0/1001915304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc102620 0x7f70fc074790 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f70ec000c00 tx=0x7f70ec00fa70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:31.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.276+0000 7f70f9600700 1 -- 172.21.15.2:0/1001915304 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec027070 con 0x7f70fc102620 2024-06-13T11:33:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.276+0000 7f70f9600700 1 -- 172.21.15.2:0/1001915304 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70ec00b560 con 0x7f70fc102620 2024-06-13T11:33:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.276+0000 7f70f9600700 1 -- 172.21.15.2:0/1001915304 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec004930 con 0x7f70fc102620 2024-06-13T11:33:31.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.276+0000 7f7101600700 1 -- 172.21.15.2:0/1001915304 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70fc1a7420 con 0x7f70fc102620 2024-06-13T11:33:31.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.276+0000 7f7101600700 1 -- 172.21.15.2:0/1001915304 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70fc1a7820 con 0x7f70fc102620 2024-06-13T11:33:31.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.279+0000 7f70f9600700 1 -- 172.21.15.2:0/1001915304 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f70ec02a070 con 0x7f70fc102620 2024-06-13T11:33:31.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.280+0000 7f710d5c8b80 1 Processor -- start 2024-06-13T11:33:31.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.281+0000 7f70f9600700 1 --2- 172.21.15.2:0/1001915304 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f70e00a2e10 0x7f70e00a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.281+0000 7f710d5c8b80 1 -- start start 2024-06-13T11:33:31.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.281+0000 7f70f9600700 1 -- 172.21.15.2:0/1001915304 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f70ec0d0280 con 0x7f70fc102620 2024-06-13T11:33:31.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.281+0000 7f7100c00700 1 --2- 172.21.15.2:0/1001915304 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f70e00a2e10 0x7f70e00a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.281+0000 7f710d5c8b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3185d60 0x5598e3186140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.281+0000 7f710d5c8b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3186680 0x5598e3190ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.281+0000 7f710d5c8b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3191530 0x5598e3193920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.281+0000 7f710d5c8b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5598e3095a10 con 0x5598e3191530 2024-06-13T11:33:31.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.281+0000 7f710d5c8b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5598e30d8b00 con 0x5598e3186680 2024-06-13T11:33:31.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.281+0000 7f710d5c8b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5598e30938f0 con 0x5598e3185d60 2024-06-13T11:33:31.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.282+0000 7f70fbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3185d60 0x5598e3186140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.282+0000 7f7100c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3191530 0x5598e3193920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.282+0000 7f70fbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3185d60 0x5598e3186140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:38724/0 (socket says 172.21.15.2:38724) 2024-06-13T11:33:31.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.282+0000 7f70fbe00700 1 -- 172.21.15.2:0/1069745989 learned_addr learned my addr 172.21.15.2:0/1069745989 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:31.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.282+0000 7f70f3400700 1 --2- 172.21.15.2:0/1069745989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3186680 0x5598e3190ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.282+0000 7f70fbe00700 1 -- 172.21.15.2:0/1069745989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3186680 msgr2=0x5598e3190ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:31.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.282+0000 7f70fbe00700 1 --2- 172.21.15.2:0/1069745989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3186680 0x5598e3190ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.282+0000 7f70fbe00700 1 -- 172.21.15.2:0/1069745989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3191530 msgr2=0x5598e3193920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:31.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.282+0000 7f70fbe00700 1 --2- 172.21.15.2:0/1069745989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3191530 0x5598e3193920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.282+0000 7f70fbe00700 1 -- 172.21.15.2:0/1069745989 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e3080f90 con 0x5598e3185d60 2024-06-13T11:33:31.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.282+0000 7f7100c00700 1 --2- 172.21.15.2:0/1001915304 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f70e00a2e10 0x7f70e00a52d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009fd0 tx=0x7f70f4007b00 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:31.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.282+0000 7f70fbe00700 1 --2- 172.21.15.2:0/1069745989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3185d60 0x5598e3186140 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f70ec09c110 tx=0x7f70ec09bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d92dea7dc647b1af server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:31.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.283+0000 7f70f1600700 1 -- 172.21.15.2:0/1069745989 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec09cb10 con 0x5598e3185d60 2024-06-13T11:33:31.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.283+0000 7f70f1600700 1 -- 172.21.15.2:0/1069745989 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70ec09c410 con 0x5598e3185d60 2024-06-13T11:33:31.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.283+0000 7f70f1600700 1 -- 172.21.15.2:0/1069745989 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec09c670 con 0x5598e3185d60 2024-06-13T11:33:31.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.283+0000 7f710d5c8b80 1 -- 172.21.15.2:0/1069745989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3185d60 msgr2=0x5598e3186140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:31.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.283+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/1069745989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3185d60 0x5598e3186140 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f70ec09c110 tx=0x7f70ec09bd70 comp rx=0 tx=0).stop 2024-06-13T11:33:31.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.284+0000 7f710d5c8b80 1 -- 172.21.15.2:0/1069745989 shutdown_connections 2024-06-13T11:33:31.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.284+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/1069745989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3191530 0x5598e3193920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.284+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/1069745989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3185d60 0x5598e3186140 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.284+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/1069745989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3186680 0x5598e3190ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.284+0000 7f710d5c8b80 1 -- 172.21.15.2:0/1069745989 >> 172.21.15.2:0/1069745989 conn(0x5598e30b3170 msgr2=0x5598e3182280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:31.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.284+0000 7f710d5c8b80 1 -- 172.21.15.2:0/1069745989 shutdown_connections 2024-06-13T11:33:31.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.284+0000 7f710d5c8b80 1 -- 172.21.15.2:0/1069745989 wait complete. 2024-06-13T11:33:31.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.284+0000 7f710d5c8b80 1 -- start start 2024-06-13T11:33:31.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.285+0000 7f710d5c8b80 1 Processor -- start 2024-06-13T11:33:31.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.285+0000 7f710d5c8b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3185d60 0x5598e3190d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.285+0000 7f710d5c8b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3186680 0x5598e318e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.285+0000 7f710d5c8b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3191530 0x5598e318e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.285+0000 7f710d5c8b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5598e3074f60 con 0x5598e3191530 2024-06-13T11:33:31.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.285+0000 7f710d5c8b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5598e30d4ac0 con 0x5598e3185d60 2024-06-13T11:33:31.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.285+0000 7f710d5c8b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5598e30938f0 con 0x5598e3186680 2024-06-13T11:33:31.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.285+0000 7f710d5c8b80 10 client.0 _ll_register_callbacks cb 0x5598e306e380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:33:31.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.285+0000 7f7100c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3191530 0x5598e318e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.285+0000 7f70fbe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3185d60 0x5598e3190d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.285+0000 7f7100c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3191530 0x5598e318e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49688/0 (socket says 172.21.15.2:49688) 2024-06-13T11:33:31.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.285+0000 7f70f3400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3186680 0x5598e318e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.285+0000 7f7100c00700 1 -- 172.21.15.2:0/325467343 learned_addr learned my addr 172.21.15.2:0/325467343 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:31.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.285+0000 7f70fbe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3185d60 0x5598e3190d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:35210/0 (socket says 172.21.15.2:35210) 2024-06-13T11:33:31.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.286+0000 7f70fbe00700 1 -- 172.21.15.2:0/325467343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3186680 msgr2=0x5598e318e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:31.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.286+0000 7f70fbe00700 1 --2- 172.21.15.2:0/325467343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3186680 0x5598e318e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.286+0000 7f70fbe00700 1 -- 172.21.15.2:0/325467343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3191530 msgr2=0x5598e318e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:31.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.286+0000 7f70fbe00700 1 --2- 172.21.15.2:0/325467343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3191530 0x5598e318e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.286+0000 7f70fbe00700 1 -- 172.21.15.2:0/325467343 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598e30278d0 con 0x5598e3185d60 2024-06-13T11:33:31.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.286+0000 7f70fbe00700 1 --2- 172.21.15.2:0/325467343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3185d60 0x5598e3190d60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009680 tx=0x7f70ec00bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f56bbf9d9436c9e7 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:31.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.286+0000 7f70ea000700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:33:31.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.286+0000 7f70ea000700 1 -- 172.21.15.2:0/325467343 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec0b4070 con 0x5598e3185d60 2024-06-13T11:33:31.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.286+0000 7f70ea000700 1 -- 172.21.15.2:0/325467343 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f70ec09c880 con 0x5598e3185d60 2024-06-13T11:33:31.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.286+0000 7f710d5c8b80 1 -- 172.21.15.2:0/325467343 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70ec09c410 con 0x5598e3185d60 2024-06-13T11:33:31.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.287+0000 7f70ea000700 1 -- 172.21.15.2:0/325467343 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f70ec083050 con 0x5598e3185d60 2024-06-13T11:33:31.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.287+0000 7f710d5c8b80 10 client.26420 fetch_fsmap learned FSMap version 31 2024-06-13T11:33:31.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.287+0000 7f710d5c8b80 1 -- 172.21.15.2:0/325467343 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5598e319e4a0 con 0x5598e3185d60 2024-06-13T11:33:31.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.287+0000 7f70ea000700 1 -- 172.21.15.2:0/325467343 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70ec09c410 con 0x5598e3185d60 2024-06-13T11:33:31.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.287+0000 7f70ea000700 1 -- 172.21.15.2:0/325467343 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f70ec0a4bf0 con 0x5598e3185d60 2024-06-13T11:33:31.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.287+0000 7f710d5c8b80 10 client.26420 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:33:31.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.287+0000 7f710d5c8b80 10 client.26420 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:33:31.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.287+0000 7f710d5c8b80 20 client.26420 populate_metadata read hostname 'smithi002' 2024-06-13T11:33:31.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.287+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/325467343 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5598e31a0970 0x5598e31a2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.287+0000 7f710d5c8b80 4 client.26420 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:33:31.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.287+0000 7f710d5c8b80 1 -- 172.21.15.2:0/325467343 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598e30e6000 con 0x5598e31a0970 2024-06-13T11:33:31.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.288+0000 7f70f3400700 1 --2- 172.21.15.2:0/325467343 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5598e31a0970 0x5598e31a2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.289+0000 7f70f3400700 1 --2- 172.21.15.2:0/325467343 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5598e31a0970 0x5598e31a2d60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=17344a12f7057bf2 server_cookie=51376cc556afdb7f in_seq=0 out_seq=0 2024-06-13T11:33:31.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.289+0000 7f70ea000700 10 client.26420 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:33:31.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.290+0000 7f70ea000700 1 -- 172.21.15.2:0/325467343 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5598e30e6000 con 0x5598e31a0970 2024-06-13T11:33:31.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.290+0000 7f70ea000700 10 client.26420 handle_command_reply: tid=0 2024-06-13T11:33:31.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.290+0000 7f710d5c8b80 1 client.26420 shutdown 2024-06-13T11:33:31.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.290+0000 7f710d5c8b80 1 -- 172.21.15.2:0/325467343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3185d60 msgr2=0x5598e3190d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:31.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.290+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/325467343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3185d60 0x5598e3190d60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009680 tx=0x7f70ec00bd50 comp rx=0 tx=0).stop 2024-06-13T11:33:31.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.290+0000 7f710d5c8b80 1 -- 172.21.15.2:0/325467343 shutdown_connections 2024-06-13T11:33:31.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.290+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/325467343 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5598e31a0970 0x5598e31a2d60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.290+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/325467343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3191530 0x5598e318e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.290+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/325467343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3185d60 0x5598e3190d60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.290+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/325467343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3186680 0x5598e318e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.290+0000 7f70ea000700 0 client.26420 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:33:31.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.290+0000 7f710d5c8b80 1 -- 172.21.15.2:0/325467343 >> 172.21.15.2:0/325467343 conn(0x5598e30b3170 msgr2=0x5598e3181e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:31.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.290+0000 7f710d5c8b80 1 -- 172.21.15.2:0/325467343 shutdown_connections 2024-06-13T11:33:31.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.290+0000 7f710d5c8b80 1 -- 172.21.15.2:0/325467343 wait complete. 2024-06-13T11:33:31.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.291+0000 7f710d5c8b80 20 client.26420 trim_cache size 0 max 16384 2024-06-13T11:33:31.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.307+0000 7f710d5c8b80 1 Processor -- start 2024-06-13T11:33:31.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.308+0000 7f710d5c8b80 1 -- start start 2024-06-13T11:33:31.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.308+0000 7f710d5c8b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3185d60 0x5598e3182390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.308+0000 7f710d5c8b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3186680 0x5598e31a8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.308+0000 7f710d5c8b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3191530 0x5598e31a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.308+0000 7f710d5c8b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc1b2e00 con 0x5598e3185d60 2024-06-13T11:33:31.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.308+0000 7f710d5c8b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc1b0690 con 0x5598e3186680 2024-06-13T11:33:31.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.308+0000 7f710d5c8b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc1ae500 con 0x5598e3191530 2024-06-13T11:33:31.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.309+0000 7f70fbe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3185d60 0x5598e3182390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.309+0000 7f7100c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3191530 0x5598e31a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.309+0000 7f70f3400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3186680 0x5598e31a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.309+0000 7f7100c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3191530 0x5598e31a8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:38756/0 (socket says 172.21.15.2:38756) 2024-06-13T11:33:31.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.309+0000 7f70fbe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3185d60 0x5598e3182390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49702/0 (socket says 172.21.15.2:49702) 2024-06-13T11:33:31.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.309+0000 7f7100c00700 1 -- 172.21.15.2:0/3803918008 learned_addr learned my addr 172.21.15.2:0/3803918008 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:31.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.309+0000 7f7100c00700 1 -- 172.21.15.2:0/3803918008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3186680 msgr2=0x5598e31a8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:31.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.309+0000 7f7100c00700 1 --2- 172.21.15.2:0/3803918008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3186680 0x5598e31a8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.309+0000 7f7100c00700 1 -- 172.21.15.2:0/3803918008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3185d60 msgr2=0x5598e3182390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:31.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.309+0000 7f7100c00700 1 --2- 172.21.15.2:0/3803918008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3185d60 0x5598e3182390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.309+0000 7f7100c00700 1 -- 172.21.15.2:0/3803918008 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e318de30 con 0x5598e3191530 2024-06-13T11:33:31.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.310+0000 7f7100c00700 1 --2- 172.21.15.2:0/3803918008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3191530 0x5598e31a8a80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f70f401a700 tx=0x7f70f401c030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1379433f2e7702d6 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:31.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.310+0000 7f70f0c00700 1 -- 172.21.15.2:0/3803918008 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f4024670 con 0x5598e3191530 2024-06-13T11:33:31.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.310+0000 7f70f0c00700 1 -- 172.21.15.2:0/3803918008 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70f4029070 con 0x5598e3191530 2024-06-13T11:33:31.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.310+0000 7f70f0c00700 1 -- 172.21.15.2:0/3803918008 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f4017be0 con 0x5598e3191530 2024-06-13T11:33:31.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.311+0000 7f710d5c8b80 1 -- 172.21.15.2:0/3803918008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3191530 msgr2=0x5598e31a8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:31.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.311+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/3803918008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3191530 0x5598e31a8a80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f70f401a700 tx=0x7f70f401c030 comp rx=0 tx=0).stop 2024-06-13T11:33:31.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.311+0000 7f710d5c8b80 1 -- 172.21.15.2:0/3803918008 shutdown_connections 2024-06-13T11:33:31.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.311+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/3803918008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3185d60 0x5598e3182390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.311+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/3803918008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3191530 0x5598e31a8a80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.311+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/3803918008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3186680 0x5598e31a8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.311+0000 7f710d5c8b80 1 -- 172.21.15.2:0/3803918008 >> 172.21.15.2:0/3803918008 conn(0x5598e30b3170 msgr2=0x5598e318d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:31.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.311+0000 7f710d5c8b80 1 -- 172.21.15.2:0/3803918008 shutdown_connections 2024-06-13T11:33:31.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.311+0000 7f710d5c8b80 1 -- 172.21.15.2:0/3803918008 wait complete. 2024-06-13T11:33:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.311+0000 7f710d5c8b80 1 -- start start 2024-06-13T11:33:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.312+0000 7f710d5c8b80 1 Processor -- start 2024-06-13T11:33:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.312+0000 7f710d5c8b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3185d60 0x5598e3198f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.312+0000 7f710d5c8b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3186680 0x5598e31994c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.312+0000 7f710d5c8b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3191530 0x5598e31964e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.312+0000 7f710d5c8b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc1aeb50 con 0x5598e3186680 2024-06-13T11:33:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.312+0000 7f710d5c8b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc1affc0 con 0x5598e3191530 2024-06-13T11:33:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.312+0000 7f710d5c8b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc1af220 con 0x5598e3185d60 2024-06-13T11:33:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.312+0000 7f710d5c8b80 10 client.0 _ll_register_callbacks cb 0x5598e306e380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:33:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.312+0000 7f70f3400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3186680 0x5598e31994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.312+0000 7f70fbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3185d60 0x5598e3198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.313+0000 7f70f3400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3186680 0x5598e31994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49718/0 (socket says 172.21.15.2:49718) 2024-06-13T11:33:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.313+0000 7f70f3400700 1 -- 172.21.15.2:0/34161511 learned_addr learned my addr 172.21.15.2:0/34161511 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:31.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.313+0000 7f70fbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3185d60 0x5598e3198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:38772/0 (socket says 172.21.15.2:38772) 2024-06-13T11:33:31.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.313+0000 7f7100c00700 1 --2- 172.21.15.2:0/34161511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3191530 0x5598e31964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.313+0000 7f70f3400700 1 -- 172.21.15.2:0/34161511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3185d60 msgr2=0x5598e3198f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.313+0000 7f70f3400700 1 --2- 172.21.15.2:0/34161511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3185d60 0x5598e3198f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.313+0000 7f70f3400700 1 -- 172.21.15.2:0/34161511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3191530 msgr2=0x5598e31964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.313+0000 7f70f3400700 1 --2- 172.21.15.2:0/34161511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3191530 0x5598e31964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.313+0000 7f70f3400700 1 -- 172.21.15.2:0/34161511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598e3196d20 con 0x5598e3186680 2024-06-13T11:33:31.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.313+0000 7f70fbe00700 1 --2- 172.21.15.2:0/34161511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3185d60 0x5598e3198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:33:31.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.313+0000 7f70f3400700 1 --2- 172.21.15.2:0/34161511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3186680 0x5598e31994c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f70e400a010 tx=0x7f70e401f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51aac8e80069a3e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:31.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.313+0000 7f70ea000700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:33:31.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.314+0000 7f70ea000700 1 -- 172.21.15.2:0/34161511 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e40042f0 con 0x5598e3186680 2024-06-13T11:33:31.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.314+0000 7f710d5c8b80 1 -- 172.21.15.2:0/34161511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70f4029070 con 0x5598e3186680 2024-06-13T11:33:31.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.314+0000 7f70ea000700 1 -- 172.21.15.2:0/34161511 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f70e4004490 con 0x5598e3186680 2024-06-13T11:33:31.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.314+0000 7f70ea000700 1 -- 172.21.15.2:0/34161511 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f70e4030050 con 0x5598e3186680 2024-06-13T11:33:31.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.314+0000 7f710d5c8b80 10 client.16323 fetch_fsmap learned FSMap version 31 2024-06-13T11:33:31.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.314+0000 7f710d5c8b80 1 -- 172.21.15.2:0/34161511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5598e320b090 con 0x5598e3186680 2024-06-13T11:33:31.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.314+0000 7f70ea000700 1 -- 172.21.15.2:0/34161511 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70f4029070 con 0x5598e3186680 2024-06-13T11:33:31.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.315+0000 7f70ea000700 1 -- 172.21.15.2:0/34161511 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f70e40109d0 con 0x5598e3186680 2024-06-13T11:33:31.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.315+0000 7f710d5c8b80 10 client.16323 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:33:31.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.315+0000 7f710d5c8b80 10 client.16323 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:33:31.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.315+0000 7f710d5c8b80 20 client.16323 populate_metadata read hostname 'smithi002' 2024-06-13T11:33:31.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.315+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/34161511 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5598e320b720 0x5598e320db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:31.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.315+0000 7f710d5c8b80 4 client.16323 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:33:31.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.315+0000 7f710d5c8b80 1 -- 172.21.15.2:0/34161511 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5598e30e0580 con 0x5598e320b720 2024-06-13T11:33:31.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.315+0000 7f70fbe00700 1 --2- 172.21.15.2:0/34161511 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5598e320b720 0x5598e320db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:31.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.316+0000 7f70fbe00700 1 --2- 172.21.15.2:0/34161511 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5598e320b720 0x5598e320db40 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fae32335c0b0a318 server_cookie=d85c5739cb575330 in_seq=0 out_seq=0 2024-06-13T11:33:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.316+0000 7f70ea000700 10 client.16323 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:33:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.316+0000 7f70ea000700 1 -- 172.21.15.2:0/34161511 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5598e30e0580 con 0x5598e320b720 2024-06-13T11:33:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.316+0000 7f70ea000700 10 client.16323 handle_command_reply: tid=0 2024-06-13T11:33:31.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.316+0000 7f710d5c8b80 1 client.16323 shutdown 2024-06-13T11:33:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.316+0000 7f710d5c8b80 1 -- 172.21.15.2:0/34161511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3186680 msgr2=0x5598e31994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.316+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/34161511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3186680 0x5598e31994c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f70e400a010 tx=0x7f70e401f8f0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.316+0000 7f710d5c8b80 1 -- 172.21.15.2:0/34161511 shutdown_connections 2024-06-13T11:33:31.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.316+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/34161511 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x5598e320b720 0x5598e320db40 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.316+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/34161511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5598e3191530 0x5598e31964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.316+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/34161511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5598e3185d60 0x5598e3198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.316+0000 7f70ea000700 0 client.16323 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:33:31.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.316+0000 7f710d5c8b80 1 --2- 172.21.15.2:0/34161511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5598e3186680 0x5598e31994c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.316+0000 7f710d5c8b80 1 -- 172.21.15.2:0/34161511 >> 172.21.15.2:0/34161511 conn(0x5598e30b3170 msgr2=0x5598e319bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:31.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.317+0000 7f710d5c8b80 1 -- 172.21.15.2:0/34161511 shutdown_connections 2024-06-13T11:33:31.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.317+0000 7f710d5c8b80 1 -- 172.21.15.2:0/34161511 wait complete. 2024-06-13T11:33:31.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.317+0000 7f710d5c8b80 20 client.16323 trim_cache size 0 max 16384 2024-06-13T11:33:31.337 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:33:31.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.318+0000 7f7101600700 1 -- 172.21.15.2:0/1001915304 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f70e00a2e10 msgr2=0x7f70e00a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:31.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.318+0000 7f7101600700 1 --2- 172.21.15.2:0/1001915304 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f70e00a2e10 0x7f70e00a52d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009fd0 tx=0x7f70f4007b00 comp rx=0 tx=0).stop 2024-06-13T11:33:31.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.318+0000 7f7101600700 1 -- 172.21.15.2:0/1001915304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc102620 msgr2=0x7f70fc074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:31.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.318+0000 7f7101600700 1 --2- 172.21.15.2:0/1001915304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc102620 0x7f70fc074790 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f70ec000c00 tx=0x7f70ec00fa70 comp rx=0 tx=0).stop 2024-06-13T11:33:31.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.318+0000 7f7101600700 1 -- 172.21.15.2:0/1001915304 shutdown_connections 2024-06-13T11:33:31.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.318+0000 7f7101600700 1 --2- 172.21.15.2:0/1001915304 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f70e00a2e10 0x7f70e00a52d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.318+0000 7f7101600700 1 --2- 172.21.15.2:0/1001915304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70fc107700 0x7f70fc075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.318+0000 7f7101600700 1 --2- 172.21.15.2:0/1001915304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc102620 0x7f70fc074790 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.318+0000 7f7101600700 1 --2- 172.21.15.2:0/1001915304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70fc102fd0 0x7f70fc074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:31.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.318+0000 7f7101600700 1 -- 172.21.15.2:0/1001915304 >> 172.21.15.2:0/1001915304 conn(0x7f70fc0fdf10 msgr2=0x7f70fc0ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:31.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.318+0000 7f7101600700 1 -- 172.21.15.2:0/1001915304 shutdown_connections 2024-06-13T11:33:31.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:31.318+0000 7f7101600700 1 -- 172.21.15.2:0/1001915304 wait complete. 2024-06-13T11:33:31.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:31 smithi178 ceph-mon[36913]: pgmap v301: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:32.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:31 smithi077 ceph-mon[36410]: pgmap v301: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:32.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:31 smithi002 ceph-mon[32210]: pgmap v301: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:32.217 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-13T11:33:32.667 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:33:33.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:33 smithi178 ceph-mon[36913]: pgmap v302: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:33:34.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:33 smithi077 ceph-mon[36410]: pgmap v302: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:33:34.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:33 smithi002 ceph-mon[32210]: pgmap v302: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:33:35.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.066+0000 7f2a72a00700 1 -- 172.21.15.2:0/1565133826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a6c107450 msgr2=0x7f2a6c107830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:35.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.066+0000 7f2a72a00700 1 --2- 172.21.15.2:0/1565133826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a6c107450 0x7f2a6c107830 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009990 tx=0x7f2a5c009ca0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.066+0000 7f2a72a00700 1 -- 172.21.15.2:0/1565133826 shutdown_connections 2024-06-13T11:33:35.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.066+0000 7f2a72a00700 1 --2- 172.21.15.2:0/1565133826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a6c107450 0x7f2a6c107830 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.066+0000 7f2a72a00700 1 --2- 172.21.15.2:0/1565133826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a6c102ee0 0x7f2a6c10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.066+0000 7f2a72a00700 1 --2- 172.21.15.2:0/1565133826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c102540 0x7f2a6c1029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.066+0000 7f2a72a00700 1 -- 172.21.15.2:0/1565133826 >> 172.21.15.2:0/1565133826 conn(0x7f2a6c0795f0 msgr2=0x7f2a6c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:35.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.066+0000 7f2a72a00700 1 -- 172.21.15.2:0/1565133826 shutdown_connections 2024-06-13T11:33:35.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.066+0000 7f2a72a00700 1 -- 172.21.15.2:0/1565133826 wait complete. 2024-06-13T11:33:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.068+0000 7f2a72a00700 1 Processor -- start 2024-06-13T11:33:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.068+0000 7f2a72a00700 1 -- start start 2024-06-13T11:33:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.068+0000 7f2a72a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a6c102540 0x7f2a6c074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.068+0000 7f2a72a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a6c102ee0 0x7f2a6c074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.068+0000 7f2a72a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c107450 0x7f2a6c075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.069+0000 7f2a72a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c1127c0 con 0x7f2a6c102ee0 2024-06-13T11:33:35.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.069+0000 7f2a72a00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c112640 con 0x7f2a6c107450 2024-06-13T11:33:35.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.069+0000 7f2a72a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c112940 con 0x7f2a6c102540 2024-06-13T11:33:35.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.069+0000 7f2a6b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a6c102ee0 0x7f2a6c074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.069+0000 7f2a6b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a6c102ee0 0x7f2a6c074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49738/0 (socket says 172.21.15.2:49738) 2024-06-13T11:33:35.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.069+0000 7f2a6b400700 1 -- 172.21.15.2:0/2924581593 learned_addr learned my addr 172.21.15.2:0/2924581593 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:35.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.069+0000 7f2a6be00700 1 --2- 172.21.15.2:0/2924581593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a6c102540 0x7f2a6c074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.069+0000 7f2a70a00700 1 --2- 172.21.15.2:0/2924581593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c107450 0x7f2a6c075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.069+0000 7f2a6be00700 1 -- 172.21.15.2:0/2924581593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c107450 msgr2=0x7f2a6c075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:35.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.069+0000 7f2a6be00700 1 --2- 172.21.15.2:0/2924581593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c107450 0x7f2a6c075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.069+0000 7f2a6be00700 1 -- 172.21.15.2:0/2924581593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a6c102ee0 msgr2=0x7f2a6c074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:35.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.069+0000 7f2a6be00700 1 --2- 172.21.15.2:0/2924581593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a6c102ee0 0x7f2a6c074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.069+0000 7f2a6be00700 1 -- 172.21.15.2:0/2924581593 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6c1a71e0 con 0x7f2a6c102540 2024-06-13T11:33:35.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.069+0000 7f2a6b400700 1 --2- 172.21.15.2:0/2924581593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a6c102ee0 0x7f2a6c074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:33:35.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.070+0000 7f2a6be00700 1 --2- 172.21.15.2:0/2924581593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a6c102540 0x7f2a6c074790 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0098e0 tx=0x7f2a5c00b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:35.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.070+0000 7f2a68c00700 1 -- 172.21.15.2:0/2924581593 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c027070 con 0x7f2a6c102540 2024-06-13T11:33:35.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.070+0000 7f2a68c00700 1 -- 172.21.15.2:0/2924581593 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a5c003d70 con 0x7f2a6c102540 2024-06-13T11:33:35.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.070+0000 7f2a72a00700 1 -- 172.21.15.2:0/2924581593 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a6c1a7470 con 0x7f2a6c102540 2024-06-13T11:33:35.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.070+0000 7f2a68c00700 1 -- 172.21.15.2:0/2924581593 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c00f460 con 0x7f2a6c102540 2024-06-13T11:33:35.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.070+0000 7f2a72a00700 1 -- 172.21.15.2:0/2924581593 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a6c1a78c0 con 0x7f2a6c102540 2024-06-13T11:33:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.074+0000 7f2a68c00700 1 -- 172.21.15.2:0/2924581593 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f2a5c02a070 con 0x7f2a6c102540 2024-06-13T11:33:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.075+0000 7f2a68c00700 1 --2- 172.21.15.2:0/2924581593 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2a500a2d90 0x7f2a500a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.075+0000 7f2a7d2c2b80 1 Processor -- start 2024-06-13T11:33:35.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.075+0000 7f2a7d2c2b80 1 -- start start 2024-06-13T11:33:35.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.075+0000 7f2a68c00700 1 -- 172.21.15.2:0/2924581593 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f2a5c0d0690 con 0x7f2a6c102540 2024-06-13T11:33:35.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.075+0000 7f2a6b400700 1 --2- 172.21.15.2:0/2924581593 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2a500a2d90 0x7f2a500a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.076+0000 7f2a7d2c2b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555608552e40 0x5556085d6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.076+0000 7f2a7d2c2b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556085d65b0 0x5556085d6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.076+0000 7f2a7d2c2b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085e1300 0x5556085e36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.076+0000 7f2a7d2c2b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5556084e5a10 con 0x555608552e40 2024-06-13T11:33:35.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.076+0000 7f2a7d2c2b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555608528b00 con 0x5556085e1300 2024-06-13T11:33:35.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.076+0000 7f2a7d2c2b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5556084e38f0 con 0x5556085d65b0 2024-06-13T11:33:35.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.076+0000 7f2a6be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555608552e40 0x5556085d6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.076+0000 7f2a6b400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556085d65b0 0x5556085d6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.076+0000 7f2a6be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555608552e40 0x5556085d6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49742/0 (socket says 172.21.15.2:49742) 2024-06-13T11:33:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.076+0000 7f2a6be00700 1 -- 172.21.15.2:0/2712629458 learned_addr learned my addr 172.21.15.2:0/2712629458 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.076+0000 7f2a70a00700 1 --2- 172.21.15.2:0/2712629458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085e1300 0x5556085e36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.077+0000 7f2a70a00700 1 -- 172.21.15.2:0/2712629458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556085d65b0 msgr2=0x5556085d6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.077+0000 7f2a6b400700 1 --2- 172.21.15.2:0/2924581593 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2a500a2d90 0x7f2a500a5250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c079b60 tx=0x7f2a58009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.077+0000 7f2a70a00700 1 --2- 172.21.15.2:0/2712629458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556085d65b0 0x5556085d6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.077+0000 7f2a70a00700 1 -- 172.21.15.2:0/2712629458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555608552e40 msgr2=0x5556085d6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:35.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.077+0000 7f2a70a00700 1 --2- 172.21.15.2:0/2712629458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555608552e40 0x5556085d6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.077+0000 7f2a70a00700 1 -- 172.21.15.2:0/2712629458 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556084d0f90 con 0x5556085e1300 2024-06-13T11:33:35.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.077+0000 7f2a70a00700 1 --2- 172.21.15.2:0/2712629458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085e1300 0x5556085e36f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2a64003e90 tx=0x7f2a64009ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bf5aaea2b7b80bf server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:35.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.077+0000 7f2a61600700 1 -- 172.21.15.2:0/2712629458 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a64004bb0 con 0x5556085e1300 2024-06-13T11:33:35.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.077+0000 7f2a61600700 1 -- 172.21.15.2:0/2712629458 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a64004850 con 0x5556085e1300 2024-06-13T11:33:35.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.077+0000 7f2a61600700 1 -- 172.21.15.2:0/2712629458 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a64007d80 con 0x5556085e1300 2024-06-13T11:33:35.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.078+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/2712629458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085e1300 msgr2=0x5556085e36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:35.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.078+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/2712629458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085e1300 0x5556085e36f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2a64003e90 tx=0x7f2a64009ba0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.078+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/2712629458 shutdown_connections 2024-06-13T11:33:35.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.078+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/2712629458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555608552e40 0x5556085d6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.078+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/2712629458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085e1300 0x5556085e36f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.078+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/2712629458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556085d65b0 0x5556085d6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.078+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/2712629458 >> 172.21.15.2:0/2712629458 conn(0x555608503170 msgr2=0x5556085d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.078+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/2712629458 shutdown_connections 2024-06-13T11:33:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.078+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/2712629458 wait complete. 2024-06-13T11:33:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.079+0000 7f2a7d2c2b80 1 -- start start 2024-06-13T11:33:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.079+0000 7f2a7d2c2b80 1 Processor -- start 2024-06-13T11:33:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.080+0000 7f2a7d2c2b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555608552e40 0x5556085e0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.080+0000 7f2a7d2c2b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085d65b0 0x5556085ddd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.080+0000 7f2a7d2c2b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556085e1300 0x5556085de250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.080+0000 7f2a7d2c2b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5556084c4f60 con 0x5556085e1300 2024-06-13T11:33:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.080+0000 7f2a7d2c2b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555608524ac0 con 0x5556085d65b0 2024-06-13T11:33:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.080+0000 7f2a7d2c2b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5556085e3fc0 con 0x555608552e40 2024-06-13T11:33:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.080+0000 7f2a7d2c2b80 10 client.0 _ll_register_callbacks cb 0x5556084c2720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:33:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.080+0000 7f2a6be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555608552e40 0x5556085e0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.080+0000 7f2a70a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556085e1300 0x5556085de250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.080+0000 7f2a6be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555608552e40 0x5556085e0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:38818/0 (socket says 172.21.15.2:38818) 2024-06-13T11:33:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.080+0000 7f2a6be00700 1 -- 172.21.15.2:0/2210520551 learned_addr learned my addr 172.21.15.2:0/2210520551 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:35.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.080+0000 7f2a6b400700 1 --2- 172.21.15.2:0/2210520551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085d65b0 0x5556085ddd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.081+0000 7f2a6be00700 1 -- 172.21.15.2:0/2210520551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085d65b0 msgr2=0x5556085ddd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:35.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.081+0000 7f2a6be00700 1 --2- 172.21.15.2:0/2210520551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085d65b0 0x5556085ddd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.081+0000 7f2a6be00700 1 -- 172.21.15.2:0/2210520551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556085e1300 msgr2=0x5556085de250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:35.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.081+0000 7f2a6be00700 1 --2- 172.21.15.2:0/2210520551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556085e1300 0x5556085de250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.081+0000 7f2a6be00700 1 -- 172.21.15.2:0/2210520551 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556084778d0 con 0x555608552e40 2024-06-13T11:33:35.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.081+0000 7f2a6be00700 1 --2- 172.21.15.2:0/2210520551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555608552e40 0x5556085e0a10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0059d0 tx=0x7f2a5c098b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c2ecd8618b5a821 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:35.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.081+0000 7f2a56000700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:33:35.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.081+0000 7f2a56000700 1 -- 172.21.15.2:0/2210520551 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0b5060 con 0x555608552e40 2024-06-13T11:33:35.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.081+0000 7f2a56000700 1 -- 172.21.15.2:0/2210520551 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f2a5c0d0220 con 0x555608552e40 2024-06-13T11:33:35.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.081+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/2210520551 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a64004850 con 0x555608552e40 2024-06-13T11:33:35.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.082+0000 7f2a56000700 1 -- 172.21.15.2:0/2210520551 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2a5c09c180 con 0x555608552e40 2024-06-13T11:33:35.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.082+0000 7f2a7d2c2b80 10 client.26473 fetch_fsmap learned FSMap version 31 2024-06-13T11:33:35.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.082+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/2210520551 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5556085ee680 con 0x555608552e40 2024-06-13T11:33:35.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.082+0000 7f2a56000700 1 -- 172.21.15.2:0/2210520551 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a64004850 con 0x555608552e40 2024-06-13T11:33:35.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.082+0000 7f2a56000700 1 -- 172.21.15.2:0/2210520551 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f2a5c09ca80 con 0x555608552e40 2024-06-13T11:33:35.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.082+0000 7f2a7d2c2b80 10 client.26473 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:33:35.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.082+0000 7f2a7d2c2b80 10 client.26473 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:33:35.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.082+0000 7f2a7d2c2b80 20 client.26473 populate_metadata read hostname 'smithi002' 2024-06-13T11:33:35.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.082+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/2210520551 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5556085f0c40 0x5556085f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.082+0000 7f2a7d2c2b80 4 client.26473 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:33:35.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.082+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/2210520551 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555608536000 con 0x5556085f0c40 2024-06-13T11:33:35.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.083+0000 7f2a6b400700 1 --2- 172.21.15.2:0/2210520551 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5556085f0c40 0x5556085f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.083+0000 7f2a6b400700 1 --2- 172.21.15.2:0/2210520551 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5556085f0c40 0x5556085f30a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ad5086d04e4668bd server_cookie=4913cbcbc1035ce1 in_seq=0 out_seq=0 2024-06-13T11:33:35.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.083+0000 7f2a56000700 10 client.26473 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:33:35.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.084+0000 7f2a56000700 1 -- 172.21.15.2:0/2210520551 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x555608536000 con 0x5556085f0c40 2024-06-13T11:33:35.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.084+0000 7f2a56000700 10 client.26473 handle_command_reply: tid=0 2024-06-13T11:33:35.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.084+0000 7f2a7d2c2b80 1 client.26473 shutdown 2024-06-13T11:33:35.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.084+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/2210520551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555608552e40 msgr2=0x5556085e0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:35.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.084+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/2210520551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555608552e40 0x5556085e0a10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0059d0 tx=0x7f2a5c098b90 comp rx=0 tx=0).stop 2024-06-13T11:33:35.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.085+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/2210520551 shutdown_connections 2024-06-13T11:33:35.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.085+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/2210520551 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5556085f0c40 0x5556085f30a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.085+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/2210520551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556085e1300 0x5556085de250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.085+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/2210520551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555608552e40 0x5556085e0a10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.085+0000 7f2a56000700 0 client.26473 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:33:35.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.085+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/2210520551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085d65b0 0x5556085ddd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.085+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/2210520551 >> 172.21.15.2:0/2210520551 conn(0x555608503170 msgr2=0x5556085d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:35.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.085+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/2210520551 shutdown_connections 2024-06-13T11:33:35.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.085+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/2210520551 wait complete. 2024-06-13T11:33:35.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.085+0000 7f2a7d2c2b80 20 client.26473 trim_cache size 0 max 16384 2024-06-13T11:33:35.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.102+0000 7f2a7d2c2b80 1 Processor -- start 2024-06-13T11:33:35.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.102+0000 7f2a7d2c2b80 1 -- start start 2024-06-13T11:33:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.102+0000 7f2a7d2c2b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555608552e40 0x5556085dcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.102+0000 7f2a7d2c2b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556085d65b0 0x5556085e26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.102+0000 7f2a7d2c2b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085e1300 0x5556085e0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.102+0000 7f2a7d2c2b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c1b2e80 con 0x555608552e40 2024-06-13T11:33:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.102+0000 7f2a7d2c2b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c1b0710 con 0x5556085e1300 2024-06-13T11:33:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.102+0000 7f2a7d2c2b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c1ae580 con 0x5556085d65b0 2024-06-13T11:33:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.103+0000 7f2a6be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555608552e40 0x5556085dcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.103+0000 7f2a6be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555608552e40 0x5556085dcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49760/0 (socket says 172.21.15.2:49760) 2024-06-13T11:33:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.103+0000 7f2a6be00700 1 -- 172.21.15.2:0/1863715437 learned_addr learned my addr 172.21.15.2:0/1863715437 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.103+0000 7f2a70a00700 1 --2- 172.21.15.2:0/1863715437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085e1300 0x5556085e0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.103+0000 7f2a6b400700 1 --2- 172.21.15.2:0/1863715437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556085d65b0 0x5556085e26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.103+0000 7f2a6be00700 1 -- 172.21.15.2:0/1863715437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556085d65b0 msgr2=0x5556085e26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.103+0000 7f2a6be00700 1 --2- 172.21.15.2:0/1863715437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556085d65b0 0x5556085e26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.103+0000 7f2a6be00700 1 -- 172.21.15.2:0/1863715437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085e1300 msgr2=0x5556085e0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.103+0000 7f2a6be00700 1 --2- 172.21.15.2:0/1863715437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085e1300 0x5556085e0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.103+0000 7f2a6be00700 1 -- 172.21.15.2:0/1863715437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556085d9950 con 0x555608552e40 2024-06-13T11:33:35.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.104+0000 7f2a6be00700 1 --2- 172.21.15.2:0/1863715437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555608552e40 0x5556085dcd10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c09aad0 tx=0x7f2a5c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b06b1e85cfb1cbc server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:35.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.104+0000 7f2a60c00700 1 -- 172.21.15.2:0/1863715437 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0b5040 con 0x555608552e40 2024-06-13T11:33:35.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.104+0000 7f2a60c00700 1 -- 172.21.15.2:0/1863715437 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a5c0d0070 con 0x555608552e40 2024-06-13T11:33:35.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.104+0000 7f2a60c00700 1 -- 172.21.15.2:0/1863715437 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0bb170 con 0x555608552e40 2024-06-13T11:33:35.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.104+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/1863715437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555608552e40 msgr2=0x5556085dcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:35.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.104+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/1863715437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555608552e40 0x5556085dcd10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c09aad0 tx=0x7f2a5c009ca0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.105+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/1863715437 shutdown_connections 2024-06-13T11:33:35.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.105+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/1863715437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x555608552e40 0x5556085dcd10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.105+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/1863715437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085e1300 0x5556085e0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.105+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/1863715437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556085d65b0 0x5556085e26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.105+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/1863715437 >> 172.21.15.2:0/1863715437 conn(0x555608503170 msgr2=0x5556085dc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:35.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.105+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/1863715437 shutdown_connections 2024-06-13T11:33:35.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.105+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/1863715437 wait complete. 2024-06-13T11:33:35.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.105+0000 7f2a7d2c2b80 1 -- start start 2024-06-13T11:33:35.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.105+0000 7f2a7d2c2b80 1 Processor -- start 2024-06-13T11:33:35.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.106+0000 7f2a7d2c2b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555608552e40 0x5556085da0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.106+0000 7f2a7d2c2b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085d65b0 0x5556085da5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.106+0000 7f2a7d2c2b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556085e1300 0x5556085dab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.106+0000 7f2a7d2c2b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c1aebd0 con 0x5556085e1300 2024-06-13T11:33:35.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.106+0000 7f2a7d2c2b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c1b0040 con 0x5556085d65b0 2024-06-13T11:33:35.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.106+0000 7f2a7d2c2b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c1af2a0 con 0x555608552e40 2024-06-13T11:33:35.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.106+0000 7f2a7d2c2b80 10 client.0 _ll_register_callbacks cb 0x5556084c2720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:33:35.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.106+0000 7f2a70a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556085e1300 0x5556085dab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.106+0000 7f2a6be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555608552e40 0x5556085da0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.106+0000 7f2a6b400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085d65b0 0x5556085da5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.106+0000 7f2a6be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555608552e40 0x5556085da0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:38828/0 (socket says 172.21.15.2:38828) 2024-06-13T11:33:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.106+0000 7f2a6be00700 1 -- 172.21.15.2:0/1451199958 learned_addr learned my addr 172.21.15.2:0/1451199958 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.106+0000 7f2a6b400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085d65b0 0x5556085da5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:35280/0 (socket says 172.21.15.2:35280) 2024-06-13T11:33:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.107+0000 7f2a6be00700 1 -- 172.21.15.2:0/1451199958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085d65b0 msgr2=0x5556085da5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:35.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.107+0000 7f2a6be00700 1 --2- 172.21.15.2:0/1451199958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085d65b0 0x5556085da5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.107+0000 7f2a6be00700 1 -- 172.21.15.2:0/1451199958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556085e1300 msgr2=0x5556085dab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.107+0000 7f2a6be00700 1 --2- 172.21.15.2:0/1451199958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556085e1300 0x5556085dab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.107+0000 7f2a6be00700 1 -- 172.21.15.2:0/1451199958 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556085e8460 con 0x555608552e40 2024-06-13T11:33:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.107+0000 7f2a6be00700 1 --2- 172.21.15.2:0/1451199958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555608552e40 0x5556085da0a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009750 tx=0x7f2a5c0a3040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec4cc08f94be667 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.107+0000 7f2a56000700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:33:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.107+0000 7f2a56000700 1 -- 172.21.15.2:0/1451199958 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0b5040 con 0x555608552e40 2024-06-13T11:33:35.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.107+0000 7f2a56000700 1 -- 172.21.15.2:0/1451199958 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f2a5c0a4f70 con 0x555608552e40 2024-06-13T11:33:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.107+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/1451199958 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a5c0d0070 con 0x555608552e40 2024-06-13T11:33:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.108+0000 7f2a56000700 1 -- 172.21.15.2:0/1451199958 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2a5c0a0c20 con 0x555608552e40 2024-06-13T11:33:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.108+0000 7f2a7d2c2b80 10 client.26479 fetch_fsmap learned FSMap version 31 2024-06-13T11:33:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.108+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/1451199958 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5556085e8460 con 0x555608552e40 2024-06-13T11:33:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.108+0000 7f2a56000700 1 -- 172.21.15.2:0/1451199958 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a5c0d0070 con 0x555608552e40 2024-06-13T11:33:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.108+0000 7f2a56000700 1 -- 172.21.15.2:0/1451199958 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f2a5c09db50 con 0x555608552e40 2024-06-13T11:33:35.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.108+0000 7f2a7d2c2b80 10 client.26479 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:33:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.108+0000 7f2a7d2c2b80 10 client.26479 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:33:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.108+0000 7f2a7d2c2b80 20 client.26479 populate_metadata read hostname 'smithi002' 2024-06-13T11:33:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.108+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/1451199958 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5556085e9940 0x55560865d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.108+0000 7f2a7d2c2b80 4 client.26479 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:33:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.108+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/1451199958 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555608530580 con 0x5556085e9940 2024-06-13T11:33:35.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.109+0000 7f2a6b400700 1 --2- 172.21.15.2:0/1451199958 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5556085e9940 0x55560865d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:35.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.109+0000 7f2a6b400700 1 --2- 172.21.15.2:0/1451199958 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5556085e9940 0x55560865d990 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ef3d020cdfb3064b server_cookie=35d409068fe9a9e4 in_seq=0 out_seq=0 2024-06-13T11:33:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.109+0000 7f2a56000700 10 client.26479 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:33:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.109+0000 7f2a56000700 1 -- 172.21.15.2:0/1451199958 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555608530580 con 0x5556085e9940 2024-06-13T11:33:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.109+0000 7f2a56000700 10 client.26479 handle_command_reply: tid=0 2024-06-13T11:33:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.109+0000 7f2a7d2c2b80 1 client.26479 shutdown 2024-06-13T11:33:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.110+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/1451199958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555608552e40 msgr2=0x5556085da0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.110+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/1451199958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555608552e40 0x5556085da0a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009750 tx=0x7f2a5c0a3040 comp rx=0 tx=0).stop 2024-06-13T11:33:35.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.110+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/1451199958 shutdown_connections 2024-06-13T11:33:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.110+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/1451199958 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5556085e9940 0x55560865d990 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.110+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/1451199958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5556085e1300 0x5556085dab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.110+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/1451199958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555608552e40 0x5556085da0a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.110+0000 7f2a7d2c2b80 1 --2- 172.21.15.2:0/1451199958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5556085d65b0 0x5556085da5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.110+0000 7f2a56000700 0 client.26479 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:33:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.110+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/1451199958 >> 172.21.15.2:0/1451199958 conn(0x555608503170 msgr2=0x5556085d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:35.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.110+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/1451199958 shutdown_connections 2024-06-13T11:33:35.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.110+0000 7f2a7d2c2b80 1 -- 172.21.15.2:0/1451199958 wait complete. 2024-06-13T11:33:35.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.110+0000 7f2a7d2c2b80 20 client.26479 trim_cache size 0 max 16384 2024-06-13T11:33:35.118 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:33:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.111+0000 7f2a72a00700 1 -- 172.21.15.2:0/2924581593 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2a500a2d90 msgr2=0x7f2a500a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.111+0000 7f2a72a00700 1 --2- 172.21.15.2:0/2924581593 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2a500a2d90 0x7f2a500a5250 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c079b60 tx=0x7f2a58009260 comp rx=0 tx=0).stop 2024-06-13T11:33:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.111+0000 7f2a72a00700 1 -- 172.21.15.2:0/2924581593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a6c102540 msgr2=0x7f2a6c074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.111+0000 7f2a72a00700 1 --2- 172.21.15.2:0/2924581593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a6c102540 0x7f2a6c074790 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0098e0 tx=0x7f2a5c00b7e0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.111+0000 7f2a72a00700 1 -- 172.21.15.2:0/2924581593 shutdown_connections 2024-06-13T11:33:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.111+0000 7f2a72a00700 1 --2- 172.21.15.2:0/2924581593 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2a500a2d90 0x7f2a500a5250 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.111+0000 7f2a72a00700 1 --2- 172.21.15.2:0/2924581593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c107450 0x7f2a6c075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.111+0000 7f2a72a00700 1 --2- 172.21.15.2:0/2924581593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a6c102540 0x7f2a6c074790 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.111+0000 7f2a72a00700 1 --2- 172.21.15.2:0/2924581593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a6c102ee0 0x7f2a6c074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.111+0000 7f2a72a00700 1 -- 172.21.15.2:0/2924581593 >> 172.21.15.2:0/2924581593 conn(0x7f2a6c0795f0 msgr2=0x7f2a6c1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.111+0000 7f2a72a00700 1 -- 172.21.15.2:0/2924581593 shutdown_connections 2024-06-13T11:33:35.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:35.111+0000 7f2a72a00700 1 -- 172.21.15.2:0/2924581593 wait complete. 2024-06-13T11:33:35.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:35 smithi178 ceph-mon[36913]: pgmap v303: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:36.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:35 smithi077 ceph-mon[36410]: pgmap v303: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:36.128 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:35 smithi002 ceph-mon[32210]: pgmap v303: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:36.192 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-13T11:33:36.684 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:33:37.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:37 smithi178 ceph-mon[36913]: pgmap v304: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:38.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:37 smithi077 ceph-mon[36410]: pgmap v304: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:38.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:37 smithi002 ceph-mon[32210]: pgmap v304: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:39.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.093+0000 7f4d39e00700 1 -- 172.21.15.2:0/3264387475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d34109450 msgr2=0x7f4d34115960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:39.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.093+0000 7f4d39e00700 1 --2- 172.21.15.2:0/3264387475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d34109450 0x7f4d34115960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00b0a0 tx=0x7f4d2c00b3b0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.094+0000 7f4d39e00700 1 -- 172.21.15.2:0/3264387475 shutdown_connections 2024-06-13T11:33:39.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.094+0000 7f4d39e00700 1 --2- 172.21.15.2:0/3264387475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d34109450 0x7f4d34115960 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.094+0000 7f4d39e00700 1 --2- 172.21.15.2:0/3264387475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d3410ea90 0x7f4d3410ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.094+0000 7f4d39e00700 1 --2- 172.21.15.2:0/3264387475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d34108a90 0x7f4d34108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.094+0000 7f4d39e00700 1 -- 172.21.15.2:0/3264387475 >> 172.21.15.2:0/3264387475 conn(0x7f4d34075ca0 msgr2=0x7f4d341072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.094+0000 7f4d39e00700 1 -- 172.21.15.2:0/3264387475 shutdown_connections 2024-06-13T11:33:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.094+0000 7f4d39e00700 1 -- 172.21.15.2:0/3264387475 wait complete. 2024-06-13T11:33:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.095+0000 7f4d39e00700 1 Processor -- start 2024-06-13T11:33:39.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.095+0000 7f4d39e00700 1 -- start start 2024-06-13T11:33:39.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.095+0000 7f4d39e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d34108a90 0x7f4d3419f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.095+0000 7f4d39e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d34109450 0x7f4d3419f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.095+0000 7f4d39e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d3410ea90 0x7f4d341a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.095+0000 7f4d39e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34118e70 con 0x7f4d34108a90 2024-06-13T11:33:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.095+0000 7f4d39e00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34118cf0 con 0x7f4d3410ea90 2024-06-13T11:33:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.095+0000 7f4d39e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34118ff0 con 0x7f4d34109450 2024-06-13T11:33:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.096+0000 7f4d33400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d3410ea90 0x7f4d341a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.096+0000 7f4d32a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d34108a90 0x7f4d3419f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.096+0000 7f4d33400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d3410ea90 0x7f4d341a3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:39300/0 (socket says 172.21.15.2:39300) 2024-06-13T11:33:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.096+0000 7f4d33400700 1 -- 172.21.15.2:0/559962281 learned_addr learned my addr 172.21.15.2:0/559962281 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.096+0000 7f4d32000700 1 --2- 172.21.15.2:0/559962281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d34109450 0x7f4d3419f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.096+0000 7f4d33400700 1 -- 172.21.15.2:0/559962281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d34109450 msgr2=0x7f4d3419f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.096+0000 7f4d33400700 1 --2- 172.21.15.2:0/559962281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d34109450 0x7f4d3419f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.096+0000 7f4d33400700 1 -- 172.21.15.2:0/559962281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d34108a90 msgr2=0x7f4d3419f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.096+0000 7f4d33400700 1 --2- 172.21.15.2:0/559962281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d34108a90 0x7f4d3419f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.096+0000 7f4d33400700 1 -- 172.21.15.2:0/559962281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d341a41c0 con 0x7f4d3410ea90 2024-06-13T11:33:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.097+0000 7f4d33400700 1 --2- 172.21.15.2:0/559962281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d3410ea90 0x7f4d341a3a80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00b070 tx=0x7f4d2c004c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.097+0000 7f4d38a00700 1 -- 172.21.15.2:0/559962281 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c021070 con 0x7f4d3410ea90 2024-06-13T11:33:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.097+0000 7f4d38a00700 1 -- 172.21.15.2:0/559962281 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d2c003c00 con 0x7f4d3410ea90 2024-06-13T11:33:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.097+0000 7f4d38a00700 1 -- 172.21.15.2:0/559962281 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c004740 con 0x7f4d3410ea90 2024-06-13T11:33:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.097+0000 7f4d39e00700 1 -- 172.21.15.2:0/559962281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d341a4450 con 0x7f4d3410ea90 2024-06-13T11:33:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.097+0000 7f4d39e00700 1 -- 172.21.15.2:0/559962281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d341abd30 con 0x7f4d3410ea90 2024-06-13T11:33:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.101+0000 7f4d38a00700 1 -- 172.21.15.2:0/559962281 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f4d2c007980 con 0x7f4d3410ea90 2024-06-13T11:33:39.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.101+0000 7f4d44719b80 1 Processor -- start 2024-06-13T11:33:39.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.102+0000 7f4d44719b80 1 -- start start 2024-06-13T11:33:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.102+0000 7f4d44719b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b0446ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.102+0000 7f4d44719b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b044704b0 0x557b04469d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.102+0000 7f4d44719b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446a240 0x557b0446a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.102+0000 7f4d44719b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557b04378a10 con 0x557b0446fb90 2024-06-13T11:33:39.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.102+0000 7f4d44719b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557b043bbb00 con 0x557b0446a240 2024-06-13T11:33:39.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.102+0000 7f4d44719b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x557b043768f0 con 0x557b044704b0 2024-06-13T11:33:39.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.102+0000 7f4d38a00700 1 --2- 172.21.15.2:0/559962281 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4d180a2e10 0x7f4d180a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.102+0000 7f4d32000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b0446ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.102+0000 7f4d32000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b0446ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38400/0 (socket says 172.21.15.2:38400) 2024-06-13T11:33:39.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.102+0000 7f4d32000700 1 -- 172.21.15.2:0/2795635248 learned_addr learned my addr 172.21.15.2:0/2795635248 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:39.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.103+0000 7f4d32a00700 1 --2- 172.21.15.2:0/2795635248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b044704b0 0x557b04469d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.103+0000 7f4d38a00700 1 -- 172.21.15.2:0/559962281 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f4d2c00f020 con 0x7f4d3410ea90 2024-06-13T11:33:39.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.103+0000 7f4d32000700 1 --2- 172.21.15.2:0/2795635248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446a240 0x557b0446a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.103+0000 7f4d33400700 1 --2- 172.21.15.2:0/559962281 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4d180a2e10 0x7f4d180a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.103+0000 7f4d32a00700 1 -- 172.21.15.2:0/2795635248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446a240 msgr2=0x557b0446a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:39.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.103+0000 7f4d32a00700 1 --2- 172.21.15.2:0/2795635248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446a240 0x557b0446a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.103+0000 7f4d32a00700 1 -- 172.21.15.2:0/2795635248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 msgr2=0x557b0446ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:39.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.103+0000 7f4d32a00700 1 --2- 172.21.15.2:0/2795635248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b0446ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.103+0000 7f4d32a00700 1 -- 172.21.15.2:0/2795635248 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b04363f90 con 0x557b044704b0 2024-06-13T11:33:39.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.104+0000 7f4d32a00700 1 --2- 172.21.15.2:0/2795635248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b044704b0 0x557b04469d00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009cb0 tx=0x7f4d240058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad5f7640771def2c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:39.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.104+0000 7f4d33400700 1 --2- 172.21.15.2:0/559962281 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4d180a2e10 0x7f4d180a52d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0990e0 tx=0x7f4d2c00b3b0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:39.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.104+0000 7f4d28c00700 1 -- 172.21.15.2:0/2795635248 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24011ce0 con 0x557b044704b0 2024-06-13T11:33:39.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.104+0000 7f4d28c00700 1 -- 172.21.15.2:0/2795635248 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d24004530 con 0x557b044704b0 2024-06-13T11:33:39.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.104+0000 7f4d28c00700 1 -- 172.21.15.2:0/2795635248 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24005280 con 0x557b044704b0 2024-06-13T11:33:39.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.105+0000 7f4d44719b80 1 -- 172.21.15.2:0/2795635248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b044704b0 msgr2=0x557b04469d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:39.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.105+0000 7f4d44719b80 1 --2- 172.21.15.2:0/2795635248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b044704b0 0x557b04469d00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009cb0 tx=0x7f4d240058e0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.105+0000 7f4d44719b80 1 -- 172.21.15.2:0/2795635248 shutdown_connections 2024-06-13T11:33:39.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.105+0000 7f4d44719b80 1 --2- 172.21.15.2:0/2795635248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b0446ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.105+0000 7f4d44719b80 1 --2- 172.21.15.2:0/2795635248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446a240 0x557b0446a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.105+0000 7f4d44719b80 1 --2- 172.21.15.2:0/2795635248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b044704b0 0x557b04469d00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.105+0000 7f4d44719b80 1 -- 172.21.15.2:0/2795635248 >> 172.21.15.2:0/2795635248 conn(0x557b04396170 msgr2=0x557b04464ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:39.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.105+0000 7f4d44719b80 1 -- 172.21.15.2:0/2795635248 shutdown_connections 2024-06-13T11:33:39.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.105+0000 7f4d44719b80 1 -- 172.21.15.2:0/2795635248 wait complete. 2024-06-13T11:33:39.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.105+0000 7f4d44719b80 1 -- start start 2024-06-13T11:33:39.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.106+0000 7f4d44719b80 1 Processor -- start 2024-06-13T11:33:39.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.106+0000 7f4d44719b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b0446a240 0x557b044761f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.106+0000 7f4d44719b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b044734f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.106+0000 7f4d44719b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b044704b0 0x557b04473a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.106+0000 7f4d44719b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557b04357f60 con 0x557b0446fb90 2024-06-13T11:33:39.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.106+0000 7f4d44719b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557b043b7ac0 con 0x557b044704b0 2024-06-13T11:33:39.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.106+0000 7f4d44719b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x557b04476e90 con 0x557b0446a240 2024-06-13T11:33:39.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.106+0000 7f4d44719b80 10 client.0 _ll_register_callbacks cb 0x557b04351380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:33:39.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.107+0000 7f4d32a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b044734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.107+0000 7f4d32a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b044734f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38416/0 (socket says 172.21.15.2:38416) 2024-06-13T11:33:39.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.107+0000 7f4d32a00700 1 -- 172.21.15.2:0/4280306594 learned_addr learned my addr 172.21.15.2:0/4280306594 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:39.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.107+0000 7f4d32000700 1 --2- 172.21.15.2:0/4280306594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b0446a240 0x557b044761f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.107+0000 7f4d32000700 1 --2- 172.21.15.2:0/4280306594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b044704b0 0x557b04473a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.107+0000 7f4d32a00700 1 -- 172.21.15.2:0/4280306594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b0446a240 msgr2=0x557b044761f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:39.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.107+0000 7f4d32a00700 1 --2- 172.21.15.2:0/4280306594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b0446a240 0x557b044761f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.107+0000 7f4d32a00700 1 -- 172.21.15.2:0/4280306594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b044704b0 msgr2=0x557b04473a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:39.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.107+0000 7f4d32a00700 1 --2- 172.21.15.2:0/4280306594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b044704b0 0x557b04473a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.107+0000 7f4d32a00700 1 -- 172.21.15.2:0/4280306594 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b0430a8d0 con 0x557b0446fb90 2024-06-13T11:33:39.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.107+0000 7f4d32000700 1 --2- 172.21.15.2:0/4280306594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b044704b0 0x557b04473a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:33:39.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.107+0000 7f4d32a00700 1 --2- 172.21.15.2:0/4280306594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b044734f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4d24004e00 tx=0x7f4d24005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d89e393598a353 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:39.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.107+0000 7f4d1d600700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:33:39.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.108+0000 7f4d1d600700 1 -- 172.21.15.2:0/4280306594 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24004050 con 0x557b0446fb90 2024-06-13T11:33:39.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.108+0000 7f4d1d600700 1 -- 172.21.15.2:0/4280306594 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f4d240041f0 con 0x557b0446fb90 2024-06-13T11:33:39.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.108+0000 7f4d44719b80 1 -- 172.21.15.2:0/4280306594 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d24004530 con 0x557b0446fb90 2024-06-13T11:33:39.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.108+0000 7f4d1d600700 1 -- 172.21.15.2:0/4280306594 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4d24030050 con 0x557b0446fb90 2024-06-13T11:33:39.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.108+0000 7f4d44719b80 10 client.16353 fetch_fsmap learned FSMap version 31 2024-06-13T11:33:39.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.108+0000 7f4d44719b80 1 -- 172.21.15.2:0/4280306594 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557b044815f0 con 0x557b0446fb90 2024-06-13T11:33:39.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.109+0000 7f4d1d600700 1 -- 172.21.15.2:0/4280306594 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d24004530 con 0x557b0446fb90 2024-06-13T11:33:39.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.109+0000 7f4d1d600700 1 -- 172.21.15.2:0/4280306594 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f4d24018070 con 0x557b0446fb90 2024-06-13T11:33:39.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.109+0000 7f4d44719b80 10 client.16353 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:33:39.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.109+0000 7f4d44719b80 10 client.16353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:33:39.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.109+0000 7f4d44719b80 20 client.16353 populate_metadata read hostname 'smithi002' 2024-06-13T11:33:39.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.109+0000 7f4d44719b80 1 --2- 172.21.15.2:0/4280306594 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x557b04483b10 0x557b04485f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.109+0000 7f4d44719b80 4 client.16353 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:33:39.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.109+0000 7f4d44719b80 1 -- 172.21.15.2:0/4280306594 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b043c9000 con 0x557b04483b10 2024-06-13T11:33:39.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.109+0000 7f4d32000700 1 --2- 172.21.15.2:0/4280306594 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x557b04483b10 0x557b04485f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.110+0000 7f4d32000700 1 --2- 172.21.15.2:0/4280306594 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x557b04483b10 0x557b04485f00 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb6391341e18a415 server_cookie=1c1bbcefd1b3cbdc in_seq=0 out_seq=0 2024-06-13T11:33:39.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.110+0000 7f4d1d600700 10 client.16353 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:33:39.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.111+0000 7f4d1d600700 1 -- 172.21.15.2:0/4280306594 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557b043c9000 con 0x557b04483b10 2024-06-13T11:33:39.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.111+0000 7f4d1d600700 10 client.16353 handle_command_reply: tid=0 2024-06-13T11:33:39.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.111+0000 7f4d44719b80 1 client.16353 shutdown 2024-06-13T11:33:39.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.111+0000 7f4d44719b80 1 -- 172.21.15.2:0/4280306594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 msgr2=0x557b044734f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:39.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.111+0000 7f4d44719b80 1 --2- 172.21.15.2:0/4280306594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b044734f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4d24004e00 tx=0x7f4d24005dd0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.111+0000 7f4d44719b80 1 -- 172.21.15.2:0/4280306594 shutdown_connections 2024-06-13T11:33:39.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.111+0000 7f4d44719b80 1 --2- 172.21.15.2:0/4280306594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b044704b0 0x557b04473a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.111+0000 7f4d44719b80 1 --2- 172.21.15.2:0/4280306594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b0446a240 0x557b044761f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.111+0000 7f4d44719b80 1 --2- 172.21.15.2:0/4280306594 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x557b04483b10 0x557b04485f00 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.111+0000 7f4d44719b80 1 --2- 172.21.15.2:0/4280306594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b044734f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.111+0000 7f4d44719b80 1 -- 172.21.15.2:0/4280306594 >> 172.21.15.2:0/4280306594 conn(0x557b04396170 msgr2=0x557b0445e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:39.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.111+0000 7f4d1d600700 0 client.16353 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:33:39.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.111+0000 7f4d44719b80 1 -- 172.21.15.2:0/4280306594 shutdown_connections 2024-06-13T11:33:39.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.111+0000 7f4d44719b80 1 -- 172.21.15.2:0/4280306594 wait complete. 2024-06-13T11:33:39.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.112+0000 7f4d44719b80 20 client.16353 trim_cache size 0 max 16384 2024-06-13T11:33:39.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.129+0000 7f4d44719b80 1 Processor -- start 2024-06-13T11:33:39.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.129+0000 7f4d44719b80 1 -- start start 2024-06-13T11:33:39.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.129+0000 7f4d44719b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446a240 0x557b04469d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.129+0000 7f4d44719b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b0445f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.129+0000 7f4d44719b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b044704b0 0x557b04471040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.129+0000 7f4d44719b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d341b7380 con 0x557b0446fb90 2024-06-13T11:33:39.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.129+0000 7f4d44719b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d341b4c10 con 0x557b0446a240 2024-06-13T11:33:39.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.129+0000 7f4d44719b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4d341b2a80 con 0x557b044704b0 2024-06-13T11:33:39.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.130+0000 7f4d32a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b0445f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.130+0000 7f4d32000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446a240 0x557b04469d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.130+0000 7f4d32a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b0445f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38422/0 (socket says 172.21.15.2:38422) 2024-06-13T11:33:39.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.130+0000 7f4d32000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446a240 0x557b04469d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:39316/0 (socket says 172.21.15.2:39316) 2024-06-13T11:33:39.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.130+0000 7f4d32a00700 1 -- 172.21.15.2:0/3507057166 learned_addr learned my addr 172.21.15.2:0/3507057166 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:39.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.130+0000 7f4d32000700 1 --2- 172.21.15.2:0/3507057166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b044704b0 0x557b04471040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.130+0000 7f4d32a00700 1 -- 172.21.15.2:0/3507057166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b044704b0 msgr2=0x557b04471040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:39.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.130+0000 7f4d32a00700 1 --2- 172.21.15.2:0/3507057166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b044704b0 0x557b04471040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.130+0000 7f4d32a00700 1 -- 172.21.15.2:0/3507057166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446a240 msgr2=0x557b04469d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:39.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.130+0000 7f4d32a00700 1 --2- 172.21.15.2:0/3507057166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446a240 0x557b04469d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.130+0000 7f4d32a00700 1 -- 172.21.15.2:0/3507057166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b044732c0 con 0x557b0446fb90 2024-06-13T11:33:39.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.131+0000 7f4d32a00700 1 --2- 172.21.15.2:0/3507057166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b0445f130 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4d240098b0 tx=0x7f4d24005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5577003299bb7a9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:39.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.131+0000 7f4d1fe00700 1 -- 172.21.15.2:0/3507057166 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24003680 con 0x557b0446fb90 2024-06-13T11:33:39.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.131+0000 7f4d1fe00700 1 -- 172.21.15.2:0/3507057166 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d24027070 con 0x557b0446fb90 2024-06-13T11:33:39.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.131+0000 7f4d1fe00700 1 -- 172.21.15.2:0/3507057166 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24003e10 con 0x557b0446fb90 2024-06-13T11:33:39.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.132+0000 7f4d44719b80 1 -- 172.21.15.2:0/3507057166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 msgr2=0x557b0445f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:39.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.132+0000 7f4d44719b80 1 --2- 172.21.15.2:0/3507057166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b0445f130 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4d240098b0 tx=0x7f4d24005a00 comp rx=0 tx=0).stop 2024-06-13T11:33:39.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.132+0000 7f4d44719b80 1 -- 172.21.15.2:0/3507057166 shutdown_connections 2024-06-13T11:33:39.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.132+0000 7f4d44719b80 1 --2- 172.21.15.2:0/3507057166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b044704b0 0x557b04471040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.132+0000 7f4d44719b80 1 --2- 172.21.15.2:0/3507057166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446a240 0x557b04469d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.132+0000 7f4d44719b80 1 --2- 172.21.15.2:0/3507057166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446fb90 0x557b0445f130 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.132+0000 7f4d44719b80 1 -- 172.21.15.2:0/3507057166 >> 172.21.15.2:0/3507057166 conn(0x557b04396170 msgr2=0x557b04470930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:39.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.132+0000 7f4d44719b80 1 -- 172.21.15.2:0/3507057166 shutdown_connections 2024-06-13T11:33:39.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.132+0000 7f4d44719b80 1 -- 172.21.15.2:0/3507057166 wait complete. 2024-06-13T11:33:39.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.132+0000 7f4d44719b80 1 -- start start 2024-06-13T11:33:39.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.133+0000 7f4d44719b80 1 Processor -- start 2024-06-13T11:33:39.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.133+0000 7f4d44719b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446a240 0x557b0448bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.133+0000 7f4d44719b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446fb90 0x557b0447c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.133+0000 7f4d44719b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b044704b0 0x557b0447c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.133+0000 7f4d44719b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d341b30d0 con 0x557b0446a240 2024-06-13T11:33:39.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.133+0000 7f4d44719b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d341b4540 con 0x557b0446fb90 2024-06-13T11:33:39.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.133+0000 7f4d44719b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4d341b37a0 con 0x557b044704b0 2024-06-13T11:33:39.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.133+0000 7f4d44719b80 10 client.0 _ll_register_callbacks cb 0x557b04351380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:33:39.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.133+0000 7f4d32000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446a240 0x557b0448bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.134+0000 7f4d32a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446fb90 0x557b0447c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.134+0000 7f4d32000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446a240 0x557b0448bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38430/0 (socket says 172.21.15.2:38430) 2024-06-13T11:33:39.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.134+0000 7f4d32000700 1 -- 172.21.15.2:0/2829588967 learned_addr learned my addr 172.21.15.2:0/2829588967 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:39.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.134+0000 7f4d32000700 1 --2- 172.21.15.2:0/2829588967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b044704b0 0x557b0447c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.134+0000 7f4d32a00700 1 -- 172.21.15.2:0/2829588967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b044704b0 msgr2=0x557b0447c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:39.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.134+0000 7f4d32a00700 1 --2- 172.21.15.2:0/2829588967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b044704b0 0x557b0447c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.134+0000 7f4d32a00700 1 -- 172.21.15.2:0/2829588967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446a240 msgr2=0x557b0448bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:39.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.134+0000 7f4d32a00700 1 --2- 172.21.15.2:0/2829588967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446a240 0x557b0448bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.134+0000 7f4d32a00700 1 -- 172.21.15.2:0/2829588967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b0448a630 con 0x557b0446fb90 2024-06-13T11:33:39.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.134+0000 7f4d32000700 1 --2- 172.21.15.2:0/2829588967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446a240 0x557b0448bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:33:39.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.134+0000 7f4d32a00700 1 --2- 172.21.15.2:0/2829588967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446fb90 0x557b0447c150 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x557b04378b60 tx=0x7f4d24004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65a20794cab8deeb server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:39.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.134+0000 7f4d1d600700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:33:39.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.135+0000 7f4d1d600700 1 -- 172.21.15.2:0/2829588967 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24038070 con 0x557b0446fb90 2024-06-13T11:33:39.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.135+0000 7f4d1d600700 1 -- 172.21.15.2:0/2829588967 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f4d24004e30 con 0x557b0446fb90 2024-06-13T11:33:39.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.135+0000 7f4d44719b80 1 -- 172.21.15.2:0/2829588967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d24027070 con 0x557b0446fb90 2024-06-13T11:33:39.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.135+0000 7f4d1d600700 1 -- 172.21.15.2:0/2829588967 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4d24005050 con 0x557b0446fb90 2024-06-13T11:33:39.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.135+0000 7f4d44719b80 10 client.26462 fetch_fsmap learned FSMap version 31 2024-06-13T11:33:39.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.135+0000 7f4d44719b80 1 -- 172.21.15.2:0/2829588967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557b044ed790 con 0x557b0446fb90 2024-06-13T11:33:39.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.135+0000 7f4d1d600700 1 -- 172.21.15.2:0/2829588967 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d24027070 con 0x557b0446fb90 2024-06-13T11:33:39.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.136+0000 7f4d1d600700 1 -- 172.21.15.2:0/2829588967 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f4d24018030 con 0x557b0446fb90 2024-06-13T11:33:39.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.136+0000 7f4d44719b80 10 client.26462 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:33:39.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.136+0000 7f4d44719b80 10 client.26462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:33:39.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.136+0000 7f4d44719b80 20 client.26462 populate_metadata read hostname 'smithi002' 2024-06-13T11:33:39.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.136+0000 7f4d44719b80 1 --2- 172.21.15.2:0/2829588967 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x557b044edd80 0x557b044f0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:39.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.136+0000 7f4d44719b80 4 client.26462 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:33:39.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.136+0000 7f4d44719b80 1 -- 172.21.15.2:0/2829588967 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557b043c3580 con 0x557b044edd80 2024-06-13T11:33:39.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.136+0000 7f4d32000700 1 --2- 172.21.15.2:0/2829588967 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x557b044edd80 0x557b044f0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:39.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.137+0000 7f4d32000700 1 --2- 172.21.15.2:0/2829588967 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x557b044edd80 0x557b044f0170 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53d176906a3993d8 server_cookie=352804e9d815e377 in_seq=0 out_seq=0 2024-06-13T11:33:39.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.137+0000 7f4d1d600700 10 client.26462 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:33:39.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.137+0000 7f4d1d600700 1 -- 172.21.15.2:0/2829588967 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557b043c3580 con 0x557b044edd80 2024-06-13T11:33:39.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.137+0000 7f4d1d600700 10 client.26462 handle_command_reply: tid=0 2024-06-13T11:33:39.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.137+0000 7f4d44719b80 1 client.26462 shutdown 2024-06-13T11:33:39.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.137+0000 7f4d44719b80 1 -- 172.21.15.2:0/2829588967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446fb90 msgr2=0x557b0447c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:39.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.137+0000 7f4d44719b80 1 --2- 172.21.15.2:0/2829588967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446fb90 0x557b0447c150 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x557b04378b60 tx=0x7f4d24004ad0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.137+0000 7f4d44719b80 1 -- 172.21.15.2:0/2829588967 shutdown_connections 2024-06-13T11:33:39.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.137+0000 7f4d44719b80 1 --2- 172.21.15.2:0/2829588967 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x557b044edd80 0x557b044f0170 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.137+0000 7f4d44719b80 1 --2- 172.21.15.2:0/2829588967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557b0446a240 0x557b0448bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.137+0000 7f4d44719b80 1 --2- 172.21.15.2:0/2829588967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b044704b0 0x557b0447c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.137+0000 7f4d44719b80 1 --2- 172.21.15.2:0/2829588967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557b0446fb90 0x557b0447c150 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.137+0000 7f4d1d600700 0 client.26462 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:33:39.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.137+0000 7f4d44719b80 1 -- 172.21.15.2:0/2829588967 >> 172.21.15.2:0/2829588967 conn(0x557b04396170 msgr2=0x557b04471e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:39.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.137+0000 7f4d44719b80 1 -- 172.21.15.2:0/2829588967 shutdown_connections 2024-06-13T11:33:39.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.137+0000 7f4d44719b80 1 -- 172.21.15.2:0/2829588967 wait complete. 2024-06-13T11:33:39.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.138+0000 7f4d44719b80 20 client.26462 trim_cache size 0 max 16384 2024-06-13T11:33:39.143 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:33:39.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.138+0000 7f4d39e00700 1 -- 172.21.15.2:0/559962281 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4d180a2e10 msgr2=0x7f4d180a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:39.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.138+0000 7f4d39e00700 1 --2- 172.21.15.2:0/559962281 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4d180a2e10 0x7f4d180a52d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0990e0 tx=0x7f4d2c00b3b0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.138+0000 7f4d39e00700 1 -- 172.21.15.2:0/559962281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d3410ea90 msgr2=0x7f4d341a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:39.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.138+0000 7f4d39e00700 1 --2- 172.21.15.2:0/559962281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d3410ea90 0x7f4d341a3a80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00b070 tx=0x7f4d2c004c60 comp rx=0 tx=0).stop 2024-06-13T11:33:39.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.138+0000 7f4d39e00700 1 -- 172.21.15.2:0/559962281 shutdown_connections 2024-06-13T11:33:39.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.138+0000 7f4d39e00700 1 --2- 172.21.15.2:0/559962281 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f4d180a2e10 0x7f4d180a52d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.138+0000 7f4d39e00700 1 --2- 172.21.15.2:0/559962281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d34108a90 0x7f4d3419f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.138+0000 7f4d39e00700 1 --2- 172.21.15.2:0/559962281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d3410ea90 0x7f4d341a3a80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.138+0000 7f4d39e00700 1 --2- 172.21.15.2:0/559962281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d34109450 0x7f4d3419f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:39.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.138+0000 7f4d39e00700 1 -- 172.21.15.2:0/559962281 >> 172.21.15.2:0/559962281 conn(0x7f4d34075ca0 msgr2=0x7f4d340761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:39.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.139+0000 7f4d39e00700 1 -- 172.21.15.2:0/559962281 shutdown_connections 2024-06-13T11:33:39.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:39.139+0000 7f4d39e00700 1 -- 172.21.15.2:0/559962281 wait complete. 2024-06-13T11:33:39.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:39 smithi002 ceph-mon[32210]: pgmap v305: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:33:39.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:39 smithi178 ceph-mon[36913]: pgmap v305: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:33:40.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:39 smithi077 ceph-mon[36410]: pgmap v305: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:33:41.113 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-13T11:33:41.114 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-13T11:33:41.604 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:33:41.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:41 smithi178 ceph-mon[36913]: pgmap v306: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:41.960 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:41 smithi002 ceph-mon[32210]: pgmap v306: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:42.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:41 smithi077 ceph-mon[36410]: pgmap v306: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:43.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:43 smithi002 ceph-mon[32210]: pgmap v307: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:33:43.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:43 smithi178 ceph-mon[36913]: pgmap v307: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:33:44.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:43 smithi077 ceph-mon[36410]: pgmap v307: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:33:44.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.053+0000 7f0b8e000700 1 -- 172.21.15.2:0/1337346634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b88102de0 msgr2=0x7f0b8810b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:44.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.053+0000 7f0b8e000700 1 --2- 172.21.15.2:0/1337346634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b88102de0 0x7f0b8810b240 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009990 tx=0x7f0b74009ca0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.053+0000 7f0b8e000700 1 -- 172.21.15.2:0/1337346634 shutdown_connections 2024-06-13T11:33:44.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.053+0000 7f0b8e000700 1 --2- 172.21.15.2:0/1337346634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b8810b8b0 0x7f0b8810dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.053+0000 7f0b8e000700 1 --2- 172.21.15.2:0/1337346634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b88102430 0x7f0b88102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.053+0000 7f0b8e000700 1 --2- 172.21.15.2:0/1337346634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b88102de0 0x7f0b8810b240 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.053+0000 7f0b8e000700 1 -- 172.21.15.2:0/1337346634 >> 172.21.15.2:0/1337346634 conn(0x7f0b88076130 msgr2=0x7f0b88076540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:44.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.054+0000 7f0b8e000700 1 -- 172.21.15.2:0/1337346634 shutdown_connections 2024-06-13T11:33:44.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.054+0000 7f0b8e000700 1 -- 172.21.15.2:0/1337346634 wait complete. 2024-06-13T11:33:44.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.055+0000 7f0b8e000700 1 Processor -- start 2024-06-13T11:33:44.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.055+0000 7f0b8e000700 1 -- start start 2024-06-13T11:33:44.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.056+0000 7f0b8e000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b88102430 0x7f0b881a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.056+0000 7f0b8e000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b88102de0 0x7f0b881a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.056+0000 7f0b8e000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b8810b8b0 0x7f0b8819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.056+0000 7f0b8e000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0b881126a0 con 0x7f0b8810b8b0 2024-06-13T11:33:44.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.056+0000 7f0b8e000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b88112520 con 0x7f0b88102de0 2024-06-13T11:33:44.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.056+0000 7f0b8e000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0b88112820 con 0x7f0b88102430 2024-06-13T11:33:44.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.056+0000 7f0b8d600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b8810b8b0 0x7f0b8819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.056+0000 7f0b8cc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b88102430 0x7f0b881a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.056+0000 7f0b8cc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b88102430 0x7f0b881a0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:39554/0 (socket says 172.21.15.2:39554) 2024-06-13T11:33:44.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.056+0000 7f0b8cc00700 1 -- 172.21.15.2:0/2154349617 learned_addr learned my addr 172.21.15.2:0/2154349617 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:44.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.056+0000 7f0b87e00700 1 --2- 172.21.15.2:0/2154349617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b88102de0 0x7f0b881a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.057+0000 7f0b8cc00700 1 -- 172.21.15.2:0/2154349617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b88102de0 msgr2=0x7f0b881a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:44.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.057+0000 7f0b8cc00700 1 --2- 172.21.15.2:0/2154349617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b88102de0 0x7f0b881a0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.057+0000 7f0b8cc00700 1 -- 172.21.15.2:0/2154349617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b8810b8b0 msgr2=0x7f0b8819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:44.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.057+0000 7f0b8cc00700 1 --2- 172.21.15.2:0/2154349617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b8810b8b0 0x7f0b8819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.057+0000 7f0b8cc00700 1 -- 172.21.15.2:0/2154349617 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b8819b260 con 0x7f0b88102430 2024-06-13T11:33:44.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.057+0000 7f0b87e00700 1 --2- 172.21.15.2:0/2154349617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b88102de0 0x7f0b881a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:33:44.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.057+0000 7f0b8cc00700 1 --2- 172.21.15.2:0/2154349617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b88102430 0x7f0b881a0940 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00c370 tx=0x7f0b7c00c680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:44.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.058+0000 7f0b85600700 1 -- 172.21.15.2:0/2154349617 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c0092e0 con 0x7f0b88102430 2024-06-13T11:33:44.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.058+0000 7f0b8e000700 1 -- 172.21.15.2:0/2154349617 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b8819b4f0 con 0x7f0b88102430 2024-06-13T11:33:44.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.058+0000 7f0b85600700 1 -- 172.21.15.2:0/2154349617 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b7c00cbe0 con 0x7f0b88102430 2024-06-13T11:33:44.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.058+0000 7f0b85600700 1 -- 172.21.15.2:0/2154349617 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c0047e0 con 0x7f0b88102430 2024-06-13T11:33:44.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.058+0000 7f0b8e000700 1 -- 172.21.15.2:0/2154349617 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b881a7810 con 0x7f0b88102430 2024-06-13T11:33:44.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.061+0000 7f0b85600700 1 -- 172.21.15.2:0/2154349617 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f0b7c01a020 con 0x7f0b88102430 2024-06-13T11:33:44.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.063+0000 7f0b85600700 1 --2- 172.21.15.2:0/2154349617 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0b700a2d90 0x7f0b700a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.063+0000 7f0b99eb3b80 1 Processor -- start 2024-06-13T11:33:44.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.064+0000 7f0b85600700 1 -- 172.21.15.2:0/2154349617 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f0b7c0cf1f0 con 0x7f0b88102430 2024-06-13T11:33:44.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.064+0000 7f0b99eb3b80 1 -- start start 2024-06-13T11:33:44.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.064+0000 7f0b87e00700 1 --2- 172.21.15.2:0/2154349617 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0b700a2d90 0x7f0b700a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.064+0000 7f0b99eb3b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 0x55f7182401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.064+0000 7f0b99eb3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f718240700 0x55f71824b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.064+0000 7f0b99eb3b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f71824b5b0 0x55f71824d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.064+0000 7f0b99eb3b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f71814fa90 con 0x55f71824b5b0 2024-06-13T11:33:44.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.064+0000 7f0b99eb3b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f718192b80 con 0x55f71823fde0 2024-06-13T11:33:44.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.064+0000 7f0b99eb3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f71814d970 con 0x55f718240700 2024-06-13T11:33:44.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.065+0000 7f0b8cc00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 0x55f7182401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.065+0000 7f0b8cc00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 0x55f7182401c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:39348/0 (socket says 172.21.15.2:39348) 2024-06-13T11:33:44.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.065+0000 7f0b8cc00700 1 -- 172.21.15.2:0/1691941230 learned_addr learned my addr 172.21.15.2:0/1691941230 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:44.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.065+0000 7f0b87e00700 1 --2- 172.21.15.2:0/1691941230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f718240700 0x55f71824b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.065+0000 7f0b8d600700 1 --2- 172.21.15.2:0/1691941230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f71824b5b0 0x55f71824d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.065+0000 7f0b8cc00700 1 -- 172.21.15.2:0/1691941230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f718240700 msgr2=0x55f71824b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:44.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.065+0000 7f0b8cc00700 1 --2- 172.21.15.2:0/1691941230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f718240700 0x55f71824b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.065+0000 7f0b8cc00700 1 -- 172.21.15.2:0/1691941230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f71824b5b0 msgr2=0x55f71824d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:44.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.065+0000 7f0b8cc00700 1 --2- 172.21.15.2:0/1691941230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f71824b5b0 0x55f71824d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.065+0000 7f0b8cc00700 1 -- 172.21.15.2:0/1691941230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f71813b010 con 0x55f71823fde0 2024-06-13T11:33:44.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.065+0000 7f0b87e00700 1 --2- 172.21.15.2:0/1691941230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f718240700 0x55f71824b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:33:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.065+0000 7f0b87e00700 1 --2- 172.21.15.2:0/2154349617 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0b700a2d90 0x7f0b700a5250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0b740098e0 tx=0x7f0b74005960 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.065+0000 7f0b8cc00700 1 --2- 172.21.15.2:0/1691941230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 0x55f7182401c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c0a3a30 tx=0x7f0b7c09b140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49ae271cea5c778f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.066+0000 7f0b7a000700 1 -- 172.21.15.2:0/1691941230 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c095e60 con 0x55f71823fde0 2024-06-13T11:33:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.066+0000 7f0b7a000700 1 -- 172.21.15.2:0/1691941230 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b7c09b9f0 con 0x55f71823fde0 2024-06-13T11:33:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.066+0000 7f0b7a000700 1 -- 172.21.15.2:0/1691941230 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c09b550 con 0x55f71823fde0 2024-06-13T11:33:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.066+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/1691941230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 msgr2=0x55f7182401c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.066+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/1691941230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 0x55f7182401c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c0a3a30 tx=0x7f0b7c09b140 comp rx=0 tx=0).stop 2024-06-13T11:33:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.067+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/1691941230 shutdown_connections 2024-06-13T11:33:44.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.067+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/1691941230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f71824b5b0 0x55f71824d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.067+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/1691941230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 0x55f7182401c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.067+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/1691941230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f718240700 0x55f71824b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.067+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/1691941230 >> 172.21.15.2:0/1691941230 conn(0x55f71816d1f0 msgr2=0x55f71823c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:44.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.067+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/1691941230 shutdown_connections 2024-06-13T11:33:44.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.067+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/1691941230 wait complete. 2024-06-13T11:33:44.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.067+0000 7f0b99eb3b80 1 -- start start 2024-06-13T11:33:44.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.068+0000 7f0b99eb3b80 1 Processor -- start 2024-06-13T11:33:44.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.068+0000 7f0b99eb3b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 0x55f71824ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.068+0000 7f0b99eb3b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f718240700 0x55f718248110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.068+0000 7f0b99eb3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 0x55f718248650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.068+0000 7f0b99eb3b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f71812efe0 con 0x55f718240700 2024-06-13T11:33:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.068+0000 7f0b99eb3b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f71818eb40 con 0x55f71823fde0 2024-06-13T11:33:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.068+0000 7f0b99eb3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f71824e040 con 0x55f71824b5b0 2024-06-13T11:33:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.068+0000 7f0b99eb3b80 10 client.0 _ll_register_callbacks cb 0x55f718128400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:33:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.069+0000 7f0b8cc00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 0x55f71824ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.069+0000 7f0b87e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f718240700 0x55f718248110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.069+0000 7f0b8cc00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 0x55f71824ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:39362/0 (socket says 172.21.15.2:39362) 2024-06-13T11:33:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.069+0000 7f0b8cc00700 1 -- 172.21.15.2:0/1922279159 learned_addr learned my addr 172.21.15.2:0/1922279159 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.069+0000 7f0b8d600700 1 --2- 172.21.15.2:0/1922279159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 0x55f718248650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.069+0000 7f0b8cc00700 1 -- 172.21.15.2:0/1922279159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 msgr2=0x55f718248650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.069+0000 7f0b8cc00700 1 --2- 172.21.15.2:0/1922279159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 0x55f718248650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.069+0000 7f0b8cc00700 1 -- 172.21.15.2:0/1922279159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f718240700 msgr2=0x55f718248110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.069+0000 7f0b8cc00700 1 --2- 172.21.15.2:0/1922279159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f718240700 0x55f718248110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.069+0000 7f0b8cc00700 1 -- 172.21.15.2:0/1922279159 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7180e1950 con 0x55f71823fde0 2024-06-13T11:33:44.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.069+0000 7f0b87e00700 1 --2- 172.21.15.2:0/1922279159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f718240700 0x55f718248110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:33:44.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.069+0000 7f0b8cc00700 1 --2- 172.21.15.2:0/1922279159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 0x55f71824ae10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c097750 tx=0x7f0b7c00cfc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14eac15cacced2fe server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:44.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.069+0000 7f0b6ea00700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:33:44.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.070+0000 7f0b6ea00700 1 -- 172.21.15.2:0/1922279159 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c0b8020 con 0x55f71823fde0 2024-06-13T11:33:44.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.070+0000 7f0b6ea00700 1 -- 172.21.15.2:0/1922279159 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f0b7c09b550 con 0x55f71823fde0 2024-06-13T11:33:44.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.070+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/1922279159 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b7c09b9f0 con 0x55f71823fde0 2024-06-13T11:33:44.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.070+0000 7f0b6ea00700 1 -- 172.21.15.2:0/1922279159 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0b7c095e60 con 0x55f71823fde0 2024-06-13T11:33:44.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.070+0000 7f0b99eb3b80 10 client.26474 fetch_fsmap learned FSMap version 31 2024-06-13T11:33:44.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.070+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/1922279159 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f718258830 con 0x55f71823fde0 2024-06-13T11:33:44.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.070+0000 7f0b6ea00700 1 -- 172.21.15.2:0/1922279159 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b7c09b9f0 con 0x55f71823fde0 2024-06-13T11:33:44.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.070+0000 7f0b6ea00700 1 -- 172.21.15.2:0/1922279159 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f0b7c0bb0d0 con 0x55f71823fde0 2024-06-13T11:33:44.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.071+0000 7f0b99eb3b80 10 client.26474 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:33:44.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.071+0000 7f0b99eb3b80 10 client.26474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:33:44.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.071+0000 7f0b99eb3b80 20 client.26474 populate_metadata read hostname 'smithi002' 2024-06-13T11:33:44.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.071+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/1922279159 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55f71825ad00 0x55f71825d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.071+0000 7f0b99eb3b80 4 client.26474 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:33:44.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.071+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/1922279159 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7181a0080 con 0x55f71825ad00 2024-06-13T11:33:44.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.071+0000 7f0b87e00700 1 --2- 172.21.15.2:0/1922279159 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55f71825ad00 0x55f71825d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.072+0000 7f0b87e00700 1 --2- 172.21.15.2:0/1922279159 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55f71825ad00 0x55f71825d0f0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a5faf4ab65c79cc server_cookie=fe6159dad922e15f in_seq=0 out_seq=0 2024-06-13T11:33:44.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.072+0000 7f0b6ea00700 10 client.26474 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:33:44.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.073+0000 7f0b6ea00700 1 -- 172.21.15.2:0/1922279159 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f7181a0080 con 0x55f71825ad00 2024-06-13T11:33:44.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.073+0000 7f0b6ea00700 10 client.26474 handle_command_reply: tid=0 2024-06-13T11:33:44.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.073+0000 7f0b99eb3b80 1 client.26474 shutdown 2024-06-13T11:33:44.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.073+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/1922279159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 msgr2=0x55f71824ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:44.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.073+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/1922279159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 0x55f71824ae10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c097750 tx=0x7f0b7c00cfc0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.073+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/1922279159 shutdown_connections 2024-06-13T11:33:44.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.073+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/1922279159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 0x55f718248650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.073+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/1922279159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 0x55f71824ae10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.073+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/1922279159 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55f71825ad00 0x55f71825d0f0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.073+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/1922279159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f718240700 0x55f718248110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.073+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/1922279159 >> 172.21.15.2:0/1922279159 conn(0x55f71816d1f0 msgr2=0x55f71823bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:44.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.073+0000 7f0b6ea00700 0 client.26474 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:33:44.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.073+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/1922279159 shutdown_connections 2024-06-13T11:33:44.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.073+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/1922279159 wait complete. 2024-06-13T11:33:44.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.074+0000 7f0b99eb3b80 20 client.26474 trim_cache size 0 max 16384 2024-06-13T11:33:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.096+0000 7f0b99eb3b80 1 Processor -- start 2024-06-13T11:33:44.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.097+0000 7f0b99eb3b80 1 -- start start 2024-06-13T11:33:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.097+0000 7f0b99eb3b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f71823fde0 0x55f71823c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.097+0000 7f0b99eb3b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f718240700 0x55f71824a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.097+0000 7f0b99eb3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 0x55f718260120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.097+0000 7f0b99eb3b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0b881b2ef0 con 0x55f71823fde0 2024-06-13T11:33:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.097+0000 7f0b99eb3b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b881b0780 con 0x55f718240700 2024-06-13T11:33:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.097+0000 7f0b99eb3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0b881ae5f0 con 0x55f71824b5b0 2024-06-13T11:33:44.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.098+0000 7f0b8d600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 0x55f718260120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.098+0000 7f0b87e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f718240700 0x55f71824a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.098+0000 7f0b8cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f71823fde0 0x55f71823c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.098+0000 7f0b8d600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 0x55f718260120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:39576/0 (socket says 172.21.15.2:39576) 2024-06-13T11:33:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.098+0000 7f0b8d600700 1 -- 172.21.15.2:0/3761018197 learned_addr learned my addr 172.21.15.2:0/3761018197 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:44.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.098+0000 7f0b87e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f718240700 0x55f71824a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:39376/0 (socket says 172.21.15.2:39376) 2024-06-13T11:33:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.098+0000 7f0b87e00700 1 -- 172.21.15.2:0/3761018197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 msgr2=0x55f718260120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:44.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.098+0000 7f0b87e00700 1 --2- 172.21.15.2:0/3761018197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 0x55f718260120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.098+0000 7f0b87e00700 1 -- 172.21.15.2:0/3761018197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f71823fde0 msgr2=0x55f71823c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:44.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.098+0000 7f0b87e00700 1 --2- 172.21.15.2:0/3761018197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f71823fde0 0x55f71823c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.098+0000 7f0b87e00700 1 -- 172.21.15.2:0/3761018197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f718247ee0 con 0x55f718240700 2024-06-13T11:33:44.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.098+0000 7f0b8d600700 1 --2- 172.21.15.2:0/3761018197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 0x55f718260120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:33:44.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.099+0000 7f0b87e00700 1 --2- 172.21.15.2:0/3761018197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f718240700 0x55f71824a950 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0b74006010 tx=0x7f0b74028000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd1371381a9172f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:44.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.099+0000 7f0b79600700 1 -- 172.21.15.2:0/3761018197 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7403f070 con 0x55f718240700 2024-06-13T11:33:44.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.099+0000 7f0b79600700 1 -- 172.21.15.2:0/3761018197 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b7402b040 con 0x55f718240700 2024-06-13T11:33:44.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.099+0000 7f0b79600700 1 -- 172.21.15.2:0/3761018197 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7402a040 con 0x55f718240700 2024-06-13T11:33:44.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.100+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/3761018197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f718240700 msgr2=0x55f71824a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:44.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.100+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/3761018197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f718240700 0x55f71824a950 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0b74006010 tx=0x7f0b74028000 comp rx=0 tx=0).stop 2024-06-13T11:33:44.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.100+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/3761018197 shutdown_connections 2024-06-13T11:33:44.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.100+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/3761018197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f71823fde0 0x55f71823c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.100+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/3761018197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 0x55f718260120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.100+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/3761018197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f718240700 0x55f71824a950 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.100+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/3761018197 >> 172.21.15.2:0/3761018197 conn(0x55f71816d1f0 msgr2=0x55f71823bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.100+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/3761018197 shutdown_connections 2024-06-13T11:33:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.100+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/3761018197 wait complete. 2024-06-13T11:33:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.100+0000 7f0b99eb3b80 1 -- start start 2024-06-13T11:33:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.101+0000 7f0b99eb3b80 1 Processor -- start 2024-06-13T11:33:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.101+0000 7f0b99eb3b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 0x55f7182c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.101+0000 7f0b99eb3b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f718240700 0x55f7182c2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.101+0000 7f0b99eb3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 0x55f7182c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.101+0000 7f0b99eb3b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0b881aec40 con 0x55f718240700 2024-06-13T11:33:44.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.101+0000 7f0b99eb3b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b881b00b0 con 0x55f71823fde0 2024-06-13T11:33:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.101+0000 7f0b99eb3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0b881af310 con 0x55f71824b5b0 2024-06-13T11:33:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.101+0000 7f0b99eb3b80 10 client.0 _ll_register_callbacks cb 0x55f718128400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:33:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.101+0000 7f0b87e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f718240700 0x55f7182c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.102+0000 7f0b87e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f718240700 0x55f7182c2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38470/0 (socket says 172.21.15.2:38470) 2024-06-13T11:33:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.102+0000 7f0b87e00700 1 -- 172.21.15.2:0/507516313 learned_addr learned my addr 172.21.15.2:0/507516313 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.102+0000 7f0b8cc00700 1 --2- 172.21.15.2:0/507516313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 0x55f7182c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.102+0000 7f0b8d600700 1 --2- 172.21.15.2:0/507516313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 0x55f7182c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.102+0000 7f0b87e00700 1 -- 172.21.15.2:0/507516313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 msgr2=0x55f7182c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.102+0000 7f0b87e00700 1 --2- 172.21.15.2:0/507516313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 0x55f7182c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.102+0000 7f0b87e00700 1 -- 172.21.15.2:0/507516313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 msgr2=0x55f7182c1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.102+0000 7f0b87e00700 1 --2- 172.21.15.2:0/507516313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 0x55f7182c1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.102+0000 7f0b87e00700 1 -- 172.21.15.2:0/507516313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7182c6650 con 0x55f718240700 2024-06-13T11:33:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.102+0000 7f0b87e00700 1 --2- 172.21.15.2:0/507516313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f718240700 0x55f7182c2500 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0b740059d0 tx=0x7f0b7400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746f5d1c24d7fdc5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.102+0000 7f0b6ea00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:33:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.103+0000 7f0b6ea00700 1 -- 172.21.15.2:0/507516313 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74048060 con 0x55f718240700 2024-06-13T11:33:44.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.103+0000 7f0b6ea00700 1 -- 172.21.15.2:0/507516313 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f0b7400f660 con 0x55f718240700 2024-06-13T11:33:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.103+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/507516313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b7402b040 con 0x55f718240700 2024-06-13T11:33:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.103+0000 7f0b6ea00700 1 -- 172.21.15.2:0/507516313 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0b7404f050 con 0x55f718240700 2024-06-13T11:33:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.103+0000 7f0b99eb3b80 10 client.16377 fetch_fsmap learned FSMap version 31 2024-06-13T11:33:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.103+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/507516313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f7182cec00 con 0x55f718240700 2024-06-13T11:33:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.103+0000 7f0b6ea00700 1 -- 172.21.15.2:0/507516313 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b7402b040 con 0x55f718240700 2024-06-13T11:33:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.103+0000 7f0b6ea00700 1 -- 172.21.15.2:0/507516313 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f0b74042070 con 0x55f718240700 2024-06-13T11:33:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.104+0000 7f0b99eb3b80 10 client.16377 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:33:44.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.104+0000 7f0b99eb3b80 10 client.16377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:33:44.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.104+0000 7f0b99eb3b80 20 client.16377 populate_metadata read hostname 'smithi002' 2024-06-13T11:33:44.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.104+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/507516313 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55f7182cf1d0 0x55f7182d15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:44.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.104+0000 7f0b99eb3b80 4 client.16377 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-13T11:33:44.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.104+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/507516313 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f71819a600 con 0x55f7182cf1d0 2024-06-13T11:33:44.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.104+0000 7f0b8cc00700 1 --2- 172.21.15.2:0/507516313 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55f7182cf1d0 0x55f7182d15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:44.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.105+0000 7f0b8cc00700 1 --2- 172.21.15.2:0/507516313 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55f7182cf1d0 0x55f7182d15f0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5e6bd40e78e63b0 server_cookie=78998f6370c52136 in_seq=0 out_seq=0 2024-06-13T11:33:44.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.105+0000 7f0b6ea00700 10 client.16377 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:33:44.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.106+0000 7f0b6ea00700 1 -- 172.21.15.2:0/507516313 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f71819a600 con 0x55f7182cf1d0 2024-06-13T11:33:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.106+0000 7f0b6ea00700 10 client.16377 handle_command_reply: tid=0 2024-06-13T11:33:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.106+0000 7f0b99eb3b80 1 client.16377 shutdown 2024-06-13T11:33:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.106+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/507516313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f718240700 msgr2=0x55f7182c2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.106+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/507516313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f718240700 0x55f7182c2500 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0b740059d0 tx=0x7f0b7400bb90 comp rx=0 tx=0).stop 2024-06-13T11:33:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.106+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/507516313 shutdown_connections 2024-06-13T11:33:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.106+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/507516313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f71824b5b0 0x55f7182c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.106+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/507516313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f71823fde0 0x55f7182c1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.106+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/507516313 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55f7182cf1d0 0x55f7182d15f0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.106+0000 7f0b99eb3b80 1 --2- 172.21.15.2:0/507516313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f718240700 0x55f7182c2500 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.106+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/507516313 >> 172.21.15.2:0/507516313 conn(0x55f71816d1f0 msgr2=0x55f718249940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:44.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.106+0000 7f0b6ea00700 0 client.16377 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:33:44.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.107+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/507516313 shutdown_connections 2024-06-13T11:33:44.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.107+0000 7f0b99eb3b80 1 -- 172.21.15.2:0/507516313 wait complete. 2024-06-13T11:33:44.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.107+0000 7f0b99eb3b80 20 client.16377 trim_cache size 0 max 16384 2024-06-13T11:33:44.112 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:33:44.112 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0, 2024-06-13T11:33:44.112 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_tag": "29410c95-fd27-47bb-90c2-e0d20242e79e", 2024-06-13T11:33:44.112 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": "asynchronous" 2024-06-13T11:33:44.112 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:33:44.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.108+0000 7f0b8e000700 1 -- 172.21.15.2:0/2154349617 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0b700a2d90 msgr2=0x7f0b700a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:44.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.108+0000 7f0b8e000700 1 --2- 172.21.15.2:0/2154349617 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0b700a2d90 0x7f0b700a5250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0b740098e0 tx=0x7f0b74005960 comp rx=0 tx=0).stop 2024-06-13T11:33:44.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.108+0000 7f0b8e000700 1 -- 172.21.15.2:0/2154349617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b88102430 msgr2=0x7f0b881a0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:44.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.108+0000 7f0b8e000700 1 --2- 172.21.15.2:0/2154349617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b88102430 0x7f0b881a0940 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00c370 tx=0x7f0b7c00c680 comp rx=0 tx=0).stop 2024-06-13T11:33:44.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.108+0000 7f0b8e000700 1 -- 172.21.15.2:0/2154349617 shutdown_connections 2024-06-13T11:33:44.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.108+0000 7f0b8e000700 1 --2- 172.21.15.2:0/2154349617 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f0b700a2d90 0x7f0b700a5250 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.108+0000 7f0b8e000700 1 --2- 172.21.15.2:0/2154349617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b8810b8b0 0x7f0b8819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.108+0000 7f0b8e000700 1 --2- 172.21.15.2:0/2154349617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b88102430 0x7f0b881a0940 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.108+0000 7f0b8e000700 1 --2- 172.21.15.2:0/2154349617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b88102de0 0x7f0b881a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:44.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.108+0000 7f0b8e000700 1 -- 172.21.15.2:0/2154349617 >> 172.21.15.2:0/2154349617 conn(0x7f0b88076130 msgr2=0x7f0b8810f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:44.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.108+0000 7f0b8e000700 1 -- 172.21.15.2:0/2154349617 shutdown_connections 2024-06-13T11:33:44.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:44.108+0000 7f0b8e000700 1 -- 172.21.15.2:0/2154349617 wait complete. 2024-06-13T11:33:44.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:44 smithi002 ceph-mon[32210]: scrub queued for path: / 2024-06-13T11:33:44.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:44 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:33:44.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:44 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:33:44.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:44 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:33:44.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:44 smithi002 ceph-mon[32210]: scrub summary: active paths [/] 2024-06-13T11:33:44.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:44 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:33:44.897 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:44 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:33:45.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:44 smithi077 ceph-mon[36410]: scrub queued for path: / 2024-06-13T11:33:45.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:44 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:33:45.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:44 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:33:45.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:44 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:33:45.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:44 smithi077 ceph-mon[36410]: scrub summary: active paths [/] 2024-06-13T11:33:45.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:44 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:33:45.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:44 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:33:45.115 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:33:45.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:44 smithi178 ceph-mon[36913]: scrub queued for path: / 2024-06-13T11:33:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:44 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:33:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:44 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:33:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:44 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:33:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:44 smithi178 ceph-mon[36913]: scrub summary: active paths [/] 2024-06-13T11:33:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:44 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:33:45.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:44 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:33:45.568 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:33:45.958 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:45 smithi002 ceph-mon[32210]: scrub summary: idle+waiting paths [/] 2024-06-13T11:33:45.958 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:45 smithi002 ceph-mon[32210]: pgmap v308: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:46.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:45 smithi077 ceph-mon[36410]: scrub summary: idle+waiting paths [/] 2024-06-13T11:33:46.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:45 smithi077 ceph-mon[36410]: pgmap v308: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:46.098 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:45 smithi178 ceph-mon[36913]: scrub summary: idle+waiting paths [/] 2024-06-13T11:33:46.098 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:45 smithi178 ceph-mon[36913]: pgmap v308: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:47.754 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:47 smithi002 ceph-mon[32210]: pgmap v309: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:48.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:47 smithi077 ceph-mon[36410]: pgmap v309: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:48.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.052+0000 7f0997e00700 1 -- 172.21.15.2:0/3635254679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0998104f80 msgr2=0x7f0998111490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:48.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.052+0000 7f0997e00700 1 --2- 172.21.15.2:0/3635254679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0998104f80 0x7f0998111490 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f09900098f0 tx=0x7f0990009c00 comp rx=0 tx=0).stop 2024-06-13T11:33:48.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.052+0000 7f0997e00700 1 -- 172.21.15.2:0/3635254679 shutdown_connections 2024-06-13T11:33:48.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.052+0000 7f0997e00700 1 --2- 172.21.15.2:0/3635254679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099810a650 0x7f099810aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.052+0000 7f0997e00700 1 --2- 172.21.15.2:0/3635254679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0998104f80 0x7f0998111490 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.052+0000 7f0997e00700 1 --2- 172.21.15.2:0/3635254679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09981045c0 0x7f0998104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.052+0000 7f0997e00700 1 -- 172.21.15.2:0/3635254679 >> 172.21.15.2:0/3635254679 conn(0x7f09981000b0 msgr2=0x7f09981024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:48.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.052+0000 7f0997e00700 1 -- 172.21.15.2:0/3635254679 shutdown_connections 2024-06-13T11:33:48.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.052+0000 7f0997e00700 1 -- 172.21.15.2:0/3635254679 wait complete. 2024-06-13T11:33:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.053+0000 7f0997e00700 1 Processor -- start 2024-06-13T11:33:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.054+0000 7f0997e00700 1 -- start start 2024-06-13T11:33:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.054+0000 7f0997e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09981045c0 0x7f09981a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.054+0000 7f0997e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0998104f80 0x7f09981a0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.054+0000 7f0997e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f099810a650 0x7f099819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.054+0000 7f0997e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0998114960 con 0x7f0998104f80 2024-06-13T11:33:48.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.054+0000 7f0997e00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f09981147e0 con 0x7f09981045c0 2024-06-13T11:33:48.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.054+0000 7f0997e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0998114ae0 con 0x7f099810a650 2024-06-13T11:33:48.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.054+0000 7f098e000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0998104f80 0x7f09981a0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.054+0000 7f0996a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09981045c0 0x7f09981a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.054+0000 7f0996a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09981045c0 0x7f09981a0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:54442/0 (socket says 172.21.15.2:54442) 2024-06-13T11:33:48.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.054+0000 7f0996a00700 1 -- 172.21.15.2:0/3120648422 learned_addr learned my addr 172.21.15.2:0/3120648422 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:48.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.055+0000 7f0997400700 1 --2- 172.21.15.2:0/3120648422 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f099810a650 0x7f099819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.055+0000 7f0996a00700 1 -- 172.21.15.2:0/3120648422 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f099810a650 msgr2=0x7f099819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:48.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.055+0000 7f0996a00700 1 --2- 172.21.15.2:0/3120648422 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f099810a650 0x7f099819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.055+0000 7f0996a00700 1 -- 172.21.15.2:0/3120648422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0998104f80 msgr2=0x7f09981a0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:48.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.055+0000 7f0996a00700 1 --2- 172.21.15.2:0/3120648422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0998104f80 0x7f09981a0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.055+0000 7f0996a00700 1 -- 172.21.15.2:0/3120648422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099819b460 con 0x7f09981045c0 2024-06-13T11:33:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.055+0000 7f0996a00700 1 --2- 172.21.15.2:0/3120648422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09981045c0 0x7f09981a0a60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f098800e3f0 tx=0x7f098800e700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.055+0000 7f099ca00700 1 -- 172.21.15.2:0/3120648422 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09880092d0 con 0x7f09981045c0 2024-06-13T11:33:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.055+0000 7f099ca00700 1 -- 172.21.15.2:0/3120648422 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0988019070 con 0x7f09981045c0 2024-06-13T11:33:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.056+0000 7f0997e00700 1 -- 172.21.15.2:0/3120648422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099819b6f0 con 0x7f09981045c0 2024-06-13T11:33:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.056+0000 7f099ca00700 1 -- 172.21.15.2:0/3120648422 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09880146e0 con 0x7f09981045c0 2024-06-13T11:33:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.056+0000 7f0997e00700 1 -- 172.21.15.2:0/3120648422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09981a79e0 con 0x7f09981045c0 2024-06-13T11:33:48.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.059+0000 7f099ca00700 1 -- 172.21.15.2:0/3120648422 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f0988012050 con 0x7f09981045c0 2024-06-13T11:33:48.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.060+0000 7f09a86f4b80 1 Processor -- start 2024-06-13T11:33:48.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.060+0000 7f099ca00700 1 --2- 172.21.15.2:0/3120648422 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f097c0a2e10 0x7f097c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.061+0000 7f09a86f4b80 1 -- start start 2024-06-13T11:33:48.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.061+0000 7f099ca00700 1 -- 172.21.15.2:0/3120648422 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f09880cf480 con 0x7f09981045c0 2024-06-13T11:33:48.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.061+0000 7f0997400700 1 --2- 172.21.15.2:0/3120648422 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f097c0a2e10 0x7f097c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.061+0000 7f09a86f4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a8d60 0x5645ba0a9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.061+0000 7f09a86f4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a9680 0x5645ba0b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.061+0000 7f09a86f4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645ba0b4530 0x5645ba0b6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.061+0000 7f09a86f4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5645b9fb8a10 con 0x5645ba0b4530 2024-06-13T11:33:48.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.061+0000 7f09a86f4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5645b9ffbb00 con 0x5645ba0a9680 2024-06-13T11:33:48.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.061+0000 7f09a86f4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5645b9fb68f0 con 0x5645ba0a8d60 2024-06-13T11:33:48.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.062+0000 7f098e000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a9680 0x5645ba0b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.062+0000 7f0996a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a8d60 0x5645ba0a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.062+0000 7f0997400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645ba0b4530 0x5645ba0b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.062+0000 7f0996a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a8d60 0x5645ba0a9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:57600/0 (socket says 172.21.15.2:57600) 2024-06-13T11:33:48.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.062+0000 7f0996a00700 1 -- 172.21.15.2:0/1635691046 learned_addr learned my addr 172.21.15.2:0/1635691046 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:48.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.062+0000 7f098e000700 1 --2- 172.21.15.2:0/1635691046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a9680 0x5645ba0b3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:54452/0 (socket says 172.21.15.2:54452) 2024-06-13T11:33:48.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.062+0000 7f0996a00700 1 -- 172.21.15.2:0/1635691046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a9680 msgr2=0x5645ba0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:48.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.062+0000 7f0996a00700 1 --2- 172.21.15.2:0/1635691046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a9680 0x5645ba0b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.062+0000 7f0997400700 1 --2- 172.21.15.2:0/3120648422 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f097c0a2e10 0x7f097c0a52d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0990009fd0 tx=0x7f099000bfd0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:48.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.062+0000 7f0996a00700 1 -- 172.21.15.2:0/1635691046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645ba0b4530 msgr2=0x5645ba0b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:48.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.062+0000 7f0996a00700 1 --2- 172.21.15.2:0/1635691046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645ba0b4530 0x5645ba0b6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.062+0000 7f0996a00700 1 -- 172.21.15.2:0/1635691046 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645b9fa3f90 con 0x5645ba0a8d60 2024-06-13T11:33:48.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.062+0000 7f0996a00700 1 --2- 172.21.15.2:0/1635691046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a8d60 0x5645ba0a9140 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f09880090a0 tx=0x7f098809b3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e898630f36ca09c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:48.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.063+0000 7f098cc00700 1 -- 172.21.15.2:0/1635691046 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098809bc80 con 0x5645ba0a8d60 2024-06-13T11:33:48.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.063+0000 7f098cc00700 1 -- 172.21.15.2:0/1635691046 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f098809b580 con 0x5645ba0a8d60 2024-06-13T11:33:48.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.063+0000 7f098cc00700 1 -- 172.21.15.2:0/1635691046 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098809b7e0 con 0x5645ba0a8d60 2024-06-13T11:33:48.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.063+0000 7f09a86f4b80 1 -- 172.21.15.2:0/1635691046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a8d60 msgr2=0x5645ba0a9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:48.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.063+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/1635691046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a8d60 0x5645ba0a9140 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f09880090a0 tx=0x7f098809b3d0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.064+0000 7f09a86f4b80 1 -- 172.21.15.2:0/1635691046 shutdown_connections 2024-06-13T11:33:48.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.064+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/1635691046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645ba0b4530 0x5645ba0b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.064+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/1635691046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a8d60 0x5645ba0a9140 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.064+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/1635691046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a9680 0x5645ba0b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.064+0000 7f09a86f4b80 1 -- 172.21.15.2:0/1635691046 >> 172.21.15.2:0/1635691046 conn(0x5645b9fd6170 msgr2=0x5645ba0a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:48.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.064+0000 7f09a86f4b80 1 -- 172.21.15.2:0/1635691046 shutdown_connections 2024-06-13T11:33:48.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.064+0000 7f09a86f4b80 1 -- 172.21.15.2:0/1635691046 wait complete. 2024-06-13T11:33:48.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.064+0000 7f09a86f4b80 1 -- start start 2024-06-13T11:33:48.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.064+0000 7f09a86f4b80 1 Processor -- start 2024-06-13T11:33:48.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.065+0000 7f09a86f4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a8d60 0x5645ba0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.065+0000 7f09a86f4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645ba0a9680 0x5645ba0b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.065+0000 7f09a86f4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0b4530 0x5645ba0b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.065+0000 7f09a86f4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5645b9f97f60 con 0x5645ba0a9680 2024-06-13T11:33:48.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.065+0000 7f09a86f4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5645b9ff7ac0 con 0x5645ba0b4530 2024-06-13T11:33:48.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.065+0000 7f09a86f4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5645ba0b6fc0 con 0x5645ba0a8d60 2024-06-13T11:33:48.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.065+0000 7f09a86f4b80 10 client.0 _ll_register_callbacks cb 0x5645b9f91380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:33:48.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.065+0000 7f0996a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a8d60 0x5645ba0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.065+0000 7f098e000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645ba0a9680 0x5645ba0b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.065+0000 7f0996a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a8d60 0x5645ba0b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:57610/0 (socket says 172.21.15.2:57610) 2024-06-13T11:33:48.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.065+0000 7f0996a00700 1 -- 172.21.15.2:0/2723670041 learned_addr learned my addr 172.21.15.2:0/2723670041 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:48.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.066+0000 7f0997400700 1 --2- 172.21.15.2:0/2723670041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0b4530 0x5645ba0b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.066+0000 7f0996a00700 1 -- 172.21.15.2:0/2723670041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0b4530 msgr2=0x5645ba0b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:48.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.066+0000 7f0996a00700 1 --2- 172.21.15.2:0/2723670041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0b4530 0x5645ba0b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.066+0000 7f0996a00700 1 -- 172.21.15.2:0/2723670041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645ba0a9680 msgr2=0x5645ba0b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:48.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.066+0000 7f0996a00700 1 --2- 172.21.15.2:0/2723670041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645ba0a9680 0x5645ba0b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.066+0000 7f0996a00700 1 -- 172.21.15.2:0/2723670041 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645b9f4a8d0 con 0x5645ba0a8d60 2024-06-13T11:33:48.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.066+0000 7f0996a00700 1 --2- 172.21.15.2:0/2723670041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a8d60 0x5645ba0b3da0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f098800ea50 tx=0x7f0988007bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e294d9ba2a74d851 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:48.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.066+0000 7f0985600700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:33:48.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.066+0000 7f0985600700 1 -- 172.21.15.2:0/2723670041 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09880a41f0 con 0x5645ba0a8d60 2024-06-13T11:33:48.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.066+0000 7f0985600700 1 -- 172.21.15.2:0/2723670041 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f098809b7e0 con 0x5645ba0a8d60 2024-06-13T11:33:48.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.066+0000 7f09a86f4b80 1 -- 172.21.15.2:0/2723670041 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f098809b580 con 0x5645ba0a8d60 2024-06-13T11:33:48.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.067+0000 7f0985600700 1 -- 172.21.15.2:0/2723670041 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0988082050 con 0x5645ba0a8d60 2024-06-13T11:33:48.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.067+0000 7f09a86f4b80 10 client.26527 fetch_fsmap learned FSMap version 31 2024-06-13T11:33:48.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.067+0000 7f09a86f4b80 1 -- 172.21.15.2:0/2723670041 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5645ba0c17b0 con 0x5645ba0a8d60 2024-06-13T11:33:48.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.067+0000 7f0985600700 1 -- 172.21.15.2:0/2723670041 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f098809b580 con 0x5645ba0a8d60 2024-06-13T11:33:48.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.068+0000 7f0985600700 1 -- 172.21.15.2:0/2723670041 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f098809a9d0 con 0x5645ba0a8d60 2024-06-13T11:33:48.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.068+0000 7f09a86f4b80 10 client.26527 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:33:48.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.068+0000 7f09a86f4b80 10 client.26527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:33:48.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.068+0000 7f09a86f4b80 20 client.26527 populate_metadata read hostname 'smithi002' 2024-06-13T11:33:48.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.068+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/2723670041 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5645ba0c3c80 0x5645ba0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.068+0000 7f09a86f4b80 4 client.26527 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:33:48.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.068+0000 7f09a86f4b80 1 -- 172.21.15.2:0/2723670041 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645ba009000 con 0x5645ba0c3c80 2024-06-13T11:33:48.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.068+0000 7f098e000700 1 --2- 172.21.15.2:0/2723670041 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5645ba0c3c80 0x5645ba0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.069+0000 7f098e000700 1 --2- 172.21.15.2:0/2723670041 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5645ba0c3c80 0x5645ba0c6070 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3f2fc311b4d630f server_cookie=838d4f64d67bb308 in_seq=0 out_seq=0 2024-06-13T11:33:48.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.069+0000 7f0985600700 10 client.26527 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:33:48.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.069+0000 7f0985600700 1 -- 172.21.15.2:0/2723670041 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5645ba009000 con 0x5645ba0c3c80 2024-06-13T11:33:48.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.069+0000 7f0985600700 10 client.26527 handle_command_reply: tid=0 2024-06-13T11:33:48.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.069+0000 7f09a86f4b80 1 client.26527 shutdown 2024-06-13T11:33:48.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.070+0000 7f09a86f4b80 1 -- 172.21.15.2:0/2723670041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a8d60 msgr2=0x5645ba0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:48.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.070+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/2723670041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a8d60 0x5645ba0b3da0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f098800ea50 tx=0x7f0988007bb0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.070+0000 7f09a86f4b80 1 -- 172.21.15.2:0/2723670041 shutdown_connections 2024-06-13T11:33:48.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.070+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/2723670041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0b4530 0x5645ba0b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.070+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/2723670041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a8d60 0x5645ba0b3da0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.070+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/2723670041 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5645ba0c3c80 0x5645ba0c6070 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.070+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/2723670041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645ba0a9680 0x5645ba0b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.070+0000 7f09a86f4b80 1 -- 172.21.15.2:0/2723670041 >> 172.21.15.2:0/2723670041 conn(0x5645b9fd6170 msgr2=0x5645ba0a4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:48.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.070+0000 7f0985600700 0 client.26527 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:33:48.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.070+0000 7f09a86f4b80 1 -- 172.21.15.2:0/2723670041 shutdown_connections 2024-06-13T11:33:48.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.070+0000 7f09a86f4b80 1 -- 172.21.15.2:0/2723670041 wait complete. 2024-06-13T11:33:48.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.070+0000 7f09a86f4b80 20 client.26527 trim_cache size 0 max 16384 2024-06-13T11:33:48.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.093+0000 7f09a86f4b80 1 Processor -- start 2024-06-13T11:33:48.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.093+0000 7f09a86f4b80 1 -- start start 2024-06-13T11:33:48.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.093+0000 7f09a86f4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645b9fd6170 0x5645ba0c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.094+0000 7f09a86f4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645ba0a8d60 0x5645ba0c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.094+0000 7f09a86f4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a9680 0x5645ba0ae360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.094+0000 7f09a86f4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f09981b2f80 con 0x5645ba0a8d60 2024-06-13T11:33:48.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.094+0000 7f09a86f4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f09981b0810 con 0x5645ba0a9680 2024-06-13T11:33:48.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.094+0000 7f09a86f4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f09981ae680 con 0x5645b9fd6170 2024-06-13T11:33:48.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.094+0000 7f098e000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645ba0a8d60 0x5645ba0c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.094+0000 7f098e000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645ba0a8d60 0x5645ba0c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55566/0 (socket says 172.21.15.2:55566) 2024-06-13T11:33:48.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.094+0000 7f098e000700 1 -- 172.21.15.2:0/701606828 learned_addr learned my addr 172.21.15.2:0/701606828 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:48.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.094+0000 7f0997400700 1 --2- 172.21.15.2:0/701606828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a9680 0x5645ba0ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.094+0000 7f0996a00700 1 --2- 172.21.15.2:0/701606828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645b9fd6170 0x5645ba0c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.094+0000 7f0997400700 1 -- 172.21.15.2:0/701606828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645b9fd6170 msgr2=0x5645ba0c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:48.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.094+0000 7f0997400700 1 --2- 172.21.15.2:0/701606828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645b9fd6170 0x5645ba0c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.094+0000 7f0997400700 1 -- 172.21.15.2:0/701606828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645ba0a8d60 msgr2=0x5645ba0c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:48.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.094+0000 7f0997400700 1 --2- 172.21.15.2:0/701606828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645ba0a8d60 0x5645ba0c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.094+0000 7f0997400700 1 -- 172.21.15.2:0/701606828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645ba0a6520 con 0x5645ba0a9680 2024-06-13T11:33:48.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.095+0000 7f0997400700 1 --2- 172.21.15.2:0/701606828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a9680 0x5645ba0ae360 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f09900098c0 tx=0x7f0990026000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5664f05c202dedcf server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:48.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.095+0000 7f0987e00700 1 -- 172.21.15.2:0/701606828 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0990034070 con 0x5645ba0a9680 2024-06-13T11:33:48.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.095+0000 7f0987e00700 1 -- 172.21.15.2:0/701606828 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09900056a0 con 0x5645ba0a9680 2024-06-13T11:33:48.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.095+0000 7f0987e00700 1 -- 172.21.15.2:0/701606828 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099000b560 con 0x5645ba0a9680 2024-06-13T11:33:48.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.096+0000 7f09a86f4b80 1 -- 172.21.15.2:0/701606828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a9680 msgr2=0x5645ba0ae360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:48.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.096+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/701606828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a9680 0x5645ba0ae360 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f09900098c0 tx=0x7f0990026000 comp rx=0 tx=0).stop 2024-06-13T11:33:48.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.096+0000 7f09a86f4b80 1 -- 172.21.15.2:0/701606828 shutdown_connections 2024-06-13T11:33:48.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.096+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/701606828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a9680 0x5645ba0ae360 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.096+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/701606828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645b9fd6170 0x5645ba0c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.096+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/701606828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645ba0a8d60 0x5645ba0c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.096+0000 7f09a86f4b80 1 -- 172.21.15.2:0/701606828 >> 172.21.15.2:0/701606828 conn(0x5645ba0b0540 msgr2=0x5645ba0b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:48.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.096+0000 7f09a86f4b80 1 -- 172.21.15.2:0/701606828 shutdown_connections 2024-06-13T11:33:48.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.096+0000 7f09a86f4b80 1 -- 172.21.15.2:0/701606828 wait complete. 2024-06-13T11:33:48.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.097+0000 7f09a86f4b80 1 -- start start 2024-06-13T11:33:48.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.097+0000 7f09a86f4b80 1 Processor -- start 2024-06-13T11:33:48.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.097+0000 7f09a86f4b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645b9fd6170 0x5645ba127a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.097+0000 7f09a86f4b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a8d60 0x5645ba127f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.097+0000 7f09a86f4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a9680 0x5645ba1267c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.097+0000 7f09a86f4b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f09981aecd0 con 0x5645b9fd6170 2024-06-13T11:33:48.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.097+0000 7f09a86f4b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f09981b0140 con 0x5645ba0a8d60 2024-06-13T11:33:48.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.097+0000 7f09a86f4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f09981af3a0 con 0x5645ba0a9680 2024-06-13T11:33:48.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.097+0000 7f09a86f4b80 10 client.0 _ll_register_callbacks cb 0x5645b9f91380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:33:48.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.098+0000 7f0996a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645b9fd6170 0x5645ba127a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.098+0000 7f098e000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a8d60 0x5645ba127f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.098+0000 7f0996a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645b9fd6170 0x5645ba127a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55574/0 (socket says 172.21.15.2:55574) 2024-06-13T11:33:48.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.098+0000 7f0996a00700 1 -- 172.21.15.2:0/1747975710 learned_addr learned my addr 172.21.15.2:0/1747975710 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:33:48.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.098+0000 7f0997400700 1 --2- 172.21.15.2:0/1747975710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a9680 0x5645ba1267c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.098+0000 7f098e000700 1 -- 172.21.15.2:0/1747975710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a9680 msgr2=0x5645ba1267c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:48.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.098+0000 7f098e000700 1 --2- 172.21.15.2:0/1747975710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a9680 0x5645ba1267c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.098+0000 7f098e000700 1 -- 172.21.15.2:0/1747975710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645b9fd6170 msgr2=0x5645ba127a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:33:48.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.098+0000 7f098e000700 1 --2- 172.21.15.2:0/1747975710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645b9fd6170 0x5645ba127a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.098+0000 7f098e000700 1 -- 172.21.15.2:0/1747975710 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645ba126ea0 con 0x5645ba0a8d60 2024-06-13T11:33:48.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.098+0000 7f0996a00700 1 --2- 172.21.15.2:0/1747975710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645b9fd6170 0x5645ba127a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:33:48.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.099+0000 7f098e000700 1 --2- 172.21.15.2:0/1747975710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a8d60 0x5645ba127f80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0980009da0 tx=0x7f0980010890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b021db1f3cecf5d1 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:33:48.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.099+0000 7f0985600700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:33:48.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.099+0000 7f0985600700 1 -- 172.21.15.2:0/1747975710 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0980022070 con 0x5645ba0a8d60 2024-06-13T11:33:48.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.099+0000 7f09a86f4b80 1 -- 172.21.15.2:0/1747975710 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09900056a0 con 0x5645ba0a8d60 2024-06-13T11:33:48.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.099+0000 7f0985600700 1 -- 172.21.15.2:0/1747975710 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f0980004460 con 0x5645ba0a8d60 2024-06-13T11:33:48.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.099+0000 7f0985600700 1 -- 172.21.15.2:0/1747975710 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0980003680 con 0x5645ba0a8d60 2024-06-13T11:33:48.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.099+0000 7f09a86f4b80 10 client.26498 fetch_fsmap learned FSMap version 31 2024-06-13T11:33:48.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.099+0000 7f09a86f4b80 1 -- 172.21.15.2:0/1747975710 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5645ba12f480 con 0x5645ba0a8d60 2024-06-13T11:33:48.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.100+0000 7f0985600700 1 -- 172.21.15.2:0/1747975710 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09900056a0 con 0x5645ba0a8d60 2024-06-13T11:33:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.100+0000 7f0985600700 1 -- 172.21.15.2:0/1747975710 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f098001f990 con 0x5645ba0a8d60 2024-06-13T11:33:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.100+0000 7f09a86f4b80 10 client.26498 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:33:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.100+0000 7f09a86f4b80 10 client.26498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:33:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.100+0000 7f09a86f4b80 20 client.26498 populate_metadata read hostname 'smithi002' 2024-06-13T11:33:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.100+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/1747975710 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5645ba0b4530 0x5645ba131ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:33:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.100+0000 7f09a86f4b80 4 client.26498 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:33:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.100+0000 7f09a86f4b80 1 -- 172.21.15.2:0/1747975710 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5645ba003580 con 0x5645ba0b4530 2024-06-13T11:33:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.100+0000 7f0996a00700 1 --2- 172.21.15.2:0/1747975710 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5645ba0b4530 0x5645ba131ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:33:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.101+0000 7f0996a00700 1 --2- 172.21.15.2:0/1747975710 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5645ba0b4530 0x5645ba131ba0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e84f8c05dbbd0b2 server_cookie=5ae0f06060084136 in_seq=0 out_seq=0 2024-06-13T11:33:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.101+0000 7f0985600700 10 client.26498 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:33:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.101+0000 7f0985600700 1 -- 172.21.15.2:0/1747975710 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5645ba003580 con 0x5645ba0b4530 2024-06-13T11:33:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.101+0000 7f0985600700 10 client.26498 handle_command_reply: tid=0 2024-06-13T11:33:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.101+0000 7f09a86f4b80 1 client.26498 shutdown 2024-06-13T11:33:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.101+0000 7f09a86f4b80 1 -- 172.21.15.2:0/1747975710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a8d60 msgr2=0x5645ba127f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.101+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/1747975710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a8d60 0x5645ba127f80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0980009da0 tx=0x7f0980010890 comp rx=0 tx=0).stop 2024-06-13T11:33:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.102+0000 7f09a86f4b80 1 -- 172.21.15.2:0/1747975710 shutdown_connections 2024-06-13T11:33:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.102+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/1747975710 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x5645ba0b4530 0x5645ba131ba0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.102+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/1747975710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5645b9fd6170 0x5645ba127a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.102+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/1747975710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5645ba0a9680 0x5645ba1267c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.102+0000 7f0985600700 0 client.26498 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:33:48.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.102+0000 7f09a86f4b80 1 --2- 172.21.15.2:0/1747975710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5645ba0a8d60 0x5645ba127f80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.102+0000 7f09a86f4b80 1 -- 172.21.15.2:0/1747975710 >> 172.21.15.2:0/1747975710 conn(0x5645ba0b0540 msgr2=0x5645ba0a43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:48.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.102+0000 7f09a86f4b80 1 -- 172.21.15.2:0/1747975710 shutdown_connections 2024-06-13T11:33:48.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.102+0000 7f09a86f4b80 1 -- 172.21.15.2:0/1747975710 wait complete. 2024-06-13T11:33:48.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.102+0000 7f09a86f4b80 20 client.26498 trim_cache size 0 max 16384 2024-06-13T11:33:48.108 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:33:48.108 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-13T11:33:48.108 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": { 2024-06-13T11:33:48.108 INFO:teuthology.orchestra.run.smithi002.stdout: "29410c95-fd27-47bb-90c2-e0d20242e79e": { 2024-06-13T11:33:48.108 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-06-13T11:33:48.108 INFO:teuthology.orchestra.run.smithi002.stdout: "tag": "29410c95-fd27-47bb-90c2-e0d20242e79e", 2024-06-13T11:33:48.108 INFO:teuthology.orchestra.run.smithi002.stdout: "options": "recursive,force" 2024-06-13T11:33:48.108 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:33:48.109 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:33:48.109 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:33:48.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.103+0000 7f0997e00700 1 -- 172.21.15.2:0/3120648422 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f097c0a2e10 msgr2=0x7f097c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:48.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.103+0000 7f0997e00700 1 --2- 172.21.15.2:0/3120648422 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f097c0a2e10 0x7f097c0a52d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0990009fd0 tx=0x7f099000bfd0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.103+0000 7f0997e00700 1 -- 172.21.15.2:0/3120648422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09981045c0 msgr2=0x7f09981a0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:33:48.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.103+0000 7f0997e00700 1 --2- 172.21.15.2:0/3120648422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09981045c0 0x7f09981a0a60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f098800e3f0 tx=0x7f098800e700 comp rx=0 tx=0).stop 2024-06-13T11:33:48.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.103+0000 7f0997e00700 1 -- 172.21.15.2:0/3120648422 shutdown_connections 2024-06-13T11:33:48.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.103+0000 7f0997e00700 1 --2- 172.21.15.2:0/3120648422 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f097c0a2e10 0x7f097c0a52d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.103+0000 7f0997e00700 1 --2- 172.21.15.2:0/3120648422 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f099810a650 0x7f099819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.103+0000 7f0997e00700 1 --2- 172.21.15.2:0/3120648422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09981045c0 0x7f09981a0a60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.103+0000 7f0997e00700 1 --2- 172.21.15.2:0/3120648422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0998104f80 0x7f09981a0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:33:48.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.103+0000 7f0997e00700 1 -- 172.21.15.2:0/3120648422 >> 172.21.15.2:0/3120648422 conn(0x7f09981000b0 msgr2=0x7f0998101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:33:48.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.103+0000 7f0997e00700 1 -- 172.21.15.2:0/3120648422 shutdown_connections 2024-06-13T11:33:48.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:33:48.103+0000 7f0997e00700 1 -- 172.21.15.2:0/3120648422 wait complete. 2024-06-13T11:33:48.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:47 smithi178 ceph-mon[36913]: pgmap v309: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:33:49.055 INFO:tasks.cephfs.filesystem:scrub status for tag:29410c95-fd27-47bb-90c2-e0d20242e79e - {'path': '/', 'tag': '29410c95-fd27-47bb-90c2-e0d20242e79e', 'options': 'recursive,force'} 2024-06-13T11:33:50.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:49 smithi077 ceph-mon[36410]: pgmap v310: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:33:50.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:49 smithi002 ceph-mon[32210]: pgmap v310: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:33:50.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:49 smithi178 ceph-mon[36913]: pgmap v310: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:33:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:51 smithi077 ceph-mon[36410]: pgmap v311: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:33:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:51 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:33:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:51 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:33:52.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:51 smithi002 ceph-mon[32210]: pgmap v311: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:33:52.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:51 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:33:52.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:51 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:33:52.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:51 smithi178 ceph-mon[36913]: pgmap v311: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:33:52.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:51 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:33:52.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:51 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:33:53.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:52 smithi077 ceph-mon[36410]: scrub summary: idle 2024-06-13T11:33:53.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:52 smithi002 ceph-mon[32210]: scrub summary: idle 2024-06-13T11:33:53.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:52 smithi178 ceph-mon[36913]: scrub summary: idle 2024-06-13T11:33:54.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:53 smithi077 ceph-mon[36410]: pgmap v312: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:33:54.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:53 smithi002 ceph-mon[32210]: pgmap v312: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:33:54.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:53 smithi178 ceph-mon[36913]: pgmap v312: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:33:56.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:55 smithi077 ceph-mon[36410]: pgmap v313: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:33:56.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:55 smithi002 ceph-mon[32210]: pgmap v313: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:33:56.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:55 smithi178 ceph-mon[36913]: pgmap v313: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:33:58.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:57 smithi077 ceph-mon[36410]: pgmap v314: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:33:58.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:57 smithi002 ceph-mon[32210]: pgmap v314: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:33:58.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:57 smithi178 ceph-mon[36913]: pgmap v314: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T11:34:00.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:33:59 smithi077 ceph-mon[36410]: pgmap v315: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:34:00.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:33:59 smithi002 ceph-mon[32210]: pgmap v315: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:34:00.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:33:59 smithi178 ceph-mon[36913]: pgmap v315: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T11:34:02.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:01 smithi077 ceph-mon[36410]: pgmap v316: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:02.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:01 smithi002 ceph-mon[32210]: pgmap v316: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:02.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:01 smithi178 ceph-mon[36913]: pgmap v316: 129 pgs: 129 active+clean; 83 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:04.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:03 smithi077 ceph-mon[36410]: pgmap v317: 129 pgs: 129 active+clean; 83 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-06-13T11:34:04.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:03 smithi002 ceph-mon[32210]: pgmap v317: 129 pgs: 129 active+clean; 83 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-06-13T11:34:04.190 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-06-13T11:34:04.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:03 smithi178 ceph-mon[36913]: pgmap v317: 129 pgs: 129 active+clean; 83 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-06-13T11:34:04.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.408+0000 7f782a000640 1 -- 172.21.15.2:0/2722863626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7824073d40 msgr2=0x7f7824074120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:04.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.408+0000 7f782a000640 1 --2- 172.21.15.2:0/2722863626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7824073d40 0x7f7824074120 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7814009900 tx=0x7f781402a480 comp rx=0 tx=0).stop 2024-06-13T11:34:04.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.408+0000 7f782a000640 1 -- 172.21.15.2:0/2722863626 shutdown_connections 2024-06-13T11:34:04.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.408+0000 7f782a000640 1 --2- 172.21.15.2:0/2722863626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78241127d0 0x7f7824114bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:04.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.408+0000 7f782a000640 1 --2- 172.21.15.2:0/2722863626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7824074660 0x7f7824112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:04.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.408+0000 7f782a000640 1 --2- 172.21.15.2:0/2722863626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7824073d40 0x7f7824074120 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:04.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.408+0000 7f782a000640 1 -- 172.21.15.2:0/2722863626 >> 172.21.15.2:0/2722863626 conn(0x7f78240fd2b0 msgr2=0x7f78240ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:04.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.408+0000 7f782a000640 1 -- 172.21.15.2:0/2722863626 shutdown_connections 2024-06-13T11:34:04.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.408+0000 7f782a000640 1 -- 172.21.15.2:0/2722863626 wait complete. 2024-06-13T11:34:04.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.409+0000 7f782a000640 1 Processor -- start 2024-06-13T11:34:04.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.409+0000 7f782a000640 1 -- start start 2024-06-13T11:34:04.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.410+0000 7f782a000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7824073d40 0x7f782419e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:04.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.410+0000 7f782a000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7824074660 0x7f782419ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:04.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.410+0000 7f782a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78241127d0 0x7f78241a2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:04.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.410+0000 7f782a000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7824118210 con 0x7f7824073d40 2024-06-13T11:34:04.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.410+0000 7f782a000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7824118090 con 0x7f78241127d0 2024-06-13T11:34:04.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.410+0000 7f782a000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7824118390 con 0x7f7824074660 2024-06-13T11:34:04.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.410+0000 7f7828c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7824073d40 0x7f782419e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:04.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.410+0000 7f7828c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7824073d40 0x7f782419e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49532/0 (socket says 172.21.15.2:49532) 2024-06-13T11:34:04.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.410+0000 7f7828c00640 1 -- 172.21.15.2:0/177782921 learned_addr learned my addr 172.21.15.2:0/177782921 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:04.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.410+0000 7f7823e00640 1 --2- 172.21.15.2:0/177782921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7824074660 0x7f782419ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:04.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.410+0000 7f7829600640 1 --2- 172.21.15.2:0/177782921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78241127d0 0x7f78241a2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:04.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.410+0000 7f7828c00640 1 -- 172.21.15.2:0/177782921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7824074660 msgr2=0x7f782419ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:04.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.410+0000 7f7828c00640 1 --2- 172.21.15.2:0/177782921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7824074660 0x7f782419ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:04.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.410+0000 7f7828c00640 1 -- 172.21.15.2:0/177782921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78241127d0 msgr2=0x7f78241a2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:04.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.410+0000 7f7828c00640 1 --2- 172.21.15.2:0/177782921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78241127d0 0x7f78241a2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:04.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.411+0000 7f7828c00640 1 -- 172.21.15.2:0/177782921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78241a36b0 con 0x7f7824073d40 2024-06-13T11:34:04.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.411+0000 7f7828c00640 1 --2- 172.21.15.2:0/177782921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7824073d40 0x7f782419e710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7814004770 tx=0x7f7814003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:04.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.411+0000 7f7821600640 1 -- 172.21.15.2:0/177782921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781403f070 con 0x7f7824073d40 2024-06-13T11:34:04.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.411+0000 7f782a000640 1 -- 172.21.15.2:0/177782921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78241a3940 con 0x7f7824073d40 2024-06-13T11:34:04.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.411+0000 7f7821600640 1 -- 172.21.15.2:0/177782921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7814031ca0 con 0x7f7824073d40 2024-06-13T11:34:04.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.411+0000 7f782a000640 1 -- 172.21.15.2:0/177782921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78241ab230 con 0x7f7824073d40 2024-06-13T11:34:04.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.412+0000 7f7821600640 1 -- 172.21.15.2:0/177782921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7814049060 con 0x7f7824073d40 2024-06-13T11:34:04.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.413+0000 7f782a000640 1 -- 172.21.15.2:0/177782921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7824068240 con 0x7f7824073d40 2024-06-13T11:34:04.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.415+0000 7f7821600640 1 -- 172.21.15.2:0/177782921 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f7814042070 con 0x7f7824073d40 2024-06-13T11:34:04.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.416+0000 7f7821600640 1 --2- 172.21.15.2:0/177782921 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f78080a2ce0 0x7f78080a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:04.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.417+0000 7f7821600640 1 -- 172.21.15.2:0/177782921 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7f78140efff0 con 0x7f7824073d40 2024-06-13T11:34:04.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.417+0000 7f7823e00640 1 --2- 172.21.15.2:0/177782921 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f78080a2ce0 0x7f78080a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:04.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.418+0000 7f7823e00640 1 --2- 172.21.15.2:0/177782921 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f78080a2ce0 0x7f78080a51a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f78240ff940 tx=0x7f7810005f90 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:04.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.420+0000 7f7821600640 1 -- 172.21.15.2:0/177782921 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f78140bc2a0 con 0x7f7824073d40 2024-06-13T11:34:04.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.646+0000 7f782a000640 1 -- 172.21.15.2:0/177782921 --> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f78240ff0f0 con 0x7f78080a2ce0 2024-06-13T11:34:04.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.660+0000 7f7821600640 1 -- 172.21.15.2:0/177782921 <== mgr.25150 v2:172.21.15.2:6800/606530635 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f78240ff0f0 con 0x7f78080a2ce0 2024-06-13T11:34:04.660 INFO:teuthology.orchestra.run.smithi002.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-06-13T00:00:00", "created": "2024-06-13T11:24:02", "first": "2024-06-13T11:25:00", "last": "2024-06-13T11:34:00", "last_pruned": "2024-06-13T11:34:01", "created_count": 10, "pruned_count": 4, "active": true} 2024-06-13T11:34:04.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.663+0000 7f782a000640 1 -- 172.21.15.2:0/177782921 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f78080a2ce0 msgr2=0x7f78080a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:04.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.663+0000 7f782a000640 1 --2- 172.21.15.2:0/177782921 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f78080a2ce0 0x7f78080a51a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f78240ff940 tx=0x7f7810005f90 comp rx=0 tx=0).stop 2024-06-13T11:34:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.663+0000 7f782a000640 1 -- 172.21.15.2:0/177782921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7824073d40 msgr2=0x7f782419e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.663+0000 7f782a000640 1 --2- 172.21.15.2:0/177782921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7824073d40 0x7f782419e710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7814004770 tx=0x7f7814003c10 comp rx=0 tx=0).stop 2024-06-13T11:34:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.663+0000 7f782a000640 1 -- 172.21.15.2:0/177782921 shutdown_connections 2024-06-13T11:34:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.663+0000 7f782a000640 1 --2- 172.21.15.2:0/177782921 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f78080a2ce0 0x7f78080a51a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.663+0000 7f782a000640 1 --2- 172.21.15.2:0/177782921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7824074660 0x7f782419ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.663+0000 7f782a000640 1 --2- 172.21.15.2:0/177782921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78241127d0 0x7f78241a2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:04.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.663+0000 7f782a000640 1 --2- 172.21.15.2:0/177782921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7824073d40 0x7f782419e710 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:04.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.663+0000 7f782a000640 1 -- 172.21.15.2:0/177782921 >> 172.21.15.2:0/177782921 conn(0x7f78240fd2b0 msgr2=0x7f78240fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:04.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.664+0000 7f782a000640 1 -- 172.21.15.2:0/177782921 shutdown_connections 2024-06-13T11:34:04.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.664+0000 7f782a000640 1 -- 172.21.15.2:0/177782921 wait complete. 2024-06-13T11:34:04.682 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-06-13T11:34:04.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.889+0000 7fb59f000640 1 -- 172.21.15.2:0/2076723223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598103a00 msgr2=0x7fb598103e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:04.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.889+0000 7fb59f000640 1 --2- 172.21.15.2:0/2076723223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598103a00 0x7fb598103e80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb584009930 tx=0x7fb58402a420 comp rx=0 tx=0).stop 2024-06-13T11:34:04.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.889+0000 7fb59f000640 1 -- 172.21.15.2:0/2076723223 shutdown_connections 2024-06-13T11:34:04.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.889+0000 7fb59f000640 1 --2- 172.21.15.2:0/2076723223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5981043c0 0x7fb5981108d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:04.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.889+0000 7fb59f000640 1 --2- 172.21.15.2:0/2076723223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598103a00 0x7fb598103e80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:04.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.889+0000 7fb59f000640 1 --2- 172.21.15.2:0/2076723223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb598109a10 0x7fb598109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:04.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.889+0000 7fb59f000640 1 -- 172.21.15.2:0/2076723223 >> 172.21.15.2:0/2076723223 conn(0x7fb5980ff4b0 msgr2=0x7fb5981018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:04.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.889+0000 7fb59f000640 1 -- 172.21.15.2:0/2076723223 shutdown_connections 2024-06-13T11:34:04.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.889+0000 7fb59f000640 1 -- 172.21.15.2:0/2076723223 wait complete. 2024-06-13T11:34:04.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.890+0000 7fb59f000640 1 Processor -- start 2024-06-13T11:34:04.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.890+0000 7fb59f000640 1 -- start start 2024-06-13T11:34:04.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.891+0000 7fb59f000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb598103a00 0x7fb59819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:04.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.891+0000 7fb59f000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5981043c0 0x7fb59819a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:04.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.891+0000 7fb59f000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598109a10 0x7fb59819ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:04.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.891+0000 7fb59f000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb598113df0 con 0x7fb598109a10 2024-06-13T11:34:04.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.891+0000 7fb59f000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb598113c70 con 0x7fb598103a00 2024-06-13T11:34:04.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.891+0000 7fb59f000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb598113f70 con 0x7fb5981043c0 2024-06-13T11:34:04.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.891+0000 7fb59e600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598109a10 0x7fb59819ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:04.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.891+0000 7fb59e600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598109a10 0x7fb59819ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49544/0 (socket says 172.21.15.2:49544) 2024-06-13T11:34:04.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.891+0000 7fb59e600640 1 -- 172.21.15.2:0/1627807375 learned_addr learned my addr 172.21.15.2:0/1627807375 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:04.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.891+0000 7fb59dc00640 1 --2- 172.21.15.2:0/1627807375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb598103a00 0x7fb59819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:04.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.891+0000 7fb59d200640 1 --2- 172.21.15.2:0/1627807375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5981043c0 0x7fb59819a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:04.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.891+0000 7fb59e600640 1 -- 172.21.15.2:0/1627807375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5981043c0 msgr2=0x7fb59819a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.891+0000 7fb59e600640 1 --2- 172.21.15.2:0/1627807375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5981043c0 0x7fb59819a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.891+0000 7fb59e600640 1 -- 172.21.15.2:0/1627807375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb598103a00 msgr2=0x7fb59819a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.891+0000 7fb59e600640 1 --2- 172.21.15.2:0/1627807375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb598103a00 0x7fb59819a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.891+0000 7fb59e600640 1 -- 172.21.15.2:0/1627807375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59819f340 con 0x7fb598109a10 2024-06-13T11:34:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.892+0000 7fb59e600640 1 --2- 172.21.15.2:0/1627807375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598109a10 0x7fb59819ec10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb59000eb10 tx=0x7fb59000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.892+0000 7fb596000640 1 -- 172.21.15.2:0/1627807375 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590004b20 con 0x7fb598109a10 2024-06-13T11:34:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.892+0000 7fb596000640 1 -- 172.21.15.2:0/1627807375 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb590004cc0 con 0x7fb598109a10 2024-06-13T11:34:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.892+0000 7fb596000640 1 -- 172.21.15.2:0/1627807375 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590010760 con 0x7fb598109a10 2024-06-13T11:34:04.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.892+0000 7fb59f000640 1 -- 172.21.15.2:0/1627807375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb59819f630 con 0x7fb598109a10 2024-06-13T11:34:04.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.892+0000 7fb59f000640 1 -- 172.21.15.2:0/1627807375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5981a6ec0 con 0x7fb598109a10 2024-06-13T11:34:04.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.894+0000 7fb59f000640 1 -- 172.21.15.2:0/1627807375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb598068240 con 0x7fb598109a10 2024-06-13T11:34:04.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.896+0000 7fb596000640 1 -- 172.21.15.2:0/1627807375 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fb590005020 con 0x7fb598109a10 2024-06-13T11:34:04.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.898+0000 7fb596000640 1 --2- 172.21.15.2:0/1627807375 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb5800a2d60 0x7fb5800a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:04.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.898+0000 7fb596000640 1 -- 172.21.15.2:0/1627807375 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9483+0+0 (secure 0 0 0) 0x7fb5900cfda0 con 0x7fb598109a10 2024-06-13T11:34:04.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.898+0000 7fb59dc00640 1 --2- 172.21.15.2:0/1627807375 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb5800a2d60 0x7fb5800a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:04.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.899+0000 7fb59dc00640 1 --2- 172.21.15.2:0/1627807375 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb5800a2d60 0x7fb5800a5220 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009b50 tx=0x7fb58c005f90 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:04.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:04.903+0000 7fb596000640 1 -- 172.21.15.2:0/1627807375 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb59009c5a0 con 0x7fb598109a10 2024-06-13T11:34:05.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:05.137+0000 7fb59f000640 1 -- 172.21.15.2:0/1627807375 --> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fb598061de0 con 0x7fb5800a2d60 2024-06-13T11:34:05.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:05.152+0000 7fb596000640 1 -- 172.21.15.2:0/1627807375 <== mgr.25150 v2:172.21.15.2:6800/606530635 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fb598061de0 con 0x7fb5800a2d60 2024-06-13T11:34:05.151 INFO:teuthology.orchestra.run.smithi002.stdout:/ 1m 6m3h 2024-06-13T11:34:05.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:05.155+0000 7fb59f000640 1 -- 172.21.15.2:0/1627807375 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb5800a2d60 msgr2=0x7fb5800a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:05.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:05.155+0000 7fb59f000640 1 --2- 172.21.15.2:0/1627807375 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb5800a2d60 0x7fb5800a5220 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009b50 tx=0x7fb58c005f90 comp rx=0 tx=0).stop 2024-06-13T11:34:05.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:05.155+0000 7fb59f000640 1 -- 172.21.15.2:0/1627807375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598109a10 msgr2=0x7fb59819ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:05.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:05.155+0000 7fb59f000640 1 --2- 172.21.15.2:0/1627807375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598109a10 0x7fb59819ec10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb59000eb10 tx=0x7fb59000c2d0 comp rx=0 tx=0).stop 2024-06-13T11:34:05.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:05.155+0000 7fb59f000640 1 -- 172.21.15.2:0/1627807375 shutdown_connections 2024-06-13T11:34:05.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:05.155+0000 7fb59f000640 1 --2- 172.21.15.2:0/1627807375 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb5800a2d60 0x7fb5800a5220 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:05.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:05.155+0000 7fb59f000640 1 --2- 172.21.15.2:0/1627807375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5981043c0 0x7fb59819a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:05.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:05.155+0000 7fb59f000640 1 --2- 172.21.15.2:0/1627807375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598109a10 0x7fb59819ec10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:05.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:05.155+0000 7fb59f000640 1 --2- 172.21.15.2:0/1627807375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb598103a00 0x7fb59819a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:05.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:05.155+0000 7fb59f000640 1 -- 172.21.15.2:0/1627807375 >> 172.21.15.2:0/1627807375 conn(0x7fb5980ff4b0 msgr2=0x7fb5980ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:05.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:05.156+0000 7fb59f000640 1 -- 172.21.15.2:0/1627807375 shutdown_connections 2024-06-13T11:34:05.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:05.156+0000 7fb59f000640 1 -- 172.21.15.2:0/1627807375 wait complete. 2024-06-13T11:34:05.176 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-06-13T11:34:05.187 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-06-13T11:34:06.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:05 smithi077 ceph-mon[36410]: pgmap v318: 129 pgs: 129 active+clean; 83 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:34:06.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:05 smithi077 ceph-mon[36410]: from='client.16401 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:34:06.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:05 smithi002 ceph-mon[32210]: pgmap v318: 129 pgs: 129 active+clean; 83 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:34:06.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:05 smithi002 ceph-mon[32210]: from='client.16401 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:34:06.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:05 smithi178 ceph-mon[36913]: pgmap v318: 129 pgs: 129 active+clean; 83 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:34:06.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:05 smithi178 ceph-mon[36913]: from='client.16401 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:34:07.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:06 smithi077 ceph-mon[36410]: from='client.16407 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:34:07.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:06 smithi002 ceph-mon[32210]: from='client.16407 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:34:07.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:06 smithi178 ceph-mon[36913]: from='client.16407 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T11:34:08.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:07 smithi077 ceph-mon[36410]: pgmap v319: 129 pgs: 129 active+clean; 83 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:34:08.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:07 smithi077 ceph-mon[36410]: osdmap e107: 12 total, 12 up, 12 in 2024-06-13T11:34:08.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:07 smithi002 ceph-mon[32210]: pgmap v319: 129 pgs: 129 active+clean; 83 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:34:08.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:07 smithi002 ceph-mon[32210]: osdmap e107: 12 total, 12 up, 12 in 2024-06-13T11:34:08.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:07 smithi178 ceph-mon[36913]: pgmap v319: 129 pgs: 129 active+clean; 83 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:34:08.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:07 smithi178 ceph-mon[36913]: osdmap e107: 12 total, 12 up, 12 in 2024-06-13T11:34:10.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:09 smithi077 ceph-mon[36410]: pgmap v321: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-06-13T11:34:10.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:09 smithi077 ceph-mon[36410]: osdmap e108: 12 total, 12 up, 12 in 2024-06-13T11:34:10.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:09 smithi002 ceph-mon[32210]: pgmap v321: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-06-13T11:34:10.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:09 smithi002 ceph-mon[32210]: osdmap e108: 12 total, 12 up, 12 in 2024-06-13T11:34:10.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:09 smithi178 ceph-mon[36913]: pgmap v321: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-06-13T11:34:10.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:09 smithi178 ceph-mon[36913]: osdmap e108: 12 total, 12 up, 12 in 2024-06-13T11:34:12.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:11 smithi077 ceph-mon[36410]: pgmap v323: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 127 B/s wr, 7 op/s 2024-06-13T11:34:12.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:11 smithi002 ceph-mon[32210]: pgmap v323: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 127 B/s wr, 7 op/s 2024-06-13T11:34:12.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:11 smithi178 ceph-mon[36913]: pgmap v323: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 127 B/s wr, 7 op/s 2024-06-13T11:34:14.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:13 smithi002 ceph-mon[32210]: pgmap v324: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-06-13T11:34:14.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:13 smithi178 ceph-mon[36913]: pgmap v324: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-06-13T11:34:14.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:13 smithi077 ceph-mon[36410]: pgmap v324: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-06-13T11:34:16.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:15 smithi002 ceph-mon[32210]: pgmap v325: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-06-13T11:34:16.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:15 smithi178 ceph-mon[36913]: pgmap v325: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-06-13T11:34:16.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:15 smithi077 ceph-mon[36410]: pgmap v325: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-06-13T11:34:18.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:17 smithi002 ceph-mon[32210]: pgmap v326: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 9 op/s 2024-06-13T11:34:18.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:17 smithi178 ceph-mon[36913]: pgmap v326: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 9 op/s 2024-06-13T11:34:18.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:17 smithi077 ceph-mon[36410]: pgmap v326: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 211 B/s wr, 9 op/s 2024-06-13T11:34:19.056 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-13T11:34:19.535 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:34:19.943 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:19 smithi002 ceph-mon[32210]: pgmap v327: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-06-13T11:34:19.943 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:19 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:34:19.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:19 smithi178 ceph-mon[36913]: pgmap v327: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-06-13T11:34:19.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:19 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:34:20.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:19 smithi077 ceph-mon[36410]: pgmap v327: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-06-13T11:34:20.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:19 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:34:21.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:21.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: pgmap v328: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-06-13T11:34:21.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:21.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:21.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:21.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.657 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.658 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.659 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.659 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.659 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.659 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.659 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.659 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:21 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:21.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: pgmap v328: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-06-13T11:34:21.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:21.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:21.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:21.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.791 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.792 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:21 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:21.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: pgmap v328: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-06-13T11:34:21.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:21.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:21.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:21.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.948 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:21.949 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:21 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:22.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.099+0000 7f9614800700 1 -- 172.21.15.2:0/3204465341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c109480 msgr2=0x7f960c115990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:22.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.099+0000 7f9614800700 1 --2- 172.21.15.2:0/3204465341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c109480 0x7f960c115990 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9608009f90 tx=0x7f960800b330 comp rx=0 tx=0).stop 2024-06-13T11:34:22.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.099+0000 7f9614800700 1 -- 172.21.15.2:0/3204465341 shutdown_connections 2024-06-13T11:34:22.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.099+0000 7f9614800700 1 --2- 172.21.15.2:0/3204465341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c109480 0x7f960c115990 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.099+0000 7f9614800700 1 --2- 172.21.15.2:0/3204465341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c10eac0 0x7f960c10eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.099+0000 7f9614800700 1 --2- 172.21.15.2:0/3204465341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f960c108ac0 0x7f960c108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.099+0000 7f9614800700 1 -- 172.21.15.2:0/3204465341 >> 172.21.15.2:0/3204465341 conn(0x7f960c075c60 msgr2=0x7f960c1072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:22.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.099+0000 7f9614800700 1 -- 172.21.15.2:0/3204465341 shutdown_connections 2024-06-13T11:34:22.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.099+0000 7f9614800700 1 -- 172.21.15.2:0/3204465341 wait complete. 2024-06-13T11:34:22.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.100+0000 7f9614800700 1 Processor -- start 2024-06-13T11:34:22.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.100+0000 7f9614800700 1 -- start start 2024-06-13T11:34:22.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.101+0000 7f9614800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f960c108ac0 0x7f960c19f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.101+0000 7f9614800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c109480 0x7f960c19f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.101+0000 7f9614800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c10eac0 0x7f960c1a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.101+0000 7f9614800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f960c118e50 con 0x7f960c108ac0 2024-06-13T11:34:22.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.101+0000 7f9614800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f960c118cd0 con 0x7f960c10eac0 2024-06-13T11:34:22.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.101+0000 7f9614800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f960c118fd0 con 0x7f960c109480 2024-06-13T11:34:22.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.101+0000 7f9611e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f960c108ac0 0x7f960c19f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.101+0000 7f9611e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f960c108ac0 0x7f960c19f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35448/0 (socket says 172.21.15.2:35448) 2024-06-13T11:34:22.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.101+0000 7f9611e00700 1 -- 172.21.15.2:0/2394534870 learned_addr learned my addr 172.21.15.2:0/2394534870 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:22.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.101+0000 7f9612800700 1 --2- 172.21.15.2:0/2394534870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c10eac0 0x7f960c1a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.101+0000 7f9611400700 1 --2- 172.21.15.2:0/2394534870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c109480 0x7f960c19f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.102+0000 7f9611e00700 1 -- 172.21.15.2:0/2394534870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c109480 msgr2=0x7f960c19f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:22.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.102+0000 7f9611e00700 1 --2- 172.21.15.2:0/2394534870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c109480 0x7f960c19f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.102+0000 7f9611e00700 1 -- 172.21.15.2:0/2394534870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c10eac0 msgr2=0x7f960c1a3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:22.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.102+0000 7f9611e00700 1 --2- 172.21.15.2:0/2394534870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c10eac0 0x7f960c1a3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.102+0000 7f9611e00700 1 -- 172.21.15.2:0/2394534870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960c1a41c0 con 0x7f960c108ac0 2024-06-13T11:34:22.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.102+0000 7f9612800700 1 --2- 172.21.15.2:0/2394534870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c10eac0 0x7f960c1a3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:34:22.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.102+0000 7f9611e00700 1 --2- 172.21.15.2:0/2394534870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f960c108ac0 0x7f960c19f200 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f960000e9c0 tx=0x7f960000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:22.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.102+0000 7f9606a00700 1 -- 172.21.15.2:0/2394534870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960000cbd0 con 0x7f960c108ac0 2024-06-13T11:34:22.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.102+0000 7f9606a00700 1 -- 172.21.15.2:0/2394534870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f960000ee50 con 0x7f960c108ac0 2024-06-13T11:34:22.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.102+0000 7f9606a00700 1 -- 172.21.15.2:0/2394534870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9600005680 con 0x7f960c108ac0 2024-06-13T11:34:22.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.102+0000 7f9614800700 1 -- 172.21.15.2:0/2394534870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f960c1a44b0 con 0x7f960c108ac0 2024-06-13T11:34:22.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.102+0000 7f9614800700 1 -- 172.21.15.2:0/2394534870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f960c1abd30 con 0x7f960c108ac0 2024-06-13T11:34:22.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.106+0000 7f9606a00700 1 -- 172.21.15.2:0/2394534870 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f9600004750 con 0x7f960c108ac0 2024-06-13T11:34:22.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.107+0000 7f9606a00700 1 --2- 172.21.15.2:0/2394534870 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f95f40a2d90 0x7f95f40a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.107+0000 7f9606a00700 1 -- 172.21.15.2:0/2394534870 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7f96000cf9f0 con 0x7f960c108ac0 2024-06-13T11:34:22.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.107+0000 7f961f25bb80 1 Processor -- start 2024-06-13T11:34:22.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.108+0000 7f961f25bb80 1 -- start start 2024-06-13T11:34:22.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.108+0000 7f9611400700 1 --2- 172.21.15.2:0/2394534870 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f95f40a2d90 0x7f95f40a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.108+0000 7f961f25bb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbb23e40 0x563adbba7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.108+0000 7f961f25bb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbba75b0 0x563adbba7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.108+0000 7f961f25bb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbbb2300 0x563adbbb46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.108+0000 7f961f25bb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563adbab6a10 con 0x563adbb23e40 2024-06-13T11:34:22.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.108+0000 7f961f25bb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563adbaf9b00 con 0x563adbbb2300 2024-06-13T11:34:22.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.108+0000 7f961f25bb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563adbab48f0 con 0x563adbba75b0 2024-06-13T11:34:22.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.108+0000 7f9611e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbb23e40 0x563adbba7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.108+0000 7f9611e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbb23e40 0x563adbba7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35456/0 (socket says 172.21.15.2:35456) 2024-06-13T11:34:22.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.108+0000 7f9611e00700 1 -- 172.21.15.2:0/123778699 learned_addr learned my addr 172.21.15.2:0/123778699 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:22.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.109+0000 7f9611400700 1 --2- 172.21.15.2:0/123778699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbba75b0 0x563adbba7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.109+0000 7f9612800700 1 --2- 172.21.15.2:0/123778699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbbb2300 0x563adbbb46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.109+0000 7f9611e00700 1 -- 172.21.15.2:0/123778699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbba75b0 msgr2=0x563adbba7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:22.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.109+0000 7f9611e00700 1 --2- 172.21.15.2:0/123778699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbba75b0 0x563adbba7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.109+0000 7f9611e00700 1 -- 172.21.15.2:0/123778699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbbb2300 msgr2=0x563adbbb46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:22.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.109+0000 7f9611e00700 1 --2- 172.21.15.2:0/123778699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbbb2300 0x563adbbb46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.109+0000 7f9611400700 1 --2- 172.21.15.2:0/2394534870 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f95f40a2d90 0x7f95f40a5250 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f960c077b40 tx=0x7f95fc009310 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.109+0000 7f9611e00700 1 -- 172.21.15.2:0/123778699 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563adbaa1f90 con 0x563adbb23e40 2024-06-13T11:34:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.109+0000 7f9611e00700 1 --2- 172.21.15.2:0/123778699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbb23e40 0x563adbba7070 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9600097fb0 tx=0x7f960009b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f6c8f0f82b1879 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.110+0000 7f95fb400700 1 -- 172.21.15.2:0/123778699 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96000b3020 con 0x563adbb23e40 2024-06-13T11:34:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.110+0000 7f95fb400700 1 -- 172.21.15.2:0/123778699 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f960009ff00 con 0x563adbb23e40 2024-06-13T11:34:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.110+0000 7f95fb400700 1 -- 172.21.15.2:0/123778699 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96000a4330 con 0x563adbb23e40 2024-06-13T11:34:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.110+0000 7f961f25bb80 1 -- 172.21.15.2:0/123778699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbb23e40 msgr2=0x563adbba7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.110+0000 7f961f25bb80 1 --2- 172.21.15.2:0/123778699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbb23e40 0x563adbba7070 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9600097fb0 tx=0x7f960009b7a0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.111+0000 7f961f25bb80 1 -- 172.21.15.2:0/123778699 shutdown_connections 2024-06-13T11:34:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.111+0000 7f961f25bb80 1 --2- 172.21.15.2:0/123778699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbb23e40 0x563adbba7070 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.111+0000 7f961f25bb80 1 --2- 172.21.15.2:0/123778699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbbb2300 0x563adbbb46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.111+0000 7f961f25bb80 1 --2- 172.21.15.2:0/123778699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbba75b0 0x563adbba7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.111+0000 7f961f25bb80 1 -- 172.21.15.2:0/123778699 >> 172.21.15.2:0/123778699 conn(0x563adbad4170 msgr2=0x563adbba34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.111+0000 7f961f25bb80 1 -- 172.21.15.2:0/123778699 shutdown_connections 2024-06-13T11:34:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.111+0000 7f961f25bb80 1 -- 172.21.15.2:0/123778699 wait complete. 2024-06-13T11:34:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.111+0000 7f961f25bb80 1 -- start start 2024-06-13T11:34:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.111+0000 7f961f25bb80 1 Processor -- start 2024-06-13T11:34:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.112+0000 7f961f25bb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbb23e40 0x563adbbb1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.112+0000 7f961f25bb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbba75b0 0x563adbbaee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.112+0000 7f961f25bb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbbb2300 0x563adbbaf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.112+0000 7f961f25bb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563adba95f60 con 0x563adbbb2300 2024-06-13T11:34:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.112+0000 7f961f25bb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563adbaf5ac0 con 0x563adbba75b0 2024-06-13T11:34:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.112+0000 7f961f25bb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563adbbb4fc0 con 0x563adbb23e40 2024-06-13T11:34:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.112+0000 7f961f25bb80 10 client.0 _ll_register_callbacks cb 0x563adba93720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:34:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.112+0000 7f9612800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbbb2300 0x563adbbaf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.112+0000 7f9612800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbbb2300 0x563adbbaf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35472/0 (socket says 172.21.15.2:35472) 2024-06-13T11:34:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.112+0000 7f9612800700 1 -- 172.21.15.2:0/2636178757 learned_addr learned my addr 172.21.15.2:0/2636178757 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.112+0000 7f9611400700 1 --2- 172.21.15.2:0/2636178757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbba75b0 0x563adbbaee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.112+0000 7f9611e00700 1 --2- 172.21.15.2:0/2636178757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbb23e40 0x563adbbb1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.113+0000 7f9612800700 1 -- 172.21.15.2:0/2636178757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbb23e40 msgr2=0x563adbbb1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.113+0000 7f9612800700 1 --2- 172.21.15.2:0/2636178757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbb23e40 0x563adbbb1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.113+0000 7f9612800700 1 -- 172.21.15.2:0/2636178757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbba75b0 msgr2=0x563adbbaee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.113+0000 7f9612800700 1 --2- 172.21.15.2:0/2636178757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbba75b0 0x563adbbaee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.113+0000 7f9612800700 1 -- 172.21.15.2:0/2636178757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563adba488d0 con 0x563adbbb2300 2024-06-13T11:34:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.113+0000 7f9611400700 1 --2- 172.21.15.2:0/2636178757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbba75b0 0x563adbbaee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:34:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.113+0000 7f9612800700 1 --2- 172.21.15.2:0/2636178757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbbb2300 0x563adbbaf370 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f960800bc20 tx=0x7f960800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561d72b6f6382cd4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.113+0000 7f95efe00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:34:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.113+0000 7f95efe00700 1 -- 172.21.15.2:0/2636178757 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9608005450 con 0x563adbbb2300 2024-06-13T11:34:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.114+0000 7f95efe00700 1 -- 172.21.15.2:0/2636178757 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7f96080055f0 con 0x563adbbb2300 2024-06-13T11:34:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.114+0000 7f961f25bb80 1 -- 172.21.15.2:0/2636178757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f960009ff00 con 0x563adbbb2300 2024-06-13T11:34:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.114+0000 7f95efe00700 1 -- 172.21.15.2:0/2636178757 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9608030050 con 0x563adbbb2300 2024-06-13T11:34:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.114+0000 7f961f25bb80 10 client.16419 fetch_fsmap learned FSMap version 31 2024-06-13T11:34:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.114+0000 7f961f25bb80 1 -- 172.21.15.2:0/2636178757 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563adbbbf7c0 con 0x563adbbb2300 2024-06-13T11:34:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.114+0000 7f95efe00700 1 -- 172.21.15.2:0/2636178757 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f960009ff00 con 0x563adbbb2300 2024-06-13T11:34:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.114+0000 7f95efe00700 1 -- 172.21.15.2:0/2636178757 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f9608011070 con 0x563adbbb2300 2024-06-13T11:34:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.114+0000 7f961f25bb80 10 client.16419 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:34:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.115+0000 7f961f25bb80 10 client.16419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:34:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.115+0000 7f961f25bb80 20 client.16419 populate_metadata read hostname 'smithi002' 2024-06-13T11:34:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.115+0000 7f961f25bb80 1 --2- 172.21.15.2:0/2636178757 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x563adbbc1e00 0x563adbbc4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.115+0000 7f961f25bb80 4 client.16419 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:34:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.115+0000 7f961f25bb80 1 -- 172.21.15.2:0/2636178757 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563adbb07000 con 0x563adbbc1e00 2024-06-13T11:34:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.115+0000 7f9611e00700 1 --2- 172.21.15.2:0/2636178757 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x563adbbc1e00 0x563adbbc4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.115+0000 7f9611e00700 1 --2- 172.21.15.2:0/2636178757 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x563adbbc1e00 0x563adbbc4220 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43b0da5f10e29fa server_cookie=f5428e1173f3d345 in_seq=0 out_seq=0 2024-06-13T11:34:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.116+0000 7f95efe00700 10 client.16419 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:34:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.117+0000 7f95efe00700 1 -- 172.21.15.2:0/2636178757 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563adbb07000 con 0x563adbbc1e00 2024-06-13T11:34:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.117+0000 7f95efe00700 10 client.16419 handle_command_reply: tid=0 2024-06-13T11:34:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.117+0000 7f961f25bb80 1 client.16419 shutdown 2024-06-13T11:34:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.117+0000 7f961f25bb80 1 -- 172.21.15.2:0/2636178757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbbb2300 msgr2=0x563adbbaf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.117+0000 7f961f25bb80 1 --2- 172.21.15.2:0/2636178757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbbb2300 0x563adbbaf370 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f960800bc20 tx=0x7f960800bc50 comp rx=0 tx=0).stop 2024-06-13T11:34:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.117+0000 7f961f25bb80 1 -- 172.21.15.2:0/2636178757 shutdown_connections 2024-06-13T11:34:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.117+0000 7f961f25bb80 1 --2- 172.21.15.2:0/2636178757 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x563adbbc1e00 0x563adbbc4220 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.117+0000 7f961f25bb80 1 --2- 172.21.15.2:0/2636178757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbbb2300 0x563adbbaf370 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.117+0000 7f961f25bb80 1 --2- 172.21.15.2:0/2636178757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbb23e40 0x563adbbb1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.117+0000 7f961f25bb80 1 --2- 172.21.15.2:0/2636178757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbba75b0 0x563adbbaee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.117+0000 7f95efe00700 0 client.16419 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:34:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.117+0000 7f961f25bb80 1 -- 172.21.15.2:0/2636178757 >> 172.21.15.2:0/2636178757 conn(0x563adbad4170 msgr2=0x563adbba2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.117+0000 7f961f25bb80 1 -- 172.21.15.2:0/2636178757 shutdown_connections 2024-06-13T11:34:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.117+0000 7f961f25bb80 1 -- 172.21.15.2:0/2636178757 wait complete. 2024-06-13T11:34:22.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.118+0000 7f961f25bb80 20 client.16419 trim_cache size 0 max 16384 2024-06-13T11:34:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.141+0000 7f961f25bb80 1 Processor -- start 2024-06-13T11:34:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.141+0000 7f961f25bb80 1 -- start start 2024-06-13T11:34:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.141+0000 7f961f25bb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbb23e40 0x563adbbb1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.141+0000 7f961f25bb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbba75b0 0x563adbbb36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.141+0000 7f961f25bb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbbb2300 0x563adbbb3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.141+0000 7f961f25bb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f960c1b73c0 con 0x563adbb23e40 2024-06-13T11:34:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.141+0000 7f961f25bb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f960c1b4c50 con 0x563adbba75b0 2024-06-13T11:34:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.141+0000 7f961f25bb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f960c1b2ac0 con 0x563adbbb2300 2024-06-13T11:34:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.141+0000 7f9611e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbb23e40 0x563adbbb1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.142+0000 7f9611400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbba75b0 0x563adbbb36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.142+0000 7f9611400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbba75b0 0x563adbbb36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:33354/0 (socket says 172.21.15.2:33354) 2024-06-13T11:34:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.142+0000 7f9611e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbb23e40 0x563adbbb1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35484/0 (socket says 172.21.15.2:35484) 2024-06-13T11:34:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.142+0000 7f9611400700 1 -- 172.21.15.2:0/2347703086 learned_addr learned my addr 172.21.15.2:0/2347703086 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.142+0000 7f9612800700 1 --2- 172.21.15.2:0/2347703086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbbb2300 0x563adbbb3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.142+0000 7f9611400700 1 -- 172.21.15.2:0/2347703086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbbb2300 msgr2=0x563adbbb3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.142+0000 7f9611400700 1 --2- 172.21.15.2:0/2347703086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbbb2300 0x563adbbb3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.142+0000 7f9611400700 1 -- 172.21.15.2:0/2347703086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbb23e40 msgr2=0x563adbbb1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.142+0000 7f9611400700 1 --2- 172.21.15.2:0/2347703086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbb23e40 0x563adbbb1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.142+0000 7f9611400700 1 -- 172.21.15.2:0/2347703086 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563adbb9ae10 con 0x563adbba75b0 2024-06-13T11:34:22.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.142+0000 7f9611400700 1 --2- 172.21.15.2:0/2347703086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbba75b0 0x563adbbb36f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f95fc004090 tx=0x7f95fc01c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86ac1c9200614de3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:22.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.143+0000 7f95faa00700 1 -- 172.21.15.2:0/2347703086 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc022040 con 0x563adbba75b0 2024-06-13T11:34:22.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.143+0000 7f95faa00700 1 -- 172.21.15.2:0/2347703086 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95fc02b070 con 0x563adbba75b0 2024-06-13T11:34:22.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.143+0000 7f95faa00700 1 -- 172.21.15.2:0/2347703086 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc026690 con 0x563adbba75b0 2024-06-13T11:34:22.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.143+0000 7f961f25bb80 1 -- 172.21.15.2:0/2347703086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbba75b0 msgr2=0x563adbbb36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:22.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.143+0000 7f961f25bb80 1 --2- 172.21.15.2:0/2347703086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbba75b0 0x563adbbb36f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f95fc004090 tx=0x7f95fc01c000 comp rx=0 tx=0).stop 2024-06-13T11:34:22.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.144+0000 7f961f25bb80 1 -- 172.21.15.2:0/2347703086 shutdown_connections 2024-06-13T11:34:22.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.144+0000 7f961f25bb80 1 --2- 172.21.15.2:0/2347703086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbb23e40 0x563adbbb1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.144+0000 7f961f25bb80 1 --2- 172.21.15.2:0/2347703086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbbb2300 0x563adbbb3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.144+0000 7f961f25bb80 1 --2- 172.21.15.2:0/2347703086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbba75b0 0x563adbbb36f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.144+0000 7f961f25bb80 1 -- 172.21.15.2:0/2347703086 >> 172.21.15.2:0/2347703086 conn(0x563adbad4170 msgr2=0x563adbbad720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:22.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.144+0000 7f961f25bb80 1 -- 172.21.15.2:0/2347703086 shutdown_connections 2024-06-13T11:34:22.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.144+0000 7f961f25bb80 1 -- 172.21.15.2:0/2347703086 wait complete. 2024-06-13T11:34:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.144+0000 7f961f25bb80 1 -- start start 2024-06-13T11:34:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.144+0000 7f961f25bb80 1 Processor -- start 2024-06-13T11:34:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.145+0000 7f961f25bb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbb23e40 0x563adbbac950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.145+0000 7f961f25bb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbba75b0 0x563adbbba250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.145+0000 7f961f25bb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbbb2300 0x563adbbba790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.145+0000 7f961f25bb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f960c1b3110 con 0x563adbba75b0 2024-06-13T11:34:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.145+0000 7f961f25bb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f960c1b4580 con 0x563adbbb2300 2024-06-13T11:34:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.145+0000 7f961f25bb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f960c1b37e0 con 0x563adbb23e40 2024-06-13T11:34:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.145+0000 7f961f25bb80 10 client.0 _ll_register_callbacks cb 0x563adba93720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:34:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.145+0000 7f9611e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbb23e40 0x563adbbac950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.145+0000 7f9611400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbba75b0 0x563adbbba250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.145+0000 7f9611e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbb23e40 0x563adbbac950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:55770/0 (socket says 172.21.15.2:55770) 2024-06-13T11:34:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.145+0000 7f9611e00700 1 -- 172.21.15.2:0/3110603941 learned_addr learned my addr 172.21.15.2:0/3110603941 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.145+0000 7f9612800700 1 --2- 172.21.15.2:0/3110603941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbbb2300 0x563adbbba790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.146+0000 7f9611e00700 1 -- 172.21.15.2:0/3110603941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbbb2300 msgr2=0x563adbbba790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.146+0000 7f9611e00700 1 --2- 172.21.15.2:0/3110603941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbbb2300 0x563adbbba790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.146+0000 7f9611e00700 1 -- 172.21.15.2:0/3110603941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbba75b0 msgr2=0x563adbbba250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.146+0000 7f9611e00700 1 --2- 172.21.15.2:0/3110603941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbba75b0 0x563adbbba250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.146+0000 7f9611e00700 1 -- 172.21.15.2:0/3110603941 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563adbbb2130 con 0x563adbb23e40 2024-06-13T11:34:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.146+0000 7f9611e00700 1 --2- 172.21.15.2:0/3110603941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbb23e40 0x563adbbac950 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9600097fb0 tx=0x7f960000e940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2141a6dfb55f4084 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.146+0000 7f95efe00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:34:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.146+0000 7f95efe00700 1 -- 172.21.15.2:0/3110603941 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96000b3040 con 0x563adbb23e40 2024-06-13T11:34:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.146+0000 7f961f25bb80 1 -- 172.21.15.2:0/3110603941 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95fc02b070 con 0x563adbb23e40 2024-06-13T11:34:22.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.146+0000 7f95efe00700 1 -- 172.21.15.2:0/3110603941 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7f96000b9040 con 0x563adbb23e40 2024-06-13T11:34:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.147+0000 7f95efe00700 1 -- 172.21.15.2:0/3110603941 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9600097df0 con 0x563adbb23e40 2024-06-13T11:34:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.147+0000 7f961f25bb80 10 client.26563 fetch_fsmap learned FSMap version 31 2024-06-13T11:34:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.147+0000 7f961f25bb80 1 -- 172.21.15.2:0/3110603941 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563adbc2cb10 con 0x563adbb23e40 2024-06-13T11:34:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.147+0000 7f95efe00700 1 -- 172.21.15.2:0/3110603941 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95fc02b070 con 0x563adbb23e40 2024-06-13T11:34:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.147+0000 7f95efe00700 1 -- 172.21.15.2:0/3110603941 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f960009be20 con 0x563adbb23e40 2024-06-13T11:34:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.147+0000 7f961f25bb80 10 client.26563 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:34:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.147+0000 7f961f25bb80 10 client.26563 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:34:22.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.147+0000 7f961f25bb80 20 client.26563 populate_metadata read hostname 'smithi002' 2024-06-13T11:34:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.147+0000 7f961f25bb80 1 --2- 172.21.15.2:0/3110603941 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x563adbc2cda0 0x563adbc2f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.147+0000 7f961f25bb80 4 client.26563 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-13T11:34:22.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.147+0000 7f961f25bb80 1 -- 172.21.15.2:0/3110603941 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563adbb01580 con 0x563adbc2cda0 2024-06-13T11:34:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.148+0000 7f9611400700 1 --2- 172.21.15.2:0/3110603941 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x563adbc2cda0 0x563adbc2f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.148+0000 7f9611400700 1 --2- 172.21.15.2:0/3110603941 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x563adbc2cda0 0x563adbc2f190 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9cb8048b77ae9d0 server_cookie=48a4c067ce15e587 in_seq=0 out_seq=0 2024-06-13T11:34:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.148+0000 7f95efe00700 10 client.26563 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:34:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.148+0000 7f95efe00700 1 -- 172.21.15.2:0/3110603941 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563adbb01580 con 0x563adbc2cda0 2024-06-13T11:34:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.148+0000 7f95efe00700 10 client.26563 handle_command_reply: tid=0 2024-06-13T11:34:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.148+0000 7f961f25bb80 1 client.26563 shutdown 2024-06-13T11:34:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.148+0000 7f961f25bb80 1 -- 172.21.15.2:0/3110603941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbb23e40 msgr2=0x563adbbac950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.148+0000 7f961f25bb80 1 --2- 172.21.15.2:0/3110603941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbb23e40 0x563adbbac950 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9600097fb0 tx=0x7f960000e940 comp rx=0 tx=0).stop 2024-06-13T11:34:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.149+0000 7f961f25bb80 1 -- 172.21.15.2:0/3110603941 shutdown_connections 2024-06-13T11:34:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.149+0000 7f961f25bb80 1 --2- 172.21.15.2:0/3110603941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563adbbb2300 0x563adbbba790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.149+0000 7f961f25bb80 1 --2- 172.21.15.2:0/3110603941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563adbb23e40 0x563adbbac950 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.149+0000 7f961f25bb80 1 --2- 172.21.15.2:0/3110603941 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x563adbc2cda0 0x563adbc2f190 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.149+0000 7f961f25bb80 1 --2- 172.21.15.2:0/3110603941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563adbba75b0 0x563adbbba250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.149+0000 7f961f25bb80 1 -- 172.21.15.2:0/3110603941 >> 172.21.15.2:0/3110603941 conn(0x563adbad4170 msgr2=0x563adbba1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.149+0000 7f95efe00700 0 client.26563 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:34:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.149+0000 7f961f25bb80 1 -- 172.21.15.2:0/3110603941 shutdown_connections 2024-06-13T11:34:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.149+0000 7f961f25bb80 1 -- 172.21.15.2:0/3110603941 wait complete. 2024-06-13T11:34:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.149+0000 7f961f25bb80 20 client.26563 trim_cache size 0 max 16384 2024-06-13T11:34:22.156 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:34:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: "status": "no active scrubs running", 2024-06-13T11:34:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: "scrubs": {} 2024-06-13T11:34:22.156 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:34:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.150+0000 7f9614800700 1 -- 172.21.15.2:0/2394534870 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f95f40a2d90 msgr2=0x7f95f40a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.150+0000 7f9614800700 1 --2- 172.21.15.2:0/2394534870 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f95f40a2d90 0x7f95f40a5250 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f960c077b40 tx=0x7f95fc009310 comp rx=0 tx=0).stop 2024-06-13T11:34:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.150+0000 7f9614800700 1 -- 172.21.15.2:0/2394534870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f960c108ac0 msgr2=0x7f960c19f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.150+0000 7f9614800700 1 --2- 172.21.15.2:0/2394534870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f960c108ac0 0x7f960c19f200 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f960000e9c0 tx=0x7f960000ecd0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.150+0000 7f9614800700 1 -- 172.21.15.2:0/2394534870 shutdown_connections 2024-06-13T11:34:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.150+0000 7f9614800700 1 --2- 172.21.15.2:0/2394534870 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f95f40a2d90 0x7f95f40a5250 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.150+0000 7f9614800700 1 --2- 172.21.15.2:0/2394534870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f960c108ac0 0x7f960c19f200 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.150+0000 7f9614800700 1 --2- 172.21.15.2:0/2394534870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f960c10eac0 0x7f960c1a3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.150+0000 7f9614800700 1 --2- 172.21.15.2:0/2394534870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c109480 0x7f960c19f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:22.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.150+0000 7f9614800700 1 -- 172.21.15.2:0/2394534870 >> 172.21.15.2:0/2394534870 conn(0x7f960c075c60 msgr2=0x7f960c076220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:22.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.150+0000 7f9614800700 1 -- 172.21.15.2:0/2394534870 shutdown_connections 2024-06-13T11:34:22.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:22.150+0000 7f9614800700 1 -- 172.21.15.2:0/2394534870 wait complete. 2024-06-13T11:34:22.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:22 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi178 to 176.1M 2024-06-13T11:34:22.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:22 smithi077 ceph-mon[36410]: Unable to set osd_memory_target on smithi178 to 184755200: error parsing value: Value '184755200' is below minimum 939524096 2024-06-13T11:34:22.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:22 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-06-13T11:34:22.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:22 smithi077 ceph-mon[36410]: Unable to set osd_memory_target on smithi077 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-06-13T11:34:22.876 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:22 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi178 to 176.1M 2024-06-13T11:34:22.876 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:22 smithi002 ceph-mon[32210]: Unable to set osd_memory_target on smithi178 to 184755200: error parsing value: Value '184755200' is below minimum 939524096 2024-06-13T11:34:22.876 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:22 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-06-13T11:34:22.877 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:22 smithi002 ceph-mon[32210]: Unable to set osd_memory_target on smithi077 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-06-13T11:34:22.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:22 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi178 to 176.1M 2024-06-13T11:34:22.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:22 smithi178 ceph-mon[36913]: Unable to set osd_memory_target on smithi178 to 184755200: error parsing value: Value '184755200' is below minimum 939524096 2024-06-13T11:34:22.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:22 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi077 to 176.2M 2024-06-13T11:34:22.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:22 smithi178 ceph-mon[36913]: Unable to set osd_memory_target on smithi077 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-06-13T11:34:23.298 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-13T11:34:23.299 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:34:23.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:23 smithi002 ceph-mon[32210]: pgmap v329: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:34:23.752 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:34:23.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:23 smithi077 ceph-mon[36410]: pgmap v329: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:34:23.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:23 smithi178 ceph-mon[36913]: pgmap v329: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:34:26.039 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:25 smithi002 ceph-mon[32210]: pgmap v330: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:26.040 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:25 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:26.040 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:25 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:26.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:25 smithi077 ceph-mon[36410]: pgmap v330: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:26.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:25 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:26.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:25 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:26.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.082+0000 7faa76800700 1 -- 172.21.15.2:0/1528774562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa700746c0 msgr2=0x7faa70074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:26.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.082+0000 7faa76800700 1 --2- 172.21.15.2:0/1528774562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa700746c0 0x7faa70074aa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faa600098f0 tx=0x7faa60009c00 comp rx=0 tx=0).stop 2024-06-13T11:34:26.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.082+0000 7faa76800700 1 -- 172.21.15.2:0/1528774562 shutdown_connections 2024-06-13T11:34:26.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.082+0000 7faa76800700 1 --2- 172.21.15.2:0/1528774562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa7010ee90 0x7faa70111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:26.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.082+0000 7faa76800700 1 --2- 172.21.15.2:0/1528774562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa700746c0 0x7faa70074aa0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:26.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.082+0000 7faa76800700 1 --2- 172.21.15.2:0/1528774562 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa70074fe0 0x7faa7010e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:26.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.082+0000 7faa76800700 1 -- 172.21.15.2:0/1528774562 >> 172.21.15.2:0/1528774562 conn(0x7faa700795f0 msgr2=0x7faa70079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:26.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.083+0000 7faa76800700 1 -- 172.21.15.2:0/1528774562 shutdown_connections 2024-06-13T11:34:26.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.083+0000 7faa76800700 1 -- 172.21.15.2:0/1528774562 wait complete. 2024-06-13T11:34:26.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.084+0000 7faa76800700 1 Processor -- start 2024-06-13T11:34:26.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.084+0000 7faa76800700 1 -- start start 2024-06-13T11:34:26.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.084+0000 7faa76800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa700746c0 0x7faa7019ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:26.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.084+0000 7faa76800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa70074fe0 0x7faa7019b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:26.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.084+0000 7faa76800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa7010ee90 0x7faa7019f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:26.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.084+0000 7faa76800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faa701149f0 con 0x7faa70074fe0 2024-06-13T11:34:26.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.084+0000 7faa76800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faa70114870 con 0x7faa7010ee90 2024-06-13T11:34:26.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.084+0000 7faa76800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7faa70114b70 con 0x7faa700746c0 2024-06-13T11:34:26.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.085+0000 7faa6f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa700746c0 0x7faa7019ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:26.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.085+0000 7faa6ea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa70074fe0 0x7faa7019b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:26.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.085+0000 7faa6f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa700746c0 0x7faa7019ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56790/0 (socket says 172.21.15.2:56790) 2024-06-13T11:34:26.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.085+0000 7faa6f400700 1 -- 172.21.15.2:0/1563315442 learned_addr learned my addr 172.21.15.2:0/1563315442 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:26.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.085+0000 7faa6fe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa7010ee90 0x7faa7019f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:26.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.085+0000 7faa6f400700 1 -- 172.21.15.2:0/1563315442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa7010ee90 msgr2=0x7faa7019f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:26.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.085+0000 7faa6f400700 1 --2- 172.21.15.2:0/1563315442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa7010ee90 0x7faa7019f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:26.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.085+0000 7faa6f400700 1 -- 172.21.15.2:0/1563315442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa70074fe0 msgr2=0x7faa7019b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:26.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.085+0000 7faa6f400700 1 --2- 172.21.15.2:0/1563315442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa70074fe0 0x7faa7019b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:26.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.085+0000 7faa6f400700 1 -- 172.21.15.2:0/1563315442 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa7019fe70 con 0x7faa700746c0 2024-06-13T11:34:26.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.085+0000 7faa6ea00700 1 --2- 172.21.15.2:0/1563315442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa70074fe0 0x7faa7019b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:34:26.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.085+0000 7faa6fe00700 1 --2- 172.21.15.2:0/1563315442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa7010ee90 0x7faa7019f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:34:26.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.086+0000 7faa6f400700 1 --2- 172.21.15.2:0/1563315442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa700746c0 0x7faa7019ae60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faa60005950 tx=0x7faa6000fb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:26.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.086+0000 7faa67e00700 1 -- 172.21.15.2:0/1563315442 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa600051f0 con 0x7faa700746c0 2024-06-13T11:34:26.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.086+0000 7faa76800700 1 -- 172.21.15.2:0/1563315442 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa701a0100 con 0x7faa700746c0 2024-06-13T11:34:26.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.086+0000 7faa67e00700 1 -- 172.21.15.2:0/1563315442 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa6000b560 con 0x7faa700746c0 2024-06-13T11:34:26.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.086+0000 7faa67e00700 1 -- 172.21.15.2:0/1563315442 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa60003a40 con 0x7faa700746c0 2024-06-13T11:34:26.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.086+0000 7faa76800700 1 -- 172.21.15.2:0/1563315442 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa701a79e0 con 0x7faa700746c0 2024-06-13T11:34:26.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.087+0000 7faa76800700 1 -- 172.21.15.2:0/1563315442 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa70069180 con 0x7faa700746c0 2024-06-13T11:34:26.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.089+0000 7faa67e00700 1 -- 172.21.15.2:0/1563315442 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7faa6000ba80 con 0x7faa700746c0 2024-06-13T11:34:26.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.091+0000 7faa67e00700 1 --2- 172.21.15.2:0/1563315442 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7faa540a2e10 0x7faa540a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:26.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.091+0000 7faa67e00700 1 -- 172.21.15.2:0/1563315442 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7faa600d07d0 con 0x7faa700746c0 2024-06-13T11:34:26.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.091+0000 7faa6ea00700 1 --2- 172.21.15.2:0/1563315442 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7faa540a2e10 0x7faa540a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:26.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.092+0000 7faa6ea00700 1 --2- 172.21.15.2:0/1563315442 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7faa540a2e10 0x7faa540a52d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faa70110b90 tx=0x7faa5c009310 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:26.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.093+0000 7faa67e00700 1 -- 172.21.15.2:0/1563315442 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7faa60013030 con 0x7faa700746c0 2024-06-13T11:34:26.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:25 smithi178 ceph-mon[36913]: pgmap v330: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:26.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:25 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:26.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:25 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:26.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.377+0000 7faa76800700 1 -- 172.21.15.2:0/1563315442 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa7002dca0 con 0x7faa700746c0 2024-06-13T11:34:26.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.378+0000 7faa67e00700 1 -- 172.21.15.2:0/1563315442 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11853 (secure 0 0 0) 0x7faa6009d060 con 0x7faa700746c0 2024-06-13T11:34:26.378 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:34:26.379 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:29:21.309310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24511,24493,24509]},"id":1}]} 2024-06-13T11:34:26.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.382+0000 7faa76800700 1 -- 172.21.15.2:0/1563315442 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7faa540a2e10 msgr2=0x7faa540a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:26.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.382+0000 7faa76800700 1 --2- 172.21.15.2:0/1563315442 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7faa540a2e10 0x7faa540a52d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faa70110b90 tx=0x7faa5c009310 comp rx=0 tx=0).stop 2024-06-13T11:34:26.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.382+0000 7faa76800700 1 -- 172.21.15.2:0/1563315442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa700746c0 msgr2=0x7faa7019ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:26.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.382+0000 7faa76800700 1 --2- 172.21.15.2:0/1563315442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa700746c0 0x7faa7019ae60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faa60005950 tx=0x7faa6000fb20 comp rx=0 tx=0).stop 2024-06-13T11:34:26.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.382+0000 7faa76800700 1 -- 172.21.15.2:0/1563315442 shutdown_connections 2024-06-13T11:34:26.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.382+0000 7faa76800700 1 --2- 172.21.15.2:0/1563315442 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7faa540a2e10 0x7faa540a52d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:26.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.382+0000 7faa76800700 1 --2- 172.21.15.2:0/1563315442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa7010ee90 0x7faa7019f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:26.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.382+0000 7faa76800700 1 --2- 172.21.15.2:0/1563315442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa700746c0 0x7faa7019ae60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:26.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.382+0000 7faa76800700 1 --2- 172.21.15.2:0/1563315442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa70074fe0 0x7faa7019b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:26.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.382+0000 7faa76800700 1 -- 172.21.15.2:0/1563315442 >> 172.21.15.2:0/1563315442 conn(0x7faa700795f0 msgr2=0x7faa700ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:26.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.382+0000 7faa76800700 1 -- 172.21.15.2:0/1563315442 shutdown_connections 2024-06-13T11:34:26.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:26.382+0000 7faa76800700 1 -- 172.21.15.2:0/1563315442 wait complete. 2024-06-13T11:34:26.384 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 31 2024-06-13T11:34:27.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:26 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1563315442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:34:27.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:26 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:26 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:26 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:26 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:26 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:26 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:26 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:26 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:26 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:34:27.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:26 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:34:27.042 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:26 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:27.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:26 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1563315442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:34:27.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:26 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:26 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:26 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:26 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:26 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:26 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:26 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:26 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:26 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:34:27.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:26 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:34:27.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:26 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:27.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:26 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1563315442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:34:27.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:26 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:26 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:26 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:26 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:26 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:26 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:26 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:26 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T11:34:27.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:26 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:34:27.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:26 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:34:27.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:26 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:34:27.227 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-13T11:34:27.683 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:34:27.998 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:27 smithi002 ceph-mon[32210]: Adjusting osd_memory_target on smithi002 to 177.5M 2024-06-13T11:34:27.998 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:27 smithi002 ceph-mon[32210]: Unable to set osd_memory_target on smithi002 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-13T11:34:27.998 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:27 smithi002 ceph-mon[32210]: pgmap v331: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:28.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:27 smithi077 ceph-mon[36410]: Adjusting osd_memory_target on smithi002 to 177.5M 2024-06-13T11:34:28.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:27 smithi077 ceph-mon[36410]: Unable to set osd_memory_target on smithi002 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-13T11:34:28.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:27 smithi077 ceph-mon[36410]: pgmap v331: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:28.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:27 smithi178 ceph-mon[36913]: Adjusting osd_memory_target on smithi002 to 177.5M 2024-06-13T11:34:28.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:27 smithi178 ceph-mon[36913]: Unable to set osd_memory_target on smithi002 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-13T11:34:28.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:27 smithi178 ceph-mon[36913]: pgmap v331: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:30.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:29 smithi077 ceph-mon[36410]: pgmap v332: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:30.042 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:29 smithi002 ceph-mon[32210]: pgmap v332: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:30.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.082+0000 7f2ae7000700 1 -- 172.21.15.2:0/2198765030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ae0101ed0 msgr2=0x7f2ae0105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:30.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.082+0000 7f2ae7000700 1 --2- 172.21.15.2:0/2198765030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ae0101ed0 0x7f2ae0105f20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009990 tx=0x7f2acc009ca0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.082+0000 7f2ae7000700 1 -- 172.21.15.2:0/2198765030 shutdown_connections 2024-06-13T11:34:30.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.082+0000 7f2ae7000700 1 --2- 172.21.15.2:0/2198765030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ae0101520 0x7f2ae0101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.082+0000 7f2ae7000700 1 --2- 172.21.15.2:0/2198765030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae0106600 0x7f2ae010e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.082+0000 7f2ae7000700 1 --2- 172.21.15.2:0/2198765030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ae0101ed0 0x7f2ae0105f20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.082+0000 7f2ae7000700 1 -- 172.21.15.2:0/2198765030 >> 172.21.15.2:0/2198765030 conn(0x7f2ae00fcdb0 msgr2=0x7f2ae00ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:30.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.082+0000 7f2ae7000700 1 -- 172.21.15.2:0/2198765030 shutdown_connections 2024-06-13T11:34:30.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.082+0000 7f2ae7000700 1 -- 172.21.15.2:0/2198765030 wait complete. 2024-06-13T11:34:30.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.083+0000 7f2ae7000700 1 Processor -- start 2024-06-13T11:34:30.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.083+0000 7f2ae7000700 1 -- start start 2024-06-13T11:34:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.084+0000 7f2ae7000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae0101520 0x7f2ae019e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.084+0000 7f2ae7000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ae0101ed0 0x7f2ae019ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.084+0000 7f2ae7000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ae0106600 0x7f2ae0198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.084+0000 7f2ae7000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae01115c0 con 0x7f2ae0101ed0 2024-06-13T11:34:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.084+0000 7f2ae7000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae0111440 con 0x7f2ae0106600 2024-06-13T11:34:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.084+0000 7f2ae7000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae0111740 con 0x7f2ae0101520 2024-06-13T11:34:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.084+0000 7f2ae5200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ae0101ed0 0x7f2ae019ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.084+0000 7f2ae5c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae0101520 0x7f2ae019e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.084+0000 7f2ae5200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ae0101ed0 0x7f2ae019ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38662/0 (socket says 172.21.15.2:38662) 2024-06-13T11:34:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.084+0000 7f2ae6600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ae0106600 0x7f2ae0198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.084+0000 7f2ae5200700 1 -- 172.21.15.2:0/790850977 learned_addr learned my addr 172.21.15.2:0/790850977 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.085+0000 7f2ae5200700 1 -- 172.21.15.2:0/790850977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae0101520 msgr2=0x7f2ae019e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.085+0000 7f2ae5200700 1 --2- 172.21.15.2:0/790850977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae0101520 0x7f2ae019e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.085+0000 7f2ae5200700 1 -- 172.21.15.2:0/790850977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ae0106600 msgr2=0x7f2ae0198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:30.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.085+0000 7f2ae5200700 1 --2- 172.21.15.2:0/790850977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ae0106600 0x7f2ae0198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.085+0000 7f2ae5200700 1 -- 172.21.15.2:0/790850977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae0199220 con 0x7f2ae0101ed0 2024-06-13T11:34:30.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.085+0000 7f2ae5c00700 1 --2- 172.21.15.2:0/790850977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae0101520 0x7f2ae019e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:34:30.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.085+0000 7f2ae5200700 1 --2- 172.21.15.2:0/790850977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ae0101ed0 0x7f2ae019ee40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2acc000c00 tx=0x7f2acc005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:30.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.086+0000 7f2ade000700 1 -- 172.21.15.2:0/790850977 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc026070 con 0x7f2ae0101ed0 2024-06-13T11:34:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.086+0000 7f2ade000700 1 -- 172.21.15.2:0/790850977 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2acc021410 con 0x7f2ae0101ed0 2024-06-13T11:34:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.086+0000 7f2ae7000700 1 -- 172.21.15.2:0/790850977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae01994b0 con 0x7f2ae0101ed0 2024-06-13T11:34:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.086+0000 7f2ade000700 1 -- 172.21.15.2:0/790850977 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc017650 con 0x7f2ae0101ed0 2024-06-13T11:34:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.086+0000 7f2ae7000700 1 -- 172.21.15.2:0/790850977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae01a57d0 con 0x7f2ae0101ed0 2024-06-13T11:34:30.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.089+0000 7f2ade000700 1 -- 172.21.15.2:0/790850977 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f2acc029070 con 0x7f2ae0101ed0 2024-06-13T11:34:30.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.090+0000 7f2af2ff8b80 1 Processor -- start 2024-06-13T11:34:30.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.091+0000 7f2af2ff8b80 1 -- start start 2024-06-13T11:34:30.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.091+0000 7f2ade000700 1 --2- 172.21.15.2:0/790850977 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2ac80a2d90 0x7f2ac80a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.091+0000 7f2ade000700 1 -- 172.21.15.2:0/790850977 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7f2acc0d0390 con 0x7f2ae0101ed0 2024-06-13T11:34:30.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.091+0000 7f2af2ff8b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d85140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.091+0000 7f2af2ff8b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d85680 0x563777d8fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.091+0000 7f2ae6600700 1 --2- 172.21.15.2:0/790850977 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2ac80a2d90 0x7f2ac80a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.091+0000 7f2af2ff8b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 0x563777d92920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.091+0000 7f2af2ff8b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563777c94a10 con 0x563777d85680 2024-06-13T11:34:30.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.091+0000 7f2af2ff8b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563777cd7b00 con 0x563777d84d60 2024-06-13T11:34:30.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.091+0000 7f2af2ff8b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563777c928f0 con 0x563777d90530 2024-06-13T11:34:30.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.091+0000 7f2ae5200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d85680 0x563777d8fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.092+0000 7f2ae5c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d85140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.092+0000 7f2ae5200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d85680 0x563777d8fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38664/0 (socket says 172.21.15.2:38664) 2024-06-13T11:34:30.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.092+0000 7f2ae5200700 1 -- 172.21.15.2:0/3706846272 learned_addr learned my addr 172.21.15.2:0/3706846272 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:30.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.092+0000 7f2ae6600700 1 --2- 172.21.15.2:0/3706846272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 0x563777d92920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.092+0000 7f2ae5c00700 1 -- 172.21.15.2:0/3706846272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 msgr2=0x563777d92920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:30.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.092+0000 7f2ae5c00700 1 --2- 172.21.15.2:0/3706846272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 0x563777d92920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.092+0000 7f2ae5c00700 1 -- 172.21.15.2:0/3706846272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d85680 msgr2=0x563777d8fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:30.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.092+0000 7f2ae5c00700 1 --2- 172.21.15.2:0/3706846272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d85680 0x563777d8fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.092+0000 7f2ae5c00700 1 -- 172.21.15.2:0/3706846272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563777c7ff90 con 0x563777d84d60 2024-06-13T11:34:30.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.092+0000 7f2ae6600700 1 --2- 172.21.15.2:0/790850977 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2ac80a2d90 0x7f2ac80a5250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009fd0 tx=0x7f2ad800fc60 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:30.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.093+0000 7f2ae5c00700 1 --2- 172.21.15.2:0/3706846272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d85140 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40114c0 tx=0x7f2ad40117d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6c23267b3f092b8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:30.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.093+0000 7f2ad2a00700 1 -- 172.21.15.2:0/3706846272 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4004230 con 0x563777d84d60 2024-06-13T11:34:30.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.093+0000 7f2ad2a00700 1 -- 172.21.15.2:0/3706846272 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ad4011e50 con 0x563777d84d60 2024-06-13T11:34:30.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.093+0000 7f2ad2a00700 1 -- 172.21.15.2:0/3706846272 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4005590 con 0x563777d84d60 2024-06-13T11:34:30.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.094+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/3706846272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 msgr2=0x563777d85140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:30.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.094+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/3706846272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d85140 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40114c0 tx=0x7f2ad40117d0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.094+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/3706846272 shutdown_connections 2024-06-13T11:34:30.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.094+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/3706846272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 0x563777d92920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.094+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/3706846272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d85140 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.094+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/3706846272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d85680 0x563777d8fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.094+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/3706846272 >> 172.21.15.2:0/3706846272 conn(0x563777cb2170 msgr2=0x563777d81280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.094+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/3706846272 shutdown_connections 2024-06-13T11:34:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.094+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/3706846272 wait complete. 2024-06-13T11:34:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.095+0000 7f2af2ff8b80 1 -- start start 2024-06-13T11:34:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.095+0000 7f2af2ff8b80 1 Processor -- start 2024-06-13T11:34:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.095+0000 7f2af2ff8b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d8fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.095+0000 7f2af2ff8b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d85680 0x563777d8d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.095+0000 7f2af2ff8b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d90530 0x563777d8d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.095+0000 7f2af2ff8b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563777c73f60 con 0x563777d90530 2024-06-13T11:34:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.095+0000 7f2af2ff8b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563777cd3ac0 con 0x563777d84d60 2024-06-13T11:34:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.095+0000 7f2af2ff8b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563777d92fc0 con 0x563777d85680 2024-06-13T11:34:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.096+0000 7f2af2ff8b80 10 client.0 _ll_register_callbacks cb 0x563777c6d380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:34:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.096+0000 7f2ae5200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d85680 0x563777d8d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.096+0000 7f2ae5c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d8fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.096+0000 7f2ae5c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d8fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:53292/0 (socket says 172.21.15.2:53292) 2024-06-13T11:34:30.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.096+0000 7f2ae5c00700 1 -- 172.21.15.2:0/1320173975 learned_addr learned my addr 172.21.15.2:0/1320173975 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.096+0000 7f2ae6600700 1 --2- 172.21.15.2:0/1320173975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d90530 0x563777d8d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.096+0000 7f2ae5c00700 1 -- 172.21.15.2:0/1320173975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d85680 msgr2=0x563777d8d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.096+0000 7f2ae5c00700 1 --2- 172.21.15.2:0/1320173975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d85680 0x563777d8d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.096+0000 7f2ae5c00700 1 -- 172.21.15.2:0/1320173975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d90530 msgr2=0x563777d8d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.096+0000 7f2ae5c00700 1 --2- 172.21.15.2:0/1320173975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d90530 0x563777d8d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.096+0000 7f2ae5c00700 1 -- 172.21.15.2:0/1320173975 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563777c268d0 con 0x563777d84d60 2024-06-13T11:34:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.096+0000 7f2ae5200700 1 --2- 172.21.15.2:0/1320173975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d85680 0x563777d8d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:34:30.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.097+0000 7f2ae5c00700 1 --2- 172.21.15.2:0/1320173975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d8fd10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4005e40 tx=0x7f2ad4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d33a0e03c407689 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.097+0000 7f2ac7400700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:34:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.097+0000 7f2ac7400700 1 -- 172.21.15.2:0/1320173975 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4004db0 con 0x563777d84d60 2024-06-13T11:34:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.097+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/1320173975 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ad4011e50 con 0x563777d84d60 2024-06-13T11:34:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.097+0000 7f2ac7400700 1 -- 172.21.15.2:0/1320173975 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7f2ad400e470 con 0x563777d84d60 2024-06-13T11:34:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.097+0000 7f2ac7400700 1 -- 172.21.15.2:0/1320173975 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2ad4032050 con 0x563777d84d60 2024-06-13T11:34:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.097+0000 7f2af2ff8b80 10 client.26546 fetch_fsmap learned FSMap version 31 2024-06-13T11:34:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.097+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/1320173975 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563777d9d710 con 0x563777d84d60 2024-06-13T11:34:30.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.098+0000 7f2ac7400700 1 -- 172.21.15.2:0/1320173975 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ad4011e50 con 0x563777d84d60 2024-06-13T11:34:30.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.098+0000 7f2ac7400700 1 -- 172.21.15.2:0/1320173975 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f2ad4019730 con 0x563777d84d60 2024-06-13T11:34:30.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.098+0000 7f2af2ff8b80 10 client.26546 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:34:30.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.098+0000 7f2af2ff8b80 10 client.26546 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:34:30.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.098+0000 7f2af2ff8b80 20 client.26546 populate_metadata read hostname 'smithi002' 2024-06-13T11:34:30.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.098+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/1320173975 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x563777d9fc40 0x563777da2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.098+0000 7f2af2ff8b80 4 client.26546 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:34:30.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.098+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/1320173975 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563777ce5000 con 0x563777d9fc40 2024-06-13T11:34:30.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.099+0000 7f2ae5200700 1 --2- 172.21.15.2:0/1320173975 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x563777d9fc40 0x563777da2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.099+0000 7f2ae5200700 1 --2- 172.21.15.2:0/1320173975 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x563777d9fc40 0x563777da2030 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa6c72a46207240f server_cookie=526902048e643dee in_seq=0 out_seq=0 2024-06-13T11:34:30.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.099+0000 7f2ac7400700 10 client.26546 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:34:30.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.100+0000 7f2ac7400700 1 -- 172.21.15.2:0/1320173975 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563777ce5000 con 0x563777d9fc40 2024-06-13T11:34:30.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.100+0000 7f2ac7400700 10 client.26546 handle_command_reply: tid=0 2024-06-13T11:34:30.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.100+0000 7f2af2ff8b80 1 client.26546 shutdown 2024-06-13T11:34:30.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.100+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/1320173975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 msgr2=0x563777d8fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:30.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.100+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/1320173975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d8fd10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4005e40 tx=0x7f2ad4004750 comp rx=0 tx=0).stop 2024-06-13T11:34:30.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.100+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/1320173975 shutdown_connections 2024-06-13T11:34:30.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.100+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/1320173975 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x563777d9fc40 0x563777da2030 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.100+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/1320173975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d90530 0x563777d8d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.100+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/1320173975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d8fd10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.100+0000 7f2ac7400700 0 client.26546 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:34:30.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.100+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/1320173975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d85680 0x563777d8d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.100+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/1320173975 >> 172.21.15.2:0/1320173975 conn(0x563777cb2170 msgr2=0x563777d80e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:30.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.100+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/1320173975 shutdown_connections 2024-06-13T11:34:30.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.100+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/1320173975 wait complete. 2024-06-13T11:34:30.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.101+0000 7f2af2ff8b80 20 client.26546 trim_cache size 0 max 16384 2024-06-13T11:34:30.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.118+0000 7f2af2ff8b80 1 Processor -- start 2024-06-13T11:34:30.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.118+0000 7f2af2ff8b80 1 -- start start 2024-06-13T11:34:30.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.118+0000 7f2af2ff8b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d813c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.118+0000 7f2af2ff8b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d85680 0x563777d8f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.118+0000 7f2af2ff8b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 0x563777da77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.118+0000 7f2af2ff8b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae01b0ce0 con 0x563777d85680 2024-06-13T11:34:30.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.118+0000 7f2af2ff8b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae01ae570 con 0x563777d84d60 2024-06-13T11:34:30.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.118+0000 7f2af2ff8b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae01ac3e0 con 0x563777d90530 2024-06-13T11:34:30.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.118+0000 7f2ae5200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d85680 0x563777d8f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.118+0000 7f2ae5200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d85680 0x563777d8f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38678/0 (socket says 172.21.15.2:38678) 2024-06-13T11:34:30.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.118+0000 7f2ae5200700 1 -- 172.21.15.2:0/4150924503 learned_addr learned my addr 172.21.15.2:0/4150924503 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:30.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.119+0000 7f2ae5c00700 1 --2- 172.21.15.2:0/4150924503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d813c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.119+0000 7f2ae6600700 1 --2- 172.21.15.2:0/4150924503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 0x563777da77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.119+0000 7f2ae5200700 1 -- 172.21.15.2:0/4150924503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 msgr2=0x563777da77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.119+0000 7f2ae5200700 1 --2- 172.21.15.2:0/4150924503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 0x563777da77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.119+0000 7f2ae5200700 1 -- 172.21.15.2:0/4150924503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 msgr2=0x563777d813c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.119+0000 7f2ae5200700 1 --2- 172.21.15.2:0/4150924503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d813c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.119+0000 7f2ae5200700 1 -- 172.21.15.2:0/4150924503 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563777d85390 con 0x563777d85680 2024-06-13T11:34:30.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.119+0000 7f2ae5c00700 1 --2- 172.21.15.2:0/4150924503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d813c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:34:30.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.119+0000 7f2ae5200700 1 --2- 172.21.15.2:0/4150924503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d85680 0x563777d8f850 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2acc09c4b0 tx=0x7f2acc009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2f7aff7bac1502 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:30.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.120+0000 7f2ad2000700 1 -- 172.21.15.2:0/4150924503 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc005730 con 0x563777d85680 2024-06-13T11:34:30.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.120+0000 7f2ad2000700 1 -- 172.21.15.2:0/4150924503 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2acc09cc20 con 0x563777d85680 2024-06-13T11:34:30.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.120+0000 7f2ad2000700 1 -- 172.21.15.2:0/4150924503 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc021950 con 0x563777d85680 2024-06-13T11:34:30.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.120+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/4150924503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d85680 msgr2=0x563777d8f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:30.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.120+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/4150924503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d85680 0x563777d8f850 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2acc09c4b0 tx=0x7f2acc009310 comp rx=0 tx=0).stop 2024-06-13T11:34:30.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.120+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/4150924503 shutdown_connections 2024-06-13T11:34:30.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.120+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/4150924503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 0x563777da77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.120+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/4150924503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d813c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.120+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/4150924503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d85680 0x563777d8f850 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.121+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/4150924503 >> 172.21.15.2:0/4150924503 conn(0x563777cb2170 msgr2=0x563777d8c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:30.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.121+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/4150924503 shutdown_connections 2024-06-13T11:34:30.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.121+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/4150924503 wait complete. 2024-06-13T11:34:30.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.121+0000 7f2af2ff8b80 1 -- start start 2024-06-13T11:34:30.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.122+0000 7f2af2ff8b80 1 Processor -- start 2024-06-13T11:34:30.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.122+0000 7f2af2ff8b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d98990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.122+0000 7f2af2ff8b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 0x563777d93c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.122+0000 7f2af2ff8b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d941b0 0x563777d94630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.122+0000 7f2af2ff8b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae01aca30 con 0x563777d941b0 2024-06-13T11:34:30.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.122+0000 7f2af2ff8b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae01adea0 con 0x563777d84d60 2024-06-13T11:34:30.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.122+0000 7f2af2ff8b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae01ad100 con 0x563777d90530 2024-06-13T11:34:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.122+0000 7f2af2ff8b80 10 client.0 _ll_register_callbacks cb 0x563777c6d380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:34:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.122+0000 7f2ae5200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 0x563777d93c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.122+0000 7f2ae6600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d941b0 0x563777d94630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.122+0000 7f2ae5200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 0x563777d93c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56848/0 (socket says 172.21.15.2:56848) 2024-06-13T11:34:30.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.122+0000 7f2ae5200700 1 -- 172.21.15.2:0/3021269011 learned_addr learned my addr 172.21.15.2:0/3021269011 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:30.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.123+0000 7f2ae5c00700 1 --2- 172.21.15.2:0/3021269011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d98990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.123+0000 7f2ae5200700 1 -- 172.21.15.2:0/3021269011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 msgr2=0x563777d98990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:30.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.123+0000 7f2ae5200700 1 --2- 172.21.15.2:0/3021269011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d98990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.123+0000 7f2ae5200700 1 -- 172.21.15.2:0/3021269011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d941b0 msgr2=0x563777d94630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:30.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.123+0000 7f2ae5200700 1 --2- 172.21.15.2:0/3021269011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d941b0 0x563777d94630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.123+0000 7f2ae5200700 1 -- 172.21.15.2:0/3021269011 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563777e098e0 con 0x563777d90530 2024-06-13T11:34:30.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.123+0000 7f2ae5200700 1 --2- 172.21.15.2:0/3021269011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 0x563777d93c70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2acc098ef0 tx=0x7f2acc009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=714ce4a7993d8b61 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:30.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.123+0000 7f2ac7400700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:34:30.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.123+0000 7f2ac7400700 1 -- 172.21.15.2:0/3021269011 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0a08d0 con 0x563777d90530 2024-06-13T11:34:30.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.123+0000 7f2ac7400700 1 -- 172.21.15.2:0/3021269011 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7f2acc0b52a0 con 0x563777d90530 2024-06-13T11:34:30.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.123+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/3021269011 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2acc09cc20 con 0x563777d90530 2024-06-13T11:34:30.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.124+0000 7f2ac7400700 1 -- 172.21.15.2:0/3021269011 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2acc0a5100 con 0x563777d90530 2024-06-13T11:34:30.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.124+0000 7f2af2ff8b80 10 client.26587 fetch_fsmap learned FSMap version 31 2024-06-13T11:34:30.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.124+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/3021269011 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563777e0aba0 con 0x563777d90530 2024-06-13T11:34:30.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.124+0000 7f2ac7400700 1 -- 172.21.15.2:0/3021269011 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2acc09cc20 con 0x563777d90530 2024-06-13T11:34:30.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.124+0000 7f2ac7400700 1 -- 172.21.15.2:0/3021269011 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f2acc0a4c70 con 0x563777d90530 2024-06-13T11:34:30.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.124+0000 7f2af2ff8b80 10 client.26587 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:34:30.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.124+0000 7f2af2ff8b80 10 client.26587 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-06-13T11:34:30.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.124+0000 7f2af2ff8b80 20 client.26587 populate_metadata read hostname 'smithi002' 2024-06-13T11:34:30.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.124+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/3021269011 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x563777e0b1c0 0x563777e0d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:30.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.124+0000 7f2af2ff8b80 4 client.26587 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:34:30.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.124+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/3021269011 --> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563777cdf580 con 0x563777e0b1c0 2024-06-13T11:34:30.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.125+0000 7f2ae5c00700 1 --2- 172.21.15.2:0/3021269011 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x563777e0b1c0 0x563777e0d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:30.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.125+0000 7f2ae5c00700 1 --2- 172.21.15.2:0/3021269011 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x563777e0b1c0 0x563777e0d5e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f1351aa7e601761e server_cookie=949987158482ed7 in_seq=0 out_seq=0 2024-06-13T11:34:30.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.125+0000 7f2ac7400700 10 client.26587 ms_handle_connect on v2:172.21.15.178:6836/2179127321 2024-06-13T11:34:30.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.125+0000 7f2ac7400700 1 -- 172.21.15.2:0/3021269011 <== mds.2 v2:172.21.15.178:6836/2179127321 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563777cdf580 con 0x563777e0b1c0 2024-06-13T11:34:30.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.125+0000 7f2ac7400700 10 client.26587 handle_command_reply: tid=0 2024-06-13T11:34:30.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.125+0000 7f2af2ff8b80 1 client.26587 shutdown 2024-06-13T11:34:30.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.125+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/3021269011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 msgr2=0x563777d93c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:30.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.125+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/3021269011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 0x563777d93c70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2acc098ef0 tx=0x7f2acc009ca0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.126+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/3021269011 shutdown_connections 2024-06-13T11:34:30.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.126+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/3021269011 >> [v2:172.21.15.178:6836/2179127321,v1:172.21.15.178:6837/2179127321] conn(0x563777e0b1c0 0x563777e0d5e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.126+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/3021269011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563777d941b0 0x563777d94630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.126+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/3021269011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563777d84d60 0x563777d98990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.126+0000 7f2af2ff8b80 1 --2- 172.21.15.2:0/3021269011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563777d90530 0x563777d93c70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.126+0000 7f2ac7400700 0 client.26587 ms_handle_reset on v2:172.21.15.178:6836/2179127321 2024-06-13T11:34:30.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.126+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/3021269011 >> 172.21.15.2:0/3021269011 conn(0x563777cb2170 msgr2=0x563777d86bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:30.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.126+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/3021269011 shutdown_connections 2024-06-13T11:34:30.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.126+0000 7f2af2ff8b80 1 -- 172.21.15.2:0/3021269011 wait complete. 2024-06-13T11:34:30.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.126+0000 7f2af2ff8b80 20 client.26587 trim_cache size 0 max 16384 2024-06-13T11:34:30.142 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:34:30.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.127+0000 7f2ae7000700 1 -- 172.21.15.2:0/790850977 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2ac80a2d90 msgr2=0x7f2ac80a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:30.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.127+0000 7f2ae7000700 1 --2- 172.21.15.2:0/790850977 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2ac80a2d90 0x7f2ac80a5250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009fd0 tx=0x7f2ad800fc60 comp rx=0 tx=0).stop 2024-06-13T11:34:30.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.127+0000 7f2ae7000700 1 -- 172.21.15.2:0/790850977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ae0101ed0 msgr2=0x7f2ae019ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:30.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.127+0000 7f2ae7000700 1 --2- 172.21.15.2:0/790850977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ae0101ed0 0x7f2ae019ee40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2acc000c00 tx=0x7f2acc005610 comp rx=0 tx=0).stop 2024-06-13T11:34:30.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.127+0000 7f2ae7000700 1 -- 172.21.15.2:0/790850977 shutdown_connections 2024-06-13T11:34:30.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.127+0000 7f2ae7000700 1 --2- 172.21.15.2:0/790850977 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f2ac80a2d90 0x7f2ac80a5250 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.127+0000 7f2ae7000700 1 --2- 172.21.15.2:0/790850977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ae0106600 0x7f2ae0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.127+0000 7f2ae7000700 1 --2- 172.21.15.2:0/790850977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae0101520 0x7f2ae019e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.127+0000 7f2ae7000700 1 --2- 172.21.15.2:0/790850977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ae0101ed0 0x7f2ae019ee40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:30.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.127+0000 7f2ae7000700 1 -- 172.21.15.2:0/790850977 >> 172.21.15.2:0/790850977 conn(0x7f2ae00fcdb0 msgr2=0x7f2ae006a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:30.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.127+0000 7f2ae7000700 1 -- 172.21.15.2:0/790850977 shutdown_connections 2024-06-13T11:34:30.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:30.127+0000 7f2ae7000700 1 -- 172.21.15.2:0/790850977 wait complete. 2024-06-13T11:34:30.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:29 smithi178 ceph-mon[36913]: pgmap v332: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:31.256 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-13T11:34:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:34:32.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:31 smithi077 ceph-mon[36410]: pgmap v333: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:32.078 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:31 smithi002 ceph-mon[32210]: pgmap v333: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:32.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:31 smithi178 ceph-mon[36913]: pgmap v333: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:33.948 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:33 smithi002 ceph-mon[32210]: pgmap v334: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:34.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:33 smithi077 ceph-mon[36410]: pgmap v334: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:34.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:33 smithi178 ceph-mon[36913]: pgmap v334: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.239+0000 7f3975a00700 1 -- 172.21.15.2:0/385977186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f397006b350 msgr2=0x7f397010e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.239+0000 7f3975a00700 1 --2- 172.21.15.2:0/385977186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f397006b350 0x7f397010e9f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f395c009990 tx=0x7f395c009ca0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.239+0000 7f3975a00700 1 -- 172.21.15.2:0/385977186 shutdown_connections 2024-06-13T11:34:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.240+0000 7f3975a00700 1 --2- 172.21.15.2:0/385977186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f397006aa30 0x7f397006ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.240+0000 7f3975a00700 1 --2- 172.21.15.2:0/385977186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f397010ef30 0x7f3970111320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.240+0000 7f3975a00700 1 --2- 172.21.15.2:0/385977186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f397006b350 0x7f397010e9f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.240+0000 7f3975a00700 1 -- 172.21.15.2:0/385977186 >> 172.21.15.2:0/385977186 conn(0x7f3970078300 msgr2=0x7f3970078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:34.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.240+0000 7f3975a00700 1 -- 172.21.15.2:0/385977186 shutdown_connections 2024-06-13T11:34:34.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.240+0000 7f3975a00700 1 -- 172.21.15.2:0/385977186 wait complete. 2024-06-13T11:34:34.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.241+0000 7f3975a00700 1 Processor -- start 2024-06-13T11:34:34.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.241+0000 7f3975a00700 1 -- start start 2024-06-13T11:34:34.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.242+0000 7f3975a00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f397006aa30 0x7f397019aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.242+0000 7f3975a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f397006b350 0x7f397019b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.242+0000 7f3975a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f397010ef30 0x7f397019f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.242+0000 7f3975a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3970114990 con 0x7f397006b350 2024-06-13T11:34:34.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.242+0000 7f3975a00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3970114810 con 0x7f397006aa30 2024-06-13T11:34:34.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.242+0000 7f3975a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3970114b10 con 0x7f397010ef30 2024-06-13T11:34:34.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.242+0000 7f396ea00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f397006aa30 0x7f397019aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.242+0000 7f396e000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f397006b350 0x7f397019b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.242+0000 7f396ea00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f397006aa30 0x7f397019aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:53336/0 (socket says 172.21.15.2:53336) 2024-06-13T11:34:34.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.242+0000 7f396ea00700 1 -- 172.21.15.2:0/3170226231 learned_addr learned my addr 172.21.15.2:0/3170226231 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:34.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.243+0000 7f396f400700 1 --2- 172.21.15.2:0/3170226231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f397010ef30 0x7f397019f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.243+0000 7f396ea00700 1 -- 172.21.15.2:0/3170226231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f397010ef30 msgr2=0x7f397019f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.243+0000 7f396ea00700 1 --2- 172.21.15.2:0/3170226231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f397010ef30 0x7f397019f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.243+0000 7f396ea00700 1 -- 172.21.15.2:0/3170226231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f397006b350 msgr2=0x7f397019b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.243+0000 7f396ea00700 1 --2- 172.21.15.2:0/3170226231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f397006b350 0x7f397019b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.243+0000 7f396ea00700 1 -- 172.21.15.2:0/3170226231 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397019fe80 con 0x7f397006aa30 2024-06-13T11:34:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.243+0000 7f396ea00700 1 --2- 172.21.15.2:0/3170226231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f397006aa30 0x7f397019aec0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f396000e9a0 tx=0x7f396000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.244+0000 7f3967400700 1 -- 172.21.15.2:0/3170226231 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396000c9c0 con 0x7f397006aa30 2024-06-13T11:34:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.244+0000 7f3967400700 1 -- 172.21.15.2:0/3170226231 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f396000cb60 con 0x7f397006aa30 2024-06-13T11:34:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.244+0000 7f3975a00700 1 -- 172.21.15.2:0/3170226231 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39701a0170 con 0x7f397006aa30 2024-06-13T11:34:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.244+0000 7f3967400700 1 -- 172.21.15.2:0/3170226231 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960018660 con 0x7f397006aa30 2024-06-13T11:34:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.244+0000 7f3975a00700 1 -- 172.21.15.2:0/3170226231 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39701a79f0 con 0x7f397006aa30 2024-06-13T11:34:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.247+0000 7f3967400700 1 -- 172.21.15.2:0/3170226231 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f396000cd10 con 0x7f397006aa30 2024-06-13T11:34:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.248+0000 7f3967400700 1 --2- 172.21.15.2:0/3170226231 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f39540a2e10 0x7f39540a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.249+0000 7f39803f6b80 1 Processor -- start 2024-06-13T11:34:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.249+0000 7f3967400700 1 -- 172.21.15.2:0/3170226231 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7f39600cf950 con 0x7f397006aa30 2024-06-13T11:34:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.249+0000 7f39803f6b80 1 -- start start 2024-06-13T11:34:34.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.249+0000 7f396e000700 1 --2- 172.21.15.2:0/3170226231 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f39540a2e10 0x7f39540a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.249+0000 7f39803f6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d3903b90 0x5622d3903f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.249+0000 7f39803f6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d39044b0 0x5622d38fdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.249+0000 7f39803f6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d38fe240 0x5622d38fe680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.249+0000 7f39803f6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5622d380ca10 con 0x5622d3903b90 2024-06-13T11:34:34.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.249+0000 7f39803f6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5622d384fb00 con 0x5622d38fe240 2024-06-13T11:34:34.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.249+0000 7f39803f6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5622d380a8f0 con 0x5622d39044b0 2024-06-13T11:34:34.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.250+0000 7f396ea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d3903b90 0x5622d3903f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.250+0000 7f396ea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d3903b90 0x5622d3903f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38720/0 (socket says 172.21.15.2:38720) 2024-06-13T11:34:34.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.250+0000 7f396ea00700 1 -- 172.21.15.2:0/1504633184 learned_addr learned my addr 172.21.15.2:0/1504633184 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:34.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.250+0000 7f396e000700 1 --2- 172.21.15.2:0/1504633184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d39044b0 0x5622d38fdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.250+0000 7f396f400700 1 --2- 172.21.15.2:0/1504633184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d38fe240 0x5622d38fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.250+0000 7f396ea00700 1 -- 172.21.15.2:0/1504633184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d39044b0 msgr2=0x5622d38fdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:34.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.250+0000 7f396ea00700 1 --2- 172.21.15.2:0/1504633184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d39044b0 0x5622d38fdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.250+0000 7f396ea00700 1 -- 172.21.15.2:0/1504633184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d38fe240 msgr2=0x5622d38fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:34.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.250+0000 7f396e000700 1 --2- 172.21.15.2:0/3170226231 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f39540a2e10 0x7f39540a52d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f395c0098e0 tx=0x7f395c005960 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:34.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.250+0000 7f396ea00700 1 --2- 172.21.15.2:0/1504633184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d38fe240 0x5622d38fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.250+0000 7f396ea00700 1 -- 172.21.15.2:0/1504633184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622d37f7f90 con 0x5622d3903b90 2024-06-13T11:34:34.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.250+0000 7f396f400700 1 --2- 172.21.15.2:0/1504633184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d38fe240 0x5622d38fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:34:34.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.250+0000 7f396ea00700 1 --2- 172.21.15.2:0/1504633184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d3903b90 0x5622d3903f70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3960098420 tx=0x7f3960009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48a5f565ecc4d6b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:34.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.251+0000 7f395be00700 1 -- 172.21.15.2:0/1504633184 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39600a46c0 con 0x5622d3903b90 2024-06-13T11:34:34.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.251+0000 7f395be00700 1 -- 172.21.15.2:0/1504633184 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f396009bcb0 con 0x5622d3903b90 2024-06-13T11:34:34.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.251+0000 7f395be00700 1 -- 172.21.15.2:0/1504633184 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396009b0a0 con 0x5622d3903b90 2024-06-13T11:34:34.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.252+0000 7f39803f6b80 1 -- 172.21.15.2:0/1504633184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d3903b90 msgr2=0x5622d3903f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:34.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.252+0000 7f39803f6b80 1 --2- 172.21.15.2:0/1504633184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d3903b90 0x5622d3903f70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3960098420 tx=0x7f3960009820 comp rx=0 tx=0).stop 2024-06-13T11:34:34.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.252+0000 7f39803f6b80 1 -- 172.21.15.2:0/1504633184 shutdown_connections 2024-06-13T11:34:34.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.252+0000 7f39803f6b80 1 --2- 172.21.15.2:0/1504633184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d3903b90 0x5622d3903f70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.252+0000 7f39803f6b80 1 --2- 172.21.15.2:0/1504633184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d38fe240 0x5622d38fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.252+0000 7f39803f6b80 1 --2- 172.21.15.2:0/1504633184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d39044b0 0x5622d38fdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.252+0000 7f39803f6b80 1 -- 172.21.15.2:0/1504633184 >> 172.21.15.2:0/1504633184 conn(0x5622d382a170 msgr2=0x5622d38f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:34.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.252+0000 7f39803f6b80 1 -- 172.21.15.2:0/1504633184 shutdown_connections 2024-06-13T11:34:34.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.252+0000 7f39803f6b80 1 -- 172.21.15.2:0/1504633184 wait complete. 2024-06-13T11:34:34.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.252+0000 7f39803f6b80 1 -- start start 2024-06-13T11:34:34.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.253+0000 7f39803f6b80 1 Processor -- start 2024-06-13T11:34:34.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.253+0000 7f39803f6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d38fe240 0x5622d390a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.253+0000 7f39803f6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d3903b90 0x5622d3907580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.253+0000 7f39803f6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d39044b0 0x5622d3907ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.253+0000 7f39803f6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5622d37ebf60 con 0x5622d38fe240 2024-06-13T11:34:34.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.253+0000 7f39803f6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5622d384bac0 con 0x5622d39044b0 2024-06-13T11:34:34.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.253+0000 7f39803f6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5622d390ae30 con 0x5622d3903b90 2024-06-13T11:34:34.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.253+0000 7f39803f6b80 10 client.0 _ll_register_callbacks cb 0x5622d37e5380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:34:34.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.254+0000 7f396ea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d38fe240 0x5622d390a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.254+0000 7f396ea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d38fe240 0x5622d390a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38722/0 (socket says 172.21.15.2:38722) 2024-06-13T11:34:34.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.254+0000 7f396ea00700 1 -- 172.21.15.2:0/1057467030 learned_addr learned my addr 172.21.15.2:0/1057467030 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:34.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.254+0000 7f396f400700 1 --2- 172.21.15.2:0/1057467030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d39044b0 0x5622d3907ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.254+0000 7f396e000700 1 --2- 172.21.15.2:0/1057467030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d3903b90 0x5622d3907580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.254+0000 7f396ea00700 1 -- 172.21.15.2:0/1057467030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d3903b90 msgr2=0x5622d3907580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:34.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.254+0000 7f396ea00700 1 --2- 172.21.15.2:0/1057467030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d3903b90 0x5622d3907580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.254+0000 7f396ea00700 1 -- 172.21.15.2:0/1057467030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d39044b0 msgr2=0x5622d3907ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.254+0000 7f396ea00700 1 --2- 172.21.15.2:0/1057467030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d39044b0 0x5622d3907ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.254+0000 7f396ea00700 1 -- 172.21.15.2:0/1057467030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622d379e8d0 con 0x5622d38fe240 2024-06-13T11:34:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.254+0000 7f396ea00700 1 --2- 172.21.15.2:0/1057467030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d38fe240 0x5622d390a280 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f39600cd200 tx=0x7f39600ccc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117dec74fe668c6a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.254+0000 7f3958c00700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T11:34:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.255+0000 7f3958c00700 1 -- 172.21.15.2:0/1057467030 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39600b9060 con 0x5622d38fe240 2024-06-13T11:34:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.255+0000 7f3958c00700 1 -- 172.21.15.2:0/1057467030 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7f396009b0b0 con 0x5622d38fe240 2024-06-13T11:34:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.255+0000 7f39803f6b80 1 -- 172.21.15.2:0/1057467030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f396009bcb0 con 0x5622d38fe240 2024-06-13T11:34:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.255+0000 7f3958c00700 1 -- 172.21.15.2:0/1057467030 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3960097cf0 con 0x5622d38fe240 2024-06-13T11:34:34.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.255+0000 7f39803f6b80 10 client.16461 fetch_fsmap learned FSMap version 31 2024-06-13T11:34:34.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.255+0000 7f39803f6b80 1 -- 172.21.15.2:0/1057467030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5622d3915660 con 0x5622d38fe240 2024-06-13T11:34:34.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.255+0000 7f3958c00700 1 -- 172.21.15.2:0/1057467030 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f396009bcb0 con 0x5622d38fe240 2024-06-13T11:34:34.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.255+0000 7f3958c00700 1 -- 172.21.15.2:0/1057467030 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f39600a0f90 con 0x5622d38fe240 2024-06-13T11:34:34.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.255+0000 7f39803f6b80 10 client.16461 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:34:34.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.255+0000 7f39803f6b80 10 client.16461 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:34:34.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.256+0000 7f39803f6b80 20 client.16461 populate_metadata read hostname 'smithi002' 2024-06-13T11:34:34.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.256+0000 7f39803f6b80 1 --2- 172.21.15.2:0/1057467030 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5622d3917b30 0x5622d3919f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.256+0000 7f39803f6b80 4 client.16461 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:34:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.256+0000 7f39803f6b80 1 -- 172.21.15.2:0/1057467030 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622d385d000 con 0x5622d3917b30 2024-06-13T11:34:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.256+0000 7f396e000700 1 --2- 172.21.15.2:0/1057467030 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5622d3917b30 0x5622d3919f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.256+0000 7f396e000700 1 --2- 172.21.15.2:0/1057467030 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5622d3917b30 0x5622d3919f20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=761c5692a47fbf3e server_cookie=3d575f6571140b1 in_seq=0 out_seq=0 2024-06-13T11:34:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.256+0000 7f3958c00700 10 client.16461 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:34:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.257+0000 7f3958c00700 1 -- 172.21.15.2:0/1057467030 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5622d385d000 con 0x5622d3917b30 2024-06-13T11:34:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.257+0000 7f3958c00700 10 client.16461 handle_command_reply: tid=0 2024-06-13T11:34:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.257+0000 7f39803f6b80 1 client.16461 shutdown 2024-06-13T11:34:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.258+0000 7f39803f6b80 1 -- 172.21.15.2:0/1057467030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d38fe240 msgr2=0x5622d390a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.258+0000 7f39803f6b80 1 --2- 172.21.15.2:0/1057467030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d38fe240 0x5622d390a280 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f39600cd200 tx=0x7f39600ccc20 comp rx=0 tx=0).stop 2024-06-13T11:34:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.258+0000 7f39803f6b80 1 -- 172.21.15.2:0/1057467030 shutdown_connections 2024-06-13T11:34:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.258+0000 7f39803f6b80 1 --2- 172.21.15.2:0/1057467030 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5622d3917b30 0x5622d3919f20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.258+0000 7f39803f6b80 1 --2- 172.21.15.2:0/1057467030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d38fe240 0x5622d390a280 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.258+0000 7f39803f6b80 1 --2- 172.21.15.2:0/1057467030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d39044b0 0x5622d3907ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.258+0000 7f39803f6b80 1 --2- 172.21.15.2:0/1057467030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d3903b90 0x5622d3907580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.258+0000 7f3958c00700 0 client.16461 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:34:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.258+0000 7f39803f6b80 1 -- 172.21.15.2:0/1057467030 >> 172.21.15.2:0/1057467030 conn(0x5622d382a170 msgr2=0x5622d38f2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.258+0000 7f39803f6b80 1 -- 172.21.15.2:0/1057467030 shutdown_connections 2024-06-13T11:34:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.258+0000 7f39803f6b80 1 -- 172.21.15.2:0/1057467030 wait complete. 2024-06-13T11:34:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.258+0000 7f39803f6b80 20 client.16461 trim_cache size 0 max 16384 2024-06-13T11:34:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.275+0000 7f39803f6b80 1 Processor -- start 2024-06-13T11:34:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.275+0000 7f39803f6b80 1 -- start start 2024-06-13T11:34:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f39803f6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d38fe240 0x5622d38fdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f39803f6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d3903b90 0x5622d38f3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f39803f6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d39044b0 0x5622d3909dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f39803f6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f39701b31b0 con 0x5622d38fe240 2024-06-13T11:34:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f39803f6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f39701b0a40 con 0x5622d39044b0 2024-06-13T11:34:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f39803f6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f39701ae8b0 con 0x5622d3903b90 2024-06-13T11:34:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f396ea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d38fe240 0x5622d38fdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f396ea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d38fe240 0x5622d38fdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38732/0 (socket says 172.21.15.2:38732) 2024-06-13T11:34:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f396ea00700 1 -- 172.21.15.2:0/3304500328 learned_addr learned my addr 172.21.15.2:0/3304500328 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f396f400700 1 --2- 172.21.15.2:0/3304500328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d39044b0 0x5622d3909dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f396e000700 1 --2- 172.21.15.2:0/3304500328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d3903b90 0x5622d38f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f396ea00700 1 -- 172.21.15.2:0/3304500328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d3903b90 msgr2=0x5622d38f3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f396ea00700 1 --2- 172.21.15.2:0/3304500328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d3903b90 0x5622d38f3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f396ea00700 1 -- 172.21.15.2:0/3304500328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d39044b0 msgr2=0x5622d3909dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f396ea00700 1 --2- 172.21.15.2:0/3304500328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d39044b0 0x5622d3909dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f396ea00700 1 -- 172.21.15.2:0/3304500328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622d39041c0 con 0x5622d38fe240 2024-06-13T11:34:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.276+0000 7f396f400700 1 --2- 172.21.15.2:0/3304500328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d39044b0 0x5622d3909dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:34:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.277+0000 7f396ea00700 1 --2- 172.21.15.2:0/3304500328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d38fe240 0x5622d38fdd00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f396009b750 tx=0x7f3960009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce52464c3dc49a17 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.277+0000 7f395b400700 1 -- 172.21.15.2:0/3304500328 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39600b3070 con 0x5622d38fe240 2024-06-13T11:34:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.277+0000 7f395b400700 1 -- 172.21.15.2:0/3304500328 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39600a46c0 con 0x5622d38fe240 2024-06-13T11:34:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.277+0000 7f395b400700 1 -- 172.21.15.2:0/3304500328 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39600b9020 con 0x5622d38fe240 2024-06-13T11:34:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.278+0000 7f39803f6b80 1 -- 172.21.15.2:0/3304500328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d38fe240 msgr2=0x5622d38fdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.278+0000 7f39803f6b80 1 --2- 172.21.15.2:0/3304500328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d38fe240 0x5622d38fdd00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f396009b750 tx=0x7f3960009820 comp rx=0 tx=0).stop 2024-06-13T11:34:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.278+0000 7f39803f6b80 1 -- 172.21.15.2:0/3304500328 shutdown_connections 2024-06-13T11:34:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.278+0000 7f39803f6b80 1 --2- 172.21.15.2:0/3304500328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d38fe240 0x5622d38fdd00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.278+0000 7f39803f6b80 1 --2- 172.21.15.2:0/3304500328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d39044b0 0x5622d3909dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.278+0000 7f39803f6b80 1 --2- 172.21.15.2:0/3304500328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d3903b90 0x5622d38f3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.278+0000 7f39803f6b80 1 -- 172.21.15.2:0/3304500328 >> 172.21.15.2:0/3304500328 conn(0x5622d382a170 msgr2=0x5622d3902f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.278+0000 7f39803f6b80 1 -- 172.21.15.2:0/3304500328 shutdown_connections 2024-06-13T11:34:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.278+0000 7f39803f6b80 1 -- 172.21.15.2:0/3304500328 wait complete. 2024-06-13T11:34:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.278+0000 7f39803f6b80 1 -- start start 2024-06-13T11:34:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.279+0000 7f39803f6b80 1 Processor -- start 2024-06-13T11:34:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.279+0000 7f39803f6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d38fe240 0x5622d3919e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.279+0000 7f39803f6b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d3903b90 0x5622d391a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.279+0000 7f39803f6b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d39044b0 0x5622d391a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.279+0000 7f39803f6b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f39701aef00 con 0x5622d39044b0 2024-06-13T11:34:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.279+0000 7f39803f6b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f39701b0370 con 0x5622d3903b90 2024-06-13T11:34:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.279+0000 7f39803f6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f39701af5d0 con 0x5622d38fe240 2024-06-13T11:34:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.279+0000 7f39803f6b80 10 client.0 _ll_register_callbacks cb 0x5622d37e5380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:34:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.279+0000 7f396f400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d39044b0 0x5622d391a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.279+0000 7f396ea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d38fe240 0x5622d3919e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.279+0000 7f396e000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d3903b90 0x5622d391a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.279+0000 7f396ea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d38fe240 0x5622d3919e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:56894/0 (socket says 172.21.15.2:56894) 2024-06-13T11:34:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.279+0000 7f396ea00700 1 -- 172.21.15.2:0/3832524954 learned_addr learned my addr 172.21.15.2:0/3832524954 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.280+0000 7f396ea00700 1 -- 172.21.15.2:0/3832524954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d3903b90 msgr2=0x5622d391a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.280+0000 7f396ea00700 1 --2- 172.21.15.2:0/3832524954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d3903b90 0x5622d391a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.280+0000 7f396ea00700 1 -- 172.21.15.2:0/3832524954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d39044b0 msgr2=0x5622d391a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.280+0000 7f396ea00700 1 --2- 172.21.15.2:0/3832524954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d39044b0 0x5622d391a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.280+0000 7f396ea00700 1 -- 172.21.15.2:0/3832524954 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622d3980620 con 0x5622d38fe240 2024-06-13T11:34:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.280+0000 7f396ea00700 1 --2- 172.21.15.2:0/3832524954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d38fe240 0x5622d3919e70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f396009b700 tx=0x7f396009b950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a013ea2c76c3fc server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.280+0000 7f3958c00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-13T11:34:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.280+0000 7f3958c00700 1 -- 172.21.15.2:0/3832524954 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39600b3030 con 0x5622d38fe240 2024-06-13T11:34:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.280+0000 7f39803f6b80 1 -- 172.21.15.2:0/3832524954 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39600a46c0 con 0x5622d38fe240 2024-06-13T11:34:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.280+0000 7f3958c00700 1 -- 172.21.15.2:0/3832524954 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7f39600977a0 con 0x5622d38fe240 2024-06-13T11:34:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.281+0000 7f3958c00700 1 -- 172.21.15.2:0/3832524954 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f39600b9070 con 0x5622d38fe240 2024-06-13T11:34:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.281+0000 7f39803f6b80 10 client.26605 fetch_fsmap learned FSMap version 31 2024-06-13T11:34:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.281+0000 7f39803f6b80 1 -- 172.21.15.2:0/3832524954 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5622d3980620 con 0x5622d38fe240 2024-06-13T11:34:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.281+0000 7f3958c00700 1 -- 172.21.15.2:0/3832524954 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39600a46c0 con 0x5622d38fe240 2024-06-13T11:34:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.281+0000 7f3958c00700 1 -- 172.21.15.2:0/3832524954 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f39600a4910 con 0x5622d38fe240 2024-06-13T11:34:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.281+0000 7f39803f6b80 10 client.26605 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:34:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.281+0000 7f39803f6b80 10 client.26605 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-06-13T11:34:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.281+0000 7f39803f6b80 20 client.26605 populate_metadata read hostname 'smithi002' 2024-06-13T11:34:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.281+0000 7f39803f6b80 1 --2- 172.21.15.2:0/3832524954 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5622d3981aa0 0x5622d3983e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.281+0000 7f39803f6b80 4 client.26605 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:34:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.281+0000 7f39803f6b80 1 -- 172.21.15.2:0/3832524954 --> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5622d3857580 con 0x5622d3981aa0 2024-06-13T11:34:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.282+0000 7f396e000700 1 --2- 172.21.15.2:0/3832524954 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5622d3981aa0 0x5622d3983e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.282+0000 7f396e000700 1 --2- 172.21.15.2:0/3832524954 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5622d3981aa0 0x5622d3983e90 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=95390c88d3ea1f36 server_cookie=99f2808997e1edb3 in_seq=0 out_seq=0 2024-06-13T11:34:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.282+0000 7f3958c00700 10 client.26605 ms_handle_connect on v2:172.21.15.77:6838/45629124 2024-06-13T11:34:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.282+0000 7f3958c00700 1 -- 172.21.15.2:0/3832524954 <== mds.1 v2:172.21.15.77:6838/45629124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5622d3857580 con 0x5622d3981aa0 2024-06-13T11:34:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.282+0000 7f3958c00700 10 client.26605 handle_command_reply: tid=0 2024-06-13T11:34:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.282+0000 7f39803f6b80 1 client.26605 shutdown 2024-06-13T11:34:34.319 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:34:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.282+0000 7f39803f6b80 1 -- 172.21.15.2:0/3832524954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d38fe240 msgr2=0x5622d3919e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.282+0000 7f39803f6b80 1 --2- 172.21.15.2:0/3832524954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d38fe240 0x5622d3919e70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f396009b700 tx=0x7f396009b950 comp rx=0 tx=0).stop 2024-06-13T11:34:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.283+0000 7f39803f6b80 1 -- 172.21.15.2:0/3832524954 shutdown_connections 2024-06-13T11:34:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.283+0000 7f39803f6b80 1 --2- 172.21.15.2:0/3832524954 >> [v2:172.21.15.77:6838/45629124,v1:172.21.15.77:6839/45629124] conn(0x5622d3981aa0 0x5622d3983e90 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.283+0000 7f39803f6b80 1 --2- 172.21.15.2:0/3832524954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5622d39044b0 0x5622d391a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.283+0000 7f39803f6b80 1 --2- 172.21.15.2:0/3832524954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5622d38fe240 0x5622d3919e70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.283+0000 7f3958c00700 0 client.26605 ms_handle_reset on v2:172.21.15.77:6838/45629124 2024-06-13T11:34:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.283+0000 7f39803f6b80 1 --2- 172.21.15.2:0/3832524954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622d3903b90 0x5622d391a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.283+0000 7f39803f6b80 1 -- 172.21.15.2:0/3832524954 >> 172.21.15.2:0/3832524954 conn(0x5622d382a170 msgr2=0x5622d38f2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.283+0000 7f39803f6b80 1 -- 172.21.15.2:0/3832524954 shutdown_connections 2024-06-13T11:34:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.283+0000 7f39803f6b80 1 -- 172.21.15.2:0/3832524954 wait complete. 2024-06-13T11:34:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.283+0000 7f39803f6b80 20 client.26605 trim_cache size 0 max 16384 2024-06-13T11:34:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.283+0000 7f3975a00700 1 -- 172.21.15.2:0/3170226231 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f39540a2e10 msgr2=0x7f39540a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.283+0000 7f3975a00700 1 --2- 172.21.15.2:0/3170226231 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f39540a2e10 0x7f39540a52d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f395c0098e0 tx=0x7f395c005960 comp rx=0 tx=0).stop 2024-06-13T11:34:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.284+0000 7f3975a00700 1 -- 172.21.15.2:0/3170226231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f397006aa30 msgr2=0x7f397019aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.284+0000 7f3975a00700 1 --2- 172.21.15.2:0/3170226231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f397006aa30 0x7f397019aec0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f396000e9a0 tx=0x7f396000ecb0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.284+0000 7f3975a00700 1 -- 172.21.15.2:0/3170226231 shutdown_connections 2024-06-13T11:34:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.284+0000 7f3975a00700 1 --2- 172.21.15.2:0/3170226231 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f39540a2e10 0x7f39540a52d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.284+0000 7f3975a00700 1 --2- 172.21.15.2:0/3170226231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f397010ef30 0x7f397019f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.284+0000 7f3975a00700 1 --2- 172.21.15.2:0/3170226231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f397006aa30 0x7f397019aec0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.284+0000 7f3975a00700 1 --2- 172.21.15.2:0/3170226231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f397006b350 0x7f397019b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.284+0000 7f3975a00700 1 -- 172.21.15.2:0/3170226231 >> 172.21.15.2:0/3170226231 conn(0x7f3970078300 msgr2=0x7f39701103c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.284+0000 7f3975a00700 1 -- 172.21.15.2:0/3170226231 shutdown_connections 2024-06-13T11:34:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:34.284+0000 7f3975a00700 1 -- 172.21.15.2:0/3170226231 wait complete. 2024-06-13T11:34:35.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-13T11:34:35.824 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:34:36.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:35 smithi077 ceph-mon[36410]: pgmap v335: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:36.044 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:35 smithi002 ceph-mon[32210]: pgmap v335: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:36.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:35 smithi178 ceph-mon[36913]: pgmap v335: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:37.890 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:37 smithi002 ceph-mon[32210]: pgmap v336: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:38.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:37 smithi077 ceph-mon[36410]: pgmap v336: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:38.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:37 smithi178 ceph-mon[36913]: pgmap v336: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:38.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.272+0000 7ffb06800700 1 -- 172.21.15.2:0/2970187020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb0006aa00 msgr2=0x7ffb0006ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.272+0000 7ffb06800700 1 --2- 172.21.15.2:0/2970187020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb0006aa00 0x7ffb0006ae80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0098f0 tx=0x7ffaec009c00 comp rx=0 tx=0).stop 2024-06-13T11:34:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.272+0000 7ffb06800700 1 -- 172.21.15.2:0/2970187020 shutdown_connections 2024-06-13T11:34:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.272+0000 7ffb06800700 1 --2- 172.21.15.2:0/2970187020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb001084f0 0x7ffb001088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.272+0000 7ffb06800700 1 --2- 172.21.15.2:0/2970187020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb0006b3c0 0x7ffb0010f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.272+0000 7ffb06800700 1 --2- 172.21.15.2:0/2970187020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb0006aa00 0x7ffb0006ae80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.272+0000 7ffb06800700 1 -- 172.21.15.2:0/2970187020 >> 172.21.15.2:0/2970187020 conn(0x7ffb00078300 msgr2=0x7ffb00078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:38.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.272+0000 7ffb06800700 1 -- 172.21.15.2:0/2970187020 shutdown_connections 2024-06-13T11:34:38.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.272+0000 7ffb06800700 1 -- 172.21.15.2:0/2970187020 wait complete. 2024-06-13T11:34:38.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.273+0000 7ffb06800700 1 Processor -- start 2024-06-13T11:34:38.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.273+0000 7ffb06800700 1 -- start start 2024-06-13T11:34:38.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.274+0000 7ffb06800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb0006aa00 0x7ffb0019af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.274+0000 7ffb06800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb0006b3c0 0x7ffb0019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.274+0000 7ffb06800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb001084f0 0x7ffb0019f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.274+0000 7ffb06800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffb001127a0 con 0x7ffb001084f0 2024-06-13T11:34:38.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.274+0000 7ffb06800700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffb00112620 con 0x7ffb0006aa00 2024-06-13T11:34:38.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.274+0000 7ffb06800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ffb00112920 con 0x7ffb0006b3c0 2024-06-13T11:34:38.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.274+0000 7ffafea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb0006b3c0 0x7ffb0019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.274+0000 7ffafea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb0006b3c0 0x7ffb0019b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:48560/0 (socket says 172.21.15.2:48560) 2024-06-13T11:34:38.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.274+0000 7ffafea00700 1 -- 172.21.15.2:0/1964833855 learned_addr learned my addr 172.21.15.2:0/1964833855 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:38.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.274+0000 7ffaffe00700 1 --2- 172.21.15.2:0/1964833855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb001084f0 0x7ffb0019f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.274+0000 7ffaff400700 1 --2- 172.21.15.2:0/1964833855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb0006aa00 0x7ffb0019af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.275+0000 7ffafea00700 1 -- 172.21.15.2:0/1964833855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb0006aa00 msgr2=0x7ffb0019af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:38.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.275+0000 7ffafea00700 1 --2- 172.21.15.2:0/1964833855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb0006aa00 0x7ffb0019af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.275+0000 7ffafea00700 1 -- 172.21.15.2:0/1964833855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb001084f0 msgr2=0x7ffb0019f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:38.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.275+0000 7ffafea00700 1 --2- 172.21.15.2:0/1964833855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb001084f0 0x7ffb0019f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.275+0000 7ffafea00700 1 -- 172.21.15.2:0/1964833855 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0019ff80 con 0x7ffb0006b3c0 2024-06-13T11:34:38.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.275+0000 7ffafea00700 1 --2- 172.21.15.2:0/1964833855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb0006b3c0 0x7ffb0019b4b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffaec005950 tx=0x7ffaec005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:38.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.276+0000 7ffaf7e00700 1 -- 172.21.15.2:0/1964833855 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec0052e0 con 0x7ffb0006b3c0 2024-06-13T11:34:38.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.276+0000 7ffaf7e00700 1 -- 172.21.15.2:0/1964833855 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaec00ba40 con 0x7ffb0006b3c0 2024-06-13T11:34:38.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.276+0000 7ffaf7e00700 1 -- 172.21.15.2:0/1964833855 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec003b80 con 0x7ffb0006b3c0 2024-06-13T11:34:38.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.276+0000 7ffb06800700 1 -- 172.21.15.2:0/1964833855 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb001a0210 con 0x7ffb0006b3c0 2024-06-13T11:34:38.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.276+0000 7ffb06800700 1 -- 172.21.15.2:0/1964833855 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb001a7af0 con 0x7ffb0006b3c0 2024-06-13T11:34:38.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.281+0000 7ffaf7e00700 1 -- 172.21.15.2:0/1964833855 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7ffaec005480 con 0x7ffb0006b3c0 2024-06-13T11:34:38.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.282+0000 7ffb11224b80 1 Processor -- start 2024-06-13T11:34:38.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.282+0000 7ffb11224b80 1 -- start start 2024-06-13T11:34:38.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.283+0000 7ffaf7e00700 1 --2- 172.21.15.2:0/1964833855 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ffae40a2e10 0x7ffae40a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.283+0000 7ffb11224b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7ab90 0x55be33d7af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.283+0000 7ffb11224b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 0x55be33d74d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.283+0000 7ffb11224b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 0x55be33d75680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.283+0000 7ffb11224b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55be33c83a10 con 0x55be33d7b4b0 2024-06-13T11:34:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.283+0000 7ffb11224b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55be33cc6b00 con 0x55be33d75240 2024-06-13T11:34:38.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.283+0000 7ffb11224b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55be33c818f0 con 0x55be33d7ab90 2024-06-13T11:34:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.283+0000 7ffaf7e00700 1 -- 172.21.15.2:0/1964833855 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7ffaec0d08a0 con 0x7ffb0006b3c0 2024-06-13T11:34:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.283+0000 7ffaff400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7ab90 0x55be33d7af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.283+0000 7ffaff400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7ab90 0x55be33d7af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:48566/0 (socket says 172.21.15.2:48566) 2024-06-13T11:34:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.283+0000 7ffaff400700 1 -- 172.21.15.2:0/11919032 learned_addr learned my addr 172.21.15.2:0/11919032 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.283+0000 7ffafea00700 1 --2- 172.21.15.2:0/11919032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 0x55be33d74d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.284+0000 7ffaffe00700 1 --2- 172.21.15.2:0/1964833855 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ffae40a2e10 0x7ffae40a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.284+0000 7ffaff400700 1 -- 172.21.15.2:0/11919032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 msgr2=0x55be33d75680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:38.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.284+0000 7ffaff400700 1 --2- 172.21.15.2:0/11919032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 0x55be33d75680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.284+0000 7ffaff400700 1 -- 172.21.15.2:0/11919032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 msgr2=0x55be33d74d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:38.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.284+0000 7ffaff400700 1 --2- 172.21.15.2:0/11919032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 0x55be33d74d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.284+0000 7ffaff400700 1 -- 172.21.15.2:0/11919032 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be33c6ef90 con 0x55be33d7ab90 2024-06-13T11:34:38.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.285+0000 7ffaffe00700 1 --2- 172.21.15.2:0/1964833855 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ffae40a2e10 0x7ffae40a52d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009fd0 tx=0x7ffaf8009920 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:38.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.285+0000 7ffaff400700 1 --2- 172.21.15.2:0/11919032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7ab90 0x55be33d7af70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00046c0 tx=0x7ffaf00116c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bbf08aa66a9778d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:38.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.285+0000 7ffaf4c00700 1 -- 172.21.15.2:0/11919032 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0011cd0 con 0x55be33d7ab90 2024-06-13T11:34:38.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.285+0000 7ffaf4c00700 1 -- 172.21.15.2:0/11919032 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaf0011e70 con 0x55be33d7ab90 2024-06-13T11:34:38.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.285+0000 7ffaf4c00700 1 -- 172.21.15.2:0/11919032 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf000f900 con 0x55be33d7ab90 2024-06-13T11:34:38.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.286+0000 7ffb11224b80 1 -- 172.21.15.2:0/11919032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7ab90 msgr2=0x55be33d7af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:38.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.286+0000 7ffb11224b80 1 --2- 172.21.15.2:0/11919032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7ab90 0x55be33d7af70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00046c0 tx=0x7ffaf00116c0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.286+0000 7ffb11224b80 1 -- 172.21.15.2:0/11919032 shutdown_connections 2024-06-13T11:34:38.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.286+0000 7ffb11224b80 1 --2- 172.21.15.2:0/11919032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 0x55be33d75680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.286+0000 7ffb11224b80 1 --2- 172.21.15.2:0/11919032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7ab90 0x55be33d7af70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.286+0000 7ffb11224b80 1 --2- 172.21.15.2:0/11919032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 0x55be33d74d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.286+0000 7ffb11224b80 1 -- 172.21.15.2:0/11919032 >> 172.21.15.2:0/11919032 conn(0x55be33ca1170 msgr2=0x55be33d6fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:38.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.287+0000 7ffb11224b80 1 -- 172.21.15.2:0/11919032 shutdown_connections 2024-06-13T11:34:38.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.287+0000 7ffb11224b80 1 -- 172.21.15.2:0/11919032 wait complete. 2024-06-13T11:34:38.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.287+0000 7ffb11224b80 1 -- start start 2024-06-13T11:34:38.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.287+0000 7ffb11224b80 1 Processor -- start 2024-06-13T11:34:38.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.288+0000 7ffb11224b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 0x55be33d812b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.288+0000 7ffb11224b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7ab90 0x55be33d7e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.288+0000 7ffb11224b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7b4b0 0x55be33d7eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.288+0000 7ffb11224b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55be33c62f60 con 0x55be33d7ab90 2024-06-13T11:34:38.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.288+0000 7ffb11224b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55be33cc2ac0 con 0x55be33d75240 2024-06-13T11:34:38.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.288+0000 7ffb11224b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55be33d81e90 con 0x55be33d7b4b0 2024-06-13T11:34:38.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.288+0000 7ffb11224b80 10 client.0 _ll_register_callbacks cb 0x55be33c5c380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:34:38.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.288+0000 7ffafea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7ab90 0x55be33d7e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.288+0000 7ffaff400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 0x55be33d812b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.289+0000 7ffaff400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 0x55be33d812b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:44344/0 (socket says 172.21.15.2:44344) 2024-06-13T11:34:38.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.289+0000 7ffaff400700 1 -- 172.21.15.2:0/2703698221 learned_addr learned my addr 172.21.15.2:0/2703698221 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:38.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.289+0000 7ffaffe00700 1 --2- 172.21.15.2:0/2703698221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7b4b0 0x55be33d7eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.289+0000 7ffaff400700 1 -- 172.21.15.2:0/2703698221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7b4b0 msgr2=0x55be33d7eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:38.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.289+0000 7ffaff400700 1 --2- 172.21.15.2:0/2703698221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7b4b0 0x55be33d7eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.289+0000 7ffaff400700 1 -- 172.21.15.2:0/2703698221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7ab90 msgr2=0x55be33d7e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:38.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.289+0000 7ffaff400700 1 --2- 172.21.15.2:0/2703698221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7ab90 0x55be33d7e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.289+0000 7ffaff400700 1 -- 172.21.15.2:0/2703698221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be33c158d0 con 0x55be33d75240 2024-06-13T11:34:38.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.289+0000 7ffaff400700 1 --2- 172.21.15.2:0/2703698221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 0x55be33d812b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0000c00 tx=0x7ffaf0005750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9247a82773c53382 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:38.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.289+0000 7ffae9600700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:34:38.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.290+0000 7ffae9600700 1 -- 172.21.15.2:0/2703698221 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0029020 con 0x55be33d75240 2024-06-13T11:34:38.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.290+0000 7ffae9600700 1 -- 172.21.15.2:0/2703698221 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7ffaf0009d50 con 0x55be33d75240 2024-06-13T11:34:38.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.290+0000 7ffb11224b80 1 -- 172.21.15.2:0/2703698221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaf0011e70 con 0x55be33d75240 2024-06-13T11:34:38.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.290+0000 7ffae9600700 1 -- 172.21.15.2:0/2703698221 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffaf0034050 con 0x55be33d75240 2024-06-13T11:34:38.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.290+0000 7ffb11224b80 10 client.26579 fetch_fsmap learned FSMap version 31 2024-06-13T11:34:38.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.290+0000 7ffb11224b80 1 -- 172.21.15.2:0/2703698221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55be33d8c6c0 con 0x55be33d75240 2024-06-13T11:34:38.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.291+0000 7ffae9600700 1 -- 172.21.15.2:0/2703698221 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaf0011e70 con 0x55be33d75240 2024-06-13T11:34:38.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.291+0000 7ffae9600700 1 -- 172.21.15.2:0/2703698221 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7ffaf0012970 con 0x55be33d75240 2024-06-13T11:34:38.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.291+0000 7ffb11224b80 10 client.26579 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:34:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.291+0000 7ffb11224b80 10 client.26579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:34:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.291+0000 7ffb11224b80 20 client.26579 populate_metadata read hostname 'smithi002' 2024-06-13T11:34:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.291+0000 7ffb11224b80 1 --2- 172.21.15.2:0/2703698221 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55be33d8ed00 0x55be33d910f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.291+0000 7ffb11224b80 4 client.26579 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T11:34:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.291+0000 7ffb11224b80 1 -- 172.21.15.2:0/2703698221 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be33cd4000 con 0x55be33d8ed00 2024-06-13T11:34:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.291+0000 7ffafea00700 1 --2- 172.21.15.2:0/2703698221 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55be33d8ed00 0x55be33d910f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.292+0000 7ffafea00700 1 --2- 172.21.15.2:0/2703698221 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55be33d8ed00 0x55be33d910f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=871c85d1a6bb3931 server_cookie=d73c495a10f9af48 in_seq=0 out_seq=0 2024-06-13T11:34:38.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.292+0000 7ffae9600700 10 client.26579 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:34:38.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.293+0000 7ffae9600700 1 -- 172.21.15.2:0/2703698221 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55be33cd4000 con 0x55be33d8ed00 2024-06-13T11:34:38.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.293+0000 7ffae9600700 10 client.26579 handle_command_reply: tid=0 2024-06-13T11:34:38.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.293+0000 7ffb11224b80 1 client.26579 shutdown 2024-06-13T11:34:38.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.293+0000 7ffb11224b80 1 -- 172.21.15.2:0/2703698221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 msgr2=0x55be33d812b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:38.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.293+0000 7ffb11224b80 1 --2- 172.21.15.2:0/2703698221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 0x55be33d812b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0000c00 tx=0x7ffaf0005750 comp rx=0 tx=0).stop 2024-06-13T11:34:38.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.293+0000 7ffb11224b80 1 -- 172.21.15.2:0/2703698221 shutdown_connections 2024-06-13T11:34:38.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.293+0000 7ffb11224b80 1 --2- 172.21.15.2:0/2703698221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7b4b0 0x55be33d7eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.293+0000 7ffb11224b80 1 --2- 172.21.15.2:0/2703698221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 0x55be33d812b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.293+0000 7ffb11224b80 1 --2- 172.21.15.2:0/2703698221 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55be33d8ed00 0x55be33d910f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.293+0000 7ffb11224b80 1 --2- 172.21.15.2:0/2703698221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7ab90 0x55be33d7e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.293+0000 7ffae9600700 0 client.26579 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:34:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.293+0000 7ffb11224b80 1 -- 172.21.15.2:0/2703698221 >> 172.21.15.2:0/2703698221 conn(0x55be33ca1170 msgr2=0x55be33d69790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.294+0000 7ffb11224b80 1 -- 172.21.15.2:0/2703698221 shutdown_connections 2024-06-13T11:34:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.294+0000 7ffb11224b80 1 -- 172.21.15.2:0/2703698221 wait complete. 2024-06-13T11:34:38.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.294+0000 7ffb11224b80 20 client.26579 trim_cache size 0 max 16384 2024-06-13T11:34:38.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.311+0000 7ffb11224b80 1 Processor -- start 2024-06-13T11:34:38.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.311+0000 7ffb11224b80 1 -- start start 2024-06-13T11:34:38.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.311+0000 7ffb11224b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d75240 0x55be33d74d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.312+0000 7ffb11224b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d7ab90 0x55be33d6a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.312+0000 7ffb11224b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 0x55be33d7bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.312+0000 7ffb11224b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffb001b2fd0 con 0x55be33d7b4b0 2024-06-13T11:34:38.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.312+0000 7ffb11224b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffb001b0860 con 0x55be33d7ab90 2024-06-13T11:34:38.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.312+0000 7ffb11224b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ffb001ae6d0 con 0x55be33d75240 2024-06-13T11:34:38.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.312+0000 7ffaffe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 0x55be33d7bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.312+0000 7ffafea00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d7ab90 0x55be33d6a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.312+0000 7ffaffe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 0x55be33d7bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49362/0 (socket says 172.21.15.2:49362) 2024-06-13T11:34:38.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.312+0000 7ffaffe00700 1 -- 172.21.15.2:0/2855249779 learned_addr learned my addr 172.21.15.2:0/2855249779 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:38.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.312+0000 7ffaff400700 1 --2- 172.21.15.2:0/2855249779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d75240 0x55be33d74d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.313+0000 7ffaffe00700 1 -- 172.21.15.2:0/2855249779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d75240 msgr2=0x55be33d74d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.313+0000 7ffaffe00700 1 --2- 172.21.15.2:0/2855249779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d75240 0x55be33d74d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.313+0000 7ffaffe00700 1 -- 172.21.15.2:0/2855249779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d7ab90 msgr2=0x55be33d6a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.313+0000 7ffaffe00700 1 --2- 172.21.15.2:0/2855249779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d7ab90 0x55be33d6a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.313+0000 7ffaffe00700 1 -- 172.21.15.2:0/2855249779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be33d7c4e0 con 0x55be33d7b4b0 2024-06-13T11:34:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.313+0000 7ffaff400700 1 --2- 172.21.15.2:0/2855249779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d75240 0x55be33d74d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:34:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.313+0000 7ffafea00700 1 --2- 172.21.15.2:0/2855249779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d7ab90 0x55be33d6a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:34:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.313+0000 7ffaffe00700 1 --2- 172.21.15.2:0/2855249779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 0x55be33d7bfa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8004cd0 tx=0x7ffaf8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe220de2e33346d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.313+0000 7ffaebe00700 1 -- 172.21.15.2:0/2855249779 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf80056e0 con 0x55be33d7b4b0 2024-06-13T11:34:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.313+0000 7ffaebe00700 1 -- 172.21.15.2:0/2855249779 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaf8029070 con 0x55be33d7b4b0 2024-06-13T11:34:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.314+0000 7ffaebe00700 1 -- 172.21.15.2:0/2855249779 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8024680 con 0x55be33d7b4b0 2024-06-13T11:34:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.314+0000 7ffb11224b80 1 -- 172.21.15.2:0/2855249779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 msgr2=0x55be33d7bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.314+0000 7ffb11224b80 1 --2- 172.21.15.2:0/2855249779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 0x55be33d7bfa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8004cd0 tx=0x7ffaf8015000 comp rx=0 tx=0).stop 2024-06-13T11:34:38.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.315+0000 7ffb11224b80 1 -- 172.21.15.2:0/2855249779 shutdown_connections 2024-06-13T11:34:38.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.315+0000 7ffb11224b80 1 --2- 172.21.15.2:0/2855249779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 0x55be33d7bfa0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.315+0000 7ffb11224b80 1 --2- 172.21.15.2:0/2855249779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d75240 0x55be33d74d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.315+0000 7ffb11224b80 1 --2- 172.21.15.2:0/2855249779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d7ab90 0x55be33d6a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.315+0000 7ffb11224b80 1 -- 172.21.15.2:0/2855249779 >> 172.21.15.2:0/2855249779 conn(0x55be33ca1170 msgr2=0x55be33d7b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:38.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.315+0000 7ffb11224b80 1 -- 172.21.15.2:0/2855249779 shutdown_connections 2024-06-13T11:34:38.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.315+0000 7ffb11224b80 1 -- 172.21.15.2:0/2855249779 wait complete. 2024-06-13T11:34:38.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.315+0000 7ffb11224b80 1 -- start start 2024-06-13T11:34:38.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.316+0000 7ffb11224b80 1 Processor -- start 2024-06-13T11:34:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.316+0000 7ffb11224b80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 0x55be33d87410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.316+0000 7ffb11224b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7ab90 0x55be33d87950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.316+0000 7ffb11224b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 0x55be33d95d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.316+0000 7ffb11224b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffb001aed20 con 0x55be33d7b4b0 2024-06-13T11:34:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.316+0000 7ffb11224b80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffb001b0190 con 0x55be33d75240 2024-06-13T11:34:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.316+0000 7ffb11224b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ffb001af3f0 con 0x55be33d7ab90 2024-06-13T11:34:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.316+0000 7ffb11224b80 10 client.0 _ll_register_callbacks cb 0x55be33c5c380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T11:34:38.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.316+0000 7ffaffe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 0x55be33d95d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.317+0000 7ffaffe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 0x55be33d95d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49370/0 (socket says 172.21.15.2:49370) 2024-06-13T11:34:38.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.317+0000 7ffaffe00700 1 -- 172.21.15.2:0/1974300188 learned_addr learned my addr 172.21.15.2:0/1974300188 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:38.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.317+0000 7ffaff400700 1 --2- 172.21.15.2:0/1974300188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 0x55be33d87410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.317+0000 7ffafea00700 1 --2- 172.21.15.2:0/1974300188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7ab90 0x55be33d87950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.317+0000 7ffaff400700 1 -- 172.21.15.2:0/1974300188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7ab90 msgr2=0x55be33d87950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:38.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.317+0000 7ffaff400700 1 --2- 172.21.15.2:0/1974300188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7ab90 0x55be33d87950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.317+0000 7ffaff400700 1 -- 172.21.15.2:0/1974300188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 msgr2=0x55be33d95d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T11:34:38.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.317+0000 7ffaff400700 1 --2- 172.21.15.2:0/1974300188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 0x55be33d95d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.317+0000 7ffaff400700 1 -- 172.21.15.2:0/1974300188 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be33d965b0 con 0x55be33d75240 2024-06-13T11:34:38.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.317+0000 7ffafea00700 1 --2- 172.21.15.2:0/1974300188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7ab90 0x55be33d87950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:34:38.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.317+0000 7ffaff400700 1 --2- 172.21.15.2:0/1974300188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 0x55be33d87410 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000f4b0 tx=0x7ffaf0009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6cff743a3a8c2e7 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:38.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.317+0000 7ffae9600700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-06-13T11:34:38.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.318+0000 7ffae9600700 1 -- 172.21.15.2:0/1974300188 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0029040 con 0x55be33d75240 2024-06-13T11:34:38.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.318+0000 7ffb11224b80 1 -- 172.21.15.2:0/1974300188 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaf8029070 con 0x55be33d75240 2024-06-13T11:34:38.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.318+0000 7ffae9600700 1 -- 172.21.15.2:0/1974300188 <== mon.2 v2:172.21.15.77:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7ffaf000fcf0 con 0x55be33d75240 2024-06-13T11:34:38.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.318+0000 7ffae9600700 1 -- 172.21.15.2:0/1974300188 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffaf0045050 con 0x55be33d75240 2024-06-13T11:34:38.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.318+0000 7ffb11224b80 10 client.26585 fetch_fsmap learned FSMap version 31 2024-06-13T11:34:38.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.318+0000 7ffb11224b80 1 -- 172.21.15.2:0/1974300188 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55be33df9280 con 0x55be33d75240 2024-06-13T11:34:38.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.319+0000 7ffae9600700 1 -- 172.21.15.2:0/1974300188 <== mon.2 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaf8029070 con 0x55be33d75240 2024-06-13T11:34:38.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.319+0000 7ffae9600700 1 -- 172.21.15.2:0/1974300188 <== mon.2 v2:172.21.15.77:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7ffaf0040030 con 0x55be33d75240 2024-06-13T11:34:38.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.319+0000 7ffb11224b80 10 client.26585 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T11:34:38.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.319+0000 7ffb11224b80 10 client.26585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-06-13T11:34:38.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.319+0000 7ffb11224b80 20 client.26585 populate_metadata read hostname 'smithi002' 2024-06-13T11:34:38.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.319+0000 7ffb11224b80 1 --2- 172.21.15.2:0/1974300188 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55be33df9950 0x55be33dfbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:38.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.319+0000 7ffb11224b80 4 client.26585 mds_command: new command op to 24511 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-13T11:34:38.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.319+0000 7ffb11224b80 1 -- 172.21.15.2:0/1974300188 --> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55be33cce580 con 0x55be33df9950 2024-06-13T11:34:38.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.319+0000 7ffafea00700 1 --2- 172.21.15.2:0/1974300188 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55be33df9950 0x55be33dfbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:38.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.320+0000 7ffafea00700 1 --2- 172.21.15.2:0/1974300188 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55be33df9950 0x55be33dfbd70 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65a9079b61c23453 server_cookie=e8f1175f34aa1f89 in_seq=0 out_seq=0 2024-06-13T11:34:38.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.320+0000 7ffae9600700 10 client.26585 ms_handle_connect on v2:172.21.15.178:6838/970862278 2024-06-13T11:34:38.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.320+0000 7ffae9600700 1 -- 172.21.15.2:0/1974300188 <== mds.0 v2:172.21.15.178:6838/970862278 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55be33cce580 con 0x55be33df9950 2024-06-13T11:34:38.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.320+0000 7ffae9600700 10 client.26585 handle_command_reply: tid=0 2024-06-13T11:34:38.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.320+0000 7ffb11224b80 1 client.26585 shutdown 2024-06-13T11:34:38.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.320+0000 7ffb11224b80 1 -- 172.21.15.2:0/1974300188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 msgr2=0x55be33d87410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:38.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.320+0000 7ffb11224b80 1 --2- 172.21.15.2:0/1974300188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 0x55be33d87410 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000f4b0 tx=0x7ffaf0009f80 comp rx=0 tx=0).stop 2024-06-13T11:34:38.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.321+0000 7ffb11224b80 1 -- 172.21.15.2:0/1974300188 shutdown_connections 2024-06-13T11:34:38.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.321+0000 7ffb11224b80 1 --2- 172.21.15.2:0/1974300188 >> [v2:172.21.15.178:6838/970862278,v1:172.21.15.178:6839/970862278] conn(0x55be33df9950 0x55be33dfbd70 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.321+0000 7ffb11224b80 1 --2- 172.21.15.2:0/1974300188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55be33d7b4b0 0x55be33d95d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.321+0000 7ffb11224b80 1 --2- 172.21.15.2:0/1974300188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55be33d75240 0x55be33d87410 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.321+0000 7ffb11224b80 1 --2- 172.21.15.2:0/1974300188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be33d7ab90 0x55be33d87950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.321+0000 7ffae9600700 0 client.26585 ms_handle_reset on v2:172.21.15.178:6838/970862278 2024-06-13T11:34:38.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.321+0000 7ffb11224b80 1 -- 172.21.15.2:0/1974300188 >> 172.21.15.2:0/1974300188 conn(0x55be33ca1170 msgr2=0x55be33d7cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:38.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.321+0000 7ffb11224b80 1 -- 172.21.15.2:0/1974300188 shutdown_connections 2024-06-13T11:34:38.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.321+0000 7ffb11224b80 1 -- 172.21.15.2:0/1974300188 wait complete. 2024-06-13T11:34:38.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.321+0000 7ffb11224b80 20 client.26585 trim_cache size 0 max 16384 2024-06-13T11:34:38.328 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-06-13T11:34:38.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.322+0000 7ffb06800700 1 -- 172.21.15.2:0/1964833855 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ffae40a2e10 msgr2=0x7ffae40a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:38.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.322+0000 7ffb06800700 1 --2- 172.21.15.2:0/1964833855 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ffae40a2e10 0x7ffae40a52d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009fd0 tx=0x7ffaf8009920 comp rx=0 tx=0).stop 2024-06-13T11:34:38.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.322+0000 7ffb06800700 1 -- 172.21.15.2:0/1964833855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb0006b3c0 msgr2=0x7ffb0019b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:38.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.322+0000 7ffb06800700 1 --2- 172.21.15.2:0/1964833855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb0006b3c0 0x7ffb0019b4b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffaec005950 tx=0x7ffaec005040 comp rx=0 tx=0).stop 2024-06-13T11:34:38.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.322+0000 7ffb06800700 1 -- 172.21.15.2:0/1964833855 shutdown_connections 2024-06-13T11:34:38.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.322+0000 7ffb06800700 1 --2- 172.21.15.2:0/1964833855 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ffae40a2e10 0x7ffae40a52d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.322+0000 7ffb06800700 1 --2- 172.21.15.2:0/1964833855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb001084f0 0x7ffb0019f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.322+0000 7ffb06800700 1 --2- 172.21.15.2:0/1964833855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb0006aa00 0x7ffb0019af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.322+0000 7ffb06800700 1 --2- 172.21.15.2:0/1964833855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb0006b3c0 0x7ffb0019b4b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:38.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.322+0000 7ffb06800700 1 -- 172.21.15.2:0/1964833855 >> 172.21.15.2:0/1964833855 conn(0x7ffb00078300 msgr2=0x7ffb0010d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:38.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.322+0000 7ffb06800700 1 -- 172.21.15.2:0/1964833855 shutdown_connections 2024-06-13T11:34:38.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:38.322+0000 7ffb06800700 1 -- 172.21.15.2:0/1964833855 wait complete. 2024-06-13T11:34:39.250 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-06-13T11:34:39.257 INFO:tasks.fwd_scrub:done joining 2024-06-13T11:34:39.257 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-06-13T11:34:39.267 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T11:34:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.496+0000 7f9223e00640 1 -- 172.21.15.2:0/2688979783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9224107850 msgr2=0x7f9224107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.496+0000 7f9223e00640 1 --2- 172.21.15.2:0/2688979783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9224107850 0x7f9224107c30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9214009890 tx=0x7f921402a360 comp rx=0 tx=0).stop 2024-06-13T11:34:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.496+0000 7f9223e00640 1 -- 172.21.15.2:0/2688979783 shutdown_connections 2024-06-13T11:34:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.496+0000 7f9223e00640 1 --2- 172.21.15.2:0/2688979783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9224102200 0x7f922410e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:39.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.496+0000 7f9223e00640 1 --2- 172.21.15.2:0/2688979783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9224101840 0x7f9224101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.496+0000 7f9223e00640 1 --2- 172.21.15.2:0/2688979783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9224107850 0x7f9224107c30 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.496+0000 7f9223e00640 1 -- 172.21.15.2:0/2688979783 >> 172.21.15.2:0/2688979783 conn(0x7f92240fd3b0 msgr2=0x7f92240ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.496+0000 7f9223e00640 1 -- 172.21.15.2:0/2688979783 shutdown_connections 2024-06-13T11:34:39.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.496+0000 7f9223e00640 1 -- 172.21.15.2:0/2688979783 wait complete. 2024-06-13T11:34:39.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.497+0000 7f9223e00640 1 Processor -- start 2024-06-13T11:34:39.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.497+0000 7f9223e00640 1 -- start start 2024-06-13T11:34:39.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.498+0000 7f9223e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9224101840 0x7f9224073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:39.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.498+0000 7f9223e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9224102200 0x7f92240741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:39.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.498+0000 7f9223e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9224107850 0x7f9224074720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:39.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.498+0000 7f9223e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9224111c60 con 0x7f9224102200 2024-06-13T11:34:39.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.498+0000 7f9223e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9224111ae0 con 0x7f9224107850 2024-06-13T11:34:39.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.498+0000 7f9223e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9224111de0 con 0x7f9224101840 2024-06-13T11:34:39.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.498+0000 7f9222a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9224101840 0x7f9224073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:39.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.498+0000 7f9223400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9224107850 0x7f9224074720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:39.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.498+0000 7f9222000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9224102200 0x7f92240741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:39.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.498+0000 7f9222a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9224101840 0x7f9224073ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:48614/0 (socket says 172.21.15.2:48614) 2024-06-13T11:34:39.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.498+0000 7f9223400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9224107850 0x7f9224074720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:44360/0 (socket says 172.21.15.2:44360) 2024-06-13T11:34:39.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.498+0000 7f9222a00640 1 -- 172.21.15.2:0/1618327161 learned_addr learned my addr 172.21.15.2:0/1618327161 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:39.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.499+0000 7f9222a00640 1 -- 172.21.15.2:0/1618327161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9224107850 msgr2=0x7f9224074720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:39.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.499+0000 7f9222a00640 1 --2- 172.21.15.2:0/1618327161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9224107850 0x7f9224074720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:39.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.499+0000 7f9222a00640 1 -- 172.21.15.2:0/1618327161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9224102200 msgr2=0x7f92240741e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:39.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.499+0000 7f9222a00640 1 --2- 172.21.15.2:0/1618327161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9224102200 0x7f92240741e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:39.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.499+0000 7f9222a00640 1 -- 172.21.15.2:0/1618327161 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92241a66c0 con 0x7f9224101840 2024-06-13T11:34:39.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.499+0000 7f9222a00640 1 --2- 172.21.15.2:0/1618327161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9224101840 0x7f9224073ca0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9214035040 tx=0x7f9214033b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:39.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.499+0000 7f9228a00640 1 -- 172.21.15.2:0/1618327161 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9214037040 con 0x7f9224101840 2024-06-13T11:34:39.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.499+0000 7f9228a00640 1 -- 172.21.15.2:0/1618327161 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9214040070 con 0x7f9224101840 2024-06-13T11:34:39.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.499+0000 7f9228a00640 1 -- 172.21.15.2:0/1618327161 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9214003970 con 0x7f9224101840 2024-06-13T11:34:39.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.499+0000 7f9223e00640 1 -- 172.21.15.2:0/1618327161 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92241a6950 con 0x7f9224101840 2024-06-13T11:34:39.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.499+0000 7f9223e00640 1 -- 172.21.15.2:0/1618327161 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92241a6e90 con 0x7f9224101840 2024-06-13T11:34:39.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.501+0000 7f9223e00640 1 -- 172.21.15.2:0/1618327161 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f922404f7d0 con 0x7f9224101840 2024-06-13T11:34:39.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.503+0000 7f9228a00640 1 -- 172.21.15.2:0/1618327161 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f92140306a0 con 0x7f9224101840 2024-06-13T11:34:39.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.504+0000 7f9228a00640 1 --2- 172.21.15.2:0/1618327161 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f92080a2d70 0x7f92080a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:39.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.504+0000 7f9228a00640 1 -- 172.21.15.2:0/1618327161 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7f92140ef640 con 0x7f9224101840 2024-06-13T11:34:39.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.504+0000 7f9222000640 1 --2- 172.21.15.2:0/1618327161 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f92080a2d70 0x7f92080a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:39.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.505+0000 7f9222000640 1 --2- 172.21.15.2:0/1618327161 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f92080a2d70 0x7f92080a5230 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9224075730 tx=0x7f9210005f90 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:39.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.508+0000 7f9228a00640 1 -- 172.21.15.2:0/1618327161 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f92140bbf50 con 0x7f9224101840 2024-06-13T11:34:39.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.717+0000 7f9223e00640 1 -- 172.21.15.2:0/1618327161 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9224109db0 con 0x7f9224101840 2024-06-13T11:34:39.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.720+0000 7f9228a00640 1 -- 172.21.15.2:0/1618327161 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+25166 (secure 0 0 0) 0x7f92140bb850 con 0x7f9224101840 2024-06-13T11:34:39.719 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:34:39.720 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":108,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","created":"2024-06-13T11:09:07.839101+0000","modified":"2024-06-13T11:34:09.262585+0000","last_up_change":"2024-06-13T11:17:28.731479+0000","last_in_change":"2024-06-13T11:17:08.849067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:13:13.793461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:18:36.784824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:18:41.824835+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:18:55.545870+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f5614d91-49a7-4983-a309-0de3b3e6263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6803","nonce":4127571834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6805","nonce":4127571834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6809","nonce":4127571834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6807","nonce":4127571834}]},"public_addr":"172.21.15.2:6803/4127571834","cluster_addr":"172.21.15.2:6805/4127571834","heartbeat_back_addr":"172.21.15.2:6809/4127571834","heartbeat_front_addr":"172.21.15.2:6807/4127571834","state":["exists","up"]},{"osd":1,"uuid":"d9dbe278-309f-4726-828a-da922f486b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6801","nonce":3180360713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6803","nonce":3180360713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6807","nonce":3180360713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6805","nonce":3180360713}]},"public_addr":"172.21.15.77:6801/3180360713","cluster_addr":"172.21.15.77:6803/3180360713","heartbeat_back_addr":"172.21.15.77:6807/3180360713","heartbeat_front_addr":"172.21.15.77:6805/3180360713","state":["exists","up"]},{"osd":2,"uuid":"04c267dc-7454-418f-9965-3ff96ef280ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6801","nonce":3825510575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6803","nonce":3825510575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6807","nonce":3825510575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6805","nonce":3825510575}]},"public_addr":"172.21.15.178:6801/3825510575","cluster_addr":"172.21.15.178:6803/3825510575","heartbeat_back_addr":"172.21.15.178:6807/3825510575","heartbeat_front_addr":"172.21.15.178:6805/3825510575","state":["exists","up"]},{"osd":3,"uuid":"3847bd4f-ca04-41de-9d88-e1523dd7ff8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6811","nonce":1982693353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6813","nonce":1982693353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6817","nonce":1982693353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6815","nonce":1982693353}]},"public_addr":"172.21.15.2:6811/1982693353","cluster_addr":"172.21.15.2:6813/1982693353","heartbeat_back_addr":"172.21.15.2:6817/1982693353","heartbeat_front_addr":"172.21.15.2:6815/1982693353","state":["exists","up"]},{"osd":4,"uuid":"34d7d2e8-3dee-42b9-a6cb-d4162b122b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6809","nonce":3916694904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6811","nonce":3916694904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6815","nonce":3916694904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6813","nonce":3916694904}]},"public_addr":"172.21.15.77:6809/3916694904","cluster_addr":"172.21.15.77:6811/3916694904","heartbeat_back_addr":"172.21.15.77:6815/3916694904","heartbeat_front_addr":"172.21.15.77:6813/3916694904","state":["exists","up"]},{"osd":5,"uuid":"0468aefc-c3c8-4758-9bbf-1225b7a5ae79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6809","nonce":3572805887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6811","nonce":3572805887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6815","nonce":3572805887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6813","nonce":3572805887}]},"public_addr":"172.21.15.178:6809/3572805887","cluster_addr":"172.21.15.178:6811/3572805887","heartbeat_back_addr":"172.21.15.178:6815/3572805887","heartbeat_front_addr":"172.21.15.178:6813/3572805887","state":["exists","up"]},{"osd":6,"uuid":"0a186a4a-0e28-47bd-b5ad-9bf8079f74c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6819","nonce":1592309584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6821","nonce":1592309584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6825","nonce":1592309584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6823","nonce":1592309584}]},"public_addr":"172.21.15.2:6819/1592309584","cluster_addr":"172.21.15.2:6821/1592309584","heartbeat_back_addr":"172.21.15.2:6825/1592309584","heartbeat_front_addr":"172.21.15.2:6823/1592309584","state":["exists","up"]},{"osd":7,"uuid":"646e66f7-1ef8-428d-a842-bf28c8606df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6817","nonce":1580055775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6819","nonce":1580055775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6823","nonce":1580055775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6821","nonce":1580055775}]},"public_addr":"172.21.15.77:6817/1580055775","cluster_addr":"172.21.15.77:6819/1580055775","heartbeat_back_addr":"172.21.15.77:6823/1580055775","heartbeat_front_addr":"172.21.15.77:6821/1580055775","state":["exists","up"]},{"osd":8,"uuid":"bcc971fc-47d7-4289-8a9a-c76996c57370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6817","nonce":4285192591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6819","nonce":4285192591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6823","nonce":4285192591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6821","nonce":4285192591}]},"public_addr":"172.21.15.178:6817/4285192591","cluster_addr":"172.21.15.178:6819/4285192591","heartbeat_back_addr":"172.21.15.178:6823/4285192591","heartbeat_front_addr":"172.21.15.178:6821/4285192591","state":["exists","up"]},{"osd":9,"uuid":"899d7d4f-a24c-4508-b42c-0b363275c459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6827","nonce":4187017478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6829","nonce":4187017478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6833","nonce":4187017478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6831","nonce":4187017478}]},"public_addr":"172.21.15.2:6827/4187017478","cluster_addr":"172.21.15.2:6829/4187017478","heartbeat_back_addr":"172.21.15.2:6833/4187017478","heartbeat_front_addr":"172.21.15.2:6831/4187017478","state":["exists","up"]},{"osd":10,"uuid":"112d2b8e-9673-4d7a-97e9-2089793fdd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6825","nonce":2039538463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6827","nonce":2039538463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6831","nonce":2039538463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6829","nonce":2039538463}]},"public_addr":"172.21.15.77:6825/2039538463","cluster_addr":"172.21.15.77:6827/2039538463","heartbeat_back_addr":"172.21.15.77:6831/2039538463","heartbeat_front_addr":"172.21.15.77:6829/2039538463","state":["exists","up"]},{"osd":11,"uuid":"6b8001f5-9c74-4cc7-8c41-906cb5ac9b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6825","nonce":1915058767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6827","nonce":1915058767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6831","nonce":1915058767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6829","nonce":1915058767}]},"public_addr":"172.21.15.178:6825/1915058767","cluster_addr":"172.21.15.178:6827/1915058767","heartbeat_back_addr":"172.21.15.178:6831/1915058767","heartbeat_front_addr":"172.21.15.178:6829/1915058767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:21.707572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:46.440115+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:10.197217+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:42.853367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:08.880473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:33.605677+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:07.655377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:33.980900+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:59.397529+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:16:33.983411+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:00.932649+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:26.894098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9},{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/682201811":"2024-06-14T11:23:46.133309+0000","172.21.15.2:6801/3387272091":"2024-06-14T11:23:46.133309+0000","172.21.15.2:0/778891449":"2024-06-14T11:23:46.133309+0000","172.21.15.2:0/88846693":"2024-06-14T11:23:46.133309+0000","172.21.15.2:0/315567313":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/2084201061":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/3387272091":"2024-06-14T11:23:46.133309+0000","172.21.15.2:0/3394644803":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6801/1821969949":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/2170469985":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/1640275700":"2024-06-14T11:23:46.133309+0000","172.21.15.2:0/142516651":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6801/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/3220886565":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6800/1821969949":"2024-06-14T11:10:25.084617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:34:39.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.723+0000 7f9223e00640 1 -- 172.21.15.2:0/1618327161 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f92080a2d70 msgr2=0x7f92080a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:39.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.723+0000 7f9223e00640 1 --2- 172.21.15.2:0/1618327161 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f92080a2d70 0x7f92080a5230 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9224075730 tx=0x7f9210005f90 comp rx=0 tx=0).stop 2024-06-13T11:34:39.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.723+0000 7f9223e00640 1 -- 172.21.15.2:0/1618327161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9224101840 msgr2=0x7f9224073ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:39.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.723+0000 7f9223e00640 1 --2- 172.21.15.2:0/1618327161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9224101840 0x7f9224073ca0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9214035040 tx=0x7f9214033b60 comp rx=0 tx=0).stop 2024-06-13T11:34:39.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.723+0000 7f9223e00640 1 -- 172.21.15.2:0/1618327161 shutdown_connections 2024-06-13T11:34:39.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.723+0000 7f9223e00640 1 --2- 172.21.15.2:0/1618327161 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f92080a2d70 0x7f92080a5230 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:39.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.723+0000 7f9223e00640 1 --2- 172.21.15.2:0/1618327161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9224107850 0x7f9224074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:39.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.723+0000 7f9223e00640 1 --2- 172.21.15.2:0/1618327161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9224102200 0x7f92240741e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:39.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.723+0000 7f9223e00640 1 --2- 172.21.15.2:0/1618327161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9224101840 0x7f9224073ca0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:39.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.723+0000 7f9223e00640 1 -- 172.21.15.2:0/1618327161 >> 172.21.15.2:0/1618327161 conn(0x7f92240fd3b0 msgr2=0x7f92240fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:39.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.724+0000 7f9223e00640 1 -- 172.21.15.2:0/1618327161 shutdown_connections 2024-06-13T11:34:39.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.724+0000 7f9223e00640 1 -- 172.21.15.2:0/1618327161 wait complete. 2024-06-13T11:34:39.746 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-13T11:13:13.793461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-13T11:18:36.784824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-13T11:18:41.824835+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 107, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-13T11:18:55.545870+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 107, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-13T11:34:39.747 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-13T11:34:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.968+0000 7fb307e00640 1 -- 172.21.15.2:0/3269950948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3000767f0 msgr2=0x7fb3001122e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.968+0000 7fb307e00640 1 --2- 172.21.15.2:0/3269950948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3000767f0 0x7fb3001122e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009890 tx=0x7fb2ec02a360 comp rx=0 tx=0).stop 2024-06-13T11:34:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.968+0000 7fb307e00640 1 -- 172.21.15.2:0/3269950948 shutdown_connections 2024-06-13T11:34:39.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.968+0000 7fb307e00640 1 --2- 172.21.15.2:0/3269950948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3000767f0 0x7fb3001122e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:39.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.968+0000 7fb307e00640 1 --2- 172.21.15.2:0/3269950948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb300112820 0x7fb300114c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:39.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.968+0000 7fb307e00640 1 --2- 172.21.15.2:0/3269950948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb300075ed0 0x7fb3000762b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:39.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.968+0000 7fb307e00640 1 -- 172.21.15.2:0/3269950948 >> 172.21.15.2:0/3269950948 conn(0x7fb3000ff610 msgr2=0x7fb300101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:39.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.968+0000 7fb307e00640 1 -- 172.21.15.2:0/3269950948 shutdown_connections 2024-06-13T11:34:39.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.968+0000 7fb307e00640 1 -- 172.21.15.2:0/3269950948 wait complete. 2024-06-13T11:34:39.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.969+0000 7fb307e00640 1 Processor -- start 2024-06-13T11:34:39.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.970+0000 7fb307e00640 1 -- start start 2024-06-13T11:34:39.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.970+0000 7fb307e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb300075ed0 0x7fb3001a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:39.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.970+0000 7fb307e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3000767f0 0x7fb3001a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:39.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.970+0000 7fb307e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb300112820 0x7fb30019e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:39.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.970+0000 7fb307e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb300118380 con 0x7fb300075ed0 2024-06-13T11:34:39.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.970+0000 7fb307e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb300118200 con 0x7fb300112820 2024-06-13T11:34:39.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.970+0000 7fb307e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb300118500 con 0x7fb3000767f0 2024-06-13T11:34:39.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.970+0000 7fb305400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb300075ed0 0x7fb3001a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:39.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.971+0000 7fb305400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb300075ed0 0x7fb3001a4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49406/0 (socket says 172.21.15.2:49406) 2024-06-13T11:34:39.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.971+0000 7fb305400640 1 -- 172.21.15.2:0/2296607323 learned_addr learned my addr 172.21.15.2:0/2296607323 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:39.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.971+0000 7fb305e00640 1 --2- 172.21.15.2:0/2296607323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb300112820 0x7fb30019e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:39.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.971+0000 7fb304a00640 1 --2- 172.21.15.2:0/2296607323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3000767f0 0x7fb3001a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.971+0000 7fb305400640 1 -- 172.21.15.2:0/2296607323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3000767f0 msgr2=0x7fb3001a4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.971+0000 7fb305400640 1 --2- 172.21.15.2:0/2296607323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3000767f0 0x7fb3001a4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.971+0000 7fb305400640 1 -- 172.21.15.2:0/2296607323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb300112820 msgr2=0x7fb30019e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.971+0000 7fb305400640 1 --2- 172.21.15.2:0/2296607323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb300112820 0x7fb30019e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.971+0000 7fb305400640 1 -- 172.21.15.2:0/2296607323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30019f020 con 0x7fb300075ed0 2024-06-13T11:34:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.971+0000 7fb305e00640 1 --2- 172.21.15.2:0/2296607323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb300112820 0x7fb30019e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:34:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.971+0000 7fb305400640 1 --2- 172.21.15.2:0/2296607323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb300075ed0 0x7fb3001a4650 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400e9c0 tx=0x7fb2f400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.972+0000 7fb2fe000640 1 -- 172.21.15.2:0/2296607323 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f400ccc0 con 0x7fb300075ed0 2024-06-13T11:34:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.972+0000 7fb2fe000640 1 -- 172.21.15.2:0/2296607323 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2f4005500 con 0x7fb300075ed0 2024-06-13T11:34:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.972+0000 7fb307e00640 1 -- 172.21.15.2:0/2296607323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30019f310 con 0x7fb300075ed0 2024-06-13T11:34:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.972+0000 7fb2fe000640 1 -- 172.21.15.2:0/2296607323 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4010430 con 0x7fb300075ed0 2024-06-13T11:34:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.972+0000 7fb307e00640 1 -- 172.21.15.2:0/2296607323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3001ab5d0 con 0x7fb300075ed0 2024-06-13T11:34:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.973+0000 7fb307e00640 1 -- 172.21.15.2:0/2296607323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb30019f650 con 0x7fb300075ed0 2024-06-13T11:34:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.975+0000 7fb2fe000640 1 -- 172.21.15.2:0/2296607323 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fb2f40046c0 con 0x7fb300075ed0 2024-06-13T11:34:39.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.978+0000 7fb2fe000640 1 --2- 172.21.15.2:0/2296607323 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb2e80a2d00 0x7fb2e80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:39.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.978+0000 7fb2fe000640 1 -- 172.21.15.2:0/2296607323 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7fb2f40cfb60 con 0x7fb300075ed0 2024-06-13T11:34:39.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.978+0000 7fb304a00640 1 --2- 172.21.15.2:0/2296607323 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb2e80a2d00 0x7fb2e80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:39.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.979+0000 7fb304a00640 1 --2- 172.21.15.2:0/2296607323 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb2e80a2d00 0x7fb2e80a51c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec000c00 tx=0x7fb2ec005890 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:39.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:39.983+0000 7fb2fe000640 1 -- 172.21.15.2:0/2296607323 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb2f409c360 con 0x7fb300075ed0 2024-06-13T11:34:40.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:39 smithi077 ceph-mon[36410]: pgmap v337: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:40.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:39 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1618327161' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:34:40.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:39 smithi002 ceph-mon[32210]: pgmap v337: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:40.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:39 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1618327161' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:34:40.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.188+0000 7fb307e00640 1 -- 172.21.15.2:0/2296607323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb30010d9b0 con 0x7fb300075ed0 2024-06-13T11:34:40.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.190+0000 7fb2fe000640 1 -- 172.21.15.2:0/2296607323 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) ==== 93+0+10 (secure 0 0 0) 0x7fb2f409bc60 con 0x7fb300075ed0 2024-06-13T11:34:40.189 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-06-13T11:34:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.192+0000 7fb307e00640 1 -- 172.21.15.2:0/2296607323 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb2e80a2d00 msgr2=0x7fb2e80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.192+0000 7fb307e00640 1 --2- 172.21.15.2:0/2296607323 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb2e80a2d00 0x7fb2e80a51c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec000c00 tx=0x7fb2ec005890 comp rx=0 tx=0).stop 2024-06-13T11:34:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.192+0000 7fb307e00640 1 -- 172.21.15.2:0/2296607323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb300075ed0 msgr2=0x7fb3001a4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.192+0000 7fb307e00640 1 --2- 172.21.15.2:0/2296607323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb300075ed0 0x7fb3001a4650 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400e9c0 tx=0x7fb2f400ee80 comp rx=0 tx=0).stop 2024-06-13T11:34:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.193+0000 7fb307e00640 1 -- 172.21.15.2:0/2296607323 shutdown_connections 2024-06-13T11:34:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.193+0000 7fb307e00640 1 --2- 172.21.15.2:0/2296607323 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb2e80a2d00 0x7fb2e80a51c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.193+0000 7fb307e00640 1 --2- 172.21.15.2:0/2296607323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3000767f0 0x7fb3001a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.193+0000 7fb307e00640 1 --2- 172.21.15.2:0/2296607323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb300112820 0x7fb30019e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.193+0000 7fb307e00640 1 --2- 172.21.15.2:0/2296607323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb300075ed0 0x7fb3001a4650 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.193+0000 7fb307e00640 1 -- 172.21.15.2:0/2296607323 >> 172.21.15.2:0/2296607323 conn(0x7fb3000ff610 msgr2=0x7fb300101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:40.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.193+0000 7fb307e00640 1 -- 172.21.15.2:0/2296607323 shutdown_connections 2024-06-13T11:34:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.193+0000 7fb307e00640 1 -- 172.21.15.2:0/2296607323 wait complete. 2024-06-13T11:34:40.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:39 smithi178 ceph-mon[36913]: pgmap v337: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:40.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:39 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1618327161' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:34:40.212 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-13T11:34:40.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.425+0000 7ffa83e00640 1 -- 172.21.15.2:0/3330226195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa841099d0 msgr2=0x7ffa84109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:40.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.425+0000 7ffa83e00640 1 --2- 172.21.15.2:0/3330226195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa841099d0 0x7ffa84109db0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009890 tx=0x7ffa7402a370 comp rx=0 tx=0).stop 2024-06-13T11:34:40.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.426+0000 7ffa83e00640 1 -- 172.21.15.2:0/3330226195 shutdown_connections 2024-06-13T11:34:40.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.426+0000 7ffa83e00640 1 --2- 172.21.15.2:0/3330226195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa84104380 0x7ffa84110890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.426+0000 7ffa83e00640 1 --2- 172.21.15.2:0/3330226195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa841039c0 0x7ffa84103e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.426+0000 7ffa83e00640 1 --2- 172.21.15.2:0/3330226195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa841099d0 0x7ffa84109db0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.426+0000 7ffa83e00640 1 -- 172.21.15.2:0/3330226195 >> 172.21.15.2:0/3330226195 conn(0x7ffa840ff490 msgr2=0x7ffa841018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:40.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.426+0000 7ffa83e00640 1 -- 172.21.15.2:0/3330226195 shutdown_connections 2024-06-13T11:34:40.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.426+0000 7ffa83e00640 1 -- 172.21.15.2:0/3330226195 wait complete. 2024-06-13T11:34:40.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.427+0000 7ffa83e00640 1 Processor -- start 2024-06-13T11:34:40.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.427+0000 7ffa83e00640 1 -- start start 2024-06-13T11:34:40.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.427+0000 7ffa83e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa841039c0 0x7ffa8419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:40.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.427+0000 7ffa83e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa84104380 0x7ffa8419a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:40.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.427+0000 7ffa83e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa841099d0 0x7ffa8419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:40.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.427+0000 7ffa83e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa84113de0 con 0x7ffa841039c0 2024-06-13T11:34:40.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.427+0000 7ffa83e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffa84113c60 con 0x7ffa84104380 2024-06-13T11:34:40.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.427+0000 7ffa83e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ffa84113f60 con 0x7ffa841099d0 2024-06-13T11:34:40.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.427+0000 7ffa82a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa841039c0 0x7ffa8419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:40.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.428+0000 7ffa82a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa841039c0 0x7ffa8419a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49424/0 (socket says 172.21.15.2:49424) 2024-06-13T11:34:40.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.428+0000 7ffa82a00640 1 -- 172.21.15.2:0/1878718566 learned_addr learned my addr 172.21.15.2:0/1878718566 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:40.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.428+0000 7ffa82000640 1 --2- 172.21.15.2:0/1878718566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa84104380 0x7ffa8419a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:40.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.428+0000 7ffa83400640 1 --2- 172.21.15.2:0/1878718566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa841099d0 0x7ffa8419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:40.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.428+0000 7ffa82a00640 1 -- 172.21.15.2:0/1878718566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa841099d0 msgr2=0x7ffa8419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:40.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.428+0000 7ffa82a00640 1 --2- 172.21.15.2:0/1878718566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa841099d0 0x7ffa8419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.428+0000 7ffa82a00640 1 -- 172.21.15.2:0/1878718566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa84104380 msgr2=0x7ffa8419a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:40.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.428+0000 7ffa82a00640 1 --2- 172.21.15.2:0/1878718566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa84104380 0x7ffa8419a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.428+0000 7ffa82a00640 1 -- 172.21.15.2:0/1878718566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8419f310 con 0x7ffa841039c0 2024-06-13T11:34:40.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.428+0000 7ffa82000640 1 --2- 172.21.15.2:0/1878718566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa84104380 0x7ffa8419a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:34:40.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.428+0000 7ffa83400640 1 --2- 172.21.15.2:0/1878718566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa841099d0 0x7ffa8419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:34:40.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.428+0000 7ffa82a00640 1 --2- 172.21.15.2:0/1878718566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa841039c0 0x7ffa8419a320 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ffa74035040 tx=0x7ffa74033b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:40.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.429+0000 7ffa7b400640 1 -- 172.21.15.2:0/1878718566 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74037040 con 0x7ffa841039c0 2024-06-13T11:34:40.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.429+0000 7ffa83e00640 1 -- 172.21.15.2:0/1878718566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8419f5a0 con 0x7ffa841039c0 2024-06-13T11:34:40.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.429+0000 7ffa7b400640 1 -- 172.21.15.2:0/1878718566 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa74040070 con 0x7ffa841039c0 2024-06-13T11:34:40.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.429+0000 7ffa7b400640 1 -- 172.21.15.2:0/1878718566 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74003a10 con 0x7ffa841039c0 2024-06-13T11:34:40.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.429+0000 7ffa83e00640 1 -- 172.21.15.2:0/1878718566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa841a6e90 con 0x7ffa841039c0 2024-06-13T11:34:40.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.430+0000 7ffa83e00640 1 -- 172.21.15.2:0/1878718566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa8404f760 con 0x7ffa841039c0 2024-06-13T11:34:40.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.432+0000 7ffa7b400640 1 -- 172.21.15.2:0/1878718566 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7ffa74004170 con 0x7ffa841039c0 2024-06-13T11:34:40.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.434+0000 7ffa7b400640 1 --2- 172.21.15.2:0/1878718566 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ffa640a2d80 0x7ffa640a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:40.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.434+0000 7ffa7b400640 1 -- 172.21.15.2:0/1878718566 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7ffa740ef640 con 0x7ffa841039c0 2024-06-13T11:34:40.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.435+0000 7ffa82000640 1 --2- 172.21.15.2:0/1878718566 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ffa640a2d80 0x7ffa640a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:40.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.435+0000 7ffa82000640 1 --2- 172.21.15.2:0/1878718566 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ffa640a2d80 0x7ffa640a5240 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa84101b20 tx=0x7ffa6c005f90 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:40.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.439+0000 7ffa7b400640 1 -- 172.21.15.2:0/1878718566 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ffa740bbf50 con 0x7ffa841039c0 2024-06-13T11:34:40.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.645+0000 7ffa83e00640 1 -- 172.21.15.2:0/1878718566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ffa8410bf30 con 0x7ffa841039c0 2024-06-13T11:34:40.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.646+0000 7ffa7b400640 1 -- 172.21.15.2:0/1878718566 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) ==== 104+0+11 (secure 0 0 0) 0x7ffa740bb850 con 0x7ffa841039c0 2024-06-13T11:34:40.646 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-06-13T11:34:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.649+0000 7ffa83e00640 1 -- 172.21.15.2:0/1878718566 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ffa640a2d80 msgr2=0x7ffa640a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.649+0000 7ffa83e00640 1 --2- 172.21.15.2:0/1878718566 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ffa640a2d80 0x7ffa640a5240 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa84101b20 tx=0x7ffa6c005f90 comp rx=0 tx=0).stop 2024-06-13T11:34:40.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.649+0000 7ffa83e00640 1 -- 172.21.15.2:0/1878718566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa841039c0 msgr2=0x7ffa8419a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:40.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.649+0000 7ffa83e00640 1 --2- 172.21.15.2:0/1878718566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa841039c0 0x7ffa8419a320 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ffa74035040 tx=0x7ffa74033b60 comp rx=0 tx=0).stop 2024-06-13T11:34:40.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.649+0000 7ffa83e00640 1 -- 172.21.15.2:0/1878718566 shutdown_connections 2024-06-13T11:34:40.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.650+0000 7ffa83e00640 1 --2- 172.21.15.2:0/1878718566 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ffa640a2d80 0x7ffa640a5240 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.650+0000 7ffa83e00640 1 --2- 172.21.15.2:0/1878718566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa841099d0 0x7ffa8419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.650+0000 7ffa83e00640 1 --2- 172.21.15.2:0/1878718566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa84104380 0x7ffa8419a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.650+0000 7ffa83e00640 1 --2- 172.21.15.2:0/1878718566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa841039c0 0x7ffa8419a320 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.650+0000 7ffa83e00640 1 -- 172.21.15.2:0/1878718566 >> 172.21.15.2:0/1878718566 conn(0x7ffa840ff490 msgr2=0x7ffa840ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:40.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.650+0000 7ffa83e00640 1 -- 172.21.15.2:0/1878718566 shutdown_connections 2024-06-13T11:34:40.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.650+0000 7ffa83e00640 1 -- 172.21.15.2:0/1878718566 wait complete. 2024-06-13T11:34:40.668 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-13T11:34:40.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.886+0000 7f50abe00640 1 -- 172.21.15.2:0/3909696669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50ac1039c0 msgr2=0x7f50ac103e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:40.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.886+0000 7f50abe00640 1 --2- 172.21.15.2:0/3909696669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50ac1039c0 0x7f50ac103e40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f509c009860 tx=0x7f509c02a340 comp rx=0 tx=0).stop 2024-06-13T11:34:40.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.887+0000 7f50abe00640 1 -- 172.21.15.2:0/3909696669 shutdown_connections 2024-06-13T11:34:40.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.887+0000 7f50abe00640 1 --2- 172.21.15.2:0/3909696669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50ac104380 0x7f50ac110890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.887+0000 7f50abe00640 1 --2- 172.21.15.2:0/3909696669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50ac1039c0 0x7f50ac103e40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.887+0000 7f50abe00640 1 --2- 172.21.15.2:0/3909696669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50ac1099d0 0x7f50ac109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.887+0000 7f50abe00640 1 -- 172.21.15.2:0/3909696669 >> 172.21.15.2:0/3909696669 conn(0x7f50ac0ff490 msgr2=0x7f50ac1018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:40.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.887+0000 7f50abe00640 1 -- 172.21.15.2:0/3909696669 shutdown_connections 2024-06-13T11:34:40.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.887+0000 7f50abe00640 1 -- 172.21.15.2:0/3909696669 wait complete. 2024-06-13T11:34:40.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.888+0000 7f50abe00640 1 Processor -- start 2024-06-13T11:34:40.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.888+0000 7f50abe00640 1 -- start start 2024-06-13T11:34:40.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.888+0000 7f50abe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50ac1039c0 0x7f50ac1107f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:40.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.888+0000 7f50abe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50ac104380 0x7f50ac10d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:40.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.889+0000 7f50abe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50ac1099d0 0x7f50ac10ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:40.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.889+0000 7f50abe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac113de0 con 0x7f50ac1099d0 2024-06-13T11:34:40.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.889+0000 7f50abe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac113c60 con 0x7f50ac104380 2024-06-13T11:34:40.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.889+0000 7f50abe00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac113f60 con 0x7f50ac1039c0 2024-06-13T11:34:40.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.889+0000 7f50aaa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50ac1039c0 0x7f50ac1107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:40.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.889+0000 7f50a2000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50ac104380 0x7f50ac10d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:40.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.889+0000 7f50aaa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50ac1039c0 0x7f50ac1107f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:48652/0 (socket says 172.21.15.2:48652) 2024-06-13T11:34:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.889+0000 7f50a2000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50ac104380 0x7f50ac10d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:44420/0 (socket says 172.21.15.2:44420) 2024-06-13T11:34:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.889+0000 7f50aaa00640 1 -- 172.21.15.2:0/423761480 learned_addr learned my addr 172.21.15.2:0/423761480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.889+0000 7f50ab400640 1 --2- 172.21.15.2:0/423761480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50ac1099d0 0x7f50ac10ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.889+0000 7f50aaa00640 1 -- 172.21.15.2:0/423761480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50ac104380 msgr2=0x7f50ac10d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.889+0000 7f50aaa00640 1 --2- 172.21.15.2:0/423761480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50ac104380 0x7f50ac10d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.889+0000 7f50aaa00640 1 -- 172.21.15.2:0/423761480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50ac1099d0 msgr2=0x7f50ac10ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.889+0000 7f50aaa00640 1 --2- 172.21.15.2:0/423761480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50ac1099d0 0x7f50ac10ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:40.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.889+0000 7f50aaa00640 1 -- 172.21.15.2:0/423761480 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ac1aaac0 con 0x7f50ac1039c0 2024-06-13T11:34:40.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.889+0000 7f50a2000640 1 --2- 172.21.15.2:0/423761480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50ac104380 0x7f50ac10d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:34:40.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.890+0000 7f50aaa00640 1 --2- 172.21.15.2:0/423761480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50ac1039c0 0x7f50ac1107f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f509400e9c0 tx=0x7f509400edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:40.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.890+0000 7f50a3e00640 1 -- 172.21.15.2:0/423761480 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509400ccc0 con 0x7f50ac1039c0 2024-06-13T11:34:40.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.890+0000 7f50abe00640 1 -- 172.21.15.2:0/423761480 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50ac1aac90 con 0x7f50ac1039c0 2024-06-13T11:34:40.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.890+0000 7f50a3e00640 1 -- 172.21.15.2:0/423761480 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5094005500 con 0x7f50ac1039c0 2024-06-13T11:34:40.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.890+0000 7f50a3e00640 1 -- 172.21.15.2:0/423761480 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5094010430 con 0x7f50ac1039c0 2024-06-13T11:34:40.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.890+0000 7f50abe00640 1 -- 172.21.15.2:0/423761480 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50ac1ab1b0 con 0x7f50ac1039c0 2024-06-13T11:34:40.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.891+0000 7f50abe00640 1 -- 172.21.15.2:0/423761480 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50ac105100 con 0x7f50ac1039c0 2024-06-13T11:34:40.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.893+0000 7f50a3e00640 1 -- 172.21.15.2:0/423761480 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f50940046c0 con 0x7f50ac1039c0 2024-06-13T11:34:40.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.895+0000 7f50a3e00640 1 --2- 172.21.15.2:0/423761480 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f50900a2d00 0x7f50900a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:40.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.895+0000 7f50a3e00640 1 -- 172.21.15.2:0/423761480 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7f50940cfad0 con 0x7f50ac1039c0 2024-06-13T11:34:40.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.895+0000 7f50a2000640 1 --2- 172.21.15.2:0/423761480 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f50900a2d00 0x7f50900a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:40.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.896+0000 7f50a2000640 1 --2- 172.21.15.2:0/423761480 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f50900a2d00 0x7f50900a51c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f509c02a930 tx=0x7f509c0056d0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:40.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:40.898+0000 7f50a3e00640 1 -- 172.21.15.2:0/423761480 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f509409c2d0 con 0x7f50ac1039c0 2024-06-13T11:34:41.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:40 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2296607323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-13T11:34:41.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:40 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1878718566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-13T11:34:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.102+0000 7f50abe00640 1 -- 172.21.15.2:0/423761480 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f50ac0774f0 con 0x7f50ac1039c0 2024-06-13T11:34:41.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.102+0000 7f50a3e00640 1 -- 172.21.15.2:0/423761480 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) ==== 100+0+11 (secure 0 0 0) 0x7f509409bbd0 con 0x7f50ac1039c0 2024-06-13T11:34:41.102 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-06-13T11:34:41.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.105+0000 7f50abe00640 1 -- 172.21.15.2:0/423761480 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f50900a2d00 msgr2=0x7f50900a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.105+0000 7f50abe00640 1 --2- 172.21.15.2:0/423761480 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f50900a2d00 0x7f50900a51c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f509c02a930 tx=0x7f509c0056d0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.105+0000 7f50abe00640 1 -- 172.21.15.2:0/423761480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50ac1039c0 msgr2=0x7f50ac1107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.105+0000 7f50abe00640 1 --2- 172.21.15.2:0/423761480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50ac1039c0 0x7f50ac1107f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f509400e9c0 tx=0x7f509400edc0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.105+0000 7f50abe00640 1 -- 172.21.15.2:0/423761480 shutdown_connections 2024-06-13T11:34:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.105+0000 7f50abe00640 1 --2- 172.21.15.2:0/423761480 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f50900a2d00 0x7f50900a51c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.105+0000 7f50abe00640 1 --2- 172.21.15.2:0/423761480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50ac1099d0 0x7f50ac10ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.105+0000 7f50abe00640 1 --2- 172.21.15.2:0/423761480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50ac104380 0x7f50ac10d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.105+0000 7f50abe00640 1 --2- 172.21.15.2:0/423761480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50ac1039c0 0x7f50ac1107f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.105+0000 7f50abe00640 1 -- 172.21.15.2:0/423761480 >> 172.21.15.2:0/423761480 conn(0x7f50ac0ff490 msgr2=0x7f50ac0ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.105+0000 7f50abe00640 1 -- 172.21.15.2:0/423761480 shutdown_connections 2024-06-13T11:34:41.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.105+0000 7f50abe00640 1 -- 172.21.15.2:0/423761480 wait complete. 2024-06-13T11:34:41.121 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:40 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2296607323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-13T11:34:41.121 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:40 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1878718566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-13T11:34:41.124 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-13T11:34:41.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:40 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2296607323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-13T11:34:41.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:40 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1878718566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-13T11:34:41.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.336+0000 7fb1bf200640 1 -- 172.21.15.2:0/2205622750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b810de20 msgr2=0x7fb1b810e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:41.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.336+0000 7fb1bf200640 1 --2- 172.21.15.2:0/2205622750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b810de20 0x7fb1b810e200 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009900 tx=0x7fb1ac02a3f0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.337+0000 7fb1bf200640 1 -- 172.21.15.2:0/2205622750 shutdown_connections 2024-06-13T11:34:41.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.337+0000 7fb1bf200640 1 --2- 172.21.15.2:0/2205622750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b8108880 0x7fb1b8114c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.337+0000 7fb1bf200640 1 --2- 172.21.15.2:0/2205622750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1b8107ee0 0x7fb1b8108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.337+0000 7fb1bf200640 1 --2- 172.21.15.2:0/2205622750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b810de20 0x7fb1b810e200 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.337+0000 7fb1bf200640 1 -- 172.21.15.2:0/2205622750 >> 172.21.15.2:0/2205622750 conn(0x7fb1b80777b0 msgr2=0x7fb1b81067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:41.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.337+0000 7fb1bf200640 1 -- 172.21.15.2:0/2205622750 shutdown_connections 2024-06-13T11:34:41.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.337+0000 7fb1bf200640 1 -- 172.21.15.2:0/2205622750 wait complete. 2024-06-13T11:34:41.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.338+0000 7fb1bf200640 1 Processor -- start 2024-06-13T11:34:41.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.338+0000 7fb1bf200640 1 -- start start 2024-06-13T11:34:41.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.338+0000 7fb1bf200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b8107ee0 0x7fb1b819e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:41.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.338+0000 7fb1bf200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1b8108880 0x7fb1b819eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:41.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.338+0000 7fb1bf200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b810de20 0x7fb1b81a2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:41.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.339+0000 7fb1bf200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b8118150 con 0x7fb1b8108880 2024-06-13T11:34:41.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.339+0000 7fb1bf200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b8117fd0 con 0x7fb1b810de20 2024-06-13T11:34:41.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.339+0000 7fb1bf200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b81182d0 con 0x7fb1b8107ee0 2024-06-13T11:34:41.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.339+0000 7fb1bd400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1b8108880 0x7fb1b819eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:41.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.339+0000 7fb1bd400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1b8108880 0x7fb1b819eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49456/0 (socket says 172.21.15.2:49456) 2024-06-13T11:34:41.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.339+0000 7fb1bd400640 1 -- 172.21.15.2:0/2406928221 learned_addr learned my addr 172.21.15.2:0/2406928221 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:41.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.339+0000 7fb1be800640 1 --2- 172.21.15.2:0/2406928221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b810de20 0x7fb1b81a2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:41.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.339+0000 7fb1bde00640 1 --2- 172.21.15.2:0/2406928221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b8107ee0 0x7fb1b819e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:41.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.339+0000 7fb1bd400640 1 -- 172.21.15.2:0/2406928221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b8107ee0 msgr2=0x7fb1b819e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:41.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.339+0000 7fb1bd400640 1 --2- 172.21.15.2:0/2406928221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b8107ee0 0x7fb1b819e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.339+0000 7fb1bd400640 1 -- 172.21.15.2:0/2406928221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b810de20 msgr2=0x7fb1b81a2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:41.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.339+0000 7fb1bd400640 1 --2- 172.21.15.2:0/2406928221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b810de20 0x7fb1b81a2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.339+0000 7fb1bd400640 1 -- 172.21.15.2:0/2406928221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b81a3640 con 0x7fb1b8108880 2024-06-13T11:34:41.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.340+0000 7fb1bd400640 1 --2- 172.21.15.2:0/2406928221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1b8108880 0x7fb1b819eb90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb1a800ea60 tx=0x7fb1a800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:41.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.340+0000 7fb1b2a00640 1 -- 172.21.15.2:0/2406928221 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a800cde0 con 0x7fb1b8108880 2024-06-13T11:34:41.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.340+0000 7fb1b2a00640 1 -- 172.21.15.2:0/2406928221 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1a80035f0 con 0x7fb1b8108880 2024-06-13T11:34:41.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.340+0000 7fb1bf200640 1 -- 172.21.15.2:0/2406928221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b81a3930 con 0x7fb1b8108880 2024-06-13T11:34:41.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.340+0000 7fb1b2a00640 1 -- 172.21.15.2:0/2406928221 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8010670 con 0x7fb1b8108880 2024-06-13T11:34:41.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.340+0000 7fb1bf200640 1 -- 172.21.15.2:0/2406928221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b81ab1c0 con 0x7fb1b8108880 2024-06-13T11:34:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.341+0000 7fb1bf200640 1 -- 172.21.15.2:0/2406928221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1b804f760 con 0x7fb1b8108880 2024-06-13T11:34:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.344+0000 7fb1b2a00640 1 -- 172.21.15.2:0/2406928221 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fb1a80037a0 con 0x7fb1b8108880 2024-06-13T11:34:41.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.345+0000 7fb1b2a00640 1 --2- 172.21.15.2:0/2406928221 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb1a00a2d00 0x7fb1a00a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:41.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.346+0000 7fb1b2a00640 1 -- 172.21.15.2:0/2406928221 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7fb1a80cfb40 con 0x7fb1b8108880 2024-06-13T11:34:41.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.346+0000 7fb1bde00640 1 --2- 172.21.15.2:0/2406928221 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb1a00a2d00 0x7fb1a00a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:41.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.346+0000 7fb1bde00640 1 --2- 172.21.15.2:0/2406928221 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb1a00a2d00 0x7fb1a00a51c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009230 tx=0x7fb1ac0058d0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.350+0000 7fb1b2a00640 1 -- 172.21.15.2:0/2406928221 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb1a809c340 con 0x7fb1b8108880 2024-06-13T11:34:41.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.553+0000 7fb1bf200640 1 -- 172.21.15.2:0/2406928221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb1b802d2e0 con 0x7fb1b8108880 2024-06-13T11:34:41.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.553+0000 7fb1b2a00640 1 -- 172.21.15.2:0/2406928221 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v108) ==== 103+0+11 (secure 0 0 0) 0x7fb1a809bc40 con 0x7fb1b8108880 2024-06-13T11:34:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-06-13T11:34:41.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.556+0000 7fb1bf200640 1 -- 172.21.15.2:0/2406928221 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb1a00a2d00 msgr2=0x7fb1a00a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:41.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.556+0000 7fb1bf200640 1 --2- 172.21.15.2:0/2406928221 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb1a00a2d00 0x7fb1a00a51c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009230 tx=0x7fb1ac0058d0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.556+0000 7fb1bf200640 1 -- 172.21.15.2:0/2406928221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1b8108880 msgr2=0x7fb1b819eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:41.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.556+0000 7fb1bf200640 1 --2- 172.21.15.2:0/2406928221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1b8108880 0x7fb1b819eb90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb1a800ea60 tx=0x7fb1a800ef20 comp rx=0 tx=0).stop 2024-06-13T11:34:41.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.556+0000 7fb1bf200640 1 -- 172.21.15.2:0/2406928221 shutdown_connections 2024-06-13T11:34:41.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.556+0000 7fb1bf200640 1 --2- 172.21.15.2:0/2406928221 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fb1a00a2d00 0x7fb1a00a51c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.556+0000 7fb1bf200640 1 --2- 172.21.15.2:0/2406928221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b810de20 0x7fb1b81a2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.556+0000 7fb1bf200640 1 --2- 172.21.15.2:0/2406928221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1b8108880 0x7fb1b819eb90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.556+0000 7fb1bf200640 1 --2- 172.21.15.2:0/2406928221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b8107ee0 0x7fb1b819e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.556+0000 7fb1bf200640 1 -- 172.21.15.2:0/2406928221 >> 172.21.15.2:0/2406928221 conn(0x7fb1b80777b0 msgr2=0x7fb1b80788c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:41.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.557+0000 7fb1bf200640 1 -- 172.21.15.2:0/2406928221 shutdown_connections 2024-06-13T11:34:41.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.557+0000 7fb1bf200640 1 -- 172.21.15.2:0/2406928221 wait complete. 2024-06-13T11:34:41.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-06-13T11:34:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.799+0000 7f50cdc00640 1 -- 172.21.15.2:0/1696742838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50c8103dd0 msgr2=0x7f50c81041b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.799+0000 7f50cdc00640 1 --2- 172.21.15.2:0/1696742838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50c8103dd0 0x7f50c81041b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009860 tx=0x7f50b802a340 comp rx=0 tx=0).stop 2024-06-13T11:34:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.799+0000 7f50cdc00640 1 -- 172.21.15.2:0/1696742838 shutdown_connections 2024-06-13T11:34:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.799+0000 7f50cdc00640 1 --2- 172.21.15.2:0/1696742838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c8108ea0 0x7f50c8110a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.799+0000 7f50cdc00640 1 --2- 172.21.15.2:0/1696742838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c8104780 0x7f50c81087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.799+0000 7f50cdc00640 1 --2- 172.21.15.2:0/1696742838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50c8103dd0 0x7f50c81041b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.799+0000 7f50cdc00640 1 -- 172.21.15.2:0/1696742838 >> 172.21.15.2:0/1696742838 conn(0x7f50c80ff650 msgr2=0x7f50c8101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.800+0000 7f50cdc00640 1 -- 172.21.15.2:0/1696742838 shutdown_connections 2024-06-13T11:34:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.800+0000 7f50cdc00640 1 -- 172.21.15.2:0/1696742838 wait complete. 2024-06-13T11:34:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.801+0000 7f50cdc00640 1 Processor -- start 2024-06-13T11:34:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.801+0000 7f50cdc00640 1 -- start start 2024-06-13T11:34:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.802+0000 7f50cdc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c8103dd0 0x7f50c819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.802+0000 7f50cdc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50c8108ea0 0x7f50c819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.802+0000 7f50cdc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c819ed70 0x7f50c819f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.802+0000 7f50cdc00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8113f50 con 0x7f50c8103dd0 2024-06-13T11:34:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.802+0000 7f50cdc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8113dd0 con 0x7f50c819ed70 2024-06-13T11:34:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.802+0000 7f50cdc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f50c81140d0 con 0x7f50c8108ea0 2024-06-13T11:34:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.802+0000 7f50c6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c8103dd0 0x7f50c819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.802+0000 7f50c6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c8103dd0 0x7f50c819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49464/0 (socket says 172.21.15.2:49464) 2024-06-13T11:34:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.802+0000 7f50c6a00640 1 -- 172.21.15.2:0/1121607318 learned_addr learned my addr 172.21.15.2:0/1121607318 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:34:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.802+0000 7f50c7400640 1 --2- 172.21.15.2:0/1121607318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c819ed70 0x7f50c819f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.802+0000 7f50c6000640 1 --2- 172.21.15.2:0/1121607318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50c8108ea0 0x7f50c819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.802+0000 7f50c6a00640 1 -- 172.21.15.2:0/1121607318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50c8108ea0 msgr2=0x7f50c819a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.802+0000 7f50c6a00640 1 --2- 172.21.15.2:0/1121607318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50c8108ea0 0x7f50c819a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.802+0000 7f50c6a00640 1 -- 172.21.15.2:0/1121607318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c819ed70 msgr2=0x7f50c819f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.802+0000 7f50c6a00640 1 --2- 172.21.15.2:0/1121607318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c819ed70 0x7f50c819f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.802+0000 7f50c6a00640 1 -- 172.21.15.2:0/1121607318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c819f860 con 0x7f50c8103dd0 2024-06-13T11:34:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.803+0000 7f50c6a00640 1 --2- 172.21.15.2:0/1121607318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c8103dd0 0x7f50c819a4b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f50b8035040 tx=0x7f50b8033b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.803+0000 7f50bf400640 1 -- 172.21.15.2:0/1121607318 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8037040 con 0x7f50c8103dd0 2024-06-13T11:34:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.803+0000 7f50cdc00640 1 -- 172.21.15.2:0/1121607318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c819faf0 con 0x7f50c8103dd0 2024-06-13T11:34:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.803+0000 7f50bf400640 1 -- 172.21.15.2:0/1121607318 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50b8040070 con 0x7f50c8103dd0 2024-06-13T11:34:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.803+0000 7f50bf400640 1 -- 172.21.15.2:0/1121607318 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8003950 con 0x7f50c8103dd0 2024-06-13T11:34:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.803+0000 7f50cdc00640 1 -- 172.21.15.2:0/1121607318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c81a7310 con 0x7f50c8103dd0 2024-06-13T11:34:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.805+0000 7f50cdc00640 1 -- 172.21.15.2:0/1121607318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c8068ca0 con 0x7f50c8103dd0 2024-06-13T11:34:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.807+0000 7f50bf400640 1 -- 172.21.15.2:0/1121607318 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f50b80305e0 con 0x7f50c8103dd0 2024-06-13T11:34:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.809+0000 7f50bf400640 1 --2- 172.21.15.2:0/1121607318 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f50ac0a2d00 0x7f50ac0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:34:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.809+0000 7f50bf400640 1 -- 172.21.15.2:0/1121607318 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9483+0+0 (secure 0 0 0) 0x7f50b80ef700 con 0x7f50c8103dd0 2024-06-13T11:34:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.809+0000 7f50c6000640 1 --2- 172.21.15.2:0/1121607318 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f50ac0a2d00 0x7f50ac0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:34:41.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.810+0000 7f50c6000640 1 --2- 172.21.15.2:0/1121607318 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f50ac0a2d00 0x7f50ac0a51c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f50c8102d70 tx=0x7f50b4005f90 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:34:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:41.813+0000 7f50bf400640 1 -- 172.21.15.2:0/1121607318 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f50b80bc010 con 0x7f50c8103dd0 2024-06-13T11:34:41.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:41 smithi002 ceph-mon[32210]: pgmap v338: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:41.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:41 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/423761480' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-13T11:34:41.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:41 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2406928221' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-13T11:34:42.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:41 smithi077 ceph-mon[36410]: pgmap v338: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:42.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:41 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/423761480' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-13T11:34:42.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:41 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2406928221' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-13T11:34:42.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:42.070+0000 7f50cdc00640 1 -- 172.21.15.2:0/1121607318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f50c810c130 con 0x7f50c8103dd0 2024-06-13T11:34:42.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:42.099+0000 7f50bf400640 1 -- 172.21.15.2:0/1121607318 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+740888 (secure 0 0 0) 0x7f50b80bb910 con 0x7f50c8103dd0 2024-06-13T11:34:42.110 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:34:42.111 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:34:42.111 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 26, 2024-06-13T11:34:42.111 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.111 INFO:teuthology.orchestra.run.smithi002.stdout: "active_gid": 25150, 2024-06-13T11:34:42.111 INFO:teuthology.orchestra.run.smithi002.stdout: "active_name": "x", 2024-06-13T11:34:42.111 INFO:teuthology.orchestra.run.smithi002.stdout: "active_addrs": { 2024-06-13T11:34:42.111 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-06-13T11:34:42.112 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.112 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-06-13T11:34:42.112 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2024-06-13T11:34:42.112 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 606530635 2024-06-13T11:34:42.112 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.112 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.112 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-06-13T11:34:42.112 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2024-06-13T11:34:42.113 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 606530635 2024-06-13T11:34:42.113 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.113 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T11:34:42.113 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.113 INFO:teuthology.orchestra.run.smithi002.stdout: "active_addr": "172.21.15.2:6801/606530635", 2024-06-13T11:34:42.113 INFO:teuthology.orchestra.run.smithi002.stdout: "active_change": "2024-06-13T11:23:46.133894+0000", 2024-06-13T11:34:42.113 INFO:teuthology.orchestra.run.smithi002.stdout: "active_mgr_features": 4540701547738038271, 2024-06-13T11:34:42.113 INFO:teuthology.orchestra.run.smithi002.stdout: "available": true, 2024-06-13T11:34:42.114 INFO:teuthology.orchestra.run.smithi002.stdout: "standbys": [ 2024-06-13T11:34:42.114 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.114 INFO:teuthology.orchestra.run.smithi002.stdout: "gid": 25118, 2024-06-13T11:34:42.114 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "y", 2024-06-13T11:34:42.114 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_features": 4540701547738038271, 2024-06-13T11:34:42.114 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-06-13T11:34:42.114 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.114 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-06-13T11:34:42.114 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.115 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.115 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.115 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T11:34:42.115 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T11:34:42.115 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.115 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.115 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.115 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T11:34:42.116 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.116 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.116 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.116 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-06-13T11:34:42.116 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.116 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.116 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.117 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.117 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.117 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.117 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.117 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.117 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.117 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.117 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.118 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.118 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.118 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.118 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.118 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.118 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.118 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.118 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.119 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.119 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.119 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.119 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.119 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.119 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.119 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.119 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.120 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.120 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.120 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.120 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.120 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.120 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.120 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.120 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.121 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.121 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.121 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.121 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.121 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.121 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.121 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.121 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.122 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.122 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.122 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.122 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.122 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.122 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.122 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.122 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.123 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.123 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.123 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.123 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.123 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.123 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.123 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.124 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.124 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.124 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.124 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.124 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.124 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.124 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.125 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.125 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.125 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.125 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.125 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.125 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.125 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.125 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-06-13T11:34:42.126 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-06-13T11:34:42.126 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.126 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.126 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.126 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.126 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.126 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.126 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.127 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-06-13T11:34:42.127 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.127 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.127 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.127 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.127 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-06-13T11:34:42.127 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-06-13T11:34:42.127 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.128 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.128 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.128 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-06-13T11:34:42.128 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.128 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.128 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.128 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-06-13T11:34:42.128 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.128 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.129 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.129 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.129 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-06-13T11:34:42.129 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-06-13T11:34:42.129 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.129 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.129 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.129 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.130 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.130 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.130 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.130 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-06-13T11:34:42.130 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.130 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.130 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.130 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.131 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-06-13T11:34:42.131 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-06-13T11:34:42.131 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.131 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.131 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.131 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.131 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.131 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.131 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.132 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-06-13T11:34:42.132 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.132 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.132 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.132 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.132 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-06-13T11:34:42.132 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-06-13T11:34:42.132 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.133 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.133 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.133 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-06-13T11:34:42.133 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.133 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.133 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.133 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-06-13T11:34:42.133 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.134 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.134 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.134 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.134 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-06-13T11:34:42.134 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-06-13T11:34:42.134 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.134 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.134 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.135 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.135 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.135 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.135 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.135 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-06-13T11:34:42.135 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.135 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.136 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.136 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.136 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-06-13T11:34:42.136 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-06-13T11:34:42.136 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.136 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.136 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.136 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.137 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.137 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.137 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.137 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-13T11:34:42.137 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.137 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.137 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.137 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.137 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-06-13T11:34:42.138 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-06-13T11:34:42.138 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.138 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.138 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.138 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.138 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.138 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.138 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.139 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-06-13T11:34:42.139 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.139 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.139 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.139 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.139 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.139 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.139 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.139 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-06-13T11:34:42.140 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.140 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.140 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.140 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-06-13T11:34:42.140 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-06-13T11:34:42.140 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.140 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.140 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.140 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.141 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.141 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.141 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.141 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-06-13T11:34:42.141 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.141 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.141 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.141 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.142 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-06-13T11:34:42.142 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-06-13T11:34:42.142 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.142 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.142 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.142 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-06-13T11:34:42.142 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.143 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.143 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.143 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-06-13T11:34:42.143 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-13T11:34:42.143 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.143 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.143 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.143 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-06-13T11:34:42.144 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-06-13T11:34:42.144 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T11:34:42.144 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.144 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.144 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T11:34:42.144 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-06-13T11:34:42.144 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-06-13T11:34:42.144 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.144 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-13T11:34:42.145 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-13T11:34:42.145 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.145 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.145 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-06-13T11:34:42.145 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-06-13T11:34:42.145 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T11:34:42.145 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.145 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.146 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-06-13T11:34:42.146 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T11:34:42.146 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-06-13T11:34:42.146 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.146 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-13T11:34:42.146 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.146 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.146 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.146 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.147 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-06-13T11:34:42.147 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-06-13T11:34:42.147 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.147 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.147 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.147 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-06-13T11:34:42.147 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.147 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.147 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.148 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-13T11:34:42.148 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-13T11:34:42.148 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.148 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.148 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.148 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-06-13T11:34:42.148 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-06-13T11:34:42.148 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:42.148 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.149 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.149 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-06-13T11:34:42.149 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-06-13T11:34:42.149 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-06-13T11:34:42.149 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.149 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-06-13T11:34:42.149 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-13T11:34:42.149 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.150 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.150 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.150 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-06-13T11:34:42.150 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-06-13T11:34:42.150 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.150 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.150 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.150 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-06-13T11:34:42.151 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.151 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.151 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.151 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-06-13T11:34:42.151 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-13T11:34:42.151 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.151 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.151 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.152 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-06-13T11:34:42.152 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-06-13T11:34:42.152 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T11:34:42.152 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.152 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.152 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T11:34:42.152 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-06-13T11:34:42.152 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-06-13T11:34:42.153 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.153 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-13T11:34:42.153 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-13T11:34:42.153 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.153 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.153 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.153 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.153 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.154 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.154 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.154 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.154 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.154 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.154 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.154 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.154 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.155 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.155 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.155 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.155 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.155 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.155 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.155 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.155 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.156 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.156 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.156 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.156 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.156 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.156 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.156 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.156 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.156 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.157 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.157 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.157 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.157 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.157 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.157 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.158 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.158 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.158 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.158 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.158 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.158 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.158 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.158 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.159 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.159 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.159 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.159 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.159 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.159 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.159 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.159 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.160 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.160 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.160 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.160 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.160 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.160 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.160 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.160 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.161 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.161 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.161 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.161 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.161 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.161 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.161 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.161 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.161 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.162 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.162 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.162 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.162 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.162 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-06-13T11:34:42.162 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-06-13T11:34:42.162 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:42.162 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.163 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.163 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T11:34:42.163 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.163 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.163 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.163 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-13T11:34:42.163 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.163 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.164 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.164 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.164 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-06-13T11:34:42.164 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-06-13T11:34:42.164 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.164 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.164 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.164 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-06-13T11:34:42.164 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.165 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.165 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.165 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-06-13T11:34:42.165 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-06-13T11:34:42.165 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-06-13T11:34:42.165 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-06-13T11:34:42.165 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-06-13T11:34:42.165 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.166 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-06-13T11:34:42.166 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.166 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.166 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.166 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.166 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-06-13T11:34:42.166 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-06-13T11:34:42.166 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.167 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.167 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.167 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.167 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.167 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.167 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.167 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-13T11:34:42.167 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.167 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.168 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.168 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.168 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T11:34:42.168 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T11:34:42.168 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.168 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.168 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.168 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T11:34:42.169 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.169 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.169 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.169 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-13T11:34:42.169 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.169 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.169 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.169 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.169 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-06-13T11:34:42.170 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-06-13T11:34:42.170 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.170 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.170 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.170 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T11:34:42.170 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T11:34:42.170 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.170 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.171 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-13T11:34:42.171 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-13T11:34:42.171 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.171 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.171 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.171 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-06-13T11:34:42.171 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-06-13T11:34:42.171 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T11:34:42.172 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.172 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.172 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:42.172 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.172 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.172 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.172 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-13T11:34:42.172 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.172 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.173 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.173 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.173 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.173 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.173 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.173 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-06-13T11:34:42.173 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.173 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.173 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.174 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-06-13T11:34:42.174 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-06-13T11:34:42.174 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:42.174 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.174 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.174 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-06-13T11:34:42.174 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.174 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.175 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.175 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-13T11:34:42.175 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.175 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.175 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.175 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.175 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-06-13T11:34:42.175 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-06-13T11:34:42.175 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.176 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.176 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.176 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-06-13T11:34:42.176 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.176 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.176 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.176 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-13T11:34:42.176 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.177 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.177 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.177 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.177 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-06-13T11:34:42.177 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-06-13T11:34:42.177 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.177 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.177 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.177 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-06-13T11:34:42.178 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.178 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.178 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.178 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-13T11:34:42.178 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.178 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.178 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.179 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.179 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-06-13T11:34:42.179 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-06-13T11:34:42.179 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.179 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.179 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.179 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.179 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.180 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.180 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.180 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-13T11:34:42.180 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-13T11:34:42.180 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.180 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.180 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.180 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-06-13T11:34:42.180 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-06-13T11:34:42.181 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.181 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.181 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.181 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T11:34:42.181 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.181 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.181 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.181 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-13T11:34:42.182 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.182 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.182 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.182 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.182 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-06-13T11:34:42.182 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-06-13T11:34:42.182 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:42.182 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.183 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.183 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-06-13T11:34:42.183 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.183 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.183 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.183 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-13T11:34:42.183 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.183 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.184 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.184 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.184 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-06-13T11:34:42.184 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-06-13T11:34:42.184 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.184 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.184 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.184 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.185 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.185 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.185 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.185 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-06-13T11:34:42.185 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-06-13T11:34:42.185 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-06-13T11:34:42.185 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.185 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-13T11:34:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-06-13T11:34:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-06-13T11:34:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.186 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.187 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.187 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.187 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.187 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.187 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.187 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-13T11:34:42.187 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.187 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.188 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.188 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.188 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-06-13T11:34:42.188 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-06-13T11:34:42.188 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.188 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.188 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.188 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.189 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.189 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.189 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.189 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-13T11:34:42.189 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.189 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.189 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.189 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.189 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-06-13T11:34:42.190 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-06-13T11:34:42.190 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.190 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.190 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.190 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.190 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.190 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.190 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.191 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-13T11:34:42.191 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.191 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.191 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.191 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.191 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-06-13T11:34:42.191 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-06-13T11:34:42.191 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.192 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.192 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.192 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-13T11:34:42.192 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.192 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.192 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.192 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T11:34:42.192 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.193 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.193 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.193 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.193 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-06-13T11:34:42.193 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-06-13T11:34:42.193 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.193 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.193 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.193 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-13T11:34:42.194 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.194 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.194 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.194 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-06-13T11:34:42.194 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.194 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.194 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.194 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.195 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-06-13T11:34:42.195 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-06-13T11:34:42.195 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.195 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.195 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.195 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-13T11:34:42.195 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.195 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.196 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.196 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-06-13T11:34:42.196 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.196 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.196 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.196 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.196 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-06-13T11:34:42.196 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-06-13T11:34:42.196 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-13T11:34:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T11:34:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.198 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.198 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.198 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.198 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-06-13T11:34:42.198 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-06-13T11:34:42.198 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.198 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.198 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.198 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-13T11:34:42.199 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.199 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.199 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.199 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-06-13T11:34:42.199 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.199 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.199 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.199 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.200 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-06-13T11:34:42.200 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-06-13T11:34:42.200 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.200 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.200 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.200 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-13T11:34:42.200 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.200 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.201 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.201 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-06-13T11:34:42.201 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.201 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.201 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.201 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-06-13T11:34:42.201 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-06-13T11:34:42.201 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.202 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.202 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.202 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-13T11:34:42.202 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.202 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.202 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.202 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-06-13T11:34:42.202 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.203 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.203 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.203 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.203 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-06-13T11:34:42.203 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-06-13T11:34:42.203 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.203 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.203 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.203 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-13T11:34:42.204 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.204 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.204 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.204 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-06-13T11:34:42.204 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.204 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.204 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.204 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.205 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-06-13T11:34:42.205 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-06-13T11:34:42.205 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.205 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.205 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.205 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-13T11:34:42.205 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.205 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.206 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.206 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-06-13T11:34:42.206 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.206 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.206 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.206 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.206 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-06-13T11:34:42.206 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-06-13T11:34:42.207 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.207 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.207 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.207 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-13T11:34:42.207 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.207 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.207 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.207 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-06-13T11:34:42.208 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.208 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.208 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.208 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.208 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-06-13T11:34:42.208 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-06-13T11:34:42.208 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.208 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.209 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.209 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-13T11:34:42.209 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.209 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.209 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.209 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T11:34:42.209 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.209 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.209 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.210 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-06-13T11:34:42.210 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-06-13T11:34:42.210 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.210 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.210 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.210 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-13T11:34:42.211 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.211 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.211 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.211 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-06-13T11:34:42.211 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.211 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.211 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.211 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.211 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-06-13T11:34:42.212 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-06-13T11:34:42.212 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.212 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.212 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.212 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-13T11:34:42.212 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.212 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.212 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.213 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T11:34:42.213 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.213 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.213 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.213 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.213 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-06-13T11:34:42.213 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-06-13T11:34:42.213 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.214 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.214 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.214 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-13T11:34:42.214 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.214 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.214 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.214 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-06-13T11:34:42.214 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.215 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.215 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.215 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.215 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-06-13T11:34:42.215 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-06-13T11:34:42.215 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.215 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.215 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.215 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-13T11:34:42.216 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.216 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.216 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.216 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-06-13T11:34:42.216 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.216 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.216 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.216 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.217 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-06-13T11:34:42.217 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-06-13T11:34:42.217 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.217 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.217 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.217 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-13T11:34:42.217 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.217 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.218 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.218 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-06-13T11:34:42.218 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.218 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.218 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.218 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.218 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-06-13T11:34:42.218 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-06-13T11:34:42.219 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.219 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.219 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.219 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.219 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.219 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.219 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.219 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-06-13T11:34:42.220 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.220 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.220 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.220 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.220 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-06-13T11:34:42.220 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-06-13T11:34:42.220 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.220 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.220 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.221 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T11:34:42.221 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.221 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.221 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.221 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-13T11:34:42.221 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.221 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.221 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.221 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.222 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-06-13T11:34:42.222 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-06-13T11:34:42.222 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.222 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.222 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.222 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-06-13T11:34:42.222 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.222 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.222 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.223 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-13T11:34:42.223 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.223 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.223 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.223 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.223 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-06-13T11:34:42.223 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-06-13T11:34:42.223 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.224 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.224 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.224 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-06-13T11:34:42.224 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.224 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.224 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.224 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-13T11:34:42.224 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.225 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.225 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.225 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.225 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-06-13T11:34:42.225 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-06-13T11:34:42.225 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.225 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.225 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.226 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-06-13T11:34:42.226 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.226 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.226 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.226 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-06-13T11:34:42.226 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.226 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.226 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.226 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.227 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-06-13T11:34:42.227 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-06-13T11:34:42.227 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.227 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.227 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.227 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.227 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.227 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.228 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.228 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-13T11:34:42.228 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.228 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.228 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.228 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.228 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-06-13T11:34:42.228 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-06-13T11:34:42.228 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.229 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.229 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.229 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T11:34:42.229 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.229 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.229 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.229 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-06-13T11:34:42.229 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.229 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.230 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.230 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.230 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-06-13T11:34:42.230 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-06-13T11:34:42.230 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.230 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.230 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.230 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-13T11:34:42.231 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.231 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.231 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.231 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-13T11:34:42.231 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.231 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.231 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.231 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.232 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-06-13T11:34:42.232 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-06-13T11:34:42.232 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.232 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.232 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.232 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T11:34:42.232 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.232 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.232 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.233 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-06-13T11:34:42.233 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.233 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.233 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.233 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.233 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-06-13T11:34:42.233 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-06-13T11:34:42.233 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.233 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.233 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.234 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.234 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.234 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.234 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.234 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-13T11:34:42.234 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.234 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.234 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.235 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.235 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-06-13T11:34:42.235 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-06-13T11:34:42.235 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.235 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.235 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.235 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.235 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.236 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.236 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.236 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-13T11:34:42.236 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.236 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.236 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.236 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.236 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.236 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.237 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.237 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.237 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.237 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.237 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.237 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.237 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.237 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.238 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.238 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.238 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.238 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.238 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.238 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.238 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.238 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.239 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.239 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.239 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.239 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-06-13T11:34:42.239 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-06-13T11:34:42.239 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.239 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.239 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.240 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.240 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.240 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.240 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.240 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-13T11:34:42.240 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.240 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.240 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.241 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.241 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.241 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.241 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.241 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.241 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.241 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.241 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.242 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.242 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.242 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-13T11:34:42.242 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.242 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.242 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.242 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.242 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.242 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.243 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.243 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.243 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.243 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.243 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.243 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.243 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.243 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.244 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.244 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.244 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.244 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.244 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.244 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.244 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.244 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.245 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.245 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.245 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.245 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.245 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.245 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.245 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.245 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.246 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.246 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.246 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.246 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.246 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.246 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.246 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.247 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.247 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.247 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-13T11:34:42.247 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-13T11:34:42.247 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.247 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.247 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.247 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.248 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.248 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.248 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.248 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-13T11:34:42.248 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.248 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.248 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.248 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-13T11:34:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-13T11:34:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-06-13T11:34:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-13T11:34:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-06-13T11:34:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-06-13T11:34:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.251 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.251 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.251 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:42.251 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.251 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.251 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.251 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-06-13T11:34:42.251 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.252 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.252 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.252 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.252 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-06-13T11:34:42.252 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-06-13T11:34:42.252 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.252 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.252 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.252 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:42.253 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.253 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.253 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.253 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-13T11:34:42.253 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.253 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.253 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.253 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.254 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-06-13T11:34:42.254 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-06-13T11:34:42.254 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.254 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.254 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.254 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.254 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.254 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.254 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.255 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-06-13T11:34:42.255 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.255 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.255 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.255 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.255 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-06-13T11:34:42.255 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-06-13T11:34:42.255 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.255 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.256 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.256 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-06-13T11:34:42.256 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.256 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.256 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.256 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-06-13T11:34:42.256 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-06-13T11:34:42.256 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.256 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-06-13T11:34:42.257 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.257 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.257 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.257 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.257 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-06-13T11:34:42.257 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-06-13T11:34:42.257 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.257 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.257 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.258 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-06-13T11:34:42.258 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.258 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.258 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.258 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-13T11:34:42.258 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.258 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.258 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.259 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.259 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-06-13T11:34:42.259 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-06-13T11:34:42.259 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.259 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.259 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.259 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-13T11:34:42.259 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.259 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.260 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.260 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-13T11:34:42.260 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.260 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.260 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.260 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.260 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-06-13T11:34:42.260 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-06-13T11:34:42.261 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.261 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.261 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.261 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.261 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.261 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.261 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.261 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-13T11:34:42.261 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.262 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.262 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.262 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.262 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-06-13T11:34:42.262 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-06-13T11:34:42.262 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.262 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.263 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.263 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.263 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.263 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.263 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.263 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-13T11:34:42.263 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.263 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.263 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.264 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.264 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-06-13T11:34:42.264 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-06-13T11:34:42.264 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.264 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.264 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.264 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.264 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.264 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.265 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.265 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-13T11:34:42.265 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.265 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.265 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.265 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.265 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-06-13T11:34:42.265 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-06-13T11:34:42.266 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.266 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.266 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.266 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.266 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.266 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.266 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.266 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-13T11:34:42.267 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.267 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.267 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.267 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.267 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-06-13T11:34:42.267 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-06-13T11:34:42.267 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.267 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.268 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.268 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.268 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.268 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.268 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.268 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-13T11:34:42.268 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.268 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.268 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.269 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.269 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-06-13T11:34:42.269 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-06-13T11:34:42.269 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.269 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.269 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.269 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-06-13T11:34:42.269 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.270 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.270 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.270 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-06-13T11:34:42.270 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.270 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.270 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.270 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.270 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-06-13T11:34:42.271 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-06-13T11:34:42.271 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.271 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.271 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.271 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.271 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.271 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.271 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.272 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-13T11:34:42.272 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.272 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.272 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.272 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.272 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-06-13T11:34:42.272 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-06-13T11:34:42.272 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.272 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.273 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.273 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.273 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.273 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.273 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.273 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-13T11:34:42.273 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.273 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.273 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.274 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.274 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-06-13T11:34:42.274 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-06-13T11:34:42.274 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.274 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.274 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.274 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.274 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.275 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.275 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.275 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-13T11:34:42.275 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.275 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.275 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.275 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.275 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-06-13T11:34:42.275 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-06-13T11:34:42.276 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.276 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.276 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.276 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.276 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.276 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.276 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.276 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-06-13T11:34:42.276 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.277 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.277 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.277 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.277 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-06-13T11:34:42.277 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-06-13T11:34:42.277 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.277 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.277 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.277 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.278 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.278 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.278 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.278 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-13T11:34:42.278 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.278 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.278 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.278 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.279 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-06-13T11:34:42.279 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-06-13T11:34:42.279 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.279 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.279 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.279 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.279 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.279 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.279 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.280 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-13T11:34:42.280 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.280 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.280 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.280 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.280 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.280 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.280 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.281 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-06-13T11:34:42.281 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.281 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.281 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.281 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.281 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.281 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.281 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.281 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.282 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.282 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.282 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.282 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.282 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.282 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.282 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.282 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.283 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.283 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.283 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.283 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.283 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.283 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.283 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.283 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.284 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.284 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.284 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.284 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.284 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.284 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.284 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.284 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.285 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.285 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.285 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.285 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.285 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.285 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.285 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.285 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.286 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.286 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.286 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.286 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.286 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.286 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.286 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.286 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.286 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.287 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.287 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.287 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.287 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.287 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.287 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.287 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.287 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.288 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.288 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.288 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.288 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.288 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.288 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.288 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.288 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.289 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.289 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.289 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.289 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.289 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.289 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.289 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.289 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.290 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-06-13T11:34:42.290 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-06-13T11:34:42.290 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.290 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.290 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.290 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-06-13T11:34:42.290 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.290 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.291 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.291 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-13T11:34:42.291 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.291 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.291 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.291 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.291 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-06-13T11:34:42.291 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-06-13T11:34:42.291 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.292 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.292 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.292 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-06-13T11:34:42.292 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.292 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.292 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.292 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-13T11:34:42.292 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.292 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.293 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.293 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.293 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.293 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.293 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.293 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-06-13T11:34:42.293 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.293 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.294 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.294 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-13T11:34:42.294 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-13T11:34:42.294 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.294 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.294 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.294 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:42.294 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.295 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.295 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.295 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.295 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.295 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.295 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.295 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.295 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-06-13T11:34:42.296 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-13T11:34:42.296 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.296 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.296 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.296 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.296 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.296 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.296 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.297 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.297 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.297 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.297 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.297 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.297 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-13T11:34:42.297 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-13T11:34:42.297 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.297 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.298 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.298 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.298 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.298 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.298 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.298 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.298 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.298 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.299 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.299 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.299 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-06-13T11:34:42.299 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-06-13T11:34:42.299 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.299 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.299 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.299 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.300 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.300 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.300 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.300 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.300 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.300 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.300 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.300 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.300 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-13T11:34:42.301 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-13T11:34:42.301 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.301 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.301 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.301 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.301 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.301 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.301 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.302 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.302 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.302 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.302 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.302 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.302 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-06-13T11:34:42.302 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-13T11:34:42.302 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.302 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.303 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.303 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.303 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.303 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.303 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.303 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.303 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.303 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.304 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.304 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.304 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-13T11:34:42.304 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-13T11:34:42.304 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.304 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.304 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.304 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.305 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.305 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.305 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.305 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.305 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.305 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.305 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.305 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.305 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-13T11:34:42.306 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-13T11:34:42.306 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.306 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.306 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.306 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.306 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.306 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.307 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.307 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.307 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.307 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.307 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.307 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.307 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-13T11:34:42.307 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-13T11:34:42.308 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.308 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.308 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.308 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.308 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.308 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.308 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.308 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.308 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.309 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.309 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.309 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.309 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-13T11:34:42.309 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-13T11:34:42.309 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.309 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.309 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.310 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.310 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.310 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.310 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.310 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.310 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.310 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.310 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.310 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-13T11:34:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-13T11:34:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.311 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.312 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.312 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.312 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.312 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.312 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.312 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.312 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.312 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-13T11:34:42.313 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-13T11:34:42.313 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.313 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.313 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.313 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.313 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.313 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.313 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.314 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.314 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.314 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.314 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.314 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.314 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-13T11:34:42.314 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-13T11:34:42.314 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.315 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.315 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.315 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.315 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.315 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.315 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.315 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.315 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.316 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.316 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.316 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.316 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-13T11:34:42.316 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-13T11:34:42.316 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.316 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.316 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.316 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.317 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.317 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.317 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.317 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.317 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.317 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.317 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.317 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.318 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-06-13T11:34:42.318 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-13T11:34:42.318 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.318 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.318 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.318 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T11:34:42.318 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.318 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.319 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.319 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.319 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.319 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.319 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.319 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.319 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-13T11:34:42.319 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-13T11:34:42.319 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.320 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.320 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.320 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.320 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.320 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.320 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.320 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.320 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.321 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.321 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.321 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.321 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-06-13T11:34:42.321 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-06-13T11:34:42.321 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.321 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.321 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.322 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.322 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.322 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.322 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.322 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.322 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.322 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.322 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.323 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.323 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-06-13T11:34:42.323 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-13T11:34:42.323 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.323 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.323 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.323 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T11:34:42.323 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.324 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.324 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.324 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.324 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.324 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.324 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.324 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.324 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-13T11:34:42.324 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-13T11:34:42.325 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.325 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.325 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.325 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.325 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.325 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.325 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.325 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.326 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.326 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.326 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.326 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.326 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-13T11:34:42.326 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-13T11:34:42.326 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.327 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.327 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.327 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.327 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.327 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.327 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.327 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.327 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.328 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.328 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.328 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.328 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-13T11:34:42.328 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-13T11:34:42.328 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.328 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.328 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.328 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.329 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.329 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.329 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.329 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.329 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.329 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.329 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.329 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.330 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-13T11:34:42.330 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-13T11:34:42.330 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.330 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.330 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.330 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.330 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.330 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.331 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.331 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.331 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.331 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.331 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.331 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.331 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-06-13T11:34:42.331 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-13T11:34:42.331 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.332 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.332 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.332 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.332 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.332 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.332 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.332 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.332 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.333 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.333 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.333 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.333 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-13T11:34:42.333 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-13T11:34:42.333 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.333 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.333 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.333 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.334 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.334 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.334 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.334 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.334 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.334 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.334 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.334 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.335 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-13T11:34:42.335 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-13T11:34:42.335 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.335 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.335 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.335 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.335 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.335 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.336 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.336 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.336 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.336 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.336 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.336 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.336 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-13T11:34:42.336 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-13T11:34:42.337 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.337 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.337 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.337 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.337 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.337 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.337 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.337 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.338 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.338 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.338 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.338 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.338 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-13T11:34:42.338 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-13T11:34:42.338 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.338 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.339 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.339 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.339 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.339 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.339 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.339 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.339 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.339 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.340 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.340 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.340 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-13T11:34:42.340 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-13T11:34:42.340 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.340 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.340 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.340 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.340 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.341 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.341 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.341 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.341 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.341 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.341 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.341 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.341 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-13T11:34:42.341 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-13T11:34:42.342 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.342 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.342 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.342 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.342 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.342 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.342 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.342 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.343 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.343 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.343 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.343 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.343 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-13T11:34:42.343 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-13T11:34:42.343 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.343 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.343 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.344 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.344 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.344 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.344 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.344 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.344 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.344 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.344 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.344 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.345 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-13T11:34:42.345 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-13T11:34:42.345 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.345 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.345 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.345 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.345 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.345 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.345 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.345 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-06-13T11:34:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-13T11:34:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.347 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.347 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.347 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.347 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.347 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.347 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.347 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.348 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.348 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.348 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-13T11:34:42.348 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-13T11:34:42.348 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.348 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.348 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.348 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-13T11:34:42.349 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.349 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.349 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.349 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.349 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.349 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.349 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.349 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.349 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-13T11:34:42.349 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-13T11:34:42.350 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.350 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.350 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.350 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:42.350 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.350 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.350 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.350 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.351 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.351 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.351 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.351 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.351 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-13T11:34:42.351 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-13T11:34:42.351 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.351 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.352 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.352 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-06-13T11:34:42.352 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.352 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.352 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.352 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.352 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.352 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.353 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.353 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.353 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-13T11:34:42.353 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-13T11:34:42.353 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.353 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.353 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.353 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-06-13T11:34:42.354 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.354 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.354 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.354 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.354 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.354 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.354 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.354 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.355 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-06-13T11:34:42.355 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-13T11:34:42.355 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.355 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.355 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.355 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.355 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.355 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.356 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.356 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.356 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.356 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.356 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.356 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.356 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-13T11:34:42.356 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-13T11:34:42.356 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.357 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.357 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.357 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T11:34:42.357 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.357 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.357 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.357 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.357 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.358 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.358 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.358 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.358 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-06-13T11:34:42.358 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-13T11:34:42.358 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.358 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.358 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.359 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.359 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.359 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.359 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.359 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.359 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.359 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.359 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.359 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.360 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-06-13T11:34:42.360 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-13T11:34:42.360 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.360 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.360 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.360 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.360 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.361 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.361 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.361 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.361 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.361 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.361 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.361 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.361 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-13T11:34:42.361 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-13T11:34:42.362 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.362 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.362 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.362 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T11:34:42.362 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.362 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.362 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.362 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.363 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.363 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.363 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.363 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.363 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-13T11:34:42.363 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-13T11:34:42.363 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.363 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.363 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.364 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:42.364 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.364 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.364 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.364 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.364 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.364 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.364 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.365 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.365 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-13T11:34:42.365 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-13T11:34:42.365 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.365 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.365 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.365 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T11:34:42.365 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.365 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-06-13T11:34:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-06-13T11:34:42.367 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.367 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.367 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.367 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.367 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.367 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.367 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.367 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.368 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.368 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.368 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.368 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.368 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-06-13T11:34:42.368 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-06-13T11:34:42.368 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.368 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.368 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.369 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.369 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.369 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.369 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.369 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.369 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.369 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.369 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.369 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.370 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-06-13T11:34:42.370 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-06-13T11:34:42.370 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.370 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.370 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.370 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.371 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.371 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.371 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.371 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-06-13T11:34:42.371 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.371 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.371 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.371 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.372 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-06-13T11:34:42.372 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-06-13T11:34:42.372 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.372 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.372 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.372 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-06-13T11:34:42.372 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.372 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.372 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.373 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.373 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.373 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.373 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.373 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.373 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-06-13T11:34:42.373 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-06-13T11:34:42.373 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.374 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.374 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.374 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.374 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.374 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.374 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.374 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.375 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.375 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.375 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.375 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.375 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.375 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.375 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.375 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.375 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.376 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.376 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.376 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.376 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.376 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.376 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.376 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.376 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.376 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.377 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.377 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.377 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.377 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.377 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.377 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.377 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.377 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.378 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.378 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.378 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.378 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.378 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.378 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.378 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.378 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.379 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.379 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.379 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.379 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.379 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.379 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.379 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.379 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.379 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.380 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.380 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.380 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.380 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.380 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.380 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.380 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.380 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.381 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.381 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.381 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.381 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.381 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.381 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.381 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.381 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.381 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.382 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.382 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.382 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.382 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.382 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.382 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.382 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.382 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.383 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.383 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.383 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.383 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.383 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.383 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.383 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-06-13T11:34:42.383 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-06-13T11:34:42.384 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.384 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.384 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.384 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.384 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.384 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.384 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.384 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-06-13T11:34:42.385 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.385 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.385 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.385 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.385 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-06-13T11:34:42.385 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-06-13T11:34:42.385 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.385 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.386 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.386 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.386 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.386 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.386 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.386 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.386 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.386 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.387 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.387 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.387 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T11:34:42.387 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T11:34:42.387 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.387 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.387 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.387 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-06-13T11:34:42.387 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.388 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.388 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.388 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.388 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.388 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.388 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.388 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.388 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T11:34:42.389 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T11:34:42.389 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.389 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.389 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.389 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-06-13T11:34:42.389 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.389 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.389 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.390 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.390 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.390 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.390 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.390 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.390 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-06-13T11:34:42.390 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-06-13T11:34:42.390 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.390 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.391 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.391 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.391 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.391 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.391 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.391 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.391 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.391 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.392 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.392 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.392 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-06-13T11:34:42.392 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-06-13T11:34:42.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.392 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.392 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.392 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-06-13T11:34:42.393 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.393 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.393 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.393 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.393 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.393 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.393 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.394 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.394 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-06-13T11:34:42.394 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-06-13T11:34:42.394 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.394 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.394 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.394 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-06-13T11:34:42.394 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.395 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.395 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.395 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.395 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-06-13T11:34:42.395 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.395 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.395 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.395 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.396 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.396 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.396 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-06-13T11:34:42.396 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-06-13T11:34:42.396 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.396 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.396 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.396 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-06-13T11:34:42.397 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-06-13T11:34:42.397 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-06-13T11:34:42.397 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.397 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.397 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.397 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.397 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.397 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.398 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-06-13T11:34:42.398 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-06-13T11:34:42.398 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.398 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.398 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.398 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.398 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.398 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.398 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.399 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.399 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.399 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.399 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.399 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.399 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.399 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.399 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.400 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-06-13T11:34:42.400 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.400 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.400 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.400 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-06-13T11:34:42.400 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-06-13T11:34:42.400 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.400 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.401 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.401 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.401 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.401 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.401 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.401 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-06-13T11:34:42.401 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.401 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.402 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.402 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.402 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.402 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.402 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.402 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.402 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.402 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.403 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.403 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.403 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.403 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.403 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.403 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.403 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.403 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.404 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.404 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.404 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.404 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.404 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.404 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.404 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.404 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.404 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.405 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.405 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.405 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.405 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.405 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.405 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.405 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.405 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.406 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.406 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.406 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.406 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.406 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.406 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.406 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.407 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.407 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.407 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.407 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.407 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.407 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.407 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.407 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.407 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.408 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.408 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.408 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.408 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.408 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.408 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.408 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.408 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.409 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.409 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.409 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.409 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.409 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.409 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.409 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.409 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.410 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.410 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.410 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.410 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.410 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.410 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-06-13T11:34:42.410 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-06-13T11:34:42.411 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.411 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.411 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.411 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-06-13T11:34:42.411 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.411 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.411 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.411 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-13T11:34:42.412 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.412 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.412 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.412 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.412 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-06-13T11:34:42.412 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-06-13T11:34:42.412 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.412 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.413 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.413 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-06-13T11:34:42.413 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.413 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.413 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.413 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-13T11:34:42.413 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.413 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.414 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.414 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.414 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-06-13T11:34:42.414 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-06-13T11:34:42.414 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.414 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.414 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.414 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-06-13T11:34:42.415 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.415 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.415 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.415 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-06-13T11:34:42.415 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.415 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.415 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.416 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-06-13T11:34:42.416 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-06-13T11:34:42.416 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.416 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.416 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.416 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-06-13T11:34:42.416 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.416 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.417 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.417 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-13T11:34:42.417 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.417 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.417 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.417 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-06-13T11:34:42.417 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-06-13T11:34:42.418 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.418 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.418 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.418 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.418 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.418 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.418 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.418 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-13T11:34:42.419 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.419 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.419 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.419 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.419 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T11:34:42.419 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T11:34:42.419 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.419 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.420 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.420 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T11:34:42.420 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.420 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.420 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.420 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-06-13T11:34:42.420 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.420 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.421 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.421 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.421 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-06-13T11:34:42.421 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-06-13T11:34:42.421 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.421 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.421 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.421 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-06-13T11:34:42.421 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.422 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.422 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.422 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-13T11:34:42.422 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.422 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.422 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.422 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.422 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.423 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.423 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.423 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-06-13T11:34:42.423 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.423 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.423 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.423 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.423 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.423 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.424 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.424 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.424 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.424 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.424 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.424 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.424 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.424 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.425 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.425 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.425 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.425 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.425 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.425 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.425 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.425 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.426 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.426 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.426 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.426 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.426 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.426 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.426 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.426 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.427 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.427 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.427 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.427 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.427 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.427 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.427 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.427 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.427 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.428 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.428 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.428 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.428 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.428 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.428 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.428 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.428 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.429 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.429 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.429 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.429 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.429 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.429 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.429 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.429 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.429 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.430 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.430 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.430 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.430 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.430 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.430 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.430 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.430 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.431 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.431 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.431 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.431 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.431 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.431 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.431 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.431 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.432 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.432 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-06-13T11:34:42.432 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-06-13T11:34:42.432 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.432 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.432 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.432 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-06-13T11:34:42.432 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.433 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.433 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.433 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.433 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.433 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.433 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.433 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.433 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-06-13T11:34:42.434 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-06-13T11:34:42.434 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.434 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.434 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.434 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-06-13T11:34:42.434 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.434 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.434 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.435 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.435 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.435 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.435 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.435 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.435 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T11:34:42.435 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T11:34:42.435 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.436 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.436 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.436 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T11:34:42.436 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.436 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.436 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.436 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.436 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.437 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.437 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.437 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.437 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.437 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.437 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.437 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-06-13T11:34:42.437 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-06-13T11:34:42.438 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-06-13T11:34:42.438 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.438 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-06-13T11:34:42.438 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-06-13T11:34:42.438 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.438 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.438 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.438 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-06-13T11:34:42.439 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.439 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.439 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.439 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-13T11:34:42.439 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.439 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.439 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.439 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.440 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-06-13T11:34:42.440 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-06-13T11:34:42.440 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.440 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.440 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.440 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-06-13T11:34:42.440 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.440 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.441 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.441 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-13T11:34:42.441 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.441 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.441 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.441 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.441 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-06-13T11:34:42.441 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-06-13T11:34:42.442 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.442 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.442 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.442 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.442 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.442 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.442 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.442 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-06-13T11:34:42.443 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.443 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.443 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.443 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.443 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T11:34:42.443 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T11:34:42.443 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.443 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.443 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.444 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-06-13T11:34:42.444 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-06-13T11:34:42.444 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.444 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.444 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-13T11:34:42.444 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.444 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.444 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.445 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.445 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.445 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.445 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.445 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.445 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.445 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.445 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.446 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.446 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.446 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.446 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.446 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.446 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.446 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.446 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.447 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.447 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.447 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.447 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.447 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.447 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.447 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.447 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.447 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.448 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.448 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.448 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.448 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.448 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.448 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.448 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.448 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.449 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.449 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.449 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.449 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.449 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.449 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.449 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.449 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.450 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.450 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.450 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.450 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.450 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.450 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.450 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.450 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.451 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.451 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.451 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.451 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.451 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.451 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.451 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.451 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.452 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.452 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.452 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.452 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.452 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.452 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.452 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.452 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.453 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.453 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.453 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.453 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.453 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.453 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-06-13T11:34:42.453 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-06-13T11:34:42.453 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.454 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.454 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.454 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.454 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.454 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.454 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.454 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-06-13T11:34:42.454 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.454 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.455 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.455 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.455 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-06-13T11:34:42.455 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-06-13T11:34:42.455 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.455 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.455 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.455 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-06-13T11:34:42.456 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.456 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.456 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.456 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-06-13T11:34:42.456 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.456 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.456 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.456 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.457 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-06-13T11:34:42.457 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-06-13T11:34:42.457 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.457 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.457 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.457 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-06-13T11:34:42.457 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.457 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.457 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.458 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-13T11:34:42.458 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.458 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.458 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.458 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.458 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-06-13T11:34:42.458 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-06-13T11:34:42.458 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.459 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.459 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.459 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T11:34:42.459 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T11:34:42.459 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-06-13T11:34:42.459 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.459 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-13T11:34:42.459 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.459 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.460 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.460 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.460 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-06-13T11:34:42.460 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-06-13T11:34:42.460 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.460 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.460 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.460 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.461 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.461 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.461 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.461 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-06-13T11:34:42.461 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.461 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.461 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.461 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.461 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-06-13T11:34:42.462 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-06-13T11:34:42.462 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.462 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.462 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.462 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-06-13T11:34:42.462 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.462 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.462 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.463 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-13T11:34:42.463 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.463 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.463 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.463 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.463 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.463 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.463 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.464 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-06-13T11:34:42.464 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.464 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.464 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.464 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.464 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.464 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.464 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.465 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.465 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.465 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.465 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.465 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.465 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.465 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.465 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.465 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.466 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.466 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.466 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.466 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.466 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.466 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.466 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.466 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.467 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.467 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.467 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.467 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.467 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.467 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.467 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.467 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.468 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.468 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.468 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.468 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.468 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.468 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.468 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.468 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.469 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.469 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.469 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.469 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.469 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.469 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.469 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.469 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.470 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.470 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.470 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.470 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.470 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.470 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.470 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.470 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.471 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.471 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.471 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.471 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.471 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.471 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.471 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.471 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.472 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.472 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.472 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.472 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.472 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.472 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.472 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.472 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.472 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.473 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.473 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.473 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.473 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-06-13T11:34:42.473 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.473 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.473 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.473 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.474 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.474 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.474 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.474 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.474 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.474 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.474 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.475 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.475 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.475 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.475 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.475 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.475 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.475 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.476 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.476 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.476 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.476 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.476 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.476 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.476 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.476 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.477 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.477 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.477 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.477 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.477 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.477 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.477 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.477 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.477 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.478 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.478 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.478 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.478 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.478 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.478 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.478 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.478 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.479 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.479 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.479 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.479 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.479 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.479 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.479 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.479 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.480 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.480 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.480 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.480 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.480 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.480 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.480 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.480 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.480 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.481 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.481 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.481 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.481 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.481 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.481 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.481 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.481 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.481 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.482 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.482 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.482 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.482 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.482 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.482 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.482 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-06-13T11:34:42.482 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.483 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.483 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.483 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-06-13T11:34:42.483 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-06-13T11:34:42.483 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.483 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.483 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.483 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-06-13T11:34:42.483 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.484 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.484 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.484 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-13T11:34:42.484 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.484 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.484 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.484 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.484 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-06-13T11:34:42.484 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-06-13T11:34:42.485 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.485 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.485 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.485 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:42.485 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-06-13T11:34:42.485 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.485 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.486 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-13T11:34:42.486 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.486 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.486 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.486 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.486 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.486 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.487 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.487 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.487 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.487 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.487 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.487 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.487 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.487 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.487 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.488 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.488 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.488 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.488 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.488 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.488 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.488 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.488 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.489 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.489 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.489 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.489 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.489 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.489 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.489 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.489 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.490 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.490 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.490 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.490 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.490 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.490 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.490 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.490 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.491 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.491 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.491 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.491 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.491 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.491 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.491 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.491 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.491 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.492 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.492 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.492 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.492 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.492 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.492 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.492 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.492 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.492 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.493 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.493 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.493 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.493 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.493 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.493 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.493 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.493 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.493 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.494 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.494 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.494 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.494 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.494 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.494 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.494 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.494 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.494 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.495 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.495 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-06-13T11:34:42.495 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.495 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.495 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.495 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-06-13T11:34:42.495 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-06-13T11:34:42.495 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.496 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.496 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.496 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-06-13T11:34:42.496 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.496 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.496 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.496 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-06-13T11:34:42.496 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-13T11:34:42.497 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.497 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.497 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.497 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.497 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.497 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.497 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.497 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.497 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.498 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.498 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.498 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.498 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.498 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.498 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.498 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.498 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.499 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.499 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.499 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.499 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.499 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.499 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.499 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.500 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.500 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.500 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.500 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.500 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.500 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.500 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.500 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.500 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.501 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.501 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.501 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.501 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.501 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.501 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.501 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.501 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.502 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.502 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.502 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.502 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.502 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.502 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.502 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.503 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.503 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.503 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.503 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.503 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.503 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.503 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.503 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.503 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.504 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.504 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.504 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.504 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.504 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.504 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.504 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.505 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.505 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.505 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.505 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.505 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.505 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.505 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.505 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.506 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-06-13T11:34:42.506 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-06-13T11:34:42.506 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.506 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.506 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.506 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.506 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.506 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.507 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.507 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-06-13T11:34:42.507 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-13T11:34:42.507 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.507 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.507 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.507 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-06-13T11:34:42.508 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-06-13T11:34:42.508 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.508 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.508 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.508 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-06-13T11:34:42.508 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.508 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.508 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.509 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-06-13T11:34:42.509 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.509 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.509 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.509 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.509 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-06-13T11:34:42.509 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-06-13T11:34:42.509 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.510 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.510 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.510 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-06-13T11:34:42.510 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.510 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.510 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.510 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-06-13T11:34:42.510 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.510 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.511 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.511 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.511 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-06-13T11:34:42.511 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-06-13T11:34:42.511 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.511 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.511 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.511 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.512 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.512 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.512 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.512 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-06-13T11:34:42.512 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.512 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.512 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.512 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.513 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-06-13T11:34:42.513 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-06-13T11:34:42.513 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.513 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.513 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.513 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-06-13T11:34:42.513 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.513 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.514 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.514 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-13T11:34:42.514 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-13T11:34:42.514 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.514 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.514 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.514 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.515 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.515 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.515 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-06-13T11:34:42.515 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.515 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.515 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.515 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.515 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.516 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.516 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.516 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.516 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.516 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.516 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.516 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.516 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.517 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.517 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.517 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.517 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.517 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.517 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.517 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.517 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.518 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.518 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.518 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.518 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.518 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.518 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.518 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.518 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.519 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.520 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.522 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.523 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-06-13T11:34:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.524 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.526 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.526 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.526 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.526 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.526 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.526 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.526 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.526 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.527 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.528 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.528 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.528 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.528 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.528 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.528 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.528 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.528 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.528 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.529 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.530 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.530 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.530 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.530 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.530 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.530 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.530 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.530 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.530 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.531 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.531 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.531 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.531 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.531 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.531 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.531 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.531 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.531 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.532 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-06-13T11:34:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.533 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.534 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.535 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.536 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.537 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.538 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.538 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.538 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.538 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.538 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.538 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.538 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.539 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.539 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.539 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.539 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.539 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.539 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.539 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.539 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.539 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.540 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.540 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.540 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.540 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.540 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.540 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.540 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.540 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.540 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.541 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.541 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.541 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.541 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.541 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.541 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.541 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.542 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.542 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.542 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.542 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.542 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.542 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.542 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-06-13T11:34:42.542 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.542 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.543 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.543 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-06-13T11:34:42.543 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-06-13T11:34:42.543 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.543 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.543 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.543 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.544 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.544 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.544 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.544 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-13T11:34:42.544 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.544 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.544 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.544 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.544 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.545 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.545 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.545 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.545 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.545 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.545 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.545 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.545 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.545 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.546 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.546 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.546 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.546 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.546 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.546 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.546 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.546 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.546 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.547 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.547 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.547 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.547 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.547 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.547 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.547 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.547 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.548 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.548 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.548 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.548 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.548 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.548 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.548 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.548 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.549 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.549 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.549 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.549 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.549 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.549 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.549 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.549 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.549 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.550 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.550 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.550 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.550 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.550 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.550 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.550 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.550 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.551 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.551 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.551 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.551 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.551 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.551 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.551 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.551 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.551 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.552 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.552 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.552 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.552 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.552 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.552 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.552 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-06-13T11:34:42.553 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-06-13T11:34:42.553 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.553 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.553 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.553 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.553 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.553 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.553 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.553 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-06-13T11:34:42.554 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-06-13T11:34:42.554 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-06-13T11:34:42.554 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.554 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-06-13T11:34:42.554 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.554 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.554 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.554 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.555 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.555 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.555 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.555 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-06-13T11:34:42.555 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.555 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.555 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.556 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.556 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.556 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.556 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.556 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.556 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.556 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.556 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.556 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.557 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.557 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.557 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.557 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.557 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.557 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.557 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.557 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.558 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.558 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.558 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.558 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.558 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.558 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.558 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.558 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.559 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.559 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.559 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.559 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.559 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.559 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.559 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.559 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.559 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.560 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.560 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.560 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.560 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.560 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.560 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.560 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.560 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.561 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.561 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.561 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.561 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.561 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.561 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.561 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.561 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.562 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.562 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.562 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.562 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.562 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.562 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.562 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.562 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.563 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.563 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.563 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.563 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.563 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.563 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.563 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.564 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.564 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.564 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.564 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.564 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.564 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.564 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.564 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.564 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-06-13T11:34:42.565 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.565 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.565 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.565 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.565 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.565 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.565 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.565 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.565 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.566 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.566 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.566 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.566 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.566 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.566 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.566 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.566 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.567 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.567 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.567 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.567 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.567 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.567 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.567 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.567 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.568 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.568 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.568 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.568 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.568 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.568 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.568 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.568 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.568 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.569 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.569 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.569 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.569 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.569 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.569 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.569 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.569 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.570 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.570 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.570 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.570 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.570 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.570 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.570 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.570 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.570 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.571 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.571 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.571 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.571 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.571 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.571 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.571 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.571 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.572 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.572 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.572 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.572 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.572 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.572 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.572 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.572 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.573 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.573 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.573 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.573 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.573 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.573 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.573 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.573 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.573 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.574 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-06-13T11:34:42.574 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.574 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.574 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.574 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.574 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.574 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.574 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.574 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.575 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.575 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.575 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.575 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.575 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.575 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.575 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.575 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.576 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.576 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.576 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.576 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.576 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.576 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.576 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.577 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.577 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.577 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.577 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.577 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.577 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.577 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.577 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.577 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.578 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.578 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.578 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.578 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.578 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.578 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.578 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.578 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.578 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.579 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.579 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.579 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.579 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.579 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.579 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.579 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.579 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.580 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.580 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.580 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.580 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.580 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.580 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.580 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.580 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.580 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.581 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.581 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.581 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.581 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.581 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.581 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.581 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.581 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.581 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.582 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.582 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.582 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.582 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.582 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.582 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.582 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T11:34:42.582 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T11:34:42.582 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.583 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.583 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.583 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T11:34:42.583 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.583 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.583 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.583 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.583 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.583 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.584 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.584 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.584 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-06-13T11:34:42.584 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-06-13T11:34:42.584 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:42.584 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.584 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.584 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-06-13T11:34:42.585 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-06-13T11:34:42.585 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.585 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.585 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-06-13T11:34:42.585 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-13T11:34:42.585 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.585 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.585 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.585 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.586 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.586 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.586 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-06-13T11:34:42.586 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.586 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.586 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.586 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-06-13T11:34:42.587 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-06-13T11:34:42.587 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.587 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.587 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.587 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.587 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.587 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.587 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.587 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-13T11:34:42.588 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.588 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.588 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.588 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.588 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-06-13T11:34:42.588 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-06-13T11:34:42.588 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.588 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.589 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.589 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.589 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.589 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.589 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.589 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.589 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.589 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.589 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.590 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.590 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.590 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.590 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.590 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.590 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.590 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.590 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.591 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.591 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.591 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.591 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.591 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.591 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.591 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.591 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.592 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.592 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.592 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.592 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.592 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.592 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.592 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.592 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.592 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.593 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.593 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.593 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.593 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.593 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.593 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.593 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.593 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.593 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.594 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.594 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.594 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.594 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.594 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.594 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.594 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.594 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.595 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.595 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.595 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.595 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.595 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.595 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.595 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.595 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.595 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.596 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.596 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.596 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.596 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.596 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.596 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.596 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.596 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.597 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.597 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.597 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.597 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.597 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.597 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.597 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.597 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.598 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.598 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.598 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.598 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-06-13T11:34:42.598 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-06-13T11:34:42.598 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.598 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.599 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.599 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-06-13T11:34:42.599 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.599 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.599 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.599 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-06-13T11:34:42.599 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.599 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.600 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.600 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.600 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T11:34:42.600 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T11:34:42.600 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.600 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.600 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.600 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T11:34:42.600 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.601 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.601 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.601 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-06-13T11:34:42.601 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.601 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.601 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.601 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.601 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.602 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.602 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.602 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-06-13T11:34:42.602 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.602 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.602 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.602 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-06-13T11:34:42.602 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-06-13T11:34:42.602 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.603 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-06-13T11:34:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-06-13T11:34:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.604 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-13T11:34:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-13T11:34:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.606 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.607 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.608 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.609 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.610 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.612 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.613 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.614 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.614 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.614 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.614 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-06-13T11:34:42.614 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-06-13T11:34:42.614 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.614 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.615 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.615 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.615 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.615 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.615 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.615 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.615 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.615 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.615 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.616 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.616 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-13T11:34:42.616 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-13T11:34:42.616 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.616 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.616 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.616 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-06-13T11:34:42.616 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.617 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.617 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.617 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.617 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.617 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.617 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.617 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.617 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-06-13T11:34:42.618 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-06-13T11:34:42.618 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:42.618 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.618 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.618 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-06-13T11:34:42.618 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.618 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.618 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.619 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.619 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.619 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.619 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.619 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.619 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T11:34:42.619 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T11:34:42.619 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.620 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.620 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.620 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-06-13T11:34:42.620 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.620 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.620 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.620 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-13T11:34:42.620 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.621 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.621 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.621 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.621 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T11:34:42.621 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T11:34:42.621 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.621 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.621 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.622 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-06-13T11:34:42.622 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.622 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.622 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.622 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-13T11:34:42.622 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.622 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.622 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.623 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-06-13T11:34:42.623 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-06-13T11:34:42.623 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.623 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.623 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.623 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-06-13T11:34:42.623 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.624 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.624 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.624 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.624 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.624 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.624 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.624 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-06-13T11:34:42.625 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-06-13T11:34:42.625 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.625 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.625 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.625 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-06-13T11:34:42.625 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.625 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.625 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.626 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-06-13T11:34:42.626 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-06-13T11:34:42.626 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.626 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.626 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.626 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.626 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.626 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.627 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-06-13T11:34:42.627 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-06-13T11:34:42.627 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.627 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.627 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.627 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-06-13T11:34:42.627 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-06-13T11:34:42.627 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-06-13T11:34:42.627 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.628 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.628 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.628 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.628 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.628 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.628 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.628 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.628 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.628 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-06-13T11:34:42.629 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.629 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.629 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.629 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.629 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.629 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.629 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.629 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.630 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.630 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.630 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.630 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.630 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.630 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.630 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.630 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.631 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.631 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.631 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.631 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.631 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.631 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.631 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.631 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.631 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.632 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.632 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.632 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.632 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.632 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.632 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.632 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.632 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.632 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.633 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.633 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.633 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.633 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.633 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.633 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.633 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.633 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.633 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.634 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.634 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.634 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.634 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.634 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.634 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.634 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.634 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.634 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.635 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.635 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.635 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.635 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.635 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.635 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.635 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.635 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.635 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.636 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.636 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.636 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.636 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.636 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.636 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.636 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.636 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.636 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.637 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.637 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.637 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.637 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-06-13T11:34:42.637 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-06-13T11:34:42.637 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.637 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.637 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.638 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:42.638 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.638 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.638 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.638 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.638 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.638 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.638 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.638 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.639 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-06-13T11:34:42.639 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-06-13T11:34:42.639 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.639 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.639 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.639 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.639 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.639 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.640 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.640 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.640 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.640 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.640 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.640 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.640 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-06-13T11:34:42.640 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-06-13T11:34:42.641 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.641 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.641 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.641 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.641 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.641 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.641 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.641 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.642 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.642 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.642 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.642 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.642 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.642 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.642 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.642 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-06-13T11:34:42.642 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.643 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.643 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.643 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-06-13T11:34:42.643 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-06-13T11:34:42.643 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.643 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.643 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.643 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.643 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.644 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.644 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.644 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.644 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.644 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.644 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.644 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.644 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-06-13T11:34:42.645 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-06-13T11:34:42.645 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.645 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.645 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.645 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.645 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.645 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.645 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.645 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.646 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.646 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.646 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.646 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.646 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.646 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.647 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.647 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.647 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.647 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.647 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.647 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.647 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.647 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.648 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.648 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.648 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.648 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.648 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.648 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.648 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.648 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.649 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.649 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.649 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.649 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.649 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.649 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.649 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.649 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.650 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.650 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.650 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.650 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.650 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.650 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.650 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.650 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.651 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.651 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.651 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.651 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.651 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.651 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.651 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.651 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.652 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.652 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.652 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.652 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.652 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.652 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.652 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.652 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.652 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.653 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.653 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.653 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.653 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.653 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.653 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.653 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.653 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.654 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.654 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.654 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.654 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.654 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.654 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.654 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.654 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.655 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.655 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.655 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.655 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T11:34:42.655 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T11:34:42.655 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.655 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.655 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.656 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.656 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.656 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.656 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.656 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.656 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.656 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.656 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.657 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.657 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T11:34:42.657 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T11:34:42.657 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.657 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.657 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.657 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.657 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.658 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.658 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.658 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.658 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.658 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.658 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.658 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.658 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.659 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.659 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.659 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-06-13T11:34:42.659 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.659 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.659 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.659 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.659 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.659 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.660 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.660 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.660 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.660 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.660 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.660 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.660 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.661 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.661 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.661 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.661 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.661 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.661 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.661 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.661 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.661 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.662 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.662 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.662 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.662 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.662 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.662 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.662 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.662 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.663 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.663 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.663 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.663 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.663 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.663 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.663 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.663 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.663 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.664 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.664 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.664 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.664 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.664 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.664 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.664 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.664 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.665 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.665 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.665 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.665 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.665 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.665 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.665 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.665 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.665 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.666 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.666 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.666 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.666 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.666 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.666 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.666 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.667 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.667 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.667 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.667 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.667 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.667 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.667 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.667 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.667 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.668 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.668 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.668 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.668 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.668 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-06-13T11:34:42.668 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.668 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.668 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.669 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.669 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.669 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.669 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.669 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.669 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.669 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.669 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.670 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.670 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.670 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.670 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.670 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.670 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.670 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.671 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.671 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.671 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.671 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.671 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.671 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.671 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.671 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.672 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.672 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.672 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.672 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.672 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.672 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.672 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.672 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.673 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.673 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.673 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.673 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.673 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.673 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.673 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.673 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.674 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.674 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.674 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.674 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.674 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.674 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.674 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.674 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.675 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.675 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.675 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.675 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.675 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.675 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.675 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.675 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.676 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.676 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.676 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.676 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.676 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.676 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.676 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.676 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.676 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.676 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.677 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.677 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.677 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.677 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.677 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-06-13T11:34:42.677 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-06-13T11:34:42.677 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.677 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.678 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.678 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-06-13T11:34:42.678 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.678 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.678 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.678 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-13T11:34:42.678 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.678 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.679 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.679 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.679 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.679 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.679 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.679 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-06-13T11:34:42.679 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.679 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.679 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.680 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.680 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.680 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.680 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.680 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.680 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.680 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.680 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.680 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.681 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.681 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.681 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.681 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.681 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.681 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.681 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.681 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.681 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.682 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.682 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.682 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.682 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.682 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.682 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.682 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.682 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.682 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.683 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.683 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.683 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.683 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.683 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.683 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.683 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.683 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.683 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.684 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.684 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.684 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.684 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.684 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.684 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.684 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.684 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.684 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.685 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.685 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.685 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.685 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.685 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.685 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.685 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.685 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.685 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.686 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.686 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.686 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.686 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.686 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.686 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.686 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.686 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.687 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.687 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.687 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.687 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.687 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.687 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.687 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.687 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.688 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-06-13T11:34:42.688 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-06-13T11:34:42.688 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.688 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.688 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.688 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.688 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.688 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.688 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.689 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.689 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.689 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.689 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.689 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.689 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-06-13T11:34:42.689 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-06-13T11:34:42.689 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.689 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.690 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.690 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-06-13T11:34:42.690 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.690 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.690 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.690 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.690 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.690 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.691 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.691 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.691 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-06-13T11:34:42.691 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-06-13T11:34:42.691 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.691 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.691 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.691 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.691 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.692 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.692 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.692 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.692 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.692 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.692 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.692 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.692 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-06-13T11:34:42.693 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-06-13T11:34:42.693 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.693 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.693 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.693 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.693 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.693 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.693 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.693 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.694 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.694 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.694 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.694 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.694 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-06-13T11:34:42.694 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-06-13T11:34:42.694 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:42.695 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.695 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.695 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.695 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.695 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.695 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.695 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.695 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.695 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-06-13T11:34:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-06-13T11:34:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-06-13T11:34:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-06-13T11:34:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.699 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.699 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.699 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.699 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.699 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.699 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-06-13T11:34:42.699 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-06-13T11:34:42.699 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.699 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.700 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.700 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.700 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.700 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.700 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.700 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.700 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.700 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.701 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.701 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.701 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-06-13T11:34:42.701 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-06-13T11:34:42.701 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.701 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.701 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.701 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.702 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T11:34:42.702 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-06-13T11:34:42.702 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.702 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.702 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.702 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.702 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.702 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.703 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-06-13T11:34:42.703 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-06-13T11:34:42.703 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.703 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.703 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.703 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.703 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.703 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.703 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.704 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.704 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.704 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.704 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.704 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-06-13T11:34:42.704 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-06-13T11:34:42.704 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.704 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.705 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.705 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.705 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.705 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.705 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.705 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.705 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.705 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.706 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.706 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.706 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-06-13T11:34:42.706 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-06-13T11:34:42.706 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.706 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.706 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.706 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.707 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.707 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.707 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.707 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.707 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.707 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.707 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.707 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.707 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.708 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.708 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.708 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-06-13T11:34:42.708 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.708 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.708 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.708 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-06-13T11:34:42.708 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-06-13T11:34:42.709 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.709 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.709 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.709 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.709 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.709 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.709 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.709 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-06-13T11:34:42.709 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.710 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.710 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.710 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.710 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-06-13T11:34:42.710 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-06-13T11:34:42.710 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.710 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.710 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.711 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.711 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.711 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.711 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.711 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-06-13T11:34:42.711 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.711 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.711 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.712 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.712 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.712 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.712 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.712 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.712 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.712 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.712 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.712 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.713 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.713 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.713 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.713 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.713 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.713 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.713 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.713 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.714 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.714 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.714 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.714 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.714 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.714 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.714 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.714 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.714 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.715 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.715 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.715 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.715 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.715 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.715 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.715 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.715 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.715 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.716 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.716 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.716 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.716 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.716 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.716 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.716 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.716 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.717 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.717 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.717 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.717 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.717 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.717 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.717 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.717 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.718 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.718 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.718 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.718 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.718 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.718 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.718 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.718 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.718 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.719 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.719 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.719 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.719 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.719 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.719 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.719 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.719 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.720 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.720 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.720 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.720 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.720 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.720 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.720 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-06-13T11:34:42.720 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.720 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.721 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.721 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.721 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.721 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.721 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.721 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.721 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.721 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.722 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.722 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.722 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.722 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.722 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.722 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.722 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.722 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.723 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.723 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.723 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.723 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.723 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.723 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.723 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.723 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.723 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.724 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.724 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.724 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.724 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.724 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.724 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.724 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.724 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.725 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.725 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.725 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.725 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.725 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.725 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.725 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.725 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.726 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.726 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.726 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.726 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.726 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.726 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.726 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.726 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.727 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.727 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.727 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.727 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.727 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.727 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.727 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.727 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.727 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.728 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.728 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.728 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.728 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.728 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.728 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.728 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.728 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.729 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.729 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.729 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.729 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.729 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.729 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.729 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.729 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.729 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-06-13T11:34:42.729 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.730 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.730 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.730 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.730 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.730 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.730 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.730 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.730 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.730 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.731 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.731 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.731 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.731 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.731 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.731 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.731 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.732 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.732 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.732 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.732 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.732 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.732 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.732 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.732 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.732 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.733 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.733 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.733 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.733 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.733 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.733 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.733 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.733 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.733 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.734 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.734 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.734 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.734 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.734 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.734 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.734 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.734 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.734 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.735 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.735 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.735 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.735 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.735 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.735 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.735 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.735 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.735 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.736 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.736 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.736 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.736 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.736 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.736 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.736 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.736 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.736 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.737 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.737 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.737 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.737 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.737 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.737 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.737 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.737 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.738 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.738 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.738 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.738 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.738 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.738 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-06-13T11:34:42.738 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.738 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.739 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.739 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-06-13T11:34:42.739 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-06-13T11:34:42.739 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.739 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.739 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.739 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-13T11:34:42.739 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.740 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.740 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.740 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.740 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.740 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.740 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.740 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.740 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T11:34:42.741 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T11:34:42.741 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.741 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.741 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.741 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-06-13T11:34:42.741 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.741 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.741 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.742 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.742 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.742 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.742 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.742 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.742 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.742 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.742 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.743 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.743 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.743 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.743 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.743 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.743 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.743 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.743 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.743 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.744 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.744 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.744 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.744 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.744 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.744 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.744 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.744 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.744 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.745 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.745 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.745 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.745 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.745 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.745 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.745 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.745 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.746 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.746 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.746 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.746 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.746 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.746 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.746 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.746 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.747 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.747 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.747 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.747 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.747 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.747 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.747 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.747 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.747 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.748 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.748 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.748 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.748 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.748 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.748 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.748 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.748 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.748 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.749 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.749 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.749 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.749 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.749 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.749 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.749 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.749 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.749 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.749 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.750 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.750 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.750 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.750 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.750 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.750 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.750 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.751 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.751 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-06-13T11:34:42.751 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.751 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.751 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.751 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-06-13T11:34:42.751 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-06-13T11:34:42.751 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.752 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.752 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.752 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.752 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.752 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.752 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.752 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-13T11:34:42.752 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.752 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.753 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.753 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.753 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-06-13T11:34:42.753 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-06-13T11:34:42.753 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.753 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.753 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.753 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.753 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.754 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.754 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.754 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-13T11:34:42.754 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.754 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.754 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.754 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.754 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-06-13T11:34:42.755 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-06-13T11:34:42.755 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.755 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.755 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.755 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.755 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.755 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.755 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.755 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-13T11:34:42.756 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.756 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.756 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.756 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.756 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-06-13T11:34:42.756 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-06-13T11:34:42.756 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.756 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.757 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.757 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.757 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.757 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.757 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.757 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-13T11:34:42.757 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.757 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.758 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.758 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.758 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-06-13T11:34:42.758 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-06-13T11:34:42.758 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.758 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.758 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.758 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.759 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.759 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.759 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.759 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-13T11:34:42.759 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.759 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.759 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.759 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.759 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-06-13T11:34:42.760 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-06-13T11:34:42.760 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.760 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.760 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.760 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.760 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.760 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.760 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.761 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.761 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.761 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.761 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.761 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.761 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-06-13T11:34:42.761 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-06-13T11:34:42.761 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.762 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.762 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.762 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.762 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.762 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.762 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.763 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.763 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.763 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.763 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.763 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-06-13T11:34:42.763 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-06-13T11:34:42.763 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.763 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.764 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.764 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-13T11:34:42.764 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.764 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.764 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.764 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.764 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.764 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.765 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.765 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.765 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-06-13T11:34:42.765 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-06-13T11:34:42.765 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.765 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.765 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.765 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.766 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.766 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.766 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.766 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.766 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.766 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.766 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.766 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.767 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T11:34:42.767 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T11:34:42.767 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.767 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.767 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.767 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-06-13T11:34:42.767 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-06-13T11:34:42.767 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.768 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.768 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.768 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.768 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.768 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.768 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.768 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-06-13T11:34:42.768 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-06-13T11:34:42.768 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.769 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.769 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.769 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-06-13T11:34:42.769 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.769 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.769 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.769 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.769 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.769 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.770 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.770 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.770 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-06-13T11:34:42.770 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-06-13T11:34:42.770 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.770 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.770 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.770 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.771 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.771 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.771 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.771 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.771 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.771 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.771 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.771 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.771 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-06-13T11:34:42.772 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-06-13T11:34:42.772 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.772 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.772 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.772 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.772 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.772 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.772 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.773 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.773 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.773 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.773 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.773 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.773 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.773 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.773 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.773 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.774 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.774 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.774 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.774 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.774 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.774 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.774 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.774 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.774 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.775 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.775 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.775 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.775 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.775 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.775 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.775 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.775 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.775 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.776 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.776 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.776 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.776 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.776 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.776 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.776 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.776 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.777 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.777 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.777 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.777 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.777 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.777 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.777 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.777 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.777 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.778 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.778 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.778 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.778 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.778 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.778 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.778 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.778 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.779 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.779 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.779 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.779 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.779 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.779 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.779 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.779 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.780 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.780 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.780 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.780 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.780 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.780 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.780 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.780 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.780 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.781 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.781 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.781 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.781 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.781 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.781 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.781 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-06-13T11:34:42.781 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-06-13T11:34:42.781 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.782 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.782 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.782 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.782 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.782 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.782 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.782 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.782 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.783 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.783 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.783 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.783 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-06-13T11:34:42.783 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-06-13T11:34:42.783 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.783 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.783 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.783 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.784 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.784 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.784 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.784 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.784 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.784 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.784 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.784 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.784 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-06-13T11:34:42.785 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-06-13T11:34:42.785 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.785 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.785 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.785 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-13T11:34:42.785 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.785 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.785 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.786 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.786 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.786 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.786 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.786 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.786 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.786 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.786 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.787 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-06-13T11:34:42.787 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.787 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.787 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.787 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.787 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.787 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.787 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.787 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.788 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.788 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.788 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.788 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.788 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.788 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.788 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.788 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.788 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.789 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.789 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.789 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.789 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.789 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.789 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.789 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.789 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.790 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.790 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.790 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.790 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.790 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.790 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.790 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.790 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.790 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.791 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.791 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.791 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.791 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.791 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.791 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.791 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.791 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.792 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.792 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.792 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.792 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.792 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.792 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.792 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.792 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.793 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.793 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.793 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.793 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.793 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.793 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.793 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.793 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.794 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.794 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.794 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.794 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.794 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.794 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.794 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.794 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.795 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.795 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.795 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.795 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.795 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.795 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.795 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.795 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.795 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.796 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.796 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-06-13T11:34:42.796 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.796 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.796 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.796 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.796 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.796 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.797 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.797 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.797 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.797 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.797 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.797 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.797 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.797 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.798 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.798 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.798 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.798 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.798 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.798 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.798 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.798 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.799 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.799 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.799 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.799 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.799 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.799 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.799 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.799 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.800 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.800 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.800 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.800 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.800 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.800 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.800 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.800 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.800 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.801 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.801 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.801 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.801 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.801 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.801 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.801 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.801 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.802 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.802 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.802 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.802 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.802 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.802 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.802 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.802 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.803 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.803 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.803 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.803 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.803 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.803 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.803 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.803 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.804 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.804 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.804 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.804 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.804 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.804 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.804 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.804 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.805 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-06-13T11:34:42.805 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-06-13T11:34:42.805 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.805 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.805 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.805 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-06-13T11:34:42.805 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.806 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.806 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.806 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-13T11:34:42.806 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.806 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.806 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.806 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.806 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-06-13T11:34:42.807 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-06-13T11:34:42.807 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.807 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.807 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.807 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.807 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.807 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.807 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.807 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-06-13T11:34:42.808 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.808 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.808 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.808 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.808 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-06-13T11:34:42.808 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-06-13T11:34:42.808 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.809 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.809 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.809 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T11:34:42.809 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.809 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.809 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.809 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-13T11:34:42.809 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.809 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.810 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.810 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.810 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-06-13T11:34:42.810 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-06-13T11:34:42.810 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.810 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.810 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.811 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.811 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.811 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.811 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.811 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-13T11:34:42.811 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.811 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.811 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.811 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.812 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.812 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.812 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.812 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-06-13T11:34:42.812 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.812 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.812 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.812 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-06-13T11:34:42.813 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-06-13T11:34:42.813 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T11:34:42.813 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.813 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.813 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-06-13T11:34:42.813 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.813 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.813 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.814 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.814 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.814 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.814 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.814 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.814 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-06-13T11:34:42.814 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-06-13T11:34:42.814 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.815 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.815 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.815 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.815 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.815 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.815 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.815 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.815 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.816 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.816 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.816 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.816 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T11:34:42.816 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T11:34:42.816 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.816 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.816 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.817 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T11:34:42.817 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.817 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.817 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.817 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.817 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.817 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.817 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.818 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.818 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.818 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.818 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.818 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.818 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.818 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.818 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.819 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.819 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.819 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.819 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.819 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.819 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.819 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.819 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.820 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.820 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.820 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.820 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.820 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.820 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.820 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.820 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.821 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.821 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.821 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.821 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.821 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.821 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.821 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.821 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.822 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.822 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.822 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.822 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.822 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.822 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.822 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.822 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.822 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.823 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.823 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.823 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.823 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.823 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.823 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.823 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.823 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.824 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.824 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.824 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.824 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.824 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.824 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.824 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.824 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.825 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.825 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.825 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.825 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.825 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.825 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.825 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.825 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.826 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.826 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.826 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.826 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.826 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.826 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-06-13T11:34:42.826 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-06-13T11:34:42.826 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.827 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.827 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.827 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.827 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.827 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.827 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.827 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.827 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.827 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.828 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.828 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-06-13T11:34:42.828 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-06-13T11:34:42.828 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.828 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.828 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.828 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-06-13T11:34:42.828 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.829 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.829 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.829 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.829 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.829 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.829 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.829 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.829 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-06-13T11:34:42.829 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-06-13T11:34:42.830 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.830 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.830 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.830 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-13T11:34:42.830 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.830 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.830 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.830 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.831 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.831 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.831 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.831 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.831 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.831 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.831 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T11:34:42.831 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.831 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.832 INFO:teuthology.orchestra.run.smithi002.stdout: "gid": 25147, 2024-06-13T11:34:42.832 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "z", 2024-06-13T11:34:42.832 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_features": 4540701547738038271, 2024-06-13T11:34:42.832 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-06-13T11:34:42.832 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.832 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-06-13T11:34:42.832 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.832 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.832 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.833 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T11:34:42.833 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T11:34:42.833 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.833 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.833 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.833 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T11:34:42.833 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.833 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.834 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.834 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-06-13T11:34:42.834 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.834 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.834 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.834 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.834 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.834 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.835 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.835 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.835 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.835 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.835 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.835 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.835 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.835 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.835 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.836 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.836 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.836 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.836 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.836 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.836 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.836 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.836 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.836 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.837 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.837 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.837 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.837 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.837 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.837 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.837 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.837 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.838 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.838 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.838 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.838 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.838 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.838 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.838 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.838 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.838 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.839 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.839 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.839 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.839 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.839 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.839 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.839 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.839 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.839 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.840 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.840 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.840 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.840 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.840 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.840 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.840 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.840 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.840 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.841 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.841 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.841 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.841 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.841 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.841 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.841 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.841 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.841 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.842 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.842 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.842 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.842 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.842 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.842 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-06-13T11:34:42.842 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-06-13T11:34:42.842 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.843 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.843 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.843 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.843 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.843 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.843 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.843 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-06-13T11:34:42.843 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.844 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.844 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.844 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.844 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-06-13T11:34:42.844 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-06-13T11:34:42.844 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.844 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.844 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.845 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-06-13T11:34:42.845 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.845 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.845 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.845 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-06-13T11:34:42.845 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.845 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.845 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.846 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-06-13T11:34:42.846 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-06-13T11:34:42.846 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.846 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.846 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.846 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.846 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.846 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.847 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.847 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-06-13T11:34:42.847 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.847 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.847 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.847 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.847 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-06-13T11:34:42.847 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-06-13T11:34:42.848 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.848 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.848 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.848 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.848 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.848 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.848 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.848 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-06-13T11:34:42.849 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.849 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.849 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.849 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.849 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-06-13T11:34:42.849 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-06-13T11:34:42.849 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.849 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.850 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.850 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-06-13T11:34:42.850 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.850 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.850 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.850 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-06-13T11:34:42.850 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.850 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.851 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.851 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.851 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-06-13T11:34:42.851 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-06-13T11:34:42.851 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.851 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.851 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.851 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.851 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.852 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.852 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.852 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-06-13T11:34:42.852 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.852 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.852 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.852 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.852 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-06-13T11:34:42.852 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-06-13T11:34:42.853 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.853 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.853 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.853 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.853 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.853 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.853 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.853 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-13T11:34:42.853 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.854 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.854 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.854 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.854 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-06-13T11:34:42.854 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-06-13T11:34:42.854 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.854 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.854 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.855 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.855 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.855 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.855 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.855 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-06-13T11:34:42.855 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.855 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.855 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.855 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.856 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.856 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.856 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-06-13T11:34:42.856 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.856 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.856 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.856 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-06-13T11:34:42.856 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-06-13T11:34:42.857 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.857 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.857 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.857 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.857 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.857 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.857 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.857 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-06-13T11:34:42.857 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.858 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.858 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.858 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.858 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-06-13T11:34:42.858 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-06-13T11:34:42.858 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.858 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.858 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.859 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-06-13T11:34:42.859 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.859 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.859 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.859 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-06-13T11:34:42.859 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-13T11:34:42.859 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.859 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.859 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.860 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-06-13T11:34:42.860 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-06-13T11:34:42.860 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T11:34:42.860 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.860 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.860 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T11:34:42.860 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-06-13T11:34:42.860 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-06-13T11:34:42.860 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.860 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-13T11:34:42.861 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-13T11:34:42.861 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.861 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.861 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.861 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-06-13T11:34:42.861 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-06-13T11:34:42.861 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T11:34:42.861 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.861 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.862 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-06-13T11:34:42.862 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T11:34:42.862 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-06-13T11:34:42.862 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.862 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-13T11:34:42.862 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.862 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.862 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.863 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.863 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-06-13T11:34:42.863 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-06-13T11:34:42.863 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.863 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.863 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.863 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-06-13T11:34:42.863 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.864 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.864 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.864 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-13T11:34:42.864 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-13T11:34:42.864 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.864 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.864 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.864 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-06-13T11:34:42.865 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-06-13T11:34:42.865 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:42.865 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.865 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.865 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-06-13T11:34:42.865 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-06-13T11:34:42.865 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-06-13T11:34:42.865 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.865 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-06-13T11:34:42.866 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-13T11:34:42.866 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.866 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.866 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-06-13T11:34:42.866 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-06-13T11:34:42.866 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.866 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.866 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.867 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-06-13T11:34:42.867 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.867 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.867 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.867 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-06-13T11:34:42.867 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-13T11:34:42.867 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.867 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.867 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.868 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-06-13T11:34:42.868 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-06-13T11:34:42.868 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T11:34:42.868 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.868 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.868 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T11:34:42.868 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-06-13T11:34:42.868 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-06-13T11:34:42.869 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.869 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-13T11:34:42.869 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-13T11:34:42.869 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.869 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.869 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.869 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.869 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.869 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.870 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.870 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.870 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.870 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.870 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.870 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.870 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.870 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.871 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.871 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.871 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.871 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.871 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.871 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.871 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.871 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.871 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.872 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.872 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.872 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.872 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.872 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.872 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.872 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.872 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.873 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.874 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.874 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.874 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.874 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.874 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.874 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.874 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.874 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.875 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.875 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.875 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.875 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.875 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.875 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.875 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.875 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.876 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.876 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.876 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.876 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.876 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.876 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.876 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.876 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.876 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.877 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.877 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.877 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.877 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.877 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.877 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.877 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.877 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.877 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-06-13T11:34:42.878 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-06-13T11:34:42.878 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:42.878 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.878 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.878 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T11:34:42.878 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.878 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.878 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.879 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-13T11:34:42.879 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.879 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.879 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.879 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.879 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-06-13T11:34:42.879 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-06-13T11:34:42.881 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.881 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.881 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.882 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-06-13T11:34:42.882 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.882 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.882 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.882 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-06-13T11:34:42.882 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-06-13T11:34:42.882 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-06-13T11:34:42.882 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-06-13T11:34:42.882 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-06-13T11:34:42.883 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.883 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-06-13T11:34:42.883 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.883 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.883 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.883 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.883 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-06-13T11:34:42.883 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-06-13T11:34:42.884 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.884 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.884 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.884 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.884 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.884 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.884 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.884 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-13T11:34:42.884 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.884 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.885 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.885 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.885 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T11:34:42.885 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T11:34:42.885 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.885 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.885 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.885 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T11:34:42.885 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.886 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.886 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.886 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-13T11:34:42.886 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.886 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.886 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.886 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.886 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-06-13T11:34:42.886 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-06-13T11:34:42.887 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.887 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.887 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.887 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T11:34:42.887 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T11:34:42.887 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.887 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.887 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-13T11:34:42.887 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-13T11:34:42.888 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.888 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.888 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.888 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-06-13T11:34:42.888 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-06-13T11:34:42.888 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T11:34:42.888 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.888 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.889 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:42.889 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.889 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.889 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.889 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-13T11:34:42.889 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.889 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.889 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.889 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.890 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.890 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.890 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.890 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-06-13T11:34:42.890 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.890 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.890 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.890 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-06-13T11:34:42.890 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-06-13T11:34:42.891 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:42.891 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.891 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.891 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-06-13T11:34:42.891 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.891 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.891 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.891 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-13T11:34:42.891 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.892 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.892 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.892 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.892 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-06-13T11:34:42.892 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-06-13T11:34:42.892 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.892 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.892 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.893 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.894 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-06-13T11:34:42.895 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-13T11:34:42.896 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.897 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.898 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.899 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-06-13T11:34:42.900 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-06-13T11:34:42.901 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.902 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.903 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.904 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.905 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.906 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.906 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.906 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-06-13T11:34:42.906 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-06-13T11:34:42.906 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.906 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.906 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.906 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.907 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.907 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.907 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.907 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-13T11:34:42.907 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.907 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.907 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.907 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.907 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-06-13T11:34:42.907 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-06-13T11:34:42.908 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.908 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.908 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.908 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-13T11:34:42.908 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.908 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.908 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.908 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T11:34:42.909 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.909 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.909 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.909 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.909 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-06-13T11:34:42.909 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-06-13T11:34:42.909 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.909 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.909 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.910 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-13T11:34:42.910 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.910 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.910 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.910 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-06-13T11:34:42.910 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.910 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.911 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.911 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.911 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-06-13T11:34:42.911 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-06-13T11:34:42.911 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.911 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.911 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.911 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-13T11:34:42.911 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.912 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.912 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.912 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-06-13T11:34:42.912 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.912 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.912 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.912 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.912 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-06-13T11:34:42.913 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-06-13T11:34:42.913 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.913 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.913 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.913 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-13T11:34:42.913 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.913 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.913 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.914 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T11:34:42.914 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.914 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.914 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.914 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.914 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-06-13T11:34:42.914 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-06-13T11:34:42.914 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.915 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.915 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.915 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-13T11:34:42.915 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.915 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.915 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.915 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-06-13T11:34:42.915 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.916 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.916 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.916 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.916 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-06-13T11:34:42.916 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-06-13T11:34:42.916 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.916 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.916 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.917 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-13T11:34:42.917 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.917 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.917 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.917 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-06-13T11:34:42.917 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.917 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.917 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.917 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-06-13T11:34:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-06-13T11:34:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-13T11:34:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.918 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.919 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.919 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-06-13T11:34:42.919 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.919 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.919 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.919 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.919 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-06-13T11:34:42.919 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-06-13T11:34:42.920 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.920 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.920 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.920 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-13T11:34:42.920 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.920 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.920 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.920 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-06-13T11:34:42.920 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.921 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.921 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.921 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.921 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-06-13T11:34:42.921 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-06-13T11:34:42.921 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.921 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.921 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.921 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-13T11:34:42.922 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.922 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.922 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.922 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-06-13T11:34:42.922 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.922 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.922 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.922 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.923 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-06-13T11:34:42.923 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-06-13T11:34:42.923 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.923 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.923 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.923 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-13T11:34:42.923 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.923 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.924 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.924 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-06-13T11:34:42.924 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.924 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.924 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.924 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.924 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-06-13T11:34:42.924 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-06-13T11:34:42.924 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.925 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.925 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.925 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-13T11:34:42.925 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.925 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.925 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.925 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T11:34:42.925 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.926 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.926 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.926 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.926 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-06-13T11:34:42.926 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-06-13T11:34:42.926 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.926 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.926 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.927 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-13T11:34:42.927 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.927 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.927 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.927 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-06-13T11:34:42.927 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.927 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.927 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.928 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.928 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-06-13T11:34:42.928 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-06-13T11:34:42.928 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.928 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.928 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.928 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-13T11:34:42.928 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.928 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.929 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.929 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T11:34:42.929 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.929 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.929 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.929 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.929 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-06-13T11:34:42.929 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-06-13T11:34:42.929 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.930 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.930 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.930 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-13T11:34:42.930 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.930 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.930 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.930 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-06-13T11:34:42.930 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.930 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.931 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.931 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.931 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-06-13T11:34:42.931 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-06-13T11:34:42.931 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.931 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.931 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.931 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-13T11:34:42.931 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.932 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.932 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.932 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-06-13T11:34:42.932 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.932 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.932 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.932 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.932 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-06-13T11:34:42.932 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-06-13T11:34:42.933 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.933 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.933 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.933 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-13T11:34:42.933 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.933 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.933 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.933 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-06-13T11:34:42.934 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.934 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.934 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.934 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.934 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-06-13T11:34:42.934 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-06-13T11:34:42.934 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.934 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.934 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.935 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.935 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.935 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.935 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.935 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-06-13T11:34:42.935 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.935 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.935 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.936 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.936 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-06-13T11:34:42.936 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-06-13T11:34:42.936 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.936 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.936 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.936 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T11:34:42.936 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.937 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.937 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.937 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-13T11:34:42.937 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.937 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.937 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.937 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.937 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-06-13T11:34:42.937 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-06-13T11:34:42.938 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.938 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.938 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.938 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-06-13T11:34:42.938 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.938 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.938 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.938 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-13T11:34:42.938 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.939 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.939 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.939 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-06-13T11:34:42.939 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-06-13T11:34:42.939 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.939 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.939 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.940 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-06-13T11:34:42.940 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.940 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.940 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.940 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-13T11:34:42.940 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.940 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.940 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.940 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.941 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-06-13T11:34:42.941 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-06-13T11:34:42.941 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.941 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.941 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.941 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-06-13T11:34:42.941 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.941 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.941 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.942 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-06-13T11:34:42.942 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.942 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.942 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.942 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.942 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-06-13T11:34:42.942 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-06-13T11:34:42.942 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.943 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.943 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.943 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.943 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.943 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.943 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.943 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-13T11:34:42.943 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.943 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.944 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.944 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.944 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-06-13T11:34:42.944 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-06-13T11:34:42.944 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.944 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.944 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.944 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T11:34:42.945 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.945 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.945 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.945 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-06-13T11:34:42.945 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.945 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.945 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.945 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.946 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-06-13T11:34:42.946 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-06-13T11:34:42.946 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.946 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.946 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.946 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-13T11:34:42.946 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.946 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.946 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.947 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-13T11:34:42.947 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.947 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.947 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.947 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.947 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-06-13T11:34:42.947 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-06-13T11:34:42.947 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:42.948 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.948 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.948 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T11:34:42.948 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.948 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.948 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.948 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-06-13T11:34:42.948 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.949 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.949 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.949 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.949 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-06-13T11:34:42.949 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-06-13T11:34:42.949 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.949 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.949 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.949 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.950 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.950 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.950 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.950 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-13T11:34:42.950 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.950 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.950 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.950 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.951 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-06-13T11:34:42.951 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-06-13T11:34:42.951 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.951 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.951 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.951 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.951 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.951 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.952 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.952 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-13T11:34:42.952 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.952 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.952 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.952 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.952 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.952 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.952 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.953 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.953 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.953 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.953 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.953 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.953 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.953 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.953 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.954 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.954 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.954 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.954 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.954 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.954 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.954 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.954 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.955 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.955 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.955 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-06-13T11:34:42.955 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-06-13T11:34:42.955 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.955 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.955 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.956 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.956 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.956 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.956 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.956 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-13T11:34:42.956 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.956 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.956 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.956 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.957 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:42.957 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:42.957 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.957 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.957 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.957 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.957 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.957 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.957 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.958 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-13T11:34:42.958 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.958 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.958 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.958 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.958 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:42.958 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:42.958 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.959 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.959 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.959 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:42.959 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.959 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.959 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.959 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.959 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.960 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.960 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.960 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.960 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.960 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.960 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.960 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.960 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.961 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.961 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:42.961 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:42.961 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.961 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.961 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.961 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.961 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.962 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.962 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.962 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:42.962 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.962 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.962 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.962 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-13T11:34:42.963 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-13T11:34:42.963 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.963 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.963 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.963 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.963 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.963 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.963 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.963 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-13T11:34:42.964 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.964 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.964 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.964 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.964 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-13T11:34:42.964 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-13T11:34:42.964 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.964 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.965 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.965 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-06-13T11:34:42.965 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.965 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.965 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.965 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-13T11:34:42.965 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.966 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.966 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.966 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.966 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-06-13T11:34:42.966 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-06-13T11:34:42.966 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.966 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.966 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.967 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:42.967 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.967 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.967 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.967 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-06-13T11:34:42.967 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.967 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.967 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.968 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-06-13T11:34:42.968 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-06-13T11:34:42.968 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.968 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.968 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.968 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:42.968 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.968 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.969 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.969 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-13T11:34:42.969 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.969 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.969 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.969 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-06-13T11:34:42.969 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-06-13T11:34:42.970 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.970 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.970 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.970 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.970 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.970 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.970 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.970 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-06-13T11:34:42.971 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.971 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.971 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.971 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.971 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-06-13T11:34:42.971 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-06-13T11:34:42.971 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.971 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.971 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.972 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-06-13T11:34:42.972 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.972 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.972 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.972 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-06-13T11:34:42.972 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-06-13T11:34:42.972 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:42.972 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-06-13T11:34:42.973 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.973 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.973 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.973 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.973 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-06-13T11:34:42.973 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-06-13T11:34:42.973 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.973 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.973 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.974 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-06-13T11:34:42.974 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.974 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.974 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.974 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-13T11:34:42.974 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.974 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.974 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.975 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.975 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-06-13T11:34:42.975 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-06-13T11:34:42.975 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.975 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.975 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.975 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-13T11:34:42.975 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.976 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.976 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.976 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-13T11:34:42.976 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.976 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.976 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.976 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.976 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-06-13T11:34:42.976 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-06-13T11:34:42.977 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.977 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.977 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.977 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.977 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.977 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.977 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.977 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-13T11:34:42.977 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.978 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.978 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.978 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.978 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-06-13T11:34:42.978 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-06-13T11:34:42.978 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.978 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.979 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.979 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.979 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.979 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.979 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.979 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-13T11:34:42.979 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.979 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.979 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.980 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.980 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-06-13T11:34:42.980 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-06-13T11:34:42.980 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.980 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.980 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.980 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.980 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.981 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.981 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.981 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-13T11:34:42.981 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.981 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.981 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.981 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.981 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-06-13T11:34:42.982 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-06-13T11:34:42.982 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.982 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.982 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.982 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.982 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.982 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.982 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.983 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-13T11:34:42.983 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.983 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.983 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.983 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.983 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-06-13T11:34:42.983 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-06-13T11:34:42.983 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.983 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.984 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.984 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.984 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.984 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.984 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.984 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-13T11:34:42.984 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.984 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.985 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.985 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.985 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-06-13T11:34:42.985 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-06-13T11:34:42.985 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:42.985 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.985 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.985 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-06-13T11:34:42.986 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.986 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.986 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.986 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-06-13T11:34:42.986 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.986 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.986 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.986 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.987 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-06-13T11:34:42.987 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-06-13T11:34:42.987 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.987 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.987 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.987 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.987 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.987 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.988 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-13T11:34:42.988 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.988 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.988 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.988 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.988 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-06-13T11:34:42.988 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-06-13T11:34:42.988 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.989 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.989 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.989 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:42.989 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.989 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.989 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.989 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-13T11:34:42.989 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.989 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.990 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.990 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.990 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-06-13T11:34:42.990 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-06-13T11:34:42.990 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.990 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.990 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.991 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.991 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.991 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.991 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.991 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-13T11:34:42.991 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.991 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.991 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.992 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-06-13T11:34:42.992 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-06-13T11:34:42.992 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.992 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.992 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.992 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.992 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.992 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.993 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.993 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-06-13T11:34:42.993 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.993 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.993 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.993 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.993 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-06-13T11:34:42.993 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-06-13T11:34:42.994 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.994 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.994 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.994 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.994 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.994 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.994 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.994 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-13T11:34:42.995 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.995 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.995 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.995 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.995 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-06-13T11:34:42.995 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-06-13T11:34:42.995 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:42.995 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.995 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:42.996 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:42.996 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.996 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.996 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:42.996 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-13T11:34:42.996 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:42.996 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:42.996 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-06-13T11:34:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:42.998 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:42.998 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:42.998 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:42.998 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:42.998 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:42.998 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:42.998 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:42.998 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:42.999 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:42.999 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:42.999 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:42.999 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:42.999 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:42.999 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:42.999 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:42.999 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.000 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.000 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.000 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.000 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.000 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.000 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.000 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.000 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.001 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.001 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.001 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.001 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.001 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.001 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.001 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.001 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.001 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.002 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.002 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.002 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.002 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.002 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.002 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.002 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.002 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.003 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.003 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.003 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.003 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.003 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.003 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.003 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.003 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.004 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.005 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.005 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.005 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.005 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.005 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.005 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.005 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.005 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.006 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.006 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.006 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.006 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.006 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.006 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-06-13T11:34:43.006 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-06-13T11:34:43.006 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-06-13T11:34:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-13T11:34:43.007 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.008 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.008 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.008 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.008 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-06-13T11:34:43.008 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-06-13T11:34:43.008 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.008 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.008 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.008 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-06-13T11:34:43.009 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.009 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.009 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.009 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-13T11:34:43.009 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.009 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.009 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.009 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.010 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.010 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.010 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.010 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-06-13T11:34:43.010 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.010 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.010 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.010 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-13T11:34:43.011 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-13T11:34:43.011 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.011 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.011 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.011 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:43.011 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.011 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.011 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.012 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.012 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.012 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.012 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.012 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.012 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-06-13T11:34:43.012 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-13T11:34:43.012 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.013 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.013 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.013 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.013 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.013 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.013 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.013 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.013 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.013 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.014 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.014 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.014 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-13T11:34:43.014 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-13T11:34:43.014 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.014 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.014 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.015 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.015 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.015 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.015 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.015 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.015 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.015 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.015 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.016 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.016 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-06-13T11:34:43.016 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-06-13T11:34:43.016 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.016 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.016 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.016 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.016 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.017 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.017 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.017 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.017 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.017 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.017 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.017 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.017 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-13T11:34:43.018 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-13T11:34:43.018 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.018 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.018 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.018 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.018 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.018 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.018 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.019 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.019 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.019 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.019 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.019 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.019 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-06-13T11:34:43.019 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-13T11:34:43.019 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.020 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.020 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.020 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.020 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.020 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.020 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.020 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.020 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.021 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.021 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.021 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.021 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-13T11:34:43.021 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-13T11:34:43.021 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.021 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.021 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.022 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.022 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.022 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.022 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.022 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.022 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.022 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.022 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.023 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.023 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-13T11:34:43.023 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-13T11:34:43.023 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.023 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.023 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.023 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.023 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.024 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.024 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.024 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.024 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.024 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.024 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.024 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.024 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-13T11:34:43.025 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-13T11:34:43.025 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.025 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.025 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.025 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.025 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.025 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.025 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.026 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.026 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.026 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.026 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.026 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.026 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-13T11:34:43.026 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-13T11:34:43.026 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.027 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.027 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.027 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.027 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.027 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.027 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.027 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.027 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.027 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.028 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.028 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.028 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-13T11:34:43.028 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-13T11:34:43.028 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.028 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.028 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.029 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.029 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.029 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.029 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.029 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.029 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.029 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.029 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.030 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.030 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-13T11:34:43.030 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-13T11:34:43.030 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.030 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.030 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.030 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.030 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.031 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.031 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.031 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.031 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.031 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.031 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.031 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.031 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-13T11:34:43.032 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-13T11:34:43.032 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.032 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.032 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.032 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.032 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.032 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.032 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.033 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.033 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.033 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.033 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.033 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.033 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-13T11:34:43.033 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-13T11:34:43.033 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.033 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.034 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.034 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.034 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.034 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.034 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.034 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.034 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.034 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.035 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.035 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-06-13T11:34:43.035 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-13T11:34:43.035 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.035 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.035 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.035 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T11:34:43.035 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.036 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.036 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.036 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.036 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.036 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.036 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.036 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.036 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-13T11:34:43.037 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-13T11:34:43.037 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.037 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.037 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.037 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.037 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.037 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.037 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.037 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.038 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.038 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.038 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.038 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-06-13T11:34:43.038 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-06-13T11:34:43.038 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.038 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.039 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.039 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.039 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.039 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.039 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.039 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.039 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.039 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.040 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.040 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-06-13T11:34:43.040 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-13T11:34:43.040 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.040 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.040 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.040 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T11:34:43.040 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.041 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.041 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.041 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.041 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.041 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.041 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.041 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.041 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-13T11:34:43.041 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-13T11:34:43.042 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.042 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.042 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.042 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.042 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.042 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.042 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.042 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.043 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.043 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.043 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.043 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.043 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-13T11:34:43.043 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-13T11:34:43.043 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.043 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.044 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.044 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.044 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.044 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.044 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.044 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.044 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.044 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.045 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.045 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.045 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-13T11:34:43.045 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-13T11:34:43.045 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.045 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.045 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.045 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.045 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.046 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.046 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.046 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.046 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.046 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.046 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.046 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.047 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-13T11:34:43.047 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-13T11:34:43.047 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.047 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.047 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.047 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.047 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.047 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.048 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.048 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.048 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.048 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.048 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.048 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.048 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-06-13T11:34:43.048 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-13T11:34:43.048 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.049 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.049 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.049 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.049 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.049 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.049 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.049 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.049 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.050 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.050 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.050 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.050 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-13T11:34:43.050 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-13T11:34:43.050 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.050 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.050 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.050 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.051 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.051 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.051 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.051 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.051 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.051 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.051 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.051 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.052 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-13T11:34:43.052 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-13T11:34:43.052 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.052 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.052 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.052 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.052 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.052 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.053 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.053 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.053 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.053 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.053 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.053 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.053 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-13T11:34:43.053 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-13T11:34:43.054 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.054 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.054 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.054 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.054 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.054 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.054 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.054 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.055 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.055 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.055 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.055 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.055 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-13T11:34:43.055 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-13T11:34:43.055 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.055 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.055 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.056 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.056 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.056 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.056 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.056 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.056 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.056 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.056 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.057 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-13T11:34:43.057 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-13T11:34:43.057 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.057 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.057 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.057 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.057 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.057 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.058 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.058 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.058 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.058 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.058 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.058 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.058 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-13T11:34:43.058 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-13T11:34:43.059 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.059 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.059 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.059 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.059 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.059 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.059 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.059 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.060 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.060 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.060 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.060 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.060 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-13T11:34:43.060 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-13T11:34:43.060 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.061 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.061 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.061 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.061 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.061 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.061 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.061 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.061 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.061 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.061 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.062 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.062 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-13T11:34:43.062 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-13T11:34:43.062 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.062 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.062 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.062 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.062 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.063 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.063 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.063 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.063 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.063 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.063 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.063 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.063 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-06-13T11:34:43.063 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-13T11:34:43.064 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.064 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.064 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.064 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.064 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.064 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.064 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.064 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.064 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.065 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.065 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.065 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.065 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-13T11:34:43.065 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-13T11:34:43.065 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.065 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.065 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.065 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-13T11:34:43.066 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.066 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.066 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.066 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.066 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.066 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.066 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.066 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.067 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-13T11:34:43.067 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-13T11:34:43.067 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.067 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.067 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.067 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:43.067 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.067 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.068 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.068 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.068 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.068 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.068 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.068 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-13T11:34:43.068 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-13T11:34:43.068 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.069 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.069 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.069 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-06-13T11:34:43.069 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.069 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.069 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.069 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.069 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.069 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.070 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.070 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.070 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-13T11:34:43.070 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-13T11:34:43.070 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.070 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.070 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.070 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-06-13T11:34:43.071 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.071 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.071 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.071 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.071 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.071 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.071 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.071 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.071 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-06-13T11:34:43.072 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-13T11:34:43.072 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.072 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.072 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.072 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.072 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.072 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.072 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.072 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.073 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.073 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.073 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.073 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.073 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-13T11:34:43.073 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-13T11:34:43.073 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.073 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.073 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.074 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T11:34:43.074 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.074 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.074 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.074 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.074 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.074 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.074 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.075 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.075 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-06-13T11:34:43.075 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-13T11:34:43.075 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.075 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.075 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.075 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.075 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.076 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.076 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.076 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.076 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.076 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.076 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.076 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.076 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-06-13T11:34:43.076 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-13T11:34:43.077 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.077 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.077 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.077 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.077 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.077 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.077 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.077 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.078 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.078 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.078 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.078 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.078 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-13T11:34:43.078 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-13T11:34:43.078 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.078 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.079 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.079 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T11:34:43.079 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.079 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.079 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.079 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.079 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.079 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.079 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.080 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.080 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-13T11:34:43.080 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-13T11:34:43.080 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.080 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.080 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.080 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:43.080 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.080 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.081 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.081 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.081 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.081 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.081 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.081 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.081 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-13T11:34:43.081 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-13T11:34:43.081 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.081 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.082 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.082 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T11:34:43.082 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.082 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.082 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.082 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.082 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.082 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.083 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.083 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.083 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-06-13T11:34:43.083 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-06-13T11:34:43.083 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.083 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.083 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.083 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.084 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.084 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.084 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.084 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.084 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.084 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.084 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.084 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.084 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-06-13T11:34:43.085 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-06-13T11:34:43.085 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.085 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.085 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.085 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.085 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.085 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.085 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.086 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.086 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.086 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.086 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.086 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.086 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-06-13T11:34:43.086 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-06-13T11:34:43.086 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.087 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.087 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.087 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.087 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.087 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.087 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.087 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-06-13T11:34:43.087 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.088 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.088 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.088 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.088 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-06-13T11:34:43.088 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-06-13T11:34:43.088 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.088 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.088 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.089 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-06-13T11:34:43.089 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.089 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.089 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.089 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.089 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.089 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.089 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.090 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.090 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-06-13T11:34:43.090 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-06-13T11:34:43.090 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.090 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.090 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.090 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.090 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.091 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.091 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.091 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.091 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.091 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.091 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.091 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.091 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.092 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.092 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.092 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.092 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.092 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.092 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.092 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.092 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.093 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.093 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.093 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.093 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.093 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.093 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.093 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.093 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.094 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.094 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.094 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.094 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.094 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.094 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.094 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.094 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.095 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.095 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.095 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.095 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.095 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.095 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.095 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.095 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.095 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.096 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.096 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.096 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.096 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.096 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.096 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.096 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.096 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.097 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.097 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.097 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.097 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.097 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.097 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.097 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.097 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.098 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.098 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.098 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.098 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.098 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.098 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.098 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.098 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.099 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.099 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.099 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.099 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.099 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.099 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.099 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.099 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.100 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.100 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.100 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.100 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.100 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-06-13T11:34:43.100 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-06-13T11:34:43.100 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.100 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.100 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.101 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.101 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.101 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.101 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.101 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-06-13T11:34:43.101 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.101 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.101 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.102 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.102 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-06-13T11:34:43.102 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-06-13T11:34:43.102 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.102 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.102 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.102 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.102 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.103 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.103 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.103 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.103 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.103 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.103 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.103 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.103 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T11:34:43.103 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T11:34:43.104 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.104 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.104 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.104 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-06-13T11:34:43.104 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.104 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.104 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.104 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.105 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.105 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.105 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.105 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.105 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T11:34:43.105 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T11:34:43.105 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.105 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.106 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.106 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-06-13T11:34:43.106 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.106 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.106 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.106 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.106 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.106 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.107 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.107 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.107 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-06-13T11:34:43.107 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-06-13T11:34:43.107 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.107 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.107 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.107 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.108 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.108 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.108 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.108 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.108 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.108 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.108 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.108 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.108 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-06-13T11:34:43.109 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-06-13T11:34:43.109 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.109 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.109 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.109 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-06-13T11:34:43.109 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.109 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.109 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.109 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.110 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.110 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.110 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.110 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.110 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-06-13T11:34:43.110 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-06-13T11:34:43.110 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.110 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.111 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.111 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-06-13T11:34:43.111 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.111 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.111 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.111 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.111 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-06-13T11:34:43.111 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.112 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.112 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.112 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.112 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.112 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.112 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-06-13T11:34:43.112 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-06-13T11:34:43.112 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.113 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.113 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.113 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-06-13T11:34:43.113 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-06-13T11:34:43.113 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-06-13T11:34:43.113 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.113 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.113 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.114 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.114 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.114 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.114 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-06-13T11:34:43.114 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-06-13T11:34:43.114 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.114 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.115 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.115 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.115 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.115 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.115 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.115 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.115 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.115 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.116 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.116 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.116 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.116 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.116 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-06-13T11:34:43.116 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.116 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.117 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.117 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-06-13T11:34:43.117 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-06-13T11:34:43.117 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.117 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.117 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.117 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.117 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.117 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.118 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.118 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-06-13T11:34:43.118 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.118 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.118 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.118 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.118 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.119 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.119 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.119 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.119 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.119 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.119 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.119 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.119 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.120 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.120 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.120 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.120 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.120 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.120 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.120 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.120 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.120 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.121 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.121 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.121 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.121 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.121 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.121 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.121 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.121 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.121 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.122 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.122 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.122 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.122 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.122 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.122 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.122 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.122 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.122 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.123 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.123 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.123 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.123 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.123 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.123 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.123 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.123 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.124 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.124 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.124 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.124 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.124 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.124 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.124 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.124 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.124 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.124 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.125 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.125 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.125 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.125 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.125 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.125 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.125 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.125 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.125 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.126 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.126 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.126 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.126 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.126 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.126 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.126 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-06-13T11:34:43.126 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-06-13T11:34:43.127 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.127 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.127 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.127 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-06-13T11:34:43.127 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.127 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.127 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.127 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-13T11:34:43.127 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.128 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.128 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.128 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.128 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-06-13T11:34:43.128 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-06-13T11:34:43.128 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.128 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.128 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.129 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-06-13T11:34:43.129 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.129 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.129 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.129 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-13T11:34:43.129 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.129 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.129 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.129 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.130 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-06-13T11:34:43.130 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-06-13T11:34:43.130 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.130 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.130 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.130 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-06-13T11:34:43.130 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.130 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.131 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.131 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-06-13T11:34:43.131 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.131 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.131 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.131 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.131 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-06-13T11:34:43.131 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-06-13T11:34:43.131 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.132 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.132 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.132 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-06-13T11:34:43.132 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.132 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.132 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.132 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-13T11:34:43.132 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.132 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.133 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.133 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.133 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-06-13T11:34:43.133 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-06-13T11:34:43.133 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.133 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.133 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.133 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.133 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.134 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.134 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.134 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-13T11:34:43.134 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.134 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.134 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.134 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.134 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T11:34:43.135 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T11:34:43.135 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.135 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.135 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.135 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T11:34:43.135 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.135 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.135 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.136 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-06-13T11:34:43.136 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.136 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.136 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.136 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.136 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-06-13T11:34:43.136 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-06-13T11:34:43.136 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.136 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.137 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.137 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-06-13T11:34:43.137 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.137 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.137 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.137 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-13T11:34:43.137 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.137 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.137 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.138 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.138 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.138 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.138 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.138 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-06-13T11:34:43.138 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.138 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.138 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.139 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.139 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.139 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.139 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.139 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.139 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.139 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.139 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.139 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.140 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.140 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.140 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.140 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.140 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.140 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.140 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.140 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.140 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.141 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.141 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.141 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.141 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.141 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.141 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.141 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.141 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.141 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.142 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.142 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.142 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.142 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.142 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.142 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.142 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.142 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.143 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.143 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.143 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.143 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.143 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.143 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.143 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.143 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.143 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.144 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.144 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.144 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.144 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.144 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.144 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.144 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.144 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.144 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.145 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.145 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.145 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.145 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.145 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.145 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.145 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.146 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.146 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.146 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.146 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.146 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.146 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.146 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.146 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.147 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-06-13T11:34:43.147 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-06-13T11:34:43.147 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.147 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.147 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.147 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-06-13T11:34:43.147 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.147 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.147 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.148 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.148 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.148 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.148 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.148 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.148 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-06-13T11:34:43.148 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-06-13T11:34:43.148 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.149 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.149 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.149 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-06-13T11:34:43.149 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.149 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.149 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.149 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.149 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.150 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.150 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.150 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.150 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T11:34:43.150 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T11:34:43.150 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.150 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.151 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.151 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T11:34:43.151 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.151 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.151 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.151 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.151 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.151 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.151 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.152 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.152 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.152 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.152 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.152 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-06-13T11:34:43.152 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-06-13T11:34:43.152 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-06-13T11:34:43.152 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.153 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-06-13T11:34:43.153 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-06-13T11:34:43.153 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.153 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.153 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.153 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-06-13T11:34:43.153 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.153 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.153 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.153 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-13T11:34:43.154 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.154 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.154 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.154 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-06-13T11:34:43.154 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-06-13T11:34:43.154 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.154 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.155 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.155 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-06-13T11:34:43.155 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.155 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.155 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.155 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-13T11:34:43.155 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.155 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.155 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.156 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.156 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-06-13T11:34:43.156 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-06-13T11:34:43.156 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.156 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.156 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.156 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.156 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.156 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.157 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.157 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-06-13T11:34:43.157 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.157 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.157 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.157 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.157 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T11:34:43.157 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T11:34:43.157 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.158 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.158 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.158 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-06-13T11:34:43.158 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-06-13T11:34:43.158 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.158 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.158 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-13T11:34:43.158 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.158 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.159 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.159 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.159 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.159 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.159 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.159 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.159 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.159 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.160 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.160 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.160 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.160 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.160 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.160 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.160 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.160 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.160 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.161 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.161 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.161 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.161 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.161 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.161 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.161 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.161 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.161 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.162 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.162 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.162 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.162 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.162 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.162 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.162 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.162 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.162 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.163 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.163 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.163 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.163 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.163 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.163 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.163 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.163 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.164 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.164 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.164 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.164 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.164 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.164 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.164 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.164 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.164 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.165 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.165 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.165 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.165 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.165 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.165 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.165 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.165 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.166 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.166 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.166 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.166 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.166 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.166 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.166 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.166 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.167 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.167 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.167 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.167 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.167 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-06-13T11:34:43.167 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-06-13T11:34:43.167 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.167 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.167 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.168 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.168 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.168 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.168 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.168 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-06-13T11:34:43.168 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.168 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.168 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.168 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.169 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-06-13T11:34:43.169 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-06-13T11:34:43.169 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.169 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.169 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.169 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-06-13T11:34:43.169 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.169 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.169 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.170 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-06-13T11:34:43.170 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.170 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.170 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.170 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.170 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-06-13T11:34:43.170 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-06-13T11:34:43.170 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.170 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.171 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.171 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-06-13T11:34:43.171 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.171 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.171 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.171 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-13T11:34:43.171 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.171 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.172 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.172 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.172 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-06-13T11:34:43.172 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-06-13T11:34:43.172 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.172 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.172 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.172 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T11:34:43.173 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T11:34:43.173 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-06-13T11:34:43.173 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.173 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-13T11:34:43.173 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.173 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.173 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.173 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.173 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-06-13T11:34:43.174 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-06-13T11:34:43.174 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.174 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.174 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.174 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.174 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.174 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.174 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.174 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-06-13T11:34:43.175 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.175 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.175 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.175 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.175 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-06-13T11:34:43.175 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-06-13T11:34:43.175 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.175 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.175 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.176 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-06-13T11:34:43.176 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.176 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.176 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.176 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-13T11:34:43.176 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.176 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.176 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.176 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.177 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.177 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.177 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.177 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-06-13T11:34:43.177 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.177 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.177 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.177 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.177 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.178 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.178 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.178 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.178 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.178 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.178 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.178 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.178 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.179 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.179 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.179 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.179 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.179 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.179 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.179 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.179 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.180 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.180 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.180 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.180 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.180 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.180 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.180 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.180 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.181 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.181 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.181 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.181 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.181 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.181 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.181 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.181 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.181 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.182 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.182 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.182 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.182 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.182 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.182 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.182 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.182 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.183 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.183 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.183 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.183 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.183 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.183 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.183 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.183 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.183 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.184 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.184 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.184 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.184 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.184 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.184 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.184 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.184 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.184 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.185 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.185 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.185 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.185 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.185 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.185 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.185 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.185 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.185 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.186 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.186 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.186 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-06-13T11:34:43.186 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.186 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.186 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.186 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.187 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.187 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.187 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.187 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.187 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.187 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.187 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.187 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.187 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.188 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.188 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.188 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.188 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.188 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.188 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.188 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.188 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.189 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.189 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.189 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.189 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.189 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.189 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.189 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.189 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.190 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.190 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.190 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.190 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.190 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.190 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.190 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.190 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.191 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.191 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.191 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.191 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.191 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.191 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.191 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.191 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.191 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.192 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.192 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.192 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.192 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.192 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.192 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.192 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.192 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.192 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.193 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.193 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.193 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.193 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.193 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.193 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.193 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.193 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.194 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.194 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.194 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.194 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.194 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.194 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.194 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.194 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.194 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.195 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.195 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.195 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.195 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.195 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-06-13T11:34:43.195 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.195 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.195 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.195 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-06-13T11:34:43.196 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-06-13T11:34:43.196 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.196 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.196 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.196 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-06-13T11:34:43.196 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.196 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.196 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.197 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-13T11:34:43.197 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.197 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.197 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.197 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.197 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-06-13T11:34:43.197 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-06-13T11:34:43.197 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.197 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.198 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.198 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:43.198 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-06-13T11:34:43.198 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.198 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.198 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-13T11:34:43.198 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.198 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.199 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.199 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.199 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.199 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.199 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.199 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.199 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.200 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.200 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.200 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.200 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.200 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.200 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.200 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.200 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.201 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.201 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.201 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.201 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.201 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.201 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.201 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.201 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.202 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.202 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.202 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.202 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.202 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.202 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.202 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.202 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.203 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.203 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.203 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.203 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.203 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.203 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.203 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.203 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.204 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.204 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.204 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.204 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.204 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.204 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.204 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.204 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.205 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.205 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.205 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.205 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.205 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.205 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.205 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.205 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.205 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.206 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.206 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.206 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.206 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.206 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.206 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.206 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.206 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.207 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.207 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.207 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.207 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.207 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.207 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.207 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.207 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.208 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.208 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.208 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-06-13T11:34:43.208 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.208 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.208 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.208 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-06-13T11:34:43.208 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-06-13T11:34:43.209 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.209 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.209 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.209 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-06-13T11:34:43.209 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.209 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.209 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.209 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-06-13T11:34:43.209 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-13T11:34:43.210 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.210 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.210 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.210 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.210 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.210 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.210 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.213 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.213 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.213 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.213 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.213 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.213 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.213 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.213 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.213 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.214 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.214 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.214 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.214 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.214 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.214 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.214 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.214 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.215 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.215 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.215 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.215 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.215 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.215 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.215 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.215 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.216 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.216 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.216 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.216 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.216 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.216 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.216 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.216 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.217 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.217 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.217 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.217 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.217 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.217 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.217 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.217 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.217 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.218 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.218 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.218 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.218 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.218 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.218 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.218 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-06-13T11:34:43.219 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-06-13T11:34:43.219 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.219 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.219 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.219 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.219 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.219 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.219 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.219 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-06-13T11:34:43.220 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-13T11:34:43.220 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.220 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.220 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.220 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-06-13T11:34:43.220 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-06-13T11:34:43.220 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.220 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.221 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.221 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-06-13T11:34:43.221 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.221 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.221 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.221 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-06-13T11:34:43.221 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.221 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.222 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.222 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.222 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-06-13T11:34:43.222 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-06-13T11:34:43.222 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.222 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.222 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.223 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-06-13T11:34:43.223 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.223 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.223 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.223 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-06-13T11:34:43.223 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.223 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.224 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.224 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.224 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-06-13T11:34:43.224 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-06-13T11:34:43.224 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.224 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.224 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.224 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.224 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.225 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.225 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.225 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-06-13T11:34:43.225 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.225 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.225 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.225 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.225 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-06-13T11:34:43.225 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-06-13T11:34:43.225 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.226 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.226 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.226 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-06-13T11:34:43.226 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.226 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.226 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.226 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-13T11:34:43.226 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-13T11:34:43.227 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.227 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.227 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.227 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.227 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.227 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.227 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-06-13T11:34:43.227 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.228 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.228 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.228 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.228 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.228 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.228 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.228 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.228 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.228 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.229 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.229 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.229 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.229 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.229 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.229 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.229 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.229 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.230 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.230 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.230 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.230 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.230 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.230 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.230 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.231 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.231 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.231 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.231 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.231 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.231 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.231 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.231 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.233 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.233 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.233 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.233 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.233 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.233 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.233 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.233 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.233 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.234 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.234 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.234 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.234 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.234 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.234 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.234 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.234 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.234 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.235 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.235 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.235 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.235 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.235 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.235 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.235 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.235 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.236 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.236 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.236 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.236 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.236 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.236 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.236 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.236 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.237 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-06-13T11:34:43.237 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.237 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.237 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.237 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.237 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.237 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.237 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.238 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.238 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.238 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.238 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.238 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.238 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.238 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.238 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.239 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.239 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.239 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.239 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.239 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.239 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.239 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.239 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.239 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.240 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.240 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.240 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.240 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.240 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.240 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.240 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.240 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.240 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.241 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.241 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.241 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.241 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.241 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.241 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.241 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.241 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.242 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.242 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.242 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.242 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.242 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.242 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.242 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.242 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.242 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.243 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.243 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.243 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.243 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.243 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.243 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.243 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.243 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.243 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.244 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.244 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.244 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.244 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.244 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.244 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.244 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.244 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.244 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.245 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.246 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-06-13T11:34:43.246 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.246 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.246 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.246 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.246 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.246 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.246 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.247 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.247 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.247 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.247 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.247 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.247 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.247 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.247 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.247 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.248 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.248 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.248 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.248 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.248 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.248 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.248 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.248 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.248 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.249 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.249 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.249 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.249 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.249 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.249 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.249 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.249 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.249 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.250 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.250 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.250 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.250 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.250 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.250 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.250 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.250 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.251 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.251 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.251 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.251 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.251 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.251 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.251 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.251 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.251 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.252 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.252 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.252 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.252 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.252 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.252 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.252 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.252 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.252 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.253 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.253 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.253 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.253 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.253 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.253 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.253 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.253 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.253 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.254 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.254 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.254 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.254 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.254 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.254 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.254 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.254 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-06-13T11:34:43.255 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.255 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.255 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.255 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-06-13T11:34:43.255 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-06-13T11:34:43.255 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.255 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.255 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.255 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.256 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.256 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.256 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.256 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-13T11:34:43.256 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.256 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.256 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.256 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.256 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.257 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.257 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.257 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.257 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.257 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.257 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.257 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.257 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.258 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.258 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.258 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.258 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.258 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.258 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.258 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.258 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.259 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.259 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.259 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.259 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.259 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.259 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.259 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.259 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.260 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.260 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.260 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.260 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.260 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.260 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.260 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.260 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.261 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.261 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.261 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.261 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.261 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.261 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.261 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.261 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.262 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.262 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.262 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.262 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.262 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.262 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.262 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.262 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.263 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.263 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.263 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.263 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.263 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.263 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.263 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.263 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.263 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.264 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.264 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.264 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.264 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.264 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.264 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.264 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.264 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.264 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.265 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.265 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.265 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-06-13T11:34:43.265 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-06-13T11:34:43.265 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.265 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.265 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.265 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.266 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.266 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.266 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.266 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-06-13T11:34:43.266 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-06-13T11:34:43.266 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-06-13T11:34:43.266 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.266 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-06-13T11:34:43.267 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.267 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.267 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.267 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.267 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.267 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.267 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.267 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-06-13T11:34:43.267 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.268 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.268 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.268 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.268 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.268 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.268 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.268 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.268 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.269 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.269 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.269 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.269 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.269 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.269 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.269 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.269 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.270 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.270 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.270 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.270 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.270 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.270 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.270 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.270 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.270 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.271 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.271 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.271 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.271 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.271 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.271 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.271 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.271 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.272 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.272 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.272 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.272 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.272 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.272 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.272 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.272 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.272 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.273 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.273 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.273 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.273 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.273 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.273 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.273 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.273 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.274 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.274 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.274 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.274 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.274 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.274 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.274 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.274 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.275 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.275 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.275 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.275 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.275 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.275 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.275 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.275 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.275 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.276 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.276 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.276 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.276 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.276 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.276 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.276 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.276 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.277 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-06-13T11:34:43.277 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.277 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.277 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.277 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.277 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.277 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.277 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.278 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.278 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.278 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.278 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.278 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.278 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.278 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.278 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.278 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.279 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.279 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.279 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.279 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.279 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.279 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.279 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.279 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.280 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.280 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.280 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.280 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.280 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.280 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.280 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.280 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.280 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.281 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.281 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.281 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.281 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.281 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.281 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.281 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.281 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.282 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.282 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.282 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.282 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.282 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.282 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.282 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.282 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.283 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.283 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.283 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.283 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.283 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.283 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.283 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.283 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.283 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.284 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.284 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.284 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.284 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.284 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.284 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.284 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.284 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.285 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.285 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.285 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.285 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.285 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.285 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.285 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.285 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.285 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.286 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.286 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-06-13T11:34:43.286 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.286 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.286 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.286 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.286 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.286 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.287 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.287 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.287 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.287 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.287 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.287 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.287 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.287 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.287 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.288 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.288 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.288 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.288 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.288 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.288 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.288 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.288 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.289 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.289 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.289 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.289 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.289 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.289 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.289 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.289 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.289 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.290 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.290 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.290 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.290 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.290 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.290 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.290 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.290 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.291 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.291 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.291 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.291 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.291 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.291 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.291 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.291 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.292 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.292 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.292 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.292 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.292 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.292 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.292 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.292 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.293 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.293 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.293 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.293 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.293 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.293 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.293 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.293 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.293 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.294 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.294 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.294 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.294 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.294 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.294 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.294 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.294 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.295 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T11:34:43.295 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T11:34:43.295 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.295 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.295 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.295 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T11:34:43.295 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.295 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.296 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.296 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.296 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.296 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.296 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.296 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.296 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-06-13T11:34:43.296 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-06-13T11:34:43.296 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:43.297 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.297 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.297 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-06-13T11:34:43.297 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-06-13T11:34:43.297 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.297 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.297 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-06-13T11:34:43.297 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-13T11:34:43.298 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.298 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.298 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.298 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.298 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.298 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.298 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-06-13T11:34:43.298 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.299 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.299 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.299 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-06-13T11:34:43.299 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-06-13T11:34:43.299 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.299 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.299 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.299 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.299 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.300 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.300 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.300 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-13T11:34:43.300 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.300 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.300 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.300 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.300 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-06-13T11:34:43.300 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-06-13T11:34:43.301 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.301 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.301 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.301 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.301 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.301 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.301 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.301 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.302 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.302 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.302 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.302 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.302 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.302 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.302 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.302 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.303 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.303 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.303 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.303 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.303 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.303 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.303 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.303 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.303 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.304 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.304 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.304 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.304 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.304 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.304 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.304 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.304 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.305 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.305 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.305 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.305 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.305 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.305 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.305 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.305 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.306 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.306 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.306 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.306 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.306 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.306 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.306 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.306 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.307 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.307 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.307 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.307 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.307 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.307 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.307 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.307 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.307 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.308 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.308 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.308 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.308 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.308 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.308 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.308 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.308 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.309 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.309 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.309 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.309 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.309 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.309 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.309 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.309 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.309 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.310 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.310 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.310 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.310 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.310 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.310 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.310 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.310 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-06-13T11:34:43.311 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-06-13T11:34:43.311 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.311 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.311 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.311 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-06-13T11:34:43.311 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.311 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.311 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.312 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-06-13T11:34:43.312 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.312 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.312 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.312 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.312 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T11:34:43.312 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T11:34:43.312 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.312 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.313 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.313 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T11:34:43.313 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.313 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.313 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.313 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-06-13T11:34:43.313 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.313 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.314 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.314 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.314 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.314 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.314 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.314 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-06-13T11:34:43.314 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.314 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.315 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.315 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-06-13T11:34:43.315 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-06-13T11:34:43.315 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.315 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.315 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.315 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.315 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.316 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.316 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.316 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.316 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.316 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.316 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.316 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.316 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-06-13T11:34:43.317 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-06-13T11:34:43.317 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.317 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.317 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.317 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.317 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.317 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.317 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-13T11:34:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-13T11:34:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.319 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.319 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.319 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.319 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.319 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.319 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.319 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.319 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.320 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.320 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.320 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.320 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.320 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.320 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.320 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.320 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.321 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.321 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.321 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.321 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.321 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.321 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.321 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.321 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.322 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.322 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.322 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.322 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.322 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.322 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.322 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.322 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.323 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.323 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.323 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.323 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.323 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.323 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.323 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.323 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.324 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.324 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.324 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.324 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.324 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.324 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.324 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.324 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.325 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.325 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.325 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.325 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.325 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.325 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.325 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.325 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.325 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.326 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.326 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.326 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.326 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.326 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.326 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.327 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.327 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.327 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.327 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-06-13T11:34:43.327 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-06-13T11:34:43.327 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.327 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.327 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.328 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.328 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.328 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.328 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.328 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.328 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.328 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.328 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.329 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.329 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-13T11:34:43.329 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-13T11:34:43.329 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.329 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.329 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.329 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-06-13T11:34:43.329 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.330 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.330 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.330 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.330 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.330 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.330 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.330 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.330 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-06-13T11:34:43.331 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-06-13T11:34:43.331 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:43.331 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.331 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.331 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-06-13T11:34:43.331 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.331 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.331 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.331 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.332 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.332 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.332 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.332 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.332 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T11:34:43.332 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T11:34:43.332 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.332 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.333 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.333 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-06-13T11:34:43.333 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.333 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.333 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.333 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-13T11:34:43.333 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.333 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.334 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.334 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.334 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T11:34:43.334 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T11:34:43.334 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.334 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.334 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.334 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-06-13T11:34:43.335 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.335 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.335 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.335 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-13T11:34:43.335 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.335 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.335 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.335 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.335 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-06-13T11:34:43.336 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-06-13T11:34:43.336 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.336 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.336 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.336 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-06-13T11:34:43.336 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.336 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.336 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.337 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.337 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.337 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.337 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.337 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.337 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-06-13T11:34:43.337 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-06-13T11:34:43.337 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.338 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.338 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.338 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-06-13T11:34:43.338 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.338 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.338 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.338 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-06-13T11:34:43.338 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-06-13T11:34:43.339 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.339 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.339 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.339 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.339 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.339 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.339 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-06-13T11:34:43.339 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-06-13T11:34:43.340 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.340 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.340 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.340 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-06-13T11:34:43.340 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-06-13T11:34:43.340 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-06-13T11:34:43.340 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.340 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.341 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.341 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.341 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.341 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.341 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.341 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.341 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.341 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-06-13T11:34:43.341 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.342 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.342 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.342 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.342 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.342 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.342 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.342 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.343 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.343 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.343 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.343 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.343 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.343 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.343 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.343 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.343 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.344 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.344 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.344 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.344 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.344 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.344 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.344 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.344 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.345 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.345 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.345 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.345 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.345 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.345 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.345 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.345 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.346 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.346 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.346 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.346 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.346 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.346 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.346 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.346 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.346 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.347 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.347 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.347 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.347 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.347 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.347 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.347 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.348 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.348 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.348 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.348 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.348 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.348 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.348 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.348 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.349 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.349 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.349 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.349 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.349 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.349 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.349 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.349 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.349 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.349 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.350 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.350 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.350 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.350 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.350 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.350 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-06-13T11:34:43.350 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-06-13T11:34:43.350 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.351 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.351 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.351 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:43.351 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.351 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.351 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.351 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.351 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.352 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.352 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.352 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.352 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-06-13T11:34:43.352 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-06-13T11:34:43.352 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.352 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.352 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.353 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.353 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.353 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.353 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.353 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.353 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.353 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.353 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.354 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.354 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-06-13T11:34:43.354 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-06-13T11:34:43.354 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.354 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.354 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.354 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.354 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.354 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.355 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.355 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.355 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.355 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.355 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.355 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.355 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.355 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.356 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.356 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-06-13T11:34:43.356 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.356 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.356 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.356 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-06-13T11:34:43.356 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-06-13T11:34:43.356 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.357 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.357 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.357 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.357 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.357 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.357 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.357 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.357 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.357 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.358 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.358 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.358 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-06-13T11:34:43.358 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-06-13T11:34:43.358 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.358 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.358 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.358 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.359 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.359 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.359 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.359 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.359 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.359 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.359 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.359 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.360 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.360 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.360 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.360 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.360 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.360 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.360 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.360 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.360 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.361 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.361 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.361 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.361 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.361 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.361 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.361 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.362 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.362 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.362 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.362 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.362 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.362 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.362 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.362 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.363 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.363 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.363 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.363 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.363 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.363 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.363 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.363 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.363 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.364 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.364 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.364 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.364 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.364 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.364 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.364 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.364 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.365 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.365 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.365 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.365 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.365 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.365 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.365 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.365 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.366 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.366 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.366 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.366 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.366 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.366 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.366 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.366 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.367 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.367 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.367 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.367 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.367 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.367 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.367 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.367 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T11:34:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T11:34:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.369 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.369 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.369 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.369 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.369 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.369 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.369 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.369 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.370 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.370 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.370 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T11:34:43.370 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T11:34:43.370 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.370 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.370 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.370 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.371 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.371 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.371 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.371 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.371 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.371 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.371 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.371 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.371 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.372 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.372 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.372 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-06-13T11:34:43.372 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.372 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.372 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.372 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.372 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.373 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.373 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.373 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.373 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.373 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.373 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.373 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.373 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.374 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.374 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.374 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.374 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.374 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.374 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.374 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.374 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.375 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.375 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.375 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.375 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.375 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.375 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.375 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.375 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.375 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.376 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.376 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.376 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.376 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.376 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.376 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.376 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.376 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.376 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.377 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.377 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.377 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.377 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.377 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.377 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.377 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.377 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.377 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.378 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.378 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.378 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.378 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.378 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.378 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.378 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.378 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.379 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.379 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.379 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.379 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.379 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.379 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.379 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.379 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.379 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.380 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.380 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.380 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.380 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.380 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.380 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.380 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.380 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.380 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.381 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.381 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.381 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-06-13T11:34:43.381 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.381 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.381 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.381 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.381 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.381 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.382 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.382 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.382 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.382 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.382 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.382 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.382 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.382 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.382 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.383 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.383 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.383 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.383 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.383 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.383 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.383 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.383 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.383 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.384 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.384 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.384 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.384 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.384 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.384 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.384 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.384 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.384 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.385 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.385 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.385 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.385 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.385 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.385 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.385 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.385 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.385 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.386 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.386 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.386 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.386 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.386 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.386 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.386 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.386 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.387 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.387 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.387 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.387 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.387 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.387 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.387 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.387 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.387 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.388 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.388 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.388 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.388 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.388 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.388 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.388 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.388 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.388 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.389 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.389 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.389 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.389 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.389 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.389 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-06-13T11:34:43.389 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-06-13T11:34:43.389 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.389 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.390 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.390 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-06-13T11:34:43.390 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.390 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.390 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.390 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-13T11:34:43.390 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.390 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.391 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.391 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.391 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.391 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.391 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.391 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-06-13T11:34:43.391 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.391 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.391 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.392 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.392 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.392 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.392 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.392 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.392 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.392 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.392 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.393 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.393 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.393 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.393 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.393 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.393 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.393 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.393 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.393 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.394 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.394 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.394 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.394 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.394 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.394 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.394 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.394 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.395 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.395 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.395 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.395 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.395 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.395 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.395 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.395 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.396 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.396 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.396 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.396 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.396 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.396 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.396 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.396 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.396 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.397 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.397 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.397 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.397 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.397 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.397 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.397 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.397 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.397 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.398 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.398 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.398 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.398 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.398 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.398 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.398 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.398 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.399 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.399 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.399 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.399 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.399 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.399 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.399 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.399 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.399 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.400 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.400 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-06-13T11:34:43.400 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-06-13T11:34:43.400 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.400 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.400 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.400 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.400 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.401 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.401 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.401 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.401 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.401 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.401 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.401 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.401 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-06-13T11:34:43.402 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-06-13T11:34:43.402 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.402 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.402 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.402 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-06-13T11:34:43.402 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.402 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.402 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.402 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.403 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.403 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.403 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.403 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.403 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-06-13T11:34:43.403 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-06-13T11:34:43.403 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.404 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.404 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.404 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.404 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.404 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.404 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.404 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.404 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.404 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.405 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.405 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.405 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-06-13T11:34:43.405 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-06-13T11:34:43.405 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.405 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.405 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.405 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.405 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.406 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.406 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.406 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.406 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.406 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.406 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.406 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-06-13T11:34:43.407 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-06-13T11:34:43.407 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:43.407 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.407 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.407 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.407 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.407 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.407 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.408 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.408 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.408 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.408 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.408 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.408 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-06-13T11:34:43.408 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-06-13T11:34:43.408 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.409 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.409 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.409 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.409 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.409 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.409 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.409 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.409 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.409 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.409 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.410 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-06-13T11:34:43.410 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-06-13T11:34:43.410 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.410 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.410 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.410 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.410 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.411 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.411 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.411 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.411 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.411 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.411 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.411 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.411 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-06-13T11:34:43.411 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-06-13T11:34:43.411 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.412 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.412 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.412 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.412 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.412 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.412 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.412 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.412 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.412 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.413 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.413 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.413 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-06-13T11:34:43.413 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-06-13T11:34:43.413 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.413 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.413 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.413 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.413 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T11:34:43.414 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-06-13T11:34:43.414 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.414 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.414 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.414 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.414 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.415 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-06-13T11:34:43.415 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-06-13T11:34:43.415 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.415 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.415 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.415 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.415 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.416 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.416 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.416 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.416 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.416 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.416 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.416 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.416 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-06-13T11:34:43.416 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-06-13T11:34:43.417 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.417 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.417 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.417 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.417 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.417 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.417 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.417 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.417 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.418 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.418 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.418 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-06-13T11:34:43.418 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-06-13T11:34:43.418 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.418 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.418 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.419 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.419 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.419 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.419 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.419 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.419 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.419 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.419 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.420 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.420 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.420 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.420 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.420 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-06-13T11:34:43.420 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.420 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.420 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.421 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-06-13T11:34:43.421 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-06-13T11:34:43.421 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.421 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.421 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.421 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.421 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.421 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.421 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.422 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-06-13T11:34:43.422 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.422 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.422 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.422 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.422 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-06-13T11:34:43.422 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-06-13T11:34:43.422 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.423 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.423 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.423 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.423 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.423 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.423 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.423 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-06-13T11:34:43.423 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.423 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.424 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.424 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.424 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.424 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.424 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.424 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.424 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.424 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.424 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.425 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.425 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.425 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.425 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.425 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.425 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.425 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.425 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.426 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.426 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.426 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.426 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.426 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.426 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.426 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.426 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.427 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.427 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.427 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.427 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.427 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.427 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.427 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.427 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.428 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.428 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.428 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.428 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.428 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.428 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.428 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.428 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.428 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.429 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.429 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.429 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.429 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.429 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.429 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.429 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.429 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.430 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.430 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.430 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.430 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.430 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.430 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.430 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.431 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.431 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.431 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.431 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.431 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.431 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.431 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.431 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.431 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.432 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.432 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.432 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.432 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.432 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.432 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.432 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.432 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-06-13T11:34:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.433 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.434 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.434 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.434 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.434 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.434 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.434 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.434 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.435 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.435 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.435 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.435 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.435 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.435 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.435 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.435 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.435 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.436 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.436 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.436 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.436 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.436 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.436 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.436 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.436 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.436 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.437 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.437 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.437 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.437 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.437 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.437 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.437 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.437 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.437 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.438 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.438 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.438 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.438 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.438 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.438 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.438 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.438 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.439 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.439 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.439 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.439 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.439 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.439 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.439 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.439 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.440 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.440 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.440 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.440 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.440 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.440 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.440 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.440 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.441 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.441 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.441 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.441 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.441 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.441 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.441 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.441 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.441 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.441 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.442 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.442 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.442 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-06-13T11:34:43.442 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.442 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.442 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.442 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.442 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.443 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.443 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.443 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.443 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.443 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.443 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.443 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.443 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.443 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.444 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.444 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.444 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.444 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.444 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.444 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.444 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.444 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.444 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.445 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.445 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.445 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.445 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.445 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.445 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.445 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.445 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.445 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.446 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.446 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.446 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.446 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.446 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.446 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.447 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.447 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.447 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.447 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.447 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.447 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.447 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.447 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.447 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.448 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.448 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.448 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.448 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.448 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.448 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.448 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.448 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.448 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.449 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.449 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.449 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.449 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.449 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.449 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.449 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.449 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.449 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.450 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.450 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.450 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.450 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.450 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.450 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.450 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.450 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.450 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.451 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.451 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-06-13T11:34:43.451 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.451 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.451 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.451 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-06-13T11:34:43.451 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-06-13T11:34:43.451 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.451 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.452 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.452 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-13T11:34:43.452 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.452 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.452 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.452 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.452 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.452 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.452 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.453 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T11:34:43.453 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T11:34:43.453 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.453 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.453 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.453 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-06-13T11:34:43.453 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.453 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.453 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.454 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.454 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.454 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.454 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.454 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.454 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.454 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.454 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.454 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.455 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.455 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.455 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.455 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.455 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.455 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.455 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.455 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.455 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.456 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.456 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.456 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.456 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.456 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.456 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.456 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.456 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.456 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.457 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.457 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.457 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.457 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.457 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.457 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.457 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.457 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.458 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.458 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.458 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.458 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.458 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.458 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.458 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.458 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.458 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.459 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.459 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.459 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.459 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.459 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.459 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.459 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.459 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.460 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.460 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.460 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.460 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.460 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.460 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.460 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.460 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.460 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.461 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.461 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.461 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.461 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.461 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.461 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.461 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.461 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.462 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.462 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.462 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.462 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.462 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.462 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.462 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.462 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.462 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.463 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-06-13T11:34:43.463 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.463 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.463 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.463 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-06-13T11:34:43.463 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-06-13T11:34:43.463 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.463 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.463 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.464 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.464 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.464 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.464 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.464 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-13T11:34:43.464 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.464 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.464 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.464 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.465 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-06-13T11:34:43.465 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-06-13T11:34:43.465 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.465 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.465 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.465 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.465 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.465 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.465 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.466 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-13T11:34:43.466 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.466 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.466 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.466 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.466 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-06-13T11:34:43.466 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-06-13T11:34:43.466 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.467 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.467 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.467 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.467 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.467 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.467 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.467 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-13T11:34:43.467 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.468 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.468 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.468 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.468 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-06-13T11:34:43.468 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-06-13T11:34:43.468 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.468 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.468 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.468 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.469 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.469 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.469 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.469 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-13T11:34:43.469 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.469 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.469 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.469 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.469 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-06-13T11:34:43.470 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-06-13T11:34:43.470 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.470 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.470 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.470 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.470 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.470 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.470 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.471 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-13T11:34:43.471 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.471 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.471 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.471 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.471 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-06-13T11:34:43.471 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-06-13T11:34:43.471 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.471 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.472 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.472 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.472 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.472 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.472 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.472 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.472 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.472 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.473 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.473 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.473 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-06-13T11:34:43.473 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-06-13T11:34:43.473 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.473 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.473 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.473 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.473 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.474 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.474 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.474 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.474 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.474 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.474 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.474 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-06-13T11:34:43.475 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-06-13T11:34:43.475 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.475 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.475 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.475 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-13T11:34:43.475 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.475 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.475 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.476 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.476 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.476 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.476 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.476 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.476 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-06-13T11:34:43.476 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-06-13T11:34:43.476 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.476 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.477 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.477 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.477 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.477 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.477 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.477 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.477 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.477 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.478 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.478 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.478 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T11:34:43.478 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T11:34:43.478 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.478 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.478 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.478 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-06-13T11:34:43.478 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-06-13T11:34:43.479 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.479 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.479 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.479 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.479 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.479 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.479 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.479 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-06-13T11:34:43.480 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-06-13T11:34:43.480 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.480 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.480 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.480 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-06-13T11:34:43.480 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.480 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.480 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.480 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.481 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.481 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.481 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.481 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.481 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-06-13T11:34:43.481 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-06-13T11:34:43.481 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.481 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.481 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.482 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.482 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.482 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.482 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.482 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.482 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.482 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.482 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.483 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.483 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-06-13T11:34:43.483 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-06-13T11:34:43.483 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.483 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.483 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.483 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.483 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.483 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.484 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.484 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.484 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.484 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.484 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.484 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.484 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.484 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.485 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.485 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.485 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.485 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.485 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.485 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.485 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.485 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.486 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.486 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.486 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.486 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.486 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.486 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.486 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.486 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.487 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.487 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.487 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.487 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.487 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.487 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.487 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.488 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.488 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.488 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.488 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.488 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.488 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.488 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.488 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.489 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.489 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.489 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.489 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.489 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.489 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.489 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.489 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.489 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.490 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.490 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.490 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.490 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.490 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.490 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.490 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.490 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.491 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.491 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.491 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.491 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.491 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.491 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.491 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.491 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.491 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.492 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.492 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.492 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.492 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.492 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.492 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.492 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.492 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.493 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.493 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.493 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-06-13T11:34:43.493 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-06-13T11:34:43.493 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.493 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.493 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.493 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.494 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.494 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.494 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.494 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.494 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.494 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.494 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.495 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.495 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-06-13T11:34:43.495 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-06-13T11:34:43.495 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.495 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.495 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.495 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.495 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.496 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.496 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.496 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.496 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.496 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.496 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.496 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.496 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-06-13T11:34:43.496 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-06-13T11:34:43.497 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.497 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.497 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.497 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-13T11:34:43.497 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.497 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.497 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.497 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.498 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.498 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.498 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.498 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.498 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.498 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.498 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.499 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-06-13T11:34:43.499 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.499 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.499 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.499 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.499 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.499 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.499 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.499 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.500 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.500 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.500 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.500 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.500 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.500 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.500 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.500 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.500 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.501 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.501 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.501 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.501 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.501 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.501 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.501 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.501 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.501 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.502 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.502 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.502 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.502 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.502 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.502 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.502 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.502 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.503 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.503 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.503 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.503 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.503 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.503 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.503 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.503 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.503 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.504 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.504 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.504 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.504 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.504 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.504 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.504 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.504 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.504 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.504 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.505 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.505 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.505 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.505 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.505 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.505 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.505 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.506 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.506 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.506 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.506 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.506 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.506 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.506 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.506 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.507 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.507 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.507 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.507 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.507 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.507 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.507 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.507 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-06-13T11:34:43.508 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.508 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.508 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.508 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.508 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.508 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.508 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.508 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.508 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.509 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.509 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.509 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.509 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.509 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.509 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.509 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.509 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.509 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.510 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.510 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.510 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.510 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.510 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.510 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.510 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.510 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.510 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.511 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.511 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.511 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.511 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.511 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.511 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.511 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.511 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.512 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.512 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.512 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.512 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.512 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.512 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.512 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.512 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.512 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.513 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.513 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.513 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.513 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.513 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.513 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.513 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.513 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.514 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.514 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.514 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.514 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.514 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.514 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.514 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.515 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.515 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.515 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.515 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.515 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.515 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.515 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.515 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.516 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.516 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.516 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.516 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.516 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.516 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.516 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-06-13T11:34:43.516 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-06-13T11:34:43.517 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.517 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.517 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.517 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-06-13T11:34:43.517 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.517 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.517 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.517 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-13T11:34:43.517 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.518 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.518 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.518 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.518 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-06-13T11:34:43.518 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-06-13T11:34:43.518 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.518 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.518 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.519 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.519 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.519 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.519 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.519 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-06-13T11:34:43.519 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.519 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.519 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.520 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.520 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-06-13T11:34:43.520 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-06-13T11:34:43.520 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.520 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.520 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.520 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T11:34:43.520 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.521 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.521 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.521 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-13T11:34:43.521 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.521 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.521 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.521 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.521 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-06-13T11:34:43.521 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-06-13T11:34:43.522 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.522 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.522 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.522 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.522 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.522 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.522 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.522 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-13T11:34:43.523 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.523 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.523 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.523 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.523 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.523 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.523 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.523 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-06-13T11:34:43.524 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.524 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.524 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.524 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-06-13T11:34:43.524 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-06-13T11:34:43.524 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T11:34:43.524 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.524 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.524 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-06-13T11:34:43.525 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.525 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.525 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.525 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.525 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.525 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.525 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.525 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.525 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-06-13T11:34:43.526 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-06-13T11:34:43.526 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.526 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.526 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.526 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.526 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.526 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.526 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.527 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.527 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.527 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.527 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.527 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.527 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T11:34:43.527 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T11:34:43.527 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.528 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.528 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.528 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T11:34:43.528 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.528 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.528 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.528 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.528 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.528 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.529 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.529 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.529 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.529 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.529 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.529 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.529 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.529 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.530 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.530 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.530 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.530 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.530 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.530 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.530 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.530 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.531 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.531 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.531 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.531 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.531 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.531 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.531 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.531 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.531 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.532 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.532 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.532 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.532 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.532 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.532 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.532 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.532 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.532 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.533 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.533 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.533 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.533 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.533 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.533 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.533 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.533 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.534 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.534 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.534 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.534 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.534 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.534 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.534 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.534 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.534 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.535 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.535 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.535 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.535 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.535 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.535 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.535 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.535 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.535 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.536 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.536 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.536 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.536 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.536 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.536 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.536 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.536 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.536 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.537 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.537 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.537 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.537 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-06-13T11:34:43.537 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-06-13T11:34:43.537 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.537 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.537 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.538 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.538 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.538 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.538 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.538 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.538 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.538 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.538 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.538 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.539 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-06-13T11:34:43.539 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-06-13T11:34:43.539 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.539 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.539 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.539 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-06-13T11:34:43.539 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.539 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.540 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.540 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.540 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.540 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.540 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.540 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.540 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-06-13T11:34:43.540 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-06-13T11:34:43.541 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.541 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.541 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.541 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-13T11:34:43.541 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.541 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.541 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.541 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.541 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.542 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.542 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.542 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.542 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.542 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.542 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T11:34:43.542 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.542 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.542 INFO:teuthology.orchestra.run.smithi002.stdout: "modules": [ 2024-06-13T11:34:43.543 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-06-13T11:34:43.543 INFO:teuthology.orchestra.run.smithi002.stdout: "dashboard", 2024-06-13T11:34:43.543 INFO:teuthology.orchestra.run.smithi002.stdout: "iostat", 2024-06-13T11:34:43.543 INFO:teuthology.orchestra.run.smithi002.stdout: "nfs", 2024-06-13T11:34:43.543 INFO:teuthology.orchestra.run.smithi002.stdout: "restful", 2024-06-13T11:34:43.543 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_schedule" 2024-06-13T11:34:43.543 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.543 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-06-13T11:34:43.543 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.543 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-06-13T11:34:43.544 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.544 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.544 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.544 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T11:34:43.544 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T11:34:43.544 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.544 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.544 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.545 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T11:34:43.545 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.545 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.545 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.545 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-06-13T11:34:43.545 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.545 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.545 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.546 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.546 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.546 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.546 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.546 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.546 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.546 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.547 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.547 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.547 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.547 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.547 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.547 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.547 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.548 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.548 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.548 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.548 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.548 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.548 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.548 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.548 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.548 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.549 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.549 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.549 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.549 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.549 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.549 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.549 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.549 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.549 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.550 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.550 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.550 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.550 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.550 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.550 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.550 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.551 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.551 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.551 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.551 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.551 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.551 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.551 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.551 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.551 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.552 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.552 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.552 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.552 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.552 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.552 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.552 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.552 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.553 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.553 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.553 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.553 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.553 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.553 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.553 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.553 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.553 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.554 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.554 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.554 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-06-13T11:34:43.554 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-06-13T11:34:43.554 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.554 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.554 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.554 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.555 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.555 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.555 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.555 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-06-13T11:34:43.555 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.555 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.555 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.555 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.555 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-06-13T11:34:43.555 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-06-13T11:34:43.556 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.556 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.556 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.556 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-06-13T11:34:43.556 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.556 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.556 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.556 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-06-13T11:34:43.557 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.557 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.557 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.557 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-06-13T11:34:43.557 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-06-13T11:34:43.557 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.557 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.557 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.558 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.558 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.558 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.558 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.558 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-06-13T11:34:43.558 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.558 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.558 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.559 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.559 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-06-13T11:34:43.559 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-06-13T11:34:43.559 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.559 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.559 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.559 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.559 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.559 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.560 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.560 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-06-13T11:34:43.560 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.560 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.560 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.560 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.560 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-06-13T11:34:43.560 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-06-13T11:34:43.560 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.561 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.561 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.561 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-06-13T11:34:43.561 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.561 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.561 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.561 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-06-13T11:34:43.561 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.561 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.561 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.562 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.562 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-06-13T11:34:43.562 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-06-13T11:34:43.562 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.562 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.562 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.562 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.562 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.563 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.563 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.563 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-06-13T11:34:43.563 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.563 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.563 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.563 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.563 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-06-13T11:34:43.563 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-06-13T11:34:43.564 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.564 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.564 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.564 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.564 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.564 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.564 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.564 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-13T11:34:43.565 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.565 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.565 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.565 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-06-13T11:34:43.565 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-06-13T11:34:43.565 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.565 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.566 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.566 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.566 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.566 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.566 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.566 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-06-13T11:34:43.566 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.566 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.566 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.567 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.567 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.567 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.567 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.567 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-06-13T11:34:43.567 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.567 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.567 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.567 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-06-13T11:34:43.568 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-06-13T11:34:43.568 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.568 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.568 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.568 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.568 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.568 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.568 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.568 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-06-13T11:34:43.569 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.569 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.569 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.569 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.569 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-06-13T11:34:43.569 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-06-13T11:34:43.569 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.569 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.569 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.570 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-06-13T11:34:43.570 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.570 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.570 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.570 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-06-13T11:34:43.570 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-13T11:34:43.570 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.571 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.571 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.571 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-06-13T11:34:43.571 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-06-13T11:34:43.571 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T11:34:43.571 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.571 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.571 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T11:34:43.571 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-06-13T11:34:43.572 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-06-13T11:34:43.572 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.572 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-13T11:34:43.572 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-13T11:34:43.572 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.572 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.572 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.572 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-06-13T11:34:43.572 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-06-13T11:34:43.573 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T11:34:43.573 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.573 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.573 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-06-13T11:34:43.573 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T11:34:43.573 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-06-13T11:34:43.573 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.573 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-13T11:34:43.574 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.574 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.574 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.574 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.574 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-06-13T11:34:43.574 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-06-13T11:34:43.574 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.574 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.575 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.575 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-06-13T11:34:43.575 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.575 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.575 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.575 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-13T11:34:43.575 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-13T11:34:43.575 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.575 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.576 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.576 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-06-13T11:34:43.576 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-06-13T11:34:43.576 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:43.576 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.576 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.576 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-06-13T11:34:43.576 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-06-13T11:34:43.576 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-06-13T11:34:43.577 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.577 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-06-13T11:34:43.577 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-13T11:34:43.577 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.577 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.577 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.577 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-06-13T11:34:43.577 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-06-13T11:34:43.578 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.578 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.578 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.578 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-06-13T11:34:43.578 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.578 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.578 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.578 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-06-13T11:34:43.578 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-13T11:34:43.579 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.579 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.579 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.579 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-06-13T11:34:43.579 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-06-13T11:34:43.579 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T11:34:43.579 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.579 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.579 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T11:34:43.580 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-06-13T11:34:43.580 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-06-13T11:34:43.580 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.580 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-13T11:34:43.580 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-13T11:34:43.580 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.580 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.580 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.580 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.581 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.581 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.581 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.581 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.581 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.581 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.581 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.581 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.581 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.582 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.582 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.582 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.582 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.582 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.582 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.582 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.582 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.582 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.583 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.583 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.583 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.583 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.583 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.583 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.583 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.583 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.583 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.584 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.584 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.584 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.584 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.584 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.584 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.584 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.584 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.584 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.585 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.585 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.585 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.585 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.585 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.585 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.585 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.585 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.586 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.586 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.586 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.586 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.586 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.586 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.586 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.586 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.586 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.587 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.587 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.587 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.587 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.587 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.587 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.587 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.587 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.587 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.588 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.588 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.588 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.588 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.588 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.588 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.588 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.588 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-06-13T11:34:43.588 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-06-13T11:34:43.589 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:43.589 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.589 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.589 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T11:34:43.589 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.589 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.589 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.589 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-13T11:34:43.589 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.590 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.590 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.590 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.590 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-06-13T11:34:43.590 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-06-13T11:34:43.590 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.590 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.590 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.590 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-06-13T11:34:43.591 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.591 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.591 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.591 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-06-13T11:34:43.591 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-06-13T11:34:43.591 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-06-13T11:34:43.591 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-06-13T11:34:43.591 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-06-13T11:34:43.592 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.592 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-06-13T11:34:43.592 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.592 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.592 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.592 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.592 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-06-13T11:34:43.592 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-06-13T11:34:43.592 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.593 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.593 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.593 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.593 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.593 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.593 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.593 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-13T11:34:43.593 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.593 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.594 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.594 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.594 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T11:34:43.594 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T11:34:43.594 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.594 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.594 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.594 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T11:34:43.595 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.595 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.595 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.595 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-13T11:34:43.595 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.595 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.595 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.595 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.595 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-06-13T11:34:43.596 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-06-13T11:34:43.596 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.596 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.596 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.596 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T11:34:43.596 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T11:34:43.596 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.596 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.596 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-13T11:34:43.597 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-13T11:34:43.597 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.597 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.597 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.597 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-06-13T11:34:43.597 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-06-13T11:34:43.597 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T11:34:43.597 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.598 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.598 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:43.598 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.598 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.598 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.598 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-13T11:34:43.598 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.598 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.599 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.599 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.599 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.599 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.599 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.599 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-06-13T11:34:43.599 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.599 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.600 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.600 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-06-13T11:34:43.600 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-06-13T11:34:43.600 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:43.600 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.600 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.600 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-06-13T11:34:43.600 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.600 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.601 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.601 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-13T11:34:43.601 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.601 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.601 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.601 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.601 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-06-13T11:34:43.601 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-06-13T11:34:43.601 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.602 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.602 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.602 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-06-13T11:34:43.602 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.602 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.602 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.602 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-13T11:34:43.602 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.603 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.603 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.603 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.603 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-06-13T11:34:43.603 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-06-13T11:34:43.603 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.603 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.603 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.603 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-06-13T11:34:43.604 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.604 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.604 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.604 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-13T11:34:43.604 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.604 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.604 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.604 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.604 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-06-13T11:34:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-06-13T11:34:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-13T11:34:43.606 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-13T11:34:43.606 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.606 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.606 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.606 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-06-13T11:34:43.606 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-06-13T11:34:43.606 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.606 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.607 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.607 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T11:34:43.607 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.607 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.607 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.607 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-13T11:34:43.607 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.608 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.608 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.608 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.608 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-06-13T11:34:43.608 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-06-13T11:34:43.608 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:43.608 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.608 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.608 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-06-13T11:34:43.609 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.609 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.609 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.609 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-13T11:34:43.609 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.609 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.609 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.609 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.610 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-06-13T11:34:43.610 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-06-13T11:34:43.610 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.610 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.610 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.610 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.610 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.610 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.611 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.611 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-06-13T11:34:43.611 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-06-13T11:34:43.611 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-06-13T11:34:43.611 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.611 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-13T11:34:43.611 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.611 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.612 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.612 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.612 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-06-13T11:34:43.612 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-06-13T11:34:43.612 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.612 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.612 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.612 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.613 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.613 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.613 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.613 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-13T11:34:43.613 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.613 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.613 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.613 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.613 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-06-13T11:34:43.614 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-06-13T11:34:43.614 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.614 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.614 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.614 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.614 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.614 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.615 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.615 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-13T11:34:43.615 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.615 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.615 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.615 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.615 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-06-13T11:34:43.615 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-06-13T11:34:43.616 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.616 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.616 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.616 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.616 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.616 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.616 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.616 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-13T11:34:43.617 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.617 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.617 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.617 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.617 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-06-13T11:34:43.617 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-06-13T11:34:43.617 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.617 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.618 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.618 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-13T11:34:43.618 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.618 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.618 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.618 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T11:34:43.618 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.618 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.619 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.619 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.619 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-06-13T11:34:43.619 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-06-13T11:34:43.619 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.619 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.619 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.619 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-13T11:34:43.620 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.620 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.620 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.620 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-06-13T11:34:43.620 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.620 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.620 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.620 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.621 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-06-13T11:34:43.621 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-06-13T11:34:43.621 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.621 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.621 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.621 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-13T11:34:43.621 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.621 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.622 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.622 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-06-13T11:34:43.622 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.622 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.622 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.622 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-06-13T11:34:43.622 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-06-13T11:34:43.622 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.623 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.623 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.623 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-13T11:34:43.623 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.623 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.623 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.623 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T11:34:43.623 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.624 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.624 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.624 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-06-13T11:34:43.624 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-06-13T11:34:43.624 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.624 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.624 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.624 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-13T11:34:43.625 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.625 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.625 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.625 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-06-13T11:34:43.625 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.625 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.625 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.625 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.626 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-06-13T11:34:43.626 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-06-13T11:34:43.626 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.626 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.626 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.626 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-13T11:34:43.626 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.626 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.627 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.627 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-06-13T11:34:43.627 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.627 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.627 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.627 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.627 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-06-13T11:34:43.627 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-06-13T11:34:43.628 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.628 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.628 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.628 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-13T11:34:43.628 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.628 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.628 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.628 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-06-13T11:34:43.628 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.629 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.629 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.629 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.629 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-06-13T11:34:43.629 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-06-13T11:34:43.629 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.629 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.629 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.630 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-13T11:34:43.630 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.630 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.630 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.630 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-06-13T11:34:43.630 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.630 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.630 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.631 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.631 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-06-13T11:34:43.631 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-06-13T11:34:43.631 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.631 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.631 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.631 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-13T11:34:43.631 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.631 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.632 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.632 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-06-13T11:34:43.632 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.632 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.632 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.632 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.632 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-06-13T11:34:43.632 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-06-13T11:34:43.632 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.633 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.633 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.633 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-13T11:34:43.633 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.633 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.633 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.633 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-06-13T11:34:43.633 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.633 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.634 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.634 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.634 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-06-13T11:34:43.634 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-06-13T11:34:43.634 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.634 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.634 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.634 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-13T11:34:43.635 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.635 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.635 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.635 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T11:34:43.635 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.635 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.635 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.635 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.635 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-06-13T11:34:43.635 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-06-13T11:34:43.636 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.636 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.636 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.636 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-13T11:34:43.636 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.636 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.636 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.636 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-06-13T11:34:43.637 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.637 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.637 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.637 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.637 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-06-13T11:34:43.637 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-06-13T11:34:43.637 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.637 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.637 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.638 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-13T11:34:43.638 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.638 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.638 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.638 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T11:34:43.638 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.638 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.638 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.639 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.639 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-06-13T11:34:43.639 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-06-13T11:34:43.639 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.639 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.639 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.639 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-13T11:34:43.639 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.640 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.640 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.640 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-06-13T11:34:43.640 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.640 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.640 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.640 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.640 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-06-13T11:34:43.640 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-06-13T11:34:43.641 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.641 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.641 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.641 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-13T11:34:43.641 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.641 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.641 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.641 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-06-13T11:34:43.642 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.642 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.642 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.642 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.642 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-06-13T11:34:43.642 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-06-13T11:34:43.642 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.642 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.642 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.643 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-13T11:34:43.643 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.643 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.643 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.643 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-06-13T11:34:43.643 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.643 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.643 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.643 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.644 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-06-13T11:34:43.644 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-06-13T11:34:43.644 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.644 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.644 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.644 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.644 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.644 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.645 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.645 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-06-13T11:34:43.645 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.645 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.645 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.645 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.645 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-06-13T11:34:43.645 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-06-13T11:34:43.646 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.646 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.646 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.646 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T11:34:43.646 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.646 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.646 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.646 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-13T11:34:43.646 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.647 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.647 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.647 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.647 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-06-13T11:34:43.647 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-06-13T11:34:43.647 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.647 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.647 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.647 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-06-13T11:34:43.648 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.648 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.648 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.648 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-13T11:34:43.648 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.648 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.648 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.648 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.649 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-06-13T11:34:43.649 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-06-13T11:34:43.649 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.649 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.649 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.649 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-06-13T11:34:43.649 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.649 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.650 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.650 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-13T11:34:43.650 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.650 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.650 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.650 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.650 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-06-13T11:34:43.650 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-06-13T11:34:43.651 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.651 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.651 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.651 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-06-13T11:34:43.651 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.651 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.651 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.651 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-06-13T11:34:43.652 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.652 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.652 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.652 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.652 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-06-13T11:34:43.652 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-06-13T11:34:43.652 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.652 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.653 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.653 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.653 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.653 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.653 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.653 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-13T11:34:43.653 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.653 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.654 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.654 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.654 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-06-13T11:34:43.654 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-06-13T11:34:43.654 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.654 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.654 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.654 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T11:34:43.654 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.655 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.655 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.655 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-06-13T11:34:43.655 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.655 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.655 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.655 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.655 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-06-13T11:34:43.655 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-06-13T11:34:43.656 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.656 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.656 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.656 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-13T11:34:43.656 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.656 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.656 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.656 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-13T11:34:43.656 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.657 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.657 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.657 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.657 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-06-13T11:34:43.657 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-06-13T11:34:43.657 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.657 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.657 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.657 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T11:34:43.658 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.658 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.658 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.658 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-06-13T11:34:43.658 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.658 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.658 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.658 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.659 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-06-13T11:34:43.659 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-06-13T11:34:43.659 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.659 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.659 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.659 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.659 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.659 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.659 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.660 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-13T11:34:43.660 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.660 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.660 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.660 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.660 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-06-13T11:34:43.660 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-06-13T11:34:43.660 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.661 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.661 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.661 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.661 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.661 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.661 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.661 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-13T11:34:43.661 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.662 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.662 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.662 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.662 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.662 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.662 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.662 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.662 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.662 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.663 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.663 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.663 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.663 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.663 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.663 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.663 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.663 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.664 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.664 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.664 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.664 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.664 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.664 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.664 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-06-13T11:34:43.665 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-06-13T11:34:43.665 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.665 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.665 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.665 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.665 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.665 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.665 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.665 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-13T11:34:43.666 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.666 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.666 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.666 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.666 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.666 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.666 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.666 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-13T11:34:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.667 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.668 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.668 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.668 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.668 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.668 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.668 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.668 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.668 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.669 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.669 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.669 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.669 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.669 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.669 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.669 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.669 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.669 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.670 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.670 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.670 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.670 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.670 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.670 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.670 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.670 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.671 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.671 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.671 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.671 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.671 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.671 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.671 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.671 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.672 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.672 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.672 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.672 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-13T11:34:43.672 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-13T11:34:43.672 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.672 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.672 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.673 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.673 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.673 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.673 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.673 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-13T11:34:43.673 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.673 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.673 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.674 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.674 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-13T11:34:43.674 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-13T11:34:43.674 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.674 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.674 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.674 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-06-13T11:34:43.674 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.674 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.675 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.675 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-13T11:34:43.675 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.675 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.675 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.675 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-06-13T11:34:43.675 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-06-13T11:34:43.676 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.676 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.676 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.676 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:43.676 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.676 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.676 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.676 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-06-13T11:34:43.676 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.677 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.677 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.677 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-06-13T11:34:43.677 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-06-13T11:34:43.677 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.677 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.677 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.677 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:43.678 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.678 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.678 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.678 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-13T11:34:43.678 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.678 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.678 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.678 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.679 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-06-13T11:34:43.679 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-06-13T11:34:43.679 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.679 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.679 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.679 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.679 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.679 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.679 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.680 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-06-13T11:34:43.680 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.680 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.680 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.680 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.680 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-06-13T11:34:43.680 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-06-13T11:34:43.680 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.680 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.681 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.681 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-06-13T11:34:43.681 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.681 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.681 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.681 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-06-13T11:34:43.681 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-06-13T11:34:43.681 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.681 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-06-13T11:34:43.682 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.682 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.682 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.682 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.682 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-06-13T11:34:43.682 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-06-13T11:34:43.682 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.682 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.683 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.683 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-06-13T11:34:43.683 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.683 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.683 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.683 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-13T11:34:43.683 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.683 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.683 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.683 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.684 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-06-13T11:34:43.684 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-06-13T11:34:43.684 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.684 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.684 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.684 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-13T11:34:43.684 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.684 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.685 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.685 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-13T11:34:43.685 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.685 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.685 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.685 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.685 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-06-13T11:34:43.685 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-06-13T11:34:43.686 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.686 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.686 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.686 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.686 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.686 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.686 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.686 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-13T11:34:43.687 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.687 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.687 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.687 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.687 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-06-13T11:34:43.687 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-06-13T11:34:43.687 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.687 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.687 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.687 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.688 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.688 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.688 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.688 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-13T11:34:43.688 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.688 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.688 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.688 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.688 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-06-13T11:34:43.689 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-06-13T11:34:43.689 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.689 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.689 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.689 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.689 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.689 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.689 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.689 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-13T11:34:43.690 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.690 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.690 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.690 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.690 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-06-13T11:34:43.690 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-06-13T11:34:43.690 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.690 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.691 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.691 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.691 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.691 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.691 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.691 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-13T11:34:43.691 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.691 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.691 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.692 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.692 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-06-13T11:34:43.692 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-06-13T11:34:43.692 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.692 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.692 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.692 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.692 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.693 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.693 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.693 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-13T11:34:43.693 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.693 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.693 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.693 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.693 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-06-13T11:34:43.694 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-06-13T11:34:43.694 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.694 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.694 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.694 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-06-13T11:34:43.694 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.694 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.694 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.695 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-06-13T11:34:43.695 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.695 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.695 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.695 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.695 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-06-13T11:34:43.695 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-06-13T11:34:43.695 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.695 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.696 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.696 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.696 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.696 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.696 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.696 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-13T11:34:43.696 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.696 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.697 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.697 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.697 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-06-13T11:34:43.697 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-06-13T11:34:43.697 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.697 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.697 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.697 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.697 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.698 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.698 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.698 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-13T11:34:43.698 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.698 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.698 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.698 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.698 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-06-13T11:34:43.699 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-06-13T11:34:43.699 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.699 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.699 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.699 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.699 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.699 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.699 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.699 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-13T11:34:43.699 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.700 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.700 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.700 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.700 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-06-13T11:34:43.700 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-06-13T11:34:43.700 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.700 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.700 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.701 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.701 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.701 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.701 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.701 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-06-13T11:34:43.701 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.701 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.701 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.701 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.702 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-06-13T11:34:43.702 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-06-13T11:34:43.702 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.702 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.702 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.702 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.702 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.702 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.703 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.703 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-13T11:34:43.703 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.703 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.703 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.703 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-06-13T11:34:43.703 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-06-13T11:34:43.704 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.704 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.704 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.704 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.704 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.704 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.704 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.704 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-13T11:34:43.704 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.705 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.705 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.705 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.705 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.705 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.705 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.705 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-06-13T11:34:43.705 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.705 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.706 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.706 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.706 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.706 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.706 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.706 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.706 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.706 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.707 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.707 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.707 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.707 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.707 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.707 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.707 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.707 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.707 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.708 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.708 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.708 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.708 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.708 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.708 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.708 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.708 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.708 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.709 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.709 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.709 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.709 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.709 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.709 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.709 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.709 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.709 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.710 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.710 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.710 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.710 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.710 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.710 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.710 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.710 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.711 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.711 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.711 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.711 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.711 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.711 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.711 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.711 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.711 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.712 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.712 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.712 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.712 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.712 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.712 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.712 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.712 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.712 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.713 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.713 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.713 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.713 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.713 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.713 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.713 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.713 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.714 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.714 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.714 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-06-13T11:34:43.714 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-06-13T11:34:43.714 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.714 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.714 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.715 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-06-13T11:34:43.715 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.715 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.715 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.715 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-13T11:34:43.715 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.716 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.716 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.716 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.716 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-06-13T11:34:43.716 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-06-13T11:34:43.716 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.716 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.716 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.716 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-06-13T11:34:43.717 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.717 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.717 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.717 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-13T11:34:43.717 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.717 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.717 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.717 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.718 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.718 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.718 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.718 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-06-13T11:34:43.718 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.718 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.718 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.718 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-13T11:34:43.719 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-13T11:34:43.719 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.719 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.719 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.719 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:43.719 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.719 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.719 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.720 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.720 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.720 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.720 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.720 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.720 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-06-13T11:34:43.720 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-13T11:34:43.720 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.721 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.721 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.721 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.721 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.721 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.721 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.721 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.721 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.722 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.722 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.722 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.722 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-13T11:34:43.722 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-13T11:34:43.722 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.722 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.722 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.723 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.723 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.723 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.723 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.723 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.723 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.723 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.723 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.723 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.724 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-06-13T11:34:43.724 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-06-13T11:34:43.724 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.724 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.724 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.724 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.724 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.724 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.724 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.724 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.725 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.725 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.725 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.725 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.725 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-13T11:34:43.725 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-13T11:34:43.725 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.725 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.725 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.726 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.726 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.726 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.726 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.726 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.726 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.726 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.726 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.727 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.727 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-06-13T11:34:43.727 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-13T11:34:43.727 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.727 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.727 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.727 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.727 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.728 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.728 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.728 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.728 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.728 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.728 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.728 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.728 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-13T11:34:43.728 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-13T11:34:43.729 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.729 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.729 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.729 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.729 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.729 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.729 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.729 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.730 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.730 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.730 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.730 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.730 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-13T11:34:43.730 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-13T11:34:43.730 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.731 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.731 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.731 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.731 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.731 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.731 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.731 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.731 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.731 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.732 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.732 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.732 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-13T11:34:43.732 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-13T11:34:43.732 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.732 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.732 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.732 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.733 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.733 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.733 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.733 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.733 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.733 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.733 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.733 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.734 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-13T11:34:43.734 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-13T11:34:43.734 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.734 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.734 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.734 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.734 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.734 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.734 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.735 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.735 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.735 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.735 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.735 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.735 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-13T11:34:43.735 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-13T11:34:43.735 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.736 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.736 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.736 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.736 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.736 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.736 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.736 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.736 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.736 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.737 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.737 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.737 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-13T11:34:43.737 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-13T11:34:43.737 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.737 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.737 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.737 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.738 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.738 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.738 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.738 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.738 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.738 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.738 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.738 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.739 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-13T11:34:43.739 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-13T11:34:43.739 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.739 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.739 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.739 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.739 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.739 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.739 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.740 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.740 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.740 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.740 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.740 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.740 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-13T11:34:43.740 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-13T11:34:43.740 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.741 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.741 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.741 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.741 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.741 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.741 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.741 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.741 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.741 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.742 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.742 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.742 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-06-13T11:34:43.742 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-13T11:34:43.742 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.742 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.742 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.742 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T11:34:43.742 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.743 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.743 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.743 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.743 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.743 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.743 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.743 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.743 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-13T11:34:43.744 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-13T11:34:43.744 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.744 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.744 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.744 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.744 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.744 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.744 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.744 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.745 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.745 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.745 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.745 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.745 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-06-13T11:34:43.745 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-06-13T11:34:43.745 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.745 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.745 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.746 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.746 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.746 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.746 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.746 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.746 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.746 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.746 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-06-13T11:34:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-13T11:34:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T11:34:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.748 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.748 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.748 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.748 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.748 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.748 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.748 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-13T11:34:43.748 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-13T11:34:43.748 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.749 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.749 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.749 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.749 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.749 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.749 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.749 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.749 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.749 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.750 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.750 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.750 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-13T11:34:43.750 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-13T11:34:43.750 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.750 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.750 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.750 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.751 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.751 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.751 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.751 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.751 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.751 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.751 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.751 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.751 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-13T11:34:43.751 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-13T11:34:43.752 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.752 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.752 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.752 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.752 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.752 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.752 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.752 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.752 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.753 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.753 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.753 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.753 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-13T11:34:43.753 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-13T11:34:43.753 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.753 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.753 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.754 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.754 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.754 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.754 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.754 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.754 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.754 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.754 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.755 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.755 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-06-13T11:34:43.755 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-13T11:34:43.755 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.755 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.755 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.755 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.755 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.756 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.756 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.756 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.756 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.756 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.756 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.756 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.756 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-13T11:34:43.756 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-13T11:34:43.757 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.757 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.757 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.757 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.757 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.757 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.757 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.757 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.758 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.758 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.758 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.758 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.758 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-13T11:34:43.758 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-13T11:34:43.758 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.758 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.759 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.759 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.759 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.759 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.759 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.759 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.759 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.759 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.759 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.760 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.760 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-13T11:34:43.760 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-13T11:34:43.760 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.760 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.760 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.760 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.760 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.761 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.761 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.761 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.761 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.761 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.761 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.761 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.761 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-13T11:34:43.762 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-13T11:34:43.762 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.762 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.762 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.762 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.762 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.762 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.762 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.763 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.763 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.763 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.763 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.763 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-13T11:34:43.763 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-13T11:34:43.763 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.763 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.764 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.764 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.764 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.764 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.764 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.764 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.764 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.764 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.765 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.765 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.765 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-13T11:34:43.765 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-13T11:34:43.765 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.765 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.765 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.765 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.765 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.766 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.766 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.766 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.766 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.766 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.766 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.766 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.766 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-13T11:34:43.767 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-13T11:34:43.767 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.767 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.767 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.767 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.767 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.767 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.767 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.767 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.768 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.768 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.768 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.768 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.768 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-13T11:34:43.768 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-13T11:34:43.768 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.768 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.769 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.769 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.769 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.769 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.769 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.769 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.769 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.769 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.769 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.770 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.770 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-06-13T11:34:43.770 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-13T11:34:43.770 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.770 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.770 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.770 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.770 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.771 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.771 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.771 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.771 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.771 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.771 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.771 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.771 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-13T11:34:43.772 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-13T11:34:43.772 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.772 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.772 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.772 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-13T11:34:43.772 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.772 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.772 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.773 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.773 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.773 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.773 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.773 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.773 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-13T11:34:43.773 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-13T11:34:43.773 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.774 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.774 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.774 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:43.774 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.774 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.774 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.774 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.774 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.774 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.777 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.778 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.778 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-13T11:34:43.778 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-13T11:34:43.778 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.778 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.778 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.778 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-06-13T11:34:43.779 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.779 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.779 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.779 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.779 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.779 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.779 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.779 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.779 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-13T11:34:43.780 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-13T11:34:43.780 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.780 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.780 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.780 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-06-13T11:34:43.780 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.780 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.780 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.780 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.781 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.781 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.781 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.781 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.781 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-06-13T11:34:43.781 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-13T11:34:43.781 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.781 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.781 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.782 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.782 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.782 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.782 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.782 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.782 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.782 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.782 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.783 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.783 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-13T11:34:43.783 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-13T11:34:43.783 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.783 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.783 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.783 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T11:34:43.783 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.783 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.784 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.784 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.784 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.784 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.784 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.784 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.784 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-06-13T11:34:43.784 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-13T11:34:43.785 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.785 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.785 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.785 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.785 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.785 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.785 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.785 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.785 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.786 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.786 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.786 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.786 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-06-13T11:34:43.786 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-13T11:34:43.786 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.786 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.786 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.787 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.787 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.787 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.787 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.787 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.787 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.787 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.787 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.787 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.788 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-13T11:34:43.788 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-13T11:34:43.788 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.788 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.788 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.788 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T11:34:43.788 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.788 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.788 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.789 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.789 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.789 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.789 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.789 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.789 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-13T11:34:43.789 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-13T11:34:43.789 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.789 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.790 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.790 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:43.790 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.790 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.790 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.790 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.790 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.790 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.791 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.791 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.791 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-13T11:34:43.791 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-13T11:34:43.791 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.791 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.791 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.791 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T11:34:43.791 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.792 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.792 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.792 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.792 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.792 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.792 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.792 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.792 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-06-13T11:34:43.792 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-06-13T11:34:43.793 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.793 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.793 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.793 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.793 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.793 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.793 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.793 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.793 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.794 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.794 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.794 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.794 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-06-13T11:34:43.794 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-06-13T11:34:43.794 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.794 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.794 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.794 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.795 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.795 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.795 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.795 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.795 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.795 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.795 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.795 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.796 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-06-13T11:34:43.796 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-06-13T11:34:43.796 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.796 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.796 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.796 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.796 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.796 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.797 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.797 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-06-13T11:34:43.797 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.797 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.797 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.797 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.797 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-06-13T11:34:43.797 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-06-13T11:34:43.798 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.798 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.798 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.798 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-06-13T11:34:43.798 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.798 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.798 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.798 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.798 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.799 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.799 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.799 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.799 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-06-13T11:34:43.799 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-06-13T11:34:43.799 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.799 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.799 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.800 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.800 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.800 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.800 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.800 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.800 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.800 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.800 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.801 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.801 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.801 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.801 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.801 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.801 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.801 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.801 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.801 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.802 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.802 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.802 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.802 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.802 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.802 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.802 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.803 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.803 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.803 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.803 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.803 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.803 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.803 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.803 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.804 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.804 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.804 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.804 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.804 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.804 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.804 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.804 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.805 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.805 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.805 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.805 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.805 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.805 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.805 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.805 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.806 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.806 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.806 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.806 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.806 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.806 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.806 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.806 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.807 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.807 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.807 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.807 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.807 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.807 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.807 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.807 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.808 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.808 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.808 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.808 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.808 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.808 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.808 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.808 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.809 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.809 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.809 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.809 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.809 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.809 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-06-13T11:34:43.809 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-06-13T11:34:43.809 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.810 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.810 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.810 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.810 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.810 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.810 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.810 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-06-13T11:34:43.810 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.811 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.811 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.811 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.811 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-06-13T11:34:43.811 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-06-13T11:34:43.811 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.811 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.811 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.811 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.812 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.812 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.812 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.812 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.812 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.812 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.812 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.812 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.812 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T11:34:43.812 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T11:34:43.813 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.813 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.813 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.813 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-06-13T11:34:43.813 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.813 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.813 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.813 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.813 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.814 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.814 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.814 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.814 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T11:34:43.814 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T11:34:43.814 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.814 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.814 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.815 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-06-13T11:34:43.815 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.815 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.815 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.815 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.815 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.816 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.816 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.816 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.816 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-06-13T11:34:43.816 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-06-13T11:34:43.816 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.816 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.816 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.816 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.817 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.817 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.817 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.817 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.817 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.817 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.817 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.817 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.817 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-06-13T11:34:43.818 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-06-13T11:34:43.818 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.818 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.818 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.818 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-06-13T11:34:43.818 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.819 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.819 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.819 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.819 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.819 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.819 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.819 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.820 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-06-13T11:34:43.820 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-06-13T11:34:43.820 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.820 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.820 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.820 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-06-13T11:34:43.820 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.821 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.821 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.821 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.821 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-06-13T11:34:43.821 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.821 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.821 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.821 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.821 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.822 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.822 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-06-13T11:34:43.822 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-06-13T11:34:43.822 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.822 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.822 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.822 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-06-13T11:34:43.823 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-06-13T11:34:43.823 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-06-13T11:34:43.823 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.823 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.823 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.823 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.823 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.824 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-06-13T11:34:43.824 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-06-13T11:34:43.824 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.824 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.824 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.824 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.824 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.824 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.825 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.825 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.825 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.825 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.825 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.825 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.825 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.825 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.826 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.826 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-06-13T11:34:43.826 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.826 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.826 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.826 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-06-13T11:34:43.826 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-06-13T11:34:43.826 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.826 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.827 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.827 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.827 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.827 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.827 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.827 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-06-13T11:34:43.827 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.828 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.828 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.828 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.828 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.828 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.828 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.828 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.828 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.829 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.829 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.829 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.829 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.829 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.829 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.829 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.829 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.830 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.830 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.830 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.830 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.830 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.830 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.830 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.830 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.831 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.831 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.831 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.831 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.831 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.831 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.831 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.831 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.831 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.832 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.832 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.832 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.832 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.832 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.832 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.832 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.832 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.833 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.833 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.833 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.833 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.833 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.833 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.833 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.833 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.833 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.834 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.834 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.834 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.834 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.834 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.834 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.834 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.834 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.834 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.835 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.835 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.835 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.835 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.835 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.835 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.835 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.835 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.835 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.836 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.836 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.836 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.836 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.836 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-06-13T11:34:43.836 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-06-13T11:34:43.836 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.836 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.836 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.837 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-06-13T11:34:43.837 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.837 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.837 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.837 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-13T11:34:43.837 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.837 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.837 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.838 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-06-13T11:34:43.838 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-06-13T11:34:43.838 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.838 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.838 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.838 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-06-13T11:34:43.838 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.838 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.838 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.839 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-13T11:34:43.839 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.839 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.839 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.839 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.839 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-06-13T11:34:43.839 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-06-13T11:34:43.839 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.839 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.840 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.840 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-06-13T11:34:43.840 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.840 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.840 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.840 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-06-13T11:34:43.840 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.840 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.841 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.841 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-06-13T11:34:43.841 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-06-13T11:34:43.841 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.841 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.841 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.841 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-06-13T11:34:43.842 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.842 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.842 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.842 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-13T11:34:43.842 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.842 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.842 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.842 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.843 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-06-13T11:34:43.843 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-06-13T11:34:43.843 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.843 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.843 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.843 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:43.843 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.843 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.843 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.844 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-13T11:34:43.844 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.844 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.844 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.844 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.844 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T11:34:43.844 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T11:34:43.844 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.845 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.845 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.845 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T11:34:43.845 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.845 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.845 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.845 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-06-13T11:34:43.845 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.845 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.846 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.846 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.846 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-06-13T11:34:43.846 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-06-13T11:34:43.846 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.846 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.846 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.846 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-06-13T11:34:43.846 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.847 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.847 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.847 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-13T11:34:43.847 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.847 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.847 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.847 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.847 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.848 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.848 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.848 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-06-13T11:34:43.848 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.848 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.848 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.848 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.848 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.848 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.849 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.849 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.849 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.849 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.849 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.849 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.849 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.849 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.849 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.850 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.850 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.850 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.850 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.850 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.850 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.850 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.850 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.850 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.851 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.851 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.851 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.851 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.851 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.851 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.851 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.851 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.852 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.852 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.852 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.852 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.852 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.852 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.852 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.852 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.852 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.853 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.853 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.853 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.853 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.853 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.853 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.853 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.853 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.854 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.854 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.854 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.854 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.854 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.854 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.854 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.854 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.855 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.855 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.855 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.855 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.855 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.855 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.855 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.855 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.855 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.856 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.856 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.856 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.856 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.856 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.856 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.856 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-06-13T11:34:43.857 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-06-13T11:34:43.857 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.857 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.857 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.857 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-06-13T11:34:43.857 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.858 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.858 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.858 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.858 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.858 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.858 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.858 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.858 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-06-13T11:34:43.859 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-06-13T11:34:43.859 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.859 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.859 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.859 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-06-13T11:34:43.859 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.859 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.859 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.860 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.860 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.860 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.860 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.860 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.860 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T11:34:43.860 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T11:34:43.860 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.861 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.861 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.861 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T11:34:43.861 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.861 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.861 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.861 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.861 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.862 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.862 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.862 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.862 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.862 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.862 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.862 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-06-13T11:34:43.862 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-06-13T11:34:43.862 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-06-13T11:34:43.863 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.863 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-06-13T11:34:43.863 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-06-13T11:34:43.863 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.863 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.863 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.863 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-06-13T11:34:43.863 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.863 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.864 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.864 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-13T11:34:43.864 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.864 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.864 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.864 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.864 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-06-13T11:34:43.864 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-06-13T11:34:43.864 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.864 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.865 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.865 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-06-13T11:34:43.865 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.865 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.865 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.865 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-13T11:34:43.865 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.865 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.865 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.866 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-06-13T11:34:43.866 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-06-13T11:34:43.866 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.866 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.866 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.866 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.866 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.866 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.867 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.867 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-06-13T11:34:43.867 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.867 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.867 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.867 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.867 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T11:34:43.867 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T11:34:43.867 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:43.868 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.868 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.868 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-06-13T11:34:43.868 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-06-13T11:34:43.868 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.868 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.868 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-13T11:34:43.868 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.868 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.869 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.869 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.869 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.869 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.869 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.869 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.869 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.869 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.870 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.870 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.870 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.870 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.870 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.870 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.870 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.870 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.870 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.871 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.871 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.871 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.871 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.871 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.871 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.871 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.871 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.871 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.872 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.872 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.872 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.872 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.872 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.872 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.872 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.872 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.872 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.873 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.873 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.873 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.873 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.873 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.873 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.873 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.873 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.874 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.874 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.874 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.874 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.874 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.874 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.874 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.874 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.875 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.875 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.875 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.875 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.875 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.875 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.875 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.875 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.876 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.876 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.876 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.876 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.876 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.876 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.876 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.876 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.877 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.877 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.877 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.877 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.877 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.877 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-06-13T11:34:43.877 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-06-13T11:34:43.877 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.877 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.878 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.878 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.878 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.878 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.878 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.878 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-06-13T11:34:43.878 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.878 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.878 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.879 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.879 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-06-13T11:34:43.879 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-06-13T11:34:43.879 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.879 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.879 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.879 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-06-13T11:34:43.879 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.879 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.880 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.880 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-06-13T11:34:43.880 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.880 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.880 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.880 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.880 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-06-13T11:34:43.880 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-06-13T11:34:43.880 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-06-13T11:34:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-13T11:34:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.881 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-06-13T11:34:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-06-13T11:34:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T11:34:43.882 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T11:34:43.883 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-06-13T11:34:43.883 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.883 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-13T11:34:43.883 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.883 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.883 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.883 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.883 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-06-13T11:34:43.883 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-06-13T11:34:43.884 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.884 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.884 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.884 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.884 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.884 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.884 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.884 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-06-13T11:34:43.884 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.885 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.885 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.885 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.885 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-06-13T11:34:43.885 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-06-13T11:34:43.885 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.885 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.885 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.885 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-06-13T11:34:43.886 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.886 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.886 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.886 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-13T11:34:43.886 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.886 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.886 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.886 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.886 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.887 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.887 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.887 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-06-13T11:34:43.887 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.887 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.887 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.887 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.887 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.887 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.888 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.888 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.888 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.888 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.888 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.888 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.888 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.888 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.888 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.889 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.889 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.889 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.889 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.889 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.889 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.889 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.890 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.890 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.890 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.890 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.890 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.890 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.890 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.890 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.891 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.891 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.891 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.891 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.891 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.891 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.891 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.891 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.892 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.892 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.892 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.892 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.892 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.892 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.892 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.892 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.892 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.893 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.893 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.893 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.893 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.893 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.893 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.893 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.893 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.893 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.894 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.894 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.894 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.894 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.894 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.894 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.894 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.894 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.895 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-06-13T11:34:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.896 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.897 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.898 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.899 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.900 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.901 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.903 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.904 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.905 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-06-13T11:34:43.905 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.905 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.905 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.905 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-06-13T11:34:43.905 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-06-13T11:34:43.905 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.905 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.905 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.905 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-06-13T11:34:43.906 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.906 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.906 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.906 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-13T11:34:43.906 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.906 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.906 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.907 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.907 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-06-13T11:34:43.907 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-06-13T11:34:43.907 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.907 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.907 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.907 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:43.907 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-06-13T11:34:43.907 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.908 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.908 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-13T11:34:43.908 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.908 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.908 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.908 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.908 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.908 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.909 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.909 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.909 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.909 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.909 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.909 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.909 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.909 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.909 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.910 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.910 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.910 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.910 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.910 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.910 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.910 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.911 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.911 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.911 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.911 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.911 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.911 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.911 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.912 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.912 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.912 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.912 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.912 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.912 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.912 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.912 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.913 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.913 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.913 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.913 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.913 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.913 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.913 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.913 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.914 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.914 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.914 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.914 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.914 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.914 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.914 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.914 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.915 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.915 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.915 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.915 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.915 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.915 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.915 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.916 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.916 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.916 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.916 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.916 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.916 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.916 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.916 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.917 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.917 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.917 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.917 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.917 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.917 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.917 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.917 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.917 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.918 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-06-13T11:34:43.918 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.918 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.918 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.918 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-06-13T11:34:43.918 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-06-13T11:34:43.918 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.918 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.918 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.919 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-06-13T11:34:43.919 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.919 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.919 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.919 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-06-13T11:34:43.919 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-13T11:34:43.919 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.919 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.920 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.920 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.920 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.920 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.920 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.920 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.920 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.920 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.920 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.921 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.921 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.921 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.921 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.921 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.921 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.921 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.921 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.921 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.922 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.922 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.922 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.922 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.922 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.922 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.922 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.923 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.923 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.923 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.923 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.923 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.923 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.923 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.923 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.924 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.924 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.924 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.924 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.924 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.924 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.924 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.924 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.924 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.925 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.925 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.925 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.925 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.925 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.925 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.925 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.925 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.926 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.926 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.926 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.926 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.926 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.926 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.926 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.926 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.927 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.927 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.927 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.927 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.927 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.927 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.927 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.927 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.928 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.928 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.928 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.928 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.928 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.928 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-06-13T11:34:43.928 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-06-13T11:34:43.928 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.928 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.929 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.929 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.929 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.929 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.929 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.929 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-06-13T11:34:43.929 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-13T11:34:43.929 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.930 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.930 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.930 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-06-13T11:34:43.930 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-06-13T11:34:43.930 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.930 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.930 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.930 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-06-13T11:34:43.931 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.931 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.931 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.931 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-06-13T11:34:43.931 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.931 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.931 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.931 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.932 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-06-13T11:34:43.932 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-06-13T11:34:43.932 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:43.932 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.932 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.932 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-06-13T11:34:43.932 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.932 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.932 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.932 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-06-13T11:34:43.933 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.933 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.933 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.933 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.933 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-06-13T11:34:43.933 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-06-13T11:34:43.933 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.933 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.934 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.934 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.934 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.934 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.934 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.934 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-06-13T11:34:43.934 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.934 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.935 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.935 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-06-13T11:34:43.935 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-06-13T11:34:43.935 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.935 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.935 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.935 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-06-13T11:34:43.935 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.936 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.936 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.936 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-13T11:34:43.936 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-13T11:34:43.936 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.936 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.936 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.936 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.936 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.936 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.937 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-06-13T11:34:43.937 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.937 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.937 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.937 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.937 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.937 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.937 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.937 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.938 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.938 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.938 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.938 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.938 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.938 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.938 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.938 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.939 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.939 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.939 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.939 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.939 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.939 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.939 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.939 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.940 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.940 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.940 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.940 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.940 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.940 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.940 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.940 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.941 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.941 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.941 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.941 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.941 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.941 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.941 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.941 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.942 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.942 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.942 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.942 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.942 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.942 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.942 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.942 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.943 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.943 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.943 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.943 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.943 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.943 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.943 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.943 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.944 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.944 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.944 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.944 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.944 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.944 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.944 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.944 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.944 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.945 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.945 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.945 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.945 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.945 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.945 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.945 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.946 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.946 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-06-13T11:34:43.946 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.946 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.946 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.946 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.946 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.946 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.947 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.947 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.947 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.947 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.947 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.947 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.947 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.947 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.947 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.948 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.948 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.948 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.948 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.948 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.948 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.948 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.948 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.948 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.948 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.949 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.949 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.949 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.949 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.949 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.949 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.949 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.949 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.949 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.950 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.950 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.950 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.950 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.950 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.950 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.950 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.950 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.951 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.951 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.951 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.951 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.951 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.951 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.951 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.951 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.951 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.952 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.952 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.952 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.952 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.952 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.952 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.952 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.952 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.952 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.953 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.953 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.953 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.953 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.953 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.953 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.953 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.953 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.953 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.953 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.954 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.954 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.954 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.954 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.954 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.954 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.954 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-06-13T11:34:43.954 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.954 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.955 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.955 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.955 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.955 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.955 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.955 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.955 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.955 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.955 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.956 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.956 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.956 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.956 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.956 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.956 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.956 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.956 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.956 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.957 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.957 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.957 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.957 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.957 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.957 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.957 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.957 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.958 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.958 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.958 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.958 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.958 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.958 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.958 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.958 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.958 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.959 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.959 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.959 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.959 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.959 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.959 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.959 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.960 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.960 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.960 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.960 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.960 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.960 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.960 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.960 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.961 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.961 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.961 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.961 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.961 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.961 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.961 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.961 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-06-13T11:34:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-06-13T11:34:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-06-13T11:34:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.965 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-13T11:34:43.965 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.965 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.965 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.965 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.965 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.965 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.966 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.966 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.966 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.966 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.966 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.966 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.966 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.966 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.966 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.967 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.967 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.967 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.967 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.967 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.967 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.967 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.967 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.968 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.968 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.968 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.968 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.968 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.968 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.968 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.968 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.970 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.970 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.970 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.970 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.970 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.970 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.970 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.970 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.971 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.971 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.971 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.971 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.971 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.971 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.971 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.971 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.971 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.972 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.972 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.972 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.972 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.972 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.972 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.972 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.972 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.973 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.973 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.973 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.973 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.973 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.973 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.973 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.973 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.974 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-06-13T11:34:43.974 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-06-13T11:34:43.974 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.974 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.974 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.974 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.974 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.975 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.975 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.975 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-06-13T11:34:43.975 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-06-13T11:34:43.975 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-06-13T11:34:43.975 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.975 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-06-13T11:34:43.975 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.976 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.976 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.976 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.976 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.976 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.976 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.976 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-06-13T11:34:43.976 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.976 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.977 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.977 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.977 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.977 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.977 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.977 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.977 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.977 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.978 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.978 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.978 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.978 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.978 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.978 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.978 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.978 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.978 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.979 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.979 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.979 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.979 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.979 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.979 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.979 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.979 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.980 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.980 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.980 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.980 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.980 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.980 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.980 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.980 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.980 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.981 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.981 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.981 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.981 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.981 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.981 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.981 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.981 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.982 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.982 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.982 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.982 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.982 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.982 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.982 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.982 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.982 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.983 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.983 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.983 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.983 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.983 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.983 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.983 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.983 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.984 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.984 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.984 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.984 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.984 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.984 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.984 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.984 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.984 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.985 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.985 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.985 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.985 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.985 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.985 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.985 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-06-13T11:34:43.985 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.986 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.986 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.986 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.986 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.986 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.986 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.986 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.986 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.987 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.987 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.987 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.987 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.987 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.987 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.987 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.988 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.988 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.988 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.988 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.988 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.988 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.988 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.988 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.988 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.989 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.989 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.989 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.989 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.989 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.989 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.989 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.989 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.990 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.990 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.990 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.990 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.990 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.990 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.990 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.990 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.991 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.991 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:43.991 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.991 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.991 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.991 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.991 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.992 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.992 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.992 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.992 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.992 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.992 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.992 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.992 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.992 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.993 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.993 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:43.993 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:43.993 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.993 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.993 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.993 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.993 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.993 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.994 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.994 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.994 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.994 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.994 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.994 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.994 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:43.994 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.995 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:43.995 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-06-13T11:34:43.995 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:43.995 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:43.995 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:43.995 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:43.995 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:43.995 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.995 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.996 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.996 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:43.996 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.996 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.996 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:43.996 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:43.996 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:43.996 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:43.996 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:43.997 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:43.997 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:43.997 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:43.997 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.997 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.997 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.997 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.997 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:43.998 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:43.998 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:43.998 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.998 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:43.998 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:43.998 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:43.998 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:43.998 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:43.998 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:43.999 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:43.999 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:43.999 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:43.999 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:43.999 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:43.999 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:43.999 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:43.999 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:43.999 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.000 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:44.000 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.000 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.000 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.000 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.000 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.000 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.000 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.001 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.001 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.001 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.001 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.001 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.001 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.001 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.001 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.002 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:44.002 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:44.002 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.002 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.002 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.002 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.002 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.002 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.002 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.003 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.003 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.003 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.003 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.003 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.003 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T11:34:44.003 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T11:34:44.003 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:44.004 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.004 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.004 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T11:34:44.004 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.004 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.004 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.004 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.004 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.004 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.005 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.005 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.005 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-06-13T11:34:44.005 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-06-13T11:34:44.005 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:44.005 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.005 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.005 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-06-13T11:34:44.005 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-06-13T11:34:44.006 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.006 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.006 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-06-13T11:34:44.006 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-13T11:34:44.006 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.006 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.006 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.006 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.006 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.007 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.007 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-06-13T11:34:44.007 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:44.007 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:44.007 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:44.007 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-06-13T11:34:44.007 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-06-13T11:34:44.008 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.008 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.008 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.008 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.008 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.008 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.008 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.008 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-13T11:34:44.009 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.009 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.009 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.009 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.009 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-06-13T11:34:44.009 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-06-13T11:34:44.009 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.009 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.010 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.010 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:44.010 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.010 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.010 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.010 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.010 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.010 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.011 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.011 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.011 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:44.011 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:44.011 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.011 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.011 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.011 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.012 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.012 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.012 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.012 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.012 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.012 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.012 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.012 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.012 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.013 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.013 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.013 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.013 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.013 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.013 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.013 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:44.013 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:44.014 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.014 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.014 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.014 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.014 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.014 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.014 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.014 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.014 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.015 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.015 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.015 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.015 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:44.015 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:44.015 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.015 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.016 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.016 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:44.016 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.016 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.016 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.016 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.016 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.016 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.017 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.017 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.017 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.017 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.017 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.017 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.017 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.017 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.018 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.018 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:44.018 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:44.018 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.018 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.018 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.018 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.018 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.018 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.019 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.019 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.019 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.019 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.019 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.019 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.019 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-06-13T11:34:44.019 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-06-13T11:34:44.020 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:44.020 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.020 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.020 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-06-13T11:34:44.020 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.020 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.020 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.020 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-06-13T11:34:44.021 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.021 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.021 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.021 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.021 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T11:34:44.021 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T11:34:44.021 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:44.021 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.021 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.022 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T11:34:44.022 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.022 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.022 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.022 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-06-13T11:34:44.022 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.022 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.022 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.022 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.023 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.023 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.023 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.023 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-06-13T11:34:44.023 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:44.023 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:44.023 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:44.023 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-06-13T11:34:44.023 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-06-13T11:34:44.024 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.024 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.024 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.024 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:44.024 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.024 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.024 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.025 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.025 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.025 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.025 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.025 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.025 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-06-13T11:34:44.025 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-06-13T11:34:44.025 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.026 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.026 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.026 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:44.026 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.026 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.026 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.026 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-13T11:34:44.026 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-13T11:34:44.027 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.027 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.027 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.027 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:44.027 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:44.027 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.027 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.027 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.028 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.029 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.030 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.031 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.031 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.031 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.031 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.031 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.031 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:44.031 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:44.031 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.032 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.033 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.035 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-06-13T11:34:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-06-13T11:34:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.036 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.037 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.037 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.037 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.037 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.037 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.037 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-13T11:34:44.037 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-13T11:34:44.037 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:44.037 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.038 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.038 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-06-13T11:34:44.038 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.038 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.038 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.038 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.038 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.038 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.039 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.039 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.039 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-06-13T11:34:44.039 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-06-13T11:34:44.039 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:44.039 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.039 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.039 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-06-13T11:34:44.039 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.040 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.040 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.040 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.040 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.040 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.040 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.040 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T11:34:44.041 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T11:34:44.041 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.041 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.041 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.041 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-06-13T11:34:44.041 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.041 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.042 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.042 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-13T11:34:44.042 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.042 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.042 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.042 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.042 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T11:34:44.042 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T11:34:44.043 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:44.043 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.043 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.043 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-06-13T11:34:44.043 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.043 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.043 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.043 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-13T11:34:44.043 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.044 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.044 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.044 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.044 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-06-13T11:34:44.044 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-06-13T11:34:44.044 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.044 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.044 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.045 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-06-13T11:34:44.045 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.045 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.045 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.045 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.045 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.045 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.045 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.045 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.046 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-06-13T11:34:44.046 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-06-13T11:34:44.046 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.046 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.046 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.046 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-06-13T11:34:44.046 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.046 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.047 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.047 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-06-13T11:34:44.047 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-06-13T11:34:44.047 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.047 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.047 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.047 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.047 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.047 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.048 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-06-13T11:34:44.048 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-06-13T11:34:44.048 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:44.048 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.048 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.048 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-06-13T11:34:44.048 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-06-13T11:34:44.048 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-06-13T11:34:44.049 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.049 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.049 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.049 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.049 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.049 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.049 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.049 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.049 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.050 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-06-13T11:34:44.050 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:44.050 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:44.050 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:44.050 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:44.050 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:44.050 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.050 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.051 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.051 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.051 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.051 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.051 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.051 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.051 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.051 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.052 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.052 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.052 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.052 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.052 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.052 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.052 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.052 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.053 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:44.053 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:44.053 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.053 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.053 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.053 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.053 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.053 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.053 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.054 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.054 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.054 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.054 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.054 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:44.054 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:44.054 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.055 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.055 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.055 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:44.055 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.055 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.055 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.055 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.055 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.055 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.056 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.056 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.056 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.056 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.056 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.056 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.056 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.056 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.056 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.057 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:44.057 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:44.057 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.057 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.057 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.057 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.057 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.057 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.058 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.058 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.058 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.058 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.058 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.058 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.058 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-06-13T11:34:44.058 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-06-13T11:34:44.059 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:44.059 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.059 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.059 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T11:34:44.059 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.059 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.059 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.059 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.060 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.060 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.060 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.060 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.060 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-06-13T11:34:44.060 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-06-13T11:34:44.060 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.060 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.060 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.061 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.061 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.061 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.061 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.061 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.061 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.061 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.061 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.062 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.062 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-06-13T11:34:44.062 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-06-13T11:34:44.062 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.062 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.062 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.062 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.062 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.063 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.063 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.063 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.063 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.063 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.063 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.063 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.063 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.063 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.064 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.064 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-06-13T11:34:44.064 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:44.064 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:44.064 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:44.064 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-06-13T11:34:44.064 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-06-13T11:34:44.064 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.064 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.065 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.065 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:44.065 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.065 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.065 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.065 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.065 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.065 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.065 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.066 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.066 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-06-13T11:34:44.066 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-06-13T11:34:44.066 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.066 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.066 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.066 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.066 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.066 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.067 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.067 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.067 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.067 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.067 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.067 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.067 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:44.067 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:44.067 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.068 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.068 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.068 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.068 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.068 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.068 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.068 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.068 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.069 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.069 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.069 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.069 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.069 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.069 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.069 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.069 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.069 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.070 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.070 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:44.070 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:44.070 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.070 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.070 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.070 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.070 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.071 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.071 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.071 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.071 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.071 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.071 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.071 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.071 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:44.071 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:44.072 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.072 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.072 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.072 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:44.072 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.072 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.072 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.072 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.073 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.073 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.073 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.073 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.073 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.073 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.073 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.073 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.073 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.074 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.074 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.074 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:44.074 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:44.074 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.074 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.074 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.074 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.075 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.075 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.075 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.075 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.075 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.075 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.075 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.075 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.075 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T11:34:44.076 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T11:34:44.076 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.076 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.076 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.076 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.076 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.076 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.076 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.077 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.077 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.077 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.077 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.077 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.077 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T11:34:44.077 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T11:34:44.077 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.077 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.078 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.078 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.078 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.078 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.078 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.078 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.078 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.078 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.078 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.079 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.079 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.079 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.079 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.079 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-06-13T11:34:44.079 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:44.079 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:44.079 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:44.079 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:44.080 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:44.080 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.080 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.080 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.080 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.080 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.080 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.080 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.080 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.081 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.081 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.081 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.081 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.081 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.081 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.081 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.081 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.082 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.082 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.082 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.082 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:44.082 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:44.082 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.082 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.082 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.082 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.083 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.083 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.083 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.083 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.083 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.083 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.083 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.083 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.083 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:44.084 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:44.084 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.084 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.084 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.084 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:44.084 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.084 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.084 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.084 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.085 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.085 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.085 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.085 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.085 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.085 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.085 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.085 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.085 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.086 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.086 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.086 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:44.086 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:44.086 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.086 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.086 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.086 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.087 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.087 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.087 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.087 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.087 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.087 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.087 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.087 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.087 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.088 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.088 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.088 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-06-13T11:34:44.088 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:44.088 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:44.088 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:44.088 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:44.088 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:44.088 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.089 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.089 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.089 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.089 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.089 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.089 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.089 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.089 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.090 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.090 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.090 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.090 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.090 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.090 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.090 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.090 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.090 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.091 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.091 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:44.091 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:44.091 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.091 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.091 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.091 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.091 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.092 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.092 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.092 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.092 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.092 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.092 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.092 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.092 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:44.092 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:44.093 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.093 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.093 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.093 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:44.093 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.093 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.093 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.093 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.094 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.094 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.094 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.094 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.094 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.094 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.094 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.094 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.095 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.095 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.095 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.095 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:44.095 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:44.095 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.095 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.095 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.095 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.096 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.096 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.096 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.096 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.096 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.096 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.096 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.096 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.096 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-06-13T11:34:44.097 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-06-13T11:34:44.097 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.097 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.097 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.097 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-06-13T11:34:44.097 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.097 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.097 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.097 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-13T11:34:44.098 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.098 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.098 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.098 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.098 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.098 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.098 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.098 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-06-13T11:34:44.099 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:44.099 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:44.099 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:44.099 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:44.099 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:44.099 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.099 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.099 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.100 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.100 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.100 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.100 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.100 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.100 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.100 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.100 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.100 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.101 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.101 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.101 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.101 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.101 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.101 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.101 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.101 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:44.102 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:44.102 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.102 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.102 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.102 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.102 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.102 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.102 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.103 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.103 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.103 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.103 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.103 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.103 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:44.103 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:44.103 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.103 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.104 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.104 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:44.104 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.104 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.104 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.104 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.104 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.104 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.105 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.105 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.105 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.105 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.105 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.105 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.105 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.105 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.105 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.106 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:44.106 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:44.106 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.106 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.106 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.106 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.106 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.106 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.107 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.107 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.107 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.107 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.107 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.107 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.107 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-06-13T11:34:44.107 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-06-13T11:34:44.108 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.108 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.108 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.108 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.108 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.108 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.108 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.108 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.108 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.109 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.109 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.109 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.109 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-06-13T11:34:44.109 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-06-13T11:34:44.109 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.109 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.109 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.110 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-06-13T11:34:44.110 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.110 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.110 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.110 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.110 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.110 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.110 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.111 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.111 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-06-13T11:34:44.111 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-06-13T11:34:44.111 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.111 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.111 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.111 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.111 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.112 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.112 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.112 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.112 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.112 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.112 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.112 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.112 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-06-13T11:34:44.113 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-06-13T11:34:44.113 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:44.113 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.113 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.113 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.113 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.113 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.113 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.114 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.114 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.114 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.114 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.114 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.114 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-06-13T11:34:44.114 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-06-13T11:34:44.114 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T11:34:44.115 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.115 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.115 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.115 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.115 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.115 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.115 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.115 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.115 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.116 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.116 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-06-13T11:34:44.116 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-06-13T11:34:44.116 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.117 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.117 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.117 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.117 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.117 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.117 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.117 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.117 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.118 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.118 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.118 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-06-13T11:34:44.118 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-06-13T11:34:44.118 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.118 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.119 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.119 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.119 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.119 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.119 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.119 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.119 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.119 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.120 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.120 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-06-13T11:34:44.120 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-06-13T11:34:44.120 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.120 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.120 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.120 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:44.121 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.121 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.121 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.121 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.121 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.121 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.121 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.121 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.121 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-06-13T11:34:44.122 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-06-13T11:34:44.122 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:44.122 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.122 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.122 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.122 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T11:34:44.123 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-06-13T11:34:44.123 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.123 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.123 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.123 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.123 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.123 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.124 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-06-13T11:34:44.124 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-06-13T11:34:44.124 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.124 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.124 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.124 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.124 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.124 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.125 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.125 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.125 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.125 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.125 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.125 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.125 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-06-13T11:34:44.125 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-06-13T11:34:44.126 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.126 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.126 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.126 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.126 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.126 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.126 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.126 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.127 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.127 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.127 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.127 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.127 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-06-13T11:34:44.127 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-06-13T11:34:44.127 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.127 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.127 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.128 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.128 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.128 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.128 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.128 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.128 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.128 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.128 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.128 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.129 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.129 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.129 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.130 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-06-13T11:34:44.130 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:44.130 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:44.130 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:44.130 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-06-13T11:34:44.130 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-06-13T11:34:44.130 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.131 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.131 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.131 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.131 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.131 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.131 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.131 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-06-13T11:34:44.131 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.131 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.132 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.132 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.132 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-06-13T11:34:44.132 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-06-13T11:34:44.132 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.132 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.132 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.132 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.132 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.133 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.133 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.133 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-06-13T11:34:44.133 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.133 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.133 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.134 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.134 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:44.134 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:44.134 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.134 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.134 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.134 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.135 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.135 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.135 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.135 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.135 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.135 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.135 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.135 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.136 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.136 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.136 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.136 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.136 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.136 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.136 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.137 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:44.137 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:44.137 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.137 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.137 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.137 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.137 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.137 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.137 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.138 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.138 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.138 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.138 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.138 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.138 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:44.138 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:44.138 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.139 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.139 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.139 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:44.139 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.139 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.139 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.139 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.139 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.140 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.140 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.140 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.140 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.140 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.140 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.140 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.140 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.140 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.141 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.141 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:44.141 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:44.141 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.141 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.141 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.141 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.141 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.142 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.142 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.142 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.142 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.142 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.142 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.142 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.142 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.143 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.143 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.143 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-06-13T11:34:44.143 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:44.143 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:44.143 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:44.143 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:44.143 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:44.144 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.144 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.144 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.144 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.144 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.144 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.144 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.144 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.145 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.145 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.145 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.145 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.145 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.145 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.145 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.145 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.145 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.146 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.146 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.146 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:44.146 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:44.146 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.146 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.146 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.146 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.147 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.147 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.147 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.147 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.147 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.147 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.147 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.147 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.147 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:44.148 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:44.148 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.148 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.148 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.148 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:44.148 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.148 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.148 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.148 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.149 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.149 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.149 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.149 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.149 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.149 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.149 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.149 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.150 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.150 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.150 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.150 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:44.150 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:44.150 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.150 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.150 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.150 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.151 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.151 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.151 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.151 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.151 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.151 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.151 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.151 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.151 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.151 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.152 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.152 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-06-13T11:34:44.152 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:44.152 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:44.152 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:44.152 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:44.152 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:44.152 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.152 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.153 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.153 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.153 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.153 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.153 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.153 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.153 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.153 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.153 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.154 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.154 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.154 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.154 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.154 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.154 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.154 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.154 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:44.155 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:44.155 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.155 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.155 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.155 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.155 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.155 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.155 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.155 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.156 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.156 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.156 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.156 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.156 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:44.156 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:44.156 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.156 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.156 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.157 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:44.157 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.157 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.157 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.157 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.157 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.157 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.157 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.157 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.158 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.158 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.158 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.158 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.158 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.158 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.158 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.158 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:44.159 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:44.159 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.159 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.159 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.159 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.159 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.159 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.159 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.159 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.160 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.160 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.160 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.160 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.160 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.160 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.160 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.161 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-06-13T11:34:44.161 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:44.161 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:44.161 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:44.161 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-06-13T11:34:44.161 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-06-13T11:34:44.161 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.161 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.162 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.162 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-13T11:34:44.162 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.162 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.162 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.162 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.162 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.163 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.163 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.163 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.163 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T11:34:44.163 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T11:34:44.163 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:44.163 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.163 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.163 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-06-13T11:34:44.164 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.164 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.164 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.164 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.164 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.164 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.164 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.164 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.164 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:44.164 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:44.165 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.165 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.165 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.165 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.165 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.165 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.165 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.165 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.166 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.166 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.166 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.166 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.166 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.166 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.166 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.166 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.167 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.167 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.167 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.167 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:44.167 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:44.167 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.167 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.167 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.167 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.167 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.168 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.168 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.168 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.168 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.168 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.168 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.168 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.168 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:44.169 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:44.169 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.169 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.169 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.169 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:44.169 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.169 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.169 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.170 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.170 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.170 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.170 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.170 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.170 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.170 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.170 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.171 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.171 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.171 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.171 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.171 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:44.171 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:44.171 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.171 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.172 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.172 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.172 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.172 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.172 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.172 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.172 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.172 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.172 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.173 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.173 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.173 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.173 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.173 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-06-13T11:34:44.173 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:44.173 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:44.173 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:44.173 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-06-13T11:34:44.174 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-06-13T11:34:44.174 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.174 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.174 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.174 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:44.174 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.174 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.174 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.175 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-13T11:34:44.175 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.175 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.175 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.175 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.175 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-06-13T11:34:44.175 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-06-13T11:34:44.175 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.176 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.176 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.176 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:44.176 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.176 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.176 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.176 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-13T11:34:44.176 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.177 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.177 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.177 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.177 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-06-13T11:34:44.177 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-06-13T11:34:44.178 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.178 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.178 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.178 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:44.179 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.179 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.179 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.179 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-13T11:34:44.179 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.180 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.180 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.180 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.180 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-06-13T11:34:44.180 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-06-13T11:34:44.181 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.181 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.181 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.181 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.181 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.181 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.182 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.182 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-13T11:34:44.182 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.182 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.182 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.182 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.182 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-06-13T11:34:44.182 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-06-13T11:34:44.183 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.183 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.183 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.183 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.183 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.183 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.183 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.183 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-13T11:34:44.184 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.184 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.184 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.184 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.184 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-06-13T11:34:44.184 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-06-13T11:34:44.184 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.184 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.184 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.185 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.185 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.185 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.185 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.185 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.185 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.185 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.185 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.185 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.186 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-06-13T11:34:44.186 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-06-13T11:34:44.186 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.186 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.186 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.186 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.186 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.187 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.187 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.187 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.187 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.187 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.187 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.187 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.187 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-06-13T11:34:44.187 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-06-13T11:34:44.188 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.188 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.188 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.188 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-13T11:34:44.188 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.188 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.188 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.188 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.188 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.189 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.189 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.189 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.189 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-06-13T11:34:44.189 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-06-13T11:34:44.189 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.189 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.189 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.190 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.190 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.190 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.190 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.190 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.190 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.190 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.190 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.191 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.191 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T11:34:44.191 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T11:34:44.191 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:44.191 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.191 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.191 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-06-13T11:34:44.191 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-06-13T11:34:44.191 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.192 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.192 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.192 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.192 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.192 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.192 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.192 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-06-13T11:34:44.192 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-06-13T11:34:44.192 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:44.192 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.193 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.193 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-06-13T11:34:44.193 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.193 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.193 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.193 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.193 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.193 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.193 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.194 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.194 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-06-13T11:34:44.194 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-06-13T11:34:44.194 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.194 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.194 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.194 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.194 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.194 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.195 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.195 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.195 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.195 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.195 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.195 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.195 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-06-13T11:34:44.195 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-06-13T11:34:44.196 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.196 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.196 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.196 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.196 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.196 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.196 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.196 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.197 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.197 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.197 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.197 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.197 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:44.197 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:44.197 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.197 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.198 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.198 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.198 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.198 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.198 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.198 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.198 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.198 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.199 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.199 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.199 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.199 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.199 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.199 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.199 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.199 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.199 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.200 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:44.200 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:44.200 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.200 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.200 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.200 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.200 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.200 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.200 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.201 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.201 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.201 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.201 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.201 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:44.201 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:44.201 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.201 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.202 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.202 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:44.202 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.202 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.202 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.202 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.202 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.202 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.202 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.203 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.203 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.203 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.203 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.203 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.203 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.203 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.203 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.203 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:44.204 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:44.204 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.204 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.204 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.204 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.204 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.204 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.204 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.204 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.204 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.205 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.205 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.205 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.205 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-06-13T11:34:44.205 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-06-13T11:34:44.205 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.205 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.205 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.206 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.206 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.206 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.206 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.206 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.206 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.206 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.206 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.207 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.207 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-06-13T11:34:44.207 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-06-13T11:34:44.207 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.207 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.207 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.207 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.207 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.207 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.208 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.208 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.208 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.208 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.208 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.208 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.208 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-06-13T11:34:44.208 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-06-13T11:34:44.209 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.209 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.209 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.209 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-13T11:34:44.209 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.209 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.209 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.209 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.209 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.210 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.210 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.210 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.210 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.210 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.210 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-06-13T11:34:44.210 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:44.211 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:44.211 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:44.211 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:44.211 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:44.211 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.211 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.211 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.211 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.212 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.212 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.212 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.212 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.212 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.212 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.212 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.212 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.212 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.212 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.213 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.213 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.213 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.213 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.213 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.213 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:44.213 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:44.213 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.213 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.214 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.214 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.214 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.214 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.214 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.214 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.214 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.214 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.215 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.215 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.215 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:44.215 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:44.215 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.215 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.215 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.215 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:44.216 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.216 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.216 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.216 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.216 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.216 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.216 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.217 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.217 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.217 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.217 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.217 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.217 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.217 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.217 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.218 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:44.218 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:44.218 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.218 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.218 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.218 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.218 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.218 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.218 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.219 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.219 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.219 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.219 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.219 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.219 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.219 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.219 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.219 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-06-13T11:34:44.220 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:44.220 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:44.220 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:44.220 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:44.220 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:44.220 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.220 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.220 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.220 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.221 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.221 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.221 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.221 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.221 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.221 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.221 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.221 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.222 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.222 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.222 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.222 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.222 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.222 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.222 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.222 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:44.223 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:44.223 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.223 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.223 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.223 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.223 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.223 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.223 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.223 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.224 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.224 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.224 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.224 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.224 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:44.224 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:44.224 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.224 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.225 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.225 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:44.225 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.225 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.225 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.225 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.225 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.225 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.225 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.226 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.226 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.226 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.226 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.226 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.226 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.226 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.226 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.227 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:44.227 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:44.227 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.227 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.227 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.227 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.227 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.227 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.227 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.228 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.228 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.228 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.228 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.228 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.228 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-06-13T11:34:44.228 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-06-13T11:34:44.228 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:44.229 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.229 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.229 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-06-13T11:34:44.229 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.229 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.229 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.229 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-13T11:34:44.229 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.229 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.230 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.230 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.230 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-06-13T11:34:44.230 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-06-13T11:34:44.230 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.230 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.230 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.230 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.231 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.231 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.231 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.231 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-06-13T11:34:44.231 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.231 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.231 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.231 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.232 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-06-13T11:34:44.232 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-06-13T11:34:44.232 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:44.232 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.232 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.232 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T11:34:44.232 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.232 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.232 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.233 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-13T11:34:44.233 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.233 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.233 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.233 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.233 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-06-13T11:34:44.233 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-06-13T11:34:44.233 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.234 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.234 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.234 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T11:34:44.234 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.234 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.234 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.234 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-13T11:34:44.234 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.235 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.235 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.235 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.235 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.235 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.235 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.235 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-06-13T11:34:44.235 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T11:34:44.236 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T11:34:44.236 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T11:34:44.236 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-06-13T11:34:44.236 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-06-13T11:34:44.236 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T11:34:44.236 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.236 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.236 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-06-13T11:34:44.236 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.237 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.237 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.237 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.237 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.237 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.237 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.237 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.237 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-06-13T11:34:44.238 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-06-13T11:34:44.238 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.238 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.238 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.238 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.238 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.238 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.238 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.239 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.239 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.239 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.239 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.239 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.239 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T11:34:44.239 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T11:34:44.239 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T11:34:44.239 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.240 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.240 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T11:34:44.240 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.240 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.240 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.240 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.240 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.240 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.241 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.241 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.241 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T11:34:44.241 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T11:34:44.241 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.241 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.241 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.241 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.241 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.241 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.242 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.242 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.242 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.242 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.242 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.242 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.242 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.242 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.243 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.243 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.243 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.243 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.243 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.243 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T11:34:44.243 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T11:34:44.243 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.244 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.244 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.244 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.244 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.244 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.244 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.244 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.244 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.244 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.245 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.245 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.245 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T11:34:44.245 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T11:34:44.245 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.245 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.245 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.245 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T11:34:44.245 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.246 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.246 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T11:34:44.246 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T11:34:44.246 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T11:34:44.246 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T11:34:44.246 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T11:34:44.246 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T11:34:44.246 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T11:34:44.247 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.247 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.247 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.247 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.247 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.247 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.247 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T11:34:44.247 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T11:34:44.248 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T11:34:44.248 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.248 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T11:34:44.248 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T11:34:44.248 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.248 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.248 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.248 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.248 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.249 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.249 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.249 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.249 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-06-13T11:34:44.249 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-06-13T11:34:44.249 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.249 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.249 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.250 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T11:34:44.250 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.250 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.250 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.250 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.250 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.250 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.250 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.251 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.251 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-06-13T11:34:44.251 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-06-13T11:34:44.251 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T11:34:44.251 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.251 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.251 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-06-13T11:34:44.251 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.251 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.251 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.252 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.252 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.252 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.252 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.252 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.252 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-06-13T11:34:44.252 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-06-13T11:34:44.252 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T11:34:44.252 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T11:34:44.253 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T11:34:44.253 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-13T11:34:44.253 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T11:34:44.253 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T11:34:44.253 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T11:34:44.253 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T11:34:44.253 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T11:34:44.253 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T11:34:44.253 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T11:34:44.254 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.254 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.254 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.254 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.254 INFO:teuthology.orchestra.run.smithi002.stdout: "services": { 2024-06-13T11:34:44.254 INFO:teuthology.orchestra.run.smithi002.stdout: "dashboard": "https://172.21.15.2:8443/" 2024-06-13T11:34:44.254 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.254 INFO:teuthology.orchestra.run.smithi002.stdout: "always_on_modules": { 2024-06-13T11:34:44.255 INFO:teuthology.orchestra.run.smithi002.stdout: "octopus": [ 2024-06-13T11:34:44.255 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-06-13T11:34:44.255 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-06-13T11:34:44.255 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-06-13T11:34:44.255 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-06-13T11:34:44.255 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-06-13T11:34:44.255 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-06-13T11:34:44.255 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-06-13T11:34:44.256 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-06-13T11:34:44.256 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-06-13T11:34:44.256 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-06-13T11:34:44.256 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.256 INFO:teuthology.orchestra.run.smithi002.stdout: "pacific": [ 2024-06-13T11:34:44.256 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-06-13T11:34:44.256 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-06-13T11:34:44.256 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-06-13T11:34:44.257 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-06-13T11:34:44.257 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-06-13T11:34:44.257 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-06-13T11:34:44.257 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-06-13T11:34:44.257 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-06-13T11:34:44.257 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-06-13T11:34:44.257 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-06-13T11:34:44.257 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.258 INFO:teuthology.orchestra.run.smithi002.stdout: "quincy": [ 2024-06-13T11:34:44.258 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-06-13T11:34:44.258 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-06-13T11:34:44.258 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-06-13T11:34:44.258 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-06-13T11:34:44.258 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-06-13T11:34:44.258 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-06-13T11:34:44.258 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-06-13T11:34:44.259 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-06-13T11:34:44.259 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-06-13T11:34:44.259 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-06-13T11:34:44.259 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.259 INFO:teuthology.orchestra.run.smithi002.stdout: "reef": [ 2024-06-13T11:34:44.259 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-06-13T11:34:44.259 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-06-13T11:34:44.259 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-06-13T11:34:44.260 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-06-13T11:34:44.260 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-06-13T11:34:44.260 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-06-13T11:34:44.260 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-06-13T11:34:44.260 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-06-13T11:34:44.260 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-06-13T11:34:44.260 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-06-13T11:34:44.260 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T11:34:44.260 INFO:teuthology.orchestra.run.smithi002.stdout: "squid": [ 2024-06-13T11:34:44.261 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-06-13T11:34:44.261 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-06-13T11:34:44.261 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-06-13T11:34:44.261 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-06-13T11:34:44.261 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-06-13T11:34:44.261 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-06-13T11:34:44.261 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-06-13T11:34:44.261 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-06-13T11:34:44.262 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-06-13T11:34:44.262 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-06-13T11:34:44.262 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T11:34:44.262 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.262 INFO:teuthology.orchestra.run.smithi002.stdout: "last_failure_osd_epoch": 100, 2024-06-13T11:34:44.262 INFO:teuthology.orchestra.run.smithi002.stdout: "active_clients": [ 2024-06-13T11:34:44.262 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.262 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-06-13T11:34:44.263 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-06-13T11:34:44.263 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.263 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-06-13T11:34:44.263 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-06-13T11:34:44.263 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1208256511 2024-06-13T11:34:44.263 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.263 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T11:34:44.263 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.264 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.264 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "libcephsqlite", 2024-06-13T11:34:44.264 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-06-13T11:34:44.264 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.264 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-06-13T11:34:44.264 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-06-13T11:34:44.264 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2229672504 2024-06-13T11:34:44.264 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.265 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T11:34:44.265 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.265 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.265 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-06-13T11:34:44.265 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-06-13T11:34:44.265 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.265 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-06-13T11:34:44.265 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-06-13T11:34:44.266 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1359206234 2024-06-13T11:34:44.266 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.266 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T11:34:44.266 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.266 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.266 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-06-13T11:34:44.266 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-06-13T11:34:44.266 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.267 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-06-13T11:34:44.267 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-06-13T11:34:44.267 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 58182472 2024-06-13T11:34:44.267 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.267 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T11:34:44.267 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.267 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.267 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-06-13T11:34:44.268 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-06-13T11:34:44.268 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.268 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-06-13T11:34:44.268 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-06-13T11:34:44.268 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 559597725 2024-06-13T11:34:44.268 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.268 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T11:34:44.268 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:44.268 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.269 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-06-13T11:34:44.269 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-06-13T11:34:44.269 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T11:34:44.269 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-06-13T11:34:44.269 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-06-13T11:34:44.269 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3378446266 2024-06-13T11:34:44.269 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.269 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T11:34:44.269 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:44.270 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T11:34:44.270 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:34:44.271 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:42 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1121607318' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-13T11:34:44.272 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:41 smithi178 ceph-mon[36913]: pgmap v338: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:44.272 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:41 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/423761480' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-13T11:34:44.272 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:41 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2406928221' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-13T11:34:44.272 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:42 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1121607318' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-13T11:34:44.272 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:43 smithi178 ceph-mon[36913]: pgmap v339: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:44.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:42.109+0000 7f50cdc00640 1 -- 172.21.15.2:0/1121607318 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f50ac0a2d00 msgr2=0x7f50ac0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:44.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:42.109+0000 7f50cdc00640 1 --2- 172.21.15.2:0/1121607318 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f50ac0a2d00 0x7f50ac0a51c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f50c8102d70 tx=0x7f50b4005f90 comp rx=0 tx=0).stop 2024-06-13T11:34:44.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:42.109+0000 7f50cdc00640 1 -- 172.21.15.2:0/1121607318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c8103dd0 msgr2=0x7f50c819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:34:44.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:42.109+0000 7f50cdc00640 1 --2- 172.21.15.2:0/1121607318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c8103dd0 0x7f50c819a4b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f50b8035040 tx=0x7f50b8033b60 comp rx=0 tx=0).stop 2024-06-13T11:34:44.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:42.109+0000 7f50cdc00640 1 -- 172.21.15.2:0/1121607318 shutdown_connections 2024-06-13T11:34:44.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:42.109+0000 7f50cdc00640 1 --2- 172.21.15.2:0/1121607318 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f50ac0a2d00 0x7f50ac0a51c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:44.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:42.109+0000 7f50cdc00640 1 --2- 172.21.15.2:0/1121607318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50c8108ea0 0x7f50c819a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:44.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:42.110+0000 7f50cdc00640 1 --2- 172.21.15.2:0/1121607318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c819ed70 0x7f50c819f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:44.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:42.110+0000 7f50cdc00640 1 --2- 172.21.15.2:0/1121607318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c8103dd0 0x7f50c819a4b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:34:44.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:42.110+0000 7f50cdc00640 1 -- 172.21.15.2:0/1121607318 >> 172.21.15.2:0/1121607318 conn(0x7f50c80ff650 msgr2=0x7f50c81019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:34:44.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:42.110+0000 7f50cdc00640 1 -- 172.21.15.2:0/1121607318 shutdown_connections 2024-06-13T11:34:44.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:34:42.110+0000 7f50cdc00640 1 -- 172.21.15.2:0/1121607318 wait complete. 2024-06-13T11:34:44.280 DEBUG:tasks.check_counter:Getting stats from a 2024-06-13T11:34:44.280 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph daemon mds.a perf dump 2024-06-13T11:34:44.281 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:42 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1121607318' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-13T11:34:44.281 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:43 smithi002 ceph-mon[32210]: pgmap v339: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:44.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:43 smithi077 ceph-mon[36410]: pgmap v339: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:44.759 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:34:46.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:45 smithi002 ceph-mon[32210]: pgmap v340: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:46.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:45 smithi178 ceph-mon[36913]: pgmap v340: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:46.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:45 smithi077 ceph-mon[36410]: pgmap v340: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:47.170 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:34:47.171 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T11:34:47.171 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-06-13T11:34:47.171 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-06-13T11:34:47.171 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-06-13T11:34:47.171 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-06-13T11:34:47.171 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-06-13T11:34:47.172 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-06-13T11:34:47.172 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.004646114, 2024-06-13T11:34:47.172 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-06-13T11:34:47.172 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000786643, 2024-06-13T11:34:47.172 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T11:34:47.172 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:34:47.172 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:47.172 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:47.173 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:47.173 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:47.173 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:34:47.173 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:47.173 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:47.173 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:47.173 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:47.173 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-13T11:34:47.173 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-06-13T11:34:47.174 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:47.174 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T11:34:47.174 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 277, 2024-06-13T11:34:47.174 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 264, 2024-06-13T11:34:47.174 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1598288, 2024-06-13T11:34:47.174 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 162112, 2024-06-13T11:34:47.174 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-06-13T11:34:47.174 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-06-13T11:34:47.175 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.117399154, 2024-06-13T11:34:47.175 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.042889946, 2024-06-13T11:34:47.175 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.082260215, 2024-06-13T11:34:47.175 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.012033387, 2024-06-13T11:34:47.175 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:34:47.175 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 264, 2024-06-13T11:34:47.175 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.027359206, 2024-06-13T11:34:47.175 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000103633 2024-06-13T11:34:47.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:47.176 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:34:47.176 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:47.176 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:47.176 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:47.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:47.176 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1598288, 2024-06-13T11:34:47.176 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 162112 2024-06-13T11:34:47.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:47.177 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T11:34:47.177 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 2, 2024-06-13T11:34:47.177 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 200, 2024-06-13T11:34:47.177 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 320, 2024-06-13T11:34:47.177 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 190896, 2024-06-13T11:34:47.177 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-06-13T11:34:47.177 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-06-13T11:34:47.177 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.042810335, 2024-06-13T11:34:47.178 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.030884198, 2024-06-13T11:34:47.178 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.004896511, 2024-06-13T11:34:47.178 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T11:34:47.178 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:34:47.178 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 197, 2024-06-13T11:34:47.178 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.027893780, 2024-06-13T11:34:47.179 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000141592 2024-06-13T11:34:47.179 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:47.179 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:34:47.179 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:47.179 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:47.179 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:47.179 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:47.180 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-13T11:34:47.180 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 190896 2024-06-13T11:34:47.180 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:47.180 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-06-13T11:34:47.180 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-06-13T11:34:47.180 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-06-13T11:34:47.180 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:47.180 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-06-13T11:34:47.180 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-06-13T11:34:47.181 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-06-13T11:34:47.181 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T11:34:47.181 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-06-13T11:34:47.181 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T11:34:47.181 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-06-13T11:34:47.181 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T11:34:47.181 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T11:34:47.181 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T11:34:47.181 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T11:34:47.182 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T11:34:47.182 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-06-13T11:34:47.182 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T11:34:47.182 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T11:34:47.182 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-06-13T11:34:47.182 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-06-13T11:34:47.182 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-06-13T11:34:47.183 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-06-13T11:34:47.183 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T11:34:47.183 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T11:34:47.183 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T11:34:47.183 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T11:34:47.183 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T11:34:47.183 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-06-13T11:34:47.183 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-06-13T11:34:47.183 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-06-13T11:34:47.184 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T11:34:47.184 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T11:34:47.184 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-06-13T11:34:47.184 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-06-13T11:34:47.184 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-06-13T11:34:47.184 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-06-13T11:34:47.184 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T11:34:47.184 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-06-13T11:34:47.184 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T11:34:47.185 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-06-13T11:34:47.185 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 148731, 2024-06-13T11:34:47.185 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 31, 2024-06-13T11:34:47.185 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-06-13T11:34:47.185 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-06-13T11:34:47.185 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-06-13T11:34:47.185 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-06-13T11:34:47.185 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-06-13T11:34:47.185 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-06-13T11:34:47.186 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-06-13T11:34:47.186 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-06-13T11:34:47.186 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-06-13T11:34:47.186 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-06-13T11:34:47.186 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T11:34:47.186 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-06-13T11:34:47.186 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-06-13T11:34:47.187 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-06-13T11:34:47.187 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-06-13T11:34:47.187 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-06-13T11:34:47.187 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-06-13T11:34:47.187 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-06-13T11:34:47.187 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-06-13T11:34:47.187 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-06-13T11:34:47.188 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:47.188 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T11:34:47.188 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-06-13T11:34:47.188 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-06-13T11:34:47.188 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-06-13T11:34:47.188 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 275, 2024-06-13T11:34:47.188 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1556778, 2024-06-13T11:34:47.188 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-06-13T11:34:47.189 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 275, 2024-06-13T11:34:47.189 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-06-13T11:34:47.189 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-06-13T11:34:47.189 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 275, 2024-06-13T11:34:47.189 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1556778, 2024-06-13T11:34:47.189 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-06-13T11:34:47.190 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:47.190 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:47.190 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:47.190 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:47.190 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:47.190 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:34:47.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:47 smithi002 ceph-mon[32210]: pgmap v341: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:48.138 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-06-13T11:34:48.138 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-06-13T11:34:48.138 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-06-13T11:34:48.138 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-06-13T11:34:48.138 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-06-13T11:34:48.138 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-06-13T11:34:48.138 DEBUG:tasks.check_counter:Getting stats from d 2024-06-13T11:34:48.139 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph daemon mds.d perf dump 2024-06-13T11:34:48.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:47 smithi178 ceph-mon[36913]: pgmap v341: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:47 smithi077 ceph-mon[36410]: pgmap v341: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:48.621 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:34:50.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:49 smithi002 ceph-mon[32210]: pgmap v342: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:50.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:49 smithi178 ceph-mon[36913]: pgmap v342: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:50.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:49 smithi077 ceph-mon[36410]: pgmap v342: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:51.115 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:34:51.115 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T11:34:51.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-06-13T11:34:51.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-06-13T11:34:51.115 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-06-13T11:34:51.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-06-13T11:34:51.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-06-13T11:34:51.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-06-13T11:34:51.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.004123551, 2024-06-13T11:34:51.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-06-13T11:34:51.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000963005, 2024-06-13T11:34:51.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T11:34:51.116 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:34:51.116 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:34:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-13T11:34:51.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-06-13T11:34:51.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:51.118 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T11:34:51.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 2, 2024-06-13T11:34:51.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 206, 2024-06-13T11:34:51.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 320, 2024-06-13T11:34:51.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 191952, 2024-06-13T11:34:51.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-06-13T11:34:51.118 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-06-13T11:34:51.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.043897874, 2024-06-13T11:34:51.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.031917580, 2024-06-13T11:34:51.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.004917978, 2024-06-13T11:34:51.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T11:34:51.119 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:34:51.119 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 203, 2024-06-13T11:34:51.119 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.036401783, 2024-06-13T11:34:51.119 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000179319 2024-06-13T11:34:51.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:51.120 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:34:51.120 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:51.120 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:51.120 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:51.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:51.120 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-13T11:34:51.120 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 191952 2024-06-13T11:34:51.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:51.120 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T11:34:51.121 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 286, 2024-06-13T11:34:51.121 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 273, 2024-06-13T11:34:51.121 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1600832, 2024-06-13T11:34:51.121 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 167536, 2024-06-13T11:34:51.121 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-06-13T11:34:51.121 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-06-13T11:34:51.121 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.115811875, 2024-06-13T11:34:51.121 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.030945854, 2024-06-13T11:34:51.121 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.101273906, 2024-06-13T11:34:51.122 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.012974011, 2024-06-13T11:34:51.122 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:34:51.122 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 273, 2024-06-13T11:34:51.122 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.029670482, 2024-06-13T11:34:51.122 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000108683 2024-06-13T11:34:51.122 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:51.122 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:34:51.122 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:51.122 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:51.123 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:51.123 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:51.123 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1600832, 2024-06-13T11:34:51.123 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 167536 2024-06-13T11:34:51.123 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:51.123 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-06-13T11:34:51.123 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-06-13T11:34:51.124 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-06-13T11:34:51.124 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:51.124 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-06-13T11:34:51.124 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-06-13T11:34:51.124 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-06-13T11:34:51.124 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T11:34:51.124 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-06-13T11:34:51.124 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T11:34:51.124 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-06-13T11:34:51.125 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T11:34:51.125 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T11:34:51.125 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T11:34:51.125 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T11:34:51.125 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T11:34:51.125 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-06-13T11:34:51.125 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T11:34:51.125 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T11:34:51.125 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-06-13T11:34:51.126 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-06-13T11:34:51.126 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-06-13T11:34:51.126 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-06-13T11:34:51.126 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T11:34:51.126 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T11:34:51.126 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T11:34:51.127 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T11:34:51.127 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T11:34:51.127 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-06-13T11:34:51.127 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-06-13T11:34:51.127 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-06-13T11:34:51.127 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T11:34:51.127 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T11:34:51.127 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-06-13T11:34:51.128 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-06-13T11:34:51.128 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-06-13T11:34:51.128 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-06-13T11:34:51.128 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T11:34:51.128 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-06-13T11:34:51.128 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T11:34:51.128 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-06-13T11:34:51.129 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 148731, 2024-06-13T11:34:51.129 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 31, 2024-06-13T11:34:51.129 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-06-13T11:34:51.129 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-06-13T11:34:51.129 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-06-13T11:34:51.129 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-06-13T11:34:51.129 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-06-13T11:34:51.129 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-06-13T11:34:51.129 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-06-13T11:34:51.130 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-06-13T11:34:51.130 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-06-13T11:34:51.130 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-06-13T11:34:51.130 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T11:34:51.130 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-06-13T11:34:51.130 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-06-13T11:34:51.130 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-06-13T11:34:51.130 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-06-13T11:34:51.131 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-06-13T11:34:51.131 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-06-13T11:34:51.131 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-06-13T11:34:51.131 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-06-13T11:34:51.131 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-06-13T11:34:51.131 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:51.131 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T11:34:51.131 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-06-13T11:34:51.132 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-06-13T11:34:51.132 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-06-13T11:34:51.132 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 284, 2024-06-13T11:34:51.132 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1558051, 2024-06-13T11:34:51.132 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-06-13T11:34:51.132 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 284, 2024-06-13T11:34:51.132 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-06-13T11:34:51.132 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-06-13T11:34:51.133 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 284, 2024-06-13T11:34:51.133 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1558051, 2024-06-13T11:34:51.133 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-06-13T11:34:51.133 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:51.133 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:51.133 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:51.133 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:51.133 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:51.134 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:34:52.092 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:51 smithi002 ceph-mon[32210]: pgmap v343: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:52.156 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-06-13T11:34:52.156 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-06-13T11:34:52.156 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-06-13T11:34:52.156 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-06-13T11:34:52.156 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-06-13T11:34:52.156 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-06-13T11:34:52.156 DEBUG:tasks.check_counter:Getting stats from g 2024-06-13T11:34:52.157 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph daemon mds.g perf dump 2024-06-13T11:34:52.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:51 smithi178 ceph-mon[36913]: pgmap v343: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:52.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:51 smithi077 ceph-mon[36410]: pgmap v343: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:52.590 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:34:53.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:53 smithi002 ceph-mon[32210]: pgmap v344: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:54.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:53 smithi178 ceph-mon[36913]: pgmap v344: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:54.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:53 smithi077 ceph-mon[36410]: pgmap v344: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:34:54.960 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:34:54.960 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T11:34:54.961 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 278, 2024-06-13T11:34:54.961 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 267, 2024-06-13T11:34:54.961 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1596752, 2024-06-13T11:34:54.961 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 164528, 2024-06-13T11:34:54.961 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-06-13T11:34:54.961 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-06-13T11:34:54.961 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.127395384, 2024-06-13T11:34:54.961 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.044318475, 2024-06-13T11:34:54.962 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.095033386, 2024-06-13T11:34:54.962 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.012135348, 2024-06-13T11:34:54.962 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:34:54.962 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 266, 2024-06-13T11:34:54.962 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.025968424, 2024-06-13T11:34:54.962 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000097625 2024-06-13T11:34:54.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:54.962 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:34:54.963 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:54.963 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:54.963 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:54.963 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:54.963 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1596752, 2024-06-13T11:34:54.963 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 164528 2024-06-13T11:34:54.963 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:54.963 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T11:34:54.963 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 6, 2024-06-13T11:34:54.964 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 205, 2024-06-13T11:34:54.964 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 3312, 2024-06-13T11:34:54.964 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 191872, 2024-06-13T11:34:54.964 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-06-13T11:34:54.964 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-06-13T11:34:54.964 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.044266857, 2024-06-13T11:34:54.964 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.032202075, 2024-06-13T11:34:54.964 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.005065496, 2024-06-13T11:34:54.965 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T11:34:54.965 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:34:54.965 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 203, 2024-06-13T11:34:54.965 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.035983498, 2024-06-13T11:34:54.965 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000177258 2024-06-13T11:34:54.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:54.965 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:34:54.965 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:54.965 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:54.966 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:54.966 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:54.966 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-06-13T11:34:54.966 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 191872 2024-06-13T11:34:54.966 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:54.966 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T11:34:54.966 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-06-13T11:34:54.966 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-06-13T11:34:54.967 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-06-13T11:34:54.967 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-06-13T11:34:54.967 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-06-13T11:34:54.967 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-06-13T11:34:54.967 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.000990532, 2024-06-13T11:34:54.967 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-06-13T11:34:54.967 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000734768, 2024-06-13T11:34:54.967 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T11:34:54.967 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:34:54.968 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:54.968 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:54.968 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:54.968 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:54.968 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:34:54.968 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:54.968 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:54.968 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:54.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:54.969 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-13T11:34:54.969 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-06-13T11:34:54.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:54.969 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-06-13T11:34:54.969 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-06-13T11:34:54.969 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-06-13T11:34:54.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:54.970 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-06-13T11:34:54.970 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-06-13T11:34:54.970 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-06-13T11:34:54.970 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T11:34:54.970 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-06-13T11:34:54.970 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T11:34:54.970 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-06-13T11:34:54.970 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T11:34:54.971 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T11:34:54.971 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T11:34:54.971 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T11:34:54.971 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T11:34:54.971 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-06-13T11:34:54.971 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T11:34:54.971 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T11:34:54.971 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-06-13T11:34:54.971 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-06-13T11:34:54.971 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-06-13T11:34:54.972 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-06-13T11:34:54.972 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T11:34:54.972 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T11:34:54.972 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T11:34:54.972 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T11:34:54.972 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T11:34:54.972 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-06-13T11:34:54.972 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-06-13T11:34:54.973 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-06-13T11:34:54.973 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T11:34:54.973 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T11:34:54.973 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-06-13T11:34:54.973 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-06-13T11:34:54.973 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-06-13T11:34:54.973 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-06-13T11:34:54.973 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T11:34:54.973 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-06-13T11:34:54.973 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T11:34:54.974 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-06-13T11:34:54.974 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 149745, 2024-06-13T11:34:54.974 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 31, 2024-06-13T11:34:54.974 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-06-13T11:34:54.974 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-06-13T11:34:54.974 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-06-13T11:34:54.974 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-06-13T11:34:54.974 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-06-13T11:34:54.975 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-06-13T11:34:54.975 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-06-13T11:34:54.975 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-06-13T11:34:54.975 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-06-13T11:34:54.975 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-06-13T11:34:54.975 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T11:34:54.975 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-06-13T11:34:54.975 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-06-13T11:34:54.975 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-06-13T11:34:54.975 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-06-13T11:34:54.976 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-06-13T11:34:54.976 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-06-13T11:34:54.976 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-06-13T11:34:54.976 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-06-13T11:34:54.976 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-06-13T11:34:54.976 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:54.976 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T11:34:54.976 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-06-13T11:34:54.976 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-06-13T11:34:54.977 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-06-13T11:34:54.977 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 280, 2024-06-13T11:34:54.977 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1557531, 2024-06-13T11:34:54.977 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-06-13T11:34:54.977 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 280, 2024-06-13T11:34:54.977 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-06-13T11:34:54.977 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-06-13T11:34:54.977 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 280, 2024-06-13T11:34:54.977 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1557531, 2024-06-13T11:34:54.977 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-06-13T11:34:54.978 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:54.978 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:54.978 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:54.978 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:54.978 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:54.978 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:34:56.029 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-06-13T11:34:56.029 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-06-13T11:34:56.030 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-06-13T11:34:56.030 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-06-13T11:34:56.030 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-06-13T11:34:56.030 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-06-13T11:34:56.030 DEBUG:tasks.check_counter:Getting stats from j 2024-06-13T11:34:56.030 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph daemon mds.j perf dump 2024-06-13T11:34:56.114 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:55 smithi002 ceph-mon[32210]: pgmap v345: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:56.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:55 smithi178 ceph-mon[36913]: pgmap v345: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:56.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:55 smithi077 ceph-mon[36410]: pgmap v345: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:56.510 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:34:58.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:57 smithi002 ceph-mon[32210]: pgmap v346: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:58.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:57 smithi178 ceph-mon[36913]: pgmap v346: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:58.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:57 smithi077 ceph-mon[36410]: pgmap v346: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:34:58.906 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T11:34:58.906 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T11:34:58.906 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-06-13T11:34:58.906 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-06-13T11:34:58.906 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-06-13T11:34:58.907 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-06-13T11:34:58.907 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-06-13T11:34:58.907 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-06-13T11:34:58.907 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.004046316, 2024-06-13T11:34:58.907 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-06-13T11:34:58.907 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000826292, 2024-06-13T11:34:58.907 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T11:34:58.907 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:34:58.907 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:58.908 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:58.908 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:58.908 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:58.908 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:34:58.908 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:58.908 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:58.908 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:58.908 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:58.909 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-13T11:34:58.909 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-06-13T11:34:58.909 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:58.909 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T11:34:58.909 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 289, 2024-06-13T11:34:58.909 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 276, 2024-06-13T11:34:58.909 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1601648, 2024-06-13T11:34:58.909 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 169456, 2024-06-13T11:34:58.909 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-06-13T11:34:58.910 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-06-13T11:34:58.910 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.132665972, 2024-06-13T11:34:58.910 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.044003702, 2024-06-13T11:34:58.910 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.107868403, 2024-06-13T11:34:58.910 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.013026742, 2024-06-13T11:34:58.910 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:34:58.910 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 276, 2024-06-13T11:34:58.910 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.028603631, 2024-06-13T11:34:58.911 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000103636 2024-06-13T11:34:58.911 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:58.911 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:34:58.911 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:58.911 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:58.911 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:58.911 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:58.911 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1601648, 2024-06-13T11:34:58.911 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 169456 2024-06-13T11:34:58.912 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:58.912 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T11:34:58.912 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 2, 2024-06-13T11:34:58.912 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 209, 2024-06-13T11:34:58.912 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 320, 2024-06-13T11:34:58.912 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 192480, 2024-06-13T11:34:58.912 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-06-13T11:34:58.912 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-06-13T11:34:58.912 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.042116859, 2024-06-13T11:34:58.912 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.031318343, 2024-06-13T11:34:58.913 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.003655001, 2024-06-13T11:34:58.913 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T11:34:58.913 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:34:58.913 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 206, 2024-06-13T11:34:58.913 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.030929714, 2024-06-13T11:34:58.913 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000150144 2024-06-13T11:34:58.913 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:58.913 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:34:58.913 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:58.914 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:58.914 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:58.914 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:58.914 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-13T11:34:58.914 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 192480 2024-06-13T11:34:58.914 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:58.914 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-06-13T11:34:58.914 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-06-13T11:34:58.915 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-06-13T11:34:58.915 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:58.915 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-06-13T11:34:58.915 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-06-13T11:34:58.915 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-06-13T11:34:58.915 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T11:34:58.915 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-06-13T11:34:58.915 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T11:34:58.916 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-06-13T11:34:58.916 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T11:34:58.916 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T11:34:58.916 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T11:34:58.916 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T11:34:58.916 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T11:34:58.916 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-06-13T11:34:58.916 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T11:34:58.916 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T11:34:58.917 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-06-13T11:34:58.917 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-06-13T11:34:58.917 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-06-13T11:34:58.917 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-06-13T11:34:58.917 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T11:34:58.917 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T11:34:58.917 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T11:34:58.917 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T11:34:58.917 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T11:34:58.918 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-06-13T11:34:58.918 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-06-13T11:34:58.918 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-06-13T11:34:58.918 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T11:34:58.918 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T11:34:58.918 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-06-13T11:34:58.918 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-06-13T11:34:58.918 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-06-13T11:34:58.919 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-06-13T11:34:58.919 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T11:34:58.919 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-06-13T11:34:58.919 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T11:34:58.919 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-06-13T11:34:58.919 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 148714, 2024-06-13T11:34:58.919 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 30, 2024-06-13T11:34:58.919 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-06-13T11:34:58.919 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-06-13T11:34:58.920 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-06-13T11:34:58.920 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-06-13T11:34:58.920 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-06-13T11:34:58.920 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-06-13T11:34:58.920 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-06-13T11:34:58.920 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-06-13T11:34:58.920 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-06-13T11:34:58.920 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-06-13T11:34:58.921 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T11:34:58.921 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-06-13T11:34:58.921 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-06-13T11:34:58.921 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-06-13T11:34:58.921 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-06-13T11:34:58.921 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-06-13T11:34:58.921 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-06-13T11:34:58.921 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-06-13T11:34:58.921 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-06-13T11:34:58.922 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-06-13T11:34:58.922 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T11:34:58.922 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T11:34:58.922 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-06-13T11:34:58.922 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-06-13T11:34:58.922 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-06-13T11:34:58.922 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 287, 2024-06-13T11:34:58.922 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1558441, 2024-06-13T11:34:58.923 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-06-13T11:34:58.923 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 287, 2024-06-13T11:34:58.923 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-06-13T11:34:58.923 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-06-13T11:34:58.923 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 287, 2024-06-13T11:34:58.923 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1558441, 2024-06-13T11:34:58.923 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-06-13T11:34:58.923 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T11:34:58.923 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T11:34:58.924 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T11:34:58.924 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:58.924 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T11:34:58.924 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T11:34:59.795 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-06-13T11:34:59.795 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-06-13T11:34:59.795 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-06-13T11:34:59.795 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-06-13T11:34:59.795 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-06-13T11:34:59.795 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-06-13T11:34:59.796 DEBUG:tasks.check_counter:Getting stats from b 2024-06-13T11:34:59.796 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph daemon mds.b perf dump 2024-06-13T11:35:00.045 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T11:35:00.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:34:59 smithi002 ceph-mon[32210]: pgmap v347: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:35:00.167 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:34:59 smithi077 ceph-mon[36410]: pgmap v347: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:35:00.196 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:34:59 smithi178 ceph-mon[36913]: pgmap v347: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T11:35:01.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:00 smithi002 ceph-mon[32210]: pgmap v348: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:35:01.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:00 smithi178 ceph-mon[36913]: pgmap v348: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:35:01.289 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:00 smithi077 ceph-mon[36410]: pgmap v348: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:35:01.960 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-06-13T11:35:01.960 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T11:35:01.960 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 4952, 2024-06-13T11:35:01.960 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 6765, 2024-06-13T11:35:01.960 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 3496162, 2024-06-13T11:35:01.960 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 7319646, 2024-06-13T11:35:01.961 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 29, 2024-06-13T11:35:01.961 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 4, 2024-06-13T11:35:01.961 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.350562643, 2024-06-13T11:35:01.961 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.135759596, 2024-06-13T11:35:01.961 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.154190355, 2024-06-13T11:35:01.961 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.058655798, 2024-06-13T11:35:01.961 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:01.961 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 6763, 2024-06-13T11:35:01.962 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.210410080, 2024-06-13T11:35:01.962 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000031111 2024-06-13T11:35:01.962 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.962 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:01.962 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 6074, 2024-06-13T11:35:01.962 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.001314613, 2024-06-13T11:35:01.962 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000216 2024-06-13T11:35:01.962 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.962 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-13T11:35:01.963 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 329968 2024-06-13T11:35:01.963 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.963 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T11:35:01.963 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 6661, 2024-06-13T11:35:01.963 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 8993, 2024-06-13T11:35:01.963 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 2031931, 2024-06-13T11:35:01.963 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 4630882, 2024-06-13T11:35:01.963 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 18, 2024-06-13T11:35:01.964 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 6, 2024-06-13T11:35:01.964 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.359426032, 2024-06-13T11:35:01.964 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.142586760, 2024-06-13T11:35:01.964 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.184627527, 2024-06-13T11:35:01.964 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.061909557, 2024-06-13T11:35:01.964 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:01.964 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 8989, 2024-06-13T11:35:01.964 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.181050089, 2024-06-13T11:35:01.965 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000020141 2024-06-13T11:35:01.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.965 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:01.965 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 6988, 2024-06-13T11:35:01.965 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.001116861, 2024-06-13T11:35:01.965 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000159 2024-06-13T11:35:01.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.965 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 5152, 2024-06-13T11:35:01.966 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 247968 2024-06-13T11:35:01.966 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.966 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T11:35:01.966 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 7445, 2024-06-13T11:35:01.966 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 7421, 2024-06-13T11:35:01.966 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 3519766, 2024-06-13T11:35:01.966 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 2635791, 2024-06-13T11:35:01.966 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 12, 2024-06-13T11:35:01.966 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 5, 2024-06-13T11:35:01.967 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.408433607, 2024-06-13T11:35:01.967 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.134193468, 2024-06-13T11:35:01.967 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.132798721, 2024-06-13T11:35:01.967 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.132237161, 2024-06-13T11:35:01.967 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:01.967 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 7422, 2024-06-13T11:35:01.967 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.175521298, 2024-06-13T11:35:01.967 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000023648 2024-06-13T11:35:01.968 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.968 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:01.968 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 119, 2024-06-13T11:35:01.968 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000031653, 2024-06-13T11:35:01.968 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000265 2024-06-13T11:35:01.968 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.969 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 1667056, 2024-06-13T11:35:01.969 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 181840 2024-06-13T11:35:01.969 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.969 INFO:teuthology.orchestra.run.smithi077.stdout: "cct": { 2024-06-13T11:35:01.969 INFO:teuthology.orchestra.run.smithi077.stdout: "total_workers": 1, 2024-06-13T11:35:01.969 INFO:teuthology.orchestra.run.smithi077.stdout: "unhealthy_workers": 0 2024-06-13T11:35:01.969 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.969 INFO:teuthology.orchestra.run.smithi077.stdout: "finisher-MDSRank": { 2024-06-13T11:35:01.969 INFO:teuthology.orchestra.run.smithi077.stdout: "queue_len": 0, 2024-06-13T11:35:01.969 INFO:teuthology.orchestra.run.smithi077.stdout: "complete_latency": { 2024-06-13T11:35:01.970 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 9334, 2024-06-13T11:35:01.970 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 2.085072318, 2024-06-13T11:35:01.970 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000223384 2024-06-13T11:35:01.970 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:01.970 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.970 INFO:teuthology.orchestra.run.smithi077.stdout: "finisher-PurgeQueue": { 2024-06-13T11:35:01.970 INFO:teuthology.orchestra.run.smithi077.stdout: "queue_len": 0, 2024-06-13T11:35:01.970 INFO:teuthology.orchestra.run.smithi077.stdout: "complete_latency": { 2024-06-13T11:35:01.971 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 650, 2024-06-13T11:35:01.971 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.048221603, 2024-06-13T11:35:01.971 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000074187 2024-06-13T11:35:01.971 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:01.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.971 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-06-13T11:35:01.971 INFO:teuthology.orchestra.run.smithi077.stdout: "request": 1636, 2024-06-13T11:35:01.971 INFO:teuthology.orchestra.run.smithi077.stdout: "reply": 1635, 2024-06-13T11:35:01.971 INFO:teuthology.orchestra.run.smithi077.stdout: "reply_latency": { 2024-06-13T11:35:01.972 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 1635, 2024-06-13T11:35:01.972 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 1.179263896, 2024-06-13T11:35:01.972 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000721262 2024-06-13T11:35:01.972 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.972 INFO:teuthology.orchestra.run.smithi077.stdout: "slow_reply": 0, 2024-06-13T11:35:01.972 INFO:teuthology.orchestra.run.smithi077.stdout: "forward": 1, 2024-06-13T11:35:01.972 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_fetch_complete": 0, 2024-06-13T11:35:01.972 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_fetch_keys": 0, 2024-06-13T11:35:01.973 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_commit": 11, 2024-06-13T11:35:01.973 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_split": 0, 2024-06-13T11:35:01.973 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_merge": 0, 2024-06-13T11:35:01.973 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes": 2281, 2024-06-13T11:35:01.973 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_top": 28, 2024-06-13T11:35:01.973 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_bottom": 2253, 2024-06-13T11:35:01.973 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_pin_tail": 0, 2024-06-13T11:35:01.973 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_pinned": 2175, 2024-06-13T11:35:01.973 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_expired": 1, 2024-06-13T11:35:01.973 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_with_caps": 197, 2024-06-13T11:35:01.974 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": 197, 2024-06-13T11:35:01.974 INFO:teuthology.orchestra.run.smithi077.stdout: "subtrees": 61, 2024-06-13T11:35:01.974 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse": 3294, 2024-06-13T11:35:01.974 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_hit": 2330, 2024-06-13T11:35:01.974 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_forward": 0, 2024-06-13T11:35:01.974 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_discover": 40, 2024-06-13T11:35:01.974 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_dir_fetch": 0, 2024-06-13T11:35:01.974 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_remote_ino": 0, 2024-06-13T11:35:01.974 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_lock": 0, 2024-06-13T11:35:01.975 INFO:teuthology.orchestra.run.smithi077.stdout: "load_cent": 0, 2024-06-13T11:35:01.975 INFO:teuthology.orchestra.run.smithi077.stdout: "q": 0, 2024-06-13T11:35:01.975 INFO:teuthology.orchestra.run.smithi077.stdout: "exported": 0, 2024-06-13T11:35:01.975 INFO:teuthology.orchestra.run.smithi077.stdout: "exported_inodes": 0, 2024-06-13T11:35:01.975 INFO:teuthology.orchestra.run.smithi077.stdout: "imported": 59, 2024-06-13T11:35:01.975 INFO:teuthology.orchestra.run.smithi077.stdout: "imported_inodes": 1916, 2024-06-13T11:35:01.975 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_dir_fetch": 0, 2024-06-13T11:35:01.975 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_backtrace_fetch": 11844, 2024-06-13T11:35:01.975 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_peer_discover": 0, 2024-06-13T11:35:01.976 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rfiles": 3452, 2024-06-13T11:35:01.976 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rbytes": 26717845, 2024-06-13T11:35:01.976 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rsnaps": 6, 2024-06-13T11:35:01.976 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_backtrace_fetch": 11844, 2024-06-13T11:35:01.976 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_set_tag": 0, 2024-06-13T11:35:01.976 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_backtrace_repaired": 0, 2024-06-13T11:35:01.976 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_inotable_repaired": 0, 2024-06-13T11:35:01.976 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dir_inodes": 159, 2024-06-13T11:35:01.976 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dir_base_inodes": 0, 2024-06-13T11:35:01.976 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dirfrag_rstats": 159, 2024-06-13T11:35:01.977 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_file_inodes": 11685, 2024-06-13T11:35:01.977 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_inode_file_caps": 0, 2024-06-13T11:35:01.977 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_revoke": 43, 2024-06-13T11:35:01.977 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_grant": 596, 2024-06-13T11:35:01.977 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_trunc": 0, 2024-06-13T11:35:01.977 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-13T11:35:01.977 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-13T11:35:01.977 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_caps": 1800, 2024-06-13T11:35:01.977 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_caps_dirty": 1398, 2024-06-13T11:35:01.978 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_cap_release": 19, 2024-06-13T11:35:01.978 INFO:teuthology.orchestra.run.smithi077.stdout: "process_request_cap_release": 768 2024-06-13T11:35:01.978 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.978 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache": { 2024-06-13T11:35:01.978 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_update": 0, 2024-06-13T11:35:01.978 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_update_receipt": 0, 2024-06-13T11:35:01.978 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_try_discover": 0, 2024-06-13T11:35:01.978 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_send_discover": 40, 2024-06-13T11:35:01.978 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_handle_discover": 0, 2024-06-13T11:35:01.979 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays": 0, 2024-06-13T11:35:01.979 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays_delayed": 0, 2024-06-13T11:35:01.979 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays_enqueuing": 0, 2024-06-13T11:35:01.979 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_created": 360, 2024-06-13T11:35:01.979 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_enqueued": 360, 2024-06-13T11:35:01.979 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_reintegrated": 0, 2024-06-13T11:35:01.979 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_migrated": 0, 2024-06-13T11:35:01.979 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_processing": 0, 2024-06-13T11:35:01.979 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_enqueued": 0, 2024-06-13T11:35:01.980 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_prioritized": 0, 2024-06-13T11:35:01.980 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_started": 0, 2024-06-13T11:35:01.980 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_completed": 0, 2024-06-13T11:35:01.980 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_quiesce_path": 0, 2024-06-13T11:35:01.980 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_quiesce_inode": 0, 2024-06-13T11:35:01.980 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_enqueue_scrub": 0, 2024-06-13T11:35:01.980 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_exportdir": 0, 2024-06-13T11:35:01.980 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_flush": 0, 2024-06-13T11:35:01.980 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_fragmentdir": 0, 2024-06-13T11:35:01.981 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_fragstats": 0, 2024-06-13T11:35:01.981 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_inodestats": 0 2024-06-13T11:35:01.981 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.981 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log": { 2024-06-13T11:35:01.981 INFO:teuthology.orchestra.run.smithi077.stdout: "evlrg": 0, 2024-06-13T11:35:01.981 INFO:teuthology.orchestra.run.smithi077.stdout: "evadd": 3015, 2024-06-13T11:35:01.981 INFO:teuthology.orchestra.run.smithi077.stdout: "evex": 0, 2024-06-13T11:35:01.981 INFO:teuthology.orchestra.run.smithi077.stdout: "evtrm": 0, 2024-06-13T11:35:01.981 INFO:teuthology.orchestra.run.smithi077.stdout: "ev": 3015, 2024-06-13T11:35:01.982 INFO:teuthology.orchestra.run.smithi077.stdout: "evexg": 0, 2024-06-13T11:35:01.982 INFO:teuthology.orchestra.run.smithi077.stdout: "evexd": 0, 2024-06-13T11:35:01.982 INFO:teuthology.orchestra.run.smithi077.stdout: "segadd": 5, 2024-06-13T11:35:01.982 INFO:teuthology.orchestra.run.smithi077.stdout: "segex": 0, 2024-06-13T11:35:01.982 INFO:teuthology.orchestra.run.smithi077.stdout: "segtrm": 0, 2024-06-13T11:35:01.982 INFO:teuthology.orchestra.run.smithi077.stdout: "seg": 5, 2024-06-13T11:35:01.982 INFO:teuthology.orchestra.run.smithi077.stdout: "segmjr": 2, 2024-06-13T11:35:01.982 INFO:teuthology.orchestra.run.smithi077.stdout: "segexg": 0, 2024-06-13T11:35:01.983 INFO:teuthology.orchestra.run.smithi077.stdout: "segexd": 0, 2024-06-13T11:35:01.983 INFO:teuthology.orchestra.run.smithi077.stdout: "expos": 4194304, 2024-06-13T11:35:01.983 INFO:teuthology.orchestra.run.smithi077.stdout: "wrpos": 10357566, 2024-06-13T11:35:01.983 INFO:teuthology.orchestra.run.smithi077.stdout: "rdpos": 0, 2024-06-13T11:35:01.983 INFO:teuthology.orchestra.run.smithi077.stdout: "jlat": { 2024-06-13T11:35:01.983 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 107, 2024-06-13T11:35:01.983 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.307128955, 2024-06-13T11:35:01.983 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.002870364 2024-06-13T11:35:01.984 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.984 INFO:teuthology.orchestra.run.smithi077.stdout: "replayed": 0 2024-06-13T11:35:01.984 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.984 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_mem": { 2024-06-13T11:35:01.984 INFO:teuthology.orchestra.run.smithi077.stdout: "ino": 1765, 2024-06-13T11:35:01.984 INFO:teuthology.orchestra.run.smithi077.stdout: "ino+": 2125, 2024-06-13T11:35:01.984 INFO:teuthology.orchestra.run.smithi077.stdout: "ino-": 360, 2024-06-13T11:35:01.984 INFO:teuthology.orchestra.run.smithi077.stdout: "dir": 97, 2024-06-13T11:35:01.984 INFO:teuthology.orchestra.run.smithi077.stdout: "dir+": 98, 2024-06-13T11:35:01.985 INFO:teuthology.orchestra.run.smithi077.stdout: "dir-": 1, 2024-06-13T11:35:01.985 INFO:teuthology.orchestra.run.smithi077.stdout: "dn": 2281, 2024-06-13T11:35:01.985 INFO:teuthology.orchestra.run.smithi077.stdout: "dn+": 2652, 2024-06-13T11:35:01.985 INFO:teuthology.orchestra.run.smithi077.stdout: "dn-": 371, 2024-06-13T11:35:01.985 INFO:teuthology.orchestra.run.smithi077.stdout: "cap": 197, 2024-06-13T11:35:01.985 INFO:teuthology.orchestra.run.smithi077.stdout: "cap+": 1690, 2024-06-13T11:35:01.985 INFO:teuthology.orchestra.run.smithi077.stdout: "cap-": 1493, 2024-06-13T11:35:01.985 INFO:teuthology.orchestra.run.smithi077.stdout: "rss": 73092, 2024-06-13T11:35:01.986 INFO:teuthology.orchestra.run.smithi077.stdout: "heap": 223612 2024-06-13T11:35:01.986 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.986 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_server": { 2024-06-13T11:35:01.986 INFO:teuthology.orchestra.run.smithi077.stdout: "dispatch_client_request": 2253, 2024-06-13T11:35:01.986 INFO:teuthology.orchestra.run.smithi077.stdout: "dispatch_server_request": 0, 2024-06-13T11:35:01.986 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_request": 1636, 2024-06-13T11:35:01.986 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_session": 16, 2024-06-13T11:35:01.987 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_peer_request": 570, 2024-06-13T11:35:01.987 INFO:teuthology.orchestra.run.smithi077.stdout: "req_create_latency": { 2024-06-13T11:35:01.987 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 209, 2024-06-13T11:35:01.987 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.270309156, 2024-06-13T11:35:01.987 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.001293345 2024-06-13T11:35:01.987 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.987 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getattr_latency": { 2024-06-13T11:35:01.987 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 2, 2024-06-13T11:35:01.988 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000425994, 2024-06-13T11:35:01.988 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000212997 2024-06-13T11:35:01.988 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.988 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getfilelock_latency": { 2024-06-13T11:35:01.988 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:01.988 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:01.988 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:01.988 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.989 INFO:teuthology.orchestra.run.smithi077.stdout: "req_link_latency": { 2024-06-13T11:35:01.989 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:01.989 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:01.989 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:01.989 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.989 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookup_latency": { 2024-06-13T11:35:01.989 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 1002, 2024-06-13T11:35:01.989 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.303502692, 2024-06-13T11:35:01.990 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000302896 2024-06-13T11:35:01.990 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.990 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookuphash_latency": { 2024-06-13T11:35:01.990 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:01.990 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:01.990 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:01.990 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.990 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupino_latency": { 2024-06-13T11:35:01.991 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:01.991 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:01.991 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:01.991 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.991 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupname_latency": { 2024-06-13T11:35:01.991 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:01.991 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:01.991 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:01.991 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.992 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupparent_latency": { 2024-06-13T11:35:01.992 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:01.992 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:01.992 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:01.992 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.992 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupsnap_latency": { 2024-06-13T11:35:01.992 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:01.992 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:01.992 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:01.993 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.993 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lssnap_latency": { 2024-06-13T11:35:01.993 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:01.993 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:01.993 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:01.993 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.994 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mkdir_latency": { 2024-06-13T11:35:01.994 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 1, 2024-06-13T11:35:01.994 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.002149949, 2024-06-13T11:35:01.994 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.002149949 2024-06-13T11:35:01.994 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.994 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mknod_latency": { 2024-06-13T11:35:01.994 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:01.994 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:01.995 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:01.995 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.995 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mksnap_latency": { 2024-06-13T11:35:01.995 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:01.995 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:01.995 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:01.995 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.995 INFO:teuthology.orchestra.run.smithi077.stdout: "req_open_latency": { 2024-06-13T11:35:01.995 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 35, 2024-06-13T11:35:01.996 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.011115628, 2024-06-13T11:35:01.996 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000317589 2024-06-13T11:35:01.996 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.996 INFO:teuthology.orchestra.run.smithi077.stdout: "req_readdir_latency": { 2024-06-13T11:35:01.996 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 25, 2024-06-13T11:35:01.996 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.019526896, 2024-06-13T11:35:01.996 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000781075 2024-06-13T11:35:01.996 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.996 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rename_latency": { 2024-06-13T11:35:01.997 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:01.997 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:01.997 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:01.997 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.997 INFO:teuthology.orchestra.run.smithi077.stdout: "req_renamesnap_latency": { 2024-06-13T11:35:01.997 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:01.997 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:01.997 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:01.997 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.998 INFO:teuthology.orchestra.run.smithi077.stdout: "req_snapdiff_latency": { 2024-06-13T11:35:01.998 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:01.998 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:01.998 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:01.998 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.998 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmdir_latency": { 2024-06-13T11:35:01.998 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:01.998 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:01.999 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:01.999 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.999 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmsnap_latency": { 2024-06-13T11:35:01.999 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:01.999 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:01.999 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:01.999 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:01.999 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmxattr_latency": { 2024-06-13T11:35:01.999 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:02.000 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:02.000 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:02.000 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.000 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setattr_latency": { 2024-06-13T11:35:02.000 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:02.000 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:02.000 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:02.000 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.000 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setdirlayout_latency": { 2024-06-13T11:35:02.001 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:02.001 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:02.001 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:02.001 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.001 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setfilelock_latency": { 2024-06-13T11:35:02.001 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:02.001 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:02.001 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:02.001 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.002 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setlayout_latency": { 2024-06-13T11:35:02.002 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:02.002 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:02.002 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:02.002 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.002 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setxattr_latency": { 2024-06-13T11:35:02.002 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:02.002 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:02.003 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:02.003 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.003 INFO:teuthology.orchestra.run.smithi077.stdout: "req_symlink_latency": { 2024-06-13T11:35:02.003 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 1, 2024-06-13T11:35:02.003 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.001194274, 2024-06-13T11:35:02.003 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.001194274 2024-06-13T11:35:02.003 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.003 INFO:teuthology.orchestra.run.smithi077.stdout: "req_unlink_latency": { 2024-06-13T11:35:02.003 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 360, 2024-06-13T11:35:02.003 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.571039307, 2024-06-13T11:35:02.004 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.001586220 2024-06-13T11:35:02.004 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.004 INFO:teuthology.orchestra.run.smithi077.stdout: "cap_revoke_eviction": 0, 2024-06-13T11:35:02.004 INFO:teuthology.orchestra.run.smithi077.stdout: "cap_acquisition_throttle": 0, 2024-06-13T11:35:02.004 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getvxattr_latency": { 2024-06-13T11:35:02.004 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:02.004 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:02.004 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:02.004 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:02.005 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.005 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_sessions": { 2024-06-13T11:35:02.005 INFO:teuthology.orchestra.run.smithi077.stdout: "session_count": 1, 2024-06-13T11:35:02.005 INFO:teuthology.orchestra.run.smithi077.stdout: "session_add": 3, 2024-06-13T11:35:02.005 INFO:teuthology.orchestra.run.smithi077.stdout: "session_remove": 2, 2024-06-13T11:35:02.005 INFO:teuthology.orchestra.run.smithi077.stdout: "sessions_open": 1, 2024-06-13T11:35:02.005 INFO:teuthology.orchestra.run.smithi077.stdout: "sessions_stale": 0, 2024-06-13T11:35:02.005 INFO:teuthology.orchestra.run.smithi077.stdout: "total_load": 1073, 2024-06-13T11:35:02.005 INFO:teuthology.orchestra.run.smithi077.stdout: "average_load": 1073, 2024-06-13T11:35:02.005 INFO:teuthology.orchestra.run.smithi077.stdout: "avg_session_uptime": 2512, 2024-06-13T11:35:02.006 INFO:teuthology.orchestra.run.smithi077.stdout: "mdthresh_evicted": 0 2024-06-13T11:35:02.006 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.006 INFO:teuthology.orchestra.run.smithi077.stdout: "mempool": { 2024-06-13T11:35:02.006 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_bytes": 0, 2024-06-13T11:35:02.006 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_items": 0, 2024-06-13T11:35:02.006 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T11:35:02.006 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_items": 0, 2024-06-13T11:35:02.006 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T11:35:02.007 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_items": 0, 2024-06-13T11:35:02.007 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T11:35:02.007 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T11:35:02.007 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T11:35:02.007 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T11:35:02.007 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T11:35:02.007 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_items": 0, 2024-06-13T11:35:02.007 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T11:35:02.007 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T11:35:02.007 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_bytes": 0, 2024-06-13T11:35:02.008 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_items": 0, 2024-06-13T11:35:02.008 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_bytes": 0, 2024-06-13T11:35:02.008 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_items": 0, 2024-06-13T11:35:02.008 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T11:35:02.008 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T11:35:02.008 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T11:35:02.008 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T11:35:02.008 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T11:35:02.008 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_items": 0, 2024-06-13T11:35:02.009 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_bytes": 0, 2024-06-13T11:35:02.009 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_items": 0, 2024-06-13T11:35:02.009 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T11:35:02.009 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T11:35:02.009 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_bytes": 0, 2024-06-13T11:35:02.009 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_items": 0, 2024-06-13T11:35:02.009 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_bytes": 0, 2024-06-13T11:35:02.009 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_items": 0, 2024-06-13T11:35:02.009 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T11:35:02.010 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_items": 0, 2024-06-13T11:35:02.010 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T11:35:02.010 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_items": 0, 2024-06-13T11:35:02.010 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_bytes": 357276, 2024-06-13T11:35:02.010 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_items": 1637, 2024-06-13T11:35:02.010 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_bytes": 880, 2024-06-13T11:35:02.010 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_items": 10, 2024-06-13T11:35:02.010 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bytes": 0, 2024-06-13T11:35:02.010 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_items": 0, 2024-06-13T11:35:02.011 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_bytes": 0, 2024-06-13T11:35:02.011 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_items": 0, 2024-06-13T11:35:02.011 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_bytes": 0, 2024-06-13T11:35:02.011 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_items": 0, 2024-06-13T11:35:02.011 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_bytes": 9432, 2024-06-13T11:35:02.011 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_items": 182, 2024-06-13T11:35:02.011 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T11:35:02.011 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_items": 0, 2024-06-13T11:35:02.011 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_bytes": 0, 2024-06-13T11:35:02.012 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_items": 0, 2024-06-13T11:35:02.012 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_bytes": 5989879, 2024-06-13T11:35:02.012 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_items": 65618, 2024-06-13T11:35:02.012 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_bytes": 0, 2024-06-13T11:35:02.012 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_items": 0, 2024-06-13T11:35:02.012 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_bytes": 0, 2024-06-13T11:35:02.012 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_items": 0 2024-06-13T11:35:02.012 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.012 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter": { 2024-06-13T11:35:02.012 INFO:teuthology.orchestra.run.smithi077.stdout: "op_active": 0, 2024-06-13T11:35:02.013 INFO:teuthology.orchestra.run.smithi077.stdout: "op_laggy": 0, 2024-06-13T11:35:02.013 INFO:teuthology.orchestra.run.smithi077.stdout: "op_send": 12772, 2024-06-13T11:35:02.013 INFO:teuthology.orchestra.run.smithi077.stdout: "op_send_bytes": 6408059, 2024-06-13T11:35:02.013 INFO:teuthology.orchestra.run.smithi077.stdout: "op_resend": 33, 2024-06-13T11:35:02.013 INFO:teuthology.orchestra.run.smithi077.stdout: "op_reply": 12772, 2024-06-13T11:35:02.013 INFO:teuthology.orchestra.run.smithi077.stdout: "op_latency": { 2024-06-13T11:35:02.013 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 12772, 2024-06-13T11:35:02.013 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 13.035741916, 2024-06-13T11:35:02.013 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.001020650 2024-06-13T11:35:02.014 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.014 INFO:teuthology.orchestra.run.smithi077.stdout: "op_inflight": 0, 2024-06-13T11:35:02.014 INFO:teuthology.orchestra.run.smithi077.stdout: "oplen_avg": { 2024-06-13T11:35:02.014 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 12772, 2024-06-13T11:35:02.014 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 12836 2024-06-13T11:35:02.014 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.014 INFO:teuthology.orchestra.run.smithi077.stdout: "op": 12772, 2024-06-13T11:35:02.014 INFO:teuthology.orchestra.run.smithi077.stdout: "op_r": 11849, 2024-06-13T11:35:02.015 INFO:teuthology.orchestra.run.smithi077.stdout: "op_w": 923, 2024-06-13T11:35:02.015 INFO:teuthology.orchestra.run.smithi077.stdout: "op_rmw": 0, 2024-06-13T11:35:02.015 INFO:teuthology.orchestra.run.smithi077.stdout: "op_pg": 0, 2024-06-13T11:35:02.015 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_stat": 0, 2024-06-13T11:35:02.015 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_create": 10, 2024-06-13T11:35:02.015 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_read": 5, 2024-06-13T11:35:02.015 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_write": 112, 2024-06-13T11:35:02.015 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_writefull": 17, 2024-06-13T11:35:02.015 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_writesame": 0, 2024-06-13T11:35:02.016 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_append": 0, 2024-06-13T11:35:02.016 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_zero": 0, 2024-06-13T11:35:02.016 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_truncate": 0, 2024-06-13T11:35:02.016 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_delete": 733, 2024-06-13T11:35:02.016 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_mapext": 0, 2024-06-13T11:35:02.016 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_sparse_read": 0, 2024-06-13T11:35:02.016 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_clonerange": 0, 2024-06-13T11:35:02.016 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_getxattr": 11844, 2024-06-13T11:35:02.016 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_setxattr": 20, 2024-06-13T11:35:02.017 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_cmpxattr": 0, 2024-06-13T11:35:02.017 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_rmxattr": 0, 2024-06-13T11:35:02.017 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_resetxattrs": 0, 2024-06-13T11:35:02.017 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_call": 0, 2024-06-13T11:35:02.017 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_watch": 0, 2024-06-13T11:35:02.017 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_notify": 0, 2024-06-13T11:35:02.017 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_src_cmpxattr": 0, 2024-06-13T11:35:02.017 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_pgls": 0, 2024-06-13T11:35:02.018 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_pgls_filter": 0, 2024-06-13T11:35:02.018 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_other": 0, 2024-06-13T11:35:02.018 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_active": 0, 2024-06-13T11:35:02.018 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_send": 0, 2024-06-13T11:35:02.018 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_resend": 0, 2024-06-13T11:35:02.018 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_ping": 0, 2024-06-13T11:35:02.018 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_active": 0, 2024-06-13T11:35:02.018 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_send": 0, 2024-06-13T11:35:02.018 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_resend": 0, 2024-06-13T11:35:02.019 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_active": 0, 2024-06-13T11:35:02.019 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_send": 0, 2024-06-13T11:35:02.019 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_resend": 0, 2024-06-13T11:35:02.019 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_active": 0, 2024-06-13T11:35:02.019 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_send": 0, 2024-06-13T11:35:02.020 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_resend": 0, 2024-06-13T11:35:02.020 INFO:teuthology.orchestra.run.smithi077.stdout: "command_active": 0, 2024-06-13T11:35:02.020 INFO:teuthology.orchestra.run.smithi077.stdout: "command_send": 0, 2024-06-13T11:35:02.020 INFO:teuthology.orchestra.run.smithi077.stdout: "command_resend": 0, 2024-06-13T11:35:02.020 INFO:teuthology.orchestra.run.smithi077.stdout: "map_epoch": 108, 2024-06-13T11:35:02.020 INFO:teuthology.orchestra.run.smithi077.stdout: "map_full": 0, 2024-06-13T11:35:02.020 INFO:teuthology.orchestra.run.smithi077.stdout: "map_inc": 11, 2024-06-13T11:35:02.020 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_sessions": 12, 2024-06-13T11:35:02.021 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_session_open": 12, 2024-06-13T11:35:02.021 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_session_close": 0, 2024-06-13T11:35:02.021 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_laggy": 0, 2024-06-13T11:35:02.021 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_wr": 81, 2024-06-13T11:35:02.021 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_rd": 0, 2024-06-13T11:35:02.021 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_del": 14 2024-06-13T11:35:02.021 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.022 INFO:teuthology.orchestra.run.smithi077.stdout: "oft": { 2024-06-13T11:35:02.022 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_objs": 1, 2024-06-13T11:35:02.022 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_kv_pairs": 0, 2024-06-13T11:35:02.022 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_updates": 0, 2024-06-13T11:35:02.022 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_removes": 0 2024-06-13T11:35:02.022 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.022 INFO:teuthology.orchestra.run.smithi077.stdout: "osd-slow-ops": { 2024-06-13T11:35:02.023 INFO:teuthology.orchestra.run.smithi077.stdout: "slow_ops_count": 0 2024-06-13T11:35:02.023 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.023 INFO:teuthology.orchestra.run.smithi077.stdout: "purge_queue": { 2024-06-13T11:35:02.023 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_ops": 0, 2024-06-13T11:35:02.023 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_ops_high_water": 16, 2024-06-13T11:35:02.023 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing": 0, 2024-06-13T11:35:02.023 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_high_water": 8, 2024-06-13T11:35:02.023 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executed_ops": 720, 2024-06-13T11:35:02.024 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executed": 360, 2024-06-13T11:35:02.024 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_item_in_journal": 0 2024-06-13T11:35:02.024 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.024 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T11:35:02.024 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-06-13T11:35:02.024 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-06-13T11:35:02.024 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-06-13T11:35:02.024 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 19054, 2024-06-13T11:35:02.025 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 7311637, 2024-06-13T11:35:02.025 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:02.025 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 19054, 2024-06-13T11:35:02.025 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-06-13T11:35:02.025 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-06-13T11:35:02.025 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 19054, 2024-06-13T11:35:02.025 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 7311637, 2024-06-13T11:35:02.025 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-06-13T11:35:02.026 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:02.026 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:02.026 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:02.026 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:02.026 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.026 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-objecter_bytes": { 2024-06-13T11:35:02.026 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-06-13T11:35:02.026 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-06-13T11:35:02.027 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-06-13T11:35:02.027 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-06-13T11:35:02.027 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-06-13T11:35:02.027 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:02.027 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:02.027 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 12772, 2024-06-13T11:35:02.027 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 6447299, 2024-06-13T11:35:02.027 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 12772, 2024-06-13T11:35:02.028 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 6447299, 2024-06-13T11:35:02.028 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-06-13T11:35:02.028 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:02.028 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:02.028 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:02.028 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:02.028 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.028 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-objecter_ops": { 2024-06-13T11:35:02.029 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-06-13T11:35:02.029 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 1024, 2024-06-13T11:35:02.029 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-06-13T11:35:02.029 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-06-13T11:35:02.029 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-06-13T11:35:02.029 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:02.029 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:02.029 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 12772, 2024-06-13T11:35:02.030 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 12772, 2024-06-13T11:35:02.030 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 12772, 2024-06-13T11:35:02.030 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 12772, 2024-06-13T11:35:02.030 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-06-13T11:35:02.030 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:02.030 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:02.030 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:02.030 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:02.031 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.031 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-write_buf_throttle": { 2024-06-13T11:35:02.031 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-06-13T11:35:02.031 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 3758096384, 2024-06-13T11:35:02.031 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-06-13T11:35:02.031 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 360, 2024-06-13T11:35:02.031 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 39240, 2024-06-13T11:35:02.031 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:02.032 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 360, 2024-06-13T11:35:02.032 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-06-13T11:35:02.032 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-06-13T11:35:02.032 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 5, 2024-06-13T11:35:02.032 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 39240, 2024-06-13T11:35:02.032 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-06-13T11:35:02.032 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:02.032 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:02.033 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:02.033 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:02.033 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:02.033 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-write_buf_throttle-0x5604a4920460": { 2024-06-13T11:35:02.033 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-06-13T11:35:02.033 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 3758096384, 2024-06-13T11:35:02.033 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-06-13T11:35:02.034 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 3015, 2024-06-13T11:35:02.034 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 6163262, 2024-06-13T11:35:02.034 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:02.034 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 3015, 2024-06-13T11:35:02.034 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-06-13T11:35:02.034 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-06-13T11:35:02.035 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 107, 2024-06-13T11:35:02.035 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 6163262, 2024-06-13T11:35:02.035 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-06-13T11:35:02.035 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:02.035 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:02.035 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:02.035 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:02.036 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:02.036 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-06-13T11:35:02.768 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-06-13T11:35:02.768 INFO:tasks.check_counter:Daemon mds.b mds.imported=59 2024-06-13T11:35:02.769 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-06-13T11:35:02.769 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-06-13T11:35:02.769 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-06-13T11:35:02.769 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=0 2024-06-13T11:35:02.769 DEBUG:tasks.check_counter:Getting stats from e 2024-06-13T11:35:02.769 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph daemon mds.e perf dump 2024-06-13T11:35:03.021 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T11:35:03.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:03 smithi077 ceph-mon[36410]: pgmap v349: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-06-13T11:35:03.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:03 smithi002 ceph-mon[32210]: pgmap v349: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-06-13T11:35:03.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:03 smithi178 ceph-mon[36913]: pgmap v349: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-06-13T11:35:04.702 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-06-13T11:35:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T11:35:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 378, 2024-06-13T11:35:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 380, 2024-06-13T11:35:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 4293739, 2024-06-13T11:35:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 120268, 2024-06-13T11:35:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 6, 2024-06-13T11:35:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 2, 2024-06-13T11:35:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.036089743, 2024-06-13T11:35:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.013724069, 2024-06-13T11:35:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.010077065, 2024-06-13T11:35:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.008331715, 2024-06-13T11:35:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 378, 2024-06-13T11:35:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.016429747, 2024-06-13T11:35:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000043464 2024-06-13T11:35:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-13T11:35:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 0 2024-06-13T11:35:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T11:35:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 806, 2024-06-13T11:35:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 1014, 2024-06-13T11:35:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 1584614, 2024-06-13T11:35:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 832511, 2024-06-13T11:35:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 8, 2024-06-13T11:35:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 5, 2024-06-13T11:35:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.086889698, 2024-06-13T11:35:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.032091074, 2024-06-13T11:35:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.020692951, 2024-06-13T11:35:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.024514515, 2024-06-13T11:35:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 1011, 2024-06-13T11:35:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.057525396, 2024-06-13T11:35:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000056899 2024-06-13T11:35:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 480, 2024-06-13T11:35:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 577152 2024-06-13T11:35:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T11:35:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 1735, 2024-06-13T11:35:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 1716, 2024-06-13T11:35:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 2081304, 2024-06-13T11:35:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 625072, 2024-06-13T11:35:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 4, 2024-06-13T11:35:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 3, 2024-06-13T11:35:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.213753227, 2024-06-13T11:35:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.070352274, 2024-06-13T11:35:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.077864903, 2024-06-13T11:35:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.059357076, 2024-06-13T11:35:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 1716, 2024-06-13T11:35:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.081112010, 2024-06-13T11:35:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000047268 2024-06-13T11:35:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 1650720, 2024-06-13T11:35:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 172240 2024-06-13T11:35:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: "cct": { 2024-06-13T11:35:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: "total_workers": 1, 2024-06-13T11:35:04.713 INFO:teuthology.orchestra.run.smithi077.stdout: "unhealthy_workers": 0 2024-06-13T11:35:04.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.713 INFO:teuthology.orchestra.run.smithi077.stdout: "finisher-MDSRank": { 2024-06-13T11:35:04.713 INFO:teuthology.orchestra.run.smithi077.stdout: "queue_len": 0, 2024-06-13T11:35:04.713 INFO:teuthology.orchestra.run.smithi077.stdout: "complete_latency": { 2024-06-13T11:35:04.713 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 4415, 2024-06-13T11:35:04.713 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.133366664, 2024-06-13T11:35:04.713 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000030207 2024-06-13T11:35:04.714 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:04.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.714 INFO:teuthology.orchestra.run.smithi077.stdout: "finisher-PurgeQueue": { 2024-06-13T11:35:04.714 INFO:teuthology.orchestra.run.smithi077.stdout: "queue_len": 0, 2024-06-13T11:35:04.714 INFO:teuthology.orchestra.run.smithi077.stdout: "complete_latency": { 2024-06-13T11:35:04.714 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.714 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.714 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.715 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:04.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.715 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-06-13T11:35:04.715 INFO:teuthology.orchestra.run.smithi077.stdout: "request": 0, 2024-06-13T11:35:04.715 INFO:teuthology.orchestra.run.smithi077.stdout: "reply": 0, 2024-06-13T11:35:04.715 INFO:teuthology.orchestra.run.smithi077.stdout: "reply_latency": { 2024-06-13T11:35:04.716 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.716 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.716 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.716 INFO:teuthology.orchestra.run.smithi077.stdout: "slow_reply": 0, 2024-06-13T11:35:04.716 INFO:teuthology.orchestra.run.smithi077.stdout: "forward": 0, 2024-06-13T11:35:04.716 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_fetch_complete": 0, 2024-06-13T11:35:04.717 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_fetch_keys": 0, 2024-06-13T11:35:04.717 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_commit": 0, 2024-06-13T11:35:04.717 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_split": 0, 2024-06-13T11:35:04.717 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_merge": 0, 2024-06-13T11:35:04.717 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes": 3501, 2024-06-13T11:35:04.717 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_top": 144, 2024-06-13T11:35:04.717 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_bottom": 3357, 2024-06-13T11:35:04.717 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_pin_tail": 0, 2024-06-13T11:35:04.718 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_pinned": 3295, 2024-06-13T11:35:04.718 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_expired": 0, 2024-06-13T11:35:04.718 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_with_caps": 0, 2024-06-13T11:35:04.718 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": 0, 2024-06-13T11:35:04.718 INFO:teuthology.orchestra.run.smithi077.stdout: "subtrees": 110, 2024-06-13T11:35:04.718 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse": 0, 2024-06-13T11:35:04.718 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_hit": 0, 2024-06-13T11:35:04.719 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_forward": 0, 2024-06-13T11:35:04.719 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_discover": 0, 2024-06-13T11:35:04.719 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_dir_fetch": 0, 2024-06-13T11:35:04.719 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_remote_ino": 0, 2024-06-13T11:35:04.719 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_lock": 0, 2024-06-13T11:35:04.719 INFO:teuthology.orchestra.run.smithi077.stdout: "load_cent": 0, 2024-06-13T11:35:04.719 INFO:teuthology.orchestra.run.smithi077.stdout: "q": 0, 2024-06-13T11:35:04.719 INFO:teuthology.orchestra.run.smithi077.stdout: "exported": 0, 2024-06-13T11:35:04.720 INFO:teuthology.orchestra.run.smithi077.stdout: "exported_inodes": 0, 2024-06-13T11:35:04.720 INFO:teuthology.orchestra.run.smithi077.stdout: "imported": 0, 2024-06-13T11:35:04.720 INFO:teuthology.orchestra.run.smithi077.stdout: "imported_inodes": 0, 2024-06-13T11:35:04.720 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_dir_fetch": 0, 2024-06-13T11:35:04.720 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_backtrace_fetch": 0, 2024-06-13T11:35:04.720 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_peer_discover": 0, 2024-06-13T11:35:04.720 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rfiles": 0, 2024-06-13T11:35:04.721 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rbytes": 0, 2024-06-13T11:35:04.721 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rsnaps": 0, 2024-06-13T11:35:04.721 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_backtrace_fetch": 0, 2024-06-13T11:35:04.721 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_set_tag": 0, 2024-06-13T11:35:04.721 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_backtrace_repaired": 0, 2024-06-13T11:35:04.721 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_inotable_repaired": 0, 2024-06-13T11:35:04.721 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dir_inodes": 0, 2024-06-13T11:35:04.721 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dir_base_inodes": 0, 2024-06-13T11:35:04.722 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dirfrag_rstats": 0, 2024-06-13T11:35:04.722 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_file_inodes": 0, 2024-06-13T11:35:04.722 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_inode_file_caps": 0, 2024-06-13T11:35:04.722 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_revoke": 0, 2024-06-13T11:35:04.722 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_grant": 0, 2024-06-13T11:35:04.722 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_trunc": 0, 2024-06-13T11:35:04.722 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-13T11:35:04.723 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-13T11:35:04.723 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_caps": 0, 2024-06-13T11:35:04.723 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_caps_dirty": 0, 2024-06-13T11:35:04.723 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_cap_release": 0, 2024-06-13T11:35:04.723 INFO:teuthology.orchestra.run.smithi077.stdout: "process_request_cap_release": 0 2024-06-13T11:35:04.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.723 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache": { 2024-06-13T11:35:04.724 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_update": 0, 2024-06-13T11:35:04.724 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_update_receipt": 0, 2024-06-13T11:35:04.724 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_try_discover": 0, 2024-06-13T11:35:04.724 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_send_discover": 0, 2024-06-13T11:35:04.724 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_handle_discover": 0, 2024-06-13T11:35:04.724 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays": 0, 2024-06-13T11:35:04.724 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays_delayed": 0, 2024-06-13T11:35:04.725 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays_enqueuing": 0, 2024-06-13T11:35:04.725 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_created": 0, 2024-06-13T11:35:04.725 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_enqueued": 0, 2024-06-13T11:35:04.725 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_reintegrated": 0, 2024-06-13T11:35:04.725 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_migrated": 0, 2024-06-13T11:35:04.725 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_processing": 0, 2024-06-13T11:35:04.725 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_enqueued": 0, 2024-06-13T11:35:04.726 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_prioritized": 0, 2024-06-13T11:35:04.726 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_started": 0, 2024-06-13T11:35:04.726 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_completed": 0, 2024-06-13T11:35:04.726 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_quiesce_path": 0, 2024-06-13T11:35:04.726 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_quiesce_inode": 0, 2024-06-13T11:35:04.726 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_enqueue_scrub": 0, 2024-06-13T11:35:04.726 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_exportdir": 0, 2024-06-13T11:35:04.727 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_flush": 0, 2024-06-13T11:35:04.727 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_fragmentdir": 0, 2024-06-13T11:35:04.727 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_fragstats": 0, 2024-06-13T11:35:04.727 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_inodestats": 0 2024-06-13T11:35:04.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.727 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log": { 2024-06-13T11:35:04.727 INFO:teuthology.orchestra.run.smithi077.stdout: "evlrg": 0, 2024-06-13T11:35:04.727 INFO:teuthology.orchestra.run.smithi077.stdout: "evadd": 0, 2024-06-13T11:35:04.728 INFO:teuthology.orchestra.run.smithi077.stdout: "evex": 0, 2024-06-13T11:35:04.728 INFO:teuthology.orchestra.run.smithi077.stdout: "evtrm": 0, 2024-06-13T11:35:04.728 INFO:teuthology.orchestra.run.smithi077.stdout: "ev": 2444, 2024-06-13T11:35:04.728 INFO:teuthology.orchestra.run.smithi077.stdout: "evexg": 0, 2024-06-13T11:35:04.728 INFO:teuthology.orchestra.run.smithi077.stdout: "evexd": 0, 2024-06-13T11:35:04.728 INFO:teuthology.orchestra.run.smithi077.stdout: "segadd": 0, 2024-06-13T11:35:04.728 INFO:teuthology.orchestra.run.smithi077.stdout: "segex": 0, 2024-06-13T11:35:04.728 INFO:teuthology.orchestra.run.smithi077.stdout: "segtrm": 0, 2024-06-13T11:35:04.729 INFO:teuthology.orchestra.run.smithi077.stdout: "seg": 5, 2024-06-13T11:35:04.729 INFO:teuthology.orchestra.run.smithi077.stdout: "segmjr": 2, 2024-06-13T11:35:04.729 INFO:teuthology.orchestra.run.smithi077.stdout: "segexg": 0, 2024-06-13T11:35:04.729 INFO:teuthology.orchestra.run.smithi077.stdout: "segexd": 0, 2024-06-13T11:35:04.729 INFO:teuthology.orchestra.run.smithi077.stdout: "expos": 4194304, 2024-06-13T11:35:04.729 INFO:teuthology.orchestra.run.smithi077.stdout: "wrpos": 9766638, 2024-06-13T11:35:04.729 INFO:teuthology.orchestra.run.smithi077.stdout: "rdpos": 9766064, 2024-06-13T11:35:04.729 INFO:teuthology.orchestra.run.smithi077.stdout: "jlat": { 2024-06-13T11:35:04.730 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.730 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.730 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.730 INFO:teuthology.orchestra.run.smithi077.stdout: "replayed": 2444 2024-06-13T11:35:04.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.730 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_mem": { 2024-06-13T11:35:04.730 INFO:teuthology.orchestra.run.smithi077.stdout: "ino": 2389, 2024-06-13T11:35:04.730 INFO:teuthology.orchestra.run.smithi077.stdout: "ino+": 2614, 2024-06-13T11:35:04.731 INFO:teuthology.orchestra.run.smithi077.stdout: "ino-": 225, 2024-06-13T11:35:04.731 INFO:teuthology.orchestra.run.smithi077.stdout: "dir": 138, 2024-06-13T11:35:04.731 INFO:teuthology.orchestra.run.smithi077.stdout: "dir+": 138, 2024-06-13T11:35:04.731 INFO:teuthology.orchestra.run.smithi077.stdout: "dir-": 0, 2024-06-13T11:35:04.731 INFO:teuthology.orchestra.run.smithi077.stdout: "dn": 3501, 2024-06-13T11:35:04.731 INFO:teuthology.orchestra.run.smithi077.stdout: "dn+": 3501, 2024-06-13T11:35:04.731 INFO:teuthology.orchestra.run.smithi077.stdout: "dn-": 0, 2024-06-13T11:35:04.731 INFO:teuthology.orchestra.run.smithi077.stdout: "cap": 0, 2024-06-13T11:35:04.732 INFO:teuthology.orchestra.run.smithi077.stdout: "cap+": 0, 2024-06-13T11:35:04.732 INFO:teuthology.orchestra.run.smithi077.stdout: "cap-": 0, 2024-06-13T11:35:04.732 INFO:teuthology.orchestra.run.smithi077.stdout: "rss": 62180, 2024-06-13T11:35:04.732 INFO:teuthology.orchestra.run.smithi077.stdout: "heap": 215420 2024-06-13T11:35:04.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.732 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_server": { 2024-06-13T11:35:04.732 INFO:teuthology.orchestra.run.smithi077.stdout: "dispatch_client_request": 0, 2024-06-13T11:35:04.733 INFO:teuthology.orchestra.run.smithi077.stdout: "dispatch_server_request": 0, 2024-06-13T11:35:04.733 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_request": 0, 2024-06-13T11:35:04.733 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_session": 0, 2024-06-13T11:35:04.733 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_peer_request": 0, 2024-06-13T11:35:04.733 INFO:teuthology.orchestra.run.smithi077.stdout: "req_create_latency": { 2024-06-13T11:35:04.733 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.733 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.734 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.734 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getattr_latency": { 2024-06-13T11:35:04.734 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.734 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.735 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.735 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getfilelock_latency": { 2024-06-13T11:35:04.735 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.735 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.735 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.736 INFO:teuthology.orchestra.run.smithi077.stdout: "req_link_latency": { 2024-06-13T11:35:04.736 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.736 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.736 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.737 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookup_latency": { 2024-06-13T11:35:04.737 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.737 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.737 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.737 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookuphash_latency": { 2024-06-13T11:35:04.737 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.738 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.738 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.738 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupino_latency": { 2024-06-13T11:35:04.738 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.738 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.739 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.739 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupname_latency": { 2024-06-13T11:35:04.739 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.739 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.739 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.740 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupparent_latency": { 2024-06-13T11:35:04.740 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.740 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.740 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.740 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupsnap_latency": { 2024-06-13T11:35:04.740 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.741 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.741 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.741 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lssnap_latency": { 2024-06-13T11:35:04.741 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.741 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.741 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.742 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mkdir_latency": { 2024-06-13T11:35:04.742 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.742 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.742 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.743 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mknod_latency": { 2024-06-13T11:35:04.743 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.743 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.743 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.743 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mksnap_latency": { 2024-06-13T11:35:04.743 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.743 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.744 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.744 INFO:teuthology.orchestra.run.smithi077.stdout: "req_open_latency": { 2024-06-13T11:35:04.744 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.744 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.744 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.744 INFO:teuthology.orchestra.run.smithi077.stdout: "req_readdir_latency": { 2024-06-13T11:35:04.744 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.745 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.745 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.745 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rename_latency": { 2024-06-13T11:35:04.745 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.745 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.745 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.746 INFO:teuthology.orchestra.run.smithi077.stdout: "req_renamesnap_latency": { 2024-06-13T11:35:04.746 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.746 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.746 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.746 INFO:teuthology.orchestra.run.smithi077.stdout: "req_snapdiff_latency": { 2024-06-13T11:35:04.746 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.746 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.747 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.747 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmdir_latency": { 2024-06-13T11:35:04.747 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.747 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.747 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.747 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmsnap_latency": { 2024-06-13T11:35:04.747 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.748 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.748 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.748 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmxattr_latency": { 2024-06-13T11:35:04.748 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.748 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.748 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.749 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setattr_latency": { 2024-06-13T11:35:04.749 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.749 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.749 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.749 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setdirlayout_latency": { 2024-06-13T11:35:04.749 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.749 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.750 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.750 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setfilelock_latency": { 2024-06-13T11:35:04.750 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.750 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.750 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.750 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setlayout_latency": { 2024-06-13T11:35:04.751 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.751 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.751 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.751 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setxattr_latency": { 2024-06-13T11:35:04.751 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.751 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.751 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.752 INFO:teuthology.orchestra.run.smithi077.stdout: "req_symlink_latency": { 2024-06-13T11:35:04.752 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.752 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.752 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.752 INFO:teuthology.orchestra.run.smithi077.stdout: "req_unlink_latency": { 2024-06-13T11:35:04.752 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.753 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.753 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.753 INFO:teuthology.orchestra.run.smithi077.stdout: "cap_revoke_eviction": 0, 2024-06-13T11:35:04.753 INFO:teuthology.orchestra.run.smithi077.stdout: "cap_acquisition_throttle": 0, 2024-06-13T11:35:04.753 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getvxattr_latency": { 2024-06-13T11:35:04.753 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.753 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.753 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_sessions": { 2024-06-13T11:35:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: "session_count": 2, 2024-06-13T11:35:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: "session_add": 4, 2024-06-13T11:35:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: "session_remove": 2, 2024-06-13T11:35:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: "sessions_open": 2, 2024-06-13T11:35:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: "sessions_stale": 0, 2024-06-13T11:35:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "total_load": 0, 2024-06-13T11:35:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "average_load": 0, 2024-06-13T11:35:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "avg_session_uptime": 4354, 2024-06-13T11:35:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "mdthresh_evicted": 0 2024-06-13T11:35:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "mempool": { 2024-06-13T11:35:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_bytes": 0, 2024-06-13T11:35:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_items": 0, 2024-06-13T11:35:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T11:35:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_items": 0, 2024-06-13T11:35:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T11:35:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_items": 0, 2024-06-13T11:35:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T11:35:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T11:35:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T11:35:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T11:35:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T11:35:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_items": 0, 2024-06-13T11:35:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T11:35:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T11:35:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_bytes": 0, 2024-06-13T11:35:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_items": 0, 2024-06-13T11:35:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_bytes": 0, 2024-06-13T11:35:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_items": 0, 2024-06-13T11:35:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T11:35:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T11:35:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T11:35:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T11:35:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T11:35:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_items": 0, 2024-06-13T11:35:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_bytes": 0, 2024-06-13T11:35:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_items": 0, 2024-06-13T11:35:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T11:35:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T11:35:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_bytes": 0, 2024-06-13T11:35:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_items": 0, 2024-06-13T11:35:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_bytes": 0, 2024-06-13T11:35:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_items": 0, 2024-06-13T11:35:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T11:35:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_items": 0, 2024-06-13T11:35:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T11:35:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_items": 0, 2024-06-13T11:35:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_bytes": 287464, 2024-06-13T11:35:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_items": 2450, 2024-06-13T11:35:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_bytes": 0, 2024-06-13T11:35:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_items": 0, 2024-06-13T11:35:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bytes": 0, 2024-06-13T11:35:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_items": 0, 2024-06-13T11:35:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_bytes": 0, 2024-06-13T11:35:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_items": 0, 2024-06-13T11:35:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_bytes": 0, 2024-06-13T11:35:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_items": 0, 2024-06-13T11:35:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_bytes": 9432, 2024-06-13T11:35:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_items": 182, 2024-06-13T11:35:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T11:35:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_items": 0, 2024-06-13T11:35:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_bytes": 0, 2024-06-13T11:35:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_items": 0, 2024-06-13T11:35:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_bytes": 8170022, 2024-06-13T11:35:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_items": 72263, 2024-06-13T11:35:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_bytes": 0, 2024-06-13T11:35:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_items": 0, 2024-06-13T11:35:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_bytes": 0, 2024-06-13T11:35:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_items": 0 2024-06-13T11:35:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter": { 2024-06-13T11:35:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: "op_active": 0, 2024-06-13T11:35:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "op_laggy": 0, 2024-06-13T11:35:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "op_send": 2605, 2024-06-13T11:35:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "op_send_bytes": 21, 2024-06-13T11:35:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "op_resend": 3, 2024-06-13T11:35:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "op_reply": 2605, 2024-06-13T11:35:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "op_latency": { 2024-06-13T11:35:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 2605, 2024-06-13T11:35:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 2.026959772, 2024-06-13T11:35:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000778103 2024-06-13T11:35:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: "op_inflight": 0, 2024-06-13T11:35:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: "oplen_avg": { 2024-06-13T11:35:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 2605, 2024-06-13T11:35:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 2606 2024-06-13T11:35:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: "op": 2605, 2024-06-13T11:35:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: "op_r": 2605, 2024-06-13T11:35:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "op_w": 0, 2024-06-13T11:35:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "op_rmw": 0, 2024-06-13T11:35:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "op_pg": 0, 2024-06-13T11:35:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_stat": 1679, 2024-06-13T11:35:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_create": 0, 2024-06-13T11:35:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_read": 924, 2024-06-13T11:35:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_write": 0, 2024-06-13T11:35:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_writefull": 0, 2024-06-13T11:35:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_writesame": 0, 2024-06-13T11:35:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_append": 0, 2024-06-13T11:35:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_zero": 0, 2024-06-13T11:35:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_truncate": 0, 2024-06-13T11:35:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_delete": 0, 2024-06-13T11:35:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_mapext": 0, 2024-06-13T11:35:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_sparse_read": 0, 2024-06-13T11:35:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_clonerange": 0, 2024-06-13T11:35:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_getxattr": 1, 2024-06-13T11:35:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_setxattr": 0, 2024-06-13T11:35:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_cmpxattr": 0, 2024-06-13T11:35:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_rmxattr": 0, 2024-06-13T11:35:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_resetxattrs": 0, 2024-06-13T11:35:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_call": 0, 2024-06-13T11:35:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_watch": 0, 2024-06-13T11:35:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_notify": 0, 2024-06-13T11:35:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_src_cmpxattr": 0, 2024-06-13T11:35:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_pgls": 0, 2024-06-13T11:35:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_pgls_filter": 0, 2024-06-13T11:35:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_other": 0, 2024-06-13T11:35:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_active": 0, 2024-06-13T11:35:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_send": 0, 2024-06-13T11:35:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_resend": 0, 2024-06-13T11:35:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_ping": 0, 2024-06-13T11:35:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_active": 0, 2024-06-13T11:35:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_send": 0, 2024-06-13T11:35:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_resend": 0, 2024-06-13T11:35:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_active": 0, 2024-06-13T11:35:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_send": 0, 2024-06-13T11:35:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_resend": 0, 2024-06-13T11:35:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_active": 0, 2024-06-13T11:35:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_send": 0, 2024-06-13T11:35:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_resend": 0, 2024-06-13T11:35:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "command_active": 0, 2024-06-13T11:35:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "command_send": 0, 2024-06-13T11:35:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "command_resend": 0, 2024-06-13T11:35:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: "map_epoch": 108, 2024-06-13T11:35:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: "map_full": 0, 2024-06-13T11:35:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: "map_inc": 11, 2024-06-13T11:35:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_sessions": 6, 2024-06-13T11:35:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_session_open": 6, 2024-06-13T11:35:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_session_close": 0, 2024-06-13T11:35:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_laggy": 0, 2024-06-13T11:35:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_wr": 0, 2024-06-13T11:35:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_rd": 2, 2024-06-13T11:35:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_del": 0 2024-06-13T11:35:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "oft": { 2024-06-13T11:35:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_objs": 0, 2024-06-13T11:35:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_kv_pairs": 0, 2024-06-13T11:35:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_updates": 0, 2024-06-13T11:35:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_removes": 0 2024-06-13T11:35:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "osd-slow-ops": { 2024-06-13T11:35:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "slow_ops_count": 0 2024-06-13T11:35:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "purge_queue": { 2024-06-13T11:35:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_ops": 0, 2024-06-13T11:35:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_ops_high_water": 0, 2024-06-13T11:35:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing": 0, 2024-06-13T11:35:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_high_water": 0, 2024-06-13T11:35:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executed_ops": 0, 2024-06-13T11:35:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executed": 0, 2024-06-13T11:35:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_item_in_journal": 0 2024-06-13T11:35:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T11:35:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-06-13T11:35:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-06-13T11:35:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-06-13T11:35:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 2915, 2024-06-13T11:35:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 7678549, 2024-06-13T11:35:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 2915, 2024-06-13T11:35:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-06-13T11:35:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-06-13T11:35:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 2915, 2024-06-13T11:35:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 7678549, 2024-06-13T11:35:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-06-13T11:35:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-objecter_bytes": { 2024-06-13T11:35:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-06-13T11:35:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-06-13T11:35:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-06-13T11:35:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-06-13T11:35:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-06-13T11:35:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 2605, 2024-06-13T11:35:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 5572339, 2024-06-13T11:35:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 2605, 2024-06-13T11:35:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 5572339, 2024-06-13T11:35:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-06-13T11:35:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-objecter_ops": { 2024-06-13T11:35:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-06-13T11:35:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 1024, 2024-06-13T11:35:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-06-13T11:35:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-06-13T11:35:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-06-13T11:35:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 2605, 2024-06-13T11:35:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 2605, 2024-06-13T11:35:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 2605, 2024-06-13T11:35:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 2605, 2024-06-13T11:35:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-06-13T11:35:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-write_buf_throttle": { 2024-06-13T11:35:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-06-13T11:35:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 3758096384, 2024-06-13T11:35:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-06-13T11:35:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-06-13T11:35:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-06-13T11:35:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-06-13T11:35:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-06-13T11:35:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 0, 2024-06-13T11:35:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 0, 2024-06-13T11:35:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-06-13T11:35:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-write_buf_throttle-0x55a5930066e0": { 2024-06-13T11:35:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-06-13T11:35:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 3758096384, 2024-06-13T11:35:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-06-13T11:35:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-06-13T11:35:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-06-13T11:35:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-06-13T11:35:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-06-13T11:35:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 0, 2024-06-13T11:35:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 0, 2024-06-13T11:35:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-06-13T11:35:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:04.785 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-06-13T11:35:05.556 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-06-13T11:35:05.556 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-06-13T11:35:05.556 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-06-13T11:35:05.556 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-06-13T11:35:05.556 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-06-13T11:35:05.556 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-06-13T11:35:05.557 DEBUG:tasks.check_counter:Getting stats from h 2024-06-13T11:35:05.557 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph daemon mds.h perf dump 2024-06-13T11:35:05.789 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:05 smithi077 ceph-mon[36410]: pgmap v350: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:35:05.791 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T11:35:05.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:05 smithi002 ceph-mon[32210]: pgmap v350: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:35:05.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:05 smithi178 ceph-mon[36913]: pgmap v350: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:35:07.541 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-06-13T11:35:07.542 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T11:35:07.542 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 2620, 2024-06-13T11:35:07.542 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 2622, 2024-06-13T11:35:07.542 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 6903701, 2024-06-13T11:35:07.542 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 833167, 2024-06-13T11:35:07.542 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 6, 2024-06-13T11:35:07.542 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 2, 2024-06-13T11:35:07.543 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.207624376, 2024-06-13T11:35:07.543 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.068021746, 2024-06-13T11:35:07.543 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.052685369, 2024-06-13T11:35:07.543 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.070407765, 2024-06-13T11:35:07.543 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:07.543 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 2620, 2024-06-13T11:35:07.543 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.086930719, 2024-06-13T11:35:07.543 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000033179 2024-06-13T11:35:07.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.544 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:07.544 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.544 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.544 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.544 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-13T11:35:07.544 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 0 2024-06-13T11:35:07.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.545 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T11:35:07.545 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 8, 2024-06-13T11:35:07.545 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 212, 2024-06-13T11:35:07.545 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 3868, 2024-06-13T11:35:07.545 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 499658, 2024-06-13T11:35:07.545 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 6, 2024-06-13T11:35:07.545 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 4, 2024-06-13T11:35:07.545 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.012751580, 2024-06-13T11:35:07.545 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.008332043, 2024-06-13T11:35:07.546 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.001936333, 2024-06-13T11:35:07.546 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.000209332, 2024-06-13T11:35:07.546 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:07.546 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 210, 2024-06-13T11:35:07.546 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.034183901, 2024-06-13T11:35:07.546 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000162780 2024-06-13T11:35:07.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.546 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:07.547 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.547 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.547 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.547 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-06-13T11:35:07.547 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 498960 2024-06-13T11:35:07.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.547 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T11:35:07.547 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 307, 2024-06-13T11:35:07.548 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 290, 2024-06-13T11:35:07.548 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 1648764, 2024-06-13T11:35:07.548 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 171006, 2024-06-13T11:35:07.548 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 3, 2024-06-13T11:35:07.548 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 2, 2024-06-13T11:35:07.548 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.056624875, 2024-06-13T11:35:07.548 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.018833098, 2024-06-13T11:35:07.548 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.037413288, 2024-06-13T11:35:07.548 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.007169425, 2024-06-13T11:35:07.549 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:07.549 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 289, 2024-06-13T11:35:07.549 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.015620259, 2024-06-13T11:35:07.549 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000054049 2024-06-13T11:35:07.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.549 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:07.549 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.549 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.550 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.550 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 1648496, 2024-06-13T11:35:07.550 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 170688 2024-06-13T11:35:07.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.550 INFO:teuthology.orchestra.run.smithi077.stdout: "cct": { 2024-06-13T11:35:07.550 INFO:teuthology.orchestra.run.smithi077.stdout: "total_workers": 1, 2024-06-13T11:35:07.550 INFO:teuthology.orchestra.run.smithi077.stdout: "unhealthy_workers": 0 2024-06-13T11:35:07.551 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.551 INFO:teuthology.orchestra.run.smithi077.stdout: "finisher-MDSRank": { 2024-06-13T11:35:07.551 INFO:teuthology.orchestra.run.smithi077.stdout: "queue_len": 0, 2024-06-13T11:35:07.551 INFO:teuthology.orchestra.run.smithi077.stdout: "complete_latency": { 2024-06-13T11:35:07.551 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 4303, 2024-06-13T11:35:07.551 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.111005940, 2024-06-13T11:35:07.551 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000025797 2024-06-13T11:35:07.551 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:07.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.552 INFO:teuthology.orchestra.run.smithi077.stdout: "finisher-PurgeQueue": { 2024-06-13T11:35:07.552 INFO:teuthology.orchestra.run.smithi077.stdout: "queue_len": 0, 2024-06-13T11:35:07.552 INFO:teuthology.orchestra.run.smithi077.stdout: "complete_latency": { 2024-06-13T11:35:07.552 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.552 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.552 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.552 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:07.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.553 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-06-13T11:35:07.553 INFO:teuthology.orchestra.run.smithi077.stdout: "request": 0, 2024-06-13T11:35:07.553 INFO:teuthology.orchestra.run.smithi077.stdout: "reply": 0, 2024-06-13T11:35:07.553 INFO:teuthology.orchestra.run.smithi077.stdout: "reply_latency": { 2024-06-13T11:35:07.553 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.553 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.553 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.554 INFO:teuthology.orchestra.run.smithi077.stdout: "slow_reply": 0, 2024-06-13T11:35:07.554 INFO:teuthology.orchestra.run.smithi077.stdout: "forward": 0, 2024-06-13T11:35:07.554 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_fetch_complete": 0, 2024-06-13T11:35:07.554 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_fetch_keys": 0, 2024-06-13T11:35:07.554 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_commit": 0, 2024-06-13T11:35:07.554 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_split": 0, 2024-06-13T11:35:07.554 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_merge": 0, 2024-06-13T11:35:07.554 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes": 2563, 2024-06-13T11:35:07.555 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_top": 25, 2024-06-13T11:35:07.555 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_bottom": 2538, 2024-06-13T11:35:07.555 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_pin_tail": 0, 2024-06-13T11:35:07.555 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_pinned": 2527, 2024-06-13T11:35:07.555 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_expired": 0, 2024-06-13T11:35:07.555 INFO:teuthology.orchestra.run.smithi077.stdout: "inodes_with_caps": 0, 2024-06-13T11:35:07.555 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": 0, 2024-06-13T11:35:07.555 INFO:teuthology.orchestra.run.smithi077.stdout: "subtrees": 61, 2024-06-13T11:35:07.555 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse": 0, 2024-06-13T11:35:07.556 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_hit": 0, 2024-06-13T11:35:07.556 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_forward": 0, 2024-06-13T11:35:07.556 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_discover": 0, 2024-06-13T11:35:07.556 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_dir_fetch": 0, 2024-06-13T11:35:07.556 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_remote_ino": 0, 2024-06-13T11:35:07.556 INFO:teuthology.orchestra.run.smithi077.stdout: "traverse_lock": 0, 2024-06-13T11:35:07.556 INFO:teuthology.orchestra.run.smithi077.stdout: "load_cent": 0, 2024-06-13T11:35:07.556 INFO:teuthology.orchestra.run.smithi077.stdout: "q": 0, 2024-06-13T11:35:07.557 INFO:teuthology.orchestra.run.smithi077.stdout: "exported": 0, 2024-06-13T11:35:07.557 INFO:teuthology.orchestra.run.smithi077.stdout: "exported_inodes": 0, 2024-06-13T11:35:07.557 INFO:teuthology.orchestra.run.smithi077.stdout: "imported": 0, 2024-06-13T11:35:07.557 INFO:teuthology.orchestra.run.smithi077.stdout: "imported_inodes": 0, 2024-06-13T11:35:07.557 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_dir_fetch": 0, 2024-06-13T11:35:07.557 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_backtrace_fetch": 0, 2024-06-13T11:35:07.557 INFO:teuthology.orchestra.run.smithi077.stdout: "openino_peer_discover": 0, 2024-06-13T11:35:07.557 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rfiles": 0, 2024-06-13T11:35:07.557 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rbytes": 0, 2024-06-13T11:35:07.558 INFO:teuthology.orchestra.run.smithi077.stdout: "root_rsnaps": 0, 2024-06-13T11:35:07.558 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_backtrace_fetch": 0, 2024-06-13T11:35:07.558 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_set_tag": 0, 2024-06-13T11:35:07.558 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_backtrace_repaired": 0, 2024-06-13T11:35:07.558 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_inotable_repaired": 0, 2024-06-13T11:35:07.558 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dir_inodes": 0, 2024-06-13T11:35:07.558 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dir_base_inodes": 0, 2024-06-13T11:35:07.558 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_dirfrag_rstats": 0, 2024-06-13T11:35:07.559 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_file_inodes": 0, 2024-06-13T11:35:07.559 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_inode_file_caps": 0, 2024-06-13T11:35:07.559 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_revoke": 0, 2024-06-13T11:35:07.559 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_grant": 0, 2024-06-13T11:35:07.559 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_trunc": 0, 2024-06-13T11:35:07.559 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-13T11:35:07.559 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-13T11:35:07.559 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_caps": 0, 2024-06-13T11:35:07.560 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_caps_dirty": 0, 2024-06-13T11:35:07.560 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_cap_release": 0, 2024-06-13T11:35:07.560 INFO:teuthology.orchestra.run.smithi077.stdout: "process_request_cap_release": 0 2024-06-13T11:35:07.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.560 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache": { 2024-06-13T11:35:07.560 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_update": 0, 2024-06-13T11:35:07.560 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_update_receipt": 0, 2024-06-13T11:35:07.560 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_try_discover": 0, 2024-06-13T11:35:07.561 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_send_discover": 0, 2024-06-13T11:35:07.561 INFO:teuthology.orchestra.run.smithi077.stdout: "dir_handle_discover": 0, 2024-06-13T11:35:07.561 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays": 0, 2024-06-13T11:35:07.561 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays_delayed": 0, 2024-06-13T11:35:07.561 INFO:teuthology.orchestra.run.smithi077.stdout: "num_strays_enqueuing": 0, 2024-06-13T11:35:07.561 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_created": 0, 2024-06-13T11:35:07.561 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_enqueued": 0, 2024-06-13T11:35:07.561 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_reintegrated": 0, 2024-06-13T11:35:07.561 INFO:teuthology.orchestra.run.smithi077.stdout: "strays_migrated": 0, 2024-06-13T11:35:07.562 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_processing": 0, 2024-06-13T11:35:07.562 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_enqueued": 0, 2024-06-13T11:35:07.562 INFO:teuthology.orchestra.run.smithi077.stdout: "num_recovering_prioritized": 0, 2024-06-13T11:35:07.562 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_started": 0, 2024-06-13T11:35:07.562 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_completed": 0, 2024-06-13T11:35:07.562 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_quiesce_path": 0, 2024-06-13T11:35:07.562 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_quiesce_inode": 0, 2024-06-13T11:35:07.562 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_enqueue_scrub": 0, 2024-06-13T11:35:07.562 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_exportdir": 0, 2024-06-13T11:35:07.563 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_flush": 0, 2024-06-13T11:35:07.563 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_fragmentdir": 0, 2024-06-13T11:35:07.563 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_fragstats": 0, 2024-06-13T11:35:07.563 INFO:teuthology.orchestra.run.smithi077.stdout: "ireq_inodestats": 0 2024-06-13T11:35:07.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.563 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log": { 2024-06-13T11:35:07.563 INFO:teuthology.orchestra.run.smithi077.stdout: "evlrg": 0, 2024-06-13T11:35:07.563 INFO:teuthology.orchestra.run.smithi077.stdout: "evadd": 0, 2024-06-13T11:35:07.563 INFO:teuthology.orchestra.run.smithi077.stdout: "evex": 0, 2024-06-13T11:35:07.564 INFO:teuthology.orchestra.run.smithi077.stdout: "evtrm": 0, 2024-06-13T11:35:07.564 INFO:teuthology.orchestra.run.smithi077.stdout: "ev": 3015, 2024-06-13T11:35:07.564 INFO:teuthology.orchestra.run.smithi077.stdout: "evexg": 0, 2024-06-13T11:35:07.564 INFO:teuthology.orchestra.run.smithi077.stdout: "evexd": 0, 2024-06-13T11:35:07.564 INFO:teuthology.orchestra.run.smithi077.stdout: "segadd": 0, 2024-06-13T11:35:07.564 INFO:teuthology.orchestra.run.smithi077.stdout: "segex": 0, 2024-06-13T11:35:07.564 INFO:teuthology.orchestra.run.smithi077.stdout: "segtrm": 0, 2024-06-13T11:35:07.564 INFO:teuthology.orchestra.run.smithi077.stdout: "seg": 5, 2024-06-13T11:35:07.565 INFO:teuthology.orchestra.run.smithi077.stdout: "segmjr": 2, 2024-06-13T11:35:07.565 INFO:teuthology.orchestra.run.smithi077.stdout: "segexg": 0, 2024-06-13T11:35:07.565 INFO:teuthology.orchestra.run.smithi077.stdout: "segexd": 0, 2024-06-13T11:35:07.565 INFO:teuthology.orchestra.run.smithi077.stdout: "expos": 4194304, 2024-06-13T11:35:07.565 INFO:teuthology.orchestra.run.smithi077.stdout: "wrpos": 10357566, 2024-06-13T11:35:07.565 INFO:teuthology.orchestra.run.smithi077.stdout: "rdpos": 10356992, 2024-06-13T11:35:07.565 INFO:teuthology.orchestra.run.smithi077.stdout: "jlat": { 2024-06-13T11:35:07.565 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.566 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.566 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.566 INFO:teuthology.orchestra.run.smithi077.stdout: "replayed": 3015 2024-06-13T11:35:07.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.566 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_mem": { 2024-06-13T11:35:07.566 INFO:teuthology.orchestra.run.smithi077.stdout: "ino": 1757, 2024-06-13T11:35:07.566 INFO:teuthology.orchestra.run.smithi077.stdout: "ino+": 2117, 2024-06-13T11:35:07.566 INFO:teuthology.orchestra.run.smithi077.stdout: "ino-": 360, 2024-06-13T11:35:07.567 INFO:teuthology.orchestra.run.smithi077.stdout: "dir": 89, 2024-06-13T11:35:07.567 INFO:teuthology.orchestra.run.smithi077.stdout: "dir+": 89, 2024-06-13T11:35:07.567 INFO:teuthology.orchestra.run.smithi077.stdout: "dir-": 0, 2024-06-13T11:35:07.567 INFO:teuthology.orchestra.run.smithi077.stdout: "dn": 2563, 2024-06-13T11:35:07.567 INFO:teuthology.orchestra.run.smithi077.stdout: "dn+": 2563, 2024-06-13T11:35:07.567 INFO:teuthology.orchestra.run.smithi077.stdout: "dn-": 0, 2024-06-13T11:35:07.567 INFO:teuthology.orchestra.run.smithi077.stdout: "cap": 0, 2024-06-13T11:35:07.567 INFO:teuthology.orchestra.run.smithi077.stdout: "cap+": 0, 2024-06-13T11:35:07.567 INFO:teuthology.orchestra.run.smithi077.stdout: "cap-": 0, 2024-06-13T11:35:07.568 INFO:teuthology.orchestra.run.smithi077.stdout: "rss": 60360, 2024-06-13T11:35:07.568 INFO:teuthology.orchestra.run.smithi077.stdout: "heap": 215420 2024-06-13T11:35:07.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.568 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_server": { 2024-06-13T11:35:07.568 INFO:teuthology.orchestra.run.smithi077.stdout: "dispatch_client_request": 0, 2024-06-13T11:35:07.568 INFO:teuthology.orchestra.run.smithi077.stdout: "dispatch_server_request": 0, 2024-06-13T11:35:07.568 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_request": 0, 2024-06-13T11:35:07.568 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_client_session": 0, 2024-06-13T11:35:07.568 INFO:teuthology.orchestra.run.smithi077.stdout: "handle_peer_request": 0, 2024-06-13T11:35:07.569 INFO:teuthology.orchestra.run.smithi077.stdout: "req_create_latency": { 2024-06-13T11:35:07.569 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.569 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.569 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.569 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getattr_latency": { 2024-06-13T11:35:07.569 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.569 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.570 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.570 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getfilelock_latency": { 2024-06-13T11:35:07.570 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.570 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.570 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.570 INFO:teuthology.orchestra.run.smithi077.stdout: "req_link_latency": { 2024-06-13T11:35:07.571 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.571 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.571 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.571 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookup_latency": { 2024-06-13T11:35:07.571 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.571 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.571 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.572 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookuphash_latency": { 2024-06-13T11:35:07.572 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.572 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.572 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.572 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupino_latency": { 2024-06-13T11:35:07.572 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.572 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.573 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.573 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupname_latency": { 2024-06-13T11:35:07.573 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.573 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.573 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.573 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupparent_latency": { 2024-06-13T11:35:07.574 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.574 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.574 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.574 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lookupsnap_latency": { 2024-06-13T11:35:07.574 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.574 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.574 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.575 INFO:teuthology.orchestra.run.smithi077.stdout: "req_lssnap_latency": { 2024-06-13T11:35:07.575 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.575 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.575 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.575 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mkdir_latency": { 2024-06-13T11:35:07.576 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.576 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.576 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.576 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mknod_latency": { 2024-06-13T11:35:07.577 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.577 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.577 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.577 INFO:teuthology.orchestra.run.smithi077.stdout: "req_mksnap_latency": { 2024-06-13T11:35:07.577 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.577 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.577 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.578 INFO:teuthology.orchestra.run.smithi077.stdout: "req_open_latency": { 2024-06-13T11:35:07.578 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.578 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.578 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.578 INFO:teuthology.orchestra.run.smithi077.stdout: "req_readdir_latency": { 2024-06-13T11:35:07.578 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.579 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.579 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.579 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rename_latency": { 2024-06-13T11:35:07.579 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.579 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.579 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.580 INFO:teuthology.orchestra.run.smithi077.stdout: "req_renamesnap_latency": { 2024-06-13T11:35:07.580 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.580 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.580 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.580 INFO:teuthology.orchestra.run.smithi077.stdout: "req_snapdiff_latency": { 2024-06-13T11:35:07.580 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.581 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.581 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.581 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmdir_latency": { 2024-06-13T11:35:07.581 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.581 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.581 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.582 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmsnap_latency": { 2024-06-13T11:35:07.582 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.582 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.582 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.582 INFO:teuthology.orchestra.run.smithi077.stdout: "req_rmxattr_latency": { 2024-06-13T11:35:07.582 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.582 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.583 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.583 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setattr_latency": { 2024-06-13T11:35:07.583 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.583 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.583 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.584 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setdirlayout_latency": { 2024-06-13T11:35:07.584 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.584 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.584 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.584 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setfilelock_latency": { 2024-06-13T11:35:07.584 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.584 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.585 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.585 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setlayout_latency": { 2024-06-13T11:35:07.585 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.585 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.585 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.586 INFO:teuthology.orchestra.run.smithi077.stdout: "req_setxattr_latency": { 2024-06-13T11:35:07.586 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.586 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.586 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.586 INFO:teuthology.orchestra.run.smithi077.stdout: "req_symlink_latency": { 2024-06-13T11:35:07.586 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.586 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.586 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.587 INFO:teuthology.orchestra.run.smithi077.stdout: "req_unlink_latency": { 2024-06-13T11:35:07.587 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.587 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.587 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.587 INFO:teuthology.orchestra.run.smithi077.stdout: "cap_revoke_eviction": 0, 2024-06-13T11:35:07.587 INFO:teuthology.orchestra.run.smithi077.stdout: "cap_acquisition_throttle": 0, 2024-06-13T11:35:07.588 INFO:teuthology.orchestra.run.smithi077.stdout: "req_getvxattr_latency": { 2024-06-13T11:35:07.588 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.588 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.588 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.588 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:07.588 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.588 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_sessions": { 2024-06-13T11:35:07.588 INFO:teuthology.orchestra.run.smithi077.stdout: "session_count": 1, 2024-06-13T11:35:07.589 INFO:teuthology.orchestra.run.smithi077.stdout: "session_add": 3, 2024-06-13T11:35:07.589 INFO:teuthology.orchestra.run.smithi077.stdout: "session_remove": 2, 2024-06-13T11:35:07.589 INFO:teuthology.orchestra.run.smithi077.stdout: "sessions_open": 1, 2024-06-13T11:35:07.589 INFO:teuthology.orchestra.run.smithi077.stdout: "sessions_stale": 0, 2024-06-13T11:35:07.589 INFO:teuthology.orchestra.run.smithi077.stdout: "total_load": 0, 2024-06-13T11:35:07.589 INFO:teuthology.orchestra.run.smithi077.stdout: "average_load": 0, 2024-06-13T11:35:07.589 INFO:teuthology.orchestra.run.smithi077.stdout: "avg_session_uptime": 2514, 2024-06-13T11:35:07.589 INFO:teuthology.orchestra.run.smithi077.stdout: "mdthresh_evicted": 0 2024-06-13T11:35:07.590 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.590 INFO:teuthology.orchestra.run.smithi077.stdout: "mempool": { 2024-06-13T11:35:07.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_bytes": 0, 2024-06-13T11:35:07.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_items": 0, 2024-06-13T11:35:07.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T11:35:07.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_items": 0, 2024-06-13T11:35:07.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T11:35:07.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_items": 0, 2024-06-13T11:35:07.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T11:35:07.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T11:35:07.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T11:35:07.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T11:35:07.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T11:35:07.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_items": 0, 2024-06-13T11:35:07.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T11:35:07.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T11:35:07.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_bytes": 0, 2024-06-13T11:35:07.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_items": 0, 2024-06-13T11:35:07.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_bytes": 0, 2024-06-13T11:35:07.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_items": 0, 2024-06-13T11:35:07.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T11:35:07.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T11:35:07.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T11:35:07.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T11:35:07.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T11:35:07.593 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_items": 0, 2024-06-13T11:35:07.593 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_bytes": 0, 2024-06-13T11:35:07.593 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_items": 0, 2024-06-13T11:35:07.593 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T11:35:07.593 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T11:35:07.593 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_bytes": 0, 2024-06-13T11:35:07.593 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_items": 0, 2024-06-13T11:35:07.593 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_bytes": 0, 2024-06-13T11:35:07.594 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_items": 0, 2024-06-13T11:35:07.594 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T11:35:07.594 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_items": 0, 2024-06-13T11:35:07.594 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T11:35:07.594 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_items": 0, 2024-06-13T11:35:07.594 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_bytes": 246920, 2024-06-13T11:35:07.594 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_items": 1801, 2024-06-13T11:35:07.594 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_bytes": 0, 2024-06-13T11:35:07.595 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_items": 0, 2024-06-13T11:35:07.595 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bytes": 0, 2024-06-13T11:35:07.595 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_items": 0, 2024-06-13T11:35:07.595 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_bytes": 0, 2024-06-13T11:35:07.595 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_items": 0, 2024-06-13T11:35:07.595 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_bytes": 0, 2024-06-13T11:35:07.595 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_items": 0, 2024-06-13T11:35:07.595 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_bytes": 9432, 2024-06-13T11:35:07.595 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_items": 182, 2024-06-13T11:35:07.596 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T11:35:07.596 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_items": 0, 2024-06-13T11:35:07.596 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_bytes": 0, 2024-06-13T11:35:07.596 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_items": 0, 2024-06-13T11:35:07.596 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_bytes": 5984555, 2024-06-13T11:35:07.596 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_items": 54477, 2024-06-13T11:35:07.596 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_bytes": 0, 2024-06-13T11:35:07.596 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_items": 0, 2024-06-13T11:35:07.597 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_bytes": 0, 2024-06-13T11:35:07.597 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_items": 0 2024-06-13T11:35:07.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.597 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter": { 2024-06-13T11:35:07.597 INFO:teuthology.orchestra.run.smithi077.stdout: "op_active": 0, 2024-06-13T11:35:07.597 INFO:teuthology.orchestra.run.smithi077.stdout: "op_laggy": 0, 2024-06-13T11:35:07.597 INFO:teuthology.orchestra.run.smithi077.stdout: "op_send": 2623, 2024-06-13T11:35:07.597 INFO:teuthology.orchestra.run.smithi077.stdout: "op_send_bytes": 21, 2024-06-13T11:35:07.597 INFO:teuthology.orchestra.run.smithi077.stdout: "op_resend": 3, 2024-06-13T11:35:07.598 INFO:teuthology.orchestra.run.smithi077.stdout: "op_reply": 2623, 2024-06-13T11:35:07.598 INFO:teuthology.orchestra.run.smithi077.stdout: "op_latency": { 2024-06-13T11:35:07.598 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 2623, 2024-06-13T11:35:07.598 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 1.496970333, 2024-06-13T11:35:07.598 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000570709 2024-06-13T11:35:07.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.598 INFO:teuthology.orchestra.run.smithi077.stdout: "op_inflight": 0, 2024-06-13T11:35:07.599 INFO:teuthology.orchestra.run.smithi077.stdout: "oplen_avg": { 2024-06-13T11:35:07.599 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 2623, 2024-06-13T11:35:07.599 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 2624 2024-06-13T11:35:07.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.599 INFO:teuthology.orchestra.run.smithi077.stdout: "op": 2623, 2024-06-13T11:35:07.599 INFO:teuthology.orchestra.run.smithi077.stdout: "op_r": 2623, 2024-06-13T11:35:07.599 INFO:teuthology.orchestra.run.smithi077.stdout: "op_w": 0, 2024-06-13T11:35:07.599 INFO:teuthology.orchestra.run.smithi077.stdout: "op_rmw": 0, 2024-06-13T11:35:07.599 INFO:teuthology.orchestra.run.smithi077.stdout: "op_pg": 0, 2024-06-13T11:35:07.600 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_stat": 1687, 2024-06-13T11:35:07.600 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_create": 0, 2024-06-13T11:35:07.600 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_read": 934, 2024-06-13T11:35:07.600 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_write": 0, 2024-06-13T11:35:07.600 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_writefull": 0, 2024-06-13T11:35:07.600 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_writesame": 0, 2024-06-13T11:35:07.600 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_append": 0, 2024-06-13T11:35:07.600 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_zero": 0, 2024-06-13T11:35:07.601 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_truncate": 0, 2024-06-13T11:35:07.601 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_delete": 0, 2024-06-13T11:35:07.601 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_mapext": 0, 2024-06-13T11:35:07.601 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_sparse_read": 0, 2024-06-13T11:35:07.601 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_clonerange": 0, 2024-06-13T11:35:07.601 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_getxattr": 1, 2024-06-13T11:35:07.601 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_setxattr": 0, 2024-06-13T11:35:07.601 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_cmpxattr": 0, 2024-06-13T11:35:07.602 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_rmxattr": 0, 2024-06-13T11:35:07.602 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_resetxattrs": 0, 2024-06-13T11:35:07.602 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_call": 0, 2024-06-13T11:35:07.602 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_watch": 0, 2024-06-13T11:35:07.602 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_notify": 0, 2024-06-13T11:35:07.602 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_src_cmpxattr": 0, 2024-06-13T11:35:07.602 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_pgls": 0, 2024-06-13T11:35:07.602 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_pgls_filter": 0, 2024-06-13T11:35:07.603 INFO:teuthology.orchestra.run.smithi077.stdout: "osdop_other": 0, 2024-06-13T11:35:07.603 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_active": 0, 2024-06-13T11:35:07.603 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_send": 0, 2024-06-13T11:35:07.603 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_resend": 0, 2024-06-13T11:35:07.603 INFO:teuthology.orchestra.run.smithi077.stdout: "linger_ping": 0, 2024-06-13T11:35:07.603 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_active": 0, 2024-06-13T11:35:07.603 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_send": 0, 2024-06-13T11:35:07.604 INFO:teuthology.orchestra.run.smithi077.stdout: "poolop_resend": 0, 2024-06-13T11:35:07.604 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_active": 0, 2024-06-13T11:35:07.604 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_send": 0, 2024-06-13T11:35:07.604 INFO:teuthology.orchestra.run.smithi077.stdout: "poolstat_resend": 0, 2024-06-13T11:35:07.604 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_active": 0, 2024-06-13T11:35:07.604 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_send": 0, 2024-06-13T11:35:07.604 INFO:teuthology.orchestra.run.smithi077.stdout: "statfs_resend": 0, 2024-06-13T11:35:07.604 INFO:teuthology.orchestra.run.smithi077.stdout: "command_active": 0, 2024-06-13T11:35:07.605 INFO:teuthology.orchestra.run.smithi077.stdout: "command_send": 0, 2024-06-13T11:35:07.605 INFO:teuthology.orchestra.run.smithi077.stdout: "command_resend": 0, 2024-06-13T11:35:07.605 INFO:teuthology.orchestra.run.smithi077.stdout: "map_epoch": 109, 2024-06-13T11:35:07.605 INFO:teuthology.orchestra.run.smithi077.stdout: "map_full": 0, 2024-06-13T11:35:07.605 INFO:teuthology.orchestra.run.smithi077.stdout: "map_inc": 12, 2024-06-13T11:35:07.605 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_sessions": 4, 2024-06-13T11:35:07.605 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_session_open": 4, 2024-06-13T11:35:07.605 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_session_close": 0, 2024-06-13T11:35:07.606 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_laggy": 0, 2024-06-13T11:35:07.606 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_wr": 0, 2024-06-13T11:35:07.606 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_rd": 2, 2024-06-13T11:35:07.606 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_del": 0 2024-06-13T11:35:07.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.606 INFO:teuthology.orchestra.run.smithi077.stdout: "oft": { 2024-06-13T11:35:07.606 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_objs": 0, 2024-06-13T11:35:07.606 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_kv_pairs": 0, 2024-06-13T11:35:07.607 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_updates": 0, 2024-06-13T11:35:07.607 INFO:teuthology.orchestra.run.smithi077.stdout: "omap_total_removes": 0 2024-06-13T11:35:07.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.607 INFO:teuthology.orchestra.run.smithi077.stdout: "osd-slow-ops": { 2024-06-13T11:35:07.607 INFO:teuthology.orchestra.run.smithi077.stdout: "slow_ops_count": 0 2024-06-13T11:35:07.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.607 INFO:teuthology.orchestra.run.smithi077.stdout: "purge_queue": { 2024-06-13T11:35:07.607 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_ops": 0, 2024-06-13T11:35:07.608 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_ops_high_water": 0, 2024-06-13T11:35:07.608 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing": 0, 2024-06-13T11:35:07.608 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executing_high_water": 0, 2024-06-13T11:35:07.608 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executed_ops": 0, 2024-06-13T11:35:07.608 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_executed": 0, 2024-06-13T11:35:07.608 INFO:teuthology.orchestra.run.smithi077.stdout: "pq_item_in_journal": 0 2024-06-13T11:35:07.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.608 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T11:35:07.608 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-06-13T11:35:07.609 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-06-13T11:35:07.609 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-06-13T11:35:07.609 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 2931, 2024-06-13T11:35:07.609 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 8273882, 2024-06-13T11:35:07.609 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:07.609 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 2931, 2024-06-13T11:35:07.609 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-06-13T11:35:07.610 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-06-13T11:35:07.610 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 2931, 2024-06-13T11:35:07.610 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 8273882, 2024-06-13T11:35:07.610 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-06-13T11:35:07.610 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.610 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.610 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.610 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:07.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.611 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-objecter_bytes": { 2024-06-13T11:35:07.611 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-06-13T11:35:07.611 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-06-13T11:35:07.611 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-06-13T11:35:07.611 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-06-13T11:35:07.611 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-06-13T11:35:07.611 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:07.612 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:07.612 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 2623, 2024-06-13T11:35:07.612 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 6163267, 2024-06-13T11:35:07.612 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 2623, 2024-06-13T11:35:07.612 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 6163267, 2024-06-13T11:35:07.612 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-06-13T11:35:07.612 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.612 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.612 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.613 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:07.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.613 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-objecter_ops": { 2024-06-13T11:35:07.613 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-06-13T11:35:07.613 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 1024, 2024-06-13T11:35:07.613 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-06-13T11:35:07.613 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-06-13T11:35:07.613 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-06-13T11:35:07.614 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:07.614 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:07.614 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 2623, 2024-06-13T11:35:07.614 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 2623, 2024-06-13T11:35:07.614 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 2623, 2024-06-13T11:35:07.614 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 2623, 2024-06-13T11:35:07.614 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-06-13T11:35:07.614 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.615 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.615 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.615 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:07.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.615 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-write_buf_throttle": { 2024-06-13T11:35:07.615 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-06-13T11:35:07.615 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 3758096384, 2024-06-13T11:35:07.615 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-06-13T11:35:07.616 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-06-13T11:35:07.616 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-06-13T11:35:07.616 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:07.616 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:07.616 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-06-13T11:35:07.616 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-06-13T11:35:07.616 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 0, 2024-06-13T11:35:07.616 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 0, 2024-06-13T11:35:07.616 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-06-13T11:35:07.617 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.617 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.617 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.617 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:07.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:07.617 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-write_buf_throttle-0x563e000926e0": { 2024-06-13T11:35:07.617 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-06-13T11:35:07.617 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 3758096384, 2024-06-13T11:35:07.617 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-06-13T11:35:07.618 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 0, 2024-06-13T11:35:07.618 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 0, 2024-06-13T11:35:07.618 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:07.618 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:07.618 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-06-13T11:35:07.618 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-06-13T11:35:07.618 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 0, 2024-06-13T11:35:07.618 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 0, 2024-06-13T11:35:07.619 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-06-13T11:35:07.619 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:07.619 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:07.619 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:07.619 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:07.619 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:07.619 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-06-13T11:35:07.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:07 smithi077 ceph-mon[36410]: pgmap v351: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:35:07.790 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:07 smithi077 ceph-mon[36410]: osdmap e109: 12 total, 12 up, 12 in 2024-06-13T11:35:07.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:07 smithi002 ceph-mon[32210]: pgmap v351: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:35:07.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:07 smithi002 ceph-mon[32210]: osdmap e109: 12 total, 12 up, 12 in 2024-06-13T11:35:07.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:07 smithi178 ceph-mon[36913]: pgmap v351: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-06-13T11:35:07.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:07 smithi178 ceph-mon[36913]: osdmap e109: 12 total, 12 up, 12 in 2024-06-13T11:35:08.331 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-06-13T11:35:08.331 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-06-13T11:35:08.331 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-06-13T11:35:08.331 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-06-13T11:35:08.331 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-06-13T11:35:08.331 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-06-13T11:35:08.331 DEBUG:tasks.check_counter:Getting stats from k 2024-06-13T11:35:08.332 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph daemon mds.k perf dump 2024-06-13T11:35:08.567 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T11:35:09.867 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:09 smithi002 ceph-mon[32210]: pgmap v353: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-06-13T11:35:09.868 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:09 smithi002 ceph-mon[32210]: osdmap e110: 12 total, 12 up, 12 in 2024-06-13T11:35:09.946 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:09 smithi077 ceph-mon[36410]: pgmap v353: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-06-13T11:35:09.946 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:09 smithi077 ceph-mon[36410]: osdmap e110: 12 total, 12 up, 12 in 2024-06-13T11:35:09.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:09 smithi178 ceph-mon[36913]: pgmap v353: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-06-13T11:35:09.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:09 smithi178 ceph-mon[36913]: osdmap e110: 12 total, 12 up, 12 in 2024-06-13T11:35:10.366 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-06-13T11:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T11:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 4, 2024-06-13T11:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 4, 2024-06-13T11:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 2992, 2024-06-13T11:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 448, 2024-06-13T11:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 4, 2024-06-13T11:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 0, 2024-06-13T11:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.001336011, 2024-06-13T11:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.000043282, 2024-06-13T11:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.000555873, 2024-06-13T11:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T11:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 3, 2024-06-13T11:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000702489, 2024-06-13T11:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000234163 2024-06-13T11:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-06-13T11:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 448 2024-06-13T11:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T11:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 289, 2024-06-13T11:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 278, 2024-06-13T11:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 1599744, 2024-06-13T11:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 171584, 2024-06-13T11:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 2, 2024-06-13T11:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 1, 2024-06-13T11:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.053154858, 2024-06-13T11:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.016814049, 2024-06-13T11:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.037197800, 2024-06-13T11:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.006843841, 2024-06-13T11:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 277, 2024-06-13T11:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.014586115, 2024-06-13T11:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000052657 2024-06-13T11:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:10.372 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:10.372 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:10.372 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:10.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:10.372 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 1599744, 2024-06-13T11:35:10.372 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 171584 2024-06-13T11:35:10.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:10.372 INFO:teuthology.orchestra.run.smithi077.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T11:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_messages": 2, 2024-06-13T11:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages": 212, 2024-06-13T11:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_bytes": 320, 2024-06-13T11:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_bytes": 193008, 2024-06-13T11:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_created_connections": 5, 2024-06-13T11:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_active_connections": 3, 2024-06-13T11:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_total_time": 0.014102091, 2024-06-13T11:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_send_time": 0.010023347, 2024-06-13T11:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_recv_time": 0.001295834, 2024-06-13T11:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T11:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 209, 2024-06-13T11:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.023574669, 2024-06-13T11:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000112797 2024-06-13T11:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-13T11:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: "msgr_send_encrypted_bytes": 193008 2024-06-13T11:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: "cct": { 2024-06-13T11:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: "total_workers": 0, 2024-06-13T11:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: "unhealthy_workers": 0 2024-06-13T11:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: "mempool": { 2024-06-13T11:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_bytes": 0, 2024-06-13T11:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: "bloom_filter_items": 0, 2024-06-13T11:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T11:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_items": 0, 2024-06-13T11:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T11:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_data_items": 0, 2024-06-13T11:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T11:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T11:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T11:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T11:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T11:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_other_items": 0, 2024-06-13T11:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T11:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T11:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_bytes": 0, 2024-06-13T11:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_items": 0, 2024-06-13T11:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_bytes": 0, 2024-06-13T11:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blob_items": 0, 2024-06-13T11:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T11:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T11:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T11:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T11:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T11:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_items": 0, 2024-06-13T11:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_bytes": 0, 2024-06-13T11:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_txc_items": 0, 2024-06-13T11:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T11:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T11:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_bytes": 0, 2024-06-13T11:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_writing_items": 0, 2024-06-13T11:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_bytes": 0, 2024-06-13T11:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_items": 0, 2024-06-13T11:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T11:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_reader_items": 0, 2024-06-13T11:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T11:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_file_writer_items": 0, 2024-06-13T11:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_bytes": 148714, 2024-06-13T11:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_anon_items": 30, 2024-06-13T11:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_bytes": 0, 2024-06-13T11:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: "buffer_meta_items": 0, 2024-06-13T11:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bytes": 0, 2024-06-13T11:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_items": 0, 2024-06-13T11:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_bytes": 0, 2024-06-13T11:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mapbl_items": 0, 2024-06-13T11:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_bytes": 0, 2024-06-13T11:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pglog_items": 0, 2024-06-13T11:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_bytes": 0, 2024-06-13T11:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_items": 0, 2024-06-13T11:35:10.382 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T11:35:10.382 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_mapping_items": 0, 2024-06-13T11:35:10.382 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_bytes": 0, 2024-06-13T11:35:10.382 INFO:teuthology.orchestra.run.smithi077.stdout: "pgmap_items": 0, 2024-06-13T11:35:10.382 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_bytes": 928, 2024-06-13T11:35:10.382 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_co_items": 2, 2024-06-13T11:35:10.382 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_bytes": 0, 2024-06-13T11:35:10.382 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_1_items": 0, 2024-06-13T11:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_bytes": 0, 2024-06-13T11:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "unittest_2_items": 0 2024-06-13T11:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-06-13T11:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T11:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "val": 0, 2024-06-13T11:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "max": 104857600, 2024-06-13T11:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "get_started": 0, 2024-06-13T11:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "get": 291, 2024-06-13T11:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "get_sum": 1558961, 2024-06-13T11:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "get_or_fail_success": 291, 2024-06-13T11:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "take": 0, 2024-06-13T11:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "take_sum": 0, 2024-06-13T11:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "put": 291, 2024-06-13T11:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "put_sum": 1558961, 2024-06-13T11:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "wait": { 2024-06-13T11:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "avgcount": 0, 2024-06-13T11:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "sum": 0.000000000, 2024-06-13T11:35:10.385 INFO:teuthology.orchestra.run.smithi077.stdout: "avgtime": 0.000000000 2024-06-13T11:35:10.385 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:10.385 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-06-13T11:35:10.385 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-06-13T11:35:11.106 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-06-13T11:35:11.106 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-06-13T11:35:11.107 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-06-13T11:35:11.107 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-06-13T11:35:11.107 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-06-13T11:35:11.107 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-06-13T11:35:11.107 DEBUG:tasks.check_counter:Getting stats from c 2024-06-13T11:35:11.107 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph daemon mds.c perf dump 2024-06-13T11:35:11.353 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:35:11.726 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:11 smithi178 ceph-mon[36913]: pgmap v355: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-06-13T11:35:11.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:11 smithi002 ceph-mon[32210]: pgmap v355: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-06-13T11:35:12.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:11 smithi077 ceph-mon[36410]: pgmap v355: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-06-13T11:35:13.146 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-06-13T11:35:13.146 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T11:35:13.146 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 11231, 2024-06-13T11:35:13.147 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 13970, 2024-06-13T11:35:13.147 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 4675257, 2024-06-13T11:35:13.147 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 8339618, 2024-06-13T11:35:13.147 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 21, 2024-06-13T11:35:13.147 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 3, 2024-06-13T11:35:13.147 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.701613106, 2024-06-13T11:35:13.147 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.258704123, 2024-06-13T11:35:13.147 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.276450978, 2024-06-13T11:35:13.147 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.179351329, 2024-06-13T11:35:13.148 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:13.148 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 13970, 2024-06-13T11:35:13.148 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.442009363, 2024-06-13T11:35:13.148 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000031639 2024-06-13T11:35:13.148 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.148 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:13.148 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 4673, 2024-06-13T11:35:13.148 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.001160955, 2024-06-13T11:35:13.149 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000248 2024-06-13T11:35:13.149 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.149 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 1670784, 2024-06-13T11:35:13.149 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 189472 2024-06-13T11:35:13.149 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.149 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T11:35:13.149 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 5542, 2024-06-13T11:35:13.149 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 5750, 2024-06-13T11:35:13.150 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 1420766, 2024-06-13T11:35:13.150 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 4034028, 2024-06-13T11:35:13.150 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 28, 2024-06-13T11:35:13.150 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 6, 2024-06-13T11:35:13.150 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.389950177, 2024-06-13T11:35:13.150 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.165233565, 2024-06-13T11:35:13.150 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.086350905, 2024-06-13T11:35:13.150 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.111581698, 2024-06-13T11:35:13.151 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:13.151 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 5747, 2024-06-13T11:35:13.151 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.227778583, 2024-06-13T11:35:13.151 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000039634 2024-06-13T11:35:13.151 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.151 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:13.151 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 114, 2024-06-13T11:35:13.151 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000022260, 2024-06-13T11:35:13.152 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000195 2024-06-13T11:35:13.152 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.152 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-13T11:35:13.152 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 502448 2024-06-13T11:35:13.152 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.152 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T11:35:13.152 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 5988, 2024-06-13T11:35:13.152 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 7710, 2024-06-13T11:35:13.152 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 4279727, 2024-06-13T11:35:13.153 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 2650602, 2024-06-13T11:35:13.153 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 10, 2024-06-13T11:35:13.153 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 6, 2024-06-13T11:35:13.153 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.429995341, 2024-06-13T11:35:13.153 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.170165994, 2024-06-13T11:35:13.153 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.183937019, 2024-06-13T11:35:13.153 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.076827965, 2024-06-13T11:35:13.153 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:13.153 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 7708, 2024-06-13T11:35:13.154 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.257932764, 2024-06-13T11:35:13.154 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000033462 2024-06-13T11:35:13.154 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.154 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:13.154 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 6552, 2024-06-13T11:35:13.154 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.001380742, 2024-06-13T11:35:13.154 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000210 2024-06-13T11:35:13.154 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.154 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 3648, 2024-06-13T11:35:13.155 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 12336 2024-06-13T11:35:13.155 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.155 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2024-06-13T11:35:13.155 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2024-06-13T11:35:13.155 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2024-06-13T11:35:13.155 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.155 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2024-06-13T11:35:13.156 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-06-13T11:35:13.156 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-06-13T11:35:13.156 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 12970, 2024-06-13T11:35:13.156 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 2.767324077, 2024-06-13T11:35:13.156 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000213363 2024-06-13T11:35:13.156 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:13.156 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.156 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2024-06-13T11:35:13.156 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-06-13T11:35:13.157 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-06-13T11:35:13.157 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 435, 2024-06-13T11:35:13.157 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.028122117, 2024-06-13T11:35:13.157 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000064648 2024-06-13T11:35:13.157 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:13.157 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.157 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2024-06-13T11:35:13.157 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 747, 2024-06-13T11:35:13.157 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 744, 2024-06-13T11:35:13.158 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2024-06-13T11:35:13.158 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 744, 2024-06-13T11:35:13.158 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.808753742, 2024-06-13T11:35:13.158 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.001087034 2024-06-13T11:35:13.158 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.158 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2024-06-13T11:35:13.158 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 3, 2024-06-13T11:35:13.158 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 0, 2024-06-13T11:35:13.159 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2024-06-13T11:35:13.159 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 11, 2024-06-13T11:35:13.159 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 0, 2024-06-13T11:35:13.159 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2024-06-13T11:35:13.159 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 3306, 2024-06-13T11:35:13.159 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 144, 2024-06-13T11:35:13.159 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 3162, 2024-06-13T11:35:13.159 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 0, 2024-06-13T11:35:13.159 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 3078, 2024-06-13T11:35:13.160 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 1, 2024-06-13T11:35:13.160 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 77, 2024-06-13T11:35:13.160 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 77, 2024-06-13T11:35:13.160 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 110, 2024-06-13T11:35:13.160 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 1509, 2024-06-13T11:35:13.160 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 955, 2024-06-13T11:35:13.160 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 0, 2024-06-13T11:35:13.160 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 23, 2024-06-13T11:35:13.160 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2024-06-13T11:35:13.161 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2024-06-13T11:35:13.161 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 0, 2024-06-13T11:35:13.161 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2024-06-13T11:35:13.161 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2024-06-13T11:35:13.161 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 0, 2024-06-13T11:35:13.161 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 0, 2024-06-13T11:35:13.161 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 108, 2024-06-13T11:35:13.161 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 2946, 2024-06-13T11:35:13.162 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2024-06-13T11:35:13.162 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 16992, 2024-06-13T11:35:13.162 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2024-06-13T11:35:13.162 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 3452, 2024-06-13T11:35:13.162 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 26717845, 2024-06-13T11:35:13.162 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 6, 2024-06-13T11:35:13.162 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 16992, 2024-06-13T11:35:13.162 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2024-06-13T11:35:13.163 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2024-06-13T11:35:13.163 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2024-06-13T11:35:13.163 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 160, 2024-06-13T11:35:13.163 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 0, 2024-06-13T11:35:13.163 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 160, 2024-06-13T11:35:13.163 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 16832, 2024-06-13T11:35:13.163 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 0, 2024-06-13T11:35:13.163 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 23, 2024-06-13T11:35:13.163 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 482, 2024-06-13T11:35:13.164 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2024-06-13T11:35:13.164 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-13T11:35:13.164 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-13T11:35:13.164 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 1296, 2024-06-13T11:35:13.164 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 1117, 2024-06-13T11:35:13.164 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 39, 2024-06-13T11:35:13.164 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 464 2024-06-13T11:35:13.164 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.165 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2024-06-13T11:35:13.165 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2024-06-13T11:35:13.165 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 0, 2024-06-13T11:35:13.165 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 0, 2024-06-13T11:35:13.165 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 23, 2024-06-13T11:35:13.165 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 0, 2024-06-13T11:35:13.165 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2024-06-13T11:35:13.165 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2024-06-13T11:35:13.165 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2024-06-13T11:35:13.166 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 225, 2024-06-13T11:35:13.166 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 225, 2024-06-13T11:35:13.166 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 0, 2024-06-13T11:35:13.166 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2024-06-13T11:35:13.166 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2024-06-13T11:35:13.166 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2024-06-13T11:35:13.166 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2024-06-13T11:35:13.166 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2024-06-13T11:35:13.167 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2024-06-13T11:35:13.167 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_path": 0, 2024-06-13T11:35:13.167 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_inode": 0, 2024-06-13T11:35:13.167 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 0, 2024-06-13T11:35:13.167 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 0, 2024-06-13T11:35:13.167 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2024-06-13T11:35:13.167 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 0, 2024-06-13T11:35:13.167 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2024-06-13T11:35:13.167 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0 2024-06-13T11:35:13.167 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.168 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2024-06-13T11:35:13.168 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2024-06-13T11:35:13.168 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 2444, 2024-06-13T11:35:13.168 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 0, 2024-06-13T11:35:13.168 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 0, 2024-06-13T11:35:13.168 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 2444, 2024-06-13T11:35:13.168 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2024-06-13T11:35:13.168 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 0, 2024-06-13T11:35:13.169 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 5, 2024-06-13T11:35:13.169 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 0, 2024-06-13T11:35:13.169 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 0, 2024-06-13T11:35:13.169 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 5, 2024-06-13T11:35:13.169 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 2, 2024-06-13T11:35:13.169 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2024-06-13T11:35:13.169 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 0, 2024-06-13T11:35:13.169 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 4194304, 2024-06-13T11:35:13.169 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 9766638, 2024-06-13T11:35:13.170 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 0, 2024-06-13T11:35:13.170 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2024-06-13T11:35:13.170 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 143, 2024-06-13T11:35:13.170 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 1.412475536, 2024-06-13T11:35:13.170 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.009877451 2024-06-13T11:35:13.170 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.170 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 0 2024-06-13T11:35:13.170 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.171 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2024-06-13T11:35:13.171 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 2397, 2024-06-13T11:35:13.171 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 2622, 2024-06-13T11:35:13.171 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 225, 2024-06-13T11:35:13.171 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 146, 2024-06-13T11:35:13.171 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 147, 2024-06-13T11:35:13.171 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 1, 2024-06-13T11:35:13.171 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 3306, 2024-06-13T11:35:13.171 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 3535, 2024-06-13T11:35:13.172 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 229, 2024-06-13T11:35:13.172 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 77, 2024-06-13T11:35:13.172 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 2226, 2024-06-13T11:35:13.172 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 2149, 2024-06-13T11:35:13.172 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 72732, 2024-06-13T11:35:13.172 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 223612 2024-06-13T11:35:13.172 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.172 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2024-06-13T11:35:13.173 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 1216, 2024-06-13T11:35:13.173 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 0, 2024-06-13T11:35:13.173 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 747, 2024-06-13T11:35:13.173 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 25, 2024-06-13T11:35:13.173 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 456, 2024-06-13T11:35:13.173 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2024-06-13T11:35:13.173 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 230, 2024-06-13T11:35:13.173 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.259202068, 2024-06-13T11:35:13.173 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.001126965 2024-06-13T11:35:13.173 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.174 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2024-06-13T11:35:13.174 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 4, 2024-06-13T11:35:13.174 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.001880580, 2024-06-13T11:35:13.174 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000470145 2024-06-13T11:35:13.174 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.174 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2024-06-13T11:35:13.174 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.174 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.175 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.175 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.175 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2024-06-13T11:35:13.175 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.175 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.175 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.175 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.175 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2024-06-13T11:35:13.176 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 274, 2024-06-13T11:35:13.176 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.089914411, 2024-06-13T11:35:13.176 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000328154 2024-06-13T11:35:13.176 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.176 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2024-06-13T11:35:13.176 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.176 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.176 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.177 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.177 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2024-06-13T11:35:13.177 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.177 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.177 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.177 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.177 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2024-06-13T11:35:13.177 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.177 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.178 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.178 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.178 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2024-06-13T11:35:13.178 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.178 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.178 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.178 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.178 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2024-06-13T11:35:13.179 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.179 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.179 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.179 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.179 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2024-06-13T11:35:13.179 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.180 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.180 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.180 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.180 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2024-06-13T11:35:13.180 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.181 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.181 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.181 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.181 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2024-06-13T11:35:13.181 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.181 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.181 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.181 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.181 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2024-06-13T11:35:13.182 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.182 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.182 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.182 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.182 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2024-06-13T11:35:13.182 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 5, 2024-06-13T11:35:13.182 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000895241, 2024-06-13T11:35:13.183 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000179048 2024-06-13T11:35:13.183 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.183 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2024-06-13T11:35:13.183 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 6, 2024-06-13T11:35:13.183 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.005994413, 2024-06-13T11:35:13.183 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000999068 2024-06-13T11:35:13.183 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.183 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2024-06-13T11:35:13.184 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2, 2024-06-13T11:35:13.184 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.004489337, 2024-06-13T11:35:13.184 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.002244668 2024-06-13T11:35:13.184 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.184 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2024-06-13T11:35:13.184 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.184 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.184 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.184 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.185 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2024-06-13T11:35:13.185 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.185 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.185 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.185 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.185 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2024-06-13T11:35:13.185 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.185 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.185 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.186 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.186 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2024-06-13T11:35:13.186 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.186 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.186 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.186 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.186 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2024-06-13T11:35:13.187 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.187 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.187 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.187 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.187 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2024-06-13T11:35:13.187 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.187 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.187 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.187 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.188 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2024-06-13T11:35:13.188 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.188 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.188 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.188 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.188 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2024-06-13T11:35:13.188 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.188 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.189 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.189 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.189 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2024-06-13T11:35:13.189 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.189 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.189 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.189 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.189 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2024-06-13T11:35:13.190 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.190 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.190 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.190 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.190 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2024-06-13T11:35:13.190 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.190 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.191 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.191 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.191 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2024-06-13T11:35:13.191 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 223, 2024-06-13T11:35:13.191 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.446377692, 2024-06-13T11:35:13.191 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.002001693 2024-06-13T11:35:13.191 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.191 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2024-06-13T11:35:13.192 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2024-06-13T11:35:13.192 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2024-06-13T11:35:13.192 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.192 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.192 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.192 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:13.192 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.192 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2024-06-13T11:35:13.193 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 2, 2024-06-13T11:35:13.193 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 4, 2024-06-13T11:35:13.193 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 2, 2024-06-13T11:35:13.193 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 2, 2024-06-13T11:35:13.193 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2024-06-13T11:35:13.193 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 509, 2024-06-13T11:35:13.193 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 254, 2024-06-13T11:35:13.193 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 610, 2024-06-13T11:35:13.194 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2024-06-13T11:35:13.194 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.194 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2024-06-13T11:35:13.194 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2024-06-13T11:35:13.194 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2024-06-13T11:35:13.194 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T11:35:13.194 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2024-06-13T11:35:13.194 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T11:35:13.195 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2024-06-13T11:35:13.195 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T11:35:13.195 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T11:35:13.195 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T11:35:13.195 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T11:35:13.195 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T11:35:13.195 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2024-06-13T11:35:13.196 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T11:35:13.196 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T11:35:13.196 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2024-06-13T11:35:13.196 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2024-06-13T11:35:13.196 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2024-06-13T11:35:13.196 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2024-06-13T11:35:13.196 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T11:35:13.196 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T11:35:13.197 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T11:35:13.197 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T11:35:13.197 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T11:35:13.197 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2024-06-13T11:35:13.197 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2024-06-13T11:35:13.197 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2024-06-13T11:35:13.198 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T11:35:13.198 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T11:35:13.198 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2024-06-13T11:35:13.198 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2024-06-13T11:35:13.198 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2024-06-13T11:35:13.198 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2024-06-13T11:35:13.198 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T11:35:13.198 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2024-06-13T11:35:13.199 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T11:35:13.199 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2024-06-13T11:35:13.199 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 387102, 2024-06-13T11:35:13.199 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 2221, 2024-06-13T11:35:13.199 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 880, 2024-06-13T11:35:13.199 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 10, 2024-06-13T11:35:13.199 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2024-06-13T11:35:13.199 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2024-06-13T11:35:13.200 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2024-06-13T11:35:13.200 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2024-06-13T11:35:13.200 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2024-06-13T11:35:13.200 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2024-06-13T11:35:13.200 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 9432, 2024-06-13T11:35:13.200 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 182, 2024-06-13T11:35:13.200 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T11:35:13.200 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2024-06-13T11:35:13.200 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2024-06-13T11:35:13.201 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2024-06-13T11:35:13.201 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 8204074, 2024-06-13T11:35:13.201 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 86338, 2024-06-13T11:35:13.201 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2024-06-13T11:35:13.201 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2024-06-13T11:35:13.201 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2024-06-13T11:35:13.201 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2024-06-13T11:35:13.201 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.201 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2024-06-13T11:35:13.202 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2024-06-13T11:35:13.202 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2024-06-13T11:35:13.202 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 17682, 2024-06-13T11:35:13.202 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 5794136, 2024-06-13T11:35:13.202 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 27, 2024-06-13T11:35:13.202 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 17682, 2024-06-13T11:35:13.202 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2024-06-13T11:35:13.202 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 17682, 2024-06-13T11:35:13.203 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 12.978776656, 2024-06-13T11:35:13.203 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000734010 2024-06-13T11:35:13.203 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.203 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2024-06-13T11:35:13.203 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2024-06-13T11:35:13.203 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 17682, 2024-06-13T11:35:13.203 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 17738 2024-06-13T11:35:13.203 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.204 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 17682, 2024-06-13T11:35:13.204 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 16999, 2024-06-13T11:35:13.204 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 683, 2024-06-13T11:35:13.204 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2024-06-13T11:35:13.204 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2024-06-13T11:35:13.204 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 0, 2024-06-13T11:35:13.204 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 10, 2024-06-13T11:35:13.204 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 7, 2024-06-13T11:35:13.205 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 150, 2024-06-13T11:35:13.205 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 20, 2024-06-13T11:35:13.205 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2024-06-13T11:35:13.205 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2024-06-13T11:35:13.205 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2024-06-13T11:35:13.205 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 0, 2024-06-13T11:35:13.205 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 463, 2024-06-13T11:35:13.205 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2024-06-13T11:35:13.206 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2024-06-13T11:35:13.206 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2024-06-13T11:35:13.206 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 16992, 2024-06-13T11:35:13.206 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 20, 2024-06-13T11:35:13.206 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2024-06-13T11:35:13.206 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2024-06-13T11:35:13.206 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2024-06-13T11:35:13.206 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2024-06-13T11:35:13.207 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2024-06-13T11:35:13.207 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2024-06-13T11:35:13.207 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2024-06-13T11:35:13.207 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2024-06-13T11:35:13.207 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2024-06-13T11:35:13.207 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2024-06-13T11:35:13.207 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2024-06-13T11:35:13.207 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2024-06-13T11:35:13.207 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2024-06-13T11:35:13.208 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2024-06-13T11:35:13.208 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2024-06-13T11:35:13.208 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2024-06-13T11:35:13.208 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2024-06-13T11:35:13.208 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2024-06-13T11:35:13.208 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2024-06-13T11:35:13.208 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2024-06-13T11:35:13.208 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2024-06-13T11:35:13.208 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2024-06-13T11:35:13.208 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2024-06-13T11:35:13.209 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2024-06-13T11:35:13.209 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2024-06-13T11:35:13.209 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2024-06-13T11:35:13.209 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 110, 2024-06-13T11:35:13.209 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2024-06-13T11:35:13.209 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 13, 2024-06-13T11:35:13.209 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 12, 2024-06-13T11:35:13.209 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 12, 2024-06-13T11:35:13.209 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 0, 2024-06-13T11:35:13.210 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2024-06-13T11:35:13.210 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 60, 2024-06-13T11:35:13.210 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 0, 2024-06-13T11:35:13.210 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 16 2024-06-13T11:35:13.210 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.210 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2024-06-13T11:35:13.210 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 1, 2024-06-13T11:35:13.210 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2024-06-13T11:35:13.211 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2024-06-13T11:35:13.211 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2024-06-13T11:35:13.211 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.211 INFO:teuthology.orchestra.run.smithi178.stdout: "osd-slow-ops": { 2024-06-13T11:35:13.211 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2024-06-13T11:35:13.211 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.211 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2024-06-13T11:35:13.211 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2024-06-13T11:35:13.211 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 16, 2024-06-13T11:35:13.212 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2024-06-13T11:35:13.212 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 8, 2024-06-13T11:35:13.212 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed_ops": 450, 2024-06-13T11:35:13.212 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 225, 2024-06-13T11:35:13.212 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2024-06-13T11:35:13.212 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.212 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T11:35:13.212 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-13T11:35:13.213 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-06-13T11:35:13.213 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-13T11:35:13.213 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 22757, 2024-06-13T11:35:13.213 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 8305438, 2024-06-13T11:35:13.213 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:13.213 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 22757, 2024-06-13T11:35:13.213 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-13T11:35:13.213 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-13T11:35:13.213 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 22757, 2024-06-13T11:35:13.214 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 8305438, 2024-06-13T11:35:13.214 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-13T11:35:13.214 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.214 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.214 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.214 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:13.214 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.214 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2024-06-13T11:35:13.215 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-13T11:35:13.215 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-06-13T11:35:13.215 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-13T11:35:13.215 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-13T11:35:13.215 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-13T11:35:13.215 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:13.215 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:13.215 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 17682, 2024-06-13T11:35:13.215 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 5818661, 2024-06-13T11:35:13.216 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 17682, 2024-06-13T11:35:13.216 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 5818661, 2024-06-13T11:35:13.216 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-13T11:35:13.216 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.216 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.216 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.216 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:13.216 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.216 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2024-06-13T11:35:13.217 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-13T11:35:13.217 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2024-06-13T11:35:13.217 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-13T11:35:13.217 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-13T11:35:13.217 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-13T11:35:13.217 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:13.217 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:13.217 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 17682, 2024-06-13T11:35:13.217 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 17682, 2024-06-13T11:35:13.218 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 17682, 2024-06-13T11:35:13.218 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 17682, 2024-06-13T11:35:13.218 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-13T11:35:13.218 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.218 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.218 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.218 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:13.218 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.219 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2024-06-13T11:35:13.219 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-13T11:35:13.219 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-06-13T11:35:13.219 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-13T11:35:13.219 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 225, 2024-06-13T11:35:13.219 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 24525, 2024-06-13T11:35:13.219 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:13.219 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 225, 2024-06-13T11:35:13.219 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-13T11:35:13.220 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-13T11:35:13.220 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 7, 2024-06-13T11:35:13.220 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 24525, 2024-06-13T11:35:13.220 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-13T11:35:13.220 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.220 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.220 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.220 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:13.220 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:13.221 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x55746644a460": { 2024-06-13T11:35:13.221 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-13T11:35:13.221 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-06-13T11:35:13.221 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-13T11:35:13.221 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 2444, 2024-06-13T11:35:13.221 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 5572334, 2024-06-13T11:35:13.222 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:13.222 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 2444, 2024-06-13T11:35:13.222 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-13T11:35:13.222 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-13T11:35:13.222 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 143, 2024-06-13T11:35:13.222 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 5572334, 2024-06-13T11:35:13.222 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-13T11:35:13.222 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:13.223 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:13.223 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:13.223 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:13.223 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:13.223 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-06-13T11:35:13.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:13 smithi002 ceph-mon[32210]: pgmap v356: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:35:13.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:13 smithi178 ceph-mon[36913]: pgmap v356: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:35:14.006 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-06-13T11:35:14.006 INFO:tasks.check_counter:Daemon mds.c mds.imported=108 2024-06-13T11:35:14.006 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-06-13T11:35:14.006 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-06-13T11:35:14.007 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-06-13T11:35:14.007 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-06-13T11:35:14.007 DEBUG:tasks.check_counter:Getting stats from f 2024-06-13T11:35:14.007 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph daemon mds.f perf dump 2024-06-13T11:35:14.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:13 smithi077 ceph-mon[36410]: pgmap v356: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:35:14.247 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:35:15.606 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:15 smithi178 ceph-mon[36913]: pgmap v357: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:35:15.857 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-06-13T11:35:15.857 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T11:35:15.857 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 2472, 2024-06-13T11:35:15.858 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 2472, 2024-06-13T11:35:15.858 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 22320739, 2024-06-13T11:35:15.858 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 785282, 2024-06-13T11:35:15.858 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 7, 2024-06-13T11:35:15.858 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 3, 2024-06-13T11:35:15.858 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.235800202, 2024-06-13T11:35:15.858 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.073955243, 2024-06-13T11:35:15.859 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.066816749, 2024-06-13T11:35:15.859 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.074348270, 2024-06-13T11:35:15.859 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:15.859 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2471, 2024-06-13T11:35:15.859 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.096885404, 2024-06-13T11:35:15.859 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000039208 2024-06-13T11:35:15.859 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.859 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:15.860 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.860 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.860 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.860 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.860 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-06-13T11:35:15.860 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 448 2024-06-13T11:35:15.860 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.860 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T11:35:15.861 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 58, 2024-06-13T11:35:15.861 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 266, 2024-06-13T11:35:15.861 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 16793612, 2024-06-13T11:35:15.861 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 518354, 2024-06-13T11:35:15.861 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 7, 2024-06-13T11:35:15.861 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 5, 2024-06-13T11:35:15.861 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.023747035, 2024-06-13T11:35:15.862 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.009836450, 2024-06-13T11:35:15.862 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.009962577, 2024-06-13T11:35:15.862 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.001172296, 2024-06-13T11:35:15.862 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:15.862 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 263, 2024-06-13T11:35:15.862 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.023690604, 2024-06-13T11:35:15.862 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000090078 2024-06-13T11:35:15.862 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.862 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:15.863 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.863 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.863 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.863 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.863 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-13T11:35:15.863 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 500480 2024-06-13T11:35:15.863 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.863 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T11:35:15.863 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 657, 2024-06-13T11:35:15.864 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 640, 2024-06-13T11:35:15.864 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 10124861, 2024-06-13T11:35:15.864 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 283295, 2024-06-13T11:35:15.864 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 4, 2024-06-13T11:35:15.864 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 3, 2024-06-13T11:35:15.864 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.096564351, 2024-06-13T11:35:15.864 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.030469849, 2024-06-13T11:35:15.864 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.054009287, 2024-06-13T11:35:15.864 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.017925678, 2024-06-13T11:35:15.865 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:15.865 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 639, 2024-06-13T11:35:15.865 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.042477943, 2024-06-13T11:35:15.865 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000066475 2024-06-13T11:35:15.865 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.865 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:15.865 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.865 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.866 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.866 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.866 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 1650256, 2024-06-13T11:35:15.866 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 173584 2024-06-13T11:35:15.866 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.866 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2024-06-13T11:35:15.866 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2024-06-13T11:35:15.866 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2024-06-13T11:35:15.866 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.867 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2024-06-13T11:35:15.867 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-06-13T11:35:15.867 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-06-13T11:35:15.867 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 4763, 2024-06-13T11:35:15.867 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.146941463, 2024-06-13T11:35:15.867 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000030850 2024-06-13T11:35:15.867 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:15.867 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.867 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2024-06-13T11:35:15.868 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-06-13T11:35:15.868 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-06-13T11:35:15.868 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.868 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.868 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.868 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:15.868 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.868 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2024-06-13T11:35:15.868 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 0, 2024-06-13T11:35:15.868 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 0, 2024-06-13T11:35:15.869 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2024-06-13T11:35:15.869 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.869 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.869 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.869 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.869 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2024-06-13T11:35:15.870 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 0, 2024-06-13T11:35:15.870 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 0, 2024-06-13T11:35:15.870 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2024-06-13T11:35:15.870 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 0, 2024-06-13T11:35:15.870 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 0, 2024-06-13T11:35:15.870 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2024-06-13T11:35:15.870 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 2960, 2024-06-13T11:35:15.870 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 0, 2024-06-13T11:35:15.870 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 2960, 2024-06-13T11:35:15.871 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 0, 2024-06-13T11:35:15.871 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 2960, 2024-06-13T11:35:15.871 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 0, 2024-06-13T11:35:15.871 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 0, 2024-06-13T11:35:15.871 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 0, 2024-06-13T11:35:15.871 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 169, 2024-06-13T11:35:15.871 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 0, 2024-06-13T11:35:15.871 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 0, 2024-06-13T11:35:15.872 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 0, 2024-06-13T11:35:15.872 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 0, 2024-06-13T11:35:15.872 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2024-06-13T11:35:15.872 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2024-06-13T11:35:15.872 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 0, 2024-06-13T11:35:15.872 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2024-06-13T11:35:15.872 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2024-06-13T11:35:15.872 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 0, 2024-06-13T11:35:15.872 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 0, 2024-06-13T11:35:15.873 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 0, 2024-06-13T11:35:15.873 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 0, 2024-06-13T11:35:15.873 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2024-06-13T11:35:15.873 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 0, 2024-06-13T11:35:15.873 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2024-06-13T11:35:15.873 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 3452, 2024-06-13T11:35:15.873 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 26717845, 2024-06-13T11:35:15.873 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 6, 2024-06-13T11:35:15.873 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 0, 2024-06-13T11:35:15.873 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2024-06-13T11:35:15.874 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2024-06-13T11:35:15.874 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2024-06-13T11:35:15.874 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 0, 2024-06-13T11:35:15.874 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 0, 2024-06-13T11:35:15.874 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 0, 2024-06-13T11:35:15.874 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 0, 2024-06-13T11:35:15.875 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 0, 2024-06-13T11:35:15.875 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 0, 2024-06-13T11:35:15.875 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 0, 2024-06-13T11:35:15.875 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2024-06-13T11:35:15.875 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-13T11:35:15.875 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-13T11:35:15.875 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 0, 2024-06-13T11:35:15.875 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 0, 2024-06-13T11:35:15.876 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 0, 2024-06-13T11:35:15.876 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 0 2024-06-13T11:35:15.876 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.876 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2024-06-13T11:35:15.876 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2024-06-13T11:35:15.876 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 0, 2024-06-13T11:35:15.876 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 0, 2024-06-13T11:35:15.876 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 0, 2024-06-13T11:35:15.876 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 0, 2024-06-13T11:35:15.877 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2024-06-13T11:35:15.877 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2024-06-13T11:35:15.877 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2024-06-13T11:35:15.877 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 0, 2024-06-13T11:35:15.877 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 0, 2024-06-13T11:35:15.877 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 0, 2024-06-13T11:35:15.877 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2024-06-13T11:35:15.877 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2024-06-13T11:35:15.877 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2024-06-13T11:35:15.878 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2024-06-13T11:35:15.878 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2024-06-13T11:35:15.878 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2024-06-13T11:35:15.878 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_path": 0, 2024-06-13T11:35:15.878 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_inode": 0, 2024-06-13T11:35:15.878 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 0, 2024-06-13T11:35:15.878 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 0, 2024-06-13T11:35:15.878 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2024-06-13T11:35:15.878 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 0, 2024-06-13T11:35:15.879 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2024-06-13T11:35:15.879 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0 2024-06-13T11:35:15.879 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.879 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2024-06-13T11:35:15.879 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2024-06-13T11:35:15.879 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 0, 2024-06-13T11:35:15.879 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 0, 2024-06-13T11:35:15.879 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 0, 2024-06-13T11:35:15.879 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 19553, 2024-06-13T11:35:15.880 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2024-06-13T11:35:15.880 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 0, 2024-06-13T11:35:15.880 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 0, 2024-06-13T11:35:15.880 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 0, 2024-06-13T11:35:15.880 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 0, 2024-06-13T11:35:15.880 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 27, 2024-06-13T11:35:15.880 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 3, 2024-06-13T11:35:15.880 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2024-06-13T11:35:15.880 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 0, 2024-06-13T11:35:15.881 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 4194304, 2024-06-13T11:35:15.881 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 50974004, 2024-06-13T11:35:15.881 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 50973868, 2024-06-13T11:35:15.881 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2024-06-13T11:35:15.881 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.881 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.881 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.881 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.881 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 19553 2024-06-13T11:35:15.882 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.882 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2024-06-13T11:35:15.882 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 211, 2024-06-13T11:35:15.882 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 6585, 2024-06-13T11:35:15.882 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 6374, 2024-06-13T11:35:15.882 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 212, 2024-06-13T11:35:15.882 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 298, 2024-06-13T11:35:15.882 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 86, 2024-06-13T11:35:15.883 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 2960, 2024-06-13T11:35:15.883 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 7633, 2024-06-13T11:35:15.883 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 4673, 2024-06-13T11:35:15.883 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 0, 2024-06-13T11:35:15.883 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 0, 2024-06-13T11:35:15.883 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 0, 2024-06-13T11:35:15.883 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 68972, 2024-06-13T11:35:15.883 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 215420 2024-06-13T11:35:15.883 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.884 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2024-06-13T11:35:15.884 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 0, 2024-06-13T11:35:15.884 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 0, 2024-06-13T11:35:15.884 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 0, 2024-06-13T11:35:15.884 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 0, 2024-06-13T11:35:15.884 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 0, 2024-06-13T11:35:15.884 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2024-06-13T11:35:15.884 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.884 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.885 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.885 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.885 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2024-06-13T11:35:15.885 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.885 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.885 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.885 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.885 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2024-06-13T11:35:15.886 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.886 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.886 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.886 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.886 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2024-06-13T11:35:15.886 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.886 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.886 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.887 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.887 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2024-06-13T11:35:15.887 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.887 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.887 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.887 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.887 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2024-06-13T11:35:15.887 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.888 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.888 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.888 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.888 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2024-06-13T11:35:15.888 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.888 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.888 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.888 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.889 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2024-06-13T11:35:15.889 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.889 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.889 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.889 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.889 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2024-06-13T11:35:15.889 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.890 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.890 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.890 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.890 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2024-06-13T11:35:15.890 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.890 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.890 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.890 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.891 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2024-06-13T11:35:15.891 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.891 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.891 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.891 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.892 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2024-06-13T11:35:15.892 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.892 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.892 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.892 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.892 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2024-06-13T11:35:15.892 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.893 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.893 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.893 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.893 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2024-06-13T11:35:15.893 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.893 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.893 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.893 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.894 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2024-06-13T11:35:15.894 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.894 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.894 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.894 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.894 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2024-06-13T11:35:15.894 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.894 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.895 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.895 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.895 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2024-06-13T11:35:15.895 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.895 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.895 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.895 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.895 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2024-06-13T11:35:15.896 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.896 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.896 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.896 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.896 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2024-06-13T11:35:15.896 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.896 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.896 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.897 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.897 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2024-06-13T11:35:15.897 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.897 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.897 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.897 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.897 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2024-06-13T11:35:15.898 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.898 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.898 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.898 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.898 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2024-06-13T11:35:15.898 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.898 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.898 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.899 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.899 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2024-06-13T11:35:15.899 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.899 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.899 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.899 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.899 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2024-06-13T11:35:15.899 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.900 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.900 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.900 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.900 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2024-06-13T11:35:15.900 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.900 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.900 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.901 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.901 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2024-06-13T11:35:15.901 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.901 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.901 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.901 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.901 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2024-06-13T11:35:15.902 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.902 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.902 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.902 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.902 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2024-06-13T11:35:15.902 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.902 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.902 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.903 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.903 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2024-06-13T11:35:15.903 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.903 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.903 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.903 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.903 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2024-06-13T11:35:15.903 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2024-06-13T11:35:15.904 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2024-06-13T11:35:15.904 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.904 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.904 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.904 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:15.904 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.904 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2024-06-13T11:35:15.905 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 2, 2024-06-13T11:35:15.905 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 5, 2024-06-13T11:35:15.905 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 3, 2024-06-13T11:35:15.905 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 3, 2024-06-13T11:35:15.905 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2024-06-13T11:35:15.905 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 0, 2024-06-13T11:35:15.905 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 0, 2024-06-13T11:35:15.905 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 3406, 2024-06-13T11:35:15.906 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2024-06-13T11:35:15.906 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.906 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2024-06-13T11:35:15.906 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2024-06-13T11:35:15.906 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2024-06-13T11:35:15.906 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T11:35:15.906 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2024-06-13T11:35:15.906 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T11:35:15.906 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2024-06-13T11:35:15.907 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T11:35:15.907 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T11:35:15.907 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T11:35:15.907 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T11:35:15.907 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T11:35:15.907 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2024-06-13T11:35:15.907 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T11:35:15.907 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T11:35:15.907 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2024-06-13T11:35:15.908 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2024-06-13T11:35:15.908 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2024-06-13T11:35:15.908 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2024-06-13T11:35:15.908 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T11:35:15.908 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T11:35:15.908 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T11:35:15.908 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T11:35:15.908 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T11:35:15.908 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2024-06-13T11:35:15.909 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2024-06-13T11:35:15.909 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2024-06-13T11:35:15.909 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T11:35:15.909 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T11:35:15.909 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2024-06-13T11:35:15.909 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2024-06-13T11:35:15.909 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2024-06-13T11:35:15.909 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2024-06-13T11:35:15.909 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T11:35:15.910 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2024-06-13T11:35:15.910 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T11:35:15.910 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2024-06-13T11:35:15.910 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 215041, 2024-06-13T11:35:15.910 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 277, 2024-06-13T11:35:15.910 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 0, 2024-06-13T11:35:15.910 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 0, 2024-06-13T11:35:15.910 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2024-06-13T11:35:15.910 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2024-06-13T11:35:15.911 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2024-06-13T11:35:15.911 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2024-06-13T11:35:15.911 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2024-06-13T11:35:15.911 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2024-06-13T11:35:15.911 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 9432, 2024-06-13T11:35:15.911 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 182, 2024-06-13T11:35:15.911 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T11:35:15.911 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2024-06-13T11:35:15.911 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2024-06-13T11:35:15.912 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2024-06-13T11:35:15.912 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 2913009, 2024-06-13T11:35:15.912 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 18538, 2024-06-13T11:35:15.912 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2024-06-13T11:35:15.912 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2024-06-13T11:35:15.912 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2024-06-13T11:35:15.912 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2024-06-13T11:35:15.912 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.912 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2024-06-13T11:35:15.913 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2024-06-13T11:35:15.913 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2024-06-13T11:35:15.913 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 2869, 2024-06-13T11:35:15.913 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 26, 2024-06-13T11:35:15.913 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 4, 2024-06-13T11:35:15.913 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 2869, 2024-06-13T11:35:15.913 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2024-06-13T11:35:15.913 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2869, 2024-06-13T11:35:15.913 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 1.743969977, 2024-06-13T11:35:15.914 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000607866 2024-06-13T11:35:15.914 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.914 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2024-06-13T11:35:15.914 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2024-06-13T11:35:15.914 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2869, 2024-06-13T11:35:15.914 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 2870 2024-06-13T11:35:15.914 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.914 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 2869, 2024-06-13T11:35:15.914 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 2869, 2024-06-13T11:35:15.915 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 0, 2024-06-13T11:35:15.915 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2024-06-13T11:35:15.915 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2024-06-13T11:35:15.915 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 1834, 2024-06-13T11:35:15.915 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 0, 2024-06-13T11:35:15.915 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 1032, 2024-06-13T11:35:15.915 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 0, 2024-06-13T11:35:15.915 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 0, 2024-06-13T11:35:15.915 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2024-06-13T11:35:15.916 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2024-06-13T11:35:15.916 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2024-06-13T11:35:15.916 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 0, 2024-06-13T11:35:15.916 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 0, 2024-06-13T11:35:15.916 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2024-06-13T11:35:15.916 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2024-06-13T11:35:15.916 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2024-06-13T11:35:15.916 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 2, 2024-06-13T11:35:15.916 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 0, 2024-06-13T11:35:15.917 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2024-06-13T11:35:15.917 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2024-06-13T11:35:15.917 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2024-06-13T11:35:15.917 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2024-06-13T11:35:15.917 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2024-06-13T11:35:15.917 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2024-06-13T11:35:15.917 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2024-06-13T11:35:15.917 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2024-06-13T11:35:15.918 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2024-06-13T11:35:15.918 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2024-06-13T11:35:15.918 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2024-06-13T11:35:15.918 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2024-06-13T11:35:15.918 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2024-06-13T11:35:15.918 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2024-06-13T11:35:15.918 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2024-06-13T11:35:15.918 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2024-06-13T11:35:15.919 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2024-06-13T11:35:15.919 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2024-06-13T11:35:15.919 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2024-06-13T11:35:15.919 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2024-06-13T11:35:15.919 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2024-06-13T11:35:15.919 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2024-06-13T11:35:15.919 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2024-06-13T11:35:15.919 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2024-06-13T11:35:15.919 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2024-06-13T11:35:15.920 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2024-06-13T11:35:15.920 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 110, 2024-06-13T11:35:15.920 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2024-06-13T11:35:15.920 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 13, 2024-06-13T11:35:15.920 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 7, 2024-06-13T11:35:15.920 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 7, 2024-06-13T11:35:15.920 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 0, 2024-06-13T11:35:15.920 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2024-06-13T11:35:15.920 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 0, 2024-06-13T11:35:15.921 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 2, 2024-06-13T11:35:15.921 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 0 2024-06-13T11:35:15.921 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.921 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2024-06-13T11:35:15.921 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 0, 2024-06-13T11:35:15.921 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2024-06-13T11:35:15.921 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2024-06-13T11:35:15.921 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2024-06-13T11:35:15.922 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.922 INFO:teuthology.orchestra.run.smithi178.stdout: "osd-slow-ops": { 2024-06-13T11:35:15.922 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2024-06-13T11:35:15.922 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.922 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2024-06-13T11:35:15.922 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2024-06-13T11:35:15.922 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 0, 2024-06-13T11:35:15.922 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2024-06-13T11:35:15.922 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 0, 2024-06-13T11:35:15.923 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed_ops": 0, 2024-06-13T11:35:15.923 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 0, 2024-06-13T11:35:15.923 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2024-06-13T11:35:15.923 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.923 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T11:35:15.923 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-13T11:35:15.923 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-06-13T11:35:15.923 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-13T11:35:15.923 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 3183, 2024-06-13T11:35:15.924 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 48933781, 2024-06-13T11:35:15.924 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:15.924 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 3183, 2024-06-13T11:35:15.924 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-13T11:35:15.924 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-13T11:35:15.924 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3183, 2024-06-13T11:35:15.924 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 48933781, 2024-06-13T11:35:15.924 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-13T11:35:15.924 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.925 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.925 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.925 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:15.925 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.925 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2024-06-13T11:35:15.925 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-13T11:35:15.925 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-06-13T11:35:15.925 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-13T11:35:15.925 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-13T11:35:15.926 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-13T11:35:15.926 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:15.926 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:15.926 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 2869, 2024-06-13T11:35:15.926 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 46781912, 2024-06-13T11:35:15.926 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 2869, 2024-06-13T11:35:15.926 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 46781912, 2024-06-13T11:35:15.926 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-13T11:35:15.926 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.927 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.927 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.927 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:15.927 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.927 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2024-06-13T11:35:15.927 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-13T11:35:15.927 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2024-06-13T11:35:15.927 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-13T11:35:15.927 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-13T11:35:15.928 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-13T11:35:15.928 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:15.928 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:15.928 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 2869, 2024-06-13T11:35:15.928 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 2869, 2024-06-13T11:35:15.928 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 2869, 2024-06-13T11:35:15.928 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 2869, 2024-06-13T11:35:15.928 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-13T11:35:15.928 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.929 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.929 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.929 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:15.929 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.929 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2024-06-13T11:35:15.929 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-13T11:35:15.929 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-06-13T11:35:15.929 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-13T11:35:15.929 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-13T11:35:15.930 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-13T11:35:15.930 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:15.930 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:15.930 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-13T11:35:15.930 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-13T11:35:15.930 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-06-13T11:35:15.930 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-06-13T11:35:15.930 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-13T11:35:15.930 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.931 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.931 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.931 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:15.931 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:15.931 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x55fa31caa6e0": { 2024-06-13T11:35:15.931 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-13T11:35:15.931 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-06-13T11:35:15.931 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-13T11:35:15.932 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-13T11:35:15.932 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-13T11:35:15.932 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:15.932 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:15.932 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-13T11:35:15.932 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-13T11:35:15.932 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-06-13T11:35:15.932 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-06-13T11:35:15.932 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-13T11:35:15.933 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:15.933 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:15.933 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:15.933 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:15.933 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:15.933 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-06-13T11:35:15.933 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:15 smithi002 ceph-mon[32210]: pgmap v357: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:35:16.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:15 smithi077 ceph-mon[36410]: pgmap v357: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T11:35:16.658 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-06-13T11:35:16.658 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-06-13T11:35:16.658 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-06-13T11:35:16.658 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-06-13T11:35:16.659 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-06-13T11:35:16.659 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-06-13T11:35:16.659 DEBUG:tasks.check_counter:Getting stats from i 2024-06-13T11:35:16.659 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph daemon mds.i perf dump 2024-06-13T11:35:16.895 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:35:17.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:17 smithi002 ceph-mon[32210]: pgmap v358: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2024-06-13T11:35:17.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:17 smithi178 ceph-mon[36913]: pgmap v358: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2024-06-13T11:35:18.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:17 smithi077 ceph-mon[36410]: pgmap v358: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 206 B/s wr, 6 op/s 2024-06-13T11:35:18.585 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-06-13T11:35:18.586 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T11:35:18.586 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 4317, 2024-06-13T11:35:18.586 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 4293, 2024-06-13T11:35:18.586 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 1135941, 2024-06-13T11:35:18.586 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 22991741, 2024-06-13T11:35:18.586 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 98, 2024-06-13T11:35:18.586 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 7, 2024-06-13T11:35:18.587 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.471717806, 2024-06-13T11:35:18.587 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.201126576, 2024-06-13T11:35:18.587 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.108541702, 2024-06-13T11:35:18.587 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.123566087, 2024-06-13T11:35:18.587 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:18.587 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 4284, 2024-06-13T11:35:18.587 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.373300964, 2024-06-13T11:35:18.587 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000087138 2024-06-13T11:35:18.587 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.588 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:18.588 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 379, 2024-06-13T11:35:18.588 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000063419, 2024-06-13T11:35:18.588 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000167 2024-06-13T11:35:18.588 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.588 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 103328, 2024-06-13T11:35:18.588 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 370528 2024-06-13T11:35:18.588 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.588 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T11:35:18.589 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 27726, 2024-06-13T11:35:18.589 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 44207, 2024-06-13T11:35:18.589 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 9664220, 2024-06-13T11:35:18.589 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 38661868, 2024-06-13T11:35:18.589 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 19, 2024-06-13T11:35:18.589 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 6, 2024-06-13T11:35:18.589 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 1.951131157, 2024-06-13T11:35:18.589 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.824296744, 2024-06-13T11:35:18.590 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 1.124736630, 2024-06-13T11:35:18.590 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.244168690, 2024-06-13T11:35:18.590 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:18.590 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 44208, 2024-06-13T11:35:18.590 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 2.117164004, 2024-06-13T11:35:18.590 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000047890 2024-06-13T11:35:18.590 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.590 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:18.591 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 53510, 2024-06-13T11:35:18.591 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.009382848, 2024-06-13T11:35:18.591 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000175 2024-06-13T11:35:18.591 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.591 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 327104, 2024-06-13T11:35:18.591 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 369408 2024-06-13T11:35:18.591 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.591 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T11:35:18.591 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 9237, 2024-06-13T11:35:18.592 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 7525, 2024-06-13T11:35:18.592 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 4146913, 2024-06-13T11:35:18.592 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 9518852, 2024-06-13T11:35:18.592 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 14, 2024-06-13T11:35:18.592 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 5, 2024-06-13T11:35:18.592 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.625491584, 2024-06-13T11:35:18.592 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.229943909, 2024-06-13T11:35:18.592 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.282478008, 2024-06-13T11:35:18.592 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.141551176, 2024-06-13T11:35:18.593 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:18.593 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 7528, 2024-06-13T11:35:18.593 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.622689999, 2024-06-13T11:35:18.593 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000082716 2024-06-13T11:35:18.593 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.593 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:18.593 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 6416, 2024-06-13T11:35:18.593 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.001056255, 2024-06-13T11:35:18.593 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000164 2024-06-13T11:35:18.593 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.594 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 1689008, 2024-06-13T11:35:18.594 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 197408 2024-06-13T11:35:18.594 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.594 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2024-06-13T11:35:18.594 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2024-06-13T11:35:18.594 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2024-06-13T11:35:18.594 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.594 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2024-06-13T11:35:18.595 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-06-13T11:35:18.595 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-06-13T11:35:18.595 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 4574, 2024-06-13T11:35:18.595 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 12.801485222, 2024-06-13T11:35:18.595 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.002798750 2024-06-13T11:35:18.595 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:18.595 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.595 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2024-06-13T11:35:18.596 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-06-13T11:35:18.596 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-06-13T11:35:18.596 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 4573, 2024-06-13T11:35:18.596 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 1.362285981, 2024-06-13T11:35:18.596 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000297897 2024-06-13T11:35:18.596 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:18.596 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.596 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2024-06-13T11:35:18.596 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 10654, 2024-06-13T11:35:18.597 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 10536, 2024-06-13T11:35:18.597 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2024-06-13T11:35:18.597 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 10536, 2024-06-13T11:35:18.597 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 29.945957412, 2024-06-13T11:35:18.597 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.002842251 2024-06-13T11:35:18.597 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.597 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2024-06-13T11:35:18.597 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 118, 2024-06-13T11:35:18.597 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 0, 2024-06-13T11:35:18.598 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2024-06-13T11:35:18.598 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 220, 2024-06-13T11:35:18.598 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 25, 2024-06-13T11:35:18.598 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 2, 2024-06-13T11:35:18.598 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 1204, 2024-06-13T11:35:18.598 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 298, 2024-06-13T11:35:18.599 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 244, 2024-06-13T11:35:18.599 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 662, 2024-06-13T11:35:18.599 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 778, 2024-06-13T11:35:18.599 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 5017, 2024-06-13T11:35:18.599 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 110, 2024-06-13T11:35:18.599 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 111, 2024-06-13T11:35:18.599 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 169, 2024-06-13T11:35:18.599 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 11680, 2024-06-13T11:35:18.599 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 10884, 2024-06-13T11:35:18.600 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 114, 2024-06-13T11:35:18.600 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 0, 2024-06-13T11:35:18.600 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2024-06-13T11:35:18.600 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2024-06-13T11:35:18.600 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 2, 2024-06-13T11:35:18.600 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2024-06-13T11:35:18.600 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2024-06-13T11:35:18.600 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 167, 2024-06-13T11:35:18.600 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 4862, 2024-06-13T11:35:18.601 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 0, 2024-06-13T11:35:18.601 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 0, 2024-06-13T11:35:18.601 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2024-06-13T11:35:18.601 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 5231, 2024-06-13T11:35:18.601 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2024-06-13T11:35:18.601 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 3452, 2024-06-13T11:35:18.601 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 26717845, 2024-06-13T11:35:18.601 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 6, 2024-06-13T11:35:18.601 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 5231, 2024-06-13T11:35:18.601 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2024-06-13T11:35:18.602 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2024-06-13T11:35:18.602 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2024-06-13T11:35:18.602 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 428, 2024-06-13T11:35:18.602 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 12, 2024-06-13T11:35:18.602 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 416, 2024-06-13T11:35:18.602 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 4803, 2024-06-13T11:35:18.602 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 5, 2024-06-13T11:35:18.602 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 93, 2024-06-13T11:35:18.603 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 9727, 2024-06-13T11:35:18.603 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 8, 2024-06-13T11:35:18.603 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-13T11:35:18.603 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-13T11:35:18.603 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 7633, 2024-06-13T11:35:18.603 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 4923, 2024-06-13T11:35:18.603 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 672, 2024-06-13T11:35:18.603 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 3462 2024-06-13T11:35:18.603 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.604 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2024-06-13T11:35:18.604 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2024-06-13T11:35:18.604 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 0, 2024-06-13T11:35:18.604 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 0, 2024-06-13T11:35:18.604 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 0, 2024-06-13T11:35:18.604 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 63, 2024-06-13T11:35:18.604 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2024-06-13T11:35:18.604 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2024-06-13T11:35:18.604 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2024-06-13T11:35:18.605 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 2681, 2024-06-13T11:35:18.605 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 2678, 2024-06-13T11:35:18.605 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 3, 2024-06-13T11:35:18.605 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2024-06-13T11:35:18.605 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2024-06-13T11:35:18.605 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2024-06-13T11:35:18.605 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2024-06-13T11:35:18.605 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2024-06-13T11:35:18.606 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2024-06-13T11:35:18.606 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_path": 0, 2024-06-13T11:35:18.606 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_inode": 0, 2024-06-13T11:35:18.606 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 12, 2024-06-13T11:35:18.606 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 167, 2024-06-13T11:35:18.606 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2024-06-13T11:35:18.606 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 27, 2024-06-13T11:35:18.606 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2024-06-13T11:35:18.607 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0 2024-06-13T11:35:18.607 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.607 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2024-06-13T11:35:18.607 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2024-06-13T11:35:18.607 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 19553, 2024-06-13T11:35:18.607 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 0, 2024-06-13T11:35:18.608 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 0, 2024-06-13T11:35:18.608 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 19553, 2024-06-13T11:35:18.608 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2024-06-13T11:35:18.608 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 0, 2024-06-13T11:35:18.609 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 27, 2024-06-13T11:35:18.609 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 0, 2024-06-13T11:35:18.609 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 0, 2024-06-13T11:35:18.609 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 27, 2024-06-13T11:35:18.610 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 3, 2024-06-13T11:35:18.610 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2024-06-13T11:35:18.610 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 0, 2024-06-13T11:35:18.610 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 4194304, 2024-06-13T11:35:18.610 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 50974004, 2024-06-13T11:35:18.610 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 0, 2024-06-13T11:35:18.610 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2024-06-13T11:35:18.610 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 704, 2024-06-13T11:35:18.611 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 28.163059263, 2024-06-13T11:35:18.611 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.040004345 2024-06-13T11:35:18.611 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.611 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 0 2024-06-13T11:35:18.611 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.611 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2024-06-13T11:35:18.611 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 547, 2024-06-13T11:35:18.612 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 6601, 2024-06-13T11:35:18.612 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 6054, 2024-06-13T11:35:18.612 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 213, 2024-06-13T11:35:18.612 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 300, 2024-06-13T11:35:18.612 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 87, 2024-06-13T11:35:18.612 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 1204, 2024-06-13T11:35:18.612 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 8060, 2024-06-13T11:35:18.612 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 6856, 2024-06-13T11:35:18.613 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 111, 2024-06-13T11:35:18.613 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 6358, 2024-06-13T11:35:18.613 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 6247, 2024-06-13T11:35:18.613 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 94368, 2024-06-13T11:35:18.613 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 231804 2024-06-13T11:35:18.613 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.613 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2024-06-13T11:35:18.613 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 10957, 2024-06-13T11:35:18.613 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 1026, 2024-06-13T11:35:18.614 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 10654, 2024-06-13T11:35:18.614 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 202, 2024-06-13T11:35:18.614 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 2052, 2024-06-13T11:35:18.614 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2024-06-13T11:35:18.614 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 6259, 2024-06-13T11:35:18.614 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 19.799664687, 2024-06-13T11:35:18.614 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.003163391 2024-06-13T11:35:18.614 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.614 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2024-06-13T11:35:18.615 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 167, 2024-06-13T11:35:18.615 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 1.157671806, 2024-06-13T11:35:18.615 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.006932166 2024-06-13T11:35:18.615 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.615 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2024-06-13T11:35:18.615 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.615 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.615 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.615 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.615 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2024-06-13T11:35:18.616 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 3, 2024-06-13T11:35:18.616 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.003339157, 2024-06-13T11:35:18.616 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.001113052 2024-06-13T11:35:18.616 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.616 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2024-06-13T11:35:18.616 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 732, 2024-06-13T11:35:18.616 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 1.202725654, 2024-06-13T11:35:18.616 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.001643067 2024-06-13T11:35:18.616 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.617 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2024-06-13T11:35:18.617 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.617 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.617 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.617 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.617 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2024-06-13T11:35:18.617 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2, 2024-06-13T11:35:18.617 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000421594, 2024-06-13T11:35:18.617 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000210797 2024-06-13T11:35:18.618 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.618 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2024-06-13T11:35:18.618 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.618 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.618 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.618 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.618 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2024-06-13T11:35:18.618 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.618 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.618 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.619 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.619 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2024-06-13T11:35:18.619 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.619 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.619 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.619 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.620 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2024-06-13T11:35:18.620 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 11, 2024-06-13T11:35:18.620 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.002355770, 2024-06-13T11:35:18.620 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000214160 2024-06-13T11:35:18.620 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.620 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2024-06-13T11:35:18.620 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 84, 2024-06-13T11:35:18.621 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.138822206, 2024-06-13T11:35:18.621 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.001652645 2024-06-13T11:35:18.621 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.621 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2024-06-13T11:35:18.621 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.621 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.621 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.621 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.621 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2024-06-13T11:35:18.622 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 11, 2024-06-13T11:35:18.622 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.061852978, 2024-06-13T11:35:18.622 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.005622998 2024-06-13T11:35:18.622 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.622 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2024-06-13T11:35:18.622 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 403, 2024-06-13T11:35:18.622 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.181843600, 2024-06-13T11:35:18.622 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000451224 2024-06-13T11:35:18.622 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.623 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2024-06-13T11:35:18.623 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 101, 2024-06-13T11:35:18.623 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.586593633, 2024-06-13T11:35:18.623 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.005807857 2024-06-13T11:35:18.623 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.623 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2024-06-13T11:35:18.623 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 80, 2024-06-13T11:35:18.623 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.262166627, 2024-06-13T11:35:18.623 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.003277082 2024-06-13T11:35:18.624 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.624 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2024-06-13T11:35:18.624 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.624 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.624 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.624 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.624 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2024-06-13T11:35:18.624 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.624 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.625 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.625 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.625 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2024-06-13T11:35:18.625 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 22, 2024-06-13T11:35:18.625 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.420312292, 2024-06-13T11:35:18.625 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.019105104 2024-06-13T11:35:18.625 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.625 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2024-06-13T11:35:18.625 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 5, 2024-06-13T11:35:18.626 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.022805558, 2024-06-13T11:35:18.626 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.004561111 2024-06-13T11:35:18.626 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.626 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2024-06-13T11:35:18.626 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.626 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.626 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.626 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.626 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2024-06-13T11:35:18.627 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 10, 2024-06-13T11:35:18.627 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.056155545, 2024-06-13T11:35:18.627 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.005615554 2024-06-13T11:35:18.627 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.627 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2024-06-13T11:35:18.627 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.627 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.627 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.627 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.627 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2024-06-13T11:35:18.628 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 8, 2024-06-13T11:35:18.628 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.003160784, 2024-06-13T11:35:18.628 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000395098 2024-06-13T11:35:18.628 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.628 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2024-06-13T11:35:18.628 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.628 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.629 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.629 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.629 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2024-06-13T11:35:18.629 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 8, 2024-06-13T11:35:18.629 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.024079073, 2024-06-13T11:35:18.629 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.003009884 2024-06-13T11:35:18.629 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.629 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2024-06-13T11:35:18.629 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 6, 2024-06-13T11:35:18.630 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.004317766, 2024-06-13T11:35:18.630 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000719627 2024-06-13T11:35:18.630 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.630 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2024-06-13T11:35:18.630 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2624, 2024-06-13T11:35:18.630 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 6.017668682, 2024-06-13T11:35:18.630 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.002293318 2024-06-13T11:35:18.630 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.630 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2024-06-13T11:35:18.631 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2024-06-13T11:35:18.631 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2024-06-13T11:35:18.631 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.631 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.631 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.631 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:18.631 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.631 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2024-06-13T11:35:18.631 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 2, 2024-06-13T11:35:18.631 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 5, 2024-06-13T11:35:18.632 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 3, 2024-06-13T11:35:18.632 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 2, 2024-06-13T11:35:18.632 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2024-06-13T11:35:18.632 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 43, 2024-06-13T11:35:18.632 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 21, 2024-06-13T11:35:18.632 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 654, 2024-06-13T11:35:18.632 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2024-06-13T11:35:18.632 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.632 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2024-06-13T11:35:18.633 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2024-06-13T11:35:18.633 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2024-06-13T11:35:18.633 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T11:35:18.633 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2024-06-13T11:35:18.633 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T11:35:18.633 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2024-06-13T11:35:18.633 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T11:35:18.633 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T11:35:18.634 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T11:35:18.634 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T11:35:18.634 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T11:35:18.634 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2024-06-13T11:35:18.634 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T11:35:18.634 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T11:35:18.634 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2024-06-13T11:35:18.634 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2024-06-13T11:35:18.634 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2024-06-13T11:35:18.634 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2024-06-13T11:35:18.635 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T11:35:18.635 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T11:35:18.635 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T11:35:18.635 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T11:35:18.635 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T11:35:18.635 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2024-06-13T11:35:18.635 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2024-06-13T11:35:18.635 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2024-06-13T11:35:18.635 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T11:35:18.636 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T11:35:18.636 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2024-06-13T11:35:18.636 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2024-06-13T11:35:18.636 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2024-06-13T11:35:18.636 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2024-06-13T11:35:18.636 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T11:35:18.636 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2024-06-13T11:35:18.636 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T11:35:18.637 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2024-06-13T11:35:18.637 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 318273, 2024-06-13T11:35:18.637 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 640, 2024-06-13T11:35:18.637 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 1320, 2024-06-13T11:35:18.637 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 15, 2024-06-13T11:35:18.637 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2024-06-13T11:35:18.637 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2024-06-13T11:35:18.637 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2024-06-13T11:35:18.637 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2024-06-13T11:35:18.638 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2024-06-13T11:35:18.638 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2024-06-13T11:35:18.638 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 9432, 2024-06-13T11:35:18.638 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 182, 2024-06-13T11:35:18.638 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T11:35:18.638 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2024-06-13T11:35:18.638 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2024-06-13T11:35:18.638 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2024-06-13T11:35:18.638 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 2605981, 2024-06-13T11:35:18.639 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 33087, 2024-06-13T11:35:18.639 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2024-06-13T11:35:18.639 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2024-06-13T11:35:18.639 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2024-06-13T11:35:18.639 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2024-06-13T11:35:18.639 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.639 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2024-06-13T11:35:18.639 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2024-06-13T11:35:18.639 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2024-06-13T11:35:18.640 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 12322, 2024-06-13T11:35:18.640 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 50814407, 2024-06-13T11:35:18.640 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 37, 2024-06-13T11:35:18.640 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 12322, 2024-06-13T11:35:18.640 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2024-06-13T11:35:18.640 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 12322, 2024-06-13T11:35:18.640 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 60.797954641, 2024-06-13T11:35:18.640 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.004934097 2024-06-13T11:35:18.640 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.640 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2024-06-13T11:35:18.641 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2024-06-13T11:35:18.641 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 12322, 2024-06-13T11:35:18.641 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 12656 2024-06-13T11:35:18.641 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.641 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 12322, 2024-06-13T11:35:18.641 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 5299, 2024-06-13T11:35:18.641 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 7023, 2024-06-13T11:35:18.641 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2024-06-13T11:35:18.641 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2024-06-13T11:35:18.642 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 0, 2024-06-13T11:35:18.642 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 11, 2024-06-13T11:35:18.642 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 56, 2024-06-13T11:35:18.642 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 748, 2024-06-13T11:35:18.642 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 53, 2024-06-13T11:35:18.642 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2024-06-13T11:35:18.642 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2024-06-13T11:35:18.642 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2024-06-13T11:35:18.642 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 9, 2024-06-13T11:35:18.643 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 5896, 2024-06-13T11:35:18.643 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2024-06-13T11:35:18.643 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2024-06-13T11:35:18.643 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2024-06-13T11:35:18.643 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 5243, 2024-06-13T11:35:18.643 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 22, 2024-06-13T11:35:18.643 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2024-06-13T11:35:18.643 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2024-06-13T11:35:18.643 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2024-06-13T11:35:18.643 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2024-06-13T11:35:18.644 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2024-06-13T11:35:18.644 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2024-06-13T11:35:18.644 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2024-06-13T11:35:18.644 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2024-06-13T11:35:18.644 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2024-06-13T11:35:18.644 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 8, 2024-06-13T11:35:18.644 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2024-06-13T11:35:18.644 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2024-06-13T11:35:18.644 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2024-06-13T11:35:18.645 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2024-06-13T11:35:18.645 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2024-06-13T11:35:18.645 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2024-06-13T11:35:18.645 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2024-06-13T11:35:18.645 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2024-06-13T11:35:18.645 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2024-06-13T11:35:18.645 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2024-06-13T11:35:18.646 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2024-06-13T11:35:18.646 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2024-06-13T11:35:18.646 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2024-06-13T11:35:18.646 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2024-06-13T11:35:18.646 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2024-06-13T11:35:18.646 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2024-06-13T11:35:18.646 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 110, 2024-06-13T11:35:18.646 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2024-06-13T11:35:18.647 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 22, 2024-06-13T11:35:18.647 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 12, 2024-06-13T11:35:18.647 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 12, 2024-06-13T11:35:18.647 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 0, 2024-06-13T11:35:18.647 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2024-06-13T11:35:18.647 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 570, 2024-06-13T11:35:18.647 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 0, 2024-06-13T11:35:18.647 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 40 2024-06-13T11:35:18.647 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.647 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2024-06-13T11:35:18.648 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 1, 2024-06-13T11:35:18.648 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2024-06-13T11:35:18.648 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2024-06-13T11:35:18.648 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2024-06-13T11:35:18.648 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.648 INFO:teuthology.orchestra.run.smithi178.stdout: "osd-slow-ops": { 2024-06-13T11:35:18.648 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2024-06-13T11:35:18.648 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.648 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2024-06-13T11:35:18.649 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2024-06-13T11:35:18.649 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 17, 2024-06-13T11:35:18.649 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2024-06-13T11:35:18.649 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 10, 2024-06-13T11:35:18.649 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed_ops": 5341, 2024-06-13T11:35:18.649 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 2678, 2024-06-13T11:35:18.649 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2024-06-13T11:35:18.649 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.649 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T11:35:18.650 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-13T11:35:18.650 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-06-13T11:35:18.650 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-13T11:35:18.650 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 41276, 2024-06-13T11:35:18.650 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 11164251, 2024-06-13T11:35:18.650 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:18.650 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 41276, 2024-06-13T11:35:18.650 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-13T11:35:18.651 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-13T11:35:18.651 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 41276, 2024-06-13T11:35:18.651 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 11164251, 2024-06-13T11:35:18.651 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-13T11:35:18.651 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.651 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.651 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.651 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:18.651 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.652 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2024-06-13T11:35:18.652 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-13T11:35:18.652 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-06-13T11:35:18.652 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-13T11:35:18.652 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-13T11:35:18.652 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-13T11:35:18.652 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:18.652 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:18.652 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 12322, 2024-06-13T11:35:18.653 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 51106213, 2024-06-13T11:35:18.653 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 12322, 2024-06-13T11:35:18.653 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 51106213, 2024-06-13T11:35:18.653 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-13T11:35:18.653 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.653 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.653 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.653 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:18.653 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.654 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2024-06-13T11:35:18.654 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-13T11:35:18.654 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2024-06-13T11:35:18.654 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-13T11:35:18.654 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-13T11:35:18.654 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-13T11:35:18.654 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:18.654 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-13T11:35:18.654 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 12322, 2024-06-13T11:35:18.655 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 12322, 2024-06-13T11:35:18.655 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 12322, 2024-06-13T11:35:18.655 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 12322, 2024-06-13T11:35:18.655 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-13T11:35:18.655 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.655 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.655 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.655 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:18.655 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.656 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2024-06-13T11:35:18.656 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-13T11:35:18.656 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-06-13T11:35:18.656 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-13T11:35:18.656 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 2678, 2024-06-13T11:35:18.656 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 291806, 2024-06-13T11:35:18.656 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:18.656 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 2678, 2024-06-13T11:35:18.656 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-13T11:35:18.656 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-13T11:35:18.657 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 44, 2024-06-13T11:35:18.657 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 291806, 2024-06-13T11:35:18.657 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-13T11:35:18.657 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.657 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.657 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.657 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:18.657 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:18.657 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x5557a70de460": { 2024-06-13T11:35:18.658 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-13T11:35:18.658 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-06-13T11:35:18.658 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-13T11:35:18.658 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 19553, 2024-06-13T11:35:18.658 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 46779700, 2024-06-13T11:35:18.658 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:18.658 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 19553, 2024-06-13T11:35:18.658 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-13T11:35:18.658 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-13T11:35:18.659 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 704, 2024-06-13T11:35:18.659 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 46779700, 2024-06-13T11:35:18.659 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-13T11:35:18.659 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:18.659 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:18.659 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:18.659 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:18.659 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:18.659 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-06-13T11:35:19.399 INFO:tasks.check_counter:Daemon mds.i mds.exported=167 2024-06-13T11:35:19.399 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-06-13T11:35:19.399 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-06-13T11:35:19.399 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=11 2024-06-13T11:35:19.399 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=5 2024-06-13T11:35:19.399 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=25 2024-06-13T11:35:19.399 DEBUG:tasks.check_counter:Getting stats from l 2024-06-13T11:35:19.400 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph daemon mds.l perf dump 2024-06-13T11:35:19.636 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T11:35:19.696 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:19 smithi178 ceph-mon[36913]: pgmap v359: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-06-13T11:35:19.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:19 smithi002 ceph-mon[32210]: pgmap v359: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-06-13T11:35:20.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:19 smithi077 ceph-mon[36410]: pgmap v359: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-06-13T11:35:21.303 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-06-13T11:35:21.303 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T11:35:21.303 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 297, 2024-06-13T11:35:21.303 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 284, 2024-06-13T11:35:21.303 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 1603824, 2024-06-13T11:35:21.304 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 174592, 2024-06-13T11:35:21.304 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 4, 2024-06-13T11:35:21.304 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 0, 2024-06-13T11:35:21.304 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.056247173, 2024-06-13T11:35:21.304 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.018294425, 2024-06-13T11:35:21.304 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.037645729, 2024-06-13T11:35:21.304 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.007064760, 2024-06-13T11:35:21.304 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:21.304 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 284, 2024-06-13T11:35:21.305 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.017201586, 2024-06-13T11:35:21.305 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000060568 2024-06-13T11:35:21.305 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:21.305 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:21.305 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:21.305 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:21.305 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:21.305 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:21.305 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 1603824, 2024-06-13T11:35:21.306 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 174592 2024-06-13T11:35:21.306 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:21.306 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T11:35:21.306 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 2, 2024-06-13T11:35:21.306 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 215, 2024-06-13T11:35:21.306 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 320, 2024-06-13T11:35:21.306 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 193536, 2024-06-13T11:35:21.306 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 5, 2024-06-13T11:35:21.307 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 3, 2024-06-13T11:35:21.307 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.014376603, 2024-06-13T11:35:21.307 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.010312081, 2024-06-13T11:35:21.307 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.001312460, 2024-06-13T11:35:21.307 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T11:35:21.307 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:21.307 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 212, 2024-06-13T11:35:21.307 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.026514221, 2024-06-13T11:35:21.307 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000125067 2024-06-13T11:35:21.308 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:21.308 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:21.308 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:21.308 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:21.308 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:21.308 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:21.308 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-13T11:35:21.308 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 193536 2024-06-13T11:35:21.308 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:21.309 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T11:35:21.309 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 0, 2024-06-13T11:35:21.309 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 2, 2024-06-13T11:35:21.309 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 0, 2024-06-13T11:35:21.309 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 0, 2024-06-13T11:35:21.309 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 2, 2024-06-13T11:35:21.309 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 1, 2024-06-13T11:35:21.309 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.000254808, 2024-06-13T11:35:21.309 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.000000000, 2024-06-13T11:35:21.310 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.000165861, 2024-06-13T11:35:21.310 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T11:35:21.310 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T11:35:21.310 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:21.310 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:21.310 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:21.310 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:21.310 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-13T11:35:21.311 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:21.311 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:21.311 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:21.311 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:21.311 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-13T11:35:21.311 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 0 2024-06-13T11:35:21.311 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:21.311 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2024-06-13T11:35:21.311 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 0, 2024-06-13T11:35:21.312 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2024-06-13T11:35:21.312 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:21.312 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2024-06-13T11:35:21.312 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2024-06-13T11:35:21.312 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2024-06-13T11:35:21.312 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T11:35:21.312 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2024-06-13T11:35:21.312 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T11:35:21.313 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2024-06-13T11:35:21.313 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T11:35:21.313 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T11:35:21.313 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T11:35:21.313 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T11:35:21.313 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T11:35:21.313 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2024-06-13T11:35:21.313 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T11:35:21.314 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T11:35:21.314 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2024-06-13T11:35:21.314 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2024-06-13T11:35:21.314 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2024-06-13T11:35:21.314 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2024-06-13T11:35:21.314 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T11:35:21.314 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T11:35:21.315 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T11:35:21.315 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T11:35:21.315 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T11:35:21.315 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2024-06-13T11:35:21.315 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2024-06-13T11:35:21.315 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2024-06-13T11:35:21.315 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T11:35:21.316 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T11:35:21.316 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2024-06-13T11:35:21.316 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2024-06-13T11:35:21.316 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2024-06-13T11:35:21.316 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2024-06-13T11:35:21.316 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T11:35:21.316 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2024-06-13T11:35:21.316 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T11:35:21.317 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2024-06-13T11:35:21.317 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 148692, 2024-06-13T11:35:21.317 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 30, 2024-06-13T11:35:21.317 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 0, 2024-06-13T11:35:21.317 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 0, 2024-06-13T11:35:21.317 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2024-06-13T11:35:21.317 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2024-06-13T11:35:21.318 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2024-06-13T11:35:21.318 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2024-06-13T11:35:21.318 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2024-06-13T11:35:21.318 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2024-06-13T11:35:21.318 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 0, 2024-06-13T11:35:21.318 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 0, 2024-06-13T11:35:21.318 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T11:35:21.318 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2024-06-13T11:35:21.319 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2024-06-13T11:35:21.319 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2024-06-13T11:35:21.319 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 928, 2024-06-13T11:35:21.319 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 2, 2024-06-13T11:35:21.319 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2024-06-13T11:35:21.319 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2024-06-13T11:35:21.319 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2024-06-13T11:35:21.319 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2024-06-13T11:35:21.320 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-13T11:35:21.320 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T11:35:21.320 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-13T11:35:21.320 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-06-13T11:35:21.320 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-13T11:35:21.320 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 295, 2024-06-13T11:35:21.320 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 1559481, 2024-06-13T11:35:21.320 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-13T11:35:21.321 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 295, 2024-06-13T11:35:21.321 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-13T11:35:21.321 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-13T11:35:21.321 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 295, 2024-06-13T11:35:21.321 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 1559481, 2024-06-13T11:35:21.321 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-13T11:35:21.321 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-13T11:35:21.321 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-13T11:35:21.322 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-13T11:35:21.322 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:21.322 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-13T11:35:21.322 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-06-13T11:35:21.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:21 smithi002 ceph-mon[32210]: pgmap v360: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-06-13T11:35:21.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:21 smithi178 ceph-mon[36913]: pgmap v360: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-06-13T11:35:21.983 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-06-13T11:35:21.983 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-06-13T11:35:21.983 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-06-13T11:35:21.983 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-06-13T11:35:21.984 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-06-13T11:35:21.984 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-06-13T11:35:21.984 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-06-13T11:35:21.997 INFO:tasks.kclient:Unmounting kernel clients... 2024-06-13T11:35:21.998 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:35:21.998 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:35:22.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:21 smithi077 ceph-mon[36410]: pgmap v360: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-06-13T11:35:22.063 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T11:35:22.063 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T11:35:22.123 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd blocklist ls 2024-06-13T11:35:22.582 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:35:23.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:23 smithi002 ceph-mon[32210]: pgmap v361: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:35:23.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:23 smithi178 ceph-mon[36913]: pgmap v361: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:35:24.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:23 smithi077 ceph-mon[36410]: pgmap v361: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-06-13T11:35:24.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.806+0000 7fe2fec00700 1 -- 172.21.15.2:0/1273355095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f8105070 msgr2=0x7fe2f8111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:24.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.806+0000 7fe2fec00700 1 --2- 172.21.15.2:0/1273355095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f8105070 0x7fe2f8111580 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000b0a0 tx=0x7fe2f000b3b0 comp rx=0 tx=0).stop 2024-06-13T11:35:24.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.806+0000 7fe2fec00700 1 -- 172.21.15.2:0/1273355095 shutdown_connections 2024-06-13T11:35:24.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.806+0000 7fe2fec00700 1 --2- 172.21.15.2:0/1273355095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f8105070 0x7fe2f8111580 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:24.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.806+0000 7fe2fec00700 1 --2- 172.21.15.2:0/1273355095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f810a6b0 0x7fe2f810aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:24.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.806+0000 7fe2fec00700 1 --2- 172.21.15.2:0/1273355095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2f81046b0 0x7fe2f8104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:24.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.806+0000 7fe2fec00700 1 -- 172.21.15.2:0/1273355095 >> 172.21.15.2:0/1273355095 conn(0x7fe2f81001a0 msgr2=0x7fe2f81025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:24.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.807+0000 7fe2fec00700 1 -- 172.21.15.2:0/1273355095 shutdown_connections 2024-06-13T11:35:24.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.807+0000 7fe2fec00700 1 -- 172.21.15.2:0/1273355095 wait complete. 2024-06-13T11:35:24.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.808+0000 7fe2fec00700 1 Processor -- start 2024-06-13T11:35:24.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.808+0000 7fe2fec00700 1 -- start start 2024-06-13T11:35:24.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.809+0000 7fe2fec00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f81046b0 0x7fe2f819ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:24.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.809+0000 7fe2fec00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2f8105070 0x7fe2f819b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:24.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.809+0000 7fe2fec00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f810a6b0 0x7fe2f819f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:24.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.809+0000 7fe2fec00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f8114a40 con 0x7fe2f81046b0 2024-06-13T11:35:24.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.809+0000 7fe2fec00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f81148c0 con 0x7fe2f8105070 2024-06-13T11:35:24.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.809+0000 7fe2fec00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f8114bc0 con 0x7fe2f810a6b0 2024-06-13T11:35:24.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.809+0000 7fe2f7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f81046b0 0x7fe2f819ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:24.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.809+0000 7fe2f7e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f81046b0 0x7fe2f819ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40674/0 (socket says 172.21.15.2:40674) 2024-06-13T11:35:24.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.809+0000 7fe2f7e00700 1 -- 172.21.15.2:0/3252371720 learned_addr learned my addr 172.21.15.2:0/3252371720 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:35:24.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.809+0000 7fe2f7400700 1 --2- 172.21.15.2:0/3252371720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2f8105070 0x7fe2f819b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:24.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.809+0000 7fe2fcc00700 1 --2- 172.21.15.2:0/3252371720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f810a6b0 0x7fe2f819f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:24.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.810+0000 7fe2f7e00700 1 -- 172.21.15.2:0/3252371720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f810a6b0 msgr2=0x7fe2f819f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:24.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.810+0000 7fe2f7e00700 1 --2- 172.21.15.2:0/3252371720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f810a6b0 0x7fe2f819f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:24.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.810+0000 7fe2f7e00700 1 -- 172.21.15.2:0/3252371720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2f8105070 msgr2=0x7fe2f819b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:24.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.810+0000 7fe2f7e00700 1 --2- 172.21.15.2:0/3252371720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2f8105070 0x7fe2f819b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:24.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.810+0000 7fe2f7e00700 1 -- 172.21.15.2:0/3252371720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f819fda0 con 0x7fe2f81046b0 2024-06-13T11:35:24.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.810+0000 7fe2f7400700 1 --2- 172.21.15.2:0/3252371720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2f8105070 0x7fe2f819b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:35:24.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.810+0000 7fe2f7e00700 1 --2- 172.21.15.2:0/3252371720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f81046b0 0x7fe2f819ad90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800e9c0 tx=0x7fe2e800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:24.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.810+0000 7fe2f4c00700 1 -- 172.21.15.2:0/3252371720 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e800cbd0 con 0x7fe2f81046b0 2024-06-13T11:35:24.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.810+0000 7fe2f4c00700 1 -- 172.21.15.2:0/3252371720 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2e800ee60 con 0x7fe2f81046b0 2024-06-13T11:35:24.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.810+0000 7fe2f4c00700 1 -- 172.21.15.2:0/3252371720 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8005630 con 0x7fe2f81046b0 2024-06-13T11:35:24.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.810+0000 7fe2fec00700 1 -- 172.21.15.2:0/3252371720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f81a0090 con 0x7fe2f81046b0 2024-06-13T11:35:24.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.811+0000 7fe2fec00700 1 -- 172.21.15.2:0/3252371720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f81a7910 con 0x7fe2f81046b0 2024-06-13T11:35:24.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.812+0000 7fe2fec00700 1 -- 172.21.15.2:0/3252371720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f8069180 con 0x7fe2f81046b0 2024-06-13T11:35:24.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.814+0000 7fe2f4c00700 1 -- 172.21.15.2:0/3252371720 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fe2e8004750 con 0x7fe2f81046b0 2024-06-13T11:35:24.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.815+0000 7fe2f4c00700 1 --2- 172.21.15.2:0/3252371720 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe2dc0a2d90 0x7fe2dc0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:24.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.815+0000 7fe2f4c00700 1 -- 172.21.15.2:0/3252371720 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9483+0+0 (secure 0 0 0) 0x7fe2e80cfa60 con 0x7fe2f81046b0 2024-06-13T11:35:24.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.815+0000 7fe2f7400700 1 --2- 172.21.15.2:0/3252371720 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe2dc0a2d90 0x7fe2dc0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:24.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.816+0000 7fe2f7400700 1 --2- 172.21.15.2:0/3252371720 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe2dc0a2d90 0x7fe2dc0a5250 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8109b00 tx=0x7fe2e4009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:24.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:24.822+0000 7fe2f4c00700 1 -- 172.21.15.2:0/3252371720 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe2e809c260 con 0x7fe2f81046b0 2024-06-13T11:35:25.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:25.071+0000 7fe2fec00700 1 -- 172.21.15.2:0/3252371720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe2f819c0f0 con 0x7fe2f81046b0 2024-06-13T11:35:25.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:25.072+0000 7fe2f4c00700 1 -- 172.21.15.2:0/3252371720 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v110) ==== 81+0+924 (secure 0 0 0) 0x7fe2e809bb60 con 0x7fe2f81046b0 2024-06-13T11:35:25.072 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/682201811 2024-06-14T11:23:46.133309+0000 2024-06-13T11:35:25.072 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/3387272091 2024-06-14T11:23:46.133309+0000 2024-06-13T11:35:25.072 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/778891449 2024-06-14T11:23:46.133309+0000 2024-06-13T11:35:25.072 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/88846693 2024-06-14T11:23:46.133309+0000 2024-06-13T11:35:25.073 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/315567313 2024-06-14T11:10:25.084617+0000 2024-06-13T11:35:25.073 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2084201061 2024-06-14T11:10:25.084617+0000 2024-06-13T11:35:25.073 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/3387272091 2024-06-14T11:23:46.133309+0000 2024-06-13T11:35:25.073 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3394644803 2024-06-14T11:09:49.418694+0000 2024-06-13T11:35:25.073 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/1821969949 2024-06-14T11:10:25.084617+0000 2024-06-13T11:35:25.073 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2666864285 2024-06-14T11:09:49.418694+0000 2024-06-13T11:35:25.074 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2170469985 2024-06-14T11:09:49.418694+0000 2024-06-13T11:35:25.074 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1640275700 2024-06-14T11:23:46.133309+0000 2024-06-13T11:35:25.074 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/142516651 2024-06-14T11:10:25.084617+0000 2024-06-13T11:35:25.074 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2666864285 2024-06-14T11:09:49.418694+0000 2024-06-13T11:35:25.074 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3220886565 2024-06-14T11:09:49.418694+0000 2024-06-13T11:35:25.074 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/1821969949 2024-06-14T11:10:25.084617+0000 2024-06-13T11:35:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:25.075+0000 7fe2fec00700 1 -- 172.21.15.2:0/3252371720 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe2dc0a2d90 msgr2=0x7fe2dc0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:25.075+0000 7fe2fec00700 1 --2- 172.21.15.2:0/3252371720 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe2dc0a2d90 0x7fe2dc0a5250 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8109b00 tx=0x7fe2e4009260 comp rx=0 tx=0).stop 2024-06-13T11:35:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:25.075+0000 7fe2fec00700 1 -- 172.21.15.2:0/3252371720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f81046b0 msgr2=0x7fe2f819ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:25.075+0000 7fe2fec00700 1 --2- 172.21.15.2:0/3252371720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f81046b0 0x7fe2f819ad90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800e9c0 tx=0x7fe2e800ecd0 comp rx=0 tx=0).stop 2024-06-13T11:35:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:25.075+0000 7fe2fec00700 1 -- 172.21.15.2:0/3252371720 shutdown_connections 2024-06-13T11:35:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:25.075+0000 7fe2fec00700 1 --2- 172.21.15.2:0/3252371720 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fe2dc0a2d90 0x7fe2dc0a5250 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:25.075+0000 7fe2fec00700 1 --2- 172.21.15.2:0/3252371720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f81046b0 0x7fe2f819ad90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:25.075+0000 7fe2fec00700 1 --2- 172.21.15.2:0/3252371720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f810a6b0 0x7fe2f819f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:25.075+0000 7fe2fec00700 1 --2- 172.21.15.2:0/3252371720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2f8105070 0x7fe2f819b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:25.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:25.075+0000 7fe2fec00700 1 -- 172.21.15.2:0/3252371720 >> 172.21.15.2:0/3252371720 conn(0x7fe2f81001a0 msgr2=0x7fe2f8100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:25.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:25.076+0000 7fe2fec00700 1 -- 172.21.15.2:0/3252371720 shutdown_connections 2024-06-13T11:35:25.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:25.076+0000 7fe2fec00700 1 -- 172.21.15.2:0/3252371720 wait complete. 2024-06-13T11:35:25.077 INFO:teuthology.orchestra.run.smithi002.stderr:listed 16 entries 2024-06-13T11:35:25.763 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:25 smithi002 ceph-mon[32210]: pgmap v362: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:35:25.763 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:25 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3252371720' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T11:35:25.825 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-06-13T11:35:25.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:35:25.825 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-06-13T11:35:25.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:25 smithi178 ceph-mon[36913]: pgmap v362: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:35:25.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:25 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3252371720' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T11:35:25.950 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T11:35:25.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:35:25.950 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-13T11:35:26.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:35:26.026 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-06-13T11:35:26.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:25 smithi077 ceph-mon[36410]: pgmap v362: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:35:26.039 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:25 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3252371720' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T11:35:26.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-13T11:35:26.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:35:26.097 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-13T11:35:26.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T11:35:26.158 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-06-13T11:35:26.263 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-06-13T11:35:26.273 INFO:tasks.cephadm:Teardown begin 2024-06-13T11:35:26.273 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-13T11:35:26.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:35:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:35:27.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:27 smithi002 ceph-mon[32210]: pgmap v363: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:35:27.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:27 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:35:27.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:27 smithi178 ceph-mon[36913]: pgmap v363: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:35:27.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:27 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:35:28.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:27 smithi077 ceph-mon[36410]: pgmap v363: 129 pgs: 129 active+clean; 83 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:35:28.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:27 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T11:35:28.704 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:28 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:35:28.705 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:28 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:35:28.705 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:28 smithi002 ceph-mon[32210]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:35:28.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:28 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:35:28.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:28 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:35:28.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:28 smithi178 ceph-mon[36913]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:35:29.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.001+0000 7f0195600700 1 -- 172.21.15.2:0/474495374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0190105070 msgr2=0x7f0190111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:29.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.001+0000 7f0195600700 1 --2- 172.21.15.2:0/474495374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0190105070 0x7f0190111580 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f018800b0a0 tx=0x7f018800b3b0 comp rx=0 tx=0).stop 2024-06-13T11:35:29.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.001+0000 7f0195600700 1 -- 172.21.15.2:0/474495374 shutdown_connections 2024-06-13T11:35:29.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.001+0000 7f0195600700 1 --2- 172.21.15.2:0/474495374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f019010a6b0 0x7f019010aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:29.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.001+0000 7f0195600700 1 --2- 172.21.15.2:0/474495374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0190105070 0x7f0190111580 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:29.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.001+0000 7f0195600700 1 --2- 172.21.15.2:0/474495374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01901046b0 0x7f0190104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:29.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.001+0000 7f0195600700 1 -- 172.21.15.2:0/474495374 >> 172.21.15.2:0/474495374 conn(0x7f01901001a0 msgr2=0x7f01901025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:29.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.001+0000 7f0195600700 1 -- 172.21.15.2:0/474495374 shutdown_connections 2024-06-13T11:35:29.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.002+0000 7f0195600700 1 -- 172.21.15.2:0/474495374 wait complete. 2024-06-13T11:35:29.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.003+0000 7f0195600700 1 Processor -- start 2024-06-13T11:35:29.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.003+0000 7f0195600700 1 -- start start 2024-06-13T11:35:29.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.004+0000 7f0195600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01901046b0 0x7f019019ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:29.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.004+0000 7f0195600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0190105070 0x7f019019b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.004+0000 7f0195600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f019010a6b0 0x7f019019f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.004+0000 7f0195600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0190114a40 con 0x7f0190105070 2024-06-13T11:35:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.004+0000 7f0195600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01901148c0 con 0x7f01901046b0 2024-06-13T11:35:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.004+0000 7f0195600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0190114bc0 con 0x7f019010a6b0 2024-06-13T11:35:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.004+0000 7f018ea00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01901046b0 0x7f019019ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.004+0000 7f018ea00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01901046b0 0x7f019019ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:58128/0 (socket says 172.21.15.2:58128) 2024-06-13T11:35:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.004+0000 7f018ea00700 1 -- 172.21.15.2:0/324001374 learned_addr learned my addr 172.21.15.2:0/324001374 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:35:29.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.004+0000 7f018e000700 1 --2- 172.21.15.2:0/324001374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0190105070 0x7f019019b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.004+0000 7f018f400700 1 --2- 172.21.15.2:0/324001374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f019010a6b0 0x7f019019f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.005+0000 7f018ea00700 1 -- 172.21.15.2:0/324001374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f019010a6b0 msgr2=0x7f019019f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.005+0000 7f018ea00700 1 --2- 172.21.15.2:0/324001374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f019010a6b0 0x7f019019f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.005+0000 7f018ea00700 1 -- 172.21.15.2:0/324001374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0190105070 msgr2=0x7f019019b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.005+0000 7f018ea00700 1 --2- 172.21.15.2:0/324001374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0190105070 0x7f019019b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:29.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.005+0000 7f018ea00700 1 -- 172.21.15.2:0/324001374 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019019fdf0 con 0x7f01901046b0 2024-06-13T11:35:29.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.005+0000 7f018ea00700 1 --2- 172.21.15.2:0/324001374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01901046b0 0x7f019019ae30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f018000e9a0 tx=0x7f018000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:29.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.005+0000 7f0187400700 1 -- 172.21.15.2:0/324001374 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018000ca10 con 0x7f01901046b0 2024-06-13T11:35:29.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.005+0000 7f0195600700 1 -- 172.21.15.2:0/324001374 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01901a00e0 con 0x7f01901046b0 2024-06-13T11:35:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.005+0000 7f0187400700 1 -- 172.21.15.2:0/324001374 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f018000cbb0 con 0x7f01901046b0 2024-06-13T11:35:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.005+0000 7f0187400700 1 -- 172.21.15.2:0/324001374 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180018680 con 0x7f01901046b0 2024-06-13T11:35:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.006+0000 7f0195600700 1 -- 172.21.15.2:0/324001374 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01901a7960 con 0x7f01901046b0 2024-06-13T11:35:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.007+0000 7f0195600700 1 -- 172.21.15.2:0/324001374 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0190069180 con 0x7f01901046b0 2024-06-13T11:35:29.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.009+0000 7f0187400700 1 -- 172.21.15.2:0/324001374 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f0180010430 con 0x7f01901046b0 2024-06-13T11:35:29.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.010+0000 7f0187400700 1 --2- 172.21.15.2:0/324001374 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f01740a2d90 0x7f01740a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:29.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.010+0000 7f0187400700 1 -- 172.21.15.2:0/324001374 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9483+0+0 (secure 0 0 0) 0x7f01800cfcd0 con 0x7f01901046b0 2024-06-13T11:35:29.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.011+0000 7f018e000700 1 --2- 172.21.15.2:0/324001374 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f01740a2d90 0x7f01740a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:29.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.011+0000 7f018e000700 1 --2- 172.21.15.2:0/324001374 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f01740a2d90 0x7f01740a5250 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0190109c00 tx=0x7f017c009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:29.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.013+0000 7f0187400700 1 -- 172.21.15.2:0/324001374 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f018009c4d0 con 0x7f01901046b0 2024-06-13T11:35:29.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:28 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T11:35:29.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:28 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T11:35:29.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:28 smithi077 ceph-mon[36410]: from='mgr.25150 ' entity='mgr.x' 2024-06-13T11:35:29.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.300+0000 7f0195600700 1 -- 172.21.15.2:0/324001374 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f019002dca0 con 0x7f01901046b0 2024-06-13T11:35:29.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.302+0000 7f0187400700 1 -- 172.21.15.2:0/324001374 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11853 (secure 0 0 0) 0x7f018009bdd0 con 0x7f01901046b0 2024-06-13T11:35:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:35:29.302 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:29:21.309310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24511,24493,24509]},"id":1}]} 2024-06-13T11:35:29.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.304+0000 7f0195600700 1 -- 172.21.15.2:0/324001374 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f01740a2d90 msgr2=0x7f01740a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:29.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.304+0000 7f0195600700 1 --2- 172.21.15.2:0/324001374 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f01740a2d90 0x7f01740a5250 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0190109c00 tx=0x7f017c009260 comp rx=0 tx=0).stop 2024-06-13T11:35:29.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.304+0000 7f0195600700 1 -- 172.21.15.2:0/324001374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01901046b0 msgr2=0x7f019019ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:29.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.305+0000 7f0195600700 1 --2- 172.21.15.2:0/324001374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01901046b0 0x7f019019ae30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f018000e9a0 tx=0x7f018000ecb0 comp rx=0 tx=0).stop 2024-06-13T11:35:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.305+0000 7f0195600700 1 -- 172.21.15.2:0/324001374 shutdown_connections 2024-06-13T11:35:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.305+0000 7f0195600700 1 --2- 172.21.15.2:0/324001374 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f01740a2d90 0x7f01740a5250 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.305+0000 7f0195600700 1 --2- 172.21.15.2:0/324001374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f019010a6b0 0x7f019019f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.305+0000 7f0195600700 1 --2- 172.21.15.2:0/324001374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01901046b0 0x7f019019ae30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:29.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.305+0000 7f0195600700 1 --2- 172.21.15.2:0/324001374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0190105070 0x7f019019b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.305+0000 7f0195600700 1 -- 172.21.15.2:0/324001374 >> 172.21.15.2:0/324001374 conn(0x7f01901001a0 msgr2=0x7f01901006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.305+0000 7f0195600700 1 -- 172.21.15.2:0/324001374 shutdown_connections 2024-06-13T11:35:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:29.305+0000 7f0195600700 1 -- 172.21.15.2:0/324001374 wait complete. 2024-06-13T11:35:29.306 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 31 2024-06-13T11:35:29.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:29 smithi002 ceph-mon[32210]: pgmap v364: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-06-13T11:35:29.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:29 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/324001374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:35:29.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:29 smithi178 ceph-mon[36913]: pgmap v364: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-06-13T11:35:29.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:29 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/324001374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:35:30.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:29 smithi077 ceph-mon[36410]: pgmap v364: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-06-13T11:35:30.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:29 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/324001374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:35:30.230 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T11:35:30.720 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:35:31.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:31 smithi002 ceph-mon[32210]: pgmap v365: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-06-13T11:35:31.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:31 smithi178 ceph-mon[36913]: pgmap v365: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-06-13T11:35:32.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:31 smithi077 ceph-mon[36410]: pgmap v365: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-06-13T11:35:33.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.149+0000 7f7bdbe00700 1 -- 172.21.15.2:0/3286618152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc107700 msgr2=0x7f7bdc10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:33.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.149+0000 7f7bdbe00700 1 --2- 172.21.15.2:0/3286618152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc107700 0x7f7bdc10f2d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400b0d0 tx=0x7f7bd400b3e0 comp rx=0 tx=0).stop 2024-06-13T11:35:33.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.149+0000 7f7bdbe00700 1 -- 172.21.15.2:0/3286618152 shutdown_connections 2024-06-13T11:35:33.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.149+0000 7f7bdbe00700 1 --2- 172.21.15.2:0/3286618152 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc107700 0x7f7bdc10f2d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:33.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.149+0000 7f7bdbe00700 1 --2- 172.21.15.2:0/3286618152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bdc102620 0x7f7bdc102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:33.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.149+0000 7f7bdbe00700 1 --2- 172.21.15.2:0/3286618152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bdc102fd0 0x7f7bdc107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:33.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.149+0000 7f7bdbe00700 1 -- 172.21.15.2:0/3286618152 >> 172.21.15.2:0/3286618152 conn(0x7f7bdc0fdf10 msgr2=0x7f7bdc100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:33.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.149+0000 7f7bdbe00700 1 -- 172.21.15.2:0/3286618152 shutdown_connections 2024-06-13T11:35:33.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.149+0000 7f7bdbe00700 1 -- 172.21.15.2:0/3286618152 wait complete. 2024-06-13T11:35:33.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.151+0000 7f7bdbe00700 1 Processor -- start 2024-06-13T11:35:33.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.151+0000 7f7bdbe00700 1 -- start start 2024-06-13T11:35:33.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.151+0000 7f7bdbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bdc102620 0x7f7bdc074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:33.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.151+0000 7f7bdbe00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bdc102fd0 0x7f7bdc074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.151+0000 7f7bdbe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc107700 0x7f7bdc075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.151+0000 7f7bdbe00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc112760 con 0x7f7bdc107700 2024-06-13T11:35:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.151+0000 7f7bdbe00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc1125e0 con 0x7f7bdc102fd0 2024-06-13T11:35:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.151+0000 7f7bdbe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc1128e0 con 0x7f7bdc102620 2024-06-13T11:35:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.152+0000 7f7bdb400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc107700 0x7f7bdc075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.152+0000 7f7bdaa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bdc102620 0x7f7bdc074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.152+0000 7f7bdaa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bdc102620 0x7f7bdc074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:34154/0 (socket says 172.21.15.2:34154) 2024-06-13T11:35:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.152+0000 7f7bdaa00700 1 -- 172.21.15.2:0/2445253553 learned_addr learned my addr 172.21.15.2:0/2445253553 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:35:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.152+0000 7f7bda000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bdc102fd0 0x7f7bdc074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.152+0000 7f7bdb400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc107700 0x7f7bdc075210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46076/0 (socket says 172.21.15.2:46076) 2024-06-13T11:35:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.152+0000 7f7bdaa00700 1 -- 172.21.15.2:0/2445253553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bdc102fd0 msgr2=0x7f7bdc074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.152+0000 7f7bdaa00700 1 --2- 172.21.15.2:0/2445253553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bdc102fd0 0x7f7bdc074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.152+0000 7f7bdaa00700 1 -- 172.21.15.2:0/2445253553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc107700 msgr2=0x7f7bdc075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.152+0000 7f7bdaa00700 1 --2- 172.21.15.2:0/2445253553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc107700 0x7f7bdc075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:33.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.152+0000 7f7bdaa00700 1 -- 172.21.15.2:0/2445253553 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc1a7080 con 0x7f7bdc102620 2024-06-13T11:35:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.152+0000 7f7bdb400700 1 --2- 172.21.15.2:0/2445253553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc107700 0x7f7bdc075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:35:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.152+0000 7f7bdaa00700 1 --2- 172.21.15.2:0/2445253553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bdc102620 0x7f7bdc074790 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00d980 tx=0x7f7bcc00dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.153+0000 7f7bd3400700 1 -- 172.21.15.2:0/2445253553 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc016070 con 0x7f7bdc102620 2024-06-13T11:35:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.153+0000 7f7bdbe00700 1 -- 172.21.15.2:0/2445253553 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bdc1a7370 con 0x7f7bdc102620 2024-06-13T11:35:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.153+0000 7f7bd3400700 1 -- 172.21.15.2:0/2445253553 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bcc004d10 con 0x7f7bdc102620 2024-06-13T11:35:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.153+0000 7f7bd3400700 1 -- 172.21.15.2:0/2445253553 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc005670 con 0x7f7bdc102620 2024-06-13T11:35:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.153+0000 7f7bdbe00700 1 -- 172.21.15.2:0/2445253553 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bdc1a7900 con 0x7f7bdc102620 2024-06-13T11:35:33.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.154+0000 7f7bdbe00700 1 -- 172.21.15.2:0/2445253553 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bdc069180 con 0x7f7bdc102620 2024-06-13T11:35:33.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.156+0000 7f7bd3400700 1 -- 172.21.15.2:0/2445253553 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f7bcc004750 con 0x7f7bdc102620 2024-06-13T11:35:33.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.157+0000 7f7bd3400700 1 --2- 172.21.15.2:0/2445253553 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7bc00a2e10 0x7f7bc00a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:33.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.158+0000 7f7bd3400700 1 -- 172.21.15.2:0/2445253553 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9483+0+0 (secure 0 0 0) 0x7f7bcc0cfb00 con 0x7f7bdc102620 2024-06-13T11:35:33.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.158+0000 7f7bda000700 1 --2- 172.21.15.2:0/2445253553 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7bc00a2e10 0x7f7bc00a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:33.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.159+0000 7f7bda000700 1 --2- 172.21.15.2:0/2445253553 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7bc00a2e10 0x7f7bc00a52d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc108be0 tx=0x7f7bc8009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.160+0000 7f7bd3400700 1 -- 172.21.15.2:0/2445253553 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7bcc01f020 con 0x7f7bdc102620 2024-06-13T11:35:33.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.436+0000 7f7bdbe00700 1 -- 172.21.15.2:0/2445253553 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bdc1a7b60 con 0x7f7bdc102620 2024-06-13T11:35:33.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.438+0000 7f7bd3400700 1 -- 172.21.15.2:0/2445253553 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11853 (secure 0 0 0) 0x7f7bcc09c300 con 0x7f7bdc102620 2024-06-13T11:35:33.438 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:35:33.438 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3486542441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3486542441},{"type":"v1","addr":"172.21.15.2:6835","nonce":3486542441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/4035170856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":4035170856},{"type":"v1","addr":"172.21.15.2:6839","nonce":4035170856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3780644818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3780644818},{"type":"v1","addr":"172.21.15.2:6841","nonce":3780644818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6833/1004888584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1004888584},{"type":"v1","addr":"172.21.15.77:6833","nonce":1004888584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24443,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/377791267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":377791267},{"type":"v1","addr":"172.21.15.2:6837","nonce":377791267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1723286863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1723286863},{"type":"v1","addr":"172.21.15.178:6833","nonce":1723286863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T11:18:45.943965+0000","modified":"2024-06-13T11:29:21.309310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24511,"mds_1":24509,"mds_2":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6835/4100836585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4100836585},{"type":"v1","addr":"172.21.15.77:6835","nonce":4100836585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/1628379389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1628379389},{"type":"v1","addr":"172.21.15.77:6837","nonce":1628379389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/2515486418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2515486418},{"type":"v1","addr":"172.21.15.178:6835","nonce":2515486418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6837/2179127321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2179127321},{"type":"v1","addr":"172.21.15.178:6837","nonce":2179127321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":27,"addr":"172.21.15.77:6839/45629124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":45629124},{"type":"v1","addr":"172.21.15.77:6839","nonce":45629124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24511":{"gid":24511,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.178:6839/970862278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":970862278},{"type":"v1","addr":"172.21.15.178:6839","nonce":970862278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24511,"qdb_cluster":[24511,24493,24509]},"id":1}]} 2024-06-13T11:35:33.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.441+0000 7f7bdbe00700 1 -- 172.21.15.2:0/2445253553 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7bc00a2e10 msgr2=0x7f7bc00a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:33.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.441+0000 7f7bdbe00700 1 --2- 172.21.15.2:0/2445253553 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7bc00a2e10 0x7f7bc00a52d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc108be0 tx=0x7f7bc8009260 comp rx=0 tx=0).stop 2024-06-13T11:35:33.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.441+0000 7f7bdbe00700 1 -- 172.21.15.2:0/2445253553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bdc102620 msgr2=0x7f7bdc074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:33.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.441+0000 7f7bdbe00700 1 --2- 172.21.15.2:0/2445253553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bdc102620 0x7f7bdc074790 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00d980 tx=0x7f7bcc00dc90 comp rx=0 tx=0).stop 2024-06-13T11:35:33.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.441+0000 7f7bdbe00700 1 -- 172.21.15.2:0/2445253553 shutdown_connections 2024-06-13T11:35:33.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.441+0000 7f7bdbe00700 1 --2- 172.21.15.2:0/2445253553 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7bc00a2e10 0x7f7bc00a52d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:33.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.441+0000 7f7bdbe00700 1 --2- 172.21.15.2:0/2445253553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bdc107700 0x7f7bdc075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:33.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.441+0000 7f7bdbe00700 1 --2- 172.21.15.2:0/2445253553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bdc102620 0x7f7bdc074790 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:33.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.441+0000 7f7bdbe00700 1 --2- 172.21.15.2:0/2445253553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bdc102fd0 0x7f7bdc074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:33.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.441+0000 7f7bdbe00700 1 -- 172.21.15.2:0/2445253553 >> 172.21.15.2:0/2445253553 conn(0x7f7bdc0fdf10 msgr2=0x7f7bdc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:33.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.441+0000 7f7bdbe00700 1 -- 172.21.15.2:0/2445253553 shutdown_connections 2024-06-13T11:35:33.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:33.441+0000 7f7bdbe00700 1 -- 172.21.15.2:0/2445253553 wait complete. 2024-06-13T11:35:33.443 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 31 2024-06-13T11:35:33.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:33 smithi002 ceph-mon[32210]: pgmap v366: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-06-13T11:35:33.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:33 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2445253553' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:35:33.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:33 smithi178 ceph-mon[36913]: pgmap v366: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-06-13T11:35:33.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:33 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2445253553' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:35:34.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:33 smithi077 ceph-mon[36410]: pgmap v366: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-06-13T11:35:34.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:33 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2445253553' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T11:35:34.507 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T11:35:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:35:35.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:35 smithi002 ceph-mon[32210]: pgmap v367: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-06-13T11:35:35.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:35 smithi178 ceph-mon[36913]: pgmap v367: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-06-13T11:35:36.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:35 smithi077 ceph-mon[36410]: pgmap v367: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-06-13T11:35:37.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.476+0000 7f633f000700 1 -- 172.21.15.2:0/1732324159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f633806a170 msgr2=0x7f633806a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:37.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.476+0000 7f633f000700 1 --2- 172.21.15.2:0/1732324159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f633806a170 0x7f633806a5f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6320009990 tx=0x7f6320009ca0 comp rx=0 tx=0).stop 2024-06-13T11:35:37.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.476+0000 7f633f000700 1 -- 172.21.15.2:0/1732324159 shutdown_connections 2024-06-13T11:35:37.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.476+0000 7f633f000700 1 --2- 172.21.15.2:0/1732324159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f633806ab30 0x7f633810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:37.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.476+0000 7f633f000700 1 --2- 172.21.15.2:0/1732324159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6338108500 0x7f63381088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:37.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.476+0000 7f633f000700 1 --2- 172.21.15.2:0/1732324159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f633806a170 0x7f633806a5f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:37.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.476+0000 7f633f000700 1 -- 172.21.15.2:0/1732324159 >> 172.21.15.2:0/1732324159 conn(0x7f6338078340 msgr2=0x7f6338078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:37.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.476+0000 7f633f000700 1 -- 172.21.15.2:0/1732324159 shutdown_connections 2024-06-13T11:35:37.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.476+0000 7f633f000700 1 -- 172.21.15.2:0/1732324159 wait complete. 2024-06-13T11:35:37.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.477+0000 7f633f000700 1 Processor -- start 2024-06-13T11:35:37.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.478+0000 7f633f000700 1 -- start start 2024-06-13T11:35:37.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.478+0000 7f633f000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f633806a170 0x7f633819ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:37.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.478+0000 7f633f000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f633806ab30 0x7f633819b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:37.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.478+0000 7f633f000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6338108500 0x7f633819f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:37.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.478+0000 7f633f000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f63381127d0 con 0x7f6338108500 2024-06-13T11:35:37.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.478+0000 7f633f000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6338112650 con 0x7f633806a170 2024-06-13T11:35:37.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.478+0000 7f633f000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6338112950 con 0x7f633806ab30 2024-06-13T11:35:37.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.479+0000 7f632fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f633806ab30 0x7f633819b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:37.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.479+0000 7f632fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f633806ab30 0x7f633819b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:34120/0 (socket says 172.21.15.2:34120) 2024-06-13T11:35:37.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.479+0000 7f632fe00700 1 -- 172.21.15.2:0/2012127218 learned_addr learned my addr 172.21.15.2:0/2012127218 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:35:37.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.479+0000 7f633d000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6338108500 0x7f633819f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:37.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.479+0000 7f6337e00700 1 --2- 172.21.15.2:0/2012127218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f633806a170 0x7f633819ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:37.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.479+0000 7f632fe00700 1 -- 172.21.15.2:0/2012127218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f633806a170 msgr2=0x7f633819ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:37.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.479+0000 7f632fe00700 1 --2- 172.21.15.2:0/2012127218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f633806a170 0x7f633819ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:37.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.479+0000 7f632fe00700 1 -- 172.21.15.2:0/2012127218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6338108500 msgr2=0x7f633819f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:37.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.479+0000 7f632fe00700 1 --2- 172.21.15.2:0/2012127218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6338108500 0x7f633819f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:37.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.479+0000 7f632fe00700 1 -- 172.21.15.2:0/2012127218 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633819fe70 con 0x7f633806ab30 2024-06-13T11:35:37.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.479+0000 7f632fe00700 1 --2- 172.21.15.2:0/2012127218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f633806ab30 0x7f633819b3a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6320000c00 tx=0x7f632000ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:37.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.480+0000 7f6335600700 1 -- 172.21.15.2:0/2012127218 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6320027070 con 0x7f633806ab30 2024-06-13T11:35:37.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.480+0000 7f6335600700 1 -- 172.21.15.2:0/2012127218 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6320003d70 con 0x7f633806ab30 2024-06-13T11:35:37.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.480+0000 7f633f000700 1 -- 172.21.15.2:0/2012127218 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63381a0100 con 0x7f633806ab30 2024-06-13T11:35:37.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.480+0000 7f6335600700 1 -- 172.21.15.2:0/2012127218 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632000f460 con 0x7f633806ab30 2024-06-13T11:35:37.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.480+0000 7f633f000700 1 -- 172.21.15.2:0/2012127218 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63381a79e0 con 0x7f633806ab30 2024-06-13T11:35:37.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.481+0000 7f633f000700 1 -- 172.21.15.2:0/2012127218 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6338069180 con 0x7f633806ab30 2024-06-13T11:35:37.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.483+0000 7f6335600700 1 -- 172.21.15.2:0/2012127218 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f632002a070 con 0x7f633806ab30 2024-06-13T11:35:37.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.485+0000 7f6335600700 1 --2- 172.21.15.2:0/2012127218 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f631c0a2e10 0x7f631c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:37.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.485+0000 7f6335600700 1 -- 172.21.15.2:0/2012127218 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9483+0+0 (secure 0 0 0) 0x7f63200d0f50 con 0x7f633806ab30 2024-06-13T11:35:37.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.485+0000 7f6337e00700 1 --2- 172.21.15.2:0/2012127218 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f631c0a2e10 0x7f631c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:37.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.486+0000 7f6337e00700 1 --2- 172.21.15.2:0/2012127218 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f631c0a2e10 0x7f631c0a52d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f632800f540 tx=0x7f632800b040 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:37.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.487+0000 7f6335600700 1 -- 172.21.15.2:0/2012127218 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6320031020 con 0x7f633806ab30 2024-06-13T11:35:37.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.719+0000 7f633f000700 1 -- 172.21.15.2:0/2012127218 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63381a7bb0 con 0x7f633806ab30 2024-06-13T11:35:37.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.721+0000 7f6335600700 1 -- 172.21.15.2:0/2012127218 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) ==== 74+0+25166 (secure 0 0 0) 0x7f6320013070 con 0x7f633806ab30 2024-06-13T11:35:37.721 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T11:35:37.721 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":110,"fsid":"3611563c-2975-11ef-bc9c-c7b262605968","created":"2024-06-13T11:09:07.839101+0000","modified":"2024-06-13T11:35:09.287240+0000","last_up_change":"2024-06-13T11:17:28.731479+0000","last_in_change":"2024-06-13T11:17:08.849067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T11:13:13.793461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T11:18:36.784824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T11:18:41.824835+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":109,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T11:18:55.545870+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":109,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f5614d91-49a7-4983-a309-0de3b3e6263c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6803","nonce":4127571834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6805","nonce":4127571834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6809","nonce":4127571834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4127571834},{"type":"v1","addr":"172.21.15.2:6807","nonce":4127571834}]},"public_addr":"172.21.15.2:6803/4127571834","cluster_addr":"172.21.15.2:6805/4127571834","heartbeat_back_addr":"172.21.15.2:6809/4127571834","heartbeat_front_addr":"172.21.15.2:6807/4127571834","state":["exists","up"]},{"osd":1,"uuid":"d9dbe278-309f-4726-828a-da922f486b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6801","nonce":3180360713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6803","nonce":3180360713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6807","nonce":3180360713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3180360713},{"type":"v1","addr":"172.21.15.77:6805","nonce":3180360713}]},"public_addr":"172.21.15.77:6801/3180360713","cluster_addr":"172.21.15.77:6803/3180360713","heartbeat_back_addr":"172.21.15.77:6807/3180360713","heartbeat_front_addr":"172.21.15.77:6805/3180360713","state":["exists","up"]},{"osd":2,"uuid":"04c267dc-7454-418f-9965-3ff96ef280ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6801","nonce":3825510575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6803","nonce":3825510575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6807","nonce":3825510575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":3825510575},{"type":"v1","addr":"172.21.15.178:6805","nonce":3825510575}]},"public_addr":"172.21.15.178:6801/3825510575","cluster_addr":"172.21.15.178:6803/3825510575","heartbeat_back_addr":"172.21.15.178:6807/3825510575","heartbeat_front_addr":"172.21.15.178:6805/3825510575","state":["exists","up"]},{"osd":3,"uuid":"3847bd4f-ca04-41de-9d88-e1523dd7ff8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6811","nonce":1982693353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6813","nonce":1982693353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6817","nonce":1982693353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1982693353},{"type":"v1","addr":"172.21.15.2:6815","nonce":1982693353}]},"public_addr":"172.21.15.2:6811/1982693353","cluster_addr":"172.21.15.2:6813/1982693353","heartbeat_back_addr":"172.21.15.2:6817/1982693353","heartbeat_front_addr":"172.21.15.2:6815/1982693353","state":["exists","up"]},{"osd":4,"uuid":"34d7d2e8-3dee-42b9-a6cb-d4162b122b48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6809","nonce":3916694904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6811","nonce":3916694904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6815","nonce":3916694904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3916694904},{"type":"v1","addr":"172.21.15.77:6813","nonce":3916694904}]},"public_addr":"172.21.15.77:6809/3916694904","cluster_addr":"172.21.15.77:6811/3916694904","heartbeat_back_addr":"172.21.15.77:6815/3916694904","heartbeat_front_addr":"172.21.15.77:6813/3916694904","state":["exists","up"]},{"osd":5,"uuid":"0468aefc-c3c8-4758-9bbf-1225b7a5ae79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6809","nonce":3572805887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6811","nonce":3572805887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6815","nonce":3572805887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":3572805887},{"type":"v1","addr":"172.21.15.178:6813","nonce":3572805887}]},"public_addr":"172.21.15.178:6809/3572805887","cluster_addr":"172.21.15.178:6811/3572805887","heartbeat_back_addr":"172.21.15.178:6815/3572805887","heartbeat_front_addr":"172.21.15.178:6813/3572805887","state":["exists","up"]},{"osd":6,"uuid":"0a186a4a-0e28-47bd-b5ad-9bf8079f74c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6819","nonce":1592309584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6821","nonce":1592309584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6825","nonce":1592309584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1592309584},{"type":"v1","addr":"172.21.15.2:6823","nonce":1592309584}]},"public_addr":"172.21.15.2:6819/1592309584","cluster_addr":"172.21.15.2:6821/1592309584","heartbeat_back_addr":"172.21.15.2:6825/1592309584","heartbeat_front_addr":"172.21.15.2:6823/1592309584","state":["exists","up"]},{"osd":7,"uuid":"646e66f7-1ef8-428d-a842-bf28c8606df2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6817","nonce":1580055775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6819","nonce":1580055775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6823","nonce":1580055775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1580055775},{"type":"v1","addr":"172.21.15.77:6821","nonce":1580055775}]},"public_addr":"172.21.15.77:6817/1580055775","cluster_addr":"172.21.15.77:6819/1580055775","heartbeat_back_addr":"172.21.15.77:6823/1580055775","heartbeat_front_addr":"172.21.15.77:6821/1580055775","state":["exists","up"]},{"osd":8,"uuid":"bcc971fc-47d7-4289-8a9a-c76996c57370","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6817","nonce":4285192591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6819","nonce":4285192591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6823","nonce":4285192591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":4285192591},{"type":"v1","addr":"172.21.15.178:6821","nonce":4285192591}]},"public_addr":"172.21.15.178:6817/4285192591","cluster_addr":"172.21.15.178:6819/4285192591","heartbeat_back_addr":"172.21.15.178:6823/4285192591","heartbeat_front_addr":"172.21.15.178:6821/4285192591","state":["exists","up"]},{"osd":9,"uuid":"899d7d4f-a24c-4508-b42c-0b363275c459","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6827","nonce":4187017478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6829","nonce":4187017478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6833","nonce":4187017478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":4187017478},{"type":"v1","addr":"172.21.15.2:6831","nonce":4187017478}]},"public_addr":"172.21.15.2:6827/4187017478","cluster_addr":"172.21.15.2:6829/4187017478","heartbeat_back_addr":"172.21.15.2:6833/4187017478","heartbeat_front_addr":"172.21.15.2:6831/4187017478","state":["exists","up"]},{"osd":10,"uuid":"112d2b8e-9673-4d7a-97e9-2089793fdd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6825","nonce":2039538463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6827","nonce":2039538463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6831","nonce":2039538463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2039538463},{"type":"v1","addr":"172.21.15.77:6829","nonce":2039538463}]},"public_addr":"172.21.15.77:6825/2039538463","cluster_addr":"172.21.15.77:6827/2039538463","heartbeat_back_addr":"172.21.15.77:6831/2039538463","heartbeat_front_addr":"172.21.15.77:6829/2039538463","state":["exists","up"]},{"osd":11,"uuid":"6b8001f5-9c74-4cc7-8c41-906cb5ac9b07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6825","nonce":1915058767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6827","nonce":1915058767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6831","nonce":1915058767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1915058767},{"type":"v1","addr":"172.21.15.178:6829","nonce":1915058767}]},"public_addr":"172.21.15.178:6825/1915058767","cluster_addr":"172.21.15.178:6827/1915058767","heartbeat_back_addr":"172.21.15.178:6831/1915058767","heartbeat_front_addr":"172.21.15.178:6829/1915058767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:21.707572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:12:46.440115+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:10.197217+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:13:42.853367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:08.880473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:14:33.605677+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:07.655377+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:33.980900+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:15:59.397529+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:16:33.983411+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:00.932649+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T11:17:26.894098+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9},{"from":5,"to":7}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.18","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/682201811":"2024-06-14T11:23:46.133309+0000","172.21.15.2:6801/3387272091":"2024-06-14T11:23:46.133309+0000","172.21.15.2:0/778891449":"2024-06-14T11:23:46.133309+0000","172.21.15.2:0/88846693":"2024-06-14T11:23:46.133309+0000","172.21.15.2:0/315567313":"2024-06-14T11:10:25.084617+0000","172.21.15.2:0/2084201061":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/3387272091":"2024-06-14T11:23:46.133309+0000","172.21.15.2:0/3394644803":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6801/1821969949":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6800/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/2170469985":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/1640275700":"2024-06-14T11:23:46.133309+0000","172.21.15.2:0/142516651":"2024-06-14T11:10:25.084617+0000","172.21.15.2:6801/2666864285":"2024-06-14T11:09:49.418694+0000","172.21.15.2:0/3220886565":"2024-06-14T11:09:49.418694+0000","172.21.15.2:6800/1821969949":"2024-06-14T11:10:25.084617+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T11:35:37.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.725+0000 7f633f000700 1 -- 172.21.15.2:0/2012127218 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f631c0a2e10 msgr2=0x7f631c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:37.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.725+0000 7f633f000700 1 --2- 172.21.15.2:0/2012127218 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f631c0a2e10 0x7f631c0a52d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f632800f540 tx=0x7f632800b040 comp rx=0 tx=0).stop 2024-06-13T11:35:37.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.725+0000 7f633f000700 1 -- 172.21.15.2:0/2012127218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f633806ab30 msgr2=0x7f633819b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:37.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.725+0000 7f633f000700 1 --2- 172.21.15.2:0/2012127218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f633806ab30 0x7f633819b3a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6320000c00 tx=0x7f632000ba90 comp rx=0 tx=0).stop 2024-06-13T11:35:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.725+0000 7f633f000700 1 -- 172.21.15.2:0/2012127218 shutdown_connections 2024-06-13T11:35:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.725+0000 7f633f000700 1 --2- 172.21.15.2:0/2012127218 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f631c0a2e10 0x7f631c0a52d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.725+0000 7f633f000700 1 --2- 172.21.15.2:0/2012127218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6338108500 0x7f633819f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.725+0000 7f633f000700 1 --2- 172.21.15.2:0/2012127218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f633806a170 0x7f633819ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:37.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.725+0000 7f633f000700 1 --2- 172.21.15.2:0/2012127218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f633806ab30 0x7f633819b3a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:37.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.725+0000 7f633f000700 1 -- 172.21.15.2:0/2012127218 >> 172.21.15.2:0/2012127218 conn(0x7f6338078340 msgr2=0x7f633810d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:37.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.725+0000 7f633f000700 1 -- 172.21.15.2:0/2012127218 shutdown_connections 2024-06-13T11:35:37.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:37.725+0000 7f633f000700 1 -- 172.21.15.2:0/2012127218 wait complete. 2024-06-13T11:35:37.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:37 smithi002 ceph-mon[32210]: pgmap v368: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-06-13T11:35:37.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:37 smithi178 ceph-mon[36913]: pgmap v368: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-06-13T11:35:38.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:37 smithi077 ceph-mon[36410]: pgmap v368: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-06-13T11:35:38.633 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs fail cephfs 2024-06-13T11:35:38.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:38 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/2012127218' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:35:38.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:38 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/2012127218' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:35:39.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:38 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/2012127218' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T11:35:39.114 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:35:39.783 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:39 smithi002 ceph-mon[32210]: pgmap v369: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-06-13T11:35:39.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:39 smithi178 ceph-mon[36913]: pgmap v369: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-06-13T11:35:40.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:39 smithi077 ceph-mon[36410]: pgmap v369: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-06-13T11:35:41.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.512+0000 7f7f61000700 1 -- 172.21.15.2:0/394506365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c06a170 msgr2=0x7f7f5c06a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:41.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.512+0000 7f7f61000700 1 --2- 172.21.15.2:0/394506365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c06a170 0x7f7f5c06a5f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7f480098f0 tx=0x7f7f48009c00 comp rx=0 tx=0).stop 2024-06-13T11:35:41.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.512+0000 7f7f61000700 1 -- 172.21.15.2:0/394506365 shutdown_connections 2024-06-13T11:35:41.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.512+0000 7f7f61000700 1 --2- 172.21.15.2:0/394506365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f5c06ab30 0x7f7f5c10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:41.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.512+0000 7f7f61000700 1 --2- 172.21.15.2:0/394506365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f5c108500 0x7f7f5c1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:41.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.512+0000 7f7f61000700 1 --2- 172.21.15.2:0/394506365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c06a170 0x7f7f5c06a5f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:41.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.512+0000 7f7f61000700 1 -- 172.21.15.2:0/394506365 >> 172.21.15.2:0/394506365 conn(0x7f7f5c078340 msgr2=0x7f7f5c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:41.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.513+0000 7f7f61000700 1 -- 172.21.15.2:0/394506365 shutdown_connections 2024-06-13T11:35:41.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.513+0000 7f7f61000700 1 -- 172.21.15.2:0/394506365 wait complete. 2024-06-13T11:35:41.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.514+0000 7f7f61000700 1 Processor -- start 2024-06-13T11:35:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.514+0000 7f7f61000700 1 -- start start 2024-06-13T11:35:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.514+0000 7f7f61000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c06a170 0x7f7f5c19af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.514+0000 7f7f61000700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f5c06ab30 0x7f7f5c19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.514+0000 7f7f61000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f5c108500 0x7f7f5c19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.514+0000 7f7f61000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c1127b0 con 0x7f7f5c06a170 2024-06-13T11:35:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.514+0000 7f7f61000700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c112630 con 0x7f7f5c06ab30 2024-06-13T11:35:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.514+0000 7f7f61000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c112930 con 0x7f7f5c108500 2024-06-13T11:35:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.515+0000 7f7f59e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c06a170 0x7f7f5c19af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.515+0000 7f7f59e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c06a170 0x7f7f5c19af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42176/0 (socket says 172.21.15.2:42176) 2024-06-13T11:35:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.515+0000 7f7f59e00700 1 -- 172.21.15.2:0/1025988583 learned_addr learned my addr 172.21.15.2:0/1025988583 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:35:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.515+0000 7f7f5a800700 1 --2- 172.21.15.2:0/1025988583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f5c108500 0x7f7f5c19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.515+0000 7f7f59400700 1 --2- 172.21.15.2:0/1025988583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f5c06ab30 0x7f7f5c19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.515+0000 7f7f59400700 1 -- 172.21.15.2:0/1025988583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f5c108500 msgr2=0x7f7f5c19f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.515+0000 7f7f59400700 1 --2- 172.21.15.2:0/1025988583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f5c108500 0x7f7f5c19f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.515+0000 7f7f59400700 1 -- 172.21.15.2:0/1025988583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c06a170 msgr2=0x7f7f5c19af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:41.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.515+0000 7f7f59400700 1 --2- 172.21.15.2:0/1025988583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c06a170 0x7f7f5c19af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:41.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.515+0000 7f7f59400700 1 -- 172.21.15.2:0/1025988583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5c19ff90 con 0x7f7f5c06ab30 2024-06-13T11:35:41.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.515+0000 7f7f59e00700 1 --2- 172.21.15.2:0/1025988583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c06a170 0x7f7f5c19af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:35:41.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.516+0000 7f7f59400700 1 --2- 172.21.15.2:0/1025988583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f5c06ab30 0x7f7f5c19b4c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7f48000c00 tx=0x7f7f4800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:41.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.516+0000 7f7f52a00700 1 -- 172.21.15.2:0/1025988583 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48005140 con 0x7f7f5c06ab30 2024-06-13T11:35:41.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.516+0000 7f7f61000700 1 -- 172.21.15.2:0/1025988583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5c1a0220 con 0x7f7f5c06ab30 2024-06-13T11:35:41.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.516+0000 7f7f52a00700 1 -- 172.21.15.2:0/1025988583 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f4800b560 con 0x7f7f5c06ab30 2024-06-13T11:35:41.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.516+0000 7f7f52a00700 1 -- 172.21.15.2:0/1025988583 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48003a20 con 0x7f7f5c06ab30 2024-06-13T11:35:41.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.516+0000 7f7f61000700 1 -- 172.21.15.2:0/1025988583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f5c1a7b00 con 0x7f7f5c06ab30 2024-06-13T11:35:41.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.517+0000 7f7f61000700 1 -- 172.21.15.2:0/1025988583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f5c069180 con 0x7f7f5c06ab30 2024-06-13T11:35:41.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.520+0000 7f7f52a00700 1 -- 172.21.15.2:0/1025988583 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f7f4800ba10 con 0x7f7f5c06ab30 2024-06-13T11:35:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.521+0000 7f7f52a00700 1 --2- 172.21.15.2:0/1025988583 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7f400a2e10 0x7f7f400a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.521+0000 7f7f52a00700 1 -- 172.21.15.2:0/1025988583 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9483+0+0 (secure 0 0 0) 0x7f7f480d07b0 con 0x7f7f5c06ab30 2024-06-13T11:35:41.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.521+0000 7f7f59e00700 1 --2- 172.21.15.2:0/1025988583 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7f400a2e10 0x7f7f400a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:41.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.522+0000 7f7f59e00700 1 --2- 172.21.15.2:0/1025988583 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7f400a2e10 0x7f7f400a52d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009750 tx=0x7f7f4c009310 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:41.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.524+0000 7f7f52a00700 1 -- 172.21.15.2:0/1025988583 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7f48013030 con 0x7f7f5c06ab30 2024-06-13T11:35:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.804+0000 7f7f61000700 1 -- 172.21.15.2:0/1025988583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7f5c19c2e0 con 0x7f7f5c06ab30 2024-06-13T11:35:41.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.817+0000 7f7f52a00700 1 -- 172.21.15.2:0/1025988583 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) ==== 161+0+0 (secure 0 0 0) 0x7f7f5c19c2e0 con 0x7f7f5c06ab30 2024-06-13T11:35:41.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.821+0000 7f7f61000700 1 -- 172.21.15.2:0/1025988583 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7f400a2e10 msgr2=0x7f7f400a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.821+0000 7f7f61000700 1 --2- 172.21.15.2:0/1025988583 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7f400a2e10 0x7f7f400a52d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009750 tx=0x7f7f4c009310 comp rx=0 tx=0).stop 2024-06-13T11:35:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.821+0000 7f7f61000700 1 -- 172.21.15.2:0/1025988583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f5c06ab30 msgr2=0x7f7f5c19b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.821+0000 7f7f61000700 1 --2- 172.21.15.2:0/1025988583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f5c06ab30 0x7f7f5c19b4c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7f48000c00 tx=0x7f7f4800fa00 comp rx=0 tx=0).stop 2024-06-13T11:35:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.821+0000 7f7f61000700 1 -- 172.21.15.2:0/1025988583 shutdown_connections 2024-06-13T11:35:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.821+0000 7f7f61000700 1 --2- 172.21.15.2:0/1025988583 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f7f400a2e10 0x7f7f400a52d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.821+0000 7f7f61000700 1 --2- 172.21.15.2:0/1025988583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f5c06a170 0x7f7f5c19af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.821+0000 7f7f61000700 1 --2- 172.21.15.2:0/1025988583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f5c108500 0x7f7f5c19f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.821+0000 7f7f61000700 1 --2- 172.21.15.2:0/1025988583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f5c06ab30 0x7f7f5c19b4c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:41.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.821+0000 7f7f61000700 1 -- 172.21.15.2:0/1025988583 >> 172.21.15.2:0/1025988583 conn(0x7f7f5c078340 msgr2=0x7f7f5c10d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:41.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.821+0000 7f7f61000700 1 -- 172.21.15.2:0/1025988583 shutdown_connections 2024-06-13T11:35:41.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:41.821+0000 7f7f61000700 1 -- 172.21.15.2:0/1025988583 wait complete. 2024-06-13T11:35:41.822 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-13T11:35:41.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:41 smithi178 ceph-mon[36913]: pgmap v370: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:35:41.947 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:35:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-c[68220]: ignoring --setuser ceph since I am not root 2024-06-13T11:35:41.947 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:35:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-c[68220]: ignoring --setgroup ceph since I am not root 2024-06-13T11:35:41.947 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:35:41 smithi178 ceph-mds[68224]: -- 172.21.15.178:0/3775185077 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55dcc83944e0 con 0x55dcc836ac00 2024-06-13T11:35:41.948 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:35:41 smithi178 ceph-mds[68224]: -- 172.21.15.178:0/3775185077 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dcc8397a40 con 0x55dcc836ac00 2024-06-13T11:35:41.948 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:35:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-c[68220]: starting mds.c at 2024-06-13T11:35:41.948 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:35:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-f[67919]: ignoring --setuser ceph since I am not root 2024-06-13T11:35:41.948 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:35:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-f[67919]: ignoring --setgroup ceph since I am not root 2024-06-13T11:35:41.948 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:35:41 smithi178 ceph-mds[67923]: -- 172.21.15.178:0/4122034872 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f3f34f7a40 con 0x55f3f34cb000 2024-06-13T11:35:41.948 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:35:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-f[67919]: starting mds.f at 2024-06-13T11:35:41.949 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:35:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-i[68535]: ignoring --setuser ceph since I am not root 2024-06-13T11:35:41.949 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:35:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-i[68535]: ignoring --setgroup ceph since I am not root 2024-06-13T11:35:41.949 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:35:41 smithi178 ceph-mds[68539]: -- 172.21.15.178:0/3765162684 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c524f63a40 con 0x55c524f37000 2024-06-13T11:35:41.949 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:35:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-i[68535]: starting mds.i at 2024-06-13T11:35:42.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:41 smithi077 ceph-mon[36410]: pgmap v370: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:35:42.040 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:35:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-b[66612]: ignoring --setuser ceph since I am not root 2024-06-13T11:35:42.040 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:35:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-b[66612]: ignoring --setgroup ceph since I am not root 2024-06-13T11:35:42.041 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:35:41 smithi077 ceph-mds[66616]: -- 172.21.15.77:0/3979070098 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5633a30ada40 con 0x5633a3080c00 2024-06-13T11:35:42.041 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:35:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-b[66612]: starting mds.b at 2024-06-13T11:35:42.041 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:35:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-e[65996]: ignoring --setuser ceph since I am not root 2024-06-13T11:35:42.041 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:35:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-e[65996]: ignoring --setgroup ceph since I am not root 2024-06-13T11:35:42.041 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:35:41 smithi077 ceph-mds[66000]: -- 172.21.15.77:0/1788238325 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5561ac90fa40 con 0x5561ac8e2800 2024-06-13T11:35:42.042 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:35:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-e[65996]: starting mds.e at 2024-06-13T11:35:42.042 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:35:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-h[66311]: ignoring --setuser ceph since I am not root 2024-06-13T11:35:42.042 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:35:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-h[66311]: ignoring --setgroup ceph since I am not root 2024-06-13T11:35:42.042 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:35:41 smithi077 ceph-mds[66315]: -- 172.21.15.77:0/2520547687 <== mon.2 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561df6aada40 con 0x561df6a80c00 2024-06-13T11:35:42.042 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:35:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-h[66311]: starting mds.h at 2024-06-13T11:35:42.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:41 smithi002 ceph-mon[32210]: pgmap v370: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T11:35:42.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:41 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a[32206]: 2024-06-13T11:35:41.807+0000 7f18b7400700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-13T11:35:42.794 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-06-13T11:35:42.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:42 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1025988583' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-13T11:35:42.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:42 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-13T11:35:42.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:42 smithi178 ceph-mon[36913]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-13T11:35:42.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:42 smithi178 ceph-mon[36913]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-13T11:35:42.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:42 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-13T11:35:42.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:42 smithi178 ceph-mon[36913]: osdmap e111: 12 total, 12 up, 12 in 2024-06-13T11:35:42.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:42 smithi178 ceph-mon[36913]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-06-13T11:35:43.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:42 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1025988583' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-13T11:35:43.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:42 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-13T11:35:43.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:42 smithi077 ceph-mon[36410]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-13T11:35:43.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:42 smithi077 ceph-mon[36410]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-13T11:35:43.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:42 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-13T11:35:43.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:42 smithi077 ceph-mon[36410]: osdmap e111: 12 total, 12 up, 12 in 2024-06-13T11:35:43.041 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:42 smithi077 ceph-mon[36410]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-06-13T11:35:43.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:42 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1025988583' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-13T11:35:43.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:42 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-13T11:35:43.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:42 smithi002 ceph-mon[32210]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-13T11:35:43.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:42 smithi002 ceph-mon[32210]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-13T11:35:43.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:42 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-13T11:35:43.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:42 smithi002 ceph-mon[32210]: osdmap e111: 12 total, 12 up, 12 in 2024-06-13T11:35:43.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:42 smithi002 ceph-mon[32210]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-06-13T11:35:43.263 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:35:44.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:43 smithi002 ceph-mon[32210]: pgmap v372: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-06-13T11:35:44.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:43 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T11:35:44.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:43 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T11:35:44.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:43 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-13T11:35:44.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:43 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T11:35:44.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:43 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T11:35:44.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:43 smithi002 ceph-mon[32210]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T11:35:44.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:43 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.77:6835/455096663,v1:172.21.15.77:6837/455096663] up:boot 2024-06-13T11:35:44.147 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:43 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.77:6834/1309855145,v1:172.21.15.77:6838/1309855145] up:boot 2024-06-13T11:35:44.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:43 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.77:6836/2891001082,v1:172.21.15.77:6839/2891001082] up:boot 2024-06-13T11:35:44.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:43 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.178:6834/3935688165,v1:172.21.15.178:6837/3935688165] up:boot 2024-06-13T11:35:44.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:43 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.178:6836/4176826510,v1:172.21.15.178:6839/4176826510] up:boot 2024-06-13T11:35:44.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:43 smithi002 ceph-mon[32210]: mds.? [v2:172.21.15.178:6835/622569657,v1:172.21.15.178:6838/622569657] up:boot 2024-06-13T11:35:44.148 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:43 smithi002 ceph-mon[32210]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-06-13T11:35:44.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:43 smithi178 ceph-mon[36913]: pgmap v372: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-06-13T11:35:44.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:43 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T11:35:44.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:43 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T11:35:44.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:43 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-13T11:35:44.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:43 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T11:35:44.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:43 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T11:35:44.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:43 smithi178 ceph-mon[36913]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T11:35:44.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:43 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.77:6835/455096663,v1:172.21.15.77:6837/455096663] up:boot 2024-06-13T11:35:44.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:43 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.77:6834/1309855145,v1:172.21.15.77:6838/1309855145] up:boot 2024-06-13T11:35:44.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:43 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.77:6836/2891001082,v1:172.21.15.77:6839/2891001082] up:boot 2024-06-13T11:35:44.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:43 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.178:6834/3935688165,v1:172.21.15.178:6837/3935688165] up:boot 2024-06-13T11:35:44.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:43 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.178:6836/4176826510,v1:172.21.15.178:6839/4176826510] up:boot 2024-06-13T11:35:44.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:43 smithi178 ceph-mon[36913]: mds.? [v2:172.21.15.178:6835/622569657,v1:172.21.15.178:6838/622569657] up:boot 2024-06-13T11:35:44.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:43 smithi178 ceph-mon[36913]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-06-13T11:35:44.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:43 smithi077 ceph-mon[36410]: pgmap v372: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-06-13T11:35:44.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:43 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T11:35:44.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:43 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T11:35:44.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:43 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-13T11:35:44.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:43 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T11:35:44.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:43 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T11:35:44.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:43 smithi077 ceph-mon[36410]: from='mgr.25150 172.21.15.2:0/87140941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T11:35:44.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:43 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.77:6835/455096663,v1:172.21.15.77:6837/455096663] up:boot 2024-06-13T11:35:44.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:43 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.77:6834/1309855145,v1:172.21.15.77:6838/1309855145] up:boot 2024-06-13T11:35:44.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:43 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.77:6836/2891001082,v1:172.21.15.77:6839/2891001082] up:boot 2024-06-13T11:35:44.292 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:43 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.178:6834/3935688165,v1:172.21.15.178:6837/3935688165] up:boot 2024-06-13T11:35:44.292 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:43 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.178:6836/4176826510,v1:172.21.15.178:6839/4176826510] up:boot 2024-06-13T11:35:44.292 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:43 smithi077 ceph-mon[36410]: mds.? [v2:172.21.15.178:6835/622569657,v1:172.21.15.178:6838/622569657] up:boot 2024-06-13T11:35:44.292 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:43 smithi077 ceph-mon[36410]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-06-13T11:35:45.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.601+0000 7fd8afa00700 1 -- 172.21.15.2:0/1038854046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8105070 msgr2=0x7fd8a8111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:45.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.601+0000 7fd8afa00700 1 --2- 172.21.15.2:0/1038854046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8105070 0x7fd8a8111580 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000b0a0 tx=0x7fd8a000b3b0 comp rx=0 tx=0).stop 2024-06-13T11:35:45.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.602+0000 7fd8afa00700 1 -- 172.21.15.2:0/1038854046 shutdown_connections 2024-06-13T11:35:45.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.602+0000 7fd8afa00700 1 --2- 172.21.15.2:0/1038854046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8105070 0x7fd8a8111580 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:45.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.602+0000 7fd8afa00700 1 --2- 172.21.15.2:0/1038854046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8a810a6b0 0x7fd8a810aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:45.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.602+0000 7fd8afa00700 1 --2- 172.21.15.2:0/1038854046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8a81046b0 0x7fd8a8104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:45.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.602+0000 7fd8afa00700 1 -- 172.21.15.2:0/1038854046 >> 172.21.15.2:0/1038854046 conn(0x7fd8a81001a0 msgr2=0x7fd8a81025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:45.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.602+0000 7fd8afa00700 1 -- 172.21.15.2:0/1038854046 shutdown_connections 2024-06-13T11:35:45.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.602+0000 7fd8afa00700 1 -- 172.21.15.2:0/1038854046 wait complete. 2024-06-13T11:35:45.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.603+0000 7fd8afa00700 1 Processor -- start 2024-06-13T11:35:45.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.603+0000 7fd8afa00700 1 -- start start 2024-06-13T11:35:45.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.604+0000 7fd8afa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8a81046b0 0x7fd8a819ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:45.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.604+0000 7fd8afa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8105070 0x7fd8a819b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:45.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.604+0000 7fd8afa00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8a810a6b0 0x7fd8a819f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:45.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.604+0000 7fd8afa00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a8114a40 con 0x7fd8a8105070 2024-06-13T11:35:45.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.604+0000 7fd8afa00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a81148c0 con 0x7fd8a810a6b0 2024-06-13T11:35:45.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.604+0000 7fd8afa00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a8114bc0 con 0x7fd8a81046b0 2024-06-13T11:35:45.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.604+0000 7fd8ad000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8a81046b0 0x7fd8a819ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:45.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.604+0000 7fd8ad000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8a81046b0 0x7fd8a819ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:34146/0 (socket says 172.21.15.2:34146) 2024-06-13T11:35:45.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.604+0000 7fd8ad000700 1 -- 172.21.15.2:0/3977583417 learned_addr learned my addr 172.21.15.2:0/3977583417 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:35:45.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.604+0000 7fd8ada00700 1 --2- 172.21.15.2:0/3977583417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8a810a6b0 0x7fd8a819f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:45.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.604+0000 7fd8a7e00700 1 --2- 172.21.15.2:0/3977583417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8105070 0x7fd8a819b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:45.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.605+0000 7fd8ad000700 1 -- 172.21.15.2:0/3977583417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8a810a6b0 msgr2=0x7fd8a819f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:45.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.605+0000 7fd8ad000700 1 --2- 172.21.15.2:0/3977583417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8a810a6b0 0x7fd8a819f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:45.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.605+0000 7fd8ad000700 1 -- 172.21.15.2:0/3977583417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8105070 msgr2=0x7fd8a819b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:45.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.605+0000 7fd8ad000700 1 --2- 172.21.15.2:0/3977583417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8105070 0x7fd8a819b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:45.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.605+0000 7fd8ad000700 1 -- 172.21.15.2:0/3977583417 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a819fda0 con 0x7fd8a81046b0 2024-06-13T11:35:45.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.605+0000 7fd8ada00700 1 --2- 172.21.15.2:0/3977583417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8a810a6b0 0x7fd8a819f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T11:35:45.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.605+0000 7fd8ad000700 1 --2- 172.21.15.2:0/3977583417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8a81046b0 0x7fd8a819ad90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00e9a0 tx=0x7fd89c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:45.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.605+0000 7fd8a5600700 1 -- 172.21.15.2:0/3977583417 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c00ca10 con 0x7fd8a81046b0 2024-06-13T11:35:45.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.606+0000 7fd8a5600700 1 -- 172.21.15.2:0/3977583417 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd89c00cbb0 con 0x7fd8a81046b0 2024-06-13T11:35:45.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.606+0000 7fd8afa00700 1 -- 172.21.15.2:0/3977583417 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a81a0090 con 0x7fd8a81046b0 2024-06-13T11:35:45.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.606+0000 7fd8a5600700 1 -- 172.21.15.2:0/3977583417 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c018680 con 0x7fd8a81046b0 2024-06-13T11:35:45.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.606+0000 7fd8afa00700 1 -- 172.21.15.2:0/3977583417 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a81a7910 con 0x7fd8a81046b0 2024-06-13T11:35:45.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.607+0000 7fd8afa00700 1 -- 172.21.15.2:0/3977583417 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a8069180 con 0x7fd8a81046b0 2024-06-13T11:35:45.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.609+0000 7fd8a5600700 1 -- 172.21.15.2:0/3977583417 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fd89c010430 con 0x7fd8a81046b0 2024-06-13T11:35:45.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.610+0000 7fd8a5600700 1 --2- 172.21.15.2:0/3977583417 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd8900a2e10 0x7fd8900a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:45.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.611+0000 7fd8a5600700 1 -- 172.21.15.2:0/3977583417 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9653+0+0 (secure 0 0 0) 0x7fd89c0cfd60 con 0x7fd8a81046b0 2024-06-13T11:35:45.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.611+0000 7fd8a7e00700 1 --2- 172.21.15.2:0/3977583417 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd8900a2e10 0x7fd8900a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:45.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.611+0000 7fd8a7e00700 1 --2- 172.21.15.2:0/3977583417 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd8900a2e10 0x7fd8900a52d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd894009680 tx=0x7fd894009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:45.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.613+0000 7fd8a5600700 1 -- 172.21.15.2:0/3977583417 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd89c09c4b0 con 0x7fd8a81046b0 2024-06-13T11:35:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:45.896+0000 7fd8afa00700 1 -- 172.21.15.2:0/3977583417 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd8a802dca0 con 0x7fd8a81046b0 2024-06-13T11:35:46.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:45 smithi002 ceph-mon[32210]: pgmap v373: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-06-13T11:35:46.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:45 smithi178 ceph-mon[36913]: pgmap v373: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-06-13T11:35:46.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:45 smithi077 ceph-mon[36410]: pgmap v373: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-06-13T11:35:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:46.834+0000 7fd8a5600700 1 -- 172.21.15.2:0/3977583417 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) ==== 104+0+0 (secure 0 0 0) 0x7fd89c09bdb0 con 0x7fd8a81046b0 2024-06-13T11:35:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:46.837+0000 7fd8afa00700 1 -- 172.21.15.2:0/3977583417 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd8900a2e10 msgr2=0x7fd8900a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:46.837+0000 7fd8afa00700 1 --2- 172.21.15.2:0/3977583417 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd8900a2e10 0x7fd8900a52d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd894009680 tx=0x7fd894009260 comp rx=0 tx=0).stop 2024-06-13T11:35:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:46.837+0000 7fd8afa00700 1 -- 172.21.15.2:0/3977583417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8a81046b0 msgr2=0x7fd8a819ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:46.837+0000 7fd8afa00700 1 --2- 172.21.15.2:0/3977583417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8a81046b0 0x7fd8a819ad90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00e9a0 tx=0x7fd89c00ecb0 comp rx=0 tx=0).stop 2024-06-13T11:35:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:46.838+0000 7fd8afa00700 1 -- 172.21.15.2:0/3977583417 shutdown_connections 2024-06-13T11:35:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:46.838+0000 7fd8afa00700 1 --2- 172.21.15.2:0/3977583417 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fd8900a2e10 0x7fd8900a52d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:46.838+0000 7fd8afa00700 1 --2- 172.21.15.2:0/3977583417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8a810a6b0 0x7fd8a819f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:46.838+0000 7fd8afa00700 1 --2- 172.21.15.2:0/3977583417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8a81046b0 0x7fd8a819ad90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:46.838+0000 7fd8afa00700 1 --2- 172.21.15.2:0/3977583417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a8105070 0x7fd8a819b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:46.838+0000 7fd8afa00700 1 -- 172.21.15.2:0/3977583417 >> 172.21.15.2:0/3977583417 conn(0x7fd8a81001a0 msgr2=0x7fd8a8100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:46.838+0000 7fd8afa00700 1 -- 172.21.15.2:0/3977583417 shutdown_connections 2024-06-13T11:35:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:46.838+0000 7fd8afa00700 1 -- 172.21.15.2:0/3977583417 wait complete. 2024-06-13T11:35:47.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:46 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3977583417' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T11:35:47.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:46 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T11:35:47.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:46 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3977583417' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T11:35:47.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:46 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T11:35:47.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:46 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3977583417' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T11:35:47.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:46 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T11:35:47.773 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-13T11:35:48.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:47 smithi002 ceph-mon[32210]: pgmap v374: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-06-13T11:35:48.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:47 smithi002 ceph-mon[32210]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-13T11:35:48.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:47 smithi002 ceph-mon[32210]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-13T11:35:48.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:47 smithi002 ceph-mon[32210]: Cluster is now healthy 2024-06-13T11:35:48.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:47 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-13T11:35:48.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:47 smithi002 ceph-mon[32210]: fsmap 12 up:standby 2024-06-13T11:35:48.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:47 smithi178 ceph-mon[36913]: pgmap v374: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-06-13T11:35:48.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:47 smithi178 ceph-mon[36913]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-13T11:35:48.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:47 smithi178 ceph-mon[36913]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-13T11:35:48.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:47 smithi178 ceph-mon[36913]: Cluster is now healthy 2024-06-13T11:35:48.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:47 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-13T11:35:48.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:47 smithi178 ceph-mon[36913]: fsmap 12 up:standby 2024-06-13T11:35:48.249 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:35:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:47 smithi077 ceph-mon[36410]: pgmap v374: 129 pgs: 129 active+clean; 83 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-06-13T11:35:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:47 smithi077 ceph-mon[36410]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-13T11:35:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:47 smithi077 ceph-mon[36410]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-13T11:35:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:47 smithi077 ceph-mon[36410]: Cluster is now healthy 2024-06-13T11:35:48.290 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:47 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-13T11:35:48.291 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:47 smithi077 ceph-mon[36410]: fsmap 12 up:standby 2024-06-13T11:35:49.122 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:48 smithi077 ceph-mon[36410]: pgmap v375: 129 pgs: 129 active+clean; 83 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-06-13T11:35:49.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:48 smithi002 ceph-mon[32210]: pgmap v375: 129 pgs: 129 active+clean; 83 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-06-13T11:35:49.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:48 smithi178 ceph-mon[36913]: pgmap v375: 129 pgs: 129 active+clean; 83 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-06-13T11:35:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.614+0000 7ff73d600700 1 -- 172.21.15.2:0/3140976657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff738102fd0 msgr2=0x7ff738107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.614+0000 7ff73d600700 1 --2- 172.21.15.2:0/3140976657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff738102fd0 0x7ff738107020 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff7200099c0 tx=0x7ff720009cd0 comp rx=0 tx=0).stop 2024-06-13T11:35:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.614+0000 7ff73d600700 1 -- 172.21.15.2:0/3140976657 shutdown_connections 2024-06-13T11:35:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.614+0000 7ff73d600700 1 --2- 172.21.15.2:0/3140976657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff738107700 0x7ff73810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.614+0000 7ff73d600700 1 --2- 172.21.15.2:0/3140976657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff738102620 0x7ff738102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.614+0000 7ff73d600700 1 --2- 172.21.15.2:0/3140976657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff738102fd0 0x7ff738107020 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.614+0000 7ff73d600700 1 -- 172.21.15.2:0/3140976657 >> 172.21.15.2:0/3140976657 conn(0x7ff7380fdf10 msgr2=0x7ff738100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.614+0000 7ff73d600700 1 -- 172.21.15.2:0/3140976657 shutdown_connections 2024-06-13T11:35:50.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.614+0000 7ff73d600700 1 -- 172.21.15.2:0/3140976657 wait complete. 2024-06-13T11:35:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.615+0000 7ff73d600700 1 Processor -- start 2024-06-13T11:35:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.615+0000 7ff73d600700 1 -- start start 2024-06-13T11:35:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.616+0000 7ff73d600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff738102620 0x7ff73819ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.616+0000 7ff73d600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff738102fd0 0x7ff73819b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.616+0000 7ff73d600700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff738107700 0x7ff73819f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.616+0000 7ff73d600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff738112710 con 0x7ff738102620 2024-06-13T11:35:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.616+0000 7ff73d600700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff738112590 con 0x7ff738107700 2024-06-13T11:35:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.616+0000 7ff73d600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff738112890 con 0x7ff738102fd0 2024-06-13T11:35:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.616+0000 7ff737e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff738102620 0x7ff73819ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.616+0000 7ff72f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff738102fd0 0x7ff73819b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:50.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.616+0000 7ff72f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff738102fd0 0x7ff73819b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:49616/0 (socket says 172.21.15.2:49616) 2024-06-13T11:35:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.616+0000 7ff72f400700 1 -- 172.21.15.2:0/1830299245 learned_addr learned my addr 172.21.15.2:0/1830299245 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:35:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.616+0000 7ff73cc00700 1 --2- 172.21.15.2:0/1830299245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff738107700 0x7ff73819f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.616+0000 7ff72f400700 1 -- 172.21.15.2:0/1830299245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff738107700 msgr2=0x7ff73819f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.617+0000 7ff72f400700 1 --2- 172.21.15.2:0/1830299245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff738107700 0x7ff73819f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.617+0000 7ff72f400700 1 -- 172.21.15.2:0/1830299245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff738102620 msgr2=0x7ff73819ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.617+0000 7ff72f400700 1 --2- 172.21.15.2:0/1830299245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff738102620 0x7ff73819ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.617+0000 7ff72f400700 1 -- 172.21.15.2:0/1830299245 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73819fdf0 con 0x7ff738102fd0 2024-06-13T11:35:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.617+0000 7ff72f400700 1 --2- 172.21.15.2:0/1830299245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff738102fd0 0x7ff73819b320 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff72000c010 tx=0x7ff7200038b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.617+0000 7ff735600700 1 -- 172.21.15.2:0/1830299245 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff720026070 con 0x7ff738102fd0 2024-06-13T11:35:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.617+0000 7ff735600700 1 -- 172.21.15.2:0/1830299245 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff720005690 con 0x7ff738102fd0 2024-06-13T11:35:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.617+0000 7ff73d600700 1 -- 172.21.15.2:0/1830299245 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7381a0080 con 0x7ff738102fd0 2024-06-13T11:35:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.617+0000 7ff735600700 1 -- 172.21.15.2:0/1830299245 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72000fc80 con 0x7ff738102fd0 2024-06-13T11:35:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.617+0000 7ff73d600700 1 -- 172.21.15.2:0/1830299245 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7381a7960 con 0x7ff738102fd0 2024-06-13T11:35:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.618+0000 7ff73d600700 1 -- 172.21.15.2:0/1830299245 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff738069180 con 0x7ff738102fd0 2024-06-13T11:35:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.621+0000 7ff735600700 1 -- 172.21.15.2:0/1830299245 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7ff720029070 con 0x7ff738102fd0 2024-06-13T11:35:50.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.622+0000 7ff735600700 1 --2- 172.21.15.2:0/1830299245 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff71c0a2e10 0x7ff71c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.622+0000 7ff735600700 1 -- 172.21.15.2:0/1830299245 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9653+0+0 (secure 0 0 0) 0x7ff7200d0bc0 con 0x7ff738102fd0 2024-06-13T11:35:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.622+0000 7ff737e00700 1 --2- 172.21.15.2:0/1830299245 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff71c0a2e10 0x7ff71c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.623+0000 7ff737e00700 1 --2- 172.21.15.2:0/1830299245 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff71c0a2e10 0x7ff71c0a52d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff728009550 tx=0x7ff7280091f0 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.625+0000 7ff735600700 1 -- 172.21.15.2:0/1830299245 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff720013070 con 0x7ff738102fd0 2024-06-13T11:35:50.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:50.853+0000 7ff73d600700 1 -- 172.21.15.2:0/1830299245 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff73819c140 con 0x7ff738102fd0 2024-06-13T11:35:51.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:51.569+0000 7ff735600700 1 -- 172.21.15.2:0/1830299245 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v112) ==== 181+0+0 (secure 0 0 0) 0x7ff73819c140 con 0x7ff738102fd0 2024-06-13T11:35:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:51.575+0000 7ff73d600700 1 -- 172.21.15.2:0/1830299245 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff71c0a2e10 msgr2=0x7ff71c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:51.575+0000 7ff73d600700 1 --2- 172.21.15.2:0/1830299245 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff71c0a2e10 0x7ff71c0a52d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff728009550 tx=0x7ff7280091f0 comp rx=0 tx=0).stop 2024-06-13T11:35:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:51.575+0000 7ff73d600700 1 -- 172.21.15.2:0/1830299245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff738102fd0 msgr2=0x7ff73819b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:51.575+0000 7ff73d600700 1 --2- 172.21.15.2:0/1830299245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff738102fd0 0x7ff73819b320 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff72000c010 tx=0x7ff7200038b0 comp rx=0 tx=0).stop 2024-06-13T11:35:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:51.575+0000 7ff73d600700 1 -- 172.21.15.2:0/1830299245 shutdown_connections 2024-06-13T11:35:51.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:51.575+0000 7ff73d600700 1 --2- 172.21.15.2:0/1830299245 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7ff71c0a2e10 0x7ff71c0a52d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:51.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:51.575+0000 7ff73d600700 1 --2- 172.21.15.2:0/1830299245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff738102620 0x7ff73819ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:51.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:51.575+0000 7ff73d600700 1 --2- 172.21.15.2:0/1830299245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff738107700 0x7ff73819f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:51.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:51.575+0000 7ff73d600700 1 --2- 172.21.15.2:0/1830299245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff738102fd0 0x7ff73819b320 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:51.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:51.575+0000 7ff73d600700 1 -- 172.21.15.2:0/1830299245 >> 172.21.15.2:0/1830299245 conn(0x7ff7380fdf10 msgr2=0x7ff7380fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:51.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:51.577+0000 7ff73d600700 1 -- 172.21.15.2:0/1830299245 shutdown_connections 2024-06-13T11:35:51.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:51.577+0000 7ff73d600700 1 -- 172.21.15.2:0/1830299245 wait complete. 2024-06-13T11:35:51.579 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2024-06-13T11:35:51.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:51 smithi002 ceph-mon[32210]: pgmap v376: 129 pgs: 129 active+clean; 83 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-06-13T11:35:51.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:51 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/1830299245' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:35:51.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:51 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:35:51.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:51 smithi178 ceph-mon[36913]: pgmap v376: 129 pgs: 129 active+clean; 83 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-06-13T11:35:51.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:51 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/1830299245' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:35:51.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:51 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:35:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:51 smithi077 ceph-mon[36410]: pgmap v376: 129 pgs: 129 active+clean; 83 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-06-13T11:35:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:51 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/1830299245' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:35:52.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:51 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:35:52.474 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-13T11:35:52.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:52 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T11:35:52.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:52 smithi002 ceph-mon[32210]: osdmap e112: 12 total, 12 up, 12 in 2024-06-13T11:35:52.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:52 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T11:35:52.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:52 smithi178 ceph-mon[36913]: osdmap e112: 12 total, 12 up, 12 in 2024-06-13T11:35:52.952 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:35:53.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:52 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T11:35:53.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:52 smithi077 ceph-mon[36410]: osdmap e112: 12 total, 12 up, 12 in 2024-06-13T11:35:53.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:53 smithi002 ceph-mon[32210]: pgmap v378: 97 pgs: 97 active+clean; 26 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:35:53.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:53 smithi178 ceph-mon[36913]: pgmap v378: 97 pgs: 97 active+clean; 26 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:35:54.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:53 smithi077 ceph-mon[36410]: pgmap v378: 97 pgs: 97 active+clean; 26 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:35:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.308+0000 7f3d19200700 1 -- 172.21.15.2:0/3288843551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d1406a170 msgr2=0x7f3d1406a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.308+0000 7f3d19200700 1 --2- 172.21.15.2:0/3288843551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d1406a170 0x7f3d1406a5d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009920 tx=0x7f3d00009c30 comp rx=0 tx=0).stop 2024-06-13T11:35:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.308+0000 7f3d19200700 1 -- 172.21.15.2:0/3288843551 shutdown_connections 2024-06-13T11:35:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.308+0000 7f3d19200700 1 --2- 172.21.15.2:0/3288843551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d141084e0 0x7f3d141088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.308+0000 7f3d19200700 1 --2- 172.21.15.2:0/3288843551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d1406ab10 0x7f3d1410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.308+0000 7f3d19200700 1 --2- 172.21.15.2:0/3288843551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d1406a170 0x7f3d1406a5d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.308+0000 7f3d19200700 1 -- 172.21.15.2:0/3288843551 >> 172.21.15.2:0/3288843551 conn(0x7f3d140782c0 msgr2=0x7f3d140786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.308+0000 7f3d19200700 1 -- 172.21.15.2:0/3288843551 shutdown_connections 2024-06-13T11:35:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.308+0000 7f3d19200700 1 -- 172.21.15.2:0/3288843551 wait complete. 2024-06-13T11:35:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.310+0000 7f3d19200700 1 Processor -- start 2024-06-13T11:35:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.310+0000 7f3d19200700 1 -- start start 2024-06-13T11:35:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.310+0000 7f3d19200700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d1406a170 0x7f3d14101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.310+0000 7f3d19200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d1406ab10 0x7f3d141019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.310+0000 7f3d19200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d141084e0 0x7f3d14101ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.310+0000 7f3d19200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3d14112790 con 0x7f3d141084e0 2024-06-13T11:35:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.310+0000 7f3d19200700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3d14112610 con 0x7f3d1406a170 2024-06-13T11:35:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.310+0000 7f3d19200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3d14112910 con 0x7f3d1406ab10 2024-06-13T11:35:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.311+0000 7f3d11e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d1406a170 0x7f3d14101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.311+0000 7f3d11e00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d1406a170 0x7f3d14101460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.2:56594/0 (socket says 172.21.15.2:56594) 2024-06-13T11:35:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.311+0000 7f3d11e00700 1 -- 172.21.15.2:0/4107550039 learned_addr learned my addr 172.21.15.2:0/4107550039 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:35:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.311+0000 7f3d11400700 1 --2- 172.21.15.2:0/4107550039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d1406ab10 0x7f3d141019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.311+0000 7f3d12800700 1 --2- 172.21.15.2:0/4107550039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d141084e0 0x7f3d14101ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.311+0000 7f3d11e00700 1 -- 172.21.15.2:0/4107550039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d1406ab10 msgr2=0x7f3d141019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.311+0000 7f3d11e00700 1 --2- 172.21.15.2:0/4107550039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d1406ab10 0x7f3d141019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.311+0000 7f3d11e00700 1 -- 172.21.15.2:0/4107550039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d141084e0 msgr2=0x7f3d14101ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.311+0000 7f3d11e00700 1 --2- 172.21.15.2:0/4107550039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d141084e0 0x7f3d14101ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.311+0000 7f3d11e00700 1 -- 172.21.15.2:0/4107550039 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d141a71f0 con 0x7f3d1406a170 2024-06-13T11:35:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.311+0000 7f3d12800700 1 --2- 172.21.15.2:0/4107550039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d141084e0 0x7f3d14101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T11:35:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.311+0000 7f3d11e00700 1 --2- 172.21.15.2:0/4107550039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d1406a170 0x7f3d14101460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400ec10 tx=0x7f3d0400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.312+0000 7f3d0aa00700 1 -- 172.21.15.2:0/4107550039 <== mon.2 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400cd40 con 0x7f3d1406a170 2024-06-13T11:35:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.312+0000 7f3d0aa00700 1 -- 172.21.15.2:0/4107550039 <== mon.2 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d04004500 con 0x7f3d1406a170 2024-06-13T11:35:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.312+0000 7f3d19200700 1 -- 172.21.15.2:0/4107550039 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d141a74e0 con 0x7f3d1406a170 2024-06-13T11:35:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.312+0000 7f3d0aa00700 1 -- 172.21.15.2:0/4107550039 <== mon.2 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04010690 con 0x7f3d1406a170 2024-06-13T11:35:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.312+0000 7f3d19200700 1 -- 172.21.15.2:0/4107550039 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d141a79f0 con 0x7f3d1406a170 2024-06-13T11:35:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.313+0000 7f3d19200700 1 -- 172.21.15.2:0/4107550039 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d14069180 con 0x7f3d1406a170 2024-06-13T11:35:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.315+0000 7f3d0aa00700 1 -- 172.21.15.2:0/4107550039 <== mon.2 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f3d04043b60 con 0x7f3d1406a170 2024-06-13T11:35:55.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.317+0000 7f3d0aa00700 1 --2- 172.21.15.2:0/4107550039 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f3cf80a2d90 0x7f3cf80a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:55.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.317+0000 7f3d0aa00700 1 -- 172.21.15.2:0/4107550039 <== mon.2 v2:172.21.15.77:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9149+0+0 (secure 0 0 0) 0x7f3d040cfa00 con 0x7f3d1406a170 2024-06-13T11:35:55.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.317+0000 7f3d11400700 1 --2- 172.21.15.2:0/4107550039 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f3cf80a2d90 0x7f3cf80a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:55.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.318+0000 7f3d11400700 1 --2- 172.21.15.2:0/4107550039 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f3cf80a2d90 0x7f3cf80a5250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3d000098f0 tx=0x7f3d00019040 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:55.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.319+0000 7f3d0aa00700 1 -- 172.21.15.2:0/4107550039 <== mon.2 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3d0409c350 con 0x7f3d1406a170 2024-06-13T11:35:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.563+0000 7f3d19200700 1 -- 172.21.15.2:0/4107550039 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3d1402dca0 con 0x7f3d1406a170 2024-06-13T11:35:55.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.588+0000 7f3d0aa00700 1 -- 172.21.15.2:0/4107550039 <== mon.2 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v113) ==== 169+0+0 (secure 0 0 0) 0x7f3d0400fe10 con 0x7f3d1406a170 2024-06-13T11:35:55.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.593+0000 7f3d19200700 1 -- 172.21.15.2:0/4107550039 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f3cf80a2d90 msgr2=0x7f3cf80a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:55.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.593+0000 7f3d19200700 1 --2- 172.21.15.2:0/4107550039 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f3cf80a2d90 0x7f3cf80a5250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3d000098f0 tx=0x7f3d00019040 comp rx=0 tx=0).stop 2024-06-13T11:35:55.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.593+0000 7f3d19200700 1 -- 172.21.15.2:0/4107550039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d1406a170 msgr2=0x7f3d14101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:55.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.593+0000 7f3d19200700 1 --2- 172.21.15.2:0/4107550039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d1406a170 0x7f3d14101460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400ec10 tx=0x7f3d0400ef20 comp rx=0 tx=0).stop 2024-06-13T11:35:55.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.595+0000 7f3d19200700 1 -- 172.21.15.2:0/4107550039 shutdown_connections 2024-06-13T11:35:55.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.595+0000 7f3d19200700 1 --2- 172.21.15.2:0/4107550039 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7f3cf80a2d90 0x7f3cf80a5250 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:55.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.595+0000 7f3d19200700 1 --2- 172.21.15.2:0/4107550039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d141084e0 0x7f3d14101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:55.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.595+0000 7f3d19200700 1 --2- 172.21.15.2:0/4107550039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d1406a170 0x7f3d14101460 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:55.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.595+0000 7f3d19200700 1 --2- 172.21.15.2:0/4107550039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d1406ab10 0x7f3d141019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:55.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.595+0000 7f3d19200700 1 -- 172.21.15.2:0/4107550039 >> 172.21.15.2:0/4107550039 conn(0x7f3d140782c0 msgr2=0x7f3d140ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:55.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.595+0000 7f3d19200700 1 -- 172.21.15.2:0/4107550039 shutdown_connections 2024-06-13T11:35:55.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:55.596+0000 7f3d19200700 1 -- 172.21.15.2:0/4107550039 wait complete. 2024-06-13T11:35:55.598 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2024-06-13T11:35:55.895 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:55 smithi002 ceph-mon[32210]: pgmap v379: 97 pgs: 97 active+clean; 26 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:35:55.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:55 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/4107550039' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:35:55.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:55 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:35:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:55 smithi178 ceph-mon[36913]: pgmap v379: 97 pgs: 97 active+clean; 26 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:35:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:55 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/4107550039' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:35:55.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:55 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:35:56.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:55 smithi077 ceph-mon[36410]: pgmap v379: 97 pgs: 97 active+clean; 26 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:35:56.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:55 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/4107550039' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:35:56.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:55 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:35:56.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 3611563c-2975-11ef-bc9c-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-06-13T11:35:56.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:56 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T11:35:56.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:56 smithi002 ceph-mon[32210]: osdmap e113: 12 total, 12 up, 12 in 2024-06-13T11:35:56.874 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T11:35:56.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:56 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T11:35:56.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:56 smithi178 ceph-mon[36913]: osdmap e113: 12 total, 12 up, 12 in 2024-06-13T11:35:57.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:56 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T11:35:57.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:56 smithi077 ceph-mon[36410]: osdmap e113: 12 total, 12 up, 12 in 2024-06-13T11:35:57.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:57 smithi002 ceph-mon[32210]: pgmap v381: 33 pgs: 33 active+clean; 26 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:35:57.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:57 smithi178 ceph-mon[36913]: pgmap v381: 33 pgs: 33 active+clean; 26 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:35:58.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:57 smithi077 ceph-mon[36410]: pgmap v381: 33 pgs: 33 active+clean; 26 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:35:59.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.055+0000 7fca35c00700 1 -- 172.21.15.2:0/3330680178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca30107ab0 msgr2=0x7fca3010f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:59.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.055+0000 7fca35c00700 1 --2- 172.21.15.2:0/3330680178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca30107ab0 0x7fca3010f3c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fca2800b0d0 tx=0x7fca2800b3e0 comp rx=0 tx=0).stop 2024-06-13T11:35:59.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.055+0000 7fca35c00700 1 -- 172.21.15.2:0/3330680178 shutdown_connections 2024-06-13T11:35:59.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.055+0000 7fca35c00700 1 --2- 172.21.15.2:0/3330680178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca30107ab0 0x7fca3010f3c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.055+0000 7fca35c00700 1 --2- 172.21.15.2:0/3330680178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca30102a70 0x7fca30102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.055+0000 7fca35c00700 1 --2- 172.21.15.2:0/3330680178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca301070f0 0x7fca30107570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.055+0000 7fca35c00700 1 -- 172.21.15.2:0/3330680178 >> 172.21.15.2:0/3330680178 conn(0x7fca3007a420 msgr2=0x7fca3007a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.055+0000 7fca35c00700 1 -- 172.21.15.2:0/3330680178 shutdown_connections 2024-06-13T11:35:59.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.055+0000 7fca35c00700 1 -- 172.21.15.2:0/3330680178 wait complete. 2024-06-13T11:35:59.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.056+0000 7fca35c00700 1 Processor -- start 2024-06-13T11:35:59.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.056+0000 7fca35c00700 1 -- start start 2024-06-13T11:35:59.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.057+0000 7fca35c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca30102a70 0x7fca3019ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:59.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.057+0000 7fca35c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca301070f0 0x7fca3019b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:59.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.057+0000 7fca35c00700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca30107ab0 0x7fca3019f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:59.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.057+0000 7fca35c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fca301127f0 con 0x7fca301070f0 2024-06-13T11:35:59.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.057+0000 7fca35c00700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca30112670 con 0x7fca30107ab0 2024-06-13T11:35:59.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.057+0000 7fca35c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fca30112970 con 0x7fca30102a70 2024-06-13T11:35:59.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.057+0000 7fca2ea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca30102a70 0x7fca3019ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:59.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.057+0000 7fca2e000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca301070f0 0x7fca3019b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:59.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.057+0000 7fca2ea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca30102a70 0x7fca3019ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.2:46796/0 (socket says 172.21.15.2:46796) 2024-06-13T11:35:59.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.057+0000 7fca2ea00700 1 -- 172.21.15.2:0/3730315171 learned_addr learned my addr 172.21.15.2:0/3730315171 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T11:35:59.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.057+0000 7fca2f400700 1 --2- 172.21.15.2:0/3730315171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca30107ab0 0x7fca3019f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:59.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.057+0000 7fca2ea00700 1 -- 172.21.15.2:0/3730315171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca30107ab0 msgr2=0x7fca3019f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.057+0000 7fca2ea00700 1 --2- 172.21.15.2:0/3730315171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca30107ab0 0x7fca3019f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.058+0000 7fca2ea00700 1 -- 172.21.15.2:0/3730315171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca301070f0 msgr2=0x7fca3019b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.058+0000 7fca2ea00700 1 --2- 172.21.15.2:0/3730315171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca301070f0 0x7fca3019b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.058+0000 7fca2ea00700 1 -- 172.21.15.2:0/3730315171 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3019fd50 con 0x7fca30102a70 2024-06-13T11:35:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.058+0000 7fca2ea00700 1 --2- 172.21.15.2:0/3730315171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca30102a70 0x7fca3019ad90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fca2000eb30 tx=0x7fca2000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.058+0000 7fca27400700 1 -- 172.21.15.2:0/3730315171 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2000cbd0 con 0x7fca30102a70 2024-06-13T11:35:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.058+0000 7fca27400700 1 -- 172.21.15.2:0/3730315171 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca20004500 con 0x7fca30102a70 2024-06-13T11:35:59.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.058+0000 7fca27400700 1 -- 172.21.15.2:0/3730315171 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20010430 con 0x7fca30102a70 2024-06-13T11:35:59.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.058+0000 7fca35c00700 1 -- 172.21.15.2:0/3730315171 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca301a0040 con 0x7fca30102a70 2024-06-13T11:35:59.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.058+0000 7fca35c00700 1 -- 172.21.15.2:0/3730315171 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca301a78c0 con 0x7fca30102a70 2024-06-13T11:35:59.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.060+0000 7fca35c00700 1 -- 172.21.15.2:0/3730315171 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca30069180 con 0x7fca30102a70 2024-06-13T11:35:59.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.062+0000 7fca27400700 1 -- 172.21.15.2:0/3730315171 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fca20003f00 con 0x7fca30102a70 2024-06-13T11:35:59.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.063+0000 7fca27400700 1 --2- 172.21.15.2:0/3730315171 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fca140a2e10 0x7fca140a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T11:35:59.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.063+0000 7fca27400700 1 -- 172.21.15.2:0/3730315171 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 8582+0+0 (secure 0 0 0) 0x7fca200cf7d0 con 0x7fca30102a70 2024-06-13T11:35:59.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.063+0000 7fca2e000700 1 --2- 172.21.15.2:0/3730315171 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fca140a2e10 0x7fca140a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T11:35:59.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.064+0000 7fca2e000700 1 --2- 172.21.15.2:0/3730315171 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fca140a2e10 0x7fca140a52d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fca3010f770 tx=0x7fca1c009260 comp rx=0 tx=0).ready entity=mgr.25150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T11:35:59.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.067+0000 7fca27400700 1 -- 172.21.15.2:0/3730315171 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fca2009c350 con 0x7fca30102a70 2024-06-13T11:35:59.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.297+0000 7fca35c00700 1 -- 172.21.15.2:0/3730315171 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fca301a7b50 con 0x7fca30102a70 2024-06-13T11:35:59.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.613+0000 7fca27400700 1 -- 172.21.15.2:0/3730315171 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v114) ==== 178+0+0 (secure 0 0 0) 0x7fca2009bc50 con 0x7fca30102a70 2024-06-13T11:35:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.619+0000 7fca35c00700 1 -- 172.21.15.2:0/3730315171 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fca140a2e10 msgr2=0x7fca140a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.619+0000 7fca35c00700 1 --2- 172.21.15.2:0/3730315171 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fca140a2e10 0x7fca140a52d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fca3010f770 tx=0x7fca1c009260 comp rx=0 tx=0).stop 2024-06-13T11:35:59.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.619+0000 7fca35c00700 1 -- 172.21.15.2:0/3730315171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca30102a70 msgr2=0x7fca3019ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T11:35:59.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.619+0000 7fca35c00700 1 --2- 172.21.15.2:0/3730315171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca30102a70 0x7fca3019ad90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fca2000eb30 tx=0x7fca2000ee40 comp rx=0 tx=0).stop 2024-06-13T11:35:59.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.620+0000 7fca35c00700 1 -- 172.21.15.2:0/3730315171 shutdown_connections 2024-06-13T11:35:59.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.620+0000 7fca35c00700 1 --2- 172.21.15.2:0/3730315171 >> [v2:172.21.15.2:6800/606530635,v1:172.21.15.2:6801/606530635] conn(0x7fca140a2e10 0x7fca140a52d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:59.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.620+0000 7fca35c00700 1 --2- 172.21.15.2:0/3730315171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca30107ab0 0x7fca3019f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:59.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.620+0000 7fca35c00700 1 --2- 172.21.15.2:0/3730315171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca30102a70 0x7fca3019ad90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:59.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.620+0000 7fca35c00700 1 --2- 172.21.15.2:0/3730315171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca301070f0 0x7fca3019b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T11:35:59.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.620+0000 7fca35c00700 1 -- 172.21.15.2:0/3730315171 >> 172.21.15.2:0/3730315171 conn(0x7fca3007a420 msgr2=0x7fca30100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T11:35:59.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.621+0000 7fca35c00700 1 -- 172.21.15.2:0/3730315171 shutdown_connections 2024-06-13T11:35:59.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T11:35:59.621+0000 7fca35c00700 1 -- 172.21.15.2:0/3730315171 wait complete. 2024-06-13T11:35:59.622 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data_ec' removed 2024-06-13T11:35:59.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:59 smithi002 ceph-mon[32210]: pgmap v382: 33 pgs: 33 active+clean; 26 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:35:59.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:59 smithi002 ceph-mon[32210]: from='client.? 172.21.15.2:0/3730315171' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:35:59.896 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:35:59 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:35:59.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:59 smithi178 ceph-mon[36913]: pgmap v382: 33 pgs: 33 active+clean; 26 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:35:59.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:59 smithi178 ceph-mon[36913]: from='client.? 172.21.15.2:0/3730315171' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:35:59.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:35:59 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:36:00.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:59 smithi077 ceph-mon[36410]: pgmap v382: 33 pgs: 33 active+clean; 26 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T11:36:00.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:59 smithi077 ceph-mon[36410]: from='client.? 172.21.15.2:0/3730315171' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:36:00.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:35:59 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T11:36:00.396 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:36:00 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:36:00.214+0000 7fd078800700 -1 client.25192: SimpleRADOSStriper: lock: snap_db_v0.db: lock failed: (2) No such file or directory 2024-06-13T11:36:00.396 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:36:00 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:36:00.221+0000 7fd078800700 -1 client.25192: SimpleRADOSStriper: lock: snap_db_v0.db: lock failed: (2) No such file or directory 2024-06-13T11:36:00.470 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-13T11:36:00.567 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-13T11:36:00.599 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-13T11:36:00.632 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-06-13T11:36:00.632 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-13T11:36:00.696 DEBUG:teuthology.orchestra.run.smithi077:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-13T11:36:00.713 DEBUG:teuthology.orchestra.run.smithi178:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-13T11:36:00.731 INFO:tasks.cephadm:Stopping all daemons... 2024-06-13T11:36:00.731 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-06-13T11:36:00.731 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mon.a 2024-06-13T11:36:00.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:36:00 smithi002 ceph-mon[32210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T11:36:00.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:36:00 smithi002 ceph-mon[32210]: osdmap e114: 12 total, 12 up, 12 in 2024-06-13T11:36:00.946 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:36:00 smithi178 ceph-mon[36913]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T11:36:00.947 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:36:00 smithi178 ceph-mon[36913]: osdmap e114: 12 total, 12 up, 12 in 2024-06-13T11:36:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:36:00 smithi077 ceph-mon[36410]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T11:36:01.040 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:36:00 smithi077 ceph-mon[36410]: osdmap e114: 12 total, 12 up, 12 in 2024-06-13T11:36:01.145 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:36:00 smithi002 systemd[1]: Stopping Ceph mon.a for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:36:01.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:36:01 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a[32206]: 2024-06-13T11:36:01.331+0000 7f18be200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:36:01.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:36:01 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a[32206]: 2024-06-13T11:36:01.331+0000 7f18be200700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-06-13T11:36:01.646 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:36:01 smithi002 podman[119237]: 2024-06-13 11:36:01.508333739 +0000 UTC m=+0.318216534 container died 1e16928c773b1282405e332223cd653c2f6dd7122075faf6cbe7f59b91600652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528) 2024-06-13T11:36:02.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:36:01 smithi002 podman[119237]: 2024-06-13 11:36:01.983504316 +0000 UTC m=+0.793387074 container cleanup 1e16928c773b1282405e332223cd653c2f6dd7122075faf6cbe7f59b91600652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-06-13T11:36:02.146 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:36:01 smithi002 bash[119237]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a 2024-06-13T11:36:02.645 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 11:36:02 smithi002 podman[119251]: 2024-06-13 11:36:02.244916476 +0000 UTC m=+0.714558110 container remove 1e16928c773b1282405e332223cd653c2f6dd7122075faf6cbe7f59b91600652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-a, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-06-13T11:36:02.772 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mon.a.service' 2024-06-13T11:36:02.908 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:36:02.909 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-06-13T11:36:02.909 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-06-13T11:36:02.909 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mon.b 2024-06-13T11:36:03.232 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:36:02 smithi077 systemd[1]: Stopping Ceph mon.b for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:36:03.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:36:03 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-b[36406]: 2024-06-13T11:36:03.232+0000 7f55dc565700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:36:03.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:36:03 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-b[36406]: 2024-06-13T11:36:03.232+0000 7f55dc565700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-06-13T11:36:03.540 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:36:03 smithi077 podman[73027]: 2024-06-13 11:36:03.254039932 +0000 UTC m=+0.144185453 container died 6d9175ddbfb3042f56af4c41cb3ad429372c23e9d1804622731380fb1d5e0e07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2) 2024-06-13T11:36:03.893 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:36:03 smithi077 podman[73027]: 2024-06-13 11:36:03.65111916 +0000 UTC m=+0.541264669 container cleanup 6d9175ddbfb3042f56af4c41cb3ad429372c23e9d1804622731380fb1d5e0e07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T11:36:03.893 INFO:journalctl@ceph.mon.b.smithi077.stdout:Jun 13 11:36:03 smithi077 bash[73027]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-b 2024-06-13T11:36:04.029 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mon.b.service' 2024-06-13T11:36:04.082 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:36:04.082 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-06-13T11:36:04.082 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-06-13T11:36:04.083 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mon.c 2024-06-13T11:36:04.418 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:36:04 smithi178 systemd[1]: Stopping Ceph mon.c for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:36:04.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:36:04 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-c[36895]: 2024-06-13T11:36:04.416+0000 7f6ff365f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:36:04.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:36:04 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-c[36895]: 2024-06-13T11:36:04.416+0000 7f6ff365f700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-06-13T11:36:04.697 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:36:04 smithi178 podman[75002]: 2024-06-13 11:36:04.60174882 +0000 UTC m=+0.320431506 container died 3394830722fca6061a684a98778e8eff09ec44819365830261553f8ac31b7c13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-13T11:36:05.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:36:05 smithi178 podman[75002]: 2024-06-13 11:36:05.027134423 +0000 UTC m=+0.745817106 container cleanup 3394830722fca6061a684a98778e8eff09ec44819365830261553f8ac31b7c13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-06-13T11:36:05.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:36:05 smithi178 bash[75002]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-c 2024-06-13T11:36:05.501 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 13 11:36:05 smithi178 podman[75014]: 2024-06-13 11:36:05.245451628 +0000 UTC m=+0.637990954 container remove 3394830722fca6061a684a98778e8eff09ec44819365830261553f8ac31b7c13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mon-c, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T11:36:05.505 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mon.c.service' 2024-06-13T11:36:05.553 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:36:05.554 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-06-13T11:36:05.554 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-06-13T11:36:05.554 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mgr.x 2024-06-13T11:36:05.896 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:36:05 smithi002 systemd[1]: Stopping Ceph mgr.x for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:36:06.593 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:36:06 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:36:06.162+0000 7fd14b000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:36:06.594 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:36:06 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x[32439]: 2024-06-13T11:36:06.162+0000 7fd14b000700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-06-13T11:36:06.594 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:36:06 smithi002 podman[119356]: 2024-06-13 11:36:06.277608975 +0000 UTC m=+0.259393982 container died 98d7585ac6f823ff17cb17ae86602aaeee18e485456979ff372a84eb0dfade3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T11:36:06.895 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:36:06 smithi002 podman[119356]: 2024-06-13 11:36:06.797753134 +0000 UTC m=+0.779538061 container cleanup 98d7585ac6f823ff17cb17ae86602aaeee18e485456979ff372a84eb0dfade3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:36:06.896 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:36:06 smithi002 bash[119356]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x 2024-06-13T11:36:07.312 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 11:36:06 smithi002 podman[119370]: 2024-06-13 11:36:06.998535464 +0000 UTC m=+0.706693224 container remove 98d7585ac6f823ff17cb17ae86602aaeee18e485456979ff372a84eb0dfade3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:36:07.462 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mgr.x.service' 2024-06-13T11:36:07.577 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:36:07.577 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-06-13T11:36:07.578 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-06-13T11:36:07.578 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mgr.y 2024-06-13T11:36:08.040 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:36:07 smithi077 systemd[1]: Stopping Ceph mgr.y for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:36:08.311 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:36:08 smithi077 podman[73148]: 2024-06-13 11:36:08.103918601 +0000 UTC m=+0.332041765 container died 21341fdae483de4a588b0f88a8c7817e8f2693465faece328fbf97aacb45e31a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-3d89acc, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0) 2024-06-13T11:36:08.882 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:36:08 smithi077 podman[73148]: 2024-06-13 11:36:08.589768487 +0000 UTC m=+0.817891641 container cleanup 21341fdae483de4a588b0f88a8c7817e8f2693465faece328fbf97aacb45e31a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-06-13T11:36:08.882 INFO:journalctl@ceph.mgr.y.smithi077.stdout:Jun 13 11:36:08 smithi077 bash[73148]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-y 2024-06-13T11:36:09.025 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mgr.y.service' 2024-06-13T11:36:09.060 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:36:09.061 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-06-13T11:36:09.061 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-06-13T11:36:09.061 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mgr.z 2024-06-13T11:36:09.392 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:36:09 smithi178 systemd[1]: Stopping Ceph mgr.z for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:36:09.697 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:36:09 smithi178 podman[75126]: 2024-06-13 11:36:09.393692602 +0000 UTC m=+0.142680576 container died 6cbea389b2bef336218624bb7d0edef1b6349cb10739a7843bc8d6d51fb5e7a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-13T11:36:10.057 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:36:09 smithi178 podman[75126]: 2024-06-13 11:36:09.835791514 +0000 UTC m=+0.584779488 container cleanup 6cbea389b2bef336218624bb7d0edef1b6349cb10739a7843bc8d6d51fb5e7a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux ) 2024-06-13T11:36:10.058 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:36:09 smithi178 bash[75126]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z 2024-06-13T11:36:10.315 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:36:10 smithi178 podman[75137]: 2024-06-13 11:36:10.058986494 +0000 UTC m=+0.660036997 container remove 6cbea389b2bef336218624bb7d0edef1b6349cb10739a7843bc8d6d51fb5e7a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-06-13T11:36:10.316 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 13 11:36:10 smithi178 systemd[1]: ceph-3611563c-2975-11ef-bc9c-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-06-13T11:36:10.320 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mgr.z.service' 2024-06-13T11:36:10.352 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:36:10.352 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-06-13T11:36:10.353 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-06-13T11:36:10.353 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.0 2024-06-13T11:36:10.896 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:36:10 smithi002 systemd[1]: Stopping Ceph osd.0 for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:36:11.396 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:36:10 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-0[46524]: 2024-06-13T11:36:10.940+0000 7efc79800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:36:11.396 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:36:10 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-0[46524]: 2024-06-13T11:36:10.940+0000 7efc79800700 -1 osd.0 114 *** Got signal Terminated *** 2024-06-13T11:36:11.396 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:36:10 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-0[46524]: 2024-06-13T11:36:10.940+0000 7efc79800700 -1 osd.0 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T11:36:16.646 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:36:16 smithi002 podman[119479]: 2024-06-13 11:36:16.354052181 +0000 UTC m=+5.551200104 container died 23feef7f718bdf4bea1906f7708961a201ad4b25cf1dc5da8e2395e995eb8b07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD) 2024-06-13T11:36:17.103 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:36:16 smithi002 podman[119479]: 2024-06-13 11:36:16.802143285 +0000 UTC m=+5.999291259 container cleanup 23feef7f718bdf4bea1906f7708961a201ad4b25cf1dc5da8e2395e995eb8b07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-0, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2) 2024-06-13T11:36:17.103 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:36:16 smithi002 bash[119479]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-0 2024-06-13T11:36:17.395 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:36:17 smithi002 podman[119496]: 2024-06-13 11:36:17.103418945 +0000 UTC m=+0.730724085 container remove 23feef7f718bdf4bea1906f7708961a201ad4b25cf1dc5da8e2395e995eb8b07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD) 2024-06-13T11:36:18.396 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:36:18 smithi002 podman[119587]: 2024-06-13 11:36:17.934177053 +0000 UTC m=+0.037906207 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:36:18.396 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:36:18 smithi002 podman[119587]: 2024-06-13 11:36:18.071089978 +0000 UTC m=+0.174819159 container create be34564ca08e27672dff2a13967dfadf00e104800a7f85aa81cbdca5a1090abd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc) 2024-06-13T11:36:18.896 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:36:18 smithi002 podman[119587]: 2024-06-13 11:36:18.416835769 +0000 UTC m=+0.520565003 container init be34564ca08e27672dff2a13967dfadf00e104800a7f85aa81cbdca5a1090abd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T11:36:18.896 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:36:18 smithi002 podman[119587]: 2024-06-13 11:36:18.428635933 +0000 UTC m=+0.532365141 container start be34564ca08e27672dff2a13967dfadf00e104800a7f85aa81cbdca5a1090abd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.schema-version=1.0) 2024-06-13T11:36:18.896 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:36:18 smithi002 podman[119587]: 2024-06-13 11:36:18.523701197 +0000 UTC m=+0.627430385 container attach be34564ca08e27672dff2a13967dfadf00e104800a7f85aa81cbdca5a1090abd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-06-13T11:36:19.189 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 11:36:18 smithi002 podman[119587]: 2024-06-13 11:36:18.913212413 +0000 UTC m=+1.016941630 container died be34564ca08e27672dff2a13967dfadf00e104800a7f85aa81cbdca5a1090abd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-06-13T11:36:19.580 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.0.service' 2024-06-13T11:36:19.701 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:36:19.702 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-06-13T11:36:19.702 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-06-13T11:36:19.702 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.1 2024-06-13T11:36:20.010 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:36:19 smithi077 systemd[1]: Stopping Ceph osd.1 for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:36:20.290 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:36:20 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-1[40966]: 2024-06-13T11:36:20.010+0000 7fd252c0c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:36:20.290 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:36:20 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-1[40966]: 2024-06-13T11:36:20.010+0000 7fd252c0c700 -1 osd.1 114 *** Got signal Terminated *** 2024-06-13T11:36:20.290 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:36:20 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-1[40966]: 2024-06-13T11:36:20.010+0000 7fd252c0c700 -1 osd.1 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T11:36:25.711 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:36:25 smithi077 podman[73283]: 2024-06-13 11:36:25.406707136 +0000 UTC m=+5.511048045 container died 9e5d0aa1d3db89172811d13df380a1e1c67f1afeeb163afad8b9cbfaf22a1d1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, ceph=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-06-13T11:36:26.040 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:36:25 smithi077 podman[73283]: 2024-06-13 11:36:25.828110786 +0000 UTC m=+5.932451694 container cleanup 9e5d0aa1d3db89172811d13df380a1e1c67f1afeeb163afad8b9cbfaf22a1d1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-1, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD) 2024-06-13T11:36:26.040 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:36:25 smithi077 bash[73283]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-1 2024-06-13T11:36:26.501 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:36:26 smithi077 podman[73299]: 2024-06-13 11:36:26.088461558 +0000 UTC m=+0.678714298 container remove 9e5d0aa1d3db89172811d13df380a1e1c67f1afeeb163afad8b9cbfaf22a1d1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-1, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-06-13T11:36:26.774 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:36:26 smithi077 podman[73389]: 2024-06-13 11:36:26.405699677 +0000 UTC m=+0.017046730 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:36:26.774 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:36:26 smithi077 podman[73389]: 2024-06-13 11:36:26.522669278 +0000 UTC m=+0.134016364 container create 8106bd8b871b5c30db2d384e0b27962abe88828421b4b2ff8751790e497b8755 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.build-date=20240528, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T11:36:26.775 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:36:26 smithi077 podman[73389]: 2024-06-13 11:36:26.775828459 +0000 UTC m=+0.387175520 container init 8106bd8b871b5c30db2d384e0b27962abe88828421b4b2ff8751790e497b8755 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-06-13T11:36:27.040 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:36:26 smithi077 podman[73389]: 2024-06-13 11:36:26.779322723 +0000 UTC m=+0.390669768 container start 8106bd8b871b5c30db2d384e0b27962abe88828421b4b2ff8751790e497b8755 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-06-13T11:36:27.040 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:36:26 smithi077 podman[73389]: 2024-06-13 11:36:26.858807343 +0000 UTC m=+0.470154419 container attach 8106bd8b871b5c30db2d384e0b27962abe88828421b4b2ff8751790e497b8755 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-06-13T11:36:27.357 INFO:journalctl@ceph.osd.1.smithi077.stdout:Jun 13 11:36:27 smithi077 podman[73389]: 2024-06-13 11:36:27.078763132 +0000 UTC m=+0.690110177 container died 8106bd8b871b5c30db2d384e0b27962abe88828421b4b2ff8751790e497b8755 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-1-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-06-13T11:36:27.831 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.1.service' 2024-06-13T11:36:27.868 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:36:27.869 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-06-13T11:36:27.869 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-06-13T11:36:27.869 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.2 2024-06-13T11:36:28.162 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:36:27 smithi178 systemd[1]: Stopping Ceph osd.2 for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:36:28.447 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:36:28 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-2[42188]: 2024-06-13T11:36:28.163+0000 7fd14279f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:36:28.447 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:36:28 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-2[42188]: 2024-06-13T11:36:28.163+0000 7fd14279f700 -1 osd.2 114 *** Got signal Terminated *** 2024-06-13T11:36:28.447 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:36:28 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-2[42188]: 2024-06-13T11:36:28.163+0000 7fd14279f700 -1 osd.2 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T11:36:33.879 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:36:33 smithi178 podman[75263]: 2024-06-13 11:36:33.576493443 +0000 UTC m=+5.503578035 container died 4fe4f0e9845ead118f02c897f791d2962dc271171cdbc07ff6d4ecf77f44215d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-06-13T11:36:34.197 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:36:33 smithi178 podman[75263]: 2024-06-13 11:36:33.988188646 +0000 UTC m=+5.915273247 container cleanup 4fe4f0e9845ead118f02c897f791d2962dc271171cdbc07ff6d4ecf77f44215d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc) 2024-06-13T11:36:34.197 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:36:33 smithi178 bash[75263]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-2 2024-06-13T11:36:34.663 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:36:34 smithi178 podman[75282]: 2024-06-13 11:36:34.223122541 +0000 UTC m=+0.645265859 container remove 4fe4f0e9845ead118f02c897f791d2962dc271171cdbc07ff6d4ecf77f44215d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-06-13T11:36:34.947 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:36:34 smithi178 podman[75367]: 2024-06-13 11:36:34.567549654 +0000 UTC m=+0.017276206 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:36:34.947 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:36:34 smithi178 podman[75367]: 2024-06-13 11:36:34.6907736 +0000 UTC m=+0.140500133 container create aedad788c0cadd8e369a98e08b928b33180c6759cd97e167c2b6c352a3cf3cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-06-13T11:36:34.947 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:36:34 smithi178 podman[75367]: 2024-06-13 11:36:34.901448779 +0000 UTC m=+0.351175327 container init aedad788c0cadd8e369a98e08b928b33180c6759cd97e167c2b6c352a3cf3cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T11:36:34.947 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:36:34 smithi178 podman[75367]: 2024-06-13 11:36:34.904624512 +0000 UTC m=+0.354351046 container start aedad788c0cadd8e369a98e08b928b33180c6759cd97e167c2b6c352a3cf3cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-06-13T11:36:35.198 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:36:34 smithi178 podman[75367]: 2024-06-13 11:36:34.98498566 +0000 UTC m=+0.434712207 container attach aedad788c0cadd8e369a98e08b928b33180c6759cd97e167c2b6c352a3cf3cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-06-13T11:36:35.468 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 13 11:36:35 smithi178 podman[75367]: 2024-06-13 11:36:35.200270647 +0000 UTC m=+0.649997186 container died aedad788c0cadd8e369a98e08b928b33180c6759cd97e167c2b6c352a3cf3cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-06-13T11:36:35.889 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.2.service' 2024-06-13T11:36:35.926 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:36:35.926 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-06-13T11:36:35.927 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-06-13T11:36:35.927 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.3 2024-06-13T11:36:36.395 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:36:36 smithi002 systemd[1]: Stopping Ceph osd.3 for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:36:36.866 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:36:36 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-3[53449]: 2024-06-13T11:36:36.492+0000 7fc884400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:36:36.867 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:36:36 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-3[53449]: 2024-06-13T11:36:36.492+0000 7fc884400700 -1 osd.3 114 *** Got signal Terminated *** 2024-06-13T11:36:36.867 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:36:36 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-3[53449]: 2024-06-13T11:36:36.492+0000 7fc884400700 -1 osd.3 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T11:36:38.197 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:37 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:37.908+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:38.947 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:38 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:38.908+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:38.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:38 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:38.659+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:39.067 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:38 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:38.969+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:39.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:39 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:39.631+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:40.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:40 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:40.006+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:40.395 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:36:40 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-3[53449]: 2024-06-13T11:36:40.070+0000 7fc87fc00700 -1 osd.3 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.291121+0000 front 2024-06-13T11:36:15.291614+0000 (oldest deadline 2024-06-13T11:36:39.391146+0000) 2024-06-13T11:36:40.446 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:39 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:39.954+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:40.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:40 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:40.621+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:41.035 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:40 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:40.676+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:41.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:41.017+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:41.395 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:36:41 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-3[53449]: 2024-06-13T11:36:41.035+0000 7fc87fc00700 -1 osd.3 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.291121+0000 front 2024-06-13T11:36:15.291614+0000 (oldest deadline 2024-06-13T11:36:39.391146+0000) 2024-06-13T11:36:41.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:40 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:40.959+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:41.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:41.604+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:42.142 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:36:41 smithi002 podman[119691]: 2024-06-13 11:36:41.853382213 +0000 UTC m=+5.499632378 container died 54dc1f4f2920d7d8cb0d456ff88466377122ec4b09d98f7b139cf11f6e7a7258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528) 2024-06-13T11:36:42.143 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:41 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:41.654+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:42.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:41.982+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:42.395 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:36:42 smithi002 podman[119691]: 2024-06-13 11:36:42.354063127 +0000 UTC m=+6.000313248 container cleanup 54dc1f4f2920d7d8cb0d456ff88466377122ec4b09d98f7b139cf11f6e7a7258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T11:36:42.395 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:36:42 smithi002 bash[119691]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-3 2024-06-13T11:36:42.446 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:41.948+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:42.671 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:42 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:42.646+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:42.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:42 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:42.577+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:43.145 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:36:42 smithi002 podman[119720]: 2024-06-13 11:36:42.672166894 +0000 UTC m=+0.801384757 container remove 54dc1f4f2920d7d8cb0d456ff88466377122ec4b09d98f7b139cf11f6e7a7258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-06-13T11:36:43.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:42 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:42.950+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:43.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:42 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:42.981+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:43.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:43 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:43.671+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:43.896 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:36:43 smithi002 podman[119806]: 2024-06-13 11:36:43.482145751 +0000 UTC m=+0.037232756 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:36:43.896 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:36:43 smithi002 podman[119806]: 2024-06-13 11:36:43.606753853 +0000 UTC m=+0.161840880 container create 191eccd351de06939931d7ba85e2ed1b1ebebae60b43a57cff340711572fc47d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-3-deactivate, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T11:36:43.946 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:43 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:43.598+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:44.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:43 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:43.942+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:44.396 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:36:44 smithi002 podman[119806]: 2024-06-13 11:36:44.03504037 +0000 UTC m=+0.590127404 container init 191eccd351de06939931d7ba85e2ed1b1ebebae60b43a57cff340711572fc47d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528) 2024-06-13T11:36:44.396 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:36:44 smithi002 podman[119806]: 2024-06-13 11:36:44.046191094 +0000 UTC m=+0.601278138 container start 191eccd351de06939931d7ba85e2ed1b1ebebae60b43a57cff340711572fc47d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, io.buildah.version=1.33.5) 2024-06-13T11:36:44.396 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:36:44 smithi002 podman[119806]: 2024-06-13 11:36:44.142578128 +0000 UTC m=+0.697665208 container attach 191eccd351de06939931d7ba85e2ed1b1ebebae60b43a57cff340711572fc47d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, ceph=True) 2024-06-13T11:36:44.446 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:43 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:43.953+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:44.807 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:44 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:44.631+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:44.807 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 11:36:44 smithi002 podman[119806]: 2024-06-13 11:36:44.514643227 +0000 UTC m=+1.069730284 container died 191eccd351de06939931d7ba85e2ed1b1ebebae60b43a57cff340711572fc47d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, ceph=True) 2024-06-13T11:36:44.920 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:44 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:44.596+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:45.197 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:44 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:44.920+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:45.253 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.3.service' 2024-06-13T11:36:45.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:44 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:44.910+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:45.374 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:36:45.374 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-06-13T11:36:45.375 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-06-13T11:36:45.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.4 2024-06-13T11:36:45.706 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:45 smithi077 systemd[1]: Stopping Ceph osd.4 for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:36:45.903 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:45 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:45.599+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:46.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:45 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:45.922+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:46.040 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:45 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4[47483]: 2024-06-13T11:36:45.706+0000 7f9f09729700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:36:46.040 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:45 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4[47483]: 2024-06-13T11:36:45.706+0000 7f9f09729700 -1 osd.4 114 *** Got signal Terminated *** 2024-06-13T11:36:46.041 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:45 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4[47483]: 2024-06-13T11:36:45.706+0000 7f9f09729700 -1 osd.4 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T11:36:46.145 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:45 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:45.681+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:46.197 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:45 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:45.963+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:46.642 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:46 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:46.347+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:36:46.790 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:46 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4[47483]: 2024-06-13T11:36:46.510+0000 7f9f01d15700 -1 osd.4 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.649420+0000 front 2024-06-13T11:36:22.649440+0000 (oldest deadline 2024-06-13T11:36:45.549647+0000) 2024-06-13T11:36:46.895 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:46 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:46.641+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:46.939 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:46 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:46.632+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:46.939 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:46 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:46.632+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.776547+0000 front 2024-06-13T11:36:21.776524+0000 (oldest deadline 2024-06-13T11:36:45.876632+0000) 2024-06-13T11:36:47.196 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:46 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:46.939+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:47.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:46 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:46.888+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:47.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:46 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:46.888+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:36:47.646 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:47 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:47.392+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:36:47.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:47 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:47.602+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:47.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:47 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:47.602+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:36:47.790 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:47 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4[47483]: 2024-06-13T11:36:47.525+0000 7f9f01d15700 -1 osd.4 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.649420+0000 front 2024-06-13T11:36:22.649440+0000 (oldest deadline 2024-06-13T11:36:45.549647+0000) 2024-06-13T11:36:47.946 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:47 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:47.906+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:47.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:47 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:47.670+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:47.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:47 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:47.670+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.776547+0000 front 2024-06-13T11:36:21.776524+0000 (oldest deadline 2024-06-13T11:36:45.876632+0000) 2024-06-13T11:36:48.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:47 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:47.932+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:48.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:47 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:47.932+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:36:48.645 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:48 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:48.370+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:36:48.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:48 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:48.603+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:48.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:48 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:48.603+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:36:48.696 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:36:48 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:36:48.252+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:36:48.790 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:48 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4[47483]: 2024-06-13T11:36:48.481+0000 7f9f01d15700 -1 osd.4 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.649420+0000 front 2024-06-13T11:36:22.649440+0000 (oldest deadline 2024-06-13T11:36:45.549647+0000) 2024-06-13T11:36:48.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:48 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:48.483+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:36:48.947 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:48 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:48.862+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:48.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:48 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:48.697+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:48.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:48 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:48.697+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.776547+0000 front 2024-06-13T11:36:21.776524+0000 (oldest deadline 2024-06-13T11:36:45.876632+0000) 2024-06-13T11:36:49.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:48 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:48.952+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:49.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:48 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:48.952+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:36:49.630 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:49 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:49.372+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:36:49.697 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:36:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:36:49.296+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:36:49.790 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:49 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4[47483]: 2024-06-13T11:36:49.468+0000 7f9f01d15700 -1 osd.4 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.649420+0000 front 2024-06-13T11:36:22.649440+0000 (oldest deadline 2024-06-13T11:36:45.549647+0000) 2024-06-13T11:36:49.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:49 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:49.494+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:36:49.895 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:49 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:49.630+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:49.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:49 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:49.630+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:36:50.197 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:49.896+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:50.197 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:49.699+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:50.197 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:49.699+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.776547+0000 front 2024-06-13T11:36:21.776524+0000 (oldest deadline 2024-06-13T11:36:45.876632+0000) 2024-06-13T11:36:50.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:49 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:49.956+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:50.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:49 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:49.956+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:36:50.645 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:50 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:50.348+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:36:50.652 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:36:50 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:36:50.256+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:36:50.790 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:50 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4[47483]: 2024-06-13T11:36:50.450+0000 7f9f01d15700 -1 osd.4 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.649420+0000 front 2024-06-13T11:36:22.649440+0000 (oldest deadline 2024-06-13T11:36:45.549647+0000) 2024-06-13T11:36:50.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:50 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:50.541+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:36:50.947 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:50 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:50.870+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:50.947 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:50 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:50.870+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:36:50.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:50 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:50.653+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:50.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:50 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:50.653+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.776547+0000 front 2024-06-13T11:36:21.776524+0000 (oldest deadline 2024-06-13T11:36:45.876632+0000) 2024-06-13T11:36:51.145 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:50 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:50.677+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:51.146 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:50 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:50.677+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:36:51.290 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:51 smithi077 podman[73519]: 2024-06-13 11:36:51.177638172 +0000 UTC m=+5.594217799 container died 813c5ffc489b8696dccccc1a7aaeec79fee1b42ac2987e89c7ca1246b9e8abd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4, RELEASE=squid-3d89acc, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-06-13T11:36:51.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:50 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:50.937+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:51.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:50 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:50.937+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:36:51.645 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:51 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:51.316+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:36:51.654 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:36:51 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:36:51.242+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:36:51.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:51 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:51.500+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:36:51.790 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:51 smithi077 podman[73519]: 2024-06-13 11:36:51.565926205 +0000 UTC m=+5.982505835 container cleanup 813c5ffc489b8696dccccc1a7aaeec79fee1b42ac2987e89c7ca1246b9e8abd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-06-13T11:36:51.790 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:51 smithi077 bash[73519]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4 2024-06-13T11:36:51.947 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:51 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:51.881+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:51.947 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:51 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:51.881+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:36:51.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:51 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:51.655+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:51.948 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:51 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:51.655+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.776547+0000 front 2024-06-13T11:36:21.776524+0000 (oldest deadline 2024-06-13T11:36:45.876632+0000) 2024-06-13T11:36:52.146 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:51 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:51.662+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:52.146 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:51 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:51.662+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:36:52.192 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:51 smithi077 podman[73535]: 2024-06-13 11:36:51.867241889 +0000 UTC m=+0.678742811 container remove 813c5ffc489b8696dccccc1a7aaeec79fee1b42ac2987e89c7ca1246b9e8abd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-06-13T11:36:52.192 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:51 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:51.930+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:52.192 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:51 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:51.930+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:36:52.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:36:52 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:36:52.193+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:36:52.469 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:52 smithi077 podman[73624]: 2024-06-13 11:36:52.096365518 +0000 UTC m=+0.016737109 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:36:52.469 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:52 smithi077 podman[73624]: 2024-06-13 11:36:52.209834996 +0000 UTC m=+0.130206631 container create bcaab8fe8232539710d178e175be4aad83715ae10b978b0bcef238c9038db77c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-06-13T11:36:52.469 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:52 smithi077 podman[73624]: 2024-06-13 11:36:52.471037862 +0000 UTC m=+0.391409454 container init bcaab8fe8232539710d178e175be4aad83715ae10b978b0bcef238c9038db77c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc) 2024-06-13T11:36:52.613 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:52 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:52.350+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:36:52.765 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:52 smithi077 podman[73624]: 2024-06-13 11:36:52.474209015 +0000 UTC m=+0.394580614 container start bcaab8fe8232539710d178e175be4aad83715ae10b978b0bcef238c9038db77c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:36:52.766 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:52 smithi077 podman[73624]: 2024-06-13 11:36:52.578961782 +0000 UTC m=+0.499333392 container attach bcaab8fe8232539710d178e175be4aad83715ae10b978b0bcef238c9038db77c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD) 2024-06-13T11:36:52.766 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:52 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:52.536+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:36:52.895 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:52 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:52.614+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:52.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:52 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:52.614+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:36:52.946 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:52 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:52.897+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:52.947 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:52 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:52.897+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:36:52.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:52 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:52.671+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:52.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:52 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:52.671+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.776547+0000 front 2024-06-13T11:36:21.776524+0000 (oldest deadline 2024-06-13T11:36:45.876632+0000) 2024-06-13T11:36:53.040 INFO:journalctl@ceph.osd.4.smithi077.stdout:Jun 13 11:36:52 smithi077 podman[73624]: 2024-06-13 11:36:52.767256957 +0000 UTC m=+0.687628562 container died bcaab8fe8232539710d178e175be4aad83715ae10b978b0bcef238c9038db77c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-06-13T11:36:53.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:52 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:52.936+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:53.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:52 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:52.936+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:36:53.401 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.4.service' 2024-06-13T11:36:53.440 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:36:53.440 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-06-13T11:36:53.441 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-06-13T11:36:53.441 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.5 2024-06-13T11:36:53.632 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:53 smithi178 systemd[1]: Stopping Ceph osd.5 for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:36:53.632 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:36:53 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:36:53.236+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:36:53.645 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:53 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:53.379+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:36:53.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:53 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:53.542+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:36:53.947 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:53 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:53.870+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:53.947 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:53 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:53.870+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:36:53.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:53 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:53.632+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:53.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:53 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:53.632+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.776547+0000 front 2024-06-13T11:36:21.776524+0000 (oldest deadline 2024-06-13T11:36:45.876632+0000) 2024-06-13T11:36:53.948 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:53 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:53.749+0000 7fbafd8ff700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:36:53.948 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:53 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:53.749+0000 7fbafd8ff700 -1 osd.5 114 *** Got signal Terminated *** 2024-06-13T11:36:53.948 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:53 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:53.749+0000 7fbafd8ff700 -1 osd.5 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T11:36:54.145 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:53 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:53.659+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:54.145 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:53 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:53.659+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:36:54.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:53 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:53.903+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:54.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:53 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:53.903+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:36:54.619 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:36:54 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:36:54.263+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:36:54.677 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:54 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:54.619+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:54.677 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:54 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:54.619+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:36:54.678 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:54 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:54.417+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:36:54.678 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:54 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:54.417+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.436189+0000 front 2024-06-13T11:36:31.436286+0000 (oldest deadline 2024-06-13T11:36:53.735824+0000) 2024-06-13T11:36:54.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:54 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:54.518+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:36:54.906 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:54 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:54.620+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:54.906 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:54 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:54.620+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.776547+0000 front 2024-06-13T11:36:21.776524+0000 (oldest deadline 2024-06-13T11:36:45.876632+0000) 2024-06-13T11:36:55.196 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:54 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:54.906+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:55.197 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:54 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:54.906+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:36:55.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:54 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:54.897+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:55.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:54 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:54.897+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:36:55.635 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:36:55 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:36:55.236+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:36:55.645 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:55.379+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:36:55.645 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:55.379+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.436189+0000 front 2024-06-13T11:36:31.436286+0000 (oldest deadline 2024-06-13T11:36:53.735824+0000) 2024-06-13T11:36:55.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:55.602+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:55.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:55.602+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:36:55.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:55 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:55.602+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:36:55.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:55 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:55.535+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:36:55.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:55 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:55.535+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:36:55.945 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:55 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:55.636+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:55.946 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:55 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:55.636+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.776547+0000 front 2024-06-13T11:36:21.776524+0000 (oldest deadline 2024-06-13T11:36:45.876632+0000) 2024-06-13T11:36:55.946 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:55 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:55.636+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.878312+0000 front 2024-06-13T11:36:29.878376+0000 (oldest deadline 2024-06-13T11:36:55.178461+0000) 2024-06-13T11:36:56.197 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:55 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:55.945+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:56.197 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:55 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:55.945+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:36:56.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:55 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:55.895+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:56.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:55 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:55.895+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:36:56.591 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:56 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:56.337+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:36:56.591 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:56 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:56.337+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.436189+0000 front 2024-06-13T11:36:31.436286+0000 (oldest deadline 2024-06-13T11:36:53.735824+0000) 2024-06-13T11:36:56.673 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:36:56 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:36:56.264+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:36:56.673 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:36:56 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:36:56.264+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:36:56.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:56 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:56.486+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:36:56.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:56 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:56.486+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:36:56.895 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:56 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:56.591+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:56.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:56 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:56.591+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:36:56.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:56 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:56.591+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:36:56.941 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:56 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:56.673+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:56.941 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:56 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:56.673+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.776547+0000 front 2024-06-13T11:36:21.776524+0000 (oldest deadline 2024-06-13T11:36:45.876632+0000) 2024-06-13T11:36:56.941 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:56 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:56.673+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.878312+0000 front 2024-06-13T11:36:29.878376+0000 (oldest deadline 2024-06-13T11:36:55.178461+0000) 2024-06-13T11:36:57.197 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:56 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:56.941+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:57.197 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:56 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:56.941+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:36:57.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:56 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:56.870+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:57.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:56 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:56.870+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:36:57.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:56 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:56.870+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:36:57.646 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:57 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:57.328+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:36:57.646 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:57 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:57.328+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.436189+0000 front 2024-06-13T11:36:31.436286+0000 (oldest deadline 2024-06-13T11:36:53.735824+0000) 2024-06-13T11:36:57.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:57 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:57.558+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:57.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:57 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:57.558+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:36:57.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:57 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:57.558+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:36:57.652 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:36:57 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:36:57.265+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:36:57.653 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:36:57 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:36:57.265+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:36:57.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:57 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:57.488+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:36:57.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:57 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:57.488+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:36:57.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:57 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:57.653+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:57.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:57 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:57.653+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.776547+0000 front 2024-06-13T11:36:21.776524+0000 (oldest deadline 2024-06-13T11:36:45.876632+0000) 2024-06-13T11:36:57.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:57 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:57.653+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.878312+0000 front 2024-06-13T11:36:29.878376+0000 (oldest deadline 2024-06-13T11:36:55.178461+0000) 2024-06-13T11:36:58.242 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:57 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:57.990+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:58.243 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:57 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:57.990+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:36:58.243 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:57 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:57.990+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:36:58.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:57 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:57.900+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:58.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:57 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:57.900+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:36:58.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:57 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:57.900+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:36:58.607 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:36:58 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:36:58.242+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:36:58.607 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:36:58 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:36:58.242+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:36:58.646 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:58 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:58.369+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:36:58.646 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:58 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:58.369+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.436189+0000 front 2024-06-13T11:36:31.436286+0000 (oldest deadline 2024-06-13T11:36:53.735824+0000) 2024-06-13T11:36:58.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:58 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:58.598+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:58.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:58 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:58.598+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:36:58.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:58 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:58.598+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:36:58.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:58 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:58.458+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:36:58.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:58 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:58.458+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:36:58.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:58 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:58.608+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.975538+0000 front 2024-06-13T11:36:12.975807+0000 (oldest deadline 2024-06-13T11:36:38.275329+0000) 2024-06-13T11:36:58.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:58 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:58.608+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.776547+0000 front 2024-06-13T11:36:21.776524+0000 (oldest deadline 2024-06-13T11:36:45.876632+0000) 2024-06-13T11:36:58.947 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:58 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5[49098]: 2024-06-13T11:36:58.608+0000 7fbaf5eeb700 -1 osd.5 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.878312+0000 front 2024-06-13T11:36:29.878376+0000 (oldest deadline 2024-06-13T11:36:55.178461+0000) 2024-06-13T11:36:59.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:58 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:58.870+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:36:59.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:58 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:58.870+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:36:59.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:58 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:58.870+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:36:59.358 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:59 smithi178 podman[75490]: 2024-06-13 11:36:59.082314034 +0000 UTC m=+5.448765426 container died 6f51a0e64b5471508529e17abfacb07ddca4b7e3429e3cb9db2e5f03c9c84573 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, ceph=True, GIT_BRANCH=HEAD) 2024-06-13T11:36:59.358 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:36:59 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:36:59.198+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:36:59.358 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:36:59 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:36:59.198+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:36:59.359 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:58 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:58.976+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:36:59.359 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:58 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:58.976+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:36:59.359 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:58 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:58.976+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:36:59.623 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:59 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:59.365+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:36:59.623 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:36:59 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:36:59.365+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.436189+0000 front 2024-06-13T11:36:31.436286+0000 (oldest deadline 2024-06-13T11:36:53.735824+0000) 2024-06-13T11:36:59.697 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:59 smithi178 podman[75490]: 2024-06-13 11:36:59.466877171 +0000 UTC m=+5.833328518 container cleanup 6f51a0e64b5471508529e17abfacb07ddca4b7e3429e3cb9db2e5f03c9c84573 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-13T11:36:59.697 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:59 smithi178 bash[75490]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5 2024-06-13T11:36:59.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:59 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:59.453+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:36:59.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:36:59 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:36:59.453+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:36:59.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:59 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:59.623+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:36:59.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:59 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:59.623+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:36:59.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:36:59 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:36:59.623+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:36:59.987 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:36:59 smithi178 podman[75509]: 2024-06-13 11:36:59.734914823 +0000 UTC m=+0.645110725 container remove 6f51a0e64b5471508529e17abfacb07ddca4b7e3429e3cb9db2e5f03c9c84573 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:37:00.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:59 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:59.853+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:00.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:59 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:59.853+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:00.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:36:59 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:36:59.853+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:00.329 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:00 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:00.156+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:00.329 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:00 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:00.156+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:00.329 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:37:00 smithi178 podman[75597]: 2024-06-13 11:36:59.989935709 +0000 UTC m=+0.017132278 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:37:00.329 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:37:00 smithi178 podman[75597]: 2024-06-13 11:37:00.102507818 +0000 UTC m=+0.129704381 container create ebb676c09cb18b73a9af3f0fabc1ccd5ce14057bc5720cf57c99a9b5174faa23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:37:00.329 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:59 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:59.987+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:00.330 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:59 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:59.987+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:00.330 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:36:59 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:36:59.987+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:00.623 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:37:00 smithi178 podman[75597]: 2024-06-13 11:37:00.33033462 +0000 UTC m=+0.357531205 container init ebb676c09cb18b73a9af3f0fabc1ccd5ce14057bc5720cf57c99a9b5174faa23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528) 2024-06-13T11:37:00.623 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:37:00 smithi178 podman[75597]: 2024-06-13 11:37:00.333897165 +0000 UTC m=+0.361093733 container start ebb676c09cb18b73a9af3f0fabc1ccd5ce14057bc5720cf57c99a9b5174faa23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc) 2024-06-13T11:37:00.624 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:37:00 smithi178 podman[75597]: 2024-06-13 11:37:00.430091012 +0000 UTC m=+0.457287594 container attach ebb676c09cb18b73a9af3f0fabc1ccd5ce14057bc5720cf57c99a9b5174faa23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528) 2024-06-13T11:37:00.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:00 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:00.415+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:00.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:00 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:00.415+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:00.896 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:00 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:00.400+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:37:00.896 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:00 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:00.400+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.436189+0000 front 2024-06-13T11:36:31.436286+0000 (oldest deadline 2024-06-13T11:36:53.735824+0000) 2024-06-13T11:37:00.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:00 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:00.585+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:00.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:00 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:00.585+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:00.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:00 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:00.585+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:00.946 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 13 11:37:00 smithi178 podman[75597]: 2024-06-13 11:37:00.625208982 +0000 UTC m=+0.652405546 container died ebb676c09cb18b73a9af3f0fabc1ccd5ce14057bc5720cf57c99a9b5174faa23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5) 2024-06-13T11:37:01.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:00 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:00.842+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:01.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:00 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:00.842+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:01.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:00 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:00.842+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:01.307 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:01 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:01.187+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:01.308 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:01 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:01.187+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:01.308 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:00 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:00.997+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:01.308 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:00 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:00.997+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:01.308 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:00 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:00.997+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:01.336 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.5.service' 2024-06-13T11:37:01.380 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:37:01.380 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-06-13T11:37:01.381 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-06-13T11:37:01.381 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.6 2024-06-13T11:37:01.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:01 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:01.436+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:01.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:01 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:01.436+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:01.896 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:01 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:01.442+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:37:01.896 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:01 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:01.442+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.436189+0000 front 2024-06-13T11:36:31.436286+0000 (oldest deadline 2024-06-13T11:36:53.735824+0000) 2024-06-13T11:37:01.896 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:01 smithi002 systemd[1]: Stopping Ceph osd.6 for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:37:01.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:01 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:01.549+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:01.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:01 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:01.549+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:01.897 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:01 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:01.549+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:02.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:01 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:01.818+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:02.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:01 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:01.818+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:02.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:01 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:01.818+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:02.395 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:01 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:01.929+0000 7fed44000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:37:02.396 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:01 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:01.929+0000 7fed44000700 -1 osd.6 114 *** Got signal Terminated *** 2024-06-13T11:37:02.396 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:01 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:01.929+0000 7fed44000700 -1 osd.6 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T11:37:02.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:02 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:02.177+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:02.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:02 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:02.177+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:02.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:02 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:02.023+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:02.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:02 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:02.023+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:02.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:02 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:02.023+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:02.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:02 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:02.422+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:02.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:02 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:02.422+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:02.896 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:02 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:02.415+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:37:02.896 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:02 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:02.415+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.436189+0000 front 2024-06-13T11:36:31.436286+0000 (oldest deadline 2024-06-13T11:36:53.735824+0000) 2024-06-13T11:37:02.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:02 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:02.521+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:02.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:02 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:02.521+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:02.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:02 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:02.521+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:03.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:02 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:02.795+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:03.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:02 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:02.795+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:03.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:02 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:02.795+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:03.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:03 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:03.149+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:03.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:03 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:03.149+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:03.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:03 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:03.062+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:03.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:03 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:03.062+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:03.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:03 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:03.062+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:03.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:03 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:03.422+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:03.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:03 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:03.422+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:03.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:03 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:03.422+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.682424+0000 front 2024-06-13T11:36:39.682241+0000 (oldest deadline 2024-06-13T11:37:02.582057+0000) 2024-06-13T11:37:03.895 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:03 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:03.430+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:37:03.896 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:03 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:03.430+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.436189+0000 front 2024-06-13T11:36:31.436286+0000 (oldest deadline 2024-06-13T11:36:53.735824+0000) 2024-06-13T11:37:03.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:03 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:03.476+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:03.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:03 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:03.476+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:03.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:03 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:03.476+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:04.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:03 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:03.839+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:04.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:03 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:03.839+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:04.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:03 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:03.839+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:04.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:04 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:04.040+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:04.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:04 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:04.040+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:04.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:04 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:04.040+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:04.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:04 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:04.153+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:04.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:04 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:04.153+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:04.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:04 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:04.153+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:04.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:04 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:04.413+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:04.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:04 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:04.413+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:04.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:04 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:04.413+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.682424+0000 front 2024-06-13T11:36:39.682241+0000 (oldest deadline 2024-06-13T11:37:02.582057+0000) 2024-06-13T11:37:04.898 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:04 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:04.479+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:37:04.898 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:04 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:04.479+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.436189+0000 front 2024-06-13T11:36:31.436286+0000 (oldest deadline 2024-06-13T11:36:53.735824+0000) 2024-06-13T11:37:04.898 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:04 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:04.479+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.038386+0000 front 2024-06-13T11:36:39.037773+0000 (oldest deadline 2024-06-13T11:37:04.337922+0000) 2024-06-13T11:37:04.898 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:04 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:04.476+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:04.899 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:04 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:04.476+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:04.899 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:04 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:04.476+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:05.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:04 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:04.804+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:05.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:04 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:04.804+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:05.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:04 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:04.804+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:05.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:04 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:04.804+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:05.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:05 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:05.027+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:05.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:05 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:05.027+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:05.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:05 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:05.027+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:05.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:05 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:05.152+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:05.448 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:05 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:05.152+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:05.448 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:05 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:05.152+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:05.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:05 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:05.455+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:05.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:05 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:05.455+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:05.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:05 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:05.455+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.682424+0000 front 2024-06-13T11:36:39.682241+0000 (oldest deadline 2024-06-13T11:37:02.582057+0000) 2024-06-13T11:37:05.896 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:05 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:05.504+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:37:05.896 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:05 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:05.504+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.436189+0000 front 2024-06-13T11:36:31.436286+0000 (oldest deadline 2024-06-13T11:36:53.735824+0000) 2024-06-13T11:37:05.896 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:05 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:05.504+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.038386+0000 front 2024-06-13T11:36:39.037773+0000 (oldest deadline 2024-06-13T11:37:04.337922+0000) 2024-06-13T11:37:05.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:05 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:05.440+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:05.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:05 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:05.440+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:05.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:05 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:05.440+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:05.897 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:05 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:05.440+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:06.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:05 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:05.815+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:06.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:05 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:05.815+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:06.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:05 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:05.815+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:06.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:05 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:05.815+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:06.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:06 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:06.049+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:06.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:06 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:06.049+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:06.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:06 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:06.049+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:06.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:06 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:06.179+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:06.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:06 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:06.179+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:06.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:06 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:06.179+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:06.788 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:06 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:06.452+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:06.789 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:06 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:06.452+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:06.789 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:06 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:06.452+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.682424+0000 front 2024-06-13T11:36:39.682241+0000 (oldest deadline 2024-06-13T11:37:02.582057+0000) 2024-06-13T11:37:06.797 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:06 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:06.515+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:23.833587+0000 front 2024-06-13T11:36:23.833648+0000 (oldest deadline 2024-06-13T11:36:46.133846+0000) 2024-06-13T11:37:06.798 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:06 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:06.515+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.436189+0000 front 2024-06-13T11:36:31.436286+0000 (oldest deadline 2024-06-13T11:36:53.735824+0000) 2024-06-13T11:37:06.798 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:06 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6[60241]: 2024-06-13T11:37:06.515+0000 7fed3a800700 -1 osd.6 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.038386+0000 front 2024-06-13T11:36:39.037773+0000 (oldest deadline 2024-06-13T11:37:04.337922+0000) 2024-06-13T11:37:06.798 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:06 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:06.406+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:06.798 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:06 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:06.406+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:06.798 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:06 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:06.406+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:06.799 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:06 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:06.406+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:07.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:06 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:06.789+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:07.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:06 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:06.789+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:07.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:06 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:06.789+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:07.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:06 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:06.789+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:07.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:07 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:07.149+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:07.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:07 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:07.149+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:07.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:07 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:07.149+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:07.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:07 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:07.012+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:07.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:07 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:07.012+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:07.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:07 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:07.012+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:07.756 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:07 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:07.414+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:07.756 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:07 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:07.414+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:07.756 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:07 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:07.414+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.682424+0000 front 2024-06-13T11:36:39.682241+0000 (oldest deadline 2024-06-13T11:37:02.582057+0000) 2024-06-13T11:37:07.829 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:07 smithi002 podman[119911]: 2024-06-13 11:37:07.539631382 +0000 UTC m=+5.727417814 container died 64f1cb7fcf14ee02497d9531fcd54269d53ebe1cecd3b3f225092a2d58ff1036 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-06-13T11:37:07.830 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:07 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:07.442+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:07.830 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:07 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:07.442+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:07.830 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:07 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:07.442+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:07.830 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:07 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:07.443+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:08.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:07 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:07.756+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:08.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:07 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:07.756+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:08.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:07 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:07.756+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:08.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:07 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:07.756+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:08.441 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:08 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:08.415+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:08.441 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:08 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:08.415+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:08.441 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:08 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:08.415+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:08.441 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:08 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:08.415+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:08.442 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:08 smithi002 podman[119911]: 2024-06-13 11:37:08.181346127 +0000 UTC m=+6.369132583 container cleanup 64f1cb7fcf14ee02497d9531fcd54269d53ebe1cecd3b3f225092a2d58ff1036 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240528) 2024-06-13T11:37:08.442 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:08 smithi002 bash[119911]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6 2024-06-13T11:37:08.446 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:08 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:08.160+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:08.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:08 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:08.160+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:08.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:08 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:08.160+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:08.449 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:08 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:08.025+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:08.449 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:08 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:08.025+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:08.449 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:08 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:08.025+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:08.756 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:08 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:08.386+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:08.756 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:08 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:08.386+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:08.756 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:08 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:08.386+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.682424+0000 front 2024-06-13T11:36:39.682241+0000 (oldest deadline 2024-06-13T11:37:02.582057+0000) 2024-06-13T11:37:08.895 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:08 smithi002 podman[119930]: 2024-06-13 11:37:08.441044384 +0000 UTC m=+0.886391465 container remove 64f1cb7fcf14ee02497d9531fcd54269d53ebe1cecd3b3f225092a2d58ff1036 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:37:09.038 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:08 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:08.756+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:09.038 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:08 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:08.756+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:09.038 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:08 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:08.756+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:09.038 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:08 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:08.756+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:09.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:09 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:08.998+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:09.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:09 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:08.998+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:09.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:09 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:08.998+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:09.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:09 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:09.165+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:09.448 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:09 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:09.165+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:09.448 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:09 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:09.165+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:09.598 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:09 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:09.439+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:09.599 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:09 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:09.439+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:09.599 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:09 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:09.439+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:09.599 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:09 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:09.439+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:09.599 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:09 smithi002 podman[120019]: 2024-06-13 11:37:09.252242994 +0000 UTC m=+0.035840430 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:37:09.599 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:09 smithi002 podman[120019]: 2024-06-13 11:37:09.425223985 +0000 UTC m=+0.208821481 container create b7ac30ac7ddccf805149abb31d151a6424f4fae553450ba4b2fab64ff0bfd039 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-13T11:37:09.776 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:09 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:09.375+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:09.776 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:09 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:09.375+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:09.776 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:09 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:09.375+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.682424+0000 front 2024-06-13T11:36:39.682241+0000 (oldest deadline 2024-06-13T11:37:02.582057+0000) 2024-06-13T11:37:09.896 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:09 smithi002 podman[120019]: 2024-06-13 11:37:09.712034172 +0000 UTC m=+0.495631681 container init b7ac30ac7ddccf805149abb31d151a6424f4fae553450ba4b2fab64ff0bfd039 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528) 2024-06-13T11:37:09.896 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:09 smithi002 podman[120019]: 2024-06-13 11:37:09.724112405 +0000 UTC m=+0.507709853 container start b7ac30ac7ddccf805149abb31d151a6424f4fae553450ba4b2fab64ff0bfd039 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528) 2024-06-13T11:37:09.896 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:09 smithi002 podman[120019]: 2024-06-13 11:37:09.802502685 +0000 UTC m=+0.586100178 container attach b7ac30ac7ddccf805149abb31d151a6424f4fae553450ba4b2fab64ff0bfd039 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6-deactivate, RELEASE=squid-3d89acc, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-06-13T11:37:10.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:09 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:09.776+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:10.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:09 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:09.776+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:10.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:09 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:09.776+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:10.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:09 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:09.776+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:10.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:10 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:10.169+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:10.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:10 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:10.169+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:10.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:10 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:10.169+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:10.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:10 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:10.039+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:10.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:10 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:10.039+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:10.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:10 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:10.039+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:10.560 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 11:37:10 smithi002 podman[120019]: 2024-06-13 11:37:10.196834334 +0000 UTC m=+0.980431856 container died b7ac30ac7ddccf805149abb31d151a6424f4fae553450ba4b2fab64ff0bfd039 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-6-deactivate, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True) 2024-06-13T11:37:10.560 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:10 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:10.410+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:10.560 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:10 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:10.410+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:10.560 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:10 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:10.410+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:10.560 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:10 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:10.410+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:10.750 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:10 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:10.377+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:10.750 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:10 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:10.377+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:10.750 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:10 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:10.377+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.682424+0000 front 2024-06-13T11:36:39.682241+0000 (oldest deadline 2024-06-13T11:37:02.582057+0000) 2024-06-13T11:37:11.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:10 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:10.750+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:11.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:10 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:10.750+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:11.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:10 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:10.750+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:11.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:10 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:10.750+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:11.070 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.6.service' 2024-06-13T11:37:11.192 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:37:11.192 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-06-13T11:37:11.192 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-06-13T11:37:11.192 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.7 2024-06-13T11:37:11.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:11 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:11.167+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:11.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:11 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:11.167+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:11.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:11 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:11.167+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:11.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:11 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:11.040+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:11.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:11 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:11.040+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:11.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:11 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:11.040+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:11.509 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:11 smithi077 systemd[1]: Stopping Ceph osd.7 for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:37:11.509 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:11 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:11.343+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:11.509 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:11 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:11.343+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:11.509 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:11 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:11.343+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.682424+0000 front 2024-06-13T11:36:39.682241+0000 (oldest deadline 2024-06-13T11:37:02.582057+0000) 2024-06-13T11:37:11.645 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:11 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:11.378+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:11.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:11 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:11.378+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:11.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:11 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:11.378+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:11.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:11 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:11.378+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:11.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:11 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:11.509+0000 7f155a8b1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:37:11.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:11 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:11.509+0000 7f155a8b1700 -1 osd.7 114 *** Got signal Terminated *** 2024-06-13T11:37:11.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:11 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:11.509+0000 7f155a8b1700 -1 osd.7 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T11:37:11.790 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:11 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:11.744+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:11.791 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:11 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:11.744+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:11.791 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:11 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:11.744+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:11.791 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:11 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:11.744+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:12.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:12 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:12.128+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:12.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:12 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:12.128+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:12.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:12 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:12.128+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:12.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:12 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:12.063+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:12.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:12 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:12.063+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:12.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:12 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:12.063+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:12.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:12 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:12.375+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:12.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:12 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:12.375+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:12.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:12 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:12.375+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:12.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:12 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:12.375+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:12.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:12 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:12.375+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:12.697 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:12 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:12.309+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:12.697 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:12 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:12.309+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:12.697 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:12 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:12.309+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.682424+0000 front 2024-06-13T11:36:39.682241+0000 (oldest deadline 2024-06-13T11:37:02.582057+0000) 2024-06-13T11:37:12.697 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:12 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:12.309+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:47.183335+0000 front 2024-06-13T11:36:47.183367+0000 (oldest deadline 2024-06-13T11:37:11.883502+0000) 2024-06-13T11:37:13.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:12 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:12.697+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:13.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:12 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:12.697+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:13.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:12 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:12.697+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:13.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:12 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:12.697+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:13.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:13 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:13.097+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:13.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:13 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:13.097+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:13.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:13 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:13.097+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:13.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:13 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:13.080+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:13.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:13 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:13.080+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:13.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:13 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:13.080+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:13.448 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:13 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:13.080+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.025682+0000 front 2024-06-13T11:36:50.025799+0000 (oldest deadline 2024-06-13T11:37:12.925704+0000) 2024-06-13T11:37:13.742 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:13 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:13.297+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:13.742 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:13 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:13.297+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:13.742 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:13 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:13.297+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.682424+0000 front 2024-06-13T11:36:39.682241+0000 (oldest deadline 2024-06-13T11:37:02.582057+0000) 2024-06-13T11:37:13.742 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:13 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:13.297+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:47.183335+0000 front 2024-06-13T11:36:47.183367+0000 (oldest deadline 2024-06-13T11:37:11.883502+0000) 2024-06-13T11:37:13.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:13 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:13.398+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:13.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:13 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:13.398+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:13.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:13 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:13.398+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:13.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:13 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:13.398+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:13.896 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:13 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:13.398+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:14.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:13 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:13.742+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:14.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:13 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:13.742+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:14.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:13 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:13.742+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:14.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:13 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:13.742+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:14.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:14 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:14.104+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:14.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:14 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:14.104+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:14.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:14 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:14.104+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:14.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:14 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:14.104+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.025682+0000 front 2024-06-13T11:36:50.025799+0000 (oldest deadline 2024-06-13T11:37:12.925704+0000) 2024-06-13T11:37:14.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:14 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:14.137+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:14.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:14 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:14.137+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:14.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:14 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:14.137+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:14.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:14 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:14.137+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:14.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:14 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:14.374+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:14.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:14 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:14.374+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:14.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:14 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:14.374+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:14.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:14 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:14.374+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:14.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:14 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:14.374+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:14.763 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:14 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:14.307+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:14.763 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:14 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:14.307+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:14.763 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:14 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:14.307+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.682424+0000 front 2024-06-13T11:36:39.682241+0000 (oldest deadline 2024-06-13T11:37:02.582057+0000) 2024-06-13T11:37:14.763 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:14 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:14.307+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:47.183335+0000 front 2024-06-13T11:36:47.183367+0000 (oldest deadline 2024-06-13T11:37:11.883502+0000) 2024-06-13T11:37:15.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:14 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:14.763+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:15.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:14 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:14.763+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:15.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:14 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:14.763+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:15.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:14 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:14.763+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:15.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:15 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:15.075+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:15.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:15 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:15.075+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:15.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:15 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:15.075+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:15.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:15 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:15.075+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.025682+0000 front 2024-06-13T11:36:50.025799+0000 (oldest deadline 2024-06-13T11:37:12.925704+0000) 2024-06-13T11:37:15.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:15 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:15.164+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:15.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:15 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:15.164+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:15.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:15 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:15.164+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:15.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:15 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:15.164+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:15.645 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:15 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:15.327+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:15.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:15 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:15.327+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:15.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:15 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:15.327+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:15.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:15 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:15.327+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:15.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:15 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:15.327+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:15.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:15 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:15.327+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:15.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:15 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:15.327+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:15.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:15 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:15.327+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.682424+0000 front 2024-06-13T11:36:39.682241+0000 (oldest deadline 2024-06-13T11:37:02.582057+0000) 2024-06-13T11:37:15.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:15 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:15.327+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:47.183335+0000 front 2024-06-13T11:36:47.183367+0000 (oldest deadline 2024-06-13T11:37:11.883502+0000) 2024-06-13T11:37:16.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:15 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:15.812+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:16.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:15 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:15.812+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:16.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:15 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:15.812+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:16.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:15 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:15.812+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:16.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:15 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:15.812+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:16.348 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:16 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:16.046+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:16.348 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:16 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:16.046+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:16.348 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:16 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:16.046+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:16.348 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:16 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:16.046+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.025682+0000 front 2024-06-13T11:36:50.025799+0000 (oldest deadline 2024-06-13T11:37:12.925704+0000) 2024-06-13T11:37:16.349 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:16 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:16.133+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:16.349 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:16 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:16.133+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:16.349 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:16 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:16.133+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:16.349 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:16 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:16.133+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:16.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:16 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:16.284+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:16.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:16 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:16.284+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:16.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:16 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:16.284+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:16.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:16 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:16.284+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:16.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:16 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:16.284+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:16.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:16 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:16.292+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.179673+0000 front 2024-06-13T11:36:22.179607+0000 (oldest deadline 2024-06-13T11:36:48.079782+0000) 2024-06-13T11:37:16.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:16 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:16.292+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:29.180739+0000 front 2024-06-13T11:36:29.180753+0000 (oldest deadline 2024-06-13T11:36:55.080600+0000) 2024-06-13T11:37:16.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:16 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:16.292+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:39.682424+0000 front 2024-06-13T11:36:39.682241+0000 (oldest deadline 2024-06-13T11:37:02.582057+0000) 2024-06-13T11:37:16.790 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:16 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7[54557]: 2024-06-13T11:37:16.292+0000 7f1556ea5700 -1 osd.7 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:47.183335+0000 front 2024-06-13T11:36:47.183367+0000 (oldest deadline 2024-06-13T11:37:11.883502+0000) 2024-06-13T11:37:17.201 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:16 smithi077 podman[73742]: 2024-06-13 11:37:16.941993754 +0000 UTC m=+5.556015874 container died cc2e15d84f98c59b4647205400fc11bee839b9900fa7d486a498a223ddd51fae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528) 2024-06-13T11:37:17.202 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:16 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:16.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:17.202 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:16 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:16.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:17.202 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:16 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:16.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:17.202 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:16 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:16.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:17.202 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:16 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:16.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:17.364 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:17 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:17.016+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:17.364 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:17 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:17.016+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:17.364 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:17 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:17.016+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:17.364 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:17 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:17.016+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.025682+0000 front 2024-06-13T11:36:50.025799+0000 (oldest deadline 2024-06-13T11:37:12.925704+0000) 2024-06-13T11:37:17.364 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:17 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:17.086+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:17.365 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:17 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:17.086+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:17.365 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:17 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:17.086+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:17.365 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:17 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:17.086+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:17.540 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:17 smithi077 podman[73742]: 2024-06-13 11:37:17.293897829 +0000 UTC m=+5.907919941 container cleanup cc2e15d84f98c59b4647205400fc11bee839b9900fa7d486a498a223ddd51fae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:37:17.540 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:17 smithi077 bash[73742]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7 2024-06-13T11:37:17.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:17 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:17.297+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:17.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:17 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:17.297+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:17.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:17 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:17.297+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:17.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:17 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:17.297+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:17.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:17 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:17.297+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:17.886 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:17 smithi077 podman[73758]: 2024-06-13 11:37:17.570105489 +0000 UTC m=+0.625335357 container remove cc2e15d84f98c59b4647205400fc11bee839b9900fa7d486a498a223ddd51fae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-06-13T11:37:17.886 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:17 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:17.782+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:17.886 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:17 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:17.782+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:17.886 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:17 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:17.782+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:17.886 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:17 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:17.782+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:17.887 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:17 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:17.782+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:18.147 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:17 smithi077 podman[73848]: 2024-06-13 11:37:17.887477393 +0000 UTC m=+0.082929134 container create 5a58f73b383d87da07fe99467e767cf32924b39259ba185c4d0cd2c9fd529e10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:37:18.147 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:17 smithi077 podman[73848]: 2024-06-13 11:37:17.821124738 +0000 UTC m=+0.016576483 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:37:18.147 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:18 smithi077 podman[73848]: 2024-06-13 11:37:18.148525722 +0000 UTC m=+0.343977473 container init 5a58f73b383d87da07fe99467e767cf32924b39259ba185c4d0cd2c9fd529e10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T11:37:18.438 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:18 smithi077 podman[73848]: 2024-06-13 11:37:18.151804679 +0000 UTC m=+0.347256430 container start 5a58f73b383d87da07fe99467e767cf32924b39259ba185c4d0cd2c9fd529e10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:37:18.439 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:18 smithi077 podman[73848]: 2024-06-13 11:37:18.23158214 +0000 UTC m=+0.427033894 container attach 5a58f73b383d87da07fe99467e767cf32924b39259ba185c4d0cd2c9fd529e10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528) 2024-06-13T11:37:18.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:18 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:18.053+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:18.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:18 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:18.053+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:18.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:18 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:18.053+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:18.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:18 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:18.053+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:18.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:18 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:18.061+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:18.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:18 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:18.061+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:18.448 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:18 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:18.061+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:18.448 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:18 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:18.061+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.025682+0000 front 2024-06-13T11:36:50.025799+0000 (oldest deadline 2024-06-13T11:37:12.925704+0000) 2024-06-13T11:37:18.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:18 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:18.345+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:18.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:18 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:18.345+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:18.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:18 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:18.345+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:18.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:18 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:18.345+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:18.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:18 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:18.345+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:18.734 INFO:journalctl@ceph.osd.7.smithi077.stdout:Jun 13 11:37:18 smithi077 podman[73848]: 2024-06-13 11:37:18.440107221 +0000 UTC m=+0.635558964 container died 5a58f73b383d87da07fe99467e767cf32924b39259ba185c4d0cd2c9fd529e10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-7-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-13T11:37:19.034 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:18 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:18.747+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:19.034 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:18 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:18.747+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:19.034 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:18 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:18.747+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:19.034 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:18 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:18.747+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:19.034 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:18 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:18.747+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:19.060 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.7.service' 2024-06-13T11:37:19.096 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:37:19.097 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-06-13T11:37:19.097 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-06-13T11:37:19.097 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.8 2024-06-13T11:37:19.410 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:19 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:19.060+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:19.410 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:19 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:19.060+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:19.410 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:19 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:19.060+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:19.411 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:19 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:19.060+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:19.411 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:19 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:19.049+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:19.411 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:19 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:19.049+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:19.411 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:19 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:19.049+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:19.411 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:19 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:19.049+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.025682+0000 front 2024-06-13T11:36:50.025799+0000 (oldest deadline 2024-06-13T11:37:12.925704+0000) 2024-06-13T11:37:19.411 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:19 smithi178 systemd[1]: Stopping Ceph osd.8 for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:37:19.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:19 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:19.301+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:19.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:19 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:19.301+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:19.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:19 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:19.301+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:19.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:19 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:19.301+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:19.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:19 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:19.301+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:19.697 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:19 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:19.411+0000 7f467ada0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:37:19.697 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:19 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:19.411+0000 7f467ada0700 -1 osd.8 114 *** Got signal Terminated *** 2024-06-13T11:37:19.698 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:19 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:19.411+0000 7f467ada0700 -1 osd.8 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T11:37:20.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:19 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:19.789+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:20.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:19 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:19.789+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:20.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:19 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:19.789+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:20.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:19 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:19.789+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:20.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:19 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:19.789+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:20.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:20 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:20.035+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:20.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:20 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:20.035+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:20.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:20 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:20.035+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:20.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:20 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:20.035+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:20.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:20 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:20.096+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:20.448 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:20 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:20.096+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:20.448 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:20 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:20.096+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:20.448 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:20 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:20.096+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.025682+0000 front 2024-06-13T11:36:50.025799+0000 (oldest deadline 2024-06-13T11:37:12.925704+0000) 2024-06-13T11:37:20.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:20 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:20.274+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:20.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:20 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:20.274+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:20.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:20 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:20.274+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:20.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:20 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:20.274+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:20.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:20 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:20.274+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:21.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:20 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:20.745+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:21.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:20 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:20.745+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:21.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:20 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:20.745+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:21.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:20 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:20.745+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:21.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:20 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:20.745+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:21.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:21 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:21.110+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:21.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:21 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:21.110+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:21.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:21 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:21.110+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:21.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:21 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:21.110+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.025682+0000 front 2024-06-13T11:36:50.025799+0000 (oldest deadline 2024-06-13T11:37:12.925704+0000) 2024-06-13T11:37:21.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:20 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:20.986+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:21.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:20 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:20.986+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:21.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:20 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:20.986+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:21.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:20 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:20.986+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:21.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:20 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:20.986+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:21.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:21 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:21.239+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:21.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:21 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:21.239+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:21.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:21 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:21.239+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:21.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:21 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:21.239+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:21.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:21 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:21.239+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:22.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:21 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:21.774+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:22.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:21 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:21.774+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:22.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:21 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:21.774+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:22.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:21 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:21.774+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:22.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:21 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:21.774+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:22.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:21 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:21.774+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:22.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:22 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:22.069+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:22.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:22 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:22.069+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:22.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:22 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:22.069+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:22.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:22 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:22.069+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.025682+0000 front 2024-06-13T11:36:50.025799+0000 (oldest deadline 2024-06-13T11:37:12.925704+0000) 2024-06-13T11:37:22.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:21 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:21.983+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:22.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:21 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:21.983+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:22.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:21 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:21.983+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:22.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:21 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:21.983+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:22.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:21 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:21.983+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:22.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:22 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:22.213+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:22.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:22 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:22.213+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:22.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:22 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:22.213+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:22.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:22 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:22.213+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:22.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:22 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:22.213+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:23.042 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:22 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:22.748+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:23.042 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:22 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:22.748+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:23.042 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:22 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:22.748+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:23.043 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:22 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:22.748+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:23.043 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:22 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:22.748+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:23.043 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:22 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:22.748+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:23.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:23 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:23.042+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:23.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:23 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:23.042+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:23.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:23 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:23.042+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:23.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:23 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:23.042+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.025682+0000 front 2024-06-13T11:36:50.025799+0000 (oldest deadline 2024-06-13T11:37:12.925704+0000) 2024-06-13T11:37:23.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:23 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:23.014+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:23.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:23 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:23.014+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:23.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:23 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:23.014+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:23.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:23 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:23.014+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:23.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:23 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:23.014+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:23.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:23 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:23.225+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:23.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:23 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:23.225+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:23.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:23 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:23.225+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:23.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:23 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:23.225+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:23.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:23 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:23.225+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:23.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:23 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:23.225+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:58.534516+0000 front 2024-06-13T11:36:58.534466+0000 (oldest deadline 2024-06-13T11:37:22.634371+0000) 2024-06-13T11:37:24.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:23 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:23.758+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:24.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:23 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:23.758+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:24.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:23 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:23.758+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:24.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:23 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:23.758+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:24.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:23 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:23.758+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:24.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:23 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:23.758+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:24.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:24 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:24.033+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:20.320389+0000 front 2024-06-13T11:36:20.320372+0000 (oldest deadline 2024-06-13T11:36:47.321020+0000) 2024-06-13T11:37:24.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:24 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:24.033+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:30.222052+0000 front 2024-06-13T11:36:30.222081+0000 (oldest deadline 2024-06-13T11:36:55.522161+0000) 2024-06-13T11:37:24.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:24 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:24.033+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:41.423419+0000 front 2024-06-13T11:36:41.423505+0000 (oldest deadline 2024-06-13T11:37:03.723330+0000) 2024-06-13T11:37:24.447 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:24 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8[56106]: 2024-06-13T11:37:24.033+0000 7f4677394700 -1 osd.8 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.025682+0000 front 2024-06-13T11:36:50.025799+0000 (oldest deadline 2024-06-13T11:37:12.925704+0000) 2024-06-13T11:37:24.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:24 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:24.033+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:24.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:24 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:24.033+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:24.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:24 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:24.033+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:24.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:24 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:24.033+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:24.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:24 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:24.033+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:24.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:24 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:24.227+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:24.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:24 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:24.227+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:24.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:24 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:24.227+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:24.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:24 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:24.227+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:24.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:24 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:24.227+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:24.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:24 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:24.227+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:58.534516+0000 front 2024-06-13T11:36:58.534466+0000 (oldest deadline 2024-06-13T11:37:22.634371+0000) 2024-06-13T11:37:25.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:24 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:24.788+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:25.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:24 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:24.788+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:25.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:24 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:24.788+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:25.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:24 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:24.788+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:25.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:24 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:24.788+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:25.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:24 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:24.788+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:25.110 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:24 smithi178 podman[75717]: 2024-06-13 11:37:24.861242067 +0000 UTC m=+5.579861264 container died 85d1e0dd06f321cbd48eacd5226610667f09e7ad4477ae7b1793a98774d96b28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-06-13T11:37:25.110 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:25 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:25.060+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:25.110 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:25 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:25.060+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:25.111 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:25 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:25.060+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:25.111 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:25 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:25.060+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:25.111 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:25 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:25.060+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:25.419 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:25 smithi178 podman[75717]: 2024-06-13 11:37:25.218817709 +0000 UTC m=+5.937436908 container cleanup 85d1e0dd06f321cbd48eacd5226610667f09e7ad4477ae7b1793a98774d96b28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-06-13T11:37:25.419 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:25 smithi178 bash[75717]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8 2024-06-13T11:37:25.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:25 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:25.236+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:25.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:25 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:25.236+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:25.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:25 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:25.236+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:25.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:25 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:25.236+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:25.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:25 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:25.236+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:25.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:25 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:25.236+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:58.534516+0000 front 2024-06-13T11:36:58.534466+0000 (oldest deadline 2024-06-13T11:37:22.634371+0000) 2024-06-13T11:37:25.696 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:25 smithi178 podman[75734]: 2024-06-13 11:37:25.420178485 +0000 UTC m=+0.554656362 container remove 85d1e0dd06f321cbd48eacd5226610667f09e7ad4477ae7b1793a98774d96b28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-06-13T11:37:26.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:25 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:25.742+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:26.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:25 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:25.742+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:26.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:25 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:25.742+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:26.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:25 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:25.742+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:26.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:25 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:25.742+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:26.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:25 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:25.742+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:26.106 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:25 smithi178 podman[75822]: 2024-06-13 11:37:25.744586206 +0000 UTC m=+0.017420662 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:37:26.106 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:25 smithi178 podman[75822]: 2024-06-13 11:37:25.871253042 +0000 UTC m=+0.144087539 container create 4b59d2afdc9e89d249c3ded917a8054dfbd53e7977923a4362c801eab85f37ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:37:26.107 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:26 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:26.056+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:26.107 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:26 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:26.056+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:26.107 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:26 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:26.056+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:26.107 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:26 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:26.056+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:26.107 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:26 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:26.056+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:26.403 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:26 smithi178 podman[75822]: 2024-06-13 11:37:26.107710431 +0000 UTC m=+0.380544893 container init 4b59d2afdc9e89d249c3ded917a8054dfbd53e7977923a4362c801eab85f37ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, ceph=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-06-13T11:37:26.404 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:26 smithi178 podman[75822]: 2024-06-13 11:37:26.111692039 +0000 UTC m=+0.384526500 container start 4b59d2afdc9e89d249c3ded917a8054dfbd53e7977923a4362c801eab85f37ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:37:26.404 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:26 smithi178 podman[75822]: 2024-06-13 11:37:26.190319911 +0000 UTC m=+0.463154380 container attach 4b59d2afdc9e89d249c3ded917a8054dfbd53e7977923a4362c801eab85f37ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8-deactivate, RELEASE=squid-3d89acc, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2) 2024-06-13T11:37:26.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:26 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:26.238+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:26.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:26 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:26.238+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:26.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:26 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:26.238+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:26.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:26 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:26.238+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:26.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:26 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:26.238+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:26.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:26 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:26.238+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:58.534516+0000 front 2024-06-13T11:36:58.534466+0000 (oldest deadline 2024-06-13T11:37:22.634371+0000) 2024-06-13T11:37:26.696 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 13 11:37:26 smithi178 podman[75822]: 2024-06-13 11:37:26.405086212 +0000 UTC m=+0.677920678 container died 4b59d2afdc9e89d249c3ded917a8054dfbd53e7977923a4362c801eab85f37ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-06-13T11:37:27.029 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.8.service' 2024-06-13T11:37:27.067 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:37:27.067 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-06-13T11:37:27.068 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-06-13T11:37:27.068 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.9 2024-06-13T11:37:27.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:26 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:26.792+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:27.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:26 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:26.792+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:27.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:26 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:26.792+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:27.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:26 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:26.792+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:27.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:26 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:26.792+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:27.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:26 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:26.792+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:27.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:27 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:27.093+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:27.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:27 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:27.093+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:27.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:27 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:27.093+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:27.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:27 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:27.093+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:27.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:27 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:27.093+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:27.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:27 smithi002 systemd[1]: Stopping Ceph osd.9 for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:37:27.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:27 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:27.288+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:27.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:27 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:27.288+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:27.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:27 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:27.288+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:27.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:27 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:27.288+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:27.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:27 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:27.288+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:27.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:27 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:27.288+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:58.534516+0000 front 2024-06-13T11:36:58.534466+0000 (oldest deadline 2024-06-13T11:37:22.634371+0000) 2024-06-13T11:37:28.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:27 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:27.770+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:28.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:27 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:27.770+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:28.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:27 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:27.770+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:28.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:27 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:27.770+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:28.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:27 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:27.770+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:28.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:27 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:27.770+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:28.146 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:27 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:27.723+0000 7fa56d200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:37:28.146 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:27 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:27.723+0000 7fa56d200700 -1 osd.9 114 *** Got signal Terminated *** 2024-06-13T11:37:28.146 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:27 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:27.723+0000 7fa56d200700 -1 osd.9 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T11:37:28.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:28 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:28.141+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:28.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:28 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:28.141+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:28.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:28 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:28.141+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:28.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:28 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:28.141+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:28.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:28 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:28.141+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:28.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:28 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:28.242+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:28.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:28 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:28.242+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:28.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:28 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:28.242+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:28.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:28 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:28.242+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:28.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:28 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:28.242+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:28.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:28 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:28.242+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:58.534516+0000 front 2024-06-13T11:36:58.534466+0000 (oldest deadline 2024-06-13T11:37:22.634371+0000) 2024-06-13T11:37:29.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:28 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:28.756+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:29.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:28 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:28.756+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:29.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:28 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:28.756+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:29.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:28 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:28.756+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:29.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:28 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:28.756+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:29.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:28 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:28.756+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:29.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:29 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:29.164+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:29.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:29 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:29.164+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:29.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:29 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:29.164+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:29.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:29 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:29.164+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:29.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:29 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:29.164+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:29.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:29 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:29.164+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:29.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:29 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:29.225+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:29.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:29 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:29.225+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:29.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:29 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:29.225+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:29.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:29 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:29.225+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:29.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:29 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:29.225+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:29.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:29 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:29.225+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:58.534516+0000 front 2024-06-13T11:36:58.534466+0000 (oldest deadline 2024-06-13T11:37:22.634371+0000) 2024-06-13T11:37:30.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:29 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:29.790+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:30.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:29 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:29.790+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:30.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:29 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:29.790+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:30.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:29 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:29.790+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:30.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:29 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:29.790+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:30.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:29 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:29.790+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:30.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:29 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:29.790+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:04.287536+0000 front 2024-06-13T11:37:04.287588+0000 (oldest deadline 2024-06-13T11:37:28.987342+0000) 2024-06-13T11:37:30.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:30 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:30.179+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:30.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:30 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:30.179+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:30.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:30 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:30.179+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:30.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:30 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:30.179+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:30.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:30 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:30.179+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:30.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:30 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:30.179+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:30.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:30 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:30.182+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:30.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:30 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:30.182+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:30.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:30 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:30.182+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:30.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:30 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:30.182+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:30.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:30 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:30.182+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:30.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:30 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:30.182+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:58.534516+0000 front 2024-06-13T11:36:58.534466+0000 (oldest deadline 2024-06-13T11:37:22.634371+0000) 2024-06-13T11:37:31.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:30 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:30.776+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:31.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:30 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:30.776+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:31.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:30 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:30.776+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:31.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:30 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:30.776+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:31.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:30 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:30.776+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:31.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:30 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:30.776+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:31.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:30 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:30.776+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:04.287536+0000 front 2024-06-13T11:37:04.287588+0000 (oldest deadline 2024-06-13T11:37:28.987342+0000) 2024-06-13T11:37:31.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:31 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:31.189+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:31.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:31 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:31.189+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:31.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:31 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:31.189+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:31.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:31 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:31.189+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:31.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:31 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:31.189+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:31.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:31 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:31.189+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:31.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:31 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:31.221+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:31.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:31 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:31.221+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:31.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:31 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:31.221+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:31.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:31 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:31.221+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:31.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:31 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:31.221+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:31.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:31 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:31.221+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:58.534516+0000 front 2024-06-13T11:36:58.534466+0000 (oldest deadline 2024-06-13T11:37:22.634371+0000) 2024-06-13T11:37:32.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:31 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:31.816+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:32.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:31 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:31.816+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:32.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:31 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:31.816+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:32.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:31 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:31.816+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:32.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:31 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:31.816+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:32.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:31 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:31.816+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:32.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:31 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:31.816+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:04.287536+0000 front 2024-06-13T11:37:04.287588+0000 (oldest deadline 2024-06-13T11:37:28.987342+0000) 2024-06-13T11:37:32.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:32 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:32.231+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:15.918828+0000 front 2024-06-13T11:36:15.919440+0000 (oldest deadline 2024-06-13T11:36:40.018726+0000) 2024-06-13T11:37:32.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:32 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:32.231+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:22.320919+0000 front 2024-06-13T11:36:22.320974+0000 (oldest deadline 2024-06-13T11:36:47.021216+0000) 2024-06-13T11:37:32.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:32 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:32.231+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.225009+0000 front 2024-06-13T11:36:32.225154+0000 (oldest deadline 2024-06-13T11:36:55.125220+0000) 2024-06-13T11:37:32.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:32 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:32.231+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.627398+0000 front 2024-06-13T11:36:38.627616+0000 (oldest deadline 2024-06-13T11:37:04.527396+0000) 2024-06-13T11:37:32.646 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:32 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:32.231+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.430179+0000 front 2024-06-13T11:36:50.430243+0000 (oldest deadline 2024-06-13T11:37:11.530443+0000) 2024-06-13T11:37:32.647 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:32 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9[67083]: 2024-06-13T11:37:32.231+0000 7fa568a00700 -1 osd.9 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:58.534516+0000 front 2024-06-13T11:36:58.534466+0000 (oldest deadline 2024-06-13T11:37:22.634371+0000) 2024-06-13T11:37:32.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:32 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:32.214+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:32.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:32 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:32.214+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:32.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:32 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:32.214+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:32.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:32 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:32.214+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:32.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:32 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:32.214+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:32.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:32 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:32.214+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:33.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:32 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:32.785+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:33.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:32 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:32.785+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:33.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:32 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:32.785+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:33.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:32 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:32.785+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:33.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:32 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:32.785+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:33.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:32 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:32.785+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:33.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:32 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:32.785+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:04.287536+0000 front 2024-06-13T11:37:04.287588+0000 (oldest deadline 2024-06-13T11:37:28.987342+0000) 2024-06-13T11:37:33.395 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:33 smithi002 podman[120123]: 2024-06-13 11:37:33.140546775 +0000 UTC m=+5.555278518 container died 025a3d1e49d757d96398293de828bdf5326141994eb133aab2ec6ba5316e3d9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-06-13T11:37:33.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:33 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:33.193+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:33.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:33 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:33.193+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:33.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:33 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:33.193+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:33.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:33 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:33.193+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:33.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:33 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:33.193+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:33.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:33 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:33.193+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:34.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:33 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:33.767+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:34.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:33 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:33.767+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:34.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:33 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:33.767+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:34.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:33 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:33.767+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:34.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:33 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:33.767+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:34.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:33 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:33.767+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:34.041 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:33 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:33.767+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:04.287536+0000 front 2024-06-13T11:37:04.287588+0000 (oldest deadline 2024-06-13T11:37:28.987342+0000) 2024-06-13T11:37:34.044 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:33 smithi002 podman[120123]: 2024-06-13 11:37:33.771463633 +0000 UTC m=+6.186195402 container cleanup 025a3d1e49d757d96398293de828bdf5326141994eb133aab2ec6ba5316e3d9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc) 2024-06-13T11:37:34.044 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:33 smithi002 bash[120123]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9 2024-06-13T11:37:34.395 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:34 smithi002 podman[120142]: 2024-06-13 11:37:34.04432896 +0000 UTC m=+0.884418609 container remove 025a3d1e49d757d96398293de828bdf5326141994eb133aab2ec6ba5316e3d9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-06-13T11:37:34.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:34 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:34.151+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:34.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:34 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:34.151+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:34.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:34 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:34.151+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:34.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:34 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:34.151+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:34.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:34 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:34.151+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:34.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:34 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:34.151+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:35.224 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:34 smithi002 podman[120231]: 2024-06-13 11:37:34.837667853 +0000 UTC m=+0.035257276 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:37:35.224 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:34 smithi002 podman[120231]: 2024-06-13 11:37:34.936576637 +0000 UTC m=+0.134166088 container create 953dac5adf411282c37f55ea54676b3043a37c1b5e122e5972cc6bc2ccee24a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:37:35.224 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:35 smithi002 podman[120231]: 2024-06-13 11:37:35.223851271 +0000 UTC m=+0.421440794 container init 953dac5adf411282c37f55ea54676b3043a37c1b5e122e5972cc6bc2ccee24a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_CLEAN=True, ceph=True) 2024-06-13T11:37:35.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:34 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:34.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:35.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:34 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:34.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:35.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:34 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:34.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:35.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:34 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:34.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:35.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:34 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:34.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:35.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:34 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:34.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:35.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:34 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:34.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:04.287536+0000 front 2024-06-13T11:37:04.287588+0000 (oldest deadline 2024-06-13T11:37:28.987342+0000) 2024-06-13T11:37:35.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:35 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:35.109+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:35.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:35 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:35.109+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:35.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:35 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:35.109+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:35.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:35 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:35.109+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:35.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:35 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:35.109+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:35.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:35 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:35.109+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:35.484 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:35 smithi002 podman[120231]: 2024-06-13 11:37:35.235803399 +0000 UTC m=+0.433392886 container start 953dac5adf411282c37f55ea54676b3043a37c1b5e122e5972cc6bc2ccee24a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-06-13T11:37:35.484 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:35 smithi002 podman[120231]: 2024-06-13 11:37:35.322233141 +0000 UTC m=+0.519822631 container attach 953dac5adf411282c37f55ea54676b3043a37c1b5e122e5972cc6bc2ccee24a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5) 2024-06-13T11:37:35.819 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 11:37:35 smithi002 podman[120231]: 2024-06-13 11:37:35.71417683 +0000 UTC m=+0.911766360 container died 953dac5adf411282c37f55ea54676b3043a37c1b5e122e5972cc6bc2ccee24a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-06-13T11:37:36.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:35 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:35.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:36.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:35 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:35.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:36.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:35 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:35.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:36.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:35 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:35.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:36.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:35 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:35.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:36.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:35 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:35.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:36.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:35 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:35.791+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:04.287536+0000 front 2024-06-13T11:37:04.287588+0000 (oldest deadline 2024-06-13T11:37:28.987342+0000) 2024-06-13T11:37:36.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:36 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:36.099+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:36.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:36 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:36.099+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:36.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:36 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:36.099+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:36.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:36 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:36.099+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:36.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:36 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:36.099+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:36.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:36 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:36.099+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:36.519 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.9.service' 2024-06-13T11:37:36.622 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:37:36.623 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-06-13T11:37:36.623 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-06-13T11:37:36.623 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.10 2024-06-13T11:37:36.945 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:36 smithi077 systemd[1]: Stopping Ceph osd.10 for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:37:36.945 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:36 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:36.797+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:36.945 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:36 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:36.797+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:36.946 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:36 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:36.797+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:36.946 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:36 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:36.797+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:36.946 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:36 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:36.797+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:36.946 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:36 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:36.797+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:36.946 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:36 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:36.797+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:04.287536+0000 front 2024-06-13T11:37:04.287588+0000 (oldest deadline 2024-06-13T11:37:28.987342+0000) 2024-06-13T11:37:36.946 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:36 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:36.945+0000 7f927b4fd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:37:36.946 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:36 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:36.945+0000 7f927b4fd700 -1 osd.10 114 *** Got signal Terminated *** 2024-06-13T11:37:36.946 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:36 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:36.945+0000 7f927b4fd700 -1 osd.10 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T11:37:37.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:37 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:37.054+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:37.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:37 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:37.054+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:37.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:37 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:37.054+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:37.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:37 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:37.054+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:37.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:37 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:37.054+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:37.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:37 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:37.054+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:38.191 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:37 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:37.799+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:38.192 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:37 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:37.799+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:38.192 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:37 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:37.799+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:38.192 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:37 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:37.799+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:38.192 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:37 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:37.799+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:38.192 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:37 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:37.799+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:38.192 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:37 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:37.799+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:04.287536+0000 front 2024-06-13T11:37:04.287588+0000 (oldest deadline 2024-06-13T11:37:28.987342+0000) 2024-06-13T11:37:38.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:38 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:38.081+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:38.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:38 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:38.081+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:38.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:38 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:38.081+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:38.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:38 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:38.081+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:38.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:38 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:38.081+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:38.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:38 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:38.081+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:39.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:38 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:38.809+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:39.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:38 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:38.809+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:39.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:38 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:38.809+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:39.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:38 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:38.809+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:39.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:38 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:38.809+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:39.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:38 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:38.809+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:39.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:38 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:38.809+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:04.287536+0000 front 2024-06-13T11:37:04.287588+0000 (oldest deadline 2024-06-13T11:37:28.987342+0000) 2024-06-13T11:37:39.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:39 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:39.073+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:39.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:39 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:39.073+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:39.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:39 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:39.073+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:39.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:39 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:39.073+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:39.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:39 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:39.073+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:39.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:39 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:39.073+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:40.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:39 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:39.823+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:40.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:39 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:39.823+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:40.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:39 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:39.823+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:40.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:39 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:39.823+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:40.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:39 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:39.823+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:40.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:39 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:39.823+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:40.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:39 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:39.823+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:04.287536+0000 front 2024-06-13T11:37:04.287588+0000 (oldest deadline 2024-06-13T11:37:28.987342+0000) 2024-06-13T11:37:40.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:40 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:40.024+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:40.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:40 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:40.024+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:40.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:40 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:40.024+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:40.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:40 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:40.024+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:40.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:40 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:40.024+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:40.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:40 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:40.024+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:41.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:40 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:40.865+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:41.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:40 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:40.865+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:41.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:40 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:40.865+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:41.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:40 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:40.865+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:41.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:40 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:40.865+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:41.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:40 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:40.865+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:41.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:40 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:40.865+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:04.287536+0000 front 2024-06-13T11:37:04.287588+0000 (oldest deadline 2024-06-13T11:37:28.987342+0000) 2024-06-13T11:37:41.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:41.065+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:41.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:41.065+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:41.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:41.065+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:41.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:41.065+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:41.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:41.065+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:41.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:41 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:41.065+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:42.290 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:41.895+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:13.380825+0000 front 2024-06-13T11:36:13.380934+0000 (oldest deadline 2024-06-13T11:36:38.680494+0000) 2024-06-13T11:37:42.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:41.895+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:21.481999+0000 front 2024-06-13T11:36:21.481893+0000 (oldest deadline 2024-06-13T11:36:46.182018+0000) 2024-06-13T11:37:42.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:41.895+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:32.083103+0000 front 2024-06-13T11:36:32.083127+0000 (oldest deadline 2024-06-13T11:36:56.783134+0000) 2024-06-13T11:37:42.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:41.895+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T11:36:38.484630+0000 front 2024-06-13T11:36:38.484478+0000 (oldest deadline 2024-06-13T11:37:04.384276+0000) 2024-06-13T11:37:42.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:41.895+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:49.685211+0000 front 2024-06-13T11:36:49.685185+0000 (oldest deadline 2024-06-13T11:37:14.985348+0000) 2024-06-13T11:37:42.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:41.895+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:54.985914+0000 front 2024-06-13T11:36:54.986013+0000 (oldest deadline 2024-06-13T11:37:20.885903+0000) 2024-06-13T11:37:42.291 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:41 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10[61115]: 2024-06-13T11:37:41.895+0000 7f9273ae9700 -1 osd.10 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:04.287536+0000 front 2024-06-13T11:37:04.287588+0000 (oldest deadline 2024-06-13T11:37:28.987342+0000) 2024-06-13T11:37:42.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:42 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:42.101+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:42.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:42 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:42.101+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:42.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:42 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:42.101+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:42.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:42 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:42.101+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:42.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:42 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:42.101+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:42.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:42 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:42.101+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:42.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:42 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:42.101+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-06-13T11:37:16.498545+0000 front 2024-06-13T11:37:16.498602+0000 (oldest deadline 2024-06-13T11:37:41.198469+0000) 2024-06-13T11:37:42.790 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:42 smithi077 podman[73954]: 2024-06-13 11:37:42.476777458 +0000 UTC m=+5.656481679 container died d857a7f02f175f0f903ef00905dbfa79f0fd702325d824d99cfd08e89fe1f929 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:37:43.129 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:42 smithi077 podman[73954]: 2024-06-13 11:37:42.879225772 +0000 UTC m=+6.058929993 container cleanup d857a7f02f175f0f903ef00905dbfa79f0fd702325d824d99cfd08e89fe1f929 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=) 2024-06-13T11:37:43.129 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:42 smithi077 bash[73954]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10 2024-06-13T11:37:43.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:43 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:43.113+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:43.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:43 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:43.113+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:43.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:43 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:43.113+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:43.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:43 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:43.113+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:43.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:43 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:43.113+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:43.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:43 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:43.113+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:43.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:43 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:43.113+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-06-13T11:37:16.498545+0000 front 2024-06-13T11:37:16.498602+0000 (oldest deadline 2024-06-13T11:37:41.198469+0000) 2024-06-13T11:37:43.491 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:43 smithi077 podman[73984]: 2024-06-13 11:37:43.130583448 +0000 UTC m=+0.646522655 container remove d857a7f02f175f0f903ef00905dbfa79f0fd702325d824d99cfd08e89fe1f929 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:37:43.782 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:43 smithi077 podman[74071]: 2024-06-13 11:37:43.395470728 +0000 UTC m=+0.016781142 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:37:43.782 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:43 smithi077 podman[74071]: 2024-06-13 11:37:43.506181405 +0000 UTC m=+0.127491806 container create 40471b12be9652c4ca55f7eb2daa88423922b198a802a7ec4809acfb081d4a46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, ceph=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:37:43.782 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:43 smithi077 podman[74071]: 2024-06-13 11:37:43.700187873 +0000 UTC m=+0.321498290 container init 40471b12be9652c4ca55f7eb2daa88423922b198a802a7ec4809acfb081d4a46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10-deactivate, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-06-13T11:37:43.782 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:43 smithi077 podman[74071]: 2024-06-13 11:37:43.703125621 +0000 UTC m=+0.324436023 container start 40471b12be9652c4ca55f7eb2daa88423922b198a802a7ec4809acfb081d4a46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-13T11:37:43.782 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:43 smithi077 podman[74071]: 2024-06-13 11:37:43.783271478 +0000 UTC m=+0.404581886 container attach 40471b12be9652c4ca55f7eb2daa88423922b198a802a7ec4809acfb081d4a46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-06-13T11:37:44.040 INFO:journalctl@ceph.osd.10.smithi077.stdout:Jun 13 11:37:44 smithi077 podman[74071]: 2024-06-13 11:37:43.999729461 +0000 UTC m=+0.621039863 container died 40471b12be9652c4ca55f7eb2daa88423922b198a802a7ec4809acfb081d4a46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:37:44.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:44 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:44.138+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:44.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:44 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:44.138+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:44.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:44 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:44.138+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:44.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:44 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:44.138+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:44.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:44 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:44.138+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:44.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:44 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:44.138+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:44.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:44 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:44.138+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-06-13T11:37:16.498545+0000 front 2024-06-13T11:37:16.498602+0000 (oldest deadline 2024-06-13T11:37:41.198469+0000) 2024-06-13T11:37:44.507 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.10.service' 2024-06-13T11:37:44.544 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:37:44.544 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-06-13T11:37:44.544 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-06-13T11:37:44.544 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.11 2024-06-13T11:37:44.861 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:44 smithi178 systemd[1]: Stopping Ceph osd.11 for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:37:45.182 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:44 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:44.861+0000 7fd074520700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:37:45.182 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:44 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:44.861+0000 7fd074520700 -1 osd.11 114 *** Got signal Terminated *** 2024-06-13T11:37:45.182 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:44 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:44.861+0000 7fd074520700 -1 osd.11 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T11:37:45.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:45 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:45.183+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:45.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:45 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:45.183+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:45.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:45 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:45.183+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:45.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:45 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:45.183+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:45.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:45 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:45.183+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:45.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:45 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:45.183+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:45.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:45 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:45.183+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-06-13T11:37:16.498545+0000 front 2024-06-13T11:37:16.498602+0000 (oldest deadline 2024-06-13T11:37:41.198469+0000) 2024-06-13T11:37:46.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:46 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:46.208+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:46.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:46 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:46.208+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:46.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:46 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:46.208+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:46.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:46 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:46.208+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:46.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:46 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:46.208+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:46.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:46 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:46.208+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:46.698 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:46 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:46.208+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-06-13T11:37:16.498545+0000 front 2024-06-13T11:37:16.498602+0000 (oldest deadline 2024-06-13T11:37:41.198469+0000) 2024-06-13T11:37:47.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:47 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:47.180+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:47.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:47 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:47.180+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:47.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:47 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:47.180+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:47.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:47 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:47.180+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:47.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:47 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:47.180+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:47.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:47 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:47.180+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:47.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:47 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:47.180+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-06-13T11:37:16.498545+0000 front 2024-06-13T11:37:16.498602+0000 (oldest deadline 2024-06-13T11:37:41.198469+0000) 2024-06-13T11:37:47.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:47 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:47.180+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6820 osd.8 since back 2024-06-13T11:37:22.899340+0000 front 2024-06-13T11:37:22.899303+0000 (oldest deadline 2024-06-13T11:37:46.999394+0000) 2024-06-13T11:37:48.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:48 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:48.168+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:48.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:48 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:48.168+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:48.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:48 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:48.168+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:48.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:48 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:48.168+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:48.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:48 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:48.168+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:48.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:48 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:48.168+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:48.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:48 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:48.168+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-06-13T11:37:16.498545+0000 front 2024-06-13T11:37:16.498602+0000 (oldest deadline 2024-06-13T11:37:41.198469+0000) 2024-06-13T11:37:48.448 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:48 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:48.168+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6820 osd.8 since back 2024-06-13T11:37:22.899340+0000 front 2024-06-13T11:37:22.899303+0000 (oldest deadline 2024-06-13T11:37:46.999394+0000) 2024-06-13T11:37:49.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:49.206+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T11:36:12.488400+0000 front 2024-06-13T11:36:12.488486+0000 (oldest deadline 2024-06-13T11:36:37.788345+0000) 2024-06-13T11:37:49.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:49.206+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6804 osd.1 since back 2024-06-13T11:36:24.090940+0000 front 2024-06-13T11:36:24.090785+0000 (oldest deadline 2024-06-13T11:36:49.990816+0000) 2024-06-13T11:37:49.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:49.206+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-13T11:36:31.091805+0000 front 2024-06-13T11:36:31.091655+0000 (oldest deadline 2024-06-13T11:36:56.991863+0000) 2024-06-13T11:37:49.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:49.206+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6812 osd.4 since back 2024-06-13T11:36:50.394330+0000 front 2024-06-13T11:36:50.394349+0000 (oldest deadline 2024-06-13T11:37:13.294380+0000) 2024-06-13T11:37:49.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:49.206+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-13T11:36:56.095515+0000 front 2024-06-13T11:36:56.095567+0000 (oldest deadline 2024-06-13T11:37:20.795629+0000) 2024-06-13T11:37:49.697 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:49.206+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T11:37:05.496904+0000 front 2024-06-13T11:37:05.496945+0000 (oldest deadline 2024-06-13T11:37:28.996675+0000) 2024-06-13T11:37:49.698 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:49.206+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.77:6820 osd.7 since back 2024-06-13T11:37:16.498545+0000 front 2024-06-13T11:37:16.498602+0000 (oldest deadline 2024-06-13T11:37:41.198469+0000) 2024-06-13T11:37:49.698 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:49 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11[62972]: 2024-06-13T11:37:49.206+0000 7fd06cb0c700 -1 osd.11 114 heartbeat_check: no reply from 172.21.15.178:6820 osd.8 since back 2024-06-13T11:37:22.899340+0000 front 2024-06-13T11:37:22.899303+0000 (oldest deadline 2024-06-13T11:37:46.999394+0000) 2024-06-13T11:37:50.610 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:50 smithi178 podman[75927]: 2024-06-13 11:37:50.353192879 +0000 UTC m=+5.612175163 container died c7d729a8adf7a11ce3d1b5f5500f6b321603691ddf2fba0482cb434d20f12136 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11, RELEASE=squid-3d89acc, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-06-13T11:37:50.869 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:50 smithi178 podman[75927]: 2024-06-13 11:37:50.68596307 +0000 UTC m=+5.944945354 container cleanup c7d729a8adf7a11ce3d1b5f5500f6b321603691ddf2fba0482cb434d20f12136 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:37:50.869 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:50 smithi178 bash[75927]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11 2024-06-13T11:37:51.197 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:50 smithi178 podman[75943]: 2024-06-13 11:37:50.870516485 +0000 UTC m=+0.514870724 container remove c7d729a8adf7a11ce3d1b5f5500f6b321603691ddf2fba0482cb434d20f12136 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc) 2024-06-13T11:37:51.630 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:51 smithi178 podman[76033]: 2024-06-13 11:37:51.207951663 +0000 UTC m=+0.017838328 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T11:37:51.631 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:51 smithi178 podman[76033]: 2024-06-13 11:37:51.337446622 +0000 UTC m=+0.147333280 container create fded75af52404900809504862cb94d1cfb680c6763f2ae147c53ea1b0fefe01f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-06-13T11:37:51.631 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:51 smithi178 podman[76033]: 2024-06-13 11:37:51.548336563 +0000 UTC m=+0.358223229 container init fded75af52404900809504862cb94d1cfb680c6763f2ae147c53ea1b0fefe01f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-06-13T11:37:51.631 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:51 smithi178 podman[76033]: 2024-06-13 11:37:51.551294884 +0000 UTC m=+0.361181541 container start fded75af52404900809504862cb94d1cfb680c6763f2ae147c53ea1b0fefe01f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc) 2024-06-13T11:37:51.631 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:51 smithi178 podman[76033]: 2024-06-13 11:37:51.631559529 +0000 UTC m=+0.441446233 container attach fded75af52404900809504862cb94d1cfb680c6763f2ae147c53ea1b0fefe01f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T11:37:51.947 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 13 11:37:51 smithi178 podman[76033]: 2024-06-13 11:37:51.841212756 +0000 UTC m=+0.651099413 container died fded75af52404900809504862cb94d1cfb680c6763f2ae147c53ea1b0fefe01f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=) 2024-06-13T11:37:52.477 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@osd.11.service' 2024-06-13T11:37:52.515 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:37:52.515 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-06-13T11:37:52.516 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-06-13T11:37:52.516 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.a 2024-06-13T11:37:52.895 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 11:37:52 smithi002 systemd[1]: Stopping Ceph mds.a for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:37:53.395 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 11:37:53 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-a[74281]: 2024-06-13T11:37:53.068+0000 7f420b400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:37:53.396 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 11:37:53 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-a[74281]: 2024-06-13T11:37:53.068+0000 7f420b400700 -1 mds.a *** got signal Terminated *** 2024-06-13T11:37:55.574 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 11:37:55 smithi002 podman[120349]: 2024-06-13 11:37:55.281338845 +0000 UTC m=+2.340443191 container died 544f3bb3be50b431d5558d26c70491f0074de33638311c1f45c9634aa37f8651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, ceph=True) 2024-06-13T11:37:55.895 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 11:37:55 smithi002 podman[120349]: 2024-06-13 11:37:55.76793707 +0000 UTC m=+2.827041422 container cleanup 544f3bb3be50b431d5558d26c70491f0074de33638311c1f45c9634aa37f8651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc) 2024-06-13T11:37:55.896 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 11:37:55 smithi002 bash[120349]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-a 2024-06-13T11:37:56.336 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 11:37:56 smithi002 podman[120363]: 2024-06-13 11:37:56.060714531 +0000 UTC m=+0.765144382 container remove 544f3bb3be50b431d5558d26c70491f0074de33638311c1f45c9634aa37f8651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, ceph=True) 2024-06-13T11:37:56.370 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.a.service' 2024-06-13T11:37:56.486 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:37:56.486 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-06-13T11:37:56.486 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-06-13T11:37:56.487 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.d 2024-06-13T11:37:56.895 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 11:37:56 smithi002 systemd[1]: Stopping Ceph mds.d for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:37:57.395 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 11:37:57 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-d[73001]: 2024-06-13T11:37:57.104+0000 7f4b3da00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:37:57.396 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 11:37:57 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-d[73001]: 2024-06-13T11:37:57.104+0000 7f4b3da00700 -1 mds.d *** got signal Terminated *** 2024-06-13T11:38:00.896 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 11:38:00 smithi002 podman[120469]: 2024-06-13 11:38:00.59881482 +0000 UTC m=+3.611339204 container died e39a0ea6b2a6f0cb72e29cdc773160ffee0d7701531baee6324c0ee83c5b5e80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-06-13T11:38:01.282 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 11:38:01 smithi002 podman[120469]: 2024-06-13 11:38:01.021547092 +0000 UTC m=+4.034071487 container cleanup e39a0ea6b2a6f0cb72e29cdc773160ffee0d7701531baee6324c0ee83c5b5e80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-d, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, ceph=True) 2024-06-13T11:38:01.282 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 11:38:01 smithi002 bash[120469]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-d 2024-06-13T11:38:01.645 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 11:38:01 smithi002 podman[120482]: 2024-06-13 11:38:01.281034934 +0000 UTC m=+0.663414077 container remove e39a0ea6b2a6f0cb72e29cdc773160ffee0d7701531baee6324c0ee83c5b5e80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-d, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS) 2024-06-13T11:38:01.815 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.d.service' 2024-06-13T11:38:01.930 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:38:01.931 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-06-13T11:38:01.931 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-06-13T11:38:01.931 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.g 2024-06-13T11:38:02.395 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 11:38:02 smithi002 systemd[1]: Stopping Ceph mds.g for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:38:02.896 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 11:38:02 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-g[73825]: 2024-06-13T11:38:02.534+0000 7f0eb9e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:38:02.896 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 11:38:02 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-g[73825]: 2024-06-13T11:38:02.534+0000 7f0eb9e00700 -1 mds.g *** got signal Terminated *** 2024-06-13T11:38:06.266 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 11:38:05 smithi002 podman[120589]: 2024-06-13 11:38:05.917725376 +0000 UTC m=+3.507324879 container died 2c388cf2f466fd41a3f2f3c78ada8a512be51ebffc12c367b255b0d04c114736 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-g, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True) 2024-06-13T11:38:06.646 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 11:38:06 smithi002 podman[120589]: 2024-06-13 11:38:06.266151833 +0000 UTC m=+3.855751299 container cleanup 2c388cf2f466fd41a3f2f3c78ada8a512be51ebffc12c367b255b0d04c114736 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-g, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-06-13T11:38:06.646 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 11:38:06 smithi002 bash[120589]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-g 2024-06-13T11:38:06.646 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 11:38:06 smithi002 podman[120601]: 2024-06-13 11:38:06.442138808 +0000 UTC m=+0.511994700 container remove 2c388cf2f466fd41a3f2f3c78ada8a512be51ebffc12c367b255b0d04c114736 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-g, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T11:38:07.000 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.g.service' 2024-06-13T11:38:07.113 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:38:07.113 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-06-13T11:38:07.114 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-06-13T11:38:07.114 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.j 2024-06-13T11:38:07.645 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 11:38:07 smithi002 systemd[1]: Stopping Ceph mds.j for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:38:08.145 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 11:38:07 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-j[72592]: 2024-06-13T11:38:07.726+0000 7f0cfc400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:38:08.146 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 11:38:07 smithi002 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-j[72592]: 2024-06-13T11:38:07.726+0000 7f0cfc400700 -1 mds.j *** got signal Terminated *** 2024-06-13T11:38:12.026 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 11:38:11 smithi002 podman[120708]: 2024-06-13 11:38:11.746224159 +0000 UTC m=+4.140432126 container died 7ae3480c5f00ec82752c796e30057ac0a7a39660d5908d1aa9c62f1b51a28183 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-06-13T11:38:12.369 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 11:38:12 smithi002 podman[120708]: 2024-06-13 11:38:12.177707883 +0000 UTC m=+4.571915842 container cleanup 7ae3480c5f00ec82752c796e30057ac0a7a39660d5908d1aa9c62f1b51a28183 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-06-13T11:38:12.370 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 11:38:12 smithi002 bash[120708]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-j 2024-06-13T11:38:12.645 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 11:38:12 smithi002 podman[120735]: 2024-06-13 11:38:12.36996106 +0000 UTC m=+0.605373752 container remove 7ae3480c5f00ec82752c796e30057ac0a7a39660d5908d1aa9c62f1b51a28183 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-j, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-06-13T11:38:12.846 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.j.service' 2024-06-13T11:38:12.946 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:38:12.947 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-06-13T11:38:12.947 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-06-13T11:38:12.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.b 2024-06-13T11:38:13.228 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:38:12 smithi077 systemd[1]: Stopping Ceph mds.b for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:38:13.540 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:38:13 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-b[66612]: 2024-06-13T11:38:13.262+0000 7fa97e05b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:38:13.540 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:38:13 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-b[66612]: 2024-06-13T11:38:13.262+0000 7fa97e05b700 -1 mds.b *** got signal Terminated *** 2024-06-13T11:38:17.537 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:38:17 smithi077 podman[74180]: 2024-06-13 11:38:17.272687113 +0000 UTC m=+4.135854443 container died cb01e210b8eb43ebf9917f1b2738dd03d594d5e28ed580cfa556aff92a50de25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True) 2024-06-13T11:38:17.790 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:38:17 smithi077 podman[74180]: 2024-06-13 11:38:17.611923103 +0000 UTC m=+4.475090432 container cleanup cb01e210b8eb43ebf9917f1b2738dd03d594d5e28ed580cfa556aff92a50de25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T11:38:17.790 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:38:17 smithi077 bash[74180]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-b 2024-06-13T11:38:18.035 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.b.service' 2024-06-13T11:38:18.056 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:38:17 smithi077 podman[74204]: 2024-06-13 11:38:17.804721273 +0000 UTC m=+0.530035774 container remove cb01e210b8eb43ebf9917f1b2738dd03d594d5e28ed580cfa556aff92a50de25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:38:18.056 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:38:18 smithi077 systemd[1]: ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.b.service: Deactivated successfully. 2024-06-13T11:38:18.057 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:38:18 smithi077 systemd[1]: Stopped Ceph mds.b for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:38:18.057 INFO:journalctl@ceph.mds.b.smithi077.stdout:Jun 13 11:38:18 smithi077 systemd[1]: ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.b.service: Consumed 10.822s CPU time. 2024-06-13T11:38:18.070 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:38:18.070 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-06-13T11:38:18.070 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-06-13T11:38:18.070 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.e 2024-06-13T11:38:18.382 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:38:18 smithi077 systemd[1]: Stopping Ceph mds.e for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:38:18.790 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:38:18 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-e[65996]: 2024-06-13T11:38:18.382+0000 7f4159709700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:38:18.790 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:38:18 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-e[65996]: 2024-06-13T11:38:18.382+0000 7f4159709700 -1 mds.e *** got signal Terminated *** 2024-06-13T11:38:22.214 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:38:21 smithi077 podman[74314]: 2024-06-13 11:38:21.875094501 +0000 UTC m=+3.588344340 container died 283d34fc174fb77a3cf8be8a717332d1cac1fbb4c9c89f33de40119725ef49cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-06-13T11:38:22.540 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:38:22 smithi077 podman[74314]: 2024-06-13 11:38:22.315430137 +0000 UTC m=+4.028679977 container cleanup 283d34fc174fb77a3cf8be8a717332d1cac1fbb4c9c89f33de40119725ef49cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:38:22.540 INFO:journalctl@ceph.mds.e.smithi077.stdout:Jun 13 11:38:22 smithi077 bash[74314]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-e 2024-06-13T11:38:22.787 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.e.service' 2024-06-13T11:38:22.818 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:38:22.819 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-06-13T11:38:22.819 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-06-13T11:38:22.819 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.h 2024-06-13T11:38:23.134 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:38:22 smithi077 systemd[1]: Stopping Ceph mds.h for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:38:23.540 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:38:23 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-h[66311]: 2024-06-13T11:38:23.134+0000 7fbbfa867700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:38:23.540 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:38:23 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-h[66311]: 2024-06-13T11:38:23.134+0000 7fbbfa867700 -1 mds.h *** got signal Terminated *** 2024-06-13T11:38:26.290 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:38:25 smithi077 podman[74435]: 2024-06-13 11:38:25.876740165 +0000 UTC m=+2.841780990 container died 509e30ce727e51dca0d7b1c3e92dd022491cec12df694a31c9244d5e4f85755f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-h, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-06-13T11:38:26.693 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:38:26 smithi077 podman[74435]: 2024-06-13 11:38:26.493866938 +0000 UTC m=+3.458907762 container cleanup 509e30ce727e51dca0d7b1c3e92dd022491cec12df694a31c9244d5e4f85755f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-h, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528) 2024-06-13T11:38:26.694 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:38:26 smithi077 bash[74435]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-h 2024-06-13T11:38:26.927 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.h.service' 2024-06-13T11:38:26.946 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:38:26 smithi077 podman[74447]: 2024-06-13 11:38:26.694975159 +0000 UTC m=+0.816399085 container remove 509e30ce727e51dca0d7b1c3e92dd022491cec12df694a31c9244d5e4f85755f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-h, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, GIT_CLEAN=True) 2024-06-13T11:38:26.946 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:38:26 smithi077 systemd[1]: ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.h.service: Deactivated successfully. 2024-06-13T11:38:26.947 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:38:26 smithi077 systemd[1]: Stopped Ceph mds.h for 3611563c-2975-11ef-bc9c-c7b262605968. 2024-06-13T11:38:26.947 INFO:journalctl@ceph.mds.h.smithi077.stdout:Jun 13 11:38:26 smithi077 systemd[1]: ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.h.service: Consumed 2.856s CPU time. 2024-06-13T11:38:26.957 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:38:26.957 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-06-13T11:38:26.958 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-06-13T11:38:26.958 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.k 2024-06-13T11:38:27.288 INFO:journalctl@ceph.mds.k.smithi077.stdout:Jun 13 11:38:27 smithi077 systemd[1]: Stopping Ceph mds.k for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:38:27.540 INFO:journalctl@ceph.mds.k.smithi077.stdout:Jun 13 11:38:27 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-k[65682]: 2024-06-13T11:38:27.288+0000 7f26e4417700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:38:27.540 INFO:journalctl@ceph.mds.k.smithi077.stdout:Jun 13 11:38:27 smithi077 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-k[65682]: 2024-06-13T11:38:27.288+0000 7f26e4417700 -1 mds.k *** got signal Terminated *** 2024-06-13T11:38:31.290 INFO:journalctl@ceph.mds.k.smithi077.stdout:Jun 13 11:38:30 smithi077 podman[74558]: 2024-06-13 11:38:30.964646335 +0000 UTC m=+3.793661878 container died 78b12aa278c91c235635a0f9f4f4806164ae5348bead1ceae1d3afaedb1b2e1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-k, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T11:38:31.597 INFO:journalctl@ceph.mds.k.smithi077.stdout:Jun 13 11:38:31 smithi077 podman[74558]: 2024-06-13 11:38:31.40553417 +0000 UTC m=+4.234549723 container cleanup 78b12aa278c91c235635a0f9f4f4806164ae5348bead1ceae1d3afaedb1b2e1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-k, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T11:38:31.597 INFO:journalctl@ceph.mds.k.smithi077.stdout:Jun 13 11:38:31 smithi077 bash[74558]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-k 2024-06-13T11:38:31.821 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.k.service' 2024-06-13T11:38:31.851 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:38:31.852 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-06-13T11:38:31.852 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-06-13T11:38:31.852 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.c 2024-06-13T11:38:32.164 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:38:31 smithi178 systemd[1]: Stopping Ceph mds.c for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:38:32.424 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:38:32 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-c[68220]: 2024-06-13T11:38:32.164+0000 7f02520d1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:38:32.425 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:38:32 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-c[68220]: 2024-06-13T11:38:32.164+0000 7f02520d1700 -1 mds.c *** got signal Terminated *** 2024-06-13T11:38:34.147 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:38:33 smithi178 podman[76137]: 2024-06-13 11:38:33.876212121 +0000 UTC m=+1.823601026 container died 12b3c48dd414d5fddbb9954165b43ed00417886751a19ae907f27e4d7457b09a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-c, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T11:38:34.447 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:38:34 smithi178 podman[76137]: 2024-06-13 11:38:34.267708127 +0000 UTC m=+2.215097034 container cleanup 12b3c48dd414d5fddbb9954165b43ed00417886751a19ae907f27e4d7457b09a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_CLEAN=True, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-06-13T11:38:34.447 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 13 11:38:34 smithi178 bash[76137]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-c 2024-06-13T11:38:34.637 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.c.service' 2024-06-13T11:38:34.671 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:38:34.672 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-06-13T11:38:34.672 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-06-13T11:38:34.672 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.f 2024-06-13T11:38:35.197 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:38:34 smithi178 systemd[1]: Stopping Ceph mds.f for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:38:35.197 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:38:34 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-f[67919]: 2024-06-13T11:38:34.976+0000 7f17194f7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:38:35.197 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:38:34 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-f[67919]: 2024-06-13T11:38:34.976+0000 7f17194f7700 -1 mds.f *** got signal Terminated *** 2024-06-13T11:38:38.170 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:38:37 smithi178 podman[76271]: 2024-06-13 11:38:37.884862137 +0000 UTC m=+2.987642841 container died 12b63918acceb00128fe58d2776c8eb74ba47118b93f05e2cefdd9224a67725a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-f, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T11:38:38.447 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:38:38 smithi178 podman[76271]: 2024-06-13 11:38:38.252200884 +0000 UTC m=+3.354981588 container cleanup 12b63918acceb00128fe58d2776c8eb74ba47118b93f05e2cefdd9224a67725a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-06-13T11:38:38.447 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 13 11:38:38 smithi178 bash[76271]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-f 2024-06-13T11:38:38.679 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.f.service' 2024-06-13T11:38:38.710 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:38:38.711 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-06-13T11:38:38.711 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-06-13T11:38:38.711 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.i 2024-06-13T11:38:38.946 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:38:38 smithi178 systemd[1]: Stopping Ceph mds.i for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:38:39.447 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:38:39 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-i[68535]: 2024-06-13T11:38:39.055+0000 7f77a4045700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:38:39.447 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:38:39 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-i[68535]: 2024-06-13T11:38:39.055+0000 7f77a4045700 -1 mds.i *** got signal Terminated *** 2024-06-13T11:38:42.164 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:38:41 smithi178 podman[76393]: 2024-06-13 11:38:41.883160084 +0000 UTC m=+2.960597563 container died e59a8171a075afe42bdcfc24d5b5903bfccfbc279e124fdcb749b9d5b00976bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=) 2024-06-13T11:38:42.447 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:38:42 smithi178 podman[76393]: 2024-06-13 11:38:42.247704373 +0000 UTC m=+3.325141850 container cleanup e59a8171a075afe42bdcfc24d5b5903bfccfbc279e124fdcb749b9d5b00976bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-06-13T11:38:42.447 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 13 11:38:42 smithi178 bash[76393]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-i 2024-06-13T11:38:42.670 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.i.service' 2024-06-13T11:38:42.700 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:38:42.700 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-06-13T11:38:42.701 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-06-13T11:38:42.701 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.l 2024-06-13T11:38:43.042 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 13 11:38:42 smithi178 systemd[1]: Stopping Ceph mds.l for 3611563c-2975-11ef-bc9c-c7b262605968... 2024-06-13T11:38:43.420 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 13 11:38:43 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-l[67617]: 2024-06-13T11:38:43.042+0000 7f686ddaa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T11:38:43.420 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 13 11:38:43 smithi178 ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-l[67617]: 2024-06-13T11:38:43.042+0000 7f686ddaa700 -1 mds.l *** got signal Terminated *** 2024-06-13T11:38:44.359 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 13 11:38:44 smithi178 podman[76514]: 2024-06-13 11:38:44.094825378 +0000 UTC m=+1.162813658 container died 6f614becb90e4408cbd2a88db4e7146e9bd2369951a36a75287533019532407b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-l, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T11:38:44.692 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 13 11:38:44 smithi178 podman[76514]: 2024-06-13 11:38:44.459872994 +0000 UTC m=+1.527861273 container cleanup 6f614becb90e4408cbd2a88db4e7146e9bd2369951a36a75287533019532407b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-l, ceph=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-06-13T11:38:44.693 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 13 11:38:44 smithi178 bash[76514]: ceph-3611563c-2975-11ef-bc9c-c7b262605968-mds-l 2024-06-13T11:38:44.842 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3611563c-2975-11ef-bc9c-c7b262605968@mds.l.service' 2024-06-13T11:38:44.872 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T11:38:44.873 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-06-13T11:38:44.873 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3611563c-2975-11ef-bc9c-c7b262605968 --force --keep-logs 2024-06-13T11:38:45.212 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:38:50.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3611563c-2975-11ef-bc9c-c7b262605968 --force --keep-logs 2024-06-13T11:38:50.485 INFO:teuthology.orchestra.run.smithi077.stdout:Deleting cluster with fsid: 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:38:52.918 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3611563c-2975-11ef-bc9c-c7b262605968 --force --keep-logs 2024-06-13T11:38:53.106 INFO:teuthology.orchestra.run.smithi178.stdout:Deleting cluster with fsid: 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:38:55.441 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-13T11:38:55.538 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-13T11:38:55.570 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-13T11:38:55.595 INFO:tasks.cephadm:Archiving crash dumps... 2024-06-13T11:38:55.597 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752830/remote/smithi002/crash 2024-06-13T11:38:55.598 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/crash -- . 2024-06-13T11:38:55.710 INFO:teuthology.orchestra.run.smithi002.stderr:tar: /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/crash: Cannot open: No such file or directory 2024-06-13T11:38:55.711 INFO:teuthology.orchestra.run.smithi002.stderr:tar: Error is not recoverable: exiting now 2024-06-13T11:38:55.716 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752830/remote/smithi077/crash 2024-06-13T11:38:55.717 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/crash -- . 2024-06-13T11:38:55.763 INFO:teuthology.orchestra.run.smithi077.stderr:tar: /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/crash: Cannot open: No such file or directory 2024-06-13T11:38:55.763 INFO:teuthology.orchestra.run.smithi077.stderr:tar: Error is not recoverable: exiting now 2024-06-13T11:38:55.765 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752830/remote/smithi178/crash 2024-06-13T11:38:55.766 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/crash -- . 2024-06-13T11:38:55.809 INFO:teuthology.orchestra.run.smithi178.stderr:tar: /var/lib/ceph/3611563c-2975-11ef-bc9c-c7b262605968/crash: Cannot open: No such file or directory 2024-06-13T11:38:55.809 INFO:teuthology.orchestra.run.smithi178.stderr:tar: Error is not recoverable: exiting now 2024-06-13T11:38:55.810 INFO:tasks.cephadm:Checking cluster log for badness... 2024-06-13T11:38:55.811 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-06-13T11:38:55.921 INFO:tasks.cephadm:Compressing logs... 2024-06-13T11:38:55.922 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-13T11:38:55.926 DEBUG:teuthology.orchestra.run.smithi077:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-13T11:38:55.928 DEBUG:teuthology.orchestra.run.smithi178:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-13T11:38:55.952 INFO:teuthology.orchestra.run.smithi178.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.log 2024-06-13T11:38:55.952 INFO:teuthology.orchestra.run.smithi178.stderr:: No such file or directory 2024-06-13T11:38:55.952 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.2.log 2024-06-13T11:38:55.954 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose --/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.log: /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.f.log 2024-06-13T11:38:55.954 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.audit.log 2024-06-13T11:38:55.954 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.5.log 2024-06-13T11:38:55.955 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.c.log 2024-06-13T11:38:55.955 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.audit.log: /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mon.c.log 2024-06-13T11:38:55.955 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mgr.z.log 2024-06-13T11:38:55.955 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mon.c.log: --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.i.log 2024-06-13T11:38:55.960 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mgr.z.log: 87.8% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.log.gz 2024-06-13T11:38:55.960 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.cephadm.log 2024-06-13T11:38:55.961 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.i.log: 90.2% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.audit.log.gz 2024-06-13T11:38:55.961 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.11.log 2024-06-13T11:38:55.961 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.cephadm.log: 83.7% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.cephadm.log.gz 2024-06-13T11:38:55.961 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.8.log 2024-06-13T11:38:55.962 INFO:teuthology.orchestra.run.smithi077.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory -5 2024-06-13T11:38:55.963 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.log 2024-06-13T11:38:55.963 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.audit.log 2024-06-13T11:38:55.963 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.7.log 2024-06-13T11:38:55.963 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.b.log 2024-06-13T11:38:55.963 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.4.log 2024-06-13T11:38:55.963 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.1.log 2024-06-13T11:38:55.963 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mgr.y.log 2024-06-13T11:38:55.964 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.h.log 2024-06-13T11:38:55.964 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.10.log 2024-06-13T11:38:55.964 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.log.gz/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.h.log: 2024-06-13T11:38:55.964 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.audit.log.gz 2024-06-13T11:38:55.964 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.cephadm.log 2024-06-13T11:38:55.967 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.11.log: 92.2% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mgr.z.log.gz 2024-06-13T11:38:55.967 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-volume.log 2024-06-13T11:38:55.968 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.10.log: 92.1% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mgr.y.log.gz 2024-06-13T11:38:55.969 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.e.log 2024-06-13T11:38:55.969 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-volume.log 2024-06-13T11:38:55.969 INFO:teuthology.orchestra.run.smithi077.stderr: 83.7% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.cephadm.log.gz 2024-06-13T11:38:55.970 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mon.b.log 2024-06-13T11:38:55.977 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.l.log 2024-06-13T11:38:55.984 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.k.log 2024-06-13T11:38:55.986 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.log 2024-06-13T11:38:55.986 INFO:teuthology.orchestra.run.smithi002.stderr:: No such file or directory 2024-06-13T11:38:55.987 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.audit.log 2024-06-13T11:38:55.988 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.g.log 2024-06-13T11:38:55.989 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.j.log 2024-06-13T11:38:55.990 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.3.log 2024-06-13T11:38:55.992 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.0.log 2024-06-13T11:38:55.993 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.log.gz 2024-06-13T11:38:55.993 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-13T11:38:55.995 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.3.log: 90.1% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.audit.log.gz 2024-06-13T11:38:55.995 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mgr.x.log 2024-06-13T11:38:55.995 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mon.a.log 2024-06-13T11:38:55.995 INFO:teuthology.orchestra.run.smithi002.stderr: 94.4% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.g.log.gz 2024-06-13T11:38:55.996 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.6.log 2024-06-13T11:38:55.997 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-13T11:38:55.997 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.k.log: 91.0% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-volume.log.gz 2024-06-13T11:38:55.998 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.cephadm.log 2024-06-13T11:38:55.998 INFO:teuthology.orchestra.run.smithi002.stderr: 94.4% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.j.log.gz 2024-06-13T11:38:55.999 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.l.log: 94.4% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.l.log.gz 2024-06-13T11:38:56.000 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.a.log 2024-06-13T11:38:56.001 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-volume.log 2024-06-13T11:38:56.002 INFO:teuthology.orchestra.run.smithi002.stderr: 84.0% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph.cephadm.log.gz 2024-06-13T11:38:56.003 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.d.log 2024-06-13T11:38:56.006 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-volume.log: /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.9.log 2024-06-13T11:38:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.9.log: 94.3% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.a.log.gz 2024-06-13T11:38:56.014 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/cephadm.log: 91.0% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-volume.log.gz 2024-06-13T11:38:56.014 INFO:teuthology.orchestra.run.smithi178.stderr: 92.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-13T11:38:56.015 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-13T11:38:56.015 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-06-13T11:38:56.015 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/cephadm.log: 94.4% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.k.log.gz 2024-06-13T11:38:56.017 INFO:teuthology.orchestra.run.smithi077.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-13T11:38:56.021 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.admin.log: 91.0% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-volume.log.gz 2024-06-13T11:38:56.023 INFO:teuthology.orchestra.run.smithi002.stderr: 94.2% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.d.log.gz 2024-06-13T11:38:56.024 INFO:teuthology.orchestra.run.smithi002.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-06-13T11:38:56.031 INFO:teuthology.orchestra.run.smithi002.stderr: 94.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-13T11:38:56.229 INFO:teuthology.orchestra.run.smithi077.stderr: 94.8% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.h.log.gz 2024-06-13T11:38:56.240 INFO:teuthology.orchestra.run.smithi077.stderr: 94.4% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.e.log.gz 2024-06-13T11:38:56.456 INFO:teuthology.orchestra.run.smithi002.stderr: 90.0% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mgr.x.log.gz 2024-06-13T11:38:56.566 INFO:teuthology.orchestra.run.smithi077.stderr: 91.7% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mon.b.log.gz 2024-06-13T11:38:56.608 INFO:teuthology.orchestra.run.smithi178.stderr: 91.6% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mon.c.log.gz 2024-06-13T11:38:57.118 INFO:teuthology.orchestra.run.smithi002.stderr: 90.3% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mon.a.log.gz 2024-06-13T11:38:57.490 INFO:teuthology.orchestra.run.smithi178.stderr: 95.2% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.f.log.gz 2024-06-13T11:38:58.401 INFO:teuthology.orchestra.run.smithi077.stderr: 94.4% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.b.log.gz 2024-06-13T11:38:58.632 INFO:teuthology.orchestra.run.smithi077.stderr: 92.2% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.7.log.gz 2024-06-13T11:38:58.870 INFO:teuthology.orchestra.run.smithi002.stderr: 92.4% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.3.log.gz 2024-06-13T11:38:58.953 INFO:teuthology.orchestra.run.smithi178.stderr: 92.4% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.8.log.gz 2024-06-13T11:38:59.031 INFO:teuthology.orchestra.run.smithi178.stderr: 93.0% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.11.log.gz 2024-06-13T11:38:59.076 INFO:teuthology.orchestra.run.smithi077.stderr: 92.6% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.10.log.gz 2024-06-13T11:38:59.258 INFO:teuthology.orchestra.run.smithi077.stderr: 92.7% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.1.log.gz 2024-06-13T11:38:59.272 INFO:teuthology.orchestra.run.smithi178.stderr: 94.5% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.c.log.gz 2024-06-13T11:38:59.285 INFO:teuthology.orchestra.run.smithi002.stderr: 92.7% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.0.log.gz 2024-06-13T11:38:59.371 INFO:teuthology.orchestra.run.smithi178.stderr: 92.6% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.2.log.gz 2024-06-13T11:38:59.443 INFO:teuthology.orchestra.run.smithi002.stderr: 92.6% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.6.log.gz 2024-06-13T11:38:59.643 INFO:teuthology.orchestra.run.smithi002.stderr: 92.5% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.9.log.gz 2024-06-13T11:38:59.647 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-06-13T11:38:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m3.688s 2024-06-13T11:38:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m13.835s 2024-06-13T11:38:59.647 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m1.159s 2024-06-13T11:38:59.897 INFO:teuthology.orchestra.run.smithi077.stderr: 92.7% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.4.log.gz 2024-06-13T11:38:59.899 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-06-13T11:38:59.899 INFO:teuthology.orchestra.run.smithi077.stderr:real 0m3.956s 2024-06-13T11:38:59.899 INFO:teuthology.orchestra.run.smithi077.stderr:user 0m16.103s 2024-06-13T11:38:59.899 INFO:teuthology.orchestra.run.smithi077.stderr:sys 0m0.540s 2024-06-13T11:39:00.723 INFO:teuthology.orchestra.run.smithi178.stderr: 92.5% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-osd.5.log.gz 2024-06-13T11:39:10.061 INFO:teuthology.orchestra.run.smithi178.stderr: 93.3% -- replaced with /var/log/ceph/3611563c-2975-11ef-bc9c-c7b262605968/ceph-mds.i.log.gz 2024-06-13T11:39:10.063 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-06-13T11:39:10.063 INFO:teuthology.orchestra.run.smithi178.stderr:real 0m14.120s 2024-06-13T11:39:10.063 INFO:teuthology.orchestra.run.smithi178.stderr:user 0m32.855s 2024-06-13T11:39:10.063 INFO:teuthology.orchestra.run.smithi178.stderr:sys 0m0.984s 2024-06-13T11:39:10.063 INFO:tasks.cephadm:Archiving logs... 2024-06-13T11:39:10.064 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752830/remote/smithi002/log 2024-06-13T11:39:10.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-13T11:39:12.140 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752830/remote/smithi077/log 2024-06-13T11:39:12.140 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-13T11:39:14.301 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752830/remote/smithi178/log 2024-06-13T11:39:14.302 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-13T11:39:19.261 INFO:tasks.cephadm:Removing cluster... 2024-06-13T11:39:19.262 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3611563c-2975-11ef-bc9c-c7b262605968 --force 2024-06-13T11:39:19.612 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:39:20.332 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3611563c-2975-11ef-bc9c-c7b262605968 --force 2024-06-13T11:39:20.522 INFO:teuthology.orchestra.run.smithi077.stdout:Deleting cluster with fsid: 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:39:20.794 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3611563c-2975-11ef-bc9c-c7b262605968 --force 2024-06-13T11:39:20.984 INFO:teuthology.orchestra.run.smithi178.stdout:Deleting cluster with fsid: 3611563c-2975-11ef-bc9c-c7b262605968 2024-06-13T11:39:21.285 INFO:tasks.cephadm:Removing cephadm ... 2024-06-13T11:39:21.285 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-13T11:39:21.334 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-13T11:39:21.350 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-13T11:39:21.365 INFO:tasks.cephadm:Teardown complete 2024-06-13T11:39:21.365 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-13T11:39:21.377 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-13T11:39:21.377 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-13T11:39:21.385 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-13T11:39:21.392 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-13T11:39:21.536 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-13T11:39:21.547 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-13T11:39:21.547 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-13T11:39:21.555 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-13T11:39:21.557 DEBUG:teuthology.orchestra.run.smithi178:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-13T11:39:21.568 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-06-13T11:39:21.570 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 1: ntpq: command not found 2024-06-13T11:39:21.572 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-13T11:39:21.573 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-06-13T11:39:21.573 INFO:teuthology.orchestra.run.smithi077.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 +1870us[+1859us] +/- 44ms 2024-06-13T11:39:21.573 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 5 -980us[ -991us] +/- 79ms 2024-06-13T11:39:21.573 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 -1733us[-1743us] +/- 75ms 2024-06-13T11:39:21.573 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:39:21.575 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-13T11:39:21.575 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2024-06-13T11:39:21.575 INFO:teuthology.orchestra.run.smithi178.stdout:^* hv01.front.sepia.ceph.com 3 6 377 4 +1874us[+1866us] +/- 44ms 2024-06-13T11:39:21.575 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 -997us[-1005us] +/- 79ms 2024-06-13T11:39:21.576 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 -1729us[-1729us] +/- 75ms 2024-06-13T11:39:21.576 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:39:21.600 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-06-13T11:39:21.609 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-13T11:39:21.610 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-06-13T11:39:21.610 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 +1824us[+1828us] +/- 44ms 2024-06-13T11:39:21.610 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 -1051us[-1048us] +/- 79ms 2024-06-13T11:39:21.610 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 -1788us[-1788us] +/- 75ms 2024-06-13T11:39:21.610 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T11:39:21.611 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-13T11:39:21.624 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-13T11:39:21.625 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-13T11:39:21.807 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-13T11:39:22.024 DEBUG:teuthology.orchestra.run.smithi077:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-13T11:39:22.088 DEBUG:teuthology.orchestra.run.smithi178:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-13T11:39:22.159 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-13T11:39:22.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T11:39:22.256 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-13T11:39:22.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T11:39:22.282 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-13T11:39:22.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T11:39:22.309 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-13T11:39:22.320 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-13T11:39:22.348 INFO:teuthology.task.internal:Duration was 2404.087402 seconds 2024-06-13T11:39:22.349 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-13T11:39:22.382 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-13T11:39:22.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-13T11:39:22.388 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-13T11:39:22.390 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-13T11:39:22.424 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-13T11:39:22.427 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-13T11:39:22.538 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-13T11:39:22.994 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-13T11:39:22.994 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T11:39:22.994 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-13T11:39:23.062 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2024-06-13T11:39:23.081 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-13T11:39:23.108 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi178.front.sepia.ceph.com 2024-06-13T11:39:23.108 DEBUG:teuthology.orchestra.run.smithi178:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-13T11:39:23.131 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-13T11:39:23.132 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-13T11:39:23.139 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-13T11:39:23.150 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-13T11:39:23.218 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-13T11:39:23.219 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-13T11:39:23.223 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-13T11:39:23.226 DEBUG:teuthology.orchestra.run.smithi178:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-13T11:39:24.330 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-13T11:39:24.342 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-13T11:39:24.342 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-13T11:39:24.422 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-13T11:39:24.451 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-13T11:39:24.480 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-13T11:39:24.494 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-13T11:39:24.502 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-13T11:39:24.504 DEBUG:teuthology.orchestra.run.smithi178:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-13T11:39:24.527 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2024-06-13T11:39:24.546 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = core 2024-06-13T11:39:24.597 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-06-13T11:39:24.819 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-13T11:39:24.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T11:39:24.877 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-13T11:39:24.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T11:39:24.894 DEBUG:teuthology.orchestra.run.smithi178:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-13T11:39:24.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T11:39:24.912 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-13T11:39:24.923 INFO:teuthology.task.internal:Transferring archived files... 2024-06-13T11:39:24.924 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752830/remote/smithi002 2024-06-13T11:39:24.924 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-13T11:39:25.045 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752830/remote/smithi077 2024-06-13T11:39:25.045 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-13T11:39:25.084 DEBUG:teuthology.misc:Transferring archived files from smithi178:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752830/remote/smithi178 2024-06-13T11:39:25.085 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-13T11:39:25.125 INFO:teuthology.task.internal:Removing archive directory... 2024-06-13T11:39:25.125 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-13T11:39:25.133 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-13T11:39:25.135 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-13T11:39:25.185 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-13T11:39:25.198 INFO:teuthology.task.internal:Not uploading archives. 2024-06-13T11:39:25.198 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-13T11:39:25.290 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-13T11:39:25.290 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-13T11:39:25.298 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-13T11:39:25.301 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-13T11:39:25.316 INFO:teuthology.orchestra.run.smithi077.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 13 11:39 /home/ubuntu/cephtest 2024-06-13T11:39:25.318 INFO:teuthology.orchestra.run.smithi178.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 13 11:39 /home/ubuntu/cephtest 2024-06-13T11:39:25.352 INFO:teuthology.orchestra.run.smithi002.stdout: 393926 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 13 11:39 /home/ubuntu/cephtest 2024-06-13T11:39:25.356 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-13T11:39:25.410 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-13T11:39:25.733 INFO:teuthology.run:Summary data: client.0-kernel-sha1: ff88c41504f3e4c4268de18904a6f347f1b3f2d6 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/fsx}} duration: 2404.0874021053314 failure_reason: 'Command failed (workunit test suites/fsx.sh) on smithi002 with status 2: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1373963c202323287783ccb099bbae1ec8f14a5d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh''' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9ba828c1029b47bab9200634099bb160 status: fail success: false 2024-06-13T11:39:25.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-13T11:39:25.815 INFO:teuthology.run:FAIL